Skip to content

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

Rust
2.2 KB
Raw Blame

Tuning

Tuning helps you find a configuration that meets your goals on your workload. Start with Foundations to check your current route and plan the comparison, then use Examples to see how to evaluate candidates and choose a configuration.

  • Tuning Foundations: check your current route, then define your objective, candidates, and evaluation splits.
  • Examples: compare routing settings and model pairs with worked examples, and check the efficient model when overrides dominate.

Controls by algorithm

Examples walks through the stage router. Each algorithm has its own controls:

Related