Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.
Rust
Commits on main
fix(translation): preserve logprobs in normalized Chat requests (#987)
0ae4384 GDRS committed 1 month ago
feat(composite): support custom-schema classifiers in composite routing (#1022)
9c0924f Ayush Agarwal committed 1 month ago
feat(observability): expose translation diagnostics (#608)
a955171 Clement Pakkam Isaac committed 1 month ago
docs(benchmark): add Jev routing profile and README results (#1007)
4cbb2d1 nachiketb-nvidia committed 1 month ago
revert(vgr)!: remove trusted capability derivation (#1011)
ce7edef Ayush Agarwal committed 1 month ago
feat: upgrade dev server to use Composite + Decision (#1010)
5a5bff2 Graham King committed 1 month ago
feat(llm-client): allow disabling fallback on rate limits (#1004)
9ee35cb Elias Shieh committed 1 month ago
feat(runner): list a config's credential variables without reading their values (#972)
c6f6b0d Elyas Mehtabuddin committed 1 month ago
fix(server): report stage-router stats for a composite route (#943)
1e09969 Dmitry Voropaev committed 1 month ago
fix: treat llama.cpp exceed-context errors as overflow (#939)
a0ece87 Dmitry Voropaev committed 1 month ago
fix(routing): select composite stage policy from the classified tier (#1009)
f3baf43 ryan-lempka committed 1 month ago
feat(server): record the turn ID in the routing log (#971)
7f0602d Elyas Mehtabuddin committed 1 month ago
fix(runner): stop printing API keys in api_key_env errors (#970)
38a71ed Elyas Mehtabuddin committed 1 month ago
fix(protocol): normalize Anthropic's refusal stop reason when streaming (#941)
8e7d72b Dmitry Voropaev committed 1 month ago
fix(translation): preserve OpenAI Chat refusal text (#623)
286425e Atharva-Kanherkar committed 1 month ago
fix(translation): finish Codex tool calls through a LiteLLM gateway (#969)
f6441cc Elyas Mehtabuddin committed 1 month ago
fix(translation): return HTTP 502 for buffered Chat abort, error and repetition finish reasons (#884)
9a6d26d Colin McNamara committed 1 month ago
feat(protocol): represent MCP tools and backend history (#993)
ab7d264 David Gardner committed 1 month ago
feat(stage-router): let clean production resolve to the efficient tier (#984)
34c8e90 sabhatinas committed 1 month ago
feat(routing): support decision models in composite routes (#981)
7fa4b00 ryan-lempka committed 1 month ago