Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.
Rust
Commits on main
feat(launch): startup-timing breakdown and faster AUTO backend-format detection (#70)
9dcccfe Elyas Mehtabuddin committed 4 months ago
feat(switchyard-translation): add neutral-IR encode/decode helpers (#77)
8b8dad8 Greg Clark committed 4 months ago
chore(libsy): move Decision/RoutedLlmClient traits to protocol (#76)
694aa27 Greg Clark committed 4 months ago
chore: bump benchmark agent harness pins to current releases (#83)
ce7bead ryan-lempka committed 4 months ago
chore(libsy): move random routing algorithm into core (#81)
320aa00 Ayush Agarwal committed 4 months ago
chore: Provide a default impl for `process_signals`. (#80)
ac5ecf7 Graham King committed 4 months ago
feat(router): add escalation_router profile with judge-latched strong/weak routing (#62)
b03b6a6 Lin Jia committed 4 months ago
chore(rust): prepare translation crates for publishing (#72)
8675f8c nachiketb-nvidia committed 4 months ago
feat(latency): pass route-selection spend metadata to LiteLLM (#54)
e62fe46 eric-liu-nvidia committed 4 months ago
chore(swithyard-server): Output /v1/messages and /v1/responses sample curl (#65)
c995077 Graham King committed 4 months ago
refactor(libsy): use conversation IR request and response types (#58)
64d02db nachiketb-nvidia committed 4 months ago
chore(server): Remove two unused functions, make others private (#52)
1a98edb Graham King committed 4 months ago
feat(benchmark): add terminal-bench 2.1 dataset support (#45)
8fba1be Ayush Agarwal committed 4 months ago
chore: remove detect-secrets in favor of GitHub secret scanning (#43)
072ae3e ryan-lempka committed 4 months ago
feat(stats): track max observed context tokens per model (#24)
bacab4c Aloys Baillet committed 4 months ago
feat(latency-service): credential policy, request-type routing, metric attribution, response fidelity, and shared session-affinity store (#28)
6a9942c eric-liu-nvidia committed 4 months ago
chore(config): enable LLM and codex_cli conflict-resolution tiers in sir-merge-a-lot config (#34)
08490b4 nv-msvoboda committed 4 months ago
chore: require switchyard_team code-owner review via CODEOWNERS (#29)
266fd33 ryan-lempka committed 4 months ago