Skip to content

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

Rust

Commits on main

84eb8f0
feat(server): configure prefill routing (#616)
nachiketb-nvidia committed 2 months ago
cf95817
feat(prefill-router): add libsy algorithm wrapper (#593)
nachiketb-nvidia committed 2 months ago
bbaa05c
ci(release): publish switchyard-runner (#614)
Bryan Bednarski committed 2 months ago
e6bced8
fix(translation): preserve Anthropic tool strictness (#585)
Clement Pakkam Isaac committed 2 months ago
7a72c06
bb011ca
477ad1f
build(benchmark): Update two scripts (#589)
Graham King committed 2 months ago
035d702
feat(prefill-router): run batched prefill inference (#539)
nachiketb-nvidia committed 2 months ago
aa98c82
c597bfd
3ad6855
fix(libsy): in-flight algo count metric (#576)
Greg Clark committed 2 months ago
17b0ff6
fix(libsy): upstream sse error prop (#573)
Greg Clark committed 2 months ago
4fb3251
chore: Update PR template (#575)
Graham King committed 2 months ago
27fc1ce
8ebed5b
463a62c
fix(libsy): client disconnect logging (#555)
Greg Clark committed 2 months ago
77af9b6
chore: Update github_last_night.sh (#562)
Graham King committed 2 months ago
7f3b2fe
b73dd6f
0e031c4