Skip to content

7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.

TypeScript

Commits on main

Make the headroom guardrail thresholds tunable (#989)
suantea (asuan_suan) committed 2 months ago
547692a
Add a least-remaining key selection strategy (#930)
suantea (asuan_suan) committed 2 months ago
c4c0221
Show time-window rate-limit usage badges in the model table (#921)
suantea (asuan_suan) committed 2 months ago
065a9cd
Add an opt-in peak-hours routing adjustment (#909)
suantea (asuan_suan) committed 2 months ago
f9af5f7
Add catalog-routed video generation (#998)
Tashfeen committed 2 months ago
60f3e70
4cb8d38
Add database backups with safe restore (#999)
Tashfeen committed 2 months ago
a9b8774
c7b4d45
Normalize default-valued sampling params in the cache key (#901)
suantea (asuan_suan) committed 2 months ago
d03021e
chore(cli): release 0.5.0 (setup-dsh) (#996)
Tashfeen committed 2 months ago
db0b1b6
291556d
aa636f7