Skip to content

7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.

TypeScript

Commits on main

feat(quota): durable per-key monthly budget caps (#1159)
suantea (asuan_suan) committed 2 months ago
0fed6d0
616fdd0
feat(quota): forecast scoped request rates and exhaustion (#1157)
suantea (asuan_suan) committed 2 months ago
cf6047f
feat(keys): show working quick-start examples (#1052)
suantea (asuan_suan) committed 2 months ago
763872f
README: credit efcunha (#1143) (#1208)
Tashfeen committed 2 months ago
87fe9ae
Fix/depleted models visual (#1190)
nicyoong committed 2 months ago
f16de43
b714ac4
fe0f1c4
b9a34b0
Release v0.9.9 (#1198)
Tashfeen committed 2 months ago
780a7d8
dd3d1e9
Release v0.9.8 (#1172)
Tashfeen committed 2 months ago
83562ad