Skip to content

7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.

TypeScript

Commits on main

chore: prep v0.6.0 release (#611)
Tashfeen committed 3 months ago
27b3410
Add ModelScope provider (#581)
Tashfeen committed 3 months ago
b05b2f8
Trim README provider catalog
Tashfeen committed 4 months ago
526c863
edf219d
chore: prep v0.5.0 release (#562)
Tashfeen committed 4 months ago
4ba0159
Add SEA-LION provider (#559)
Tashfeen committed 4 months ago
a0a1530
Respect NavyAI shared token cap (#545)
Tashfeen committed 4 months ago
e7b74a5
Fix provider timeouts and Gemma quirks
Tashfeen committed 4 months ago
6bac519
Fix routing chain semantics
Tashfeen committed 4 months ago
8ad9010
Update README catalog totals
Tashfeen committed 4 months ago
3d782d3
Add NavyAI provider support
Tashfeen committed 4 months ago
406abd8