7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.
TypeScript
Commits on main
perf(cache): batch hit_count persistence instead of one UPDATE per hit (#1319)
aed4c66 suantea (asuan_suan) committed 1 month ago
fix(router): clamp max_tokens to the model's remaining context budget (#1217)
5bf71fd Chong Jia Zhen committed 1 month ago
fix(fallback): bench a route whose in-band error arrives only after most of the budget (#1268)
786f3b4 suantea (asuan_suan) committed 1 month ago
feat(config): declarative first-run admin account and Premium license (#1291)
c659a4c levonk committed 1 month ago
feat(fallback): jump-to-rank, type a destination instead of dragging (#1324)
7ccef91 tashdroid committed 1 month ago
chore(deps): bump docker/setup-buildx-action from 4.3.0 to 4.4.1 (#1321)
158c70d dependabot[bot] committed 1 month ago
chore(deps): bump docker/build-push-action from 7.3.0 to 7.4.0 (#1322)
1ad145f dependabot[bot] committed 1 month ago
fix(keys): two-step confirm before revoking the unified API key (#1316)
40d3b18 tashdroid committed 1 month ago
fix(media): relay the upstream Retry-After on image/video/speech/transcription (#1312)
1346b7d tashdroid committed 1 month ago
fix(embeddings): relay the upstream Retry-After to the client (#1311)
e41d159 tashdroid committed 1 month ago
fix(analytics): stop auth/timeout errors landing in 'Other' on the error chart (#1308)
b5d8333 tashdroid committed 1 month ago
Keep CSV labels on import (export/import round trip no longer renames keys) (#1303)
de343c0 tashdroid committed 1 month ago
Direct signup links on onboarding checklist chips (#1225) (#1299)
15c3008 tashdroid committed 1 month ago
fix(cli): say 'needs Node 20' instead of dying on old Node (#1283) (#1295)
a143971 tashdroid committed 1 month ago
fix(routing): budget sort parsed '40 RPM' as a 40M-token budget (#1292)
8aa17cd tashdroid committed 1 month ago
fix(providers): send a User-Agent to Septor Labs and CLōD, treat a Cloudflare challenge as inconclusive (#1298) (#1301)
fa12008 Tashfeen committed 1 month ago
feat(chains): rename a custom fallback chain in place (#1179) (#1284)
37f07fd tashdroid committed 2 months ago
fix(server): CSV import drops rows whose quoted label has a comma or quote (#1290)
998ab9c tashdroid committed 2 months ago
fix(providers): report a truncated Gemini stream instead of a clean stop (#1288)
1d70b75 tashdroid committed 2 months ago
fix(auth): stop a same-host reverse proxy from waiving the setup code (#1287)
5f9645c tashdroid committed 2 months ago
fix(auth): close both gaps that left login brute-force unthrottled (#1286)
9c0842c tashdroid committed 2 months ago
fix(emulation): stop a failed Gemini/Ollama request from exiting the process (#1285)
48153ea tashdroid committed 2 months ago
fix(fallback): stop the digits 402 in a token count benching a whole provider, let ACLIDE errors fail over (#1282)
b882473 Tashfeen committed 2 months ago
fix(update): compare desktop installs against the latest release tag (#1279)
6c812a6 Tashfeen committed 2 months ago
fix: make fallback retry budgets endpoint TTFB-aware (#1262) (#1272)
8ee41bb Inference_ committed 2 months ago