7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.
TypeScript
Commits on main
fix: harden 7/11 features — disconnect misclassification, JSON heal, breaker, MCP, wake flush (#528)
90c84da Tashfeen committed 4 months ago
fix(providers): 60s chat timeout for zhipu, agnes, cloudflare (reasoning-model TTFB) (#521)
e3fdd3b Tashfeen committed 4 months ago
fix(gateway): permissive json_schema upgrade needs properties:{} (Reka 503s on a bare object schema) (#520)
8d0e167 Tashfeen committed 4 months ago
fix(gateway): param-policy tuning from the live all-provider sweep (#519)
a9a0f31 Tashfeen committed 4 months ago
feat(gateway): client-disconnect abort + X-Fallback-Trail on every surface (#518)
970de63 Tashfeen committed 4 months ago
feat(server): MCP server at /mcp - gateway introspection for coding agents (#517)
2094ea0 Tashfeen committed 4 months ago
feat(gateway): structured-output fallback handling - routing filter, JSON healing, format-ignore failover (#516)
c8444a0 Tashfeen committed 4 months ago
feat(server): post-sleep wake recovery - drift detection, socket flush, immediate key re-probe (#515)
7c8971c Tashfeen committed 4 months ago
feat(gateway): forward structured outputs + extended sampling params to providers (#514)
407001c Tashfeen committed 4 months ago
docs(readme): surface undocumented features, agent recipes, current provider count (#512)
e7c1a39 Tashfeen committed 4 months ago
feat(gateway): request guardrails - per-request token budget + failover circuit breaker (#511)
cdce07d Tashfeen committed 4 months ago
Merge pull request #493 from tashfeenahmed/agent/fix-gemini-thought-signatures
83dc9b8 Tashfeen committed 4 months ago
feat(client): collapse Router pressure by default, split analytics stat cards into two rows (#485)
9858eee Tashfeen committed 4 months ago
feat(gateway): fallback hardening pack (401 rotation, rich exhaustion, daily-quota bench, truncation policy, retry budget, usage fallback) (#484)
e57a0f8 Tashfeen committed 4 months ago
refactor(gateway): unify the four provider fallback loops, fix drift (#482 base) (#483)
940986c Tashfeen committed 4 months ago
feat(docs): self-hosted OpenAPI reference at /v1/docs and /v1/openapi.json (#482)
d0f2768 Tashfeen committed 4 months ago
docs(readme): credit issue diagnosers iisyw, xsfhacg, noobix (#480)
ddd6ebe Tashfeen committed 4 months ago
fix(routing): multi-key quota fixes for #470, #454, #456, #453 (#479)
a2d2a54 Tashfeen committed 4 months ago
fix(custom): tool-capable custom models + provider label in models list (#470, #469) (#478)
012ba7a Tashfeen committed 4 months ago
security: first-run setup code, key file out of the DB, CSV export hardening (#477)
a66f752 Tashfeen committed 4 months ago
docs(readme): credit 4riful, cagedbird043, fix2015 in Contributors (#476)
a07a410 Tashfeen committed 4 months ago
refactor(db): introduce Db/DbStatement/DbFactory interfaces (#397)
4a558d9 LoneRifle committed 4 months ago
fix: sticky session map grows unbounded between prune passes (#475)
918378e Semianchuk Vitalii committed 4 months ago