7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.
TypeScript
Commits on main
feat(custom): register multiple models per endpoint in one submit (#281) (#300)
888d653 Tashfeen committed 5 months ago
fix(cloudflare): verify account-scoped tokens via /accounts/{id}/tokens/verify (#297) (#298)
e94b2c9 Tashfeen committed 5 months ago
Merge pull request #291 from tashfeenahmed/fix/groq-tool-use-failed-rescue
76e50cf Tashfeen committed 5 months ago
fix(proxy): rescue Groq-style tool_use_failed 400s into structured tool_calls (#264)
2d18965 Tashfeen committed 5 months ago
Merge pull request #290 from tashfeenahmed/fix/proxy-undici-ci
0e10c73 Tashfeen committed 5 months ago
fix(proxy): lazy-load undici + pin to ^6 so CI/Node 20 doesn't crash on import
5113836 Tashfeen committed 5 months ago
Merge pull request #289 from tashfeenahmed/feat/models-availability
00d12a7 Tashfeen committed 5 months ago
feat(models): /v1/models returns full catalog with per-model availability (#287)
f1a58c2 Tashfeen committed 5 months ago
Merge pull request #286 from tashfeenahmed/feat/outbound-proxy-rebased
2dc9967 Tashfeen committed 5 months ago
docs: credit @Slyker (outbound proxy #231) and @wells1013 (parallel #266)
439fb54 Tashfeen committed 5 months ago
test(proxy): cover proxyFetch routing — passthrough, dispatcher, bypass, disabled
fd28786 Tashfeen committed 5 months ago
fix(client): type the proxy-settings mutation response (post-rebase tsc)
48107ad Tashfeen committed 5 months ago
Merge remote-tracking branch 'origin/main' into feat/outbound-proxy-rebased
f36aaf7 Tashfeen committed 5 months ago
Merge pull request #285 from tashfeenahmed/fix/google-validatekey-taxonomy
41525d1 Tashfeen committed 5 months ago
fix(google): correct validateKey error taxonomy so good keys aren't auto-disabled (#268)
d87a717 Tashfeen committed 5 months ago
Merge pull request #280 from tashfeenahmed/chore/context-handoff-followups
16cf7f4 Tashfeen committed 5 months ago
Merge pull request #279 from immanuelsavio/feat/context-handoff
c1947b2 Tashfeen committed 5 months ago
feat(proxy): add optional context handoff on model switch
baddaeb _Algorithm_Kid98 committed 5 months ago
fix(google): cache Gemini thoughtSignature so multi-turn tool calls survive OpenAI-format clients (#278)
c721752 Tashfeen committed 5 months ago
Merge pull request #277 from tashfeenahmed/feat/catalog-boot-reapply
c47216b Tashfeen committed 5 months ago
feat(catalog-sync): re-apply the cached catalog on every boot
2410f87 Tashfeen committed 5 months ago
Merge pull request #276 from tashfeenahmed/chore/tidy-catalog-comments
5f3c066 Tashfeen committed 5 months ago
Merge pull request #275 from tashfeenahmed/fix/catalog-data-distribution
24a01c4 Tashfeen committed 5 months ago
fix(catalog): model data lives in the hosted catalog, not app migrations
d3b1f2d Tashfeen committed 5 months ago
Merge pull request #274 from tashfeenahmed/feat/recurring-free-audit-v26
4d47c55 Tashfeen committed 5 months ago
feat(catalog): June 2026 recurring-free audit (V26) — OVH platform, NIM correction, Cerebras limits
e403bc5 Tashfeen committed 5 months ago
Merge pull request #273 from tashfeenahmed/fix/export-stdout-purity
297e8ea Tashfeen committed 5 months ago