7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.
TypeScript
Commits on main
Fix a batch of routing, streaming, and deployment quick wins (#941)
a9895bc Tashfeen committed 3 months ago
feat(i18n): explain RPM/RPD/TPM/TPD in the field tooltips (#870) (#938)
20d41b3 Tashfeen committed 3 months ago
fix(anthropic): list Claude-family ids so gateway pickers find models (#880) (#937)
ee48773 Tashfeen committed 3 months ago
feat(providers): add Qianfan, Volcengine Ark, LongCat and iFlytek Spark (#936)
df1000a Tashfeen committed 3 months ago
feat(server): degraded-mode state machine (#904) (#906)
f412e97 suantea (asuan_suan) committed 3 months ago
feat(ui): merge custom-provider model aliases into a unified model (#790) (#868)
530cd37 suantea (asuan_suan) committed 3 months ago
fix(modelscope): stop health checks from burning magic-grain quota (#882)
473d790 ZER0-auto committed 3 months ago
feat(fusion): support vision (image) requests via vision-capable panel (#884)
7b54a77 Icesenator committed 3 months ago
feat(ui): search and provider filter for the explicit Fusion panel (#872) (#883)
5f42c27 suantea (asuan_suan) committed 3 months ago
fix: classify Zhipu "Prompt exceeds max length" 400 as context_too_large (#873) (#893)
15a73e2 Ben Younes committed 3 months ago
fix(probe): raise the probe max_tokens above the floor relays enforce (#903)
49a6db6 Tashfeen committed 3 months ago
fix(models): show the canonical model id on the model detail page (#725)
9484c64 suantea (asuan_suan) committed 3 months ago
feat(contributing): optional commit checklist hook for Claude Code (#860)
30480ed OhOkThisIsFine committed 3 months ago
fix(media): support model-specific FLUX image payloads (#916)
81ddd98 Tashfeen committed 3 months ago
feat(proxy): add a Test button for the outbound proxy settings (#864)
a8db049 suantea (asuan_suan) committed 3 months ago
feat(cli): freellmapi doctor — prove a client's requests reach this gateway (#862)
1129fc4 OhOkThisIsFine committed 3 months ago
fix(cli): resolve --model against the unfiltered catalog before launching (#861)
c942352 OhOkThisIsFine committed 3 months ago
chore(server): assert the pure lib modules never gain a value import (#858)
4a47b3a OhOkThisIsFine committed 3 months ago
feat(providers): add OrcaRouter (free rate-limited aliases) (#896)
fba4b3d Tashfeen committed 3 months ago
fix(tests): bind test servers to the loopback address they are called on (#888)
37ce9ac Tashfeen committed 3 months ago
chore: point the lockfile at the public registry and de-duplicate a contributor (#886)
bfb2596 Tashfeen committed 3 months ago
feat(fallback): abort stalled attempts when the retry time budget expires (hedging) (#828)
1d2226a suantea (asuan_suan) committed 3 months ago
fix(routing): fail over on a relay's bare "safe"/"unsafe" classification output (#809) (#830)
a961d93 suantea (asuan_suan) committed 3 months ago