7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.
TypeScript
Commits on main
feat(desktop): Show Compact Panel tray menu item on Windows (#1419)
48e63e9 suantea (asuan_suan) committed 1 month ago
fix(ci): use a public registry mirror for Docker builds (#1456)
39a0ff6 Tashfeen committed 1 month ago
feat(providers): Inferbase, SimpleLLM and ElectronHub embeddings (#1455)
3f131f0 Tashfeen committed 1 month ago
feat(keys): custom endpoint groups with #group routing (#1176) (#1371)
fbfb5e6 suantea (asuan_suan) committed 1 month ago
feat(routing): configurable minimum-reliability floor to drop flaky models (#filter) (#1309)
2c8bd75 suantea (asuan_suan) committed 1 month ago
feat(moderations): /v1/moderations endpoint (OpenAI-compatible) (#1155)
94a59dd suantea (asuan_suan) committed 1 month ago
feat(proxy): /v1/rerank endpoint over the existing key pool (#1029) (#1372)
65b7310 suantea (asuan_suan) committed 1 month ago
docs: add root GLOSSARY.md for agent navigation (#1375)
1c252b6 Chong Jia Zhen committed 1 month ago
perf(routing): cache the active chain, platform key counts and key decryption (#1318)
b264ffc suantea (asuan_suan) committed 1 month ago
fix(health): back off scheduled validation after provider 429s (#1377)
1a536ef Chong Jia Zhen committed 1 month ago
feat(providers): add Plugsky and ElectronHub speech support (#1441)
dbac4f3 Tashfeen committed 1 month ago
fix(desktop): route update checks through the app's proxy (#1432) (#1433)
d94b765 Tashfeen committed 1 month ago
feat(providers): add Typhoon chat and transcription adapter (#1434)
03663cc Tashfeen committed 1 month ago
feat(updates): one minimal Updates dialog from the ⋯ menu (#1429)
c125185 Tashfeen committed 1 month ago
feat(docker): opt-in "Update now" via a Watchtower sidecar; stop cleanly on SIGTERM (#1427)
0df6d4d Tashfeen committed 1 month ago
feat(desktop): in-app updates; fix the Windows updater filename; reload prompt for stale tabs (#1426)
44b3c3f Tashfeen committed 1 month ago
feat(agents): add Reasonix with `setup-reasonix`; slim the README agent list (#1425)
6530823 Tashfeen committed 1 month ago
test(llmtr): run #1390 validation cases unpaced; credit Yi-111-a (#1422)
a6b2158 Tashfeen committed 1 month ago
fix(llmtr): pace key-validation probes so a burst can't get the account banned (#1369) (#1388)
316abc4 yi111 committed 1 month ago
feat(dashboard): provider-reported balance badge on each key row (#1403) (#1417)
3bcb660 Tashfeen committed 1 month ago
feat(quota): provider-reported balance polling + manual poll endpoint (#1403) (#1414)
ee08532 Tashfeen committed 1 month ago
fix(llmtr): a 403 refusing automated validation is inconclusive, not invalid (#1390) (#1416)
021bcfb Tashfeen committed 1 month ago
fix(budget): request counts and daily caps are not monthly token budgets (#1415)
2635987 Tashfeen committed 1 month ago
feat(providers): add Gizmo and BlockRun adapters for v0.13.4 (#1396)
716948f Tashfeen committed 1 month ago
docs(security): supported versions track the 0.13.x line (#1387)
f56816b Tashfeen committed 1 month ago