7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.
TypeScript
Commits on main
chore(deps): bump actions/download-artifact from 8.0.1 to 8.0.2 (#1521)
f233e07 dependabot[bot] committed 1 month ago
feat(providers): add Auray and preserve native Gemini TTS WAV (#1518)
5a3abac Tashfeen committed 1 month ago
fix(premium): refresh every model list after a license change (#1507)
bf16604 Tashfeen committed 1 month ago
ci(desktop): notarize the app in our own afterSign hook with stapling retries (#1498)
96b6367 Tashfeen committed 1 month ago
ci(desktop): make the Intel macOS release build reliable (staple retry, pinned Python) (#1495)
05f5bc2 Tashfeen committed 1 month ago
feat(playground): + menu with attach and web search, sources tucked under Show (#1174) (#1494)
a287b44 Tashfeen committed 1 month ago
feat(search): web search engines from the catalog, agent web search and dashboard (#1458)
a2b78ce suantea (asuan_suan) committed 1 month ago
fix(auth): sign in after a password reset and log the account email (#1477) (#1486)
986b211 Tashfeen committed 1 month ago
fix(fusion): return a non-retryable 413 when the prompt is too large for the panel (#1479) (#1485)
d000f3f Tashfeen committed 1 month ago
feat(embeddings): support verified Inferbase catalog routes (#1483)
73a24de Tashfeen committed 1 month ago
fix(images): never load sharp on a CPU it can't run on, or when there is nothing to resize (#1469) (#1481)
beef0f8 Tashfeen committed 1 month ago
fix(windows): make the bootstrap and CLI test suites pass on Windows (#1392) (#1476)
a701ab6 Tashfeen committed 1 month ago
test(cli): make path assertions platform-tolerant for Windows (#1424)
55beddc suantea (asuan_suan) committed 1 month ago
fix(proxy): bind idempotency keys to extended generation options (#1440)
6d63bf1 Alex committed 1 month ago
fix(router): an explicit pin must not resurrect an upstream-retired model (#1394) (#1423)
5a42716 suantea (asuan_suan) committed 1 month ago
fix(catalog): a cached boot re-apply must not lift an upstream model retirement (#634) (#1421)
469ff8d suantea (asuan_suan) committed 1 month ago
fix(llmtr): stop probing LLMTR keys; promote them on first served request (#1459) (#1471)
ee8d8bd Tashfeen committed 1 month ago