7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.
TypeScript
Commits on main
feat(router): explain WHY the pool is empty on exhaustion (#423) (#444)
34948ee Tashfeen committed 4 months ago
fix(security): guard custom-provider base URLs against SSRF (#440) (#443)
10b5092 Tashfeen committed 4 months ago
fix(proxy): tag AbortError with <platform>, <type>, <timeout>s (#409)
53338ff Jasnoor Gill committed 4 months ago
fix(provider): distinguish Cloudflare-truncated 200 from non-OpenAI-compat endpoint (#430) (#439)
7c16a66 Jasnoor Gill committed 4 months ago
docs(readme): refresh counts and strengthen the live-catalog pitch (#441)
8b3a272 Tashfeen committed 4 months ago
fix(proxy): surface provider 400 exhaustion as invalid request
a3c8838 Kair Wang committed 4 months ago
feat(playground): optional system prompt for the chat session (#390)
95fe504 Kair Wang committed 4 months ago
chore(health): include platform and base_url in transport-error log line (#394)
d94b05d Jasnoor Gill committed 4 months ago
feat(analytics): durable hourly aggregates + lifetime counters survive raw-row prune (#410)
055c166 Jasnoor Gill committed 4 months ago
fix(desktop): pass a Scheduler to health/catalog-sync on boot
92cb320 Tashfeen committed 4 months ago
Add catalog controls, persistence backup, and declarative config
f4cd7b4 Tashfeen committed 4 months ago
feat(embeddings): accept optional dimensions parameter for MRL truncation (#393)
a8cdc3d Jasnoor Gill committed 4 months ago
fix(ratelimit): escalate NULL-limit providers via hit-count heuristic (#392)
8c9cf94 Jasnoor Gill committed 4 months ago
refactor: add runtime-capability guards and centralize Config (#375)
d1943a8 LoneRifle committed 4 months ago
Merge pull request #391 from tashfeenahmed/codex/credit-vjsai-contributor
19e965f Tashfeen committed 4 months ago
Merge pull request #331 from chongjiazhen/feat/fusion-family-diversity
96ed4ab Tashfeen committed 4 months ago
Merge pull request #374 from LoneRifle/claude/bold-faraday-zat34f
6c3a8db Tashfeen committed 4 months ago