7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.
TypeScript
Commits on main
fix(desktop): make System theme follow the OS, keep traffic-light gutter physical in RTL (#612)
6379190 Tashfeen committed 3 months ago
docs: list all 60 dashboard languages with flags in README (#610)
ad16267 Tashfeen committed 3 months ago
test: tolerate small start_offset_ms in single-attempt trace test (#606)
b40b65e Tashfeen committed 3 months ago
Issue batch 2: per-key scoring + honest group display, first-byte stream grace, Gemma tools passthrough, toast timing (#605)
99076fc Tashfeen committed 3 months ago
Issue batch: local-Ollama cooldown fix, keyless-config boot crash, served-model drift guard, failover-ladder UI, credits (#603)
cd4d839 Tashfeen committed 3 months ago
P2 batch: routing traces, reasoning control, model-source guard, catalog-driven audio transcription + dashboard (#602)
d9a0d77 Tashfeen committed 3 months ago
P1 remainder: cooldown-probe recovery, client AbortSignal propagation, honest exhaustion statuses (#601)
5a5b17c Tashfeen committed 3 months ago
Quota discipline: in-flight leases, provider RPM gate, health false negatives (#598)
c911ded Tashfeen committed 3 months ago
harden router: credential placement, quota boundaries, cooldown visibility (#597)
c0d0b03 Tashfeen committed 3 months ago
perf: gzip dashboard bundle and cache hashed assets immutably (#574)
7a3bc77 Tashfeen committed 4 months ago
fix: resolve #523 #568 #308 #436 #536 — TTS voice mapping, response model names, Termux support, docs index, health-check error surfacing (#573)
099fcd5 Tashfeen committed 4 months ago
Merge pull request #567 from tashfeenahmed/adopt-community-fixes
759de8e Tashfeen committed 4 months ago
fix(server): treat NVIDIA NIM 'DEGRADED function' 400 as provider capacity, not an invalid request
aa68fc2 Tash committed 4 months ago
feat(server): per-provider timeouts via PROVIDER_TIMEOUT_<PLATFORM>, stream stall watchdog via PROVIDER_STREAM_STALL_TIMEOUT_MS
1aaf10a Tash committed 4 months ago
fix(docker): copy server/node_modules into the runtime image so the proxy can load undici
c6589ff Tash committed 4 months ago
fix(catalog-sync): guard model override keys against unknown columns (#458)
68a33c3 CagedBird committed 4 months ago
ci(desktop): fall back to unsigned DMG when Apple signing secrets are absent (#563)
e88c5cc Tashfeen committed 4 months ago