7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.
TypeScript
English · 简体中文
API Domain — Changelog
Doc revision history for docs/api/, seeded from API-relevant commits.
2026-10-23
- fix(api): client-profile keys now authenticate
/v1/messagesand/v1beta— thesk-cp-*keys from #411 were accepted only by/v1/chat/completionsand/v1/responses; the Anthropic and Gemini surfaces still compared the unified key alone, so a downstream app speaking the Claude or Gemini wire format got401with its own profile key. Both routes now resolve throughresolveAuth: profile keys carry their server-enforced system prompt (injected first, after compression on/v1/messages, ahead ofsystemInstructionon/v1beta— same ordering contract), and a disabled profile fails like a bad key. Source:server/src/routes/anthropic.ts,server/src/routes/gemini.ts.
2026-10-20
- docs(api): document
GET /v1/usage— the endpoint shipped with #1600 and gained a per-key breakdown in #1614 but was never in01-rest-api.md. Added a Usage API section: response shape (month,resetsAt,requests,tokens,byPlatform[],byKey[]withrequestCap/tokenCap,null= unlimited), unified-key-only auth (403for client profiles), deleted keys surfacing under platformremoved, and the ledger-not-clamped-at-cap semantics that match429 quota_exceeded. Source:server/src/routes/proxy.ts(GET /v1/usagehandler).
2026-09-03
- docs(api): document the task-type routing header — added
X-FreeLLM-Task-Type: code|chat|auto(#1127) to the per-request headers section, with the weight shift it applies and the strategies that ignore it. - docs(api): document the task-weight-share setting — added
GET/PUT /api/settings/task-weight-share(#1127), the operator knob for how much weight the task-type bias moves.
2026-09-02
- docs(api): add Idempotency-Key documentation (02-idempotency.md) — documents non-streaming
POST /v1/chat/completionsidempotency from36b877d/95bc46f:Idempotency-Keyheader (trim +≤255UTF-8 bytes, first value on repeat),replayvs409 idempotency_key_conflictvsmissvialookupIdempotencyReplay, fingerprintSHA-256(model+messages+temperature/top_p/max_tokens/tools/tool_choice), SHA-256 key-hash storage,X-Routed-Via: idempotencyzero-cost replay,stream:truebypass andfinish_reason:lengthnot stored, in-flight NOT deduplicated (both attempts execute; pending-claim out of scope per95bc46f/idempotency.ts:17-20),IDEMPOTENCY_TTL_MS24 h (idempotencyTtlMs+envNumguard, lazy sweep perkey_hash),409handling, and acurltimeout→retry→replay example. Sources:server/src/services/idempotency.ts,server/src/routes/proxy.ts:1793-1835+2640-2656, migration20260901_000001_idempotency_claims.ts. Updateddocs/en/api/OVERVIEW.mdindex and added cross-ref indocs/architecture/04-degraded-mode-and-failover.md:10.
2026-08-25
- docs(api): document video platforms, free-tier budget, and backups APIs — expanded
POST /v1/videos/generationswith the bounded pollinations/huggingface surface (5-minute timeout, fal queue); addedGET /api/free-tier(pool-deduped monthly budget) andGET /api/backups(DUMP_FORMAT=1, sha256 key fingerprint) endpoint reference.
2026-08-23 — Docs reorganization
- 36850e8
docs(api): fold API guide into api domain— moveddocs/api.md→docs/api/01-rest-api.mdwithOVERVIEW.md+CHANGELOG.mdscaffold. (landed via #979)
2026-08-10 and earlier
- 8cb75ac feat(proxy): opt-in X-Fallback-Detail header with per-hop failover timings (#792)
- 878fb89 Add prompt and context compression pipeline (#628)
- 90d291d Split README into focused docs pages (#627)
Older history for this content is available via
git log --follow -- docs/api.md.