Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
Commits on main
chore(evals): remove dead and test-only eval helpers (#4079)
de89692 Tejas Chopra committed 1 month ago
chore(providers): remove dead provider and model helpers (#4078)
688b327 Tejas Chopra committed 1 month ago
chore(evals): remove the unreferenced prompt_comparison and memory runner_v3 modules (#4077)
8e61cca Tejas Chopra committed 1 month ago
refactor(backends): reuse the LiteLLM tool converters in the any-llm backend (#4076)
03538f2 Tejas Chopra committed 1 month ago
fix(providers): drop the shadowed POST /v1/messages route spec (#4075)
69a16cb Tejas Chopra committed 1 month ago
refactor(proxy): remove unreferenced and test-only helpers (#4074)
e5cbec5 Tejas Chopra committed 1 month ago
refactor(proxy): remove dead wiring and unused re-exports from server.py (#4073)
58387c1 Tejas Chopra committed 1 month ago
refactor(proxy): drop the test-only memory ranker and file-backed native memory ops (#4072)
fc5ac70 Tejas Chopra committed 1 month ago
refactor(proxy): delete the unused memory_tool_adapter module (#4071)
7e5d97f Tejas Chopra committed 1 month ago
fix(subscription): log a failed OTEL window update instead of passing silently (#4131)
7d9dd55 Tejas Chopra committed 1 month ago
fix(mcp_registry): atomic config writes, no traceback on non-UTF-8 configs, log failed removals (#4130)
f2153fe Tejas Chopra committed 1 month ago
fix(pricing): keep the long-context premium when litellm drops the 200k rate (#4109)
8c1beb2 Tejas Chopra committed 1 month ago
fix(proxy): record the provider's billed input count on streamed turns (#4052)
a9815bb Tejas Chopra committed 1 month ago
fix(ccr): serve headroom_retrieve when the model calls it alongside client tools (#4034)
01d9194 gglucass committed 1 month ago
fix(smart-crusher): keep string cells in json columns from decoding as other types (#4053)
3db1a94 Suliman Abdulrazzaq committed 1 month ago
docs(security): sync runtime-env knob table with RUNTIME_ENV_KNOBS (#4051)
a31d89b Anton Dziatkovskii committed 1 month ago
fix(anthropic): route /api/hello connectivity probes to Anthropic (#3336) (#4059)
931e5b9 Luis Araya committed 1 month ago
fix(proxy): ignore defer_loading when measuring a turn hook's tool delta (#4056)
f8212a3 Tejas Chopra committed 1 month ago
feat(plugins): add headroom-snip Claude Code mod that animates compression (#3980)
17abee2 sandeep committed 1 month ago
[codex] Make Claude project settings injection opt in (#1600)
07b4511 Feng Lin committed 1 month ago
fix(install/windows): back persistent-service with an always-on task (#1866) (#2460)
5682883 Parideboy committed 1 month ago
fix(proxy/streaming): tolerate malformed upstream SSE events (#2558)
d091fbd Navid Kamali committed 1 month ago
fix(dashboard): keep savings profile visible in light mode (#2544)
4e4f49d Raghav Desai committed 1 month ago
fix(proxy): forward x-litellm-key-* headers on streaming path (#2532)
33ade5b Bartosz Oudekerk committed 1 month ago
fix(grok): attribute api.x.ai chat outcomes as provider xai, recognize grok-shell UA (#2626)
b1fb162 gglucass committed 1 month ago