Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
Commits on main
deps: bump the cargo-minor-patch group across 1 directory with 22 updates (#2916)
148d860 dependabot[bot] committed 3 months ago
fix(cache): enforce Anthropic's 1h-before-5m cache_control ordering before forwarding (#2941)
3752458 Parideboy committed 3 months ago
fix(proxy): preserve merged session and quarantine contracts (#2943)
039cd24 JD Davis committed 3 months ago
fix(observability): aggregate tool savings in OTEL (#2936)
941c25d Tejas Chopra committed 3 months ago
fix(image): decouple routing types from trained_router so importing the compressor doesn't import torch (#2513) (#2537)
d7cf981 Abhay Singh committed 3 months ago
fix(codex): route alpha search through the Codex backend (#2538)
a540eb2 Rod Boev committed 3 months ago
fix(memory): skip <system-reminder> blocks when building the retrieval query (#2195) (#2541)
4e5a67a Abhay Singh committed 3 months ago
fix(providers/openai): bound tiktoken vocab loads with the guarded loader (#2554)
0805e8e gglucass committed 3 months ago
fix(doctor): flag `ollama launch claude` proxy bypass instead of misdirecting (#2566)
7f24d69 TenderDeve committed 3 months ago
fix(ccr): resolve <<ccr:...>> markers inline when no retrieve-tool path exists (#2512)
ce8ce83 Parideboy committed 3 months ago
docs(transforms): correct stale unit-result-cache placeholder comments (#2506)
f326fe2 gglucass committed 3 months ago
docs: add guide for using Headroom with OpenCode + DeepSeek (#2497)
565c607 suvenkatesh97 committed 3 months ago
fix(proxy/metrics): cap client-supplied model label cardinality (#2480)
e24a7e6 inix committed 3 months ago
fix(providers/anthropic): don't crash token estimation on null tool_calls (#2472)
08466f3 Abhay Singh committed 3 months ago
fix(memory): don't crash inline memory extraction on a non-object <memory> block (#2470)
e00c6ff Abhay Singh committed 3 months ago
fix(install): don't crash the PowerShell installer when $PROFILE is unset (#2469)
fc5c4e2 Abhay Singh committed 3 months ago
fix(ccr): tolerate null/malformed OpenAI data in response handling (#2467)
e583e08 Abhay Singh committed 3 months ago
fix(proxy/metrics): escape label values in the Prometheus export (#2463)
6a53861 inix committed 3 months ago
fix(install/windows): register persistent-task from S4U hidden XML (#2453) (#2459)
1edaeb8 Parideboy committed 3 months ago
fix(proxy/anthropic): None-guard usage token counts on the direct buffered path (#2434)
2b5ee7c Abhay Singh committed 3 months ago
fix(proxy): time-cap the compression timeout-debt quarantine (#2360) (#2412)
c5a08d2 Abhay Singh committed 3 months ago
fix(subscription): dedup transcript usage by message id (#2340 token inflation) (#2408)
74275b7 Abhay Singh committed 3 months ago
fix(wrap): honor Copilot OAuth wire-api override and model default (#2387)
1db6d88 Matt Van Horn committed 3 months ago
fix(proxy): port session-sticky beta headers to the Rust proxy (#2381)
f6398a6 Andrei Boldyrev committed 3 months ago
fix(proxy): compress cache-mode cold starts and tag prefix-mismatch passthrough (#2365)
aaeba0a Parideboy committed 3 months ago