Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
Commits on main
fix(proxy): subtract cache write premiums from net savings (#1800)
53a465b Rod Boev committed 4 months ago
fix(proxy): preserve streaming passthrough beta headers (#1783)
0f553a8 Rod Boev committed 4 months ago
fix(proxy/openai): translate max_tokens -> max_completion_tokens on chat path (#1774)
285808b Tejas Chopra committed 4 months ago
fix(code-compressor): CJK-aware relevance-query symbol matching (#1747)
b38315c Zhenjia ZHOU committed 4 months ago
fix(content-detector): detect and compress space-separated JSON objects (#1742)
5194bdc Rohan Richard committed 4 months ago
fix(proxy): bound HF tokenizer load and offload token counting off event loop (#1738)
46d5d68 Parideboy committed 4 months ago
fix(transforms): pass through ragged tables instead of misaligning columns (#1713)
c7665ca Parideboy committed 4 months ago
docs: add pipeline-extension recipe and x-headroom-base-url routing docs (#1712)
0dd24ec Parideboy committed 4 months ago
fix(install): pass sc.exe create as raw command line so binPath= quoting survives (#1654) (#1702)
d6e0710 Parideboy committed 4 months ago
fix(rtk): link managed rtk onto PATH instead of mutating the hook (#1698)
140cb05 Manmit Singh committed 4 months ago
fix(proxy): stop rtk stat failures from corrupting session baseline (#1693)
681b9a8 inix committed 4 months ago
fix(wrap): replace stale-proxy detection with Vite-style port fallback (#1406)
b4205c6 GUOHAO LIU committed 4 months ago
fix(install): persist --no-http2 override through install apply (#1676)
6fb5f3b Rod Boev committed 4 months ago
fix: correct Go AST compression bugs and CODE_AWARE token accounting (#1668)
3f14eac r00t committed 4 months ago
fix(proxy): persist lifetime cache-read savings across restarts (#1665)
908997e inix committed 4 months ago
fix(proxy): retry HTTP/2 stream resets instead of 502ing (#1645)
2ce19c2 Manmit Singh committed 4 months ago
fix(proxy/openai): thread savings-profile kwargs into chat completions (#1606)
7ff842d Abhay Singh committed 4 months ago
fix(proxy): keep cache_control bounded + stable so the freeze overlay stops busting (#1852)
4820134 Tejas Chopra committed 4 months ago