Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
Commits on main
ci: add Windows wheel build job (win_amd64) (#1086)
48f06ca sgfdhgfnjgmhgmnfd657-sys committed 4 months ago
fix(proxy): keep PRE_SEND from reintroducing empty tool arrays (#2015)
d1db00a Rod Boev committed 4 months ago
refactor(cache): isolate compression strategy outcomes (#1938)
b5aa8a3 JD Davis committed 4 months ago
fix(proxy): preserve terminal tool on Codex Responses (#2000)
41af39d Rod Boev committed 4 months ago
fix(proxy): cache_savings_usd silently zeroes when litellm is unavailable (#2005)
75d7861 Dima Solodukha committed 4 months ago
fix(learn): parse fenced JSON even with a prose preamble (#1988)
d2170b1 Fabien Culpo committed 4 months ago
fix(memory/sync): don't clobber memories sharing a first line (#1976)
5e14b8c Abhay Singh committed 4 months ago
fix(proxy): strip inbound Content-Encoding on messages/chat forward (#1970)
4cb33cd Abhay Singh committed 4 months ago
fix(dedup): shorter fold pointer + MIN_LINES=3, dedup Anthropic list-… (#1932)
10e4829 Tejas Chopra committed 4 months ago
chore: extract agent-evals into standalone headroom-bench repo (#1967)
7dbb9c3 Tejas Chopra committed 4 months ago
fix: patch nltk vulnerability (CVE-2026-54293) (#1929)
28ca61f OrbisAI Security committed 4 months ago
[codex] Document local LLM prefill benchmarking (#1396)
abc557a panamarob30-jpg committed 4 months ago
fix: emit unknown Anthropic content blocks verbatim in buffered-to-SSE conversion (#1825)
d05802b Matt Van Horn committed 4 months ago
fix(proxy): strip duplicated upstream server headers (#1828)
d2a86b5 Rod Boev committed 4 months ago
fix(proxy): hoist ccr_workspace_key default so /v1/messages survives CCR-inject off (#1096)
1deb947 ahhdammm committed 4 months ago
fix(scripts): rename .releaseetadata to .releasemetadata (#1246)
772adc9 Sepuri Sai Krishna committed 4 months ago
fix(litellm): inherit CustomLogger so future hooks don't crash proxy (#1114) (#1391)
9be727d Peter Lodri committed 4 months ago