Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
Commits on main
perf(metrics): cap inbound request-path cardinality to bound memory (#3340)
88a1f4e Abhay Singh committed 1 month ago
fix(proxy)!: read HEADROOM_LICENSE and make usage reporting opt-in (#3857)
7460389 Tejas Chopra committed 1 month ago
fix(install): use safe model backends for persistent services (#3646)
7287589 lorenzozane committed 1 month ago
fix(plugins/openclaw): return messages the proxy did not change exactly as they came in (#3826)
d1ad189 jedi-tal committed 1 month ago
fix(learn): run the claude-cli analysis with no tools (#3892)
db90b93 gglucass committed 1 month ago
fix(proxy): label plain OpenAI chat traffic openai, not custom (#3912)
7df8bd8 Tejas Chopra committed 1 month ago
deps: bump the npm-minor-patch group across 3 directories with 11 updates (#3910)
ff1a0d6 dependabot[bot] committed 1 month ago
chore(deps): bump the uv group across 1 directory with 2 updates (#3911)
9320c97 dependabot[bot] committed 1 month ago
deps!: drop the crewai extra to remove chromadb from the lockfile (#3870)
59b8cef Tejas Chopra committed 1 month ago
fix(transforms/kompress): preserve line boundaries and tabular output in Kompress (#3119)
fe2ed2b slxng1758 committed 1 month ago
feat(live-zone): wire the SourceCode and PlainText dispatch arms (#3227)
49f69be r3bb1t committed 1 month ago
fix(settings): report live proxy configuration (#3177)
58b1454 Sabee Ur Rehman Khan committed 1 month ago
fix(telemetry): label custom-base chat upstreams from a fixed provider set (#3759)
f0ec2bb donjor committed 1 month ago
fix(proxy): keep cache_control outside content blocks where the Chat Completions client put it (#3895)
a6d6c14 afernandez-stratio committed 1 month ago
fix(codex): explain why wrapped Codex runs without the shared server (#3899)
1982b3a Sudhindra Desai committed 1 month ago
fix(proxy): probe upstream connections with TCP keepalive so a dead link fails over (#3907)
c46e7cc gglucass committed 1 month ago
fix(mcp): resolve opencode.jsonc for MCP registration (#2496)
f824a27 Parideboy committed 1 month ago
fix(proxy/batch): honor x-headroom-bypass on the batch paths (#2570)
9b26a49 Omar Gerardo committed 1 month ago
fix(proxy): skip pricing lookup for passthrough:* models (#2585)
f87848c AxelRay committed 1 month ago
docs(security): correct credential-storage claim and add a security model page (#2684)
6ff74c5 Keshav Reddy committed 1 month ago
fix(grok): route CLI traffic to api.x.ai on shared proxies (#2693)
ef1c528 Peter committed 1 month ago
fix(wrap): scope Serena's MCP registration to the wrapped project (#2787) (#2992)
8cfeb69 Parideboy committed 1 month ago
feat(proxy): add x-headroom-keep-last-turns header for per-request context trimming (issue #2858) (#3059)
246162d Radhakrishnan Pachyappan committed 1 month ago
feat(compress): add per-message compression diagnostics (#3058)
fef99cc Radhakrishnan Pachyappan committed 1 month ago