Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
Commits on main
fix(proxy): retry passthrough on transient upstream connection close (#1513)
5d14080 Gaurav Dubey committed 4 months ago
fix(build): enable Intel macOS pip installs via ort-load-dynamic (#1538)
32ce99e Rob Francis committed 4 months ago
fix(proxy): freeze must forward cached (compressed) prefix byte-identical — stop token-mode cache busting (#1850)
248ae0f Tejas Chopra committed 4 months ago
fix: detect and clear stale ANTHROPIC_BASE_URL from crashed wrap sessions (#1768) (#1837)
84509a4 Parideboy committed 4 months ago
fix(docker): persist headroom workspace in compose (#1839)
5e29c06 Vinay Gupta committed 4 months ago
fix(proxy): strip 1m model suffix before upstream forwarding (#1840)
e22d745 Vinay Gupta committed 4 months ago
feat(content-router): lossless-first dispatch, cross-turn dedup, and A7 lossy-after-fold (#1818)
60af15f Tejas Chopra committed 4 months ago
fix(dashboard): deduplicate repeated savings metrics (#1804)
88f935a Rod Boev committed 4 months ago
perf(savings): batch tracker persistence off the request hot path (#1817)
451b9f0 inix committed 4 months ago
fix(proxy): bound Codex WS compression fallback latency (#1802)
d24a3f8 Rod Boev committed 4 months ago
fix(opencode): expose headroom/* models in injected provider config (#1716)
e8151f0 Parideboy committed 4 months ago
fix(content-router): token-measure lossless folds at the acceptance gate (#1772)
c5493ea Tejas Chopra committed 4 months ago
feat(content-router): accept any real compression (remove min-savings floor) (#1771)
6c31db9 Tejas Chopra committed 4 months ago
fix(proxy): surface codex websocket loop failures in livez (#1727)
ceae879 Rod Boev committed 4 months ago
fix(relevance): gate ONNX embedding backend behind AVX2 to avoid SIGILL (#1723) (#1765)
728b330 Parideboy committed 4 months ago
feat(anthropic): add Claude 5 family pricing & align current rates (#1767)
e84ca98 Kenneth Wong committed 4 months ago
feat(content-router): lossless-excluded compaction (grep/log/json) + enable in coding/general personas (#1762)
f067040 Tejas Chopra committed 4 months ago
feat(agent-savings): land coding + general workload personas on main (#1732)
d8db7da Tejas Chopra committed 4 months ago