Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
Commits on main
deps: bump ruff from 0.16.2 to 0.16.3 in the pip-minor-patch group (#3143)
c8db13d dependabot[bot] committed 3 months ago
deps: bump ai from 6.0.138 to 7.0.59 in /sdk/typescript (#2281)
0891062 dependabot[bot] committed 3 months ago
deps: update mcp requirement from <2.0.0,>=1.28.1 to >=1.28.1,<3.0.0 (#3144)
6928d19 dependabot[bot] committed 3 months ago
deps: bump the cargo-minor-patch group with 8 updates (#3145)
9c14e3a dependabot[bot] committed 3 months ago
fix(metrics): attribute tool-schema savings per model, not just compression (#3155)
81fe9d5 Tejas Chopra committed 3 months ago
fix(security): address u9up assessment findings (WEB-01–07) (#2207)
1f96dab Tejas Chopra committed 3 months ago
fix(proxy): return 502, not 200, when upstream connect retries are exhausted (#3083)
a3d9424 Serge ARADJ committed 3 months ago
fix(proxy/anthropic): stop answering a non-streaming turn with an event stream (#3142)
0e26fb8 Tejas Chopra committed 3 months ago
fix(deps): clear the two Rust advisories and make cargo audit blocking (#3121)
93c474e Tejas Chopra committed 3 months ago
test(proxy): pin down what Anthropic's thinking signature actually covers (#3135)
709d74c Tejas Chopra committed 3 months ago
fix(proxy): stop a lone surrogate turning a thinking body into a 500 (#3134)
284ff31 Tejas Chopra committed 3 months ago
fix(proxy): scope the signed-thinking lock to blocks that actually changed (#3124)
17522fb Tejas Chopra committed 3 months ago
fix(reporting): show net vs gross savings, real skip thresholds, and the effective profile (#3123)
250ede2 Tejas Chopra committed 3 months ago
fix(proxy): stop operator secrets following a client-chosen upstream (#3122)
05f5ef4 Tejas Chopra committed 3 months ago
fix(deps): raise the GitPython floor to 3.1.58 to clear 9 open advisories (#3120)
8156d4d Tejas Chopra committed 3 months ago
fix(copilot): send VS Code inline completions to the host that serves them (#3112)
b77d612 Tejas Chopra committed 3 months ago
fix(ccr): send Accept: application/json on a buffered stream:false turn (#3102)
139c7cb Tejas Chopra committed 3 months ago
fix(ccr): make --no-ccr disable server-side response handling too (#3101)
131b119 Tejas Chopra committed 3 months ago
fix(ccr): make StreamingCCRHandler work on OpenAI streams (#3069)
7ef736f Parideboy committed 3 months ago
fix(opencode): send x-headroom-project header on all proxied requests (#2868)
eeb038b Radhakrishnan Pachyappan committed 3 months ago
fix(proxy/cache): strip cache_control from messages in the semantic cache key (#3086)
2cae0f8 Abhay Singh committed 3 months ago
fix(proxy/anthropic): coerce present-null usage counters on the buffered backend path (#3084)
9ca5a16 Abhay Singh committed 3 months ago
test(install/windows): verify the PATH guard against the real HKCU registry (#3068)
c3c921f Parideboy committed 3 months ago
perf(perf): skip rotated logs outside the requested window (#3081)
6c9f41e gglucass committed 3 months ago