Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
Commits on main
feat(stats): per-bucket output-shaping savings in /stats-history (#1819)
12a9710 gglucass committed 4 months ago
fix(codex): preserve wrapped sessions and recover state (#2160)
dec60de Rudimar Ronsoni committed 4 months ago
feat(proxy): add opt-in cost-aware model router (#1706) (#2205)
57e8dcb Krishna Chaitanya committed 4 months ago
fix(wrap): self-heal a stale ANTHROPIC_BASE_URL left by a dead proxy (#2223)
8537e2c Zhenjia ZHOU committed 4 months ago
fix(backend/bedrock): preserve system-prompt cache_control breakpoint (list form) (#2225)
ea0115c Ingmar Krusch committed 4 months ago
fix(ccr): lowercase a retrieved hash so an uppercase echo still hits the store (#2236)
842d7e1 Abhay Singh committed 4 months ago
docs(troubleshooting): document Windows Defender ast-grep-cli false positive + workarounds (#2200) (#2237)
17d60dc Shubham Srivastava committed 4 months ago
fix(ccr): skip compact summaries for proactive expansion (#2242)
3f241e4 Vinay Gupta committed 4 months ago
feat(wrap): add omp target (Oh My Pi) with models.yml override and unwrap (#1811)
fcf455a LunarECL committed 4 months ago
feat(proxy): show real upstream provider on dashboard for OpenAI-compatible endpoints (#1594)
996c117 Manmit Singh committed 4 months ago
fix(mcp): reap orphaned mcp serve on client death (#2226)
7a5d8a7 Vsevolod Rychkov committed 4 months ago
fix(cache): stable session identity and per-conversation prefix trackers under agentic clients (#2193)
7bfb1d7 Andrei Boldyrev committed 4 months ago
refactor(proxy): extract tool definition serialization (#1998)
ad6ab48 JD Davis committed 4 months ago
feat(dashboard): add settings dashboard for proxy configuration (#2101)
96bc4cd nangsontay committed 4 months ago
feat(core): gate ONNX transforms behind a default-on `ml` feature (static/lexical builds) (#2165)
cdba2ec Matthew Jackson committed 4 months ago
fix(memory): require explicit updates for supersession (#2188)
6d897e8 Chester committed 4 months ago
fix(proxy): dedupe Codex WS request logging for accurate mixed-provider dashboards (#2189)
e5b3a63 nangsontay committed 4 months ago
fix(proxy/bedrock): wire PrefixCacheTracker updates into Bedrock backend paths (#2196)
a352fa0 Ingmar Krusch committed 4 months ago
fix(proxy): accept Codex websocket before upstream retries (#2203)
551f473 Rod Boev committed 4 months ago
fix(diff-compressor): CJK-aware relevance scoring for hunk selection (#2220)
528517c Zhenjia ZHOU committed 4 months ago
docs(ccr): correct stale 5-minute TTL hints to 30 minutes (#2224)
5de12f7 Zhenjia ZHOU committed 4 months ago
fix(cli/init): fail clearly on a target settings file with invalid JSON (#2227)
daca1dd Abhay Singh committed 4 months ago