Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
Commits on main
fix(proxy): unblock Codex WS compression — delete inner-pool + global semaphore
a167f5c chopratejas committed 6 months ago
Merge pull request #469 from chopratejas/fix/cache-writes-backend-streaming
7ddc0ce Tejas Chopra committed 6 months ago
fix(proxy): record cache reads/writes on backend-routed streaming (#327)
3e97a0c chopratejas committed 6 months ago
Merge pull request #467 from chopratejas/docs-ai-agent-discoverability
bcf5517 Tejas Chopra committed 6 months ago
docs: improve discoverability for AI agents and search crawlers
c1d2eec chopratejas committed 6 months ago
Merge pull request #466 from chopratejas/fix-464-traffic-learner-system-reminder-noise
1139b21 Tejas Chopra committed 6 months ago
Merge pull request #465 from chopratejas/fix-462-per-project-memory-scope
f8ffdbf Tejas Chopra committed 6 months ago
fix(memory): traffic_learner indexes system-reminder fragments as user preferences (refs #464)
0be0eed chopratejas committed 6 months ago
fix: per-project memory storage so projects can no longer bleed memories (GH #462)
7694f05 chopratejas committed 6 months ago
fix: narrow compressed type for mypy 1.14 in ContentRouter.compress
05fe6c0 chopratejas committed 6 months ago
Merge pull request #403 from chopratejas/realign-F2_2-policy-tuning
294df2b Tejas Chopra committed 6 months ago
Merge pull request #459 from chopratejas/fix/codex-compression-observability
4e146b0 Tejas Chopra committed 6 months ago
docs: add README redesign spec (lean-ctx parity + Headroom-first blend)
3432ee3 chopratejas committed 6 months ago
Merge pull request #458 from chopratejas/fix-litellm-azure-dashboard-compression-issues-454-455
71348f4 Tejas Chopra committed 6 months ago
fix(proxy,dashboard): correct savings reporting for backend-routed traffic and drop broken Compression Quality widget
6643266 Tejas Chopra committed 6 months ago
Merge pull request #451 from cowwoc/feature/issue-265-lean-ctx
5f96b83 Tejas Chopra committed 6 months ago
Merge pull request #450 from chopratejas/fix/windows-ort-docker-signing
5cc3fd4 Tejas Chopra committed 6 months ago