Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
Commits on main
fix: add claude-opus-4-6 (1M context) to ANTHROPIC_CONTEXT_LIMITS
5444377 chopratejas committed 8 months ago
Add SharedContext for multi-agent, rewrite README, fix proxy cleanup
6ab4488 chopratejas committed 8 months ago
Enhanced MCP server with compress/stats tools, fix proxy torch crash
87b54fc chopratejas committed 8 months ago
Fix proxy crash when torch not installed (kompress lazy imports)
fb4ab08 chopratejas committed 8 months ago
Add wrap commands for Codex/Cursor/Aider with rtk instructions, fix savings metrics
e2aac48 chopratejas committed 8 months ago
fix(wrap): route through proxy, prevent pipe deadlock, bump to 0.4.2
384ac34 Tejas Chopra committed 8 months ago
Format prefix_cache_benchmark.py for ruff 0.15 compatibility
1474355 chopratejas committed 8 months ago
Fix proxy backend bugs: env vars, tool forwarding, and provider support
4bea17b chopratejas committed 8 months ago
Kompress: use argmax for token selection, remove hardcoded 0.5 threshold
95c8133 chopratejas committed 8 months ago
Add Kompress: ModernBERT token compressor replacing LLMLingua-2
df17055 chopratejas committed 8 months ago
Updating the README to reflect the right positioning for Headroom
a727676 chopratejas committed 8 months ago
feat: provider-aware prefix cache tracking and combined savings dashboard
4a655fb Tejas Chopra committed 8 months ago
fix: dashboard metrics, TTFB tracking, eager LLMLingua loading, and multi-provider consistency
08d81f2 Tejas Chopra committed 8 months ago
style: ruff format parser.py, content_router.py, smart_crusher.py
7fd1f6f Tejas Chopra committed 8 months ago
fix(learn): pass explicit model in tests to avoid API key requirement
da481a3 Tejas Chopra committed 8 months ago