Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
Commits on main
Disable CacheAligner: it inflates tokens and breaks prefix caching
07d278a chopratejas committed 7 months ago
Fix Codex WS proxy (Issue #86), LiteLLM metrics, and backend forwarding
dc1f3ff chopratejas committed 7 months ago
Refactor: extract data models to headroom/proxy/models.py (Step 1/9)
a4ddaa3 chopratejas committed 7 months ago
Add transforms_summary to TransformResult and /v1/compress response
e2d1baf chopratejas committed 7 months ago
Fix multi-worker beacon spam, cost dashboard, upsert telemetry; bump 0.5.17
e963c90 chopratejas committed 7 months ago
Fix dashboard cost savings: use model list price, not moving average
d7ab580 chopratejas committed 7 months ago
Merge pull request #61 from gglucass/feat/persist-savings-history
a99d4b9 Tejas Chopra committed 7 months ago
Fix WebSocket proxy: forward all headers + required OpenAI-Beta header
a7cc0a3 chopratejas committed 7 months ago
Add Anthropic url overrides via ANTHROPIC_TARGET_URL env var and --anthropic-api-url flag
b38ef58 dorphalsig committed 7 months ago
Merge remote-tracking branch 'origin/main' into feat/persist-savings-history
dd50958 Garm committed 7 months ago
Bump to 0.5.16: WebSocket proxy, Kompress ONNX, Discord link update
e5d56af chopratejas committed 7 months ago
Kompress ONNX INT8: text compression without torch dependency
2d97d8e chopratejas committed 7 months ago
Remove dedupe_telemetry.py from repo, add scripts/ to .gitignore
859a1a4 chopratejas committed 7 months ago
Bump to 0.5.15: Responses API compression, tool_result ordering fix
606819c chopratejas committed 7 months ago
Fix tool_result ordering: no stray user message between tool_calls and tool
7d25c87 chopratejas committed 7 months ago
Fix zstd streaming decompression, add zstandard dep; bump to 0.5.14
6212644 chopratejas committed 7 months ago
Fix streaming tool calls, compressed request bodies, beacon field names; bump to 0.5.13
8228f0e chopratejas committed 7 months ago
Switch telemetry to proxy_telemetry_v2 table, bump to 0.5.12
c6d6c6a chopratejas committed 7 months ago
Bump to 0.5.11: fix cost calculation, Windows path decoding, unused imports
e25eb0b chopratejas committed 7 months ago
Fix cost calculation: don't mix cache savings into Headroom savings
1c6ac5d chopratejas committed 7 months ago
fix: remove unused imports in test_langgraph.py (ruff F401)
de862d9 chopratejas committed 7 months ago
Fix Windows drive letter path decoding in headroom learn (fixes #69)
c7731b1 chopratejas committed 7 months ago