Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
docs update
Nicola Beghinf59690a7a70c
diff --git a/docs/proxy.md b/docs/proxy.mdindex e5b93488a..a47a34c93 100644--- a/docs/proxy.md+++ b/docs/proxy.md@@ -32,6 +32,7 @@ headroom proxy \| `--no-rate-limit` | `false` | Disable rate limiting || `--log-file` | None | Path to JSONL log file || `--budget` | None | Daily budget limit in USD |+| `--openai-api-url` | `https://api.openai.com` | Custom OpenAI API URL endpoint |### LLMLingua Options (ML Compression)@@ -204,6 +205,7 @@ headroom_latency_ms_sumexport HEADROOM_HOST=0.0.0.0export HEADROOM_PORT=8787export HEADROOM_BUDGET=100.0+export OPENAI_TARGET_API_URL=https://custom.openai.endpoint.comheadroom proxy```