Skip to content

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

docs update

Nicola Beghinf59690a7a70c
diff --git a/docs/proxy.md b/docs/proxy.md
index e5b93488a..a47a34c93 100644
--- a/docs/proxy.md
+++ b/docs/proxy.md
@@ -32,6 +32,7 @@ headroom proxy \
| `--no-rate-limit` | `false` | Disable rate limiting |
| `--log-file` | None | Path to JSONL log file |
| `--budget` | None | Daily budget limit in USD |
+| `--openai-api-url` | `https://api.openai.com` | Custom OpenAI API URL endpoint |
### LLMLingua Options (ML Compression)
@@ -204,6 +205,7 @@ headroom_latency_ms_sum
export HEADROOM_HOST=0.0.0.0
export HEADROOM_PORT=8787
export HEADROOM_BUDGET=100.0
+export OPENAI_TARGET_API_URL=https://custom.openai.endpoint.com
headroom proxy
```