Skip to content

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

Merge pull request #107 from JerrettDavis/feat/extended-cache-ttl-metrics

Tejas Chopracfedcef7e2b2