Skip to content

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

Merge pull request #380 from chopratejas/realign-E4-openai-prompt-cache-key

Tejas Chopra2fc73d0f7324