Skip to content

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

Merge pull request #436 from chopratejas/fix/sse-usage-recovery-on-truncated-stream

Tejas Choprab166bd3d6a9b