Skip to content

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

Merge pull request #272 from chopratejas/rust-stage-2.1-hf-hub

Tejas Choprac275567d9407