Skip to content

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

Commits on main

84bd992
c6b7f18
1de32b1
c39d9fe
e355476
19fc49a
fix: release image router models after compression
Wei Alexander Xin committed 7 months ago
cf60882
d34658b