Skip to content

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

Commits on main

d0e9c4c
5eaf24e
0ef7b2a
perf: add savings audit output (#1211)
akothari-godaddy committed 1 month ago
9a72bc0