Skip to content

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

Commits on main

chore: release 0.38.0
JD Davis committed 1 month ago
94206e2
6f404de
545f544
fix(proxy): enforce budget limits on OpenAI and Gemini routes (#3579)
Johnny Wilson Dougherty committed 2 months ago
f734c57
ci: bump github/codeql-action from 3 to 4 (#3626)
dependabot[bot] committed 2 months ago
13536db