Skip to content

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

Commits on main

603f5bc
Extract memory injection mode policy (#1986)
JD Davis committed 4 months ago
e2ba09a
Extract query log policy (#1984)
JD Davis committed 4 months ago
d45748d
Extract diagnostic decode policy (#1981)
JD Davis committed 4 months ago
7fb9209
Extract wire debug format policy (#1978)
JD Davis committed 4 months ago
41ce14b
ec3c3cd
9c7b9d5
d6259b2
1000175
7c9a032
d1c484b
Extract SSE byte buffer policy (#1979)
JD Davis committed 4 months ago
b910ce5
868b88b
Extract wire debug redaction policy (#1972)
JD Davis committed 4 months ago
4640587
c904a70
2c9eb7c
ad9d086
deps: bump prometheus from 0.13.4 to 0.14.0 (#1518)
dependabot[bot] committed 4 months ago
5229c98