Skip to content

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

test(gemini): serve the memory-tail tests' body through request.stream() (#4645)

Kenneth Wongfbe1434b3b4f