Skip to content

graff — a fast agentic coding harness in Zig: multi-provider, MCP, workflows, DGM evolution loop, TS/Python SDKs

Python
788 B
Raw Blame

Codegraff v0.302.33

Claude sessions in a new repo start from the prompt cache.

A new repo reads the cache

On the Anthropic API, graff caches its tools and instructions so later requests read them at a tenth of the price. The project layout sat at the end of that cached block, so a repo the cache had not seen yet missed all of it, and the first request wrote the whole ~10k-token prefix at 1.25x.

The cache boundary now ends before the project instructions and layout. Every repo shares the tools and instructions, and only the repo's own part is written. Measured on Claude Sonnet 5.5, the first session in an unseen repo wrote 1.2k cache tokens instead of 10.1k and cost $0.017 instead of $0.033. The text graff sends is unchanged; only where the cache breakpoint sits moved.