graff — a fast agentic coding harness in Zig: multi-provider, MCP, workflows, DGM evolution loop, TS/Python SDKs
Plugin out-of-box inspect eval
Unit tests in src/plugins.zig call discover / mergeMcp directly. They
cannot tell you whether graff mcp list and graff plugins see the same
trees a session would, honor GRAFF_NO_PLUGINS, or keep graff's own
~/.codegraff/mcp.json ahead of a colliding plugin name.
This environment builds a fake $HOME with a Cursor cache plugin (manifest
name, not the content-hash folder), a Claude plugin, a personal
~/.cursor/mcp.json, and a graff global that overrides a shared server
name. The verifier is the real binary. No provider calls.
zig build
python3 evals/plugins_oob/run.py --self-test
python3 evals/plugins_oob/test_eval.py
What it guards:
- Plugin MCP names appear on
graff mcp list. - A graff global wins a shared name (plugin command must not leak).
- Claude inline
mcpServersland, and${CLAUDE_PLUGIN_ROOT}expands. GRAFF_NO_PLUGINS=1hides plugin and foreign-harness names only.graff pluginsprints the manifest name, not the Cursor cache hash.- Claude
commands/is listed;graff plugins load eval-claudenames it. - The same opt-out prints
GRAFF_NO_PLUGINSongraff plugins.
MCP fixtures use command: /bin/false so a mistaken connect cannot hang on
a remote URL. --yolo is not passed; list/inspect never start servers.