graff — a fast agentic coding harness in Zig: multi-provider, MCP, workflows, DGM evolution loop, TS/Python SDKs
Python
<!doctype html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>Graff live evals — 12 gated PRs on grok-4.6</title>
<style>
:root {
--page: #fafaf8; --ink: #18231e; --ink-2: #526157; --ink-3: #737f75;
--accent: #059669; --accent-ink: #047857; --tint: #e3f3e9; --line: #d5e0d8;
--coral: #c2410c;
}
* { box-sizing: border-box; }
body {
margin: 0; background:
radial-gradient(circle at 8% -8%, rgba(5,150,105,.12), transparent 28rem),
var(--page);
color: var(--ink);
font: 16px/1.55 Inter, ui-sans-serif, system-ui, sans-serif;
}
.shell { width: min(1080px, calc(100% - 40px)); margin: 0 auto; padding: 36px 0 72px; }
.kicker { color: var(--accent); font-size: 12px; font-weight: 700; letter-spacing: .18em; text-transform: uppercase; }
h1 { font-size: clamp(32px, 5vw, 48px); letter-spacing: -.03em; line-height: 1.08; margin: 12px 0 8px; }
.sub { color: var(--ink-2); max-width: 720px; margin: 0 0 28px; }
.hero { width: 100%; border-radius: 20px; border: 1px solid var(--line); background: #fff; }
table { width: 100%; border-collapse: collapse; font-size: 14.5px; margin: 18px 0 8px; }
th, td { text-align: left; padding: 10px 12px; border-bottom: 1px solid var(--line); }
th { color: var(--ink-3); font-size: 11px; letter-spacing: .08em; text-transform: uppercase; }
td.num { font-variant-numeric: tabular-nums; }
.panel { background: #fff; border: 1px solid var(--line); border-radius: 20px; padding: 22px 24px; margin: 22px 0; }
.panel h2 { margin: 0 0 8px; font-size: 20px; }
.muted { color: var(--ink-2); font-size: 14px; }
code { color: var(--accent-ink); font-size: 13px; }
ul { color: var(--ink-2); }
a { color: var(--accent-ink); }
</style>
</head>
<body>
<div class="shell">
<div class="kicker">Graff · live evals · 2026-09-09</div>
<h1>12 gated PRs. Same SuperGrok seat.</h1>
<p class="sub">
Five harnesses, one model (<strong>grok-4.6</strong>), no SPEC.md.
Task pass is ≥2/3. Honest list$ is the official low band on passing
reps of passing tasks. SuperGrok cash is $0.
</p>
<img class="hero" src="../artifacts/graff-evals-live/live-20260909.svg" alt="Live eval board: graff 12/12 $21.48, grok 11/12 $33.69, OpenCode 12/12 $25.71, Pi 12/12 $18.47, exo 9/12 $16.01">
<div class="panel">
<h2>Board</h2>
<p class="muted">Failed tasks contribute $0. A check-green with no tokens does not count.</p>
<table>
<thead><tr><th>Harness</th><th>Real reps</th><th>Tasks</th><th>Honest list$</th><th>Mean wall</th></tr></thead>
<tbody>
<tr><td><strong>graff</strong></td><td class="num">35/36</td><td class="num">12/12</td><td class="num">$21.48</td><td class="num">264s</td></tr>
<tr><td>grok</td><td class="num">33/36</td><td class="num">11/12</td><td class="num">$33.69</td><td class="num">362s</td></tr>
<tr><td>OpenCode</td><td class="num">36/36</td><td class="num">12/12</td><td class="num">$25.71</td><td class="num">309s</td></tr>
<tr><td>Pi</td><td class="num">35/36</td><td class="num">12/12</td><td class="num">$18.47</td><td class="num">334s</td></tr>
<tr><td>exo</td><td class="num">25/36</td><td class="num">9/12</td><td class="num">$16.01</td><td class="num">281s</td></tr>
</tbody>
</table>
</div>
<div class="panel">
<h2>How to read it</h2>
<ul>
<li>Only <code>graff-195</code> is G1–G6 certified. The other 11 are published live tasks.</li>
<li>Grok drops <code>graff-727</code> (1/3). exo drops <code>graff-gemini-ix</code> plus <code>turbo-ws-duplex</code> / <code>turbo-asgi</code> (wrapper exit 1 in <1s, no tokens).</li>
<li>Stored JSONL <code>list$</code> high-bands the rep sum. Do not tweet that column.</li>
<li>Wall is a hang detector. Do not score Graff first-token (boot <code>›</code>).</li>
<li>This is not the in-house SPEC.md suite on the README (those are $0.32-class fixtures).</li>
</ul>
<p class="muted">Receipt and rebuild: <a href="../artifacts/graff-evals-live/RECEIPT.md">artifacts/graff-evals-live/RECEIPT.md</a> · <code>python3 graff-evals/plot_live.py --from-jsonl</code></p>
</div>
</div>
</body>
</html>