graff — a fast agentic coding harness in Zig: multi-provider, MCP, workflows, DGM evolution loop, TS/Python SDKs
Python
Integrate main before the next stable release
Rach Pradhan1114275afa0e
diff --cc docs/adr/README.mdindex ccd39687,2a59af18..f18431c4--- a/docs/adr/README.md+++ b/docs/adr/README.md@@@ -315,11 -315,9 +315,14 @@@ record only when you need the evidence| [0295](0295-worker-native-turns-share-the-chat-step.md) | Experimental Worker-native turns share the native chat step; JSPI supplies bounded host I/O, not a proxy or a second agent loop. || [0296](0296-worker-tasks-own-remote-sandbox-cleanup.md) | Worker/DO tasks retain the agent loop and delegate Linux execution to remote sandboxes with explicit ownership, deletion and bounded leases. || [0297](0297-sdk-managed-replay-reuses-the-relay.md) | The fetch-only managed SDK reuses account relay/device tapes; prompt retries are explicit, durability limits are stated, and content-free OTLP export remains opt-in and observational. |+| [0298](0298-peer-send-wakes-are-bounded.md) | A `graff peer send` live wake is concurrent and bounded by one shared deadline; misses are reported and the durable room post still succeeds. |++| [0299](0299-conversation-history-forks-are-explicit.md) | `fork_from` explicitly snapshots current, project-local saved, or family-owned worker history into independent children; lightweight delegation stays the default and `retained` remains opt-in across subagents and workflows. |++| [0300](0300-workflow-synthesis-has-a-report-boundary.md) | Synthesis gets bounded evidence requests and a final report-only request; cancelled or exhausted workers are not restarted and failed stages retain prior evidence. |+ | [0298](0298-recurrence-reports-update-issue-state.md) | A current unresolved recurrence reopens the canonical resolved issue; comments alone do not complete reporting, intentional closures remain respected, and final state is verified. |+ | [0299](0299-tool-commands-launch-apps-in-the-background.md) | On macOS tool commands' `open` launches apps without activating them (a `-g` shim first on the tool PATH); `GRAFF_GUI_FOREGROUND=1` on a command is the explicit foreground opt-in. |+ | [0300](0300-a-session-shuts-down-the-simulators-it-booted.md) | Shell commands that look like simulator work are bracketed by booted-device snapshots; devices a session booted are leased under `~/.codegraff/simulators/` and shut down when the last live leaseholder ends, never devices booted before. `GRAFF_KEEP_SIMULATORS=1` opts out. |## When to write onediff --cc docs/releases/v0.302.50.mdindex 00000000,00000000..97a355c8new file mode 100644--- /dev/null+++ b/docs/releases/v0.302.50.md@@@ -1,0 -1,0 +1,18 @@@++# Codegraff v0.302.50++++## Continue conversations in new directions++++- `/fork` and ACP `session/fork` create an independent conversation while leaving the original available to resume.++- Subagents and workflows can explicitly fork history from the current conversation, a project-local saved session, or a retained worker.++- Retained workers can continue their own history or become the source of independent fan-out. Ordinary delegation stays lightweight; retaining a worker remains opt-in.++++## Keep workflows moving toward a report++++- Synthesis has a bounded evidence-gathering phase followed by a tool-free reporting request, rather than investigating indefinitely.++- Cancelled or exhausted synthesis workers are not automatically restarted.++- If the final stage fails, earlier findings remain available and are clearly marked incomplete.++- Repeated-tool guards survive worker retries and catch equivalent repeated reads.++++## Reliability++++This release also incorporates the current main-branch fixes for cancellation, peer-message delivery, platform cleanup, and regression-test stability.diff --cc evals/harness_behavior.jsonlindex 4a6cd036,65e08e49..3b59414d--- a/evals/harness_behavior.jsonl+++ b/evals/harness_behavior.jsonl@@@ -134,10 -134,19 +134,26 @@@{"id": "headless-server-does-not-hold", "why": "Run until idle: a server never reports, so a turn that leaves one running in the background ends instead of waiting on it.", "env": {"GRAFF_NO_CODEDB_GUARD": "1", "GRAFF_HEARTBEAT_SECS": "1"}, "prompt": "Start the dev server in the background and confirm it launched.", "script": [{"tool": "bash", "arguments": {"command": "python3 -m http.server 0 --bind 127.0.0.1", "run_in_background": true}}, {"text": "The dev server is running."}], "assert": [{"request_count": 2}, {"final_text_contains": "The dev server is running."}]}{"id": "claude-conversation-import-resume", "why": "Imported history uses the configured graff route without Claude credentials, retaining dialogue and historical tool results.", "env": {"ANTHROPIC_API_KEY": ""}, "args": ["--resume", "claude-import-fixture"], "claude_transcripts": {"import-fixture.jsonl": "{\"type\": \"user\", \"uuid\": \"u1\", \"message\": {\"content\": \"import-retained-question-1495\"}}\n{\"type\": \"assistant\", \"uuid\": \"a1\", \"message\": {\"model\": \"claude-sonnet-4-5\", \"content\": [{\"type\": \"thinking\", \"thinking\": \"import-private-thinking-1495\", \"signature\": \"signed\"}, {\"type\": \"text\", \"text\": \"import-retained-answer-1495\"}, {\"type\": \"tool_use\", \"id\": \"tool-import-1495\", \"name\": \"Bash\", \"input\": {\"command\": \"echo imported\"}}]}}\n{\"type\": \"user\", \"message\": {\"content\": [{\"type\": \"tool_result\", \"tool_use_id\": \"tool-import-1495\", \"content\": \"import-retained-result-1495\"}]}}\n{\"type\": \"assistant\", \"isSidechain\": true, \"message\": {\"content\": [{\"type\": \"text\", \"text\": \"import-sidechain-1495\"}]}}\n{\"type\": \"assistant\", \"message\": {\"content\": [{\"type\": \"text\", \"text\": \"import-finished-1495\"}]}}\n"}, "controls_before_prompt": [{"type": "set_model", "provider": "lmstudio", "model": "mock"}], "prompt": "Continue the imported task.", "script": [{"text": "Imported history is available."}], "assert": [{"request_contains": {"index": 0, "text": "import-retained-question-1495"}}, {"request_contains": {"index": 0, "text": "import-retained-answer-1495"}}, {"request_contains": {"index": 0, "text": "import-retained-result-1495"}}, {"request_contains": {"index": 0, "text": "import-finished-1495"}}, {"request_lacks": {"index": 0, "text": "import-private-thinking-1495"}}, {"request_lacks": {"index": 0, "text": "import-sidechain-1495"}}, {"final_text_contains": "Imported history is available."}]}{"id": "screenshot-handoff-preserves-open-work-1531", "why": "#1531: a screenshot needed on the next prompt must end the current turn without a pause question, completion claim, verifier approval, or open-work retry, and resume with the unfinished checklist intact.", "args": ["--no-lean", "--goal", "fix the control after visual identification", "--eval", "printf \"0\\n\""], "prompt": "The question interface accepts text only. A screenshot is essential to identify the control. Stop this turn so I can attach it to my next prompt.", "second_prompt": "Continue with the new input. Read back the unfinished checklist before proceeding.", "script": [{"tool": "todo_write", "arguments": {"todos": [{"content": "identify the control from the screenshot", "status": "in_progress"}]}}, {"tool": "eval", "arguments": {}}, {"tool": "yield_turn", "arguments": {"message": "Stopping this turn so you can attach the screenshot to your next prompt. The task remains unfinished."}}, {"tool": "todo_read", "arguments": {}}, {"tool": "yield_turn", "arguments": {"message": "The checklist still has the unfinished visual identification item; this turn is stopping until the missing input arrives."}}], "assert": [{"request_contains": {"index": 0, "text": "explicitly supports attachments in question replies"}}, {"request_contains": {"index": 0, "text": "Do not ask for permission to pause"}}, {"request_lacks": {"index": 0, "text": "typed text and/or pasted images"}}, {"event": {"type": "turn", "api_calls": 3, "complete": true, "text": "Stopping this turn so you can attach the screenshot to your next prompt. The task remains unfinished."}}, {"events_at_least": {"match": {"type": "turn"}, "count": 2}}, {"events_at_most": {"match": {"type": "turn"}, "count": 2}}, {"no_event": {"type": "ask_user"}}, {"no_event": {"type": "tool_call", "name": "attempt_completion"}}, {"request_contains": {"index": 4, "text": "identify the control from the screenshot"}}, {"request_contains": {"index": 4, "text": "in_progress"}}, {"request_lacks": {"index": 4, "text": "Open-work reconciliation"}}, {"final_text_contains": "checklist still has the unfinished"}]}+{"id": "repeat-identical-call-stops-the-turn", "why": "#1706: the same call with the same result must not repeat without bound. The 4th identical batch carries the no-progress notice (the 3rd does not), and the 8th ends the turn with the stop text, so the 9th request is never sent.", "prompt": "Check the box.", "script": [{"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"text": "never reached"}], "assert": [{"request_lacks": {"index": 3, "text": "times in a row"}}, {"request_contains": {"index": 4, "text": "times in a row"}}, {"request_count": 8}, {"final_text_contains": "Stopped: the model repeated the same tool call"}]}+{"id": "varying-calls-do-not-trip-the-repeat-guard", "why": "#1706 counterfactual: ten calls that differ in input all run, no notice is sent, and the turn ends on the model's own reply.", "prompt": "Run the steps.", "script": [{"tool": "bash", "arguments": {"command": "echo step 0"}}, {"tool": "bash", "arguments": {"command": "echo step 1"}}, {"tool": "bash", "arguments": {"command": "echo step 2"}}, {"tool": "bash", "arguments": {"command": "echo step 3"}}, {"tool": "bash", "arguments": {"command": "echo step 4"}}, {"tool": "bash", "arguments": {"command": "echo step 5"}}, {"tool": "bash", "arguments": {"command": "echo step 6"}}, {"tool": "bash", "arguments": {"command": "echo step 7"}}, {"tool": "bash", "arguments": {"command": "echo step 8"}}, {"tool": "bash", "arguments": {"command": "echo step 9"}}, {"text": "all steps ran"}], "assert": [{"request_count": 11}, {"request_lacks": {"index": -1, "text": "times in a row"}}, {"final_text_contains": "all steps ran"}]}+{"id": "repeat-identical-call-stops-a-workflow-synthesis-child", "why": "#1706: the guard sits in the shared turn loop, so a workflow child gets it too. The sweep phase reports, then the synthesis child repeats one call with one result; its 8th batch ends its turn and the parent reads the stop text as the synthesis result instead of the child running on.", "args": [], "prompt": "how does configuration discovery work", "script": [{"tool": "workflow", "arguments": {"phases": [{"title": "sweep config sources", "tasks": [{"description": "sweep-config", "prompt": "search for configuration discovery behavior", "isolation": "shared_cwd"}]}, {"title": "synthesize findings", "tasks": [{"description": "summary", "prompt": "summarize the findings from {{prev}}", "isolation": "shared_cwd"}]}]}}, {"text": "SWEEP-OK"}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"text": "the parent read the synthesis stop"}], "assert": [{"request_lacks": {"index": 5, "text": "times in a row"}}, {"request_contains": {"index": 6, "text": "times in a row"}}, {"request_count": 11}, {"request_contains": {"index": -1, "text": "Stopped: the model repeated the same tool call"}}, {"final_text_contains": "the parent read the synthesis stop"}], "timeout_s": 120}+{"id": "repeat-guard-survives-a-worker-retry", "why": "#1706: a worker's transient-failure re-ask resumes the same history through a fresh runTurn. The identical-batch count must carry over, or each re-ask buys the loop up to seven more batches. Five batches, a failed ask, then the 8th batch overall ends the worker.", "args": [], "prompt": "how does the loader decide which config source wins", "script": [{"tool": "workflow", "arguments": {"phases": [{"title": "sweep config sources", "tasks": [{"description": "sweep-config", "prompt": "search for how the loader picks a config source", "isolation": "shared_cwd"}]}]}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"http_status": 418, "error": "scripted flake"}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"text": "the parent read the worker stop"}], "assert": [{"request_count": 11}, {"request_contains": {"index": -1, "text": "Stopped: the model repeated the same tool call"}}, {"final_text_contains": "the parent read the worker stop"}], "timeout_s": 120}+{"id": "repeat-guard-survives-a-stream-retry", "why": "#1706: a request-layer retry after a mid-stream failure stays inside the turn and must not reset the identical-batch count. Five batches, one failed stream, then the 8th batch overall ends the turn.", "prompt": "Check the box.", "script": [{"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"text": "partial", "stream_error": {"type": "api_error", "message": "Internal error during token parsing"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"tool": "bash", "arguments": {"command": "echo ok"}}, {"text": "never reached"}], "assert": [{"request_count": 9}, {"final_text_contains": "Stopped: the model repeated the same tool call"}]}+{"id": "reworded-call-same-result-stops-the-turn", "why": "#1706: a live model dodged the identical-call guard by rewording one poll (`cat ./status.txt`, `cat 'status.txt'`, `cat -- status.txt`...) while the result never changed. The same tool returning the same result is the signal: the 6th such batch carries the reworded notice and the 12th ends the turn.", "prompt": "Wait for the deploy in status.txt.", "workspace_seed": {"status.txt": "PENDING\n"}, "script": [{"tool": "bash", "arguments": {"command": "cat status.txt"}}, {"tool": "bash", "arguments": {"command": "cat ./status.txt"}}, {"tool": "bash", "arguments": {"command": "cat status.txt"}}, {"tool": "bash", "arguments": {"command": "cat 'status.txt'"}}, {"tool": "bash", "arguments": {"command": "cat \"status.txt\""}}, {"tool": "bash", "arguments": {"command": "cat -- status.txt"}}, {"tool": "bash", "arguments": {"command": "cat -- ./status.txt"}}, {"tool": "bash", "arguments": {"command": "cat .//status.txt"}}, {"tool": "bash", "arguments": {"command": "cat ././status.txt"}}, {"tool": "bash", "arguments": {"command": "cat -- 'status.txt'"}}, {"tool": "bash", "arguments": {"command": "cat './status.txt'"}}, {"tool": "bash", "arguments": {"command": "cat ./././status.txt"}}, {"text": "never reached"}], "assert": [{"request_lacks": {"index": 5, "text": "only the wording of the call changed"}}, {"request_contains": {"index": 6, "text": "only the wording of the call changed"}}, {"request_lacks": {"index": -1, "text": "times in a row. Repeating it"}}, {"request_count": 12}, {"final_text_contains": "Stopped: the model got the same tool result 12 times in a row"}]}+{"id": "quiet-commands-do-not-trip-the-repeat-guard", "why": "#1706 counterfactual: commands that print nothing return the same `(no output)` text, but a run of them is ordinary work. Fourteen different quiet commands all run and the turn ends on the model's own reply.", "prompt": "Make the directories.", "script": [{"tool": "bash", "arguments": {"command": "mkdir -p d0"}}, {"tool": "bash", "arguments": {"command": "mkdir -p d1"}}, {"tool": "bash", "arguments": {"command": "mkdir -p d2"}}, {"tool": "bash", "arguments": {"command": "mkdir -p d3"}}, {"tool": "bash", "arguments": {"command": "mkdir -p d4"}}, {"tool": "bash", "arguments": {"command": "mkdir -p d5"}}, {"tool": "bash", "arguments": {"command": "mkdir -p d6"}}, {"tool": "bash", "arguments": {"command": "mkdir -p d7"}}, {"tool": "bash", "arguments": {"command": "mkdir -p d8"}}, {"tool": "bash", "arguments": {"command": "mkdir -p d9"}}, {"tool": "bash", "arguments": {"command": "mkdir -p d10"}}, {"tool": "bash", "arguments": {"command": "mkdir -p d11"}}, {"tool": "bash", "arguments": {"command": "mkdir -p d12"}}, {"tool": "bash", "arguments": {"command": "mkdir -p d13"}}, {"text": "all directories made"}], "assert": [{"request_count": 15}, {"request_lacks": {"index": -1, "text": "in a row"}}, {"final_text_contains": "all directories made"}]}+ {"id": "issue-recurrence-resolved-reopen", "why": "#1701: resolved-reopen. Deterministic scripted policy-delivery and local CLI roundtrip coverage; not live-model judgment. Independent issue-state and mutation assertions reject missing reopens, duplicate creation and inaccurate final-state claims.", "scripted_only": true, "args": ["--old"], "env": {"GRAFF_NO_CODEDB_GUARD": "1", "GRAFF_AUTO_ISOLATE": "off"}, "github_fixture": {"repo": "fixture/primary", "issues": {"101": {"number": 101, "title": "recurrence fixture", "body": "Previously fixed fixture recurrence.", "state": "CLOSED", "stateReason": "COMPLETED", "comments": [], "url": "https://github.com/fixture/primary/issues/101"}}}, "workspace_seed": {"recurrence.md": "**graff:** fixture (latest: fixture)\n**Harness:** not used\n**Surface:** terminal\n**Platform:** fixture\n\n## Symptom\nThe fixture failure recurs on the current fixture release.\n\n## Repro\nRepeat the local fixture operation.\n"}, "prompt": "Report the current fixture recurrence against the existing local tracker issue. Search both open and closed issues, inspect the closure reason and canonical issue, preserve the new evidence and verify the final state. Use only the installed local gh fixture.", "script": [{"tool": "bash", "arguments": {"command": "gh issue list --repo fixture/primary --state all --search 'recurrence fixture' --json number,title,body,state,stateReason"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"tool": "bash", "arguments": {"command": "gh issue reopen 101 --repo fixture/primary"}}, {"tool": "bash", "arguments": {"command": "gh issue comment 101 --repo fixture/primary --body-file recurrence.md"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"text": "Issue #101 is OPEN; recurrence evidence saved and final state verified."}], "verify_command": ["python3", "-c", "import json,pathlib\np=pathlib.Path\nexpected=json.loads('{\"101\": {\"number\": 101, \"title\": \"recurrence fixture\", \"body\": \"Previously fixed fixture recurrence.\", \"state\": \"OPEN\", \"stateReason\": \"\", \"comments\": [{\"body\": \"**graff:** fixture (latest: fixture)\\\\n**Harness:** not used\\\\n**Surface:** terminal\\\\n**Platform:** fixture\\\\n\\\\n## Symptom\\\\nThe fixture failure recurs on the current fixture release.\\\\n\\\\n## Repro\\\\nRepeat the local fixture operation.\\\\n\"}], \"url\": \"https://github.com/fixture/primary/issues/101\", \"closedAt\": null}}')\ns=json.loads(p('gh-state.json').read_text())\nassert s['issues']==expected, ('issue state/evidence mismatch',s['issues'],expected)\nrows=[json.loads(x) for x in p('gh-argv.jsonl').read_text().splitlines()]\nops=[r for r in rows if r[:1]==['issue']]\nmutations=[json.loads(x) for x in p('mutations.jsonl').read_text().splitlines()] if p('mutations.jsonl').exists() else []\nassert [(r[1],r[2]) for r in mutations]==[('reopen', '101'), ('comment', '101')], ('unexpected mutation/duplicate/reopen',mutations)\nassert any(r[:2]==['issue','list'] and '--state' in r and r[r.index('--state')+1]=='all' for r in ops), 'must search open and closed issues'\nassert any(r[:3]==['issue','view',str(101)] for r in ops), 'must inspect canonical issue'\nassert ops[-1][:3]==['issue','view',str(101)], 'must confirm final state after mutations'\nassert max(i for i,r in enumerate(ops) if r[1] in ('comment','reopen','create')) < len(ops)-1, 'state read must follow mutation'\nprint('Independent issue state, evidence, mutations and final state lookup verified')\n"], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"request_contains": {"index": -1, "text": "OPEN"}}, {"final_text_contains": "Issue #101 is OPEN; recurrence evidence saved and final state verified."}, {"events_at_least": {"match": {"type": "tool_call", "name": "bash"}, "count": 5}}, {"events_at_most": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 0}}]}+ {"id": "issue-recurrence-already-open", "why": "#1701: already-open. Deterministic scripted policy-delivery and local CLI roundtrip coverage; not live-model judgment. Independent issue-state and mutation assertions reject missing reopens, duplicate creation and inaccurate final-state claims.", "scripted_only": true, "args": ["--old"], "env": {"GRAFF_NO_CODEDB_GUARD": "1", "GRAFF_AUTO_ISOLATE": "off"}, "github_fixture": {"repo": "fixture/primary", "issues": {"101": {"number": 101, "title": "recurrence fixture", "body": "Previously fixed fixture recurrence.", "state": "OPEN", "stateReason": "", "comments": [], "url": "https://github.com/fixture/primary/issues/101"}}}, "workspace_seed": {"recurrence.md": "**graff:** fixture (latest: fixture)\n**Harness:** not used\n**Surface:** terminal\n**Platform:** fixture\n\n## Symptom\nThe fixture failure recurs on the current fixture release.\n\n## Repro\nRepeat the local fixture operation.\n"}, "prompt": "Report the current fixture recurrence against the existing local tracker issue. Search both open and closed issues, inspect the closure reason and canonical issue, preserve the new evidence and verify the final state. Use only the installed local gh fixture.", "script": [{"tool": "bash", "arguments": {"command": "gh issue list --repo fixture/primary --state all --search 'recurrence fixture' --json number,title,body,state,stateReason"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"tool": "bash", "arguments": {"command": "gh issue comment 101 --repo fixture/primary --body-file recurrence.md"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"text": "Issue #101 remains OPEN; evidence saved without reopening or creating a duplicate."}], "verify_command": ["python3", "-c", "import json,pathlib\np=pathlib.Path\nexpected=json.loads('{\"101\": {\"number\": 101, \"title\": \"recurrence fixture\", \"body\": \"Previously fixed fixture recurrence.\", \"state\": \"OPEN\", \"stateReason\": \"\", \"comments\": [{\"body\": \"**graff:** fixture (latest: fixture)\\\\n**Harness:** not used\\\\n**Surface:** terminal\\\\n**Platform:** fixture\\\\n\\\\n## Symptom\\\\nThe fixture failure recurs on the current fixture release.\\\\n\\\\n## Repro\\\\nRepeat the local fixture operation.\\\\n\"}], \"url\": \"https://github.com/fixture/primary/issues/101\"}}')\ns=json.loads(p('gh-state.json').read_text())\nassert s['issues']==expected, ('issue state/evidence mismatch',s['issues'],expected)\nrows=[json.loads(x) for x in p('gh-argv.jsonl').read_text().splitlines()]\nops=[r for r in rows if r[:1]==['issue']]\nmutations=[json.loads(x) for x in p('mutations.jsonl').read_text().splitlines()] if p('mutations.jsonl').exists() else []\nassert [(r[1],r[2]) for r in mutations]==[('comment', '101')], ('unexpected mutation/duplicate/reopen',mutations)\nassert any(r[:2]==['issue','list'] and '--state' in r and r[r.index('--state')+1]=='all' for r in ops), 'must search open and closed issues'\nassert any(r[:3]==['issue','view',str(101)] for r in ops), 'must inspect canonical issue'\nassert ops[-1][:3]==['issue','view',str(101)], 'must confirm final state after mutations'\nassert max(i for i,r in enumerate(ops) if r[1] in ('comment','reopen','create')) < len(ops)-1, 'state read must follow mutation'\nprint('Independent issue state, evidence, mutations and final state lookup verified')\n"], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"request_contains": {"index": -1, "text": "OPEN"}}, {"final_text_contains": "Issue #101 remains OPEN; evidence saved without reopening or creating a duplicate."}, {"events_at_least": {"match": {"type": "tool_call", "name": "bash"}, "count": 4}}, {"events_at_most": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 0}}]}+ {"id": "issue-recurrence-duplicate-open-canonical", "why": "#1701: duplicate-open-canonical. Deterministic scripted policy-delivery and local CLI roundtrip coverage; not live-model judgment. Independent issue-state and mutation assertions reject missing reopens, duplicate creation and inaccurate final-state claims.", "scripted_only": true, "args": ["--old"], "env": {"GRAFF_NO_CODEDB_GUARD": "1", "GRAFF_AUTO_ISOLATE": "off"}, "github_fixture": {"repo": "fixture/primary", "issues": {"101": {"number": 101, "title": "recurrence fixture", "body": "Previously fixed fixture recurrence.", "state": "OPEN", "stateReason": "", "comments": [], "url": "https://github.com/fixture/primary/issues/101"}, "102": {"number": 102, "title": "recurrence fixture", "body": "Duplicate of #101; canonical issue is https://github.com/fixture/primary/issues/101.", "state": "CLOSED", "stateReason": "DUPLICATE", "comments": [], "url": "https://github.com/fixture/primary/issues/102"}}}, "workspace_seed": {"recurrence.md": "**graff:** fixture (latest: fixture)\n**Harness:** not used\n**Surface:** terminal\n**Platform:** fixture\n\n## Symptom\nThe fixture failure recurs on the current fixture release.\n\n## Repro\nRepeat the local fixture operation.\n"}, "prompt": "Report the current fixture recurrence against the existing local tracker issue. Search both open and closed issues, inspect the closure reason and canonical issue, preserve the new evidence and verify the final state. Use only the installed local gh fixture.", "script": [{"tool": "bash", "arguments": {"command": "gh issue list --repo fixture/primary --state all --search 'recurrence fixture' --json number,title,body,state,stateReason"}}, {"tool": "bash", "arguments": {"command": "gh issue view 102 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"tool": "bash", "arguments": {"command": "gh issue comment 101 --repo fixture/primary --body-file recurrence.md"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"text": "Canonical issue #101 is OPEN with the new evidence; duplicate #102 remains CLOSED and was not reopened."}], "verify_command": ["python3", "-c", "import json,pathlib\np=pathlib.Path\nexpected=json.loads('{\"101\": {\"number\": 101, \"title\": \"recurrence fixture\", \"body\": \"Previously fixed fixture recurrence.\", \"state\": \"OPEN\", \"stateReason\": \"\", \"comments\": [{\"body\": \"**graff:** fixture (latest: fixture)\\\\n**Harness:** not used\\\\n**Surface:** terminal\\\\n**Platform:** fixture\\\\n\\\\n## Symptom\\\\nThe fixture failure recurs on the current fixture release.\\\\n\\\\n## Repro\\\\nRepeat the local fixture operation.\\\\n\"}], \"url\": \"https://github.com/fixture/primary/issues/101\"}, \"102\": {\"number\": 102, \"title\": \"recurrence fixture\", \"body\": \"Duplicate of #101; canonical issue is https://github.com/fixture/primary/issues/101.\", \"state\": \"CLOSED\", \"stateReason\": \"DUPLICATE\", \"comments\": [], \"url\": \"https://github.com/fixture/primary/issues/102\"}}')\ns=json.loads(p('gh-state.json').read_text())\nassert s['issues']==expected, ('issue state/evidence mismatch',s['issues'],expected)\nrows=[json.loads(x) for x in p('gh-argv.jsonl').read_text().splitlines()]\nops=[r for r in rows if r[:1]==['issue']]\nmutations=[json.loads(x) for x in p('mutations.jsonl').read_text().splitlines()] if p('mutations.jsonl').exists() else []\nassert [(r[1],r[2]) for r in mutations]==[('comment', '101')], ('unexpected mutation/duplicate/reopen',mutations)\nassert any(r[:2]==['issue','list'] and '--state' in r and r[r.index('--state')+1]=='all' for r in ops), 'must search open and closed issues'\nassert any(r[:3]==['issue','view',str(101)] for r in ops), 'must inspect canonical issue'\nassert ops[-1][:3]==['issue','view',str(101)], 'must confirm final state after mutations'\nassert max(i for i,r in enumerate(ops) if r[1] in ('comment','reopen','create')) < len(ops)-1, 'state read must follow mutation'\nprint('Independent issue state, evidence, mutations and final state lookup verified')\n"], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"request_contains": {"index": -1, "text": "OPEN"}}, {"final_text_contains": "Canonical issue #101 is OPEN with the new evidence; duplicate #102 remains CLOSED and was not reopened."}, {"events_at_least": {"match": {"type": "tool_call", "name": "bash"}, "count": 5}}, {"events_at_most": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 0}}, {"request_contains": {"index": 2, "text": "Duplicate of #101"}}]}+ {"id": "issue-recurrence-denied-reopen", "why": "#1701: denied-reopen. Deterministic scripted policy-delivery and local CLI roundtrip coverage; not live-model judgment. Independent issue-state and mutation assertions reject missing reopens, duplicate creation and inaccurate final-state claims.", "scripted_only": true, "args": ["--old"], "env": {"GRAFF_NO_CODEDB_GUARD": "1", "GRAFF_AUTO_ISOLATE": "off"}, "github_fixture": {"repo": "fixture/primary", "issues": {"101": {"number": 101, "title": "recurrence fixture", "body": "Previously fixed fixture recurrence.", "state": "CLOSED", "stateReason": "COMPLETED", "comments": [], "url": "https://github.com/fixture/primary/issues/101", "deny_reopen": true}}}, "workspace_seed": {"recurrence.md": "**graff:** fixture (latest: fixture)\n**Harness:** not used\n**Surface:** terminal\n**Platform:** fixture\n\n## Symptom\nThe fixture failure recurs on the current fixture release.\n\n## Repro\nRepeat the local fixture operation.\n"}, "prompt": "Report the current fixture recurrence against the existing local tracker issue. Search both open and closed issues, inspect the closure reason and canonical issue, preserve the new evidence and verify the final state. Use only the installed local gh fixture.", "script": [{"tool": "bash", "arguments": {"command": "gh issue list --repo fixture/primary --state all --search 'recurrence fixture' --json number,title,body,state,stateReason"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"tool": "bash", "arguments": {"command": "gh issue reopen 101 --repo fixture/primary"}}, {"tool": "bash", "arguments": {"command": "gh issue comment 101 --repo fixture/primary --body-file recurrence.md"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"text": "Evidence saved on #101, but reopen was denied by permissions. Verified final state: CLOSED. A maintainer must reopen it; the recurrence report is not complete."}], "verify_command": ["python3", "-c", "import json,pathlib\np=pathlib.Path\nexpected=json.loads('{\"101\": {\"number\": 101, \"title\": \"recurrence fixture\", \"body\": \"Previously fixed fixture recurrence.\", \"state\": \"CLOSED\", \"stateReason\": \"COMPLETED\", \"comments\": [{\"body\": \"**graff:** fixture (latest: fixture)\\\\n**Harness:** not used\\\\n**Surface:** terminal\\\\n**Platform:** fixture\\\\n\\\\n## Symptom\\\\nThe fixture failure recurs on the current fixture release.\\\\n\\\\n## Repro\\\\nRepeat the local fixture operation.\\\\n\"}], \"url\": \"https://github.com/fixture/primary/issues/101\", \"deny_reopen\": true}}')\ns=json.loads(p('gh-state.json').read_text())\nassert s['issues']==expected, ('issue state/evidence mismatch',s['issues'],expected)\nrows=[json.loads(x) for x in p('gh-argv.jsonl').read_text().splitlines()]\nops=[r for r in rows if r[:1]==['issue']]\nmutations=[json.loads(x) for x in p('mutations.jsonl').read_text().splitlines()] if p('mutations.jsonl').exists() else []\nassert [(r[1],r[2]) for r in mutations]==[('reopen', '101'), ('comment', '101')], ('unexpected mutation/duplicate/reopen',mutations)\nassert any(r[:2]==['issue','list'] and '--state' in r and r[r.index('--state')+1]=='all' for r in ops), 'must search open and closed issues'\nassert any(r[:3]==['issue','view',str(101)] for r in ops), 'must inspect canonical issue'\nassert ops[-1][:3]==['issue','view',str(101)], 'must confirm final state after mutations'\nassert max(i for i,r in enumerate(ops) if r[1] in ('comment','reopen','create')) < len(ops)-1, 'state read must follow mutation'\nprint('Independent issue state, evidence, mutations and final state lookup verified')\n"], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"request_contains": {"index": -1, "text": "CLOSED"}}, {"final_text_contains": "Evidence saved on #101, but reopen was denied by permissions. Verified final state: CLOSED. A maintainer must reopen it; the recurrence report is not complete."}, {"events_at_least": {"match": {"type": "tool_call", "name": "bash"}, "count": 5}}, {"event": {"type": "tool_call_finished", "name": "bash", "is_error": true}}, {"request_contains": {"index": 3, "text": "Resource not accessible by integration"}}]}+ {"id": "issue-recurrence-not-planned", "why": "#1701: not-planned. Deterministic scripted policy-delivery and local CLI roundtrip coverage; not live-model judgment. Independent issue-state and mutation assertions reject missing reopens, duplicate creation and inaccurate final-state claims.", "scripted_only": true, "args": ["--old"], "env": {"GRAFF_NO_CODEDB_GUARD": "1", "GRAFF_AUTO_ISOLATE": "off"}, "github_fixture": {"repo": "fixture/primary", "issues": {"101": {"number": 101, "title": "recurrence fixture", "body": "Closed intentionally as not planned; this behavior is rejected.", "state": "CLOSED", "stateReason": "NOT_PLANNED", "comments": [], "url": "https://github.com/fixture/primary/issues/101"}}}, "workspace_seed": {"recurrence.md": "**graff:** fixture (latest: fixture)\n**Harness:** not used\n**Surface:** terminal\n**Platform:** fixture\n\n## Symptom\nThe fixture failure recurs on the current fixture release.\n\n## Repro\nRepeat the local fixture operation.\n"}, "prompt": "Report the current fixture recurrence against the existing local tracker issue. Search both open and closed issues, inspect the closure reason and canonical issue, preserve the new evidence and verify the final state. Use only the installed local gh fixture.", "script": [{"tool": "bash", "arguments": {"command": "gh issue list --repo fixture/primary --state all --search 'recurrence fixture' --json number,title,body,state,stateReason"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"tool": "bash", "arguments": {"command": "gh issue comment 101 --repo fixture/primary --body-file recurrence.md"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"text": "Issue #101 remains CLOSED; evidence saved but not reopened because it was intentionally not planned."}], "verify_command": ["python3", "-c", "import json,pathlib\np=pathlib.Path\nexpected=json.loads('{\"101\": {\"number\": 101, \"title\": \"recurrence fixture\", \"body\": \"Closed intentionally as not planned; this behavior is rejected.\", \"state\": \"CLOSED\", \"stateReason\": \"NOT_PLANNED\", \"comments\": [{\"body\": \"**graff:** fixture (latest: fixture)\\\\n**Harness:** not used\\\\n**Surface:** terminal\\\\n**Platform:** fixture\\\\n\\\\n## Symptom\\\\nThe fixture failure recurs on the current fixture release.\\\\n\\\\n## Repro\\\\nRepeat the local fixture operation.\\\\n\"}], \"url\": \"https://github.com/fixture/primary/issues/101\"}}')\ns=json.loads(p('gh-state.json').read_text())\nassert s['issues']==expected, ('issue state/evidence mismatch',s['issues'],expected)\nrows=[json.loads(x) for x in p('gh-argv.jsonl').read_text().splitlines()]\nops=[r for r in rows if r[:1]==['issue']]\nmutations=[json.loads(x) for x in p('mutations.jsonl').read_text().splitlines()] if p('mutations.jsonl').exists() else []\nassert [(r[1],r[2]) for r in mutations]==[('comment', '101')], ('unexpected mutation/duplicate/reopen',mutations)\nassert any(r[:2]==['issue','list'] and '--state' in r and r[r.index('--state')+1]=='all' for r in ops), 'must search open and closed issues'\nassert any(r[:3]==['issue','view',str(101)] for r in ops), 'must inspect canonical issue'\nassert ops[-1][:3]==['issue','view',str(101)], 'must confirm final state after mutations'\nassert max(i for i,r in enumerate(ops) if r[1] in ('comment','reopen','create')) < len(ops)-1, 'state read must follow mutation'\nprint('Independent issue state, evidence, mutations and final state lookup verified')\n"], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"request_contains": {"index": -1, "text": "CLOSED"}}, {"final_text_contains": "Issue #101 remains CLOSED; evidence saved but not reopened because it was intentionally not planned."}, {"events_at_least": {"match": {"type": "tool_call", "name": "bash"}, "count": 4}}, {"events_at_most": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 0}}, {"request_contains": {"index": 2, "text": "NOT_PLANNED"}}]}+ {"id": "issue-recurrence-out-of-scope", "why": "#1701: out-of-scope. Deterministic scripted policy-delivery and local CLI roundtrip coverage; not live-model judgment. Independent issue-state and mutation assertions reject missing reopens, duplicate creation and inaccurate final-state claims.", "scripted_only": true, "args": ["--old"], "env": {"GRAFF_NO_CODEDB_GUARD": "1", "GRAFF_AUTO_ISOLATE": "off"}, "github_fixture": {"repo": "fixture/primary", "issues": {"101": {"number": 101, "title": "recurrence fixture", "body": "Closed intentionally: this feature is out of scope, not a resolved bug.", "state": "CLOSED", "stateReason": "NOT_PLANNED", "comments": [], "url": "https://github.com/fixture/primary/issues/101"}}}, "workspace_seed": {"recurrence.md": "**graff:** fixture (latest: fixture)\n**Harness:** not used\n**Surface:** terminal\n**Platform:** fixture\n\n## Symptom\nThe fixture failure recurs on the current fixture release.\n\n## Repro\nRepeat the local fixture operation.\n"}, "prompt": "Report the current fixture recurrence against the existing local tracker issue. Search both open and closed issues, inspect the closure reason and canonical issue, preserve the new evidence and verify the final state. Use only the installed local gh fixture.", "script": [{"tool": "bash", "arguments": {"command": "gh issue list --repo fixture/primary --state all --search 'recurrence fixture' --json number,title,body,state,stateReason"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"tool": "bash", "arguments": {"command": "gh issue comment 101 --repo fixture/primary --body-file recurrence.md"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"text": "Issue #101 remains CLOSED; evidence saved but not reopened because it was intentionally out of scope."}], "verify_command": ["python3", "-c", "import json,pathlib\np=pathlib.Path\nexpected=json.loads('{\"101\": {\"number\": 101, \"title\": \"recurrence fixture\", \"body\": \"Closed intentionally: this feature is out of scope, not a resolved bug.\", \"state\": \"CLOSED\", \"stateReason\": \"NOT_PLANNED\", \"comments\": [{\"body\": \"**graff:** fixture (latest: fixture)\\\\n**Harness:** not used\\\\n**Surface:** terminal\\\\n**Platform:** fixture\\\\n\\\\n## Symptom\\\\nThe fixture failure recurs on the current fixture release.\\\\n\\\\n## Repro\\\\nRepeat the local fixture operation.\\\\n\"}], \"url\": \"https://github.com/fixture/primary/issues/101\"}}')\ns=json.loads(p('gh-state.json').read_text())\nassert s['issues']==expected, ('issue state/evidence mismatch',s['issues'],expected)\nrows=[json.loads(x) for x in p('gh-argv.jsonl').read_text().splitlines()]\nops=[r for r in rows if r[:1]==['issue']]\nmutations=[json.loads(x) for x in p('mutations.jsonl').read_text().splitlines()] if p('mutations.jsonl').exists() else []\nassert [(r[1],r[2]) for r in mutations]==[('comment', '101')], ('unexpected mutation/duplicate/reopen',mutations)\nassert any(r[:2]==['issue','list'] and '--state' in r and r[r.index('--state')+1]=='all' for r in ops), 'must search open and closed issues'\nassert any(r[:3]==['issue','view',str(101)] for r in ops), 'must inspect canonical issue'\nassert ops[-1][:3]==['issue','view',str(101)], 'must confirm final state after mutations'\nassert max(i for i,r in enumerate(ops) if r[1] in ('comment','reopen','create')) < len(ops)-1, 'state read must follow mutation'\nprint('Independent issue state, evidence, mutations and final state lookup verified')\n"], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"request_contains": {"index": -1, "text": "CLOSED"}}, {"final_text_contains": "Issue #101 remains CLOSED; evidence saved but not reopened because it was intentionally out of scope."}, {"events_at_least": {"match": {"type": "tool_call", "name": "bash"}, "count": 4}}, {"events_at_most": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 0}}, {"request_contains": {"index": 2, "text": "NOT_PLANNED"}}]}+ {"id": "issue-recurrence-duplicate-closed-canonical", "why": "#1701: duplicate-closed-canonical. Scripted policy delivery and local issue-state roundtrip, not live-model judgment. Independent verifiers reject incorrect state, missing evidence, extra mutations and missing final reads.", "scripted_only": true, "args": ["--old"], "env": {"GRAFF_NO_CODEDB_GUARD": "1", "GRAFF_AUTO_ISOLATE": "off"}, "github_fixture": {"repo": "fixture/primary", "issues": {"101": {"number": 101, "title": "recurrence fixture", "body": "Previously fixed fixture recurrence.", "state": "CLOSED", "stateReason": "COMPLETED", "comments": [], "url": "https://github.com/fixture/primary/issues/101"}, "102": {"number": 102, "title": "recurrence fixture", "body": "Duplicate of #101. Follow the canonical tracking issue, not this copy.", "state": "CLOSED", "stateReason": "DUPLICATE", "comments": [], "url": "https://github.com/fixture/primary/issues/102"}}}, "workspace_seed": {"recurrence.md": "**graff:** fixture (latest: fixture)\n**Harness:** not used\n**Surface:** terminal\n**Platform:** fixture\n\n## Symptom\nThe fixture failure recurs on the current fixture release.\n\n## Repro\nRepeat the local fixture operation.\n"}, "prompt": "Report the supplied fixture findings using only the installed local gh. Inspect resolution and tested-version evidence, follow canonical duplicate tracking, avoid duplicate issues and report any failed operation accurately.", "script": [{"tool": "bash", "arguments": {"command": "gh issue list --repo fixture/primary --state all --search 'recurrence fixture' --json number,title,body,state,stateReason"}}, {"tool": "bash", "arguments": {"command": "gh issue view 102 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"tool": "bash", "arguments": {"command": "gh issue reopen 101 --repo fixture/primary"}}, {"tool": "bash", "arguments": {"command": "gh issue comment 101 --repo fixture/primary --body-file recurrence.md"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"text": "Canonical issue #101 is OPEN; evidence saved. Duplicate #102 remains CLOSED."}], "verify_command": ["python3", "-c", "import json,pathlib\np=pathlib.Path\nexpected=json.loads('{\"101\": {\"number\": 101, \"title\": \"recurrence fixture\", \"body\": \"Previously fixed fixture recurrence.\", \"state\": \"OPEN\", \"stateReason\": \"\", \"comments\": [{\"body\": \"**graff:** fixture (latest: fixture)\\\\n**Harness:** not used\\\\n**Surface:** terminal\\\\n**Platform:** fixture\\\\n\\\\n## Symptom\\\\nThe fixture failure recurs on the current fixture release.\\\\n\\\\n## Repro\\\\nRepeat the local fixture operation.\\\\n\"}], \"url\": \"https://github.com/fixture/primary/issues/101\", \"closedAt\": null}, \"102\": {\"number\": 102, \"title\": \"recurrence fixture\", \"body\": \"Duplicate of #101. Follow the canonical tracking issue, not this copy.\", \"state\": \"CLOSED\", \"stateReason\": \"DUPLICATE\", \"comments\": [], \"url\": \"https://github.com/fixture/primary/issues/102\"}}')\nstate=json.loads(p('gh-state.json').read_text())\nassert state['issues']==expected, ('issue state/evidence mismatch',state['issues'],expected)\nreads=[json.loads(x) for x in p('gh-argv.jsonl').read_text().splitlines()] if p('gh-argv.jsonl').exists() else []\nmutations=[json.loads(x) for x in p('mutations.jsonl').read_text().splitlines()] if p('mutations.jsonl').exists() else []\nassert [(r[1],r[2]) for r in mutations]==[('reopen', '101'), ('comment', '101')], ('incorrect mutations',mutations)\nassert any(r[:2]==['issue','list'] and '--state' in r and r[r.index('--state')+1]=='all' for r in reads), 'must search all states'\nassert reads[-1][:3]==['issue','view','101'], 'must attempt final canonical state lookup'\nassert '--json' in reads[-1] and 'state' in reads[-1][reads[-1].index('--json')+1].split(','), 'final read must include state'\nprint('Independent extended issue lifecycle verified')\n"], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"final_text_contains": "Canonical issue #101 is OPEN; evidence saved. Duplicate #102 remains CLOSED."}, {"events_at_least": {"match": {"type": "tool_call", "name": "bash"}, "count": 6}}, {"events_at_least": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 0}}, {"events_at_most": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 0}}], "fixture_exit_codes": {}, "fixture_negative_omissions": ["issue list", "issue view 101", "issue comment", "issue reopen"]}+ {"id": "issue-recurrence-duplicate-chain", "why": "#1701: duplicate-chain. Scripted policy delivery and local issue-state roundtrip, not live-model judgment. Independent verifiers reject incorrect state, missing evidence, extra mutations and missing final reads.", "scripted_only": true, "args": ["--old"], "env": {"GRAFF_NO_CODEDB_GUARD": "1", "GRAFF_AUTO_ISOLATE": "off"}, "github_fixture": {"repo": "fixture/primary", "issues": {"101": {"number": 101, "title": "recurrence fixture", "body": "Previously fixed fixture recurrence.", "state": "CLOSED", "stateReason": "COMPLETED", "comments": [], "url": "https://github.com/fixture/primary/issues/101"}, "102": {"number": 102, "title": "recurrence fixture", "body": "Duplicate of #101. Follow the canonical tracking issue, not this copy.", "state": "CLOSED", "stateReason": "DUPLICATE", "comments": [], "url": "https://github.com/fixture/primary/issues/102"}, "103": {"number": 103, "title": "recurrence fixture", "body": "Duplicate of #102, which points to canonical #101.", "state": "CLOSED", "stateReason": "DUPLICATE", "comments": [], "url": "https://github.com/fixture/primary/issues/103"}}}, "workspace_seed": {"recurrence.md": "**graff:** fixture (latest: fixture)\n**Harness:** not used\n**Surface:** terminal\n**Platform:** fixture\n\n## Symptom\nThe fixture failure recurs on the current fixture release.\n\n## Repro\nRepeat the local fixture operation.\n"}, "prompt": "Report the supplied fixture findings using only the installed local gh. Inspect resolution and tested-version evidence, follow canonical duplicate tracking, avoid duplicate issues and report any failed operation accurately.", "script": [{"tool": "bash", "arguments": {"command": "gh issue list --repo fixture/primary --state all --search 'recurrence fixture' --json number,title,body,state,stateReason"}}, {"tool": "bash", "arguments": {"command": "gh issue view 103 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"tool": "bash", "arguments": {"command": "gh issue view 102 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"tool": "bash", "arguments": {"command": "gh issue reopen 101 --repo fixture/primary"}}, {"tool": "bash", "arguments": {"command": "gh issue comment 101 --repo fixture/primary --body-file recurrence.md"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"text": "Canonical issue #101 is OPEN; evidence saved. Duplicate chain #103 and #102 remains CLOSED."}], "verify_command": ["python3", "-c", "import json,pathlib\np=pathlib.Path\nexpected=json.loads('{\"101\": {\"number\": 101, \"title\": \"recurrence fixture\", \"body\": \"Previously fixed fixture recurrence.\", \"state\": \"OPEN\", \"stateReason\": \"\", \"comments\": [{\"body\": \"**graff:** fixture (latest: fixture)\\\\n**Harness:** not used\\\\n**Surface:** terminal\\\\n**Platform:** fixture\\\\n\\\\n## Symptom\\\\nThe fixture failure recurs on the current fixture release.\\\\n\\\\n## Repro\\\\nRepeat the local fixture operation.\\\\n\"}], \"url\": \"https://github.com/fixture/primary/issues/101\", \"closedAt\": null}, \"102\": {\"number\": 102, \"title\": \"recurrence fixture\", \"body\": \"Duplicate of #101. Follow the canonical tracking issue, not this copy.\", \"state\": \"CLOSED\", \"stateReason\": \"DUPLICATE\", \"comments\": [], \"url\": \"https://github.com/fixture/primary/issues/102\"}, \"103\": {\"number\": 103, \"title\": \"recurrence fixture\", \"body\": \"Duplicate of #102, which points to canonical #101.\", \"state\": \"CLOSED\", \"stateReason\": \"DUPLICATE\", \"comments\": [], \"url\": \"https://github.com/fixture/primary/issues/103\"}}')\nstate=json.loads(p('gh-state.json').read_text())\nassert state['issues']==expected, ('issue state/evidence mismatch',state['issues'],expected)\nreads=[json.loads(x) for x in p('gh-argv.jsonl').read_text().splitlines()] if p('gh-argv.jsonl').exists() else []\nmutations=[json.loads(x) for x in p('mutations.jsonl').read_text().splitlines()] if p('mutations.jsonl').exists() else []\nassert [(r[1],r[2]) for r in mutations]==[('reopen', '101'), ('comment', '101')], ('incorrect mutations',mutations)\nassert any(r[:2]==['issue','list'] and '--state' in r and r[r.index('--state')+1]=='all' for r in reads), 'must search all states'\nassert reads[-1][:3]==['issue','view','101'], 'must attempt final canonical state lookup'\nassert '--json' in reads[-1] and 'state' in reads[-1][reads[-1].index('--json')+1].split(','), 'final read must include state'\nprint('Independent extended issue lifecycle verified')\n"], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"final_text_contains": "Canonical issue #101 is OPEN; evidence saved. Duplicate chain #103 and #102 remains CLOSED."}, {"events_at_least": {"match": {"type": "tool_call", "name": "bash"}, "count": 7}}, {"events_at_least": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 0}}, {"events_at_most": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 0}}], "fixture_exit_codes": {}, "fixture_negative_omissions": ["issue list", "issue view 101", "issue comment", "issue reopen"]}+ {"id": "issue-recurrence-no-new-evidence", "why": "#1701: no-new-evidence. Scripted policy delivery and local issue-state roundtrip, not live-model judgment. Independent verifiers reject incorrect state, missing evidence, extra mutations and missing final reads.", "scripted_only": true, "args": ["--old"], "env": {"GRAFF_NO_CODEDB_GUARD": "1", "GRAFF_AUTO_ISOLATE": "off"}, "github_fixture": {"repo": "fixture/primary", "issues": {"101": {"number": 101, "title": "recurrence fixture", "body": "Resolved. The submitted finding repeats existing evidence with no current recurrence.", "state": "CLOSED", "stateReason": "COMPLETED", "comments": [], "url": "https://github.com/fixture/primary/issues/101"}}}, "workspace_seed": {"recurrence.md": "**graff:** fixture (latest: fixture)\n**Harness:** not used\n**Surface:** terminal\n**Platform:** fixture\n\n## Symptom\nThe fixture failure recurs on the current fixture release.\n\n## Repro\nRepeat the local fixture operation.\n"}, "prompt": "Report the supplied fixture findings using only the installed local gh. Inspect resolution and tested-version evidence, follow canonical duplicate tracking, avoid duplicate issues and report any failed operation accurately.", "script": [{"tool": "bash", "arguments": {"command": "gh issue list --repo fixture/primary --state all --search 'recurrence fixture' --json number,title,body,state,stateReason"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"text": "Issue #101 remains CLOSED; no new evidence or current recurrence, so no comment or reopening."}], "verify_command": ["python3", "-c", "import json,pathlib\np=pathlib.Path\nexpected=json.loads('{\"101\": {\"number\": 101, \"title\": \"recurrence fixture\", \"body\": \"Resolved. The submitted finding repeats existing evidence with no current recurrence.\", \"state\": \"CLOSED\", \"stateReason\": \"COMPLETED\", \"comments\": [], \"url\": \"https://github.com/fixture/primary/issues/101\"}}')\nstate=json.loads(p('gh-state.json').read_text())\nassert state['issues']==expected, ('issue state/evidence mismatch',state['issues'],expected)\nreads=[json.loads(x) for x in p('gh-argv.jsonl').read_text().splitlines()] if p('gh-argv.jsonl').exists() else []\nmutations=[json.loads(x) for x in p('mutations.jsonl').read_text().splitlines()] if p('mutations.jsonl').exists() else []\nassert [(r[1],r[2]) for r in mutations]==[], ('incorrect mutations',mutations)\nassert any(r[:2]==['issue','list'] and '--state' in r and r[r.index('--state')+1]=='all' for r in reads), 'must search all states'\nassert reads[-1][:3]==['issue','view','101'], 'must attempt final canonical state lookup'\nassert '--json' in reads[-1] and 'state' in reads[-1][reads[-1].index('--json')+1].split(','), 'final read must include state'\nprint('Independent extended issue lifecycle verified')\n"], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"final_text_contains": "Issue #101 remains CLOSED; no new evidence or current recurrence, so no comment or reopening."}, {"events_at_least": {"match": {"type": "tool_call", "name": "bash"}, "count": 2}}, {"events_at_least": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 0}}, {"events_at_most": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 0}}], "fixture_exit_codes": {}, "fixture_negative_omissions": ["issue list", "issue view 101"]}+ {"id": "issue-recurrence-pre-fix-evidence", "why": "#1701: pre-fix-evidence. Scripted policy delivery and local issue-state roundtrip, not live-model judgment. Independent verifiers reject incorrect state, missing evidence, extra mutations and missing final reads.", "scripted_only": true, "args": ["--old"], "env": {"GRAFF_NO_CODEDB_GUARD": "1", "GRAFF_AUTO_ISOLATE": "off"}, "github_fixture": {"repo": "fixture/primary", "issues": {"101": {"number": 101, "title": "recurrence fixture", "body": "Fixed in fixture version 2. The newly described incident ran version 1 and does not test the fix.", "state": "CLOSED", "stateReason": "COMPLETED", "comments": [], "url": "https://github.com/fixture/primary/issues/101"}}}, "workspace_seed": {"recurrence.md": "**graff:** fixture (latest: fixture)\n**Harness:** not used\n**Surface:** terminal\n**Platform:** fixture\n\n## Symptom\nThe fixture failure recurs on the current fixture release.\n\n## Repro\nRepeat the local fixture operation.\n"}, "prompt": "Report the supplied fixture findings using only the installed local gh. Inspect resolution and tested-version evidence, follow canonical duplicate tracking, avoid duplicate issues and report any failed operation accurately.", "script": [{"tool": "bash", "arguments": {"command": "gh issue list --repo fixture/primary --state all --search 'recurrence fixture' --json number,title,body,state,stateReason"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"text": "Issue #101 remains CLOSED; the incident predates the version 2 fix and does not establish a regression."}], "verify_command": ["python3", "-c", "import json,pathlib\np=pathlib.Path\nexpected=json.loads('{\"101\": {\"number\": 101, \"title\": \"recurrence fixture\", \"body\": \"Fixed in fixture version 2. The newly described incident ran version 1 and does not test the fix.\", \"state\": \"CLOSED\", \"stateReason\": \"COMPLETED\", \"comments\": [], \"url\": \"https://github.com/fixture/primary/issues/101\"}}')\nstate=json.loads(p('gh-state.json').read_text())\nassert state['issues']==expected, ('issue state/evidence mismatch',state['issues'],expected)\nreads=[json.loads(x) for x in p('gh-argv.jsonl').read_text().splitlines()] if p('gh-argv.jsonl').exists() else []\nmutations=[json.loads(x) for x in p('mutations.jsonl').read_text().splitlines()] if p('mutations.jsonl').exists() else []\nassert [(r[1],r[2]) for r in mutations]==[], ('incorrect mutations',mutations)\nassert any(r[:2]==['issue','list'] and '--state' in r and r[r.index('--state')+1]=='all' for r in reads), 'must search all states'\nassert reads[-1][:3]==['issue','view','101'], 'must attempt final canonical state lookup'\nassert '--json' in reads[-1] and 'state' in reads[-1][reads[-1].index('--json')+1].split(','), 'final read must include state'\nprint('Independent extended issue lifecycle verified')\n"], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"final_text_contains": "Issue #101 remains CLOSED; the incident predates the version 2 fix and does not establish a regression."}, {"events_at_least": {"match": {"type": "tool_call", "name": "bash"}, "count": 2}}, {"events_at_least": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 0}}, {"events_at_most": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 0}}], "fixture_exit_codes": {}, "fixture_negative_omissions": ["issue list", "issue view 101"]}+ {"id": "issue-recurrence-withdrawn", "why": "#1701: withdrawn. Scripted policy delivery and local issue-state roundtrip, not live-model judgment. Independent verifiers reject incorrect state, missing evidence, extra mutations and missing final reads.", "scripted_only": true, "args": ["--old"], "env": {"GRAFF_NO_CODEDB_GUARD": "1", "GRAFF_AUTO_ISOLATE": "off"}, "github_fixture": {"repo": "fixture/primary", "issues": {"101": {"number": 101, "title": "recurrence fixture", "body": "Withdrawn by reporter: the behavior is intentional, not an unresolved bug.", "state": "CLOSED", "stateReason": "NOT_PLANNED", "comments": [], "url": "https://github.com/fixture/primary/issues/101"}}}, "workspace_seed": {"recurrence.md": "**graff:** fixture (latest: fixture)\n**Harness:** not used\n**Surface:** terminal\n**Platform:** fixture\n\n## Symptom\nThe fixture failure recurs on the current fixture release.\n\n## Repro\nRepeat the local fixture operation.\n"}, "prompt": "Report the supplied fixture findings using only the installed local gh. Inspect resolution and tested-version evidence, follow canonical duplicate tracking, avoid duplicate issues and report any failed operation accurately.", "script": [{"tool": "bash", "arguments": {"command": "gh issue list --repo fixture/primary --state all --search 'recurrence fixture' --json number,title,body,state,stateReason"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"text": "Issue #101 remains CLOSED; the report was withdrawn and no contradictory new evidence was provided."}], "verify_command": ["python3", "-c", "import json,pathlib\np=pathlib.Path\nexpected=json.loads('{\"101\": {\"number\": 101, \"title\": \"recurrence fixture\", \"body\": \"Withdrawn by reporter: the behavior is intentional, not an unresolved bug.\", \"state\": \"CLOSED\", \"stateReason\": \"NOT_PLANNED\", \"comments\": [], \"url\": \"https://github.com/fixture/primary/issues/101\"}}')\nstate=json.loads(p('gh-state.json').read_text())\nassert state['issues']==expected, ('issue state/evidence mismatch',state['issues'],expected)\nreads=[json.loads(x) for x in p('gh-argv.jsonl').read_text().splitlines()] if p('gh-argv.jsonl').exists() else []\nmutations=[json.loads(x) for x in p('mutations.jsonl').read_text().splitlines()] if p('mutations.jsonl').exists() else []\nassert [(r[1],r[2]) for r in mutations]==[], ('incorrect mutations',mutations)\nassert any(r[:2]==['issue','list'] and '--state' in r and r[r.index('--state')+1]=='all' for r in reads), 'must search all states'\nassert reads[-1][:3]==['issue','view','101'], 'must attempt final canonical state lookup'\nassert '--json' in reads[-1] and 'state' in reads[-1][reads[-1].index('--json')+1].split(','), 'final read must include state'\nprint('Independent extended issue lifecycle verified')\n"], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"final_text_contains": "Issue #101 remains CLOSED; the report was withdrawn and no contradictory new evidence was provided."}, {"events_at_least": {"match": {"type": "tool_call", "name": "bash"}, "count": 2}}, {"events_at_least": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 0}}, {"events_at_most": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 0}}], "fixture_exit_codes": {}, "fixture_negative_omissions": ["issue list", "issue view 101"]}+ {"id": "issue-recurrence-denied-comment", "why": "#1701: denied-comment. Scripted policy delivery and local issue-state roundtrip, not live-model judgment. Independent verifiers reject incorrect state, missing evidence, extra mutations and missing final reads.", "scripted_only": true, "args": ["--old"], "env": {"GRAFF_NO_CODEDB_GUARD": "1", "GRAFF_AUTO_ISOLATE": "off"}, "github_fixture": {"repo": "fixture/primary", "issues": {"101": {"number": 101, "title": "recurrence fixture", "body": "Previously fixed fixture recurrence.", "state": "CLOSED", "stateReason": "COMPLETED", "comments": [], "url": "https://github.com/fixture/primary/issues/101", "deny_comment": true}}}, "workspace_seed": {"recurrence.md": "**graff:** fixture (latest: fixture)\n**Harness:** not used\n**Surface:** terminal\n**Platform:** fixture\n\n## Symptom\nThe fixture failure recurs on the current fixture release.\n\n## Repro\nRepeat the local fixture operation.\n"}, "prompt": "Report the supplied fixture findings using only the installed local gh. Inspect resolution and tested-version evidence, follow canonical duplicate tracking, avoid duplicate issues and report any failed operation accurately.", "script": [{"tool": "bash", "arguments": {"command": "gh issue list --repo fixture/primary --state all --search 'recurrence fixture' --json number,title,body,state,stateReason"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"tool": "bash", "arguments": {"command": "gh issue reopen 101 --repo fixture/primary"}}, {"tool": "bash", "arguments": {"command": "gh issue comment 101 --repo fixture/primary --body-file recurrence.md"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"text": "Issue #101 is OPEN, but saving the evidence failed: comment permission denied. No evidence was saved; a maintainer must attach it."}], "verify_command": ["python3", "-c", "import json,pathlib\np=pathlib.Path\nexpected=json.loads('{\"101\": {\"number\": 101, \"title\": \"recurrence fixture\", \"body\": \"Previously fixed fixture recurrence.\", \"state\": \"OPEN\", \"stateReason\": \"\", \"comments\": [], \"url\": \"https://github.com/fixture/primary/issues/101\", \"deny_comment\": true, \"closedAt\": null}}')\nstate=json.loads(p('gh-state.json').read_text())\nassert state['issues']==expected, ('issue state/evidence mismatch',state['issues'],expected)\nreads=[json.loads(x) for x in p('gh-argv.jsonl').read_text().splitlines()] if p('gh-argv.jsonl').exists() else []\nmutations=[json.loads(x) for x in p('mutations.jsonl').read_text().splitlines()] if p('mutations.jsonl').exists() else []\nassert [(r[1],r[2]) for r in mutations]==[('reopen', '101'), ('comment', '101')], ('incorrect mutations',mutations)\nassert any(r[:2]==['issue','list'] and '--state' in r and r[r.index('--state')+1]=='all' for r in reads), 'must search all states'\nassert reads[-1][:3]==['issue','view','101'], 'must attempt final canonical state lookup'\nassert '--json' in reads[-1] and 'state' in reads[-1][reads[-1].index('--json')+1].split(','), 'final read must include state'\nprint('Independent extended issue lifecycle verified')\n"], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"final_text_contains": "Issue #101 is OPEN, but saving the evidence failed: comment permission denied. No evidence was saved; a maintainer must attach it."}, {"events_at_least": {"match": {"type": "tool_call", "name": "bash"}, "count": 5}}, {"events_at_least": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 1}}, {"events_at_most": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 1}}], "fixture_exit_codes": {"gh issue comment 101 --repo fixture/primary --body-file recurrence.md": 1}, "fixture_negative_omissions": ["issue list", "issue view 101", "issue reopen"]}+ {"id": "issue-recurrence-denied-final-state", "why": "#1701: denied-final-state. Scripted policy delivery and local issue-state roundtrip, not live-model judgment. Independent verifiers reject incorrect state, missing evidence, extra mutations and missing final reads.", "scripted_only": true, "args": ["--old"], "env": {"GRAFF_NO_CODEDB_GUARD": "1", "GRAFF_AUTO_ISOLATE": "off"}, "github_fixture": {"repo": "fixture/primary", "issues": {"101": {"number": 101, "title": "recurrence fixture", "body": "Previously fixed fixture recurrence.", "state": "CLOSED", "stateReason": "COMPLETED", "comments": [], "url": "https://github.com/fixture/primary/issues/101", "deny_view_after_mutation": true}}}, "workspace_seed": {"recurrence.md": "**graff:** fixture (latest: fixture)\n**Harness:** not used\n**Surface:** terminal\n**Platform:** fixture\n\n## Symptom\nThe fixture failure recurs on the current fixture release.\n\n## Repro\nRepeat the local fixture operation.\n"}, "prompt": "Report the supplied fixture findings using only the installed local gh. Inspect resolution and tested-version evidence, follow canonical duplicate tracking, avoid duplicate issues and report any failed operation accurately.", "script": [{"tool": "bash", "arguments": {"command": "gh issue list --repo fixture/primary --state all --search 'recurrence fixture' --json number,title,body,state,stateReason"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"tool": "bash", "arguments": {"command": "gh issue reopen 101 --repo fixture/primary"}}, {"tool": "bash", "arguments": {"command": "gh issue comment 101 --repo fixture/primary --body-file recurrence.md"}}, {"tool": "bash", "arguments": {"command": "gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url"}}, {"text": "Reopen and comment operations succeeded, but the final state lookup was denied. Final issue state is unverified; maintainer confirmation is required."}], "verify_command": ["python3", "-c", "import json,pathlib\np=pathlib.Path\nexpected=json.loads('{\"101\": {\"number\": 101, \"title\": \"recurrence fixture\", \"body\": \"Previously fixed fixture recurrence.\", \"state\": \"OPEN\", \"stateReason\": \"\", \"comments\": [{\"body\": \"**graff:** fixture (latest: fixture)\\\\n**Harness:** not used\\\\n**Surface:** terminal\\\\n**Platform:** fixture\\\\n\\\\n## Symptom\\\\nThe fixture failure recurs on the current fixture release.\\\\n\\\\n## Repro\\\\nRepeat the local fixture operation.\\\\n\"}], \"url\": \"https://github.com/fixture/primary/issues/101\", \"deny_view_after_mutation\": true, \"closedAt\": null}}')\nstate=json.loads(p('gh-state.json').read_text())\nassert state['issues']==expected, ('issue state/evidence mismatch',state['issues'],expected)\nreads=[json.loads(x) for x in p('gh-argv.jsonl').read_text().splitlines()] if p('gh-argv.jsonl').exists() else []\nmutations=[json.loads(x) for x in p('mutations.jsonl').read_text().splitlines()] if p('mutations.jsonl').exists() else []\nassert [(r[1],r[2]) for r in mutations]==[('reopen', '101'), ('comment', '101')], ('incorrect mutations',mutations)\nassert any(r[:2]==['issue','list'] and '--state' in r and r[r.index('--state')+1]=='all' for r in reads), 'must search all states'\nassert reads[-1][:3]==['issue','view','101'], 'must attempt final canonical state lookup'\nassert '--json' in reads[-1] and 'state' in reads[-1][reads[-1].index('--json')+1].split(','), 'final read must include state'\nprint('Independent extended issue lifecycle verified')\n"], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"final_text_contains": "Reopen and comment operations succeeded, but the final state lookup was denied. Final issue state is unverified; maintainer confirmation is required."}, {"events_at_least": {"match": {"type": "tool_call", "name": "bash"}, "count": 5}}, {"events_at_least": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 1}}, {"events_at_most": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 1}}], "fixture_exit_codes": {"gh issue view 101 --repo fixture/primary --json number,title,body,state,stateReason,comments,url": [0, 1]}, "fixture_negative_omissions": ["issue list", "issue view 101", "issue comment", "issue reopen"]}+ {"id": "issue-recurrence-search-failed", "why": "#1701: search-failed. Scripted policy delivery and local issue-state roundtrip, not live-model judgment. Independent verifiers reject incorrect state, missing evidence, extra mutations and missing final reads.", "scripted_only": true, "args": ["--old"], "env": {"GRAFF_NO_CODEDB_GUARD": "1", "GRAFF_AUTO_ISOLATE": "off"}, "github_fixture": {"repo": "fixture/primary", "issues": {"101": {"number": 101, "title": "recurrence fixture", "body": "Previously fixed fixture recurrence.", "state": "CLOSED", "stateReason": "COMPLETED", "comments": [], "url": "https://github.com/fixture/primary/issues/101"}}, "issue_list_denied": true}, "workspace_seed": {"recurrence.md": "**graff:** fixture (latest: fixture)\n**Harness:** not used\n**Surface:** terminal\n**Platform:** fixture\n\n## Symptom\nThe fixture failure recurs on the current fixture release.\n\n## Repro\nRepeat the local fixture operation.\n"}, "prompt": "Report the supplied fixture findings using only the installed local gh. Inspect resolution and tested-version evidence, follow canonical duplicate tracking, avoid duplicate issues and report any failed operation accurately.", "script": [{"tool": "bash", "arguments": {"command": "gh issue list --repo fixture/primary --state all --search 'recurrence fixture' --json number,title,body,state,stateReason"}}, {"text": "Issue search failed with permission denied. No issue was created, commented on or reopened; canonical tracking could not be verified."}], "verify_command": ["python3", "-c", "import json,pathlib\np=pathlib.Path\nexpected=json.loads('{\"101\": {\"number\": 101, \"title\": \"recurrence fixture\", \"body\": \"Previously fixed fixture recurrence.\", \"state\": \"CLOSED\", \"stateReason\": \"COMPLETED\", \"comments\": [], \"url\": \"https://github.com/fixture/primary/issues/101\"}}')\nstate=json.loads(p('gh-state.json').read_text())\nassert state['issues']==expected, ('issue state/evidence mismatch',state['issues'],expected)\nreads=[json.loads(x) for x in p('gh-argv.jsonl').read_text().splitlines()] if p('gh-argv.jsonl').exists() else []\nmutations=[json.loads(x) for x in p('mutations.jsonl').read_text().splitlines()] if p('mutations.jsonl').exists() else []\nassert [(r[1],r[2]) for r in mutations]==[], ('incorrect mutations',mutations)\nassert any(r[:2]==['issue','list'] and '--state' in r and r[r.index('--state')+1]=='all' for r in reads), 'must search all states'\nprint('Independent extended issue lifecycle verified')\n"], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"final_text_contains": "Issue search failed with permission denied. No issue was created, commented on or reopened; canonical tracking could not be verified."}, {"events_at_least": {"match": {"type": "tool_call", "name": "bash"}, "count": 1}}, {"events_at_least": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 1}}, {"events_at_most": {"match": {"type": "tool_call_finished", "name": "bash", "is_error": true}, "count": 1}}], "fixture_exit_codes": {"gh issue list --repo fixture/primary --state all --search 'recurrence fixture' --json number,title,body,state,stateReason": 1}, "fixture_negative_omissions": ["issue list"]}+ {"why": "#1701: custom root prompts must retain issue lifecycle guidance; scripted policy-delivery coverage, not live-model judgment.", "scripted_only": true, "prompt": "Prepare a generic fixture report; do not publish anything.", "script": [{"text": "Fixture report prepared locally."}], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"request_contains": {"index": 0, "text": "CUSTOM_ROOT"}}, {"final_text_contains": "Fixture report prepared locally."}], "id": "issue-policy-custom-root-startup", "args": ["--system-prompt", "CUSTOM_ROOT"]}+ {"why": "#1701: custom root prompts must retain issue lifecycle guidance; scripted policy-delivery coverage, not live-model judgment.", "scripted_only": true, "prompt": "Prepare a generic fixture report; do not publish anything.", "script": [{"text": "Fixture report prepared locally."}], "assert": [{"request_contains": {"index": 0, "text": "A comment alone does not complete a recurrence report."}}, {"request_contains": {"index": 0, "text": "CUSTOM_ROOT"}}, {"final_text_contains": "Fixture report prepared locally."}], "id": "issue-policy-custom-root-replaced", "controls_before_prompt": [{"type": "set_system_prompt", "text": "CUSTOM_ROOT"}]}diff --cc scripts/eval/tier1-manifest.jsonindex 93c3244c,c00850f2..1c170ff1--- a/scripts/eval/tier1-manifest.json+++ b/scripts/eval/tier1-manifest.json@@@ -14,7 -14,7 +14,7 @@@"src/main.zig","src/repl.zig"],- "test_count_baseline": 3451,- "test_count_baseline": 3391,++ "test_count_baseline": 3484,"test_count_slack": 25,"required_invariants": [{