Claude Code. Any Model. The most powerful AI coding agent now speaks every language.
test(madbench): remove the Edit-or-Write Check from the CLI Bench
Jack Rudenko9bea5bd569be
diff --git a/ai-docs/benches/recommended-models/cli.madbench.yaml b/ai-docs/benches/recommended-models/cli.madbench.yamlindex fd7abf63..cb0f2586 100644--- a/ai-docs/benches/recommended-models/cli.madbench.yaml+++ b/ai-docs/benches/recommended-models/cli.madbench.yaml@@ -45,13 +45,11 @@ scenarios:- type: file-changesmust: { update: slugify.ts }must-not: { touch: slugify.test.ts }- # The model drove tools through the proxy: it read the code...+ # The model drove tools through the proxy: it read the code. Which tool made the+ # edit is not checked: file-changes above proves the edit landed, and on+ # 2026-10-20 claude-opus-5-5 and claude-fable-5-1 fixed the test with a Bash+ # heredoc, so an Edit-or-Write Check failed two working models.- type: any-ofchecks:- { type: session:tool-used, value: Read }- { type: session:tool-used, value: Bash }- # ...and changed it with a file tool.- - type: any-of- checks:- - { type: session:tool-used, value: Edit }- - { type: session:tool-used, value: Write }