Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.
Rust agentai-agentapplecomputer-usecomputer-use-agentcontainerizationcuadesktop-automationhacktoberfestlumemacosmanusoperatorswiftvirtualizationvirtualization-frameworkwindowswindows-sandbox
chore(cua-driver-bench): license the benchmark under FSL-1.1-MIT (#4988)
Francesco Bonacci7c99b850e894
diff --git a/COMMERCIAL.md b/COMMERCIAL.mdindex 6d39973e81..40ee3eeb58 100644--- a/COMMERCIAL.md+++ b/COMMERCIAL.md@@ -5,3 +5,7 @@ Cua Spaces is source-available under FSL-1.1-MIT. You're free to use, modify andIf you want to offer Cua Spaces, or a product built on it, to others as a hosted or managed service (for example hosted desktops, sandboxes or computer-use environments), you need a commercial licence. Contact us at [email protected].Each release converts to MIT two years after it's published.++## Cua Driver Bench++Cua Driver Bench ([`benchmarks/cua-driver-bench/`](benchmarks/cua-driver-bench)) is also under FSL-1.1-MIT. You can run it, modify it and use it at work, including to evaluate a commercial product. If you want to offer it, or a substantially similar benchmark, to others as a commercial product or service (for example hosted evaluation or a paid benchmark), you need a commercial licence. Contact us at [email protected].diff --git a/LICENSING.md b/LICENSING.mdindex a46af8a837..c274054477 100644--- a/LICENSING.md+++ b/LICENSING.md@@ -13,7 +13,8 @@ Most of the repository is open source under MIT, including the cua SDK andits language packages, the `cua` command, `cua daemon`, Cua Driver and Lume.Cua Spaces is source-available under the[Functional Source License, Version 1.1, MIT Future License](https://fsl.software)-(FSL-1.1-MIT); the table below marks each FSL directory.+(FSL-1.1-MIT); the table below marks each FSL directory. Cua Driver Bench+(`benchmarks/cua-driver-bench`) is FSL-1.1-MIT too.## LICENSE files in this repository@@ -54,6 +55,7 @@ notices declare.| [`samples/infinite-canvas-swift/LICENSE`](samples/infinite-canvas-swift/LICENSE) | FSL-1.1-MIT | Infinite Canvas sample (uses the streaming client) || [`samples/openkoalabot-example-swift/LICENSE`](samples/openkoalabot-example-swift/LICENSE) | FSL-1.1-MIT | OpenKoalaBots Swift sample (uses the streaming client) || [`samples/openkoalabot-example-tauri/LICENSE`](samples/openkoalabot-example-tauri/LICENSE) | FSL-1.1-MIT | OpenKoalaBots Tauri sample (uses the streaming client) |+| [`benchmarks/cua-driver-bench/LICENSE`](benchmarks/cua-driver-bench/LICENSE) | FSL-1.1-MIT | Cua Driver Bench: harness, task set, method and results (MIT up to #4978; the digest-pinned task files have no per-file headers) || [`libs/cua-bench/LICENSE`](libs/cua-bench/LICENSE) | MIT | Package || [`libs/cua-bench-rl/LICENSE`](libs/cua-bench-rl/LICENSE) | MIT | Package || [`libs/cua-bench-s1/python/LICENSE`](libs/cua-bench-s1/python/LICENSE) | MIT | Package |diff --git a/README.md b/README.mdindex b41015a8ae..3abb935b5c 100644--- a/README.md+++ b/README.md@@ -266,10 +266,11 @@ We welcome contributions. See our [Contributing Guidelines](CONTRIBUTING.md) for## Licensing-Everything outside Cua Spaces is MIT-licensed ([LICENSE](LICENSE.md)): the cua SDK and its Python, TypeScript, Swift and Kotlin packages, the `cua` command and `cua daemon`, Cua Driver, Lume and the rest of this repository unless a directory says otherwise.+Everything outside Cua Spaces and Cua Driver Bench is MIT-licensed ([LICENSE](LICENSE.md)): the cua SDK and its Python, TypeScript, Swift and Kotlin packages, the `cua` command and `cua daemon`, Cua Driver, Lume and the rest of this repository unless a directory says otherwise.Cua Spaces is source-available under [FSL-1.1-MIT](https://fsl.software): the Spaces apps, cua-spacesd, the Cua Keyvault, teleport, Cua Volume (`cua-volume`) and the streaming client, codecs and viewers. The streaming wire protocol stays MIT. It is free to use, self-host and build on, with no competing hosted service, and each release becomes MIT two years after it ships.+Cua Driver Bench (`benchmarks/cua-driver-bench`) is under the same [FSL-1.1-MIT](benchmarks/cua-driver-bench/LICENSE); versions published before 11 Oct 2026 (#4973, #4978) were MIT.The MIT parts never depend on the FSL parts. Some subdirectories carry their own licence; [LICENSING.md](LICENSING.md) lists each one and how the two fit together.-Offering Spaces as a hosted or managed service? See [COMMERCIAL.md](COMMERCIAL.md). For use of our names and logo, see [TRADEMARKS.md](TRADEMARKS.md).+Offering Spaces, or Cua Driver Bench, as a hosted or managed service? See [COMMERCIAL.md](COMMERCIAL.md). For use of our names and logo, see [TRADEMARKS.md](TRADEMARKS.md).Third-party components have their own licenses:diff --git a/benchmarks/cua-driver-bench/LICENSE b/benchmarks/cua-driver-bench/LICENSEnew file mode 100644index 0000000000..79293ae602--- /dev/null+++ b/benchmarks/cua-driver-bench/LICENSE@@ -0,0 +1,110 @@+# Functional Source License, Version 1.1, MIT Future License++## Abbreviation++FSL-1.1-MIT++## Notice++Copyright 2026 Cua AI, Inc.++## Terms and Conditions++### Licensor ("We")++The party offering the Software under these Terms and Conditions.++### The Software++The "Software" is each version of the software that we make available under+these Terms and Conditions, as indicated by our inclusion of these Terms and+Conditions with the Software.++### License Grant++Subject to your compliance with this License Grant and the Patents,+Redistribution and Trademark clauses below, we hereby grant you the right to+use, copy, modify, create derivative works, publicly perform, publicly display+and redistribute the Software for any Permitted Purpose identified below.++### Permitted Purpose++A Permitted Purpose is any purpose other than a Competing Use. A Competing Use+means making the Software available to others in a commercial product or+service that:++1. substitutes for the Software;++2. substitutes for any other product or service we offer using the Software+ that exists as of the date we make the Software available; or++3. offers the same or substantially similar functionality as the Software.++Permitted Purposes specifically include using the Software:++1. for your internal use and access;++2. for non-commercial education;++3. for non-commercial research; and++4. in connection with professional services that you provide to a licensee+ using the Software in accordance with these Terms and Conditions.++### Patents++To the extent your use for a Permitted Purpose would necessarily infringe our+patents, the license grant above includes a license under our patents. If you+make a claim against any party that the Software infringes or contributes to+the infringement of any patent, then your patent license to the Software ends+immediately.++### Redistribution++The Terms and Conditions apply to all copies, modifications and derivatives of+the Software.++If you redistribute any copies, modifications or derivatives of the Software,+you must include a copy of or a link to these Terms and Conditions and not+remove any copyright notices provided in or with the Software.++### Disclaimer++THE SOFTWARE IS PROVIDED "AS IS" AND WITHOUT WARRANTIES OF ANY KIND, EXPRESS OR+IMPLIED, INCLUDING WITHOUT LIMITATION WARRANTIES OF FITNESS FOR A PARTICULAR+PURPOSE, MERCHANTABILITY, TITLE OR NON-INFRINGEMENT.++IN NO EVENT WILL WE HAVE ANY LIABILITY TO YOU ARISING OUT OF OR RELATED TO THE+SOFTWARE, INCLUDING INDIRECT, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES,+EVEN IF WE HAVE BEEN INFORMED OF THEIR POSSIBILITY IN ADVANCE.++### Trademarks++Except for displaying the License Details and identifying us as the origin of+the Software, you have no right under these Terms and Conditions to use our+trademarks, trade names, service marks or product names.++## Grant of Future License++We hereby irrevocably grant you an additional license to use the Software under+the MIT license that is effective on the second anniversary of the date we make+the Software available. On or after that date, you may use the Software under+the MIT license, in which case the following will apply:++Permission is hereby granted, free of charge, to any person obtaining a copy of+this software and associated documentation files (the "Software"), to deal in+the Software without restriction, including without limitation the rights to+use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies+of the Software, and to permit persons to whom the Software is furnished to do+so, subject to the following conditions:++The above copyright notice and this permission notice shall be included in all+copies or substantial portions of the Software.++THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE+SOFTWARE.diff --git a/benchmarks/cua-driver-bench/README.md b/benchmarks/cua-driver-bench/README.mdindex 6579253373..21d5676853 100644--- a/benchmarks/cua-driver-bench/README.md+++ b/benchmarks/cua-driver-bench/README.md@@ -220,6 +220,21 @@ through a dated amendment committed before its first trial. See## Licence-MIT, under the repository [LICENSE](../../LICENSE.md). The task pack was first-written in Cua's private benchmark repository and is relicensed under MIT here;-see [`taskpack/README.md`](taskpack/README.md) and its third-party notices.+Cua Driver Bench is source-available under the+[Functional Source License, Version 1.1, MIT Future License](https://fsl.software)+(FSL-1.1-MIT), the same licence as Cua Spaces; see [`LICENSE`](LICENSE). It+covers the harness, the task set, the method documents and any results+published here, and replaces the repository's root MIT License for this+directory.++You may use, copy, modify and run the benchmark for any purpose, including+commercial ones such as evaluating your own product, except a Competing Use:+offering it, or something substantially similar, to others as a commercial+product or service. For that you need a commercial licence from Cua; see+[COMMERCIAL.md](../../COMMERCIAL.md). Each release becomes available under MIT+two years after it is published.++Versions published before this change, at commits `bf94fd5c7` (#4973) and+`ebc0b3d7d` (#4978), were released under MIT and stay MIT for anyone who has+them. Third-party software the task apps install keeps its own licence; see+[`taskpack/THIRD_PARTY_NOTICES.md`](taskpack/THIRD_PARTY_NOTICES.md).diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/analyze.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/analyze.pyindex 84f7a07a1e..6ec15cd9dc 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/analyze.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/analyze.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Pre-registered statistical analysis for the macOS computer-use pilot.Compares two arms on the same tasks with the same model:diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/analyze_bench.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/analyze_bench.pyindex c5e1d099d4..33d17bd492 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/analyze_bench.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/analyze_bench.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Analysis of a run_bench.py results file with the pre-registered statistics in analyze.py.analyze_bench.py runs/<run>/results.jsonl --out-md report.md --out-json report.jsondiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/arms.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/arms.pyindex 9f8a620e69..64d4e34643 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/arms.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/arms.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Isolated Codex CLI homes for the two comparison arms.Both arms run the same Codex CLI binary, the same model route, the samediff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/bench_core.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/bench_core.pyindex 4f1acd499c..7975ce1009 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/bench_core.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/bench_core.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Pure logic for the Claude Code benchmark runner: schedule, quota gate, spend ledger, backoff,wall-clock cutoff and round bookkeeping. No GUI, no model calls, so it is unit-tested.diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/bench_v2.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/bench_v2.pyindex 961fe373c2..ddea6451b2 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/bench_v2.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/bench_v2.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Bench v2 (Amendment 14): GUI-only enforcement, task categories, the background score and theinterruption fields of a trial row.diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/cdb_adapter.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/cdb_adapter.pyindex 9c0d8dd8c9..aa77fa063f 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/cdb_adapter.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/cdb_adapter.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Run a task of the CDB task pack in this runner.The public task set's pack tasks live in ../../taskpack (MIT; see its README and each task's PROVENANCE.md).diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/claude_arms.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/claude_arms.pyindex 299fc903bf..462c67e668 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/claude_arms.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/claude_arms.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Claude Code arms: one identical `claude -p` invocation, only the MCP server (and, for arm A, theskill) differs.diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/claude_driver.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/claude_driver.pyindex 7d6389f808..1b6c5f1d01 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/claude_driver.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/claude_driver.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Run one `claude -p` trial through the stream-json host protocol.Both arms use this same host. The Codex computer-use server asks the host for per-app approvaldiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/claude_events.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/claude_events.pyindex edcf673456..5acb3715d3 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/claude_events.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/claude_events.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Metrics from a Claude Code `--output-format stream-json --verbose` log.The runner stores each stdout line as ``<epoch_ms>\\t<json>`` (a bare JSON line is accepteddiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/codex_events.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/codex_events.pyindex fa63cd61a9..2eb76edf5d 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/codex_events.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/codex_events.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Metrics from a timestamped Codex `exec --json` event log.The runner stores each stdout line as ``<epoch_ms>\\t<json>`` so tool latency can bediff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/codex_native.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/codex_native.pyindex abff5be671..35a16e69ac 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/codex_native.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/codex_native.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Amendment 20 (CUA-1347): Codex Computer-Use (Sky) driven by OpenAI's own agent and model.Arm ``cx-codex-cu`` runs the Codex agent that ships inside the ChatGPT app (``codex-cli/CodexCLI.app``,diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/launch/watch_bench.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/launch/watch_bench.pyindex 1005c82846..ff892a877a 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/launch/watch_bench.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/launch/watch_bench.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Print the live state of a benchmark run: heartbeat, flags, last results, pauses.python3 watch_bench.py [RUN_ID] [-f] (-f repeats every 30 s)"""diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/mcp_preflight.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/mcp_preflight.pyindex 4ff2f8d7ea..2ef5e2b3b0 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/mcp_preflight.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/mcp_preflight.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Live preflight for the two arms' computer-use servers.`codex-native-cu`: start the node_repl MCP server exactly as the isolated Codex homediff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/pins.json b/benchmarks/cua-driver-bench/automated-eval/macos_bench/pins.jsonindex e76fbb260a..c84c7fbc83 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/pins.json+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/pins.json@@ -19,9 +19,14 @@"environment": "Lume macOS VM on a Mac Studio host (M3 Ultra), cloned from the cached cua-base image; 6 CPU, 12 GB, 1920x1080; one VM for both arms","cdb_pack": {"repo": "trycua/cua, benchmarks/cua-driver-bench/taskpack (public copy)",- "source": "Copied from Cua's private benchmark repository at revision 16a1937a79ff2ee2e48f5b5d9bb5e6f944119b5a; see taskpack/README.md. shared/cdb-s02 also carries the Amendment 19 checker fix (one Schedule row per session).",+ "source": "Copied from Cua's private benchmark repository at revision 16a1937a79ff2ee2e48f5b5d9bb5e6f944119b5a; see taskpack/README.md. shared/cdb-s02 also carries the Amendment 19 checker fix (one Schedule row per session). The licence metadata (package.json/package-lock.json `license`, PROVENANCE.md) was changed from MIT to FSL-1.1-MIT on 11 Oct 2026; `mit_release_tree_sha256` holds the digests of the MIT copy published in #4973/#4978.","revision": "16a1937a79ff2ee2e48f5b5d9bb5e6f944119b5a","tree_sha256": {+ "shared/cdb-s02": "86857b975b6d3e2a671ab0d577fc7aef0679ffcb488b09ee8e77f647d1630d94",+ "shared/cdb-s03": "0c38419567b079ce3bb139e6105fe023ae7d1a8e60aef44278e93e6763099fff",+ "shared/cdb-s04": "d93b31598682daa0f64e180f4e4950cf8530b792e61aed9d740d53df0783c53a"+ },+ "mit_release_tree_sha256": {"shared/cdb-s02": "844dbbd2b247395303b901cbd328dee092adfa0e592b511ce6900c69e92073c9","shared/cdb-s03": "f018f55fa0208e6244e5789e0e306401a009f7ee07344aece1c741a3a9b70fa4","shared/cdb-s04": "f7c67bb4dec8711176897f6cc26df8ed55237c0de48dd13cb242119ac7ca81a8"diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/post_hoc.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/post_hoc.pyindex 599f21da38..3b4a571d2e 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/post_hoc.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/post_hoc.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Post-hoc disturbance attribution (descriptive, added after the first trials ran).The pre-registered disturbance counters come from BenchSentinel. Two things they cannot telldiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-01/PROVENANCE.md b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-01/PROVENANCE.mdindex 68fdad908a..ea8a5dc2fb 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-01/PROVENANCE.md+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-01/PROVENANCE.md@@ -15,4 +15,4 @@ log.similarity review of the other tasks that day, so that review does not coverthem. No external source is declared; a similarity check against publicbenchmarks is still to be done.-* **Licence:** MIT, under the repository [LICENSE](../../../../../../LICENSE.md).+* **Licence:** FSL-1.1-MIT, under the benchmark's [LICENSE](../../../../LICENSE).diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-01/evaluate.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-01/evaluate.pyindex 2bd78992da..9ad4bb1bd8 100755--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-01/evaluate.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-01/evaluate.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Evaluate IR-01: a permission-style sheet between step 1 and step 2 of a form (BenchLab irmodal).Usage: evaluate.py --seed N --state PATH --events PATH --result OUT.jsondiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-01/render_brief.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-01/render_brief.pyindex eddd3f4e13..bbde32b8fe 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-01/render_brief.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-01/render_brief.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Render the agent prompt for IR-01 from a seed (Amendment 14)."""from __future__ import annotationsdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-02/PROVENANCE.md b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-02/PROVENANCE.mdindex 1c59bed03f..e6f493b9d2 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-02/PROVENANCE.md+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-02/PROVENANCE.md@@ -15,4 +15,4 @@ log.similarity review of the other tasks that day, so that review does not coverthem. No external source is declared; a similarity check against publicbenchmarks is still to be done.-* **Licence:** MIT, under the repository [LICENSE](../../../../../../LICENSE.md).+* **Licence:** FSL-1.1-MIT, under the benchmark's [LICENSE](../../../../LICENSE).diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-02/evaluate.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-02/evaluate.pyindex a95d640112..0d66cd9699 100755--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-02/evaluate.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-02/evaluate.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Evaluate IR-02: a notification-style banner over the Apply button (BenchLab irbanner).Usage: evaluate.py --seed N --state PATH --events PATH --result OUT.jsondiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-02/render_brief.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-02/render_brief.pyindex 3b75c2b744..3504938ad6 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-02/render_brief.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-02/render_brief.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Render the agent prompt for IR-02 from a seed (Amendment 14)."""from __future__ import annotationsdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-03/PROVENANCE.md b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-03/PROVENANCE.mdindex 5e7b86b05e..789d240657 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-03/PROVENANCE.md+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-03/PROVENANCE.md@@ -15,4 +15,4 @@ log.similarity review of the other tasks that day, so that review does not coverthem. No external source is declared; a similarity check against publicbenchmarks is still to be done.-* **Licence:** MIT, under the repository [LICENSE](../../../../../../LICENSE.md).+* **Licence:** FSL-1.1-MIT, under the benchmark's [LICENSE](../../../../LICENSE).diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-03/evaluate.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-03/evaluate.pyindex 0d67a67298..abdb194a60 100755--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-03/evaluate.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-03/evaluate.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Evaluate IR-03: an unsaved-changes sheet when switching notes or pressing Done (BenchLab irunsaved).Usage: evaluate.py --seed N --state PATH --events PATH --result OUT.jsondiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-03/render_brief.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-03/render_brief.pyindex b14011468c..190ef9be0c 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-03/render_brief.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-03/render_brief.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Render the agent prompt for IR-03 from a seed (Amendment 14)."""from __future__ import annotationsdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-04/PROVENANCE.md b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-04/PROVENANCE.mdindex 9caaef1563..295378769e 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-04/PROVENANCE.md+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-04/PROVENANCE.md@@ -15,4 +15,4 @@ log.similarity review of the other tasks that day, so that review does not coverthem. No external source is declared; a similarity check against publicbenchmarks is still to be done.-* **Licence:** MIT, under the repository [LICENSE](../../../../../../LICENSE.md).+* **Licence:** FSL-1.1-MIT, under the benchmark's [LICENSE](../../../../LICENSE).diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-04/evaluate.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-04/evaluate.pyindex 60c2756daf..7cdabe5102 100755--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-04/evaluate.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-04/evaluate.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Evaluate IR-04: a late cookie-consent overlay on a web page (BenchLab irconsent, WKWebView).Usage: evaluate.py --seed N --state PATH --events PATH --result OUT.jsondiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-04/render_brief.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-04/render_brief.pyindex d3388ee918..87d06c3cee 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-04/render_brief.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/IR-04/render_brief.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Render the agent prompt for IR-04 from a seed (Amendment 14)."""from __future__ import annotationsdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-09/PROVENANCE.md b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-09/PROVENANCE.mdindex 7ae2b0c32d..1780f3bf86 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-09/PROVENANCE.md+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-09/PROVENANCE.md@@ -16,4 +16,4 @@ log.tasks with public desktop, web and terminal benchmarks (OSWorld, OSWorld 2.0from its paper, WindowsAgentArena, macOSWorld, Mac Agent Bench, Hunch Bench,Terminal-Bench and others) and found no near-copy or structural copy.-* **Licence:** MIT, under the repository [LICENSE](../../../../../../LICENSE.md).+* **Licence:** FSL-1.1-MIT, under the benchmark's [LICENSE](../../../../LICENSE).diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-09/evaluate.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-09/evaluate.pyindex 8851b11590..2952b5710f 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-09/evaluate.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-09/evaluate.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Evaluate MB-09: reorder a native list by drag and drop, then Done.Usage: evaluate.py --seed N --state PATH --events PATH --result OUT.jsondiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-09/render_brief.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-09/render_brief.pyindex 978ca32dee..bd3b3db229 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-09/render_brief.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-09/render_brief.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Render the agent prompt for MB-09 from a seed."""from __future__ import annotationsdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-10/PROVENANCE.md b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-10/PROVENANCE.mdindex fe8a9cef11..e0accad0c1 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-10/PROVENANCE.md+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-10/PROVENANCE.md@@ -16,4 +16,4 @@ log.tasks with public desktop, web and terminal benchmarks (OSWorld, OSWorld 2.0from its paper, WindowsAgentArena, macOSWorld, Mac Agent Bench, Hunch Bench,Terminal-Bench and others) and found no near-copy or structural copy.-* **Licence:** MIT, under the repository [LICENSE](../../../../../../LICENSE.md).+* **Licence:** FSL-1.1-MIT, under the benchmark's [LICENSE](../../../../LICENSE).diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-10/evaluate.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-10/evaluate.pyindex d43d9b471e..b2cc5a3295 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-10/evaluate.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-10/evaluate.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Evaluate MB-10 (was PROBE-HOVER): BenchLab hover mode.Usage: evaluate.py --seed N --state PATH --events PATH --result OUT.jsondiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-10/render_brief.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-10/render_brief.pyindex 678aebd441..48576a00cd 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-10/render_brief.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-10/render_brief.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Render the agent prompt for MB-10 from a seed."""from __future__ import annotationsdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-11/PROVENANCE.md b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-11/PROVENANCE.mdindex d1dce54674..557ee04104 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-11/PROVENANCE.md+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-11/PROVENANCE.md@@ -16,4 +16,4 @@ log.tasks with public desktop, web and terminal benchmarks (OSWorld, OSWorld 2.0from its paper, WindowsAgentArena, macOSWorld, Mac Agent Bench, Hunch Bench,Terminal-Bench and others) and found no near-copy or structural copy.-* **Licence:** MIT, under the repository [LICENSE](../../../../../../LICENSE.md).+* **Licence:** FSL-1.1-MIT, under the benchmark's [LICENSE](../../../../LICENSE).diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-11/evaluate.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-11/evaluate.pyindex be700b1d95..58196c981b 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-11/evaluate.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-11/evaluate.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Evaluate MB-11: read a native tooltip, type its code, Submit once.Usage: evaluate.py --seed N --state PATH --events PATH --result OUT.jsondiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-11/render_brief.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-11/render_brief.pyindex 954440d7e2..05a611874d 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-11/render_brief.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/MB-11/render_brief.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Render the agent prompt for MB-11 from a seed."""from __future__ import annotationsdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/_common/benchlab_common.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/_common/benchlab_common.pyindex 425f15f60b..d5bdf327b8 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/_common/benchlab_common.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/_common/benchlab_common.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Shared plumbing for BenchLab probes: PRNG, seed derivation, log loading, scoring.The PRNG and the per-mode derivations below must stay identical to the Swiftdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/_common/clicks.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/_common/clicks.pyindex 752aee92a2..750c69f649 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/_common/clicks.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/_common/clicks.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Click pairing for canvas modes: mouseDown/mouseUp events into clicks (copied from PROBE-CANVASCLICK)."""from __future__ import annotationsdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/_common/interrupts.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/_common/interrupts.pyindex 227a42df2d..98a2bf6051 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/_common/interrupts.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/_common/interrupts.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Shared scoring for the Bench v2 interruption probes (IR-01..IR-04, Amendment 14).Every IR evaluator records one diagnostic, `interruption`, with four fields that the runner copiesdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/synth.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/synth.pyindex a251a007f5..c3a98a3a60 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/synth.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/synth.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Synthetic BenchLab state/events builders that mimic what the app writes."""from __future__ import annotationsdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/test_common.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/test_common.pyindex b1fcc16777..69677fb329 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/test_common.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/test_common.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+from __future__ import annotationsimport jsondiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/test_interrupts.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/test_interrupts.pyindex c12053c0ca..8a6480da15 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/test_interrupts.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/test_interrupts.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""IR-01..IR-04 evaluators (Amendment 14) on synthetic logs shaped like BenchLabInterrupts.swift writes."""from __future__ import annotationsdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/test_mb_parity.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/test_mb_parity.pyindex 19ea5d8759..d178ed7d57 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/test_mb_parity.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/probes/tests/test_mb_parity.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Swift/Python parity for the MB-* derivations (needs xcrun swiftc; skipped when it is missing).Compiles BenchLab with -D BENCHLAB_DUMP and compares `--dump-params` with benchlab_common for 60 seeds.diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/recorder.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/recorder.pyindex 48dd340659..990bfdaacf 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/recorder.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/recorder.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Screen recording for every trial, plus background compression.Why not `screencapture -v` or ffmpeg avfoundation: both are attributed to the launching appdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/run_bench.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/run_bench.pyindex e04026c782..c74e83f53b 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/run_bench.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/run_bench.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Claude Code computer-use benchmark runner: same model, same harness, two MCP tool layers.run_bench.py preflight --run-id NAME [--build-dir DIR]diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/run_pilot.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/run_pilot.pyindex 431171287e..ca0b95daac 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/run_pilot.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/run_pilot.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Local macOS pilot: Codex built-in computer use vs Cua Driver, same model.Diagnostic and non-certifying. Runs on the host Mac (no VM), so it is gated ondiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchLab.swift b/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchLab.swiftindex efb8349dea..6afea2266f 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchLab.swift+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchLab.swift@@ -1,3 +1,6 @@+// SPDX-License-Identifier: FSL-1.1-MIT+// Copyright (c) 2026 Cua AI, Inc.+// BenchLab: one small native AppKit app with six test-bench modes for computer-use// probes. Every UI event is appended to --events (JSONL) and the full state is// rewritten atomically to --state. The app never writes expected answers: all taskdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchLabInterrupts.swift b/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchLabInterrupts.swiftindex 43bdd7b008..866076c429 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchLabInterrupts.swift+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchLabInterrupts.swift@@ -1,3 +1,6 @@+// SPDX-License-Identifier: FSL-1.1-MIT+// Copyright (c) 2026 Cua AI, Inc.+// BenchLabInterrupts: the Bench v2 interruption probes (IR-01..IR-04, Amendment 14, CUA-1283).// Same contract as BenchLab.swift: every UI event is appended to --events, the full state is// rewritten to --state, and no expected answer is ever written. The evaluators in ../probesdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchLabModes.swift b/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchLabModes.swiftindex dce6321c17..2c3a4ca427 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchLabModes.swift+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchLabModes.swift@@ -1,3 +1,6 @@+// SPDX-License-Identifier: FSL-1.1-MIT+// Copyright (c) 2026 Cua AI, Inc.+// BenchLabModes: the extra BenchLab modes used by the macOS bench (MB-02, MB-03, MB-06,// MB-08, MB-09, MB-11). Same contract as BenchLab.swift: every UI event is appended to// --events, the full state is rewritten to --state, and no expected answer is everdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchSentinel.swift b/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchSentinel.swiftindex dcd2ed28d3..d4901b2f80 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchSentinel.swift+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/BenchSentinel.swift@@ -1,3 +1,6 @@+// SPDX-License-Identifier: FSL-1.1-MIT+// Copyright (c) 2026 Cua AI, Inc.+// BenchSentinel: a tiny always-there window that stays frontmost and key while an// agent works in other apps. It logs focus changes, leaked keys/clicks/scrolls and// pointer position as JSONL so a run can be scored for foreground disturbance.diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/build.sh b/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/build.shindex 6b67ba3bf2..27b350fc08 100755--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/build.sh+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/build.sh@@ -1,4 +1,7 @@#!/usr/bin/env bash+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+# Build BenchSentinel.app and BenchLab.app into <outdir> and sign them ad hoc.# Usage: build.sh <outdir>set -euo pipefaildiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/summarize_sentinel.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/summarize_sentinel.pyindex e9c40d5e4f..c72cc36691 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/summarize_sentinel.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/summarize_sentinel.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Summarize a BenchSentinel JSONL log over its armed window.The armed window runs from the first {"ev":"armed"} line to the nextdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/tests/test_summarize_sentinel.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/tests/test_summarize_sentinel.pyindex 467e471250..50a31f5bef 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/tests/test_summarize_sentinel.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/swift/tests/test_summarize_sentinel.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+from __future__ import annotationsimport jsondiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_analyze.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_analyze.pyindex 7ea075a2cb..097cba8d68 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_analyze.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_analyze.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+from __future__ import annotationsimport contextlibdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_bench.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_bench.pyindex c246588d75..c297870c7d 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_bench.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_bench.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Unit tests for the Claude Code benchmark runner logic: schedule, blocks, quota gate, ledger,backoff, cutoff, stream-json parsing, failure classification, argv and environment scrubbing.No GUI and no model calls."""diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_bench_v2.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_bench_v2.pyindex cf1f07094c..de7efc6b43 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_bench_v2.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_bench_v2.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Bench v2 (Amendment 14): categories, GUI-only guard, background score, v2 task selection."""from __future__ import annotationsdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_cdb_adapter.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_cdb_adapter.pyindex c1944e6a1b..c75cb375dc 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_cdb_adapter.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_cdb_adapter.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Tests of the generic CDB adapter with a synthetic pack (no private material, no GUI, no model)."""from __future__ import annotationsdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_codex_native.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_codex_native.pyindex ca304771de..60b2e99482 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_codex_native.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_codex_native.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Amendment 20 (CUA-1347): the native Codex arm (Codex CLI + gpt-6-astra driving Codex computer use)."""from __future__ import annotationsdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_pilot_runner.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_pilot_runner.pyindex ba489e682a..75faf30dd7 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_pilot_runner.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_pilot_runner.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Unit tests for the pilot runner pieces that do not need a GUI or a model."""from __future__ import annotationsdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_runner_flow.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_runner_flow.pyindex 40b49fceba..de8c869b17 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_runner_flow.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tests/test_runner_flow.py@@ -1,3 +1,6 @@+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Flow tests for run_bench.execute_trial and the gates, with run_attempt and the pauses faked: retries,backoff, exclusion, the quota stop rule, the wall-clock cutoff, the optional budget cap, resume andfinalize. No GUI, no model."""diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/analyze_v2.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/analyze_v2.pyindex 3f94300ae3..00063a8cf3 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/analyze_v2.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/analyze_v2.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Bench v2 report (Amendment 14, A14.7): per arm, overall and per category.tools/analyze_v2.py RUN_DIR [RUN_DIR ...] [--include-smoke] [--json OUT.json] [--md OUT.md]diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/benchinput.swift b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/benchinput.swiftindex f49607f1ff..a0c7515fd3 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/benchinput.swift+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/benchinput.swift@@ -1,3 +1,6 @@+// SPDX-License-Identifier: FSL-1.1-MIT+// Copyright (c) 2026 Cua AI, Inc.+// benchinput: a tiny CGEvent injector used only to validate the MB-* fixtures (oracle solutions).// Real HID-level events at global screen points (origin top-left, points).//diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/check_named_electron.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/check_named_electron.pyindex cf7bdda19d..4ef3d56ba6 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/check_named_electron.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/check_named_electron.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Amendment 4 check (A4.2), no model call: start one CDB task's apps the way the runner does and show howeach Electron app appears to the system, to Cua Driver and to Codex computer use.diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/check_pack_pins.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/check_pack_pins.pyindex ab5606baf0..0c44686c37 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/check_pack_pins.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/check_pack_pins.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Check that pins.json `cdb_pack.tree_sha256` matches the task pack in this repository.tools/check_pack_pins.py [--write]diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/fixture.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/fixture.pyindex 038dd9ef16..ca74f5d6a6 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/fixture.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/fixture.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Fixture lifecycle for the MB-* tasks: setup, check, reset.The runner may use this module or reimplement the same three steps (they are the same as run_pilot.py'sdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/install_cua_driver.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/install_cua_driver.pyindex 9bec6d23db..61fb69aa68 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/install_cua_driver.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/install_cua_driver.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Install the pinned Cua Driver release for arm A as a private copy.Downloads the release assets named in pins.json from github.com/trycua/cua, checks their sha256 against pins.jsondiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/make_codex_cu_mcp.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/make_codex_cu_mcp.pyindex 0a1a2ce28b..770790e945 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/make_codex_cu_mcp.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/make_codex_cu_mcp.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Write the arm B MCP config for Claude Code from OpenAI's shipped plugin file.The server entry is the `cua_repl` entry of the newest `unified-computer-use` plugin in the Codex plugin cache,diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/posthoc_calls.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/posthoc_calls.pyindex 2edd22e9db..954eb762e2 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/posthoc_calls.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/posthoc_calls.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Post-hoc analyses of the tool calls in a run (labelled post-hoc in the report; not pre-registered).failed every failed MCP call: tool, input, error text, what followed, whether a retry of the same tool workeddiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/smoke_cdb_apps.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/smoke_cdb_apps.pyindex e09760dc05..7dcdeca1e5 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/smoke_cdb_apps.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/smoke_cdb_apps.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Start the apps of one CDB task the way the runner does, place the windows, hold for a screenshot, stop.No model call. Run from Terminal.app inside the benchmark VM. smoke_cdb_apps.py CDB-S01 [hold_seconds]"""diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/validate.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/validate.pyindex ab4051d241..7443835623 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/validate.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/validate.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Validate the MB-* fixtures and checkers with real input.For every task: (1) no-op run -> fail; (2) oracle through real HID events (tools/benchinput, CGEvent) -> pass;diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/validate_cdb.py b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/validate_cdb.pyindex c01077ee9d..f3808e86a2 100644--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/validate_cdb.py+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/validate_cdb.py@@ -1,4 +1,7 @@#!/usr/bin/env python3+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+"""Offline validation of the CDB tasks in this runner. No model call, no GUI.For each task: reset through the runner's adapter (the pack's setup, then its byte-level verify), run thediff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/assemble_main.sh b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/assemble_main.shindex aabd043a68..3be6619007 100755--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/assemble_main.sh+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/assemble_main.sh@@ -1,4 +1,7 @@#!/bin/zsh+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+# Assemble the private main-build app (ad-hoc signed, own bundle id) and its skill, inside the VMset -eM=~/bench-work/cua-maindiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/assemble_script.sh b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/assemble_script.shindex e71c12777e..43e9fb23d9 100755--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/assemble_script.sh+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/assemble_script.sh@@ -1,4 +1,7 @@#!/bin/zsh+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+# Amendment 6: the script arm's private app, a copy of the main-build app with its own bundle id# (com.trycua.driver.benchscript), so its TCC rows are its own. Same binary; the run_script flag is set by the# runner in the daemon's environment, not here. Run after assemble_main.sh, then tcc_grant.sh with this app and id.diff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/build_main.sh b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/build_main.shindex 9ab59bbeb5..1e7f9dc371 100755--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/build_main.sh+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/build_main.sh@@ -1,4 +1,7 @@#!/bin/zsh+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+# Kept for the record (Amendments 3 and 5): the scripts that build, assemble and grant the private main-build app inside the# benchmark VM (SIP disabled). Run as the VM user lume, with sudo rights, in this order: build_main.sh, assemble_main.sh, tcc_grant.sh.# build Cua Driver from the main snapshot (release config) inside the VMdiff --git a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/tcc_grant.sh b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/tcc_grant.shindex 207024af69..b181a99f18 100755--- a/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/tcc_grant.sh+++ b/benchmarks/cua-driver-bench/automated-eval/macos_bench/tools/vm_main_build/tcc_grant.sh@@ -1,4 +1,7 @@#!/bin/zsh+# SPDX-License-Identifier: FSL-1.1-MIT+# Copyright (c) 2026 Cua AI, Inc.+# Grant Accessibility + Screen Recording (system TCC.db) and Automation (user TCC.db) to the main-build app.# VM only (SIP is disabled in this VM). Mirrors the grants com.trycua.driver (0.34.0) already has.set -ediff --git a/benchmarks/cua-driver-bench/taskpack/README.md b/benchmarks/cua-driver-bench/taskpack/README.mdindex a72a20b6e9..fd4ebe86ba 100644--- a/benchmarks/cua-driver-bench/taskpack/README.md+++ b/benchmarks/cua-driver-bench/taskpack/README.md@@ -30,7 +30,8 @@ every registered Bench v2 run used. The copy differs from that revision only inlicence and provenance metadata:* the `license` field of every `package.json` and `package-lock.json` is now- `MIT` (it was a proprietary licence reference);+ `FSL-1.1-MIT` (it was a proprietary licence reference, and `MIT` in #4973+ and #4978);* `PROVENANCE.md` and the `provenance` block of `task.cuabench.json` describethe origin for a public reader, and each task's `README.md` no longer links todocuments of the private repository;@@ -69,6 +70,9 @@ amendment registered before their first trial.## Licence-MIT, under the repository [LICENSE](../../../LICENSE.md). Copyright (c) 2026 Cua-AI, Inc. Third-party software that the apps install is listed in+FSL-1.1-MIT, under the benchmark's [LICENSE](../LICENSE). Copyright (c) 2026+Cua AI, Inc. The task files carry no per-file SPDX headers because their+content is pinned by digest; the folder-level LICENSE covers them. The copy+published in #4973 and #4978 was MIT; its tree digests are kept in `pins.json`+`cdb_pack.mit_release_tree_sha256`. Third-party software that the apps install is listed in[`THIRD_PARTY_NOTICES.md`](THIRD_PARTY_NOTICES.md); none of it is vendored.diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/PROVENANCE.md b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/PROVENANCE.mdindex 371bd7f09b..0cfc180b51 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/PROVENANCE.md+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/PROVENANCE.md@@ -45,9 +45,11 @@ thematic (the same app or the same kind of work).## Licence-Copyright (c) 2026 Cua AI, Inc. Released under the MIT License as part of+Copyright (c) 2026 Cua AI, Inc. Released under the Functional Source License, Version 1.1, MIT+Future License (FSL-1.1-MIT) as part ofthe public Cua Driver Bench task set (see [the task pack README](../../../README.md)).This task was first written in Cua's private benchmark repository under a-proprietary licence; Cua relicensed it for this release. Electron and its+proprietary licence; Cua relicensed it for this release (under MIT in+#4973 and #4978, under FSL-1.1-MIT since; see the [bench LICENSE](../../../../LICENSE)). Electron and itslockfile-pinned dependencies are external and not vendored (see[THIRD_PARTY_NOTICES.md](../../../THIRD_PARTY_NOTICES.md)).diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/apps/lighthouse-desk/package-lock.json b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/apps/lighthouse-desk/package-lock.jsonindex 02a9245814..e641a2ddea 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/apps/lighthouse-desk/package-lock.json+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/apps/lighthouse-desk/package-lock.json@@ -7,7 +7,7 @@"": {"name": "lighthouse-desk","version": "0.1.0",- "license": "MIT",+ "license": "FSL-1.1-MIT","devDependencies": {"electron": "43.4.0"},diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/apps/lighthouse-desk/package.json b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/apps/lighthouse-desk/package.jsonindex 98d71c7361..34587db0f3 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/apps/lighthouse-desk/package.json+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/apps/lighthouse-desk/package.json@@ -3,7 +3,7 @@"version": "0.1.0","private": true,"description": "Benchmark-owned Electron surfaces for mail, chat, and calendar workflows.",- "license": "MIT",+ "license": "FSL-1.1-MIT","main": "main.js","engines": {"node": ">=22"diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/task.cuabench.json b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/task.cuabench.jsonindex cac3af8c8f..4ba23d9fad 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/task.cuabench.json+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s02/task.cuabench.json@@ -86,11 +86,11 @@},{"path": "apps/lighthouse-desk/package.json",- "sha256": "db1179b3ec39e6b87ecf43841c0f4e204cf48a366a48170f91a3c41c414a7b7e"+ "sha256": "e9e03a634c21412e6e8182ef383f178a60b6a998c7434f6759bbe485ad5afb82"},{"path": "apps/lighthouse-desk/package-lock.json",- "sha256": "6473c9cec447f93fae8862864f7c0912e124261e0c5153968444146d3426bc87"+ "sha256": "7f6041f96bff7c2ce118da24d42594ee36b02aa74b064740cd3092d48ab27ccb"},{"path": "apps/lighthouse-desk/renderer/index.html",diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/PROVENANCE.md b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/PROVENANCE.mdindex 52e8c60782..f9e7157865 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/PROVENANCE.md+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/PROVENANCE.md@@ -43,9 +43,11 @@ thematic (the same app or the same kind of work).## Licence-Copyright (c) 2026 Cua AI, Inc. Released under the MIT License as part of+Copyright (c) 2026 Cua AI, Inc. Released under the Functional Source License, Version 1.1, MIT+Future License (FSL-1.1-MIT) as part ofthe public Cua Driver Bench task set (see [the task pack README](../../../README.md)).This task was first written in Cua's private benchmark repository under a-proprietary licence; Cua relicensed it for this release. Electron and its+proprietary licence; Cua relicensed it for this release (under MIT in+#4973 and #4978, under FSL-1.1-MIT since; see the [bench LICENSE](../../../../LICENSE)). Electron and itslockfile-pinned dependencies are external and not vendored (see[THIRD_PARTY_NOTICES.md](../../../THIRD_PARTY_NOTICES.md)).diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/apps/ledger-lantern-mail/package-lock.json b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/apps/ledger-lantern-mail/package-lock.jsonindex c75943a3a3..cc1bea3034 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/apps/ledger-lantern-mail/package-lock.json+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/apps/ledger-lantern-mail/package-lock.json@@ -7,7 +7,7 @@"": {"name": "ledger-lantern-mail","version": "0.1.0",- "license": "MIT",+ "license": "FSL-1.1-MIT","devDependencies": {"electron": "43.4.0"},diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/apps/ledger-lantern-mail/package.json b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/apps/ledger-lantern-mail/package.jsonindex 9c209f7d06..88a50761f9 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/apps/ledger-lantern-mail/package.json+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/apps/ledger-lantern-mail/package.json@@ -3,7 +3,7 @@"version": "0.1.0","private": true,"description": "Read-only benchmark mail surface for Kestrel Wharf Workshop invoice records.",- "license": "MIT",+ "license": "FSL-1.1-MIT","main": "main.js","engines": {"node": ">=22"diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/task.cuabench.json b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/task.cuabench.jsonindex ff4bdf1983..3a6a21afe2 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/task.cuabench.json+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s03/task.cuabench.json@@ -102,11 +102,11 @@},{"path": "apps/ledger-lantern-mail/package.json",- "sha256": "6c135552d0054b315652f13c2f4ea2e605f53280268e5fdae7f9534a002db0f9"+ "sha256": "278704dd0704cf6cee7301af5ce7e7cb4a9f0e5a802dfc7b4ce420c0541d7af5"},{"path": "apps/ledger-lantern-mail/package-lock.json",- "sha256": "45e4895de2b08e21168447ef0b88af88a95493a1bbbdd966a2bf6ec10cdbeea3"+ "sha256": "f2238692f558cdcef175d01e107eddc73e852a3d7fe9cd9716ca5b475ae43b01"},{"path": "apps/ledger-lantern-mail/renderer/index.html",diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/PROVENANCE.md b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/PROVENANCE.mdindex d16fbab15b..83ffe1bf8f 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/PROVENANCE.md+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/PROVENANCE.md@@ -37,9 +37,11 @@ thematic (the same app or the same kind of work).## Licence-Copyright (c) 2026 Cua AI, Inc. Released under the MIT License as part of+Copyright (c) 2026 Cua AI, Inc. Released under the Functional Source License, Version 1.1, MIT+Future License (FSL-1.1-MIT) as part ofthe public Cua Driver Bench task set (see [the task pack README](../../../README.md)).This task was first written in Cua's private benchmark repository under a-proprietary licence; Cua relicensed it for this release. Electron and its+proprietary licence; Cua relicensed it for this release (under MIT in+#4973 and #4978, under FSL-1.1-MIT since; see the [bench LICENSE](../../../../LICENSE)). Electron and itslockfile-pinned dependencies are external and not vendored (see[THIRD_PARTY_NOTICES.md](../../../THIRD_PARTY_NOTICES.md)).diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/margin-lantern-manual/package-lock.json b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/margin-lantern-manual/package-lock.jsonindex a649c6a323..ca54a2cb96 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/margin-lantern-manual/package-lock.json+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/margin-lantern-manual/package-lock.json@@ -7,7 +7,7 @@"": {"name": "margin-lantern-manual","version": "0.1.0",- "license": "MIT",+ "license": "FSL-1.1-MIT","devDependencies": {"electron": "43.4.0"},diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/margin-lantern-manual/package.json b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/margin-lantern-manual/package.jsonindex 83b9ec4790..a3eab03f43 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/margin-lantern-manual/package.json+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/margin-lantern-manual/package.json@@ -3,7 +3,7 @@"version": "0.1.0","private": true,"description": "Read-only Margin Lantern support manual.",- "license": "MIT",+ "license": "FSL-1.1-MIT","main": "main.js","engines": { "node": ">=22" },"scripts": {diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/rillwatch-cases/package-lock.json b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/rillwatch-cases/package-lock.jsonindex a9bb022072..44ec398d17 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/rillwatch-cases/package-lock.json+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/rillwatch-cases/package-lock.json@@ -7,7 +7,7 @@"": {"name": "rillwatch-cases","version": "0.1.0",- "license": "MIT",+ "license": "FSL-1.1-MIT","devDependencies": {"electron": "43.4.0"},diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/rillwatch-cases/package.json b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/rillwatch-cases/package.jsonindex 90d45431f6..918762b414 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/rillwatch-cases/package.json+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/apps/rillwatch-cases/package.json@@ -3,7 +3,7 @@"version": "0.1.0","private": true,"description": "Benchmark-owned Rillwatch case review application.",- "license": "MIT",+ "license": "FSL-1.1-MIT","main": "main.js","engines": { "node": ">=22" },"scripts": {diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/evaluator/oracle.json b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/evaluator/oracle.jsonindex 32bf547aa6..6c438d1812 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/evaluator/oracle.json+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/evaluator/oracle.json@@ -45,8 +45,8 @@},"workspace_files": {"archive-site/data/records.json": "234fc0ea495a8a2da8cf9f2c03352bd8952c2c1d6aa2a2158a01ce61a4ff5030",- "archive-site/package-lock.json": "a36614027637dceac58932b1d5bf400c2da48bd84b294ac9cffaddfa59ee2f97",- "archive-site/package.json": "7cd35ca5f8f81e703de4d89f3bceecd559d338eaee830cbf5b9e9e2b238b3608",+ "archive-site/package-lock.json": "b87ec74af811b4d536cc9e4811172cbe29d801357fab3d470e095cb75cdaec2a",+ "archive-site/package.json": "82a76e1243f64ffc2dc2220031a035a77bf8c11ccbd7b8d9c4f50a3ddfc55562","archive-site/public/app.js": "c7e14bd87d27d6518fba930f47e359de687abdf959e51fdd97b6d6afa22d1a9c","archive-site/public/styles.css": "f10aa07002f774b1ac2325ae31f1a594fd12dbc5a977638d2af5e2bf3759eab5","archive-site/server.js": "baaef12b833c44ec5d6ef60b266b3c98c1441c526d8b512aa9028aaf2ee41fa1",@@ -58,8 +58,8 @@},"protected_sha256": {"archive-site/data/records.json": "234fc0ea495a8a2da8cf9f2c03352bd8952c2c1d6aa2a2158a01ce61a4ff5030",- "archive-site/package-lock.json": "a36614027637dceac58932b1d5bf400c2da48bd84b294ac9cffaddfa59ee2f97",- "archive-site/package.json": "7cd35ca5f8f81e703de4d89f3bceecd559d338eaee830cbf5b9e9e2b238b3608",+ "archive-site/package-lock.json": "b87ec74af811b4d536cc9e4811172cbe29d801357fab3d470e095cb75cdaec2a",+ "archive-site/package.json": "82a76e1243f64ffc2dc2220031a035a77bf8c11ccbd7b8d9c4f50a3ddfc55562","archive-site/public/app.js": "c7e14bd87d27d6518fba930f47e359de687abdf959e51fdd97b6d6afa22d1a9c","archive-site/public/styles.css": "f10aa07002f774b1ac2325ae31f1a594fd12dbc5a977638d2af5e2bf3759eab5","archive-site/server.js": "baaef12b833c44ec5d6ef60b266b3c98c1441c526d8b512aa9028aaf2ee41fa1",diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/fixture/archive-site/package-lock.json b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/fixture/archive-site/package-lock.jsonindex 909f2356d6..bbf8050615 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/fixture/archive-site/package-lock.json+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/fixture/archive-site/package-lock.json@@ -7,7 +7,7 @@"": {"name": "morrowglass-archive","version": "0.1.0",- "license": "MIT",+ "license": "FSL-1.1-MIT","engines": { "node": ">=22" }}}diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/fixture/archive-site/package.json b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/fixture/archive-site/package.jsonindex fbcfa44cac..0e8f2c9a69 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/fixture/archive-site/package.json+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/fixture/archive-site/package.json@@ -3,7 +3,7 @@"version": "0.1.0","private": true,"description": "Package-free local archive inspection fixture.",- "license": "MIT",+ "license": "FSL-1.1-MIT","engines": { "node": ">=22" },"scripts": { "start": "node server.js", "check": "node --check server.js && node --check public/app.js", "test": "node --test \"tests/**/*.test.js\"" }}diff --git a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/task.cuabench.json b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/task.cuabench.jsonindex 4518bd4e77..eae5185c7e 100644--- a/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/task.cuabench.json+++ b/benchmarks/cua-driver-bench/taskpack/tasks/shared/cdb-s04/task.cuabench.json@@ -70,11 +70,11 @@},{"path": "fixture/archive-site/package.json",- "sha256": "7cd35ca5f8f81e703de4d89f3bceecd559d338eaee830cbf5b9e9e2b238b3608"+ "sha256": "82a76e1243f64ffc2dc2220031a035a77bf8c11ccbd7b8d9c4f50a3ddfc55562"},{"path": "fixture/archive-site/package-lock.json",- "sha256": "a36614027637dceac58932b1d5bf400c2da48bd84b294ac9cffaddfa59ee2f97"+ "sha256": "b87ec74af811b4d536cc9e4811172cbe29d801357fab3d470e095cb75cdaec2a"},{"path": "fixture/archive-site/server.js",@@ -106,11 +106,11 @@},{"path": "apps/rillwatch-cases/package.json",- "sha256": "df31ed07918e48e9b183da3c40a0a3290567e114c7765c25c1450830691f67f3"+ "sha256": "0cf18fc4dd112b413a0bda274ff80eed78c19610e9123b38b8a7f6b172397151"},{"path": "apps/rillwatch-cases/package-lock.json",- "sha256": "1654116faf4cc75f14bc49db965059dea22f20e08e695e456a1c8a924e64541d"+ "sha256": "71168934a6a7b4f277fe3e9ce34ddc81c74e35a44eb94343e4efd2450e6180db"},{"path": "apps/rillwatch-cases/renderer/index.html",@@ -142,11 +142,11 @@},{"path": "apps/margin-lantern-manual/package.json",- "sha256": "6995b384d6c7334c4c1642b8c2a7ce5b6896e5218ceff634eb400c56f6a18bda"+ "sha256": "aa638b1dea8563a1de8c8c15547510fce4aaf4b0de8db689e8834ce8bde79e18"},{"path": "apps/margin-lantern-manual/package-lock.json",- "sha256": "b7721533e55ebfcbd185004f9889a353d64c31557eb0b8aa2fbbdc9a6562fe32"+ "sha256": "b2e78f8517631d0de6188f7de5c66a49f28694b332f9f6e53d0d937409fc7ce0"},{"path": "apps/margin-lantern-manual/renderer/index.html",@@ -276,7 +276,7 @@},{"path": "evaluator/oracle.json",- "sha256": "cc5adc7beb99c7bfe41937404f71d5127679e4a89a9174d1cea198e19a748b02"+ "sha256": "430149bd80461daf90ff36254a36848e4b9cad2f6e5e8cecf029a179ced90330"}],"staging": "agent-inaccessible",diff --git a/scripts/spdx-headers.py b/scripts/spdx-headers.pyindex efe0e5b8ed..c84dc61655 100755--- a/scripts/spdx-headers.py+++ b/scripts/spdx-headers.py@@ -72,6 +72,10 @@ GENERATED_ELSEWHERE = re.compile(r"_pb2(_grpc)?\.py$|_pb\.ts$")# them, so a header added by hand would be overwritten): the HTML5 viewer's# embedded bundle.GENERATED_DIRS = ("libs/cua/crates/cua-spacesd-html5/assets/",)+# FSL directories whose files are pinned by content digest: a header would+# change the digests the benchmark checks, so the folder-level LICENSE covers+# them instead (see benchmarks/cua-driver-bench/LICENSE).+HEADER_EXEMPT_DIRS = ("benchmarks/cua-driver-bench/taskpack/tasks/",)def spdx_header(license_id: str, suffix: str) -> list[str]:@@ -186,6 +190,7 @@ def main() -> int:for root in fsl_roots()for path in iter_source_files(root, extensions)if nearest_license_is_fsl(path, cache)+ and not str(path.relative_to(REPO)).startswith(HEADER_EXEMPT_DIRS)]label = "FSL packages"else: