Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.
Rust agentai-agentapplecomputer-usecomputer-use-agentcontainerizationcuadesktop-automationhacktoberfestlumemacosmanusoperatorswiftvirtualizationvirtualization-frameworkwindowswindows-sandbox
ci(cua-driver): add cached E2E lanes and focused feedback
Francesco Bonaccif50c3201238e
diff --git a/.github/workflows/ci-cua-driver-quick.yml b/.github/workflows/ci-cua-driver-quick.ymlnew file mode 100644index 0000000000..dc7629311c--- /dev/null+++ b/.github/workflows/ci-cua-driver-quick.yml@@ -0,0 +1,45 @@+name: "CI: Cua Driver quick feedback (non-certifying)"++on:+ pull_request:+ paths:+ - "libs/cua-driver/rust/**"+ - "libs/cua-driver/tests/fixtures/shared/web/**"+ - ".github/workflows/ci-cua-driver-quick.yml"+ workflow_dispatch:++permissions:+ contents: read++concurrency:+ group: cua-driver-quick-${{ github.ref }}+ cancel-in-progress: true++jobs:+ focused:+ name: "Linux / focused contracts (not desktop certification)"+ runs-on: ubuntu-latest+ timeout-minutes: 20+ steps:+ - uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4+ - uses: dtolnay/rust-toolchain@stable+ with:+ components: rustfmt+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2+ with:+ workspaces: "libs/cua-driver/rust -> target"+ key: quick-contracts+ save-if: ${{ github.ref == 'refs/heads/main' }}+ - uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4+ with:+ node-version: "22"+ - name: Check formatting and shared web fixture journal+ run: |+ cargo fmt --manifest-path libs/cua-driver/rust/Cargo.toml --all -- --check+ node --test libs/cua-driver/tests/fixtures/shared/web/journal.test.cjs+ - name: Run focused perception and platform-independent contracts+ working-directory: libs/cua-driver/rust+ run: |+ cargo test --locked -p cua-driver-contract --test visual_contract+ cargo test --locked -p cua-perception --test protocol+ cargo test --locked -p cua-driver-core --libdiff --git a/.github/workflows/e2e-rust-linux.yml b/.github/workflows/e2e-rust-linux.ymlindex 2e35310ede..6db0610e11 100644--- a/.github/workflows/e2e-rust-linux.yml+++ b/.github/workflows/e2e-rust-linux.yml@@ -62,6 +62,16 @@ jobs:with:ref: ${{ needs.source.outputs.sha }}- uses: dtolnay/rust-toolchain@stable+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2+ with:+ workspaces: "libs/cua-driver/rust -> target"+ key: e2e-shared+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha }}+ - uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4+ with:+ node-version: "22"+ cache: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && 'npm' || '' }}+ cache-dependency-path: libs/cua-driver/tests/fixtures/apps/cross-platform/electron/package-lock.json- name: Install GUI and Rust build dependenciesrun: |sudo apt-get update@@ -101,6 +111,16 @@ jobs:with:ref: ${{ needs.source.outputs.sha }}- uses: dtolnay/rust-toolchain@stable+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2+ with:+ workspaces: "libs/cua-driver/rust -> target"+ key: e2e-native+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha }}+ - uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4+ with:+ node-version: "22"+ cache: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && 'npm' || '' }}+ cache-dependency-path: libs/cua-driver/tests/fixtures/apps/cross-platform/electron/package-lock.json- name: Install GUI and Rust build dependenciesrun: |sudo apt-get update@@ -141,6 +161,16 @@ jobs:with:ref: ${{ needs.source.outputs.sha }}- uses: dtolnay/rust-toolchain@stable+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2+ with:+ workspaces: "libs/cua-driver/rust -> target"+ key: e2e-capture+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha }}+ - uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4+ with:+ node-version: "22"+ cache: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && 'npm' || '' }}+ cache-dependency-path: libs/cua-driver/tests/fixtures/apps/cross-platform/electron/package-lock.json- name: Install GUI and Rust build dependenciesrun: |sudo apt-get update@@ -180,6 +210,11 @@ jobs:with:ref: ${{ needs.source.outputs.sha }}- uses: dtolnay/rust-toolchain@stable+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2+ with:+ workspaces: "libs/cua-driver/rust -> target"+ key: e2e-installer+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha }}- name: Install Rust build dependenciesrun: |sudo apt-get updatediff --git a/.github/workflows/e2e-rust-windows.yml b/.github/workflows/e2e-rust-windows.ymlindex d36783af1e..ee594046b4 100644--- a/.github/workflows/e2e-rust-windows.yml+++ b/.github/workflows/e2e-rust-windows.yml@@ -60,6 +60,17 @@ jobs:- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4with:ref: ${{ needs.source.outputs.sha }}+ - uses: dtolnay/rust-toolchain@stable+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2+ with:+ workspaces: "libs/cua-driver/rust -> target"+ key: e2e-shared+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && inputs.runner == 'windows-latest' }}+ - uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4+ with:+ node-version: "22"+ cache: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && inputs.runner == 'windows-latest' && 'npm' || '' }}+ cache-dependency-path: libs/cua-driver/tests/fixtures/apps/cross-platform/electron/package-lock.json- name: Ensure FFmpeg for trajectory videoshell: pwshrun: .\scripts\ci\windows\setup-ffmpeg.ps1@@ -94,6 +105,17 @@ jobs:- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4with:ref: ${{ needs.source.outputs.sha }}+ - uses: dtolnay/rust-toolchain@stable+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2+ with:+ workspaces: "libs/cua-driver/rust -> target"+ key: e2e-native+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && inputs.runner == 'windows-latest' }}+ - uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4+ with:+ node-version: "22"+ cache: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && inputs.runner == 'windows-latest' && 'npm' || '' }}+ cache-dependency-path: libs/cua-driver/tests/fixtures/apps/cross-platform/electron/package-lock.json- name: Ensure FFmpeg for trajectory videoshell: pwshrun: .\scripts\ci\windows\setup-ffmpeg.ps1@@ -128,6 +150,17 @@ jobs:- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4with:ref: ${{ needs.source.outputs.sha }}+ - uses: dtolnay/rust-toolchain@stable+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2+ with:+ workspaces: "libs/cua-driver/rust -> target"+ key: e2e-capture+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && inputs.runner == 'windows-latest' }}+ - uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4+ with:+ node-version: "22"+ cache: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && inputs.runner == 'windows-latest' && 'npm' || '' }}+ cache-dependency-path: libs/cua-driver/tests/fixtures/apps/cross-platform/electron/package-lock.json- name: Ensure FFmpeg for trajectory videoshell: pwshrun: .\scripts\ci\windows\setup-ffmpeg.ps1@@ -163,6 +196,11 @@ jobs:with:ref: ${{ needs.source.outputs.sha }}- uses: dtolnay/rust-toolchain@stable+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2+ with:+ workspaces: "libs/cua-driver/rust -> target"+ key: e2e-installer+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha }}- name: Verify installer runner is interactiveshell: pwshrun: .\scripts\ci\windows\verify-user-session.ps1diff --git a/scripts/ci/README.md b/scripts/ci/README.mdindex b713944b68..991b0479ec 100644--- a/scripts/ci/README.md+++ b/scripts/ci/README.md@@ -107,6 +107,50 @@ desktop certification, and it does not replace the desktop matrix.## Desktop runners+### Quick development feedback++`CI: Cua Driver quick feedback (non-certifying)` runs on relevant pull requests+or by manual dispatch. It checks Rust formatting, the shared web fixture journal,+the visual contract and perception protocol, and platform-independent core+unit tests. Use it while iterating on those areas. It does not create a+desktop session, exercise native input or capture, install a release, or issue+a certification artifact. Its goal is a warm-cache run under 10 minutes;+check the workflow's measured duration rather than treating the timeout as a+performance guarantee.++For a local focused iteration, run the matching commands from the repository+root (a first compilation may be much slower than a warm run):++```bash+cargo fmt --manifest-path libs/cua-driver/rust/Cargo.toml --all -- --check+node --test libs/cua-driver/tests/fixtures/shared/web/journal.test.cjs+cd libs/cua-driver/rust+cargo test --locked -p cua-driver-contract --test visual_contract+cargo test --locked -p cua-perception --test protocol+cargo test --locked -p cua-driver-core --lib+```++For desktop behavior, use a diagnostic lane only to narrow a failure. The+complete Linux, Windows, and macOS runs at the stable exact candidate SHA+remain the certification gate described below and in the test harnesses guide.+The Linux and Windows E2E workflows cache Rust dependencies/build products+per OS and lane, and cache npm downloads for the Electron fixture on exact-ref+dispatches. A dispatch against a different reviewed SHA may restore a Rust+cache but cannot save it. Exact-ref branch dispatches save only in that branch's+GitHub cache scope; Windows RDP parity replays cannot save a cache. No fixture `node_modules`,+recording, result, or certification artifact is cached.++To measure the change, compare the wall time of each job and its build/test+step in successive cold- and warm-cache full-matrix runs at a stable candidate.+Record queue, setup, execution, and upload separately. As a pre-cache baseline,+the exact-merge-SHA September 22, 2026 runs (`35789003557` Linux,+`35789006039` Windows) took 25m31s for Linux shared and 40m52s for Windows+shared (job start to completion). The corresponding behavior-matrix steps took+23m20s and 39m41s. The other lanes ran in parallel; these times are not a+median or evidence of a 30% improvement. Compare multiple warm runs before+claiming a sustained reduction, and retain the source SHA and cache-hit state+with each measurement.+| Runner | Session | Canonical command || ------------------------------- | ------------------------------------------------------------------ | ----------------- || `linux/run-rust-e2e.sh` | Existing Linux X11 or Wayland desktop | no selector |