Skip to content

armgit / cua

Public Imported from GitHub
0

Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.

ci(cua-driver): add cached E2E lanes and focused feedback

Francesco Bonaccif50c3201238e
diff --git a/.github/workflows/ci-cua-driver-quick.yml b/.github/workflows/ci-cua-driver-quick.yml
new file mode 100644
index 0000000000..dc7629311c
--- /dev/null
+++ b/.github/workflows/ci-cua-driver-quick.yml
@@ -0,0 +1,45 @@
+name: "CI: Cua Driver quick feedback (non-certifying)"
+
+on:
+ pull_request:
+ paths:
+ - "libs/cua-driver/rust/**"
+ - "libs/cua-driver/tests/fixtures/shared/web/**"
+ - ".github/workflows/ci-cua-driver-quick.yml"
+ workflow_dispatch:
+
+permissions:
+ contents: read
+
+concurrency:
+ group: cua-driver-quick-${{ github.ref }}
+ cancel-in-progress: true
+
+jobs:
+ focused:
+ name: "Linux / focused contracts (not desktop certification)"
+ runs-on: ubuntu-latest
+ timeout-minutes: 20
+ steps:
+ - uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4
+ - uses: dtolnay/rust-toolchain@stable
+ with:
+ components: rustfmt
+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2
+ with:
+ workspaces: "libs/cua-driver/rust -> target"
+ key: quick-contracts
+ save-if: ${{ github.ref == 'refs/heads/main' }}
+ - uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4
+ with:
+ node-version: "22"
+ - name: Check formatting and shared web fixture journal
+ run: |
+ cargo fmt --manifest-path libs/cua-driver/rust/Cargo.toml --all -- --check
+ node --test libs/cua-driver/tests/fixtures/shared/web/journal.test.cjs
+ - name: Run focused perception and platform-independent contracts
+ working-directory: libs/cua-driver/rust
+ run: |
+ cargo test --locked -p cua-driver-contract --test visual_contract
+ cargo test --locked -p cua-perception --test protocol
+ cargo test --locked -p cua-driver-core --lib
diff --git a/.github/workflows/e2e-rust-linux.yml b/.github/workflows/e2e-rust-linux.yml
index 2e35310ede..6db0610e11 100644
--- a/.github/workflows/e2e-rust-linux.yml
+++ b/.github/workflows/e2e-rust-linux.yml
@@ -62,6 +62,16 @@ jobs:
with:
ref: ${{ needs.source.outputs.sha }}
- uses: dtolnay/rust-toolchain@stable
+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2
+ with:
+ workspaces: "libs/cua-driver/rust -> target"
+ key: e2e-shared
+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha }}
+ - uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4
+ with:
+ node-version: "22"
+ cache: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && 'npm' || '' }}
+ cache-dependency-path: libs/cua-driver/tests/fixtures/apps/cross-platform/electron/package-lock.json
- name: Install GUI and Rust build dependencies
run: |
sudo apt-get update
@@ -101,6 +111,16 @@ jobs:
with:
ref: ${{ needs.source.outputs.sha }}
- uses: dtolnay/rust-toolchain@stable
+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2
+ with:
+ workspaces: "libs/cua-driver/rust -> target"
+ key: e2e-native
+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha }}
+ - uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4
+ with:
+ node-version: "22"
+ cache: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && 'npm' || '' }}
+ cache-dependency-path: libs/cua-driver/tests/fixtures/apps/cross-platform/electron/package-lock.json
- name: Install GUI and Rust build dependencies
run: |
sudo apt-get update
@@ -141,6 +161,16 @@ jobs:
with:
ref: ${{ needs.source.outputs.sha }}
- uses: dtolnay/rust-toolchain@stable
+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2
+ with:
+ workspaces: "libs/cua-driver/rust -> target"
+ key: e2e-capture
+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha }}
+ - uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4
+ with:
+ node-version: "22"
+ cache: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && 'npm' || '' }}
+ cache-dependency-path: libs/cua-driver/tests/fixtures/apps/cross-platform/electron/package-lock.json
- name: Install GUI and Rust build dependencies
run: |
sudo apt-get update
@@ -180,6 +210,11 @@ jobs:
with:
ref: ${{ needs.source.outputs.sha }}
- uses: dtolnay/rust-toolchain@stable
+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2
+ with:
+ workspaces: "libs/cua-driver/rust -> target"
+ key: e2e-installer
+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha }}
- name: Install Rust build dependencies
run: |
sudo apt-get update
diff --git a/.github/workflows/e2e-rust-windows.yml b/.github/workflows/e2e-rust-windows.yml
index d36783af1e..ee594046b4 100644
--- a/.github/workflows/e2e-rust-windows.yml
+++ b/.github/workflows/e2e-rust-windows.yml
@@ -60,6 +60,17 @@ jobs:
- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4
with:
ref: ${{ needs.source.outputs.sha }}
+ - uses: dtolnay/rust-toolchain@stable
+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2
+ with:
+ workspaces: "libs/cua-driver/rust -> target"
+ key: e2e-shared
+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && inputs.runner == 'windows-latest' }}
+ - uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4
+ with:
+ node-version: "22"
+ cache: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && inputs.runner == 'windows-latest' && 'npm' || '' }}
+ cache-dependency-path: libs/cua-driver/tests/fixtures/apps/cross-platform/electron/package-lock.json
- name: Ensure FFmpeg for trajectory video
shell: pwsh
run: .\scripts\ci\windows\setup-ffmpeg.ps1
@@ -94,6 +105,17 @@ jobs:
- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4
with:
ref: ${{ needs.source.outputs.sha }}
+ - uses: dtolnay/rust-toolchain@stable
+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2
+ with:
+ workspaces: "libs/cua-driver/rust -> target"
+ key: e2e-native
+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && inputs.runner == 'windows-latest' }}
+ - uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4
+ with:
+ node-version: "22"
+ cache: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && inputs.runner == 'windows-latest' && 'npm' || '' }}
+ cache-dependency-path: libs/cua-driver/tests/fixtures/apps/cross-platform/electron/package-lock.json
- name: Ensure FFmpeg for trajectory video
shell: pwsh
run: .\scripts\ci\windows\setup-ffmpeg.ps1
@@ -128,6 +150,17 @@ jobs:
- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4
with:
ref: ${{ needs.source.outputs.sha }}
+ - uses: dtolnay/rust-toolchain@stable
+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2
+ with:
+ workspaces: "libs/cua-driver/rust -> target"
+ key: e2e-capture
+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && inputs.runner == 'windows-latest' }}
+ - uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4
+ with:
+ node-version: "22"
+ cache: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha && inputs.runner == 'windows-latest' && 'npm' || '' }}
+ cache-dependency-path: libs/cua-driver/tests/fixtures/apps/cross-platform/electron/package-lock.json
- name: Ensure FFmpeg for trajectory video
shell: pwsh
run: .\scripts\ci\windows\setup-ffmpeg.ps1
@@ -163,6 +196,11 @@ jobs:
with:
ref: ${{ needs.source.outputs.sha }}
- uses: dtolnay/rust-toolchain@stable
+ - uses: Swatinem/rust-cache@9d47c6ad4b02e050fd481d890b2ea34778fd09d6 # v2
+ with:
+ workspaces: "libs/cua-driver/rust -> target"
+ key: e2e-installer
+ save-if: ${{ github.ref_type == 'branch' && needs.source.outputs.sha == github.sha }}
- name: Verify installer runner is interactive
shell: pwsh
run: .\scripts\ci\windows\verify-user-session.ps1
diff --git a/scripts/ci/README.md b/scripts/ci/README.md
index b713944b68..991b0479ec 100644
--- a/scripts/ci/README.md
+++ b/scripts/ci/README.md
@@ -107,6 +107,50 @@ desktop certification, and it does not replace the desktop matrix.
## Desktop runners
+### Quick development feedback
+
+`CI: Cua Driver quick feedback (non-certifying)` runs on relevant pull requests
+or by manual dispatch. It checks Rust formatting, the shared web fixture journal,
+the visual contract and perception protocol, and platform-independent core
+unit tests. Use it while iterating on those areas. It does not create a
+desktop session, exercise native input or capture, install a release, or issue
+a certification artifact. Its goal is a warm-cache run under 10 minutes;
+check the workflow's measured duration rather than treating the timeout as a
+performance guarantee.
+
+For a local focused iteration, run the matching commands from the repository
+root (a first compilation may be much slower than a warm run):
+
+```bash
+cargo fmt --manifest-path libs/cua-driver/rust/Cargo.toml --all -- --check
+node --test libs/cua-driver/tests/fixtures/shared/web/journal.test.cjs
+cd libs/cua-driver/rust
+cargo test --locked -p cua-driver-contract --test visual_contract
+cargo test --locked -p cua-perception --test protocol
+cargo test --locked -p cua-driver-core --lib
+```
+
+For desktop behavior, use a diagnostic lane only to narrow a failure. The
+complete Linux, Windows, and macOS runs at the stable exact candidate SHA
+remain the certification gate described below and in the test harnesses guide.
+The Linux and Windows E2E workflows cache Rust dependencies/build products
+per OS and lane, and cache npm downloads for the Electron fixture on exact-ref
+dispatches. A dispatch against a different reviewed SHA may restore a Rust
+cache but cannot save it. Exact-ref branch dispatches save only in that branch's
+GitHub cache scope; Windows RDP parity replays cannot save a cache. No fixture `node_modules`,
+recording, result, or certification artifact is cached.
+
+To measure the change, compare the wall time of each job and its build/test
+step in successive cold- and warm-cache full-matrix runs at a stable candidate.
+Record queue, setup, execution, and upload separately. As a pre-cache baseline,
+the exact-merge-SHA September 22, 2026 runs (`35789003557` Linux,
+`35789006039` Windows) took 25m31s for Linux shared and 40m52s for Windows
+shared (job start to completion). The corresponding behavior-matrix steps took
+23m20s and 39m41s. The other lanes ran in parallel; these times are not a
+median or evidence of a 30% improvement. Compare multiple warm runs before
+claiming a sustained reduction, and retain the source SHA and cache-hit state
+with each measurement.
+
| Runner | Session | Canonical command |
| ------------------------------- | ------------------------------------------------------------------ | ----------------- |
| `linux/run-rust-e2e.sh` | Existing Linux X11 or Wayland desktop | no selector |