Skip to content

armgit / cua

Public Imported from GitHub
0

Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.

ci(e2e-cua-sdk): drop the Fleet lanes from the nightly (#5421)

Francesco Bonacci7487f66931c6
diff --git a/.github/workflows/e2e-cua-sdk.yml b/.github/workflows/e2e-cua-sdk.yml
index 75c984975a..ab985fc8f3 100644
--- a/.github/workflows/e2e-cua-sdk.yml
+++ b/.github/workflows/e2e-cua-sdk.yml
@@ -5,9 +5,8 @@ name: "E2E: cua SDK"
#
# pull_request hermetic (fixtures, daemon) + container (docker + gVisor on
# the locally built reference images) + docs blocks.
-# nightly live Fleet (+ the spacesd image lane when
-# vars.CUA_E2E_FLEET_ENV_IMAGE names an image Fleet can pull),
-# cua-sandbox, and local QEMU (KVM) on the reference disk.
+# nightly cua-sandbox and local QEMU (KVM) on the reference disk.
+# Cua Cloud has ended, so there is no live Fleet lane.
# dispatch any lane set.
#
# Lume needs a macOS host with nested virtualization, which hosted runners
@@ -32,7 +31,7 @@ on:
workflow_dispatch:
inputs:
lanes:
- description: "Lanes (comma list: hermetic,container,qemu,fleet,fleet-env,cua-sandbox,conformance)"
+ description: "Lanes (comma list: hermetic,container,qemu,cua-sandbox,conformance)"
default: "hermetic,container"
langs:
description: "Languages (py,ts,rust,go)"
@@ -116,9 +115,6 @@ jobs:
env:
LANES: ${{ github.event_name == 'workflow_dispatch' && inputs.lanes || 'hermetic,container' }}
LANGS: ${{ github.event_name == 'workflow_dispatch' && inputs.langs || 'py,ts,rust,go' }}
- CUA_CLIENT_ID: ${{ contains(inputs.lanes, 'fleet') && secrets.CUA_CLIENT_ID || '' }}
- CUA_CLIENT_SECRET: ${{ contains(inputs.lanes, 'fleet') && secrets.CUA_CLIENT_SECRET || '' }}
- CUA_E2E_FLEET_ENV_IMAGE: ${{ vars.CUA_E2E_FLEET_ENV_IMAGE }}
CUA_E2E_PLAYWRIGHT_DIR: ${{ runner.temp }}/pw
# cua keeps 5 GiB free by default. On this disposable runner, after
# the setup and the Rust half's own debug build, that refused the
@@ -140,14 +136,10 @@ jobs:
path: ${{ runner.temp }}/cua-e2e
live:
- name: nightly (fleet, cua-sandbox, qemu)
+ name: nightly (cua-sandbox, qemu)
if: github.event_name == 'schedule'
runs-on: ubuntu-24.04
timeout-minutes: 180
- env:
- CUA_CLIENT_ID: ${{ secrets.CUA_CLIENT_ID }}
- CUA_CLIENT_SECRET: ${{ secrets.CUA_CLIENT_SECRET }}
- CUA_E2E_FLEET_ENV_IMAGE: ${{ vars.CUA_E2E_FLEET_ENV_IMAGE }}
steps:
- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4
- uses: ./.github/actions/linux-rust-prep
@@ -176,15 +168,11 @@ jobs:
go-version: "1.24"
- name: Build the SDK, fixtures, bindings, images, disks and runtimes
run: tests/e2e/cua-sdk/ci-setup.sh --images --disks
- - name: Lanes
- id: lanes
- run: |
- lanes="fleet,cua-sandbox,qemu"
- [ -n "$CUA_E2E_FLEET_ENV_IMAGE" ] && lanes="$lanes,fleet-env"
- echo "lanes=$lanes" >>"$GITHUB_OUTPUT"
+ # Cua Cloud has ended (CUA-1854): Fleet refuses the old live lane, so
+ # the nightly runs only the lanes that need no cloud account.
- name: Run the suite
run: >
- python3 tests/e2e/cua-sdk/run.py --lanes "${{ steps.lanes.outputs.lanes }}"
+ python3 tests/e2e/cua-sdk/run.py --lanes cua-sandbox,qemu
--langs py,ts,rust,go --strict --out "$RUNNER_TEMP/cua-e2e"
- name: Matrix summary
if: always()
diff --git a/tests/e2e/cua-sdk/run.py b/tests/e2e/cua-sdk/run.py
index 055781af3d..8752079365 100755
--- a/tests/e2e/cua-sdk/run.py
+++ b/tests/e2e/cua-sdk/run.py
@@ -2,7 +2,7 @@
"""Run the cua SDK e2e suite and print the guide x language x lane matrix.
tests/e2e/cua-sdk/run.py --lanes hermetic,container --langs py,ts,rust
- tests/e2e/cua-sdk/run.py --lanes fleet --strict # nightly
+ tests/e2e/cua-sdk/run.py --lanes cua-sandbox,qemu --strict # nightly
tests/e2e/cua-sdk/run.py --matrix-only --out DIR # re-render results
Lanes map to the env gates in scenarios.json (the runner sets them). Every