Skip to content

Dodaios is an open-source agent OS for your desktop: it runs your coding agents, browser and apps by voice or chat, on your own machine. Formerly Personal Jarvis.

feat(ci): rebuild CI as a lane-gated orchestrator with one required gate

rubenluetke10-beep5cb08527efef
diff --git a/.github/workflows/browser-runtime.yml b/.github/workflows/browser-runtime.yml
index b1ccf7d421..ead07aa24c 100644
--- a/.github/workflows/browser-runtime.yml
+++ b/.github/workflows/browser-runtime.yml
@@ -1,16 +1,7 @@
name: Browser runtime
+# Called by ci.yml's `browser` lane (path-gated there) and runnable by hand.
on:
- pull_request:
- paths:
- - 'jarvis/society/browser/**'
- - 'jarvis/ui/web/society_browser_routes.py'
- - 'jarvis/ui/web/mcp_server_routes.py'
- - 'jarvis/agent_chat/runner_cli.py'
- - 'jarvis/brain/tool_gateway.py'
- - 'tests/contract/test_browser*'
- - 'tests/unit/society/test_browser*'
- - 'jarvis/society/approvals.py'
- - '.github/workflows/browser-runtime.yml'
+ workflow_call:
workflow_dispatch:
permissions:
contents: read
diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml
index b7a0e7b849..f26ba26dc8 100644
--- a/.github/workflows/ci.yml
+++ b/.github/workflows/ci.yml
@@ -1,839 +1,556 @@
-# Functional CI matrix (Wave 0, sub-task 0.3 - AD-4, discharges PC-1).
+# CI orchestrator — the ONE pipeline every change goes through.
#
-# Before this file the repo had NO functional CI: .github/workflows/ held only
-# supply-chain workflows, none ran pytest/ruff/mypy. This is the cross-platform
-# migration's load-bearing safety net - it is the only place the Windows-only
-# maintainer sees a red check when macOS/Linux code breaks.
+# Rebuilt 2026-09-28 after the Hermes Agent pipeline (NousResearch/hermes-agent),
+# adapted to this repo. What changed and why — measured on the old file:
#
-# Gating policy (deliberate, see docs/plans/cross-platform-mac-linux/WELLE-0):
-# * ruff / ruff format / mypy -> REPORT-ONLY (continue-on-error). The repo
-# carries a large pre-existing lint/type backlog (636 ruff findings at
-# Wave 0); making them blocking would be red-from-day-one for reasons
-# unrelated to this migration. Clean them in a separate effort, then flip
-# continue-on-error off.
-# * import-cleanliness gate -> BLOCKING. Proves `import jarvis` is clean on
-# Linux/macOS (no module-scope pywin32/winreg/global_hotkeys) - the €5-VPS
-# contract. A regression here breaks Mac/Linux outright.
-# * pytest + min-passed floor -> RED EVIDENCE. The full suite reports any
-# failure, collection error, or mass-skip regression. Agents compare a red
-# PR result with the exact base before merging; the existing required
-# `test (ubuntu-latest)` context now waits for the fast safety jobs.
+# * The test suite ran as ONE pytest process for 75-95 min on a 4-core runner
+# and hit the job timeout on most runs; one wedged test ate the budget.
+# -> scripts/ci/run_tests_parallel.py: sharded matrix, batches of files in
+# fresh processes, per-process wall clock, isolate-and-retry on failure.
+# * Its exit code was ignored (`|| echo`), so any regression rode through
+# green as long as ~1 200 tests passed.
+# -> scripts/ci/ratchet_tests.py: known failures are baselined per OS in
+# scripts/ci/test-baseline-<os>.json; a NEW failure blocks.
+# * Every PR ran every job (~20 runners, three 45-min macOS jobs on most),
+# and pushes to main cancelled each other, so main was never proven.
+# -> `detect` classifies the diff into lanes (scripts/ci/classify_changes.py,
+# fail-open); only affected lanes run on a PR. Pushes to main, the nightly
+# run and manual dispatches run everything and are never cancelled.
+# * Branch protection listed five job names; renaming a job meant a settings
+# change. -> `CI gate` aggregates every job (scripts/ci/required_results.py)
+# and is the ONLY required check, for humans and for the merge train.
+# * ~25 stdlib gates were separate steps in five jobs. -> scripts/ci/run_gates.py
+# runs them in one job, all of them report, and agents run the same command
+# locally.
#
-# Cost policy (added 2026-06-23): macOS runners bill at ~10x the Linux rate, so
-# the macOS leg is OFF for ordinary push/PR runs and ON only for a manual
-# workflow_dispatch (the `include_macos` input, default true). Linux + Windows
-# run on every push/PR and catch almost all cross-platform regressions. A
-# `concurrency` group cancels a superseded in-flight run so a burst of commits
-# can't stack billable minutes. To prove macOS on demand: the Actions tab ->
-# "Run workflow", or `gh workflow run ci.yml`. The `configure` job is the single
- # source of truth for which OS legs run (consumed by `broad-suite` and `jarvisctl`).
+# Windows: the full sharded suite on main / nightly / dispatch; on a pull
+# request only the tests the diff can reach (scripts/ci/select_tests.py).
+# macOS (~10x runner cost): nightly and manual dispatch, plus the path-gated
+# realtime contract and macOS desktop lanes.
#
-# Action SHAs are pinned to 40-char commits already vetted elsewhere in this
-# repo's workflows (CVE-2025-30066 hardening).
-#
-# Consolidation (2026-08-20): three standalone workflows moved in here as jobs,
-# because a contributor opening a PR should read ONE check list, not four. The
-# behaviour each of them gated is unchanged, only its home is:
-#
-# * frontend.yml -> job `frontend` (npm test + build + bundle budget)
-# * realtime-reliability.yml-> jobs `realtime-contract` / `realtime-slim` /
-# `realtime-soak`. They keep their OWN fixed OS matrix (macOS on every run)
-# instead of `needs: configure`, exactly as before: the point of that suite
-# is a small focused macOS proof that does not multiply the full-suite cost.
-# The one dropped trigger is `push: tags`, because a tag points at a SHA
-# that main already proved on the push that created it.
-# * dragdrop-verify.yml -> job `dragdrop`. GitHub has no per-job `paths:`
-# filter, so the path gate moved into `configure` as a git diff (stdlib +
-# git, no third-party action). Unresolvable base => the job RUNS.
+# Action SHAs are pinned to 40-char commits (CVE-2025-30066 hardening).
name: CI
on:
- push:
- branches:
- - main
- - "wip/cross-platform-cloud-first-20260529"
pull_request:
+ push:
+ branches: [main]
+ schedule:
+ - cron: "17 2 * * *" # nightly strict full run, macOS included
workflow_dispatch:
inputs:
+ full:
+ description: "Run every lane (off = only the lanes this branch's diff against main can affect; the merge train uses off)."
+ type: boolean
+ default: true
include_macos:
- description: "Also run the macOS leg (~10x runner cost). On by default for a manual run, since proving macOS is usually the point of dispatching by hand."
+ description: "Also run the macOS test shards and macOS desktop lane (~10x runner cost)."
type: boolean
default: true
run_contract_soak:
description: "Run the extended synthetic realtime orchestration soak (not release evidence)."
type: boolean
- default: true
+ default: false
-# Cost control: a new push to the same ref cancels the previous in-flight run,
-# so a burst of commits doesn't stack up billable runner minutes. Keyed on ref
-# so different branches never cancel each other.
+# A pull request (or a train-dispatched branch run) collapses to its newest
+# commit. main, the nightly run and a full manual dispatch are never cancelled:
+# every commit on main gets its own verdict.
concurrency:
- group: ci-${{ github.workflow }}-${{ github.ref }}
- cancel-in-progress: true
+ group: ci-${{ github.event_name == 'pull_request' && format('pr-{0}', github.event.pull_request.number) || (github.event_name == 'workflow_dispatch' && github.ref != 'refs/heads/main' && format('branch-{0}', github.ref)) || github.run_id }}
+ cancel-in-progress: ${{ github.event_name == 'pull_request' || (github.event_name == 'workflow_dispatch' && github.ref != 'refs/heads/main') }}
permissions:
contents: read
+env:
+ PYTHONUTF8: "1"
+ PIP_DISABLE_PIP_VERSION_CHECK: "1"
+
jobs:
- # Single source of truth for which OS legs run. macOS bills at ~10x the Linux
- # rate, so it is included ONLY for a manual workflow_dispatch with include_macos
- # (default true). Every ordinary push/PR runs the cheap Linux + Windows legs,
- # which catch almost all cross-platform regressions. Both `broad-suite` and `jarvisctl`
- # consume this output so the policy lives in exactly one place.
- configure:
- name: configure matrix (cost-aware)
+ detect:
+ name: detect lanes
runs-on: ubuntu-latest
timeout-minutes: 5
outputs:
- os-matrix: ${{ steps.pick.outputs.os-matrix }}
- dragdrop-matrix: ${{ steps.pick.outputs.dragdrop-matrix }}
- run-dragdrop: ${{ steps.paths.outputs.run-dragdrop }}
+ full: ${{ steps.lanes.outputs.full }}
+ python: ${{ steps.lanes.outputs.python }}
+ frontend: ${{ steps.lanes.outputs.frontend }}
+ deps: ${{ steps.lanes.outputs.deps }}
+ realtime: ${{ steps.lanes.outputs.realtime }}
+ cli: ${{ steps.lanes.outputs.cli }}
+ dragdrop: ${{ steps.lanes.outputs.dragdrop }}
+ browser: ${{ steps.lanes.outputs.browser }}
+ macos_desktop: ${{ steps.lanes.outputs.macos_desktop }}
+ installer: ${{ steps.lanes.outputs.installer }}
+ macos: ${{ steps.mode.outputs.macos }}
+ base: ${{ steps.mode.outputs.base }}
+ pr_mode: ${{ steps.mode.outputs.pr_mode }}
+ linux_shards: ${{ steps.shards.outputs.linux_shards }}
+ windows_shards: ${{ steps.shards.outputs.windows_shards }}
+ os_matrix: ${{ steps.mode.outputs.os_matrix }}
steps:
- - name: Checkout (full history — the path gate needs a diff base)
+ - name: Checkout (full history for the diff base)
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
fetch-depth: 0
persist-credentials: false
- - name: Pick OS matrix
- id: pick
- shell: bash
- run: |
- if [ "${{ github.event_name }}" = "workflow_dispatch" ] && [ "${{ inputs.include_macos }}" = "true" ]; then
- echo 'os-matrix=["ubuntu-latest","windows-latest","macos-latest"]' >> "$GITHUB_OUTPUT"
- echo 'dragdrop-matrix=["ubuntu-latest","windows-latest","macos-latest"]' >> "$GITHUB_OUTPUT"
- echo "macOS leg INCLUDED (manual dispatch)."
- else
- echo 'os-matrix=["ubuntu-latest","windows-latest"]' >> "$GITHUB_OUTPUT"
- echo 'dragdrop-matrix=["ubuntu-latest","windows-latest"]' >> "$GITHUB_OUTPUT"
- echo "macOS leg SKIPPED (cheap push/PR run). Dispatch manually to include it."
- fi
-
- # GitHub offers `paths:` only per WORKFLOW, never per job — so the path
- # gate that dragdrop-verify.yml got for free as its own file has to be
- # computed here. git + stdlib only: no third-party action enters the
- # supply chain for a file-list comparison (CVE-2025-30066).
- #
- # Fails OPEN on purpose: a manual dispatch, an unresolvable diff base, or
- # a first push to a new branch RUNS the job. A missed drag-drop
- # regression costs a broken overlay on someone else's OS; a redundant run
- # costs two cheap runner minutes.
- - name: Path gate for the drag-drop proof
- id: paths
+ - name: Decide run mode and diff base
+ id: mode
shell: bash
+ env:
+ EVENT: ${{ github.event_name }}
+ IN_FULL: ${{ inputs.full }}
+ IN_MACOS: ${{ inputs.include_macos }}
+ PR_BASE: ${{ github.event.pull_request.base.sha }}
run: |
- if [ "${{ github.event_name }}" = "workflow_dispatch" ]; then
- echo "run-dragdrop=true" >> "$GITHUB_OUTPUT"
- echo "Manual dispatch — drag-drop proof RUNS."
- exit 0
- fi
- base="${{ github.event.pull_request.base.sha }}"
- if [ -z "$base" ]; then
- base="${{ github.event.before }}"
- fi
- # An all-zero "before" means a branch's first push or a rewritten
- # history; treat it as no base at all.
- case "$base" in
- ""|*[!0]*) : ;;
- *) base="" ;;
+ full=false; macos=false; pr_mode=false
+ case "$EVENT" in
+ push) full=true ;;
+ schedule) full=true; macos=true ;;
+ workflow_dispatch)
+ [ "$IN_FULL" = "true" ] && full=true
+ [ "$IN_MACOS" = "true" ] && macos=true ;;
+ pull_request) pr_mode=true ;;
esac
+ # A branch run the merge train dispatched behaves like its pull request.
+ if [ "$EVENT" = "workflow_dispatch" ] && [ "$full" = "false" ]; then pr_mode=true; fi
+ git fetch --no-tags --quiet origin main:refs/remotes/origin/main || true
+ base="$PR_BASE"
if [ -z "$base" ] || ! git cat-file -e "$base^{commit}" 2>/dev/null; then
- # checkout fetches the event's ref only, so origin/main may not exist
- # locally yet — same fetch the privacy-gate job below does.
- git fetch --no-tags origin main:refs/remotes/origin/main 2>/dev/null || true
- base="$(git merge-base HEAD refs/remotes/origin/main 2>/dev/null || echo "")"
+ base="$(git merge-base HEAD refs/remotes/origin/main 2>/dev/null || true)"
fi
- if [ -z "$base" ]; then
- echo "run-dragdrop=true" >> "$GITHUB_OUTPUT"
- echo "No usable diff base — drag-drop proof RUNS (fail open)."
- exit 0
+ if [ "$EVENT" = "push" ]; then
+ before="${{ github.event.before }}"
+ case "$before" in (*[!0]*) git cat-file -e "$before^{commit}" 2>/dev/null && base="$before" ;; esac
fi
- if git diff --name-only "$base" HEAD -- \
- jarvis/overlay/drop_target.py \
- jarvis/overlay/drop_bridge.py \
- scripts/crossplatform/verify_drop_target.py \
- .github/workflows/ci.yml | grep -q .; then
- echo "run-dragdrop=true" >> "$GITHUB_OUTPUT"
- echo "Drop-path files changed since $base — drag-drop proof RUNS."
+ if [ "$macos" = "true" ]; then os='["ubuntu-latest","windows-latest","macos-latest"]'; else os='["ubuntu-latest","windows-latest"]'; fi
+ {
+ echo "full_mode=$full"; echo "macos=$macos"; echo "pr_mode=$pr_mode"; echo "base=$base"
+ echo "os_matrix=$os"
+ } | tee -a "$GITHUB_OUTPUT"
+
+ - name: Classify the change into lanes
+ id: lanes
+ shell: bash
+ env:
+ FULL: ${{ steps.mode.outputs.full_mode }}
+ BASE: ${{ steps.mode.outputs.base }}
+ run: |
+ if [ "$FULL" = "true" ] || [ -z "$BASE" ]; then
+ python3 scripts/ci/classify_changes.py --full
else
- echo "run-dragdrop=false" >> "$GITHUB_OUTPUT"
- echo "No drop-path file changed since $base — drag-drop proof SKIPPED."
+ git diff --name-only "$BASE" HEAD | tee changed.txt | python3 scripts/ci/classify_changes.py
fi
- broad-suite:
- name: broad suite (${{ matrix.os }})
- needs: configure
- strategy:
- fail-fast: false # we want to see ALL OS legs, not just the first red one
- matrix:
- os: ${{ fromJSON(needs.configure.outputs.os-matrix) }}
- runs-on: ${{ matrix.os }}
- # The complete suite was still advancing at 70% when the 75-minute job
- # limit canceled both Linux and Windows on 2026-09-26. Give the full run
- # room to finish; the pytest step still dumps thread stacks when one test
- # exceeds 300 seconds, so a genuine stall remains diagnosable.
- timeout-minutes: 150
+ # Linux always runs the whole suite in six shards. Windows runs four
+ # shards only when every lane is on; otherwise one runner takes the
+ # tests the diff can reach.
+ - name: Size the test matrices
+ id: shards
+ shell: bash
+ run: |
+ echo 'linux_shards=[1,2,3,4,5,6]' >> "$GITHUB_OUTPUT"
+ if [ "${{ steps.lanes.outputs.full }}" = "true" ]; then
+ echo 'windows_shards=[1,2,3,4]' >> "$GITHUB_OUTPUT"
+ else
+ echo 'windows_shards=[1]' >> "$GITHUB_OUTPUT"
+ fi
+ gates:
+ name: static gates
+ needs: detect
+ runs-on: ubuntu-latest
+ timeout-minutes: 20
steps:
- - name: Checkout
+ - name: Checkout (full history for diff-scoped gates)
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
+ fetch-depth: 0
persist-credentials: false
-
- - name: Set up Python 3.11
- uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
+ - uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
with:
python-version: "3.11"
-
- - name: Install base + dev (NO platform extras - proves the VPS/base install)
- shell: bash
- run: |
- python -m pip install --upgrade pip
- python -m pip install -e ".[dev]"
-
- - name: ruff lint (report-only)
- continue-on-error: true
- run: python -m ruff check jarvis/
-
- - name: ruff format check (report-only)
- continue-on-error: true
- run: python -m ruff format --check jarvis/
-
- - name: mypy (report-only)
- continue-on-error: true
- run: python -m mypy jarvis/
-
- - name: Import-cleanliness gate (BLOCKING — runs on the bare .[dev] install)
- run: python scripts/ci/check_import_clean.py
-
- # The import gate above PROVES the €5-VPS base install imports clean (no
- # Windows APIs, no system libs). Only AFTER that proof do we install the
- # system libraries + optional packages the *test suite* needs to RUN — these
- # are NOT part of the base-install contract. libportaudio2 backs sounddevice
- # (a base dep that lazy-imports PortAudio); twilio is imported by some test
- # modules that lack an importorskip guard (pre-existing). Test-only Python
- # packages, including Hypothesis, come from the [dev] extra above so the
- # documented development install is exercised without hidden supplements.
- - name: System + test-only deps (to run the suite, not part of the base proof)
- shell: bash
- run: |
- if [ "$RUNNER_OS" = "Linux" ]; then
- sudo apt-get update
- sudo apt-get install -y libportaudio2
- fi
- python -m pip install -e ".[telephony]"
-
- # The monolithic Windows process reached these stateful session tests at
- # 68%, then spent the rest of the 30-minute job budget in this two-file
- # block. Run it first in a fresh process with strict exit semantics and
- # named progress: a real regression stays blocking, while cross-suite
- # state cannot hide the remaining Windows coverage behind a timeout.
- # 2026-07-20: two consecutive main runs wedged INSIDE this step at the
- # same test (test_gemini_live_spending_cap_crosses_family_without_retrying)
- # for 23+ minutes until the 30-minute JOB timeout cancelled everything —
- # while the identical invocation passes in 16 s on a fast local Windows
- # box. Until the CI-only race is caught: faulthandler dumps every thread
- # stack once a single test exceeds 180 s (pytest built-in, no extra dep),
- # and the STEP timeout returns the job in 15 minutes with that dump in
- # the log instead of silently eating the whole job budget.
- - name: Windows realtime session isolation (BLOCKING)
- if: matrix.os == 'windows-latest'
- timeout-minutes: 15
- shell: bash
- run: |
- python -m pytest \
- tests/unit/realtime/test_session.py \
- tests/unit/realtime/test_session_self_echo.py \
- -v -p no:cacheprovider \
- -o faulthandler_timeout=180 \
- -m "not skip_ci and not slow and not openclaw_live and not voice_latency and not eval" \
- --junitxml=realtime-session-report.xml
-
- - name: pytest (JUnit XML; all failures visible)
- shell: bash
+ - name: Install the light gate dependencies (no torch, no audio)
run: |
- extra_pytest_args=()
- if [ "${{ matrix.os }}" = "windows-latest" ]; then
- extra_pytest_args+=(
- --ignore=tests/unit/realtime/test_session.py
- --ignore=tests/unit/realtime/test_session_self_echo.py
- )
- fi
- python -m pytest tests/ "${extra_pytest_args[@]}" -q -p no:cacheprovider \
- -o faulthandler_timeout=300 \
- -m "not skip_ci and not slow and not openclaw_live and not voice_latency and not eval" \
- --continue-on-collection-errors \
- --junitxml=report.xml
-
- - name: Minimum-passed floor (also runs after a failing suite)
- if: always() && matrix.os == 'ubuntu-latest'
- run: python scripts/ci/assert_min_passed.py report.xml
-
- # Its OWN strict step, on purpose, and two traps avoided deliberately:
- #
- # * NOT carrying the `eval` marker. The suite above filters
- # `-m "not ... and not eval"`, so an `eval`-marked routing test would
- # silently never run — which is exactly how scripts/skill_routing_eval.py
- # became invisible.
- # * NOT folded into the pytest step above, so it still runs and reports
- # its own result when the broad suite has unrelated failures.
- #
- # Measures precision AND recall together. Watching only precision is how
- # the wake-word subsystem destroyed its own recall twice without anyone
- # noticing (AP-27); recall may not drop without editing the committed
- # BASELINE.json in the same change, which puts it in the diff.
- - name: Skill routing eval (strict — precision AND recall)
- if: always() && matrix.os == 'ubuntu-latest'
- shell: bash
- run: |
- python -m pytest tests/unit/skills/test_skill_routing_offline.py \
- -q -p no:cacheprovider
- python scripts/skill_relevance_calibrate.py
-
- - name: Plugin auth contract (strict — browser-auth standard per plugin)
- if: always()
- shell: bash
+ python -m pip install -e . --no-deps
+ python -m pip install typer platformdirs click httpx rich pyyaml==6.0.3 pydantic loguru python-dotenv packaging
+ - name: Run every static gate
+ env:
+ PRIVACY_PRIVATE_EMAILS: ${{ vars.PRIVACY_PRIVATE_EMAILS }}
+ BASE: ${{ needs.detect.outputs.base }}
+ PR_MODE: ${{ needs.detect.outputs.pr_mode }}
run: |
- python scripts/ci/check_plugin_auth_contract.py
- python -m pytest tests/contract/test_plugin_auth_standard.py tests/contract/test_connector_auth.py tests/contract/test_service_connectors.py tests/contract/test_plugin_availability.py tests/contract/test_home_assistant_browser_auth.py -q -p no:cacheprovider
-
- # Small, independent required proof. The full-suite job above can be red on
- # unrelated baseline failures or take over an hour; neither can skip these
- # four core contracts. Keep this job name stable for branch protection.
- contract_guards:
- name: contract guards (router / voice / parity / language)
+ git fetch --no-tags --quiet origin main:refs/remotes/origin/main || true
+ args=()
+ [ -n "$BASE" ] && args+=(--base "$BASE")
+ [ "$PR_MODE" = "true" ] && args+=(--pr)
+ python scripts/ci/run_gates.py "${args[@]}"
+
+ python-fast:
+ name: python contracts (fast)
+ needs: detect
+ if: needs.detect.outputs.python == 'true'
runs-on: ubuntu-latest
- timeout-minutes: 20
+ timeout-minutes: 30
steps:
- - name: Checkout
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+ - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
persist-credentials: false
-
- - name: Set up Python 3.11
- uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
+ - uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
with:
python-version: "3.11"
-
- - name: Install test dependencies
+ cache: pip
+ cache-dependency-path: pyproject.toml
+ - name: Install base + dev (no platform extras - the VPS/base install)
run: python -m pip install -e ".[dev]"
+ - name: Import-cleanliness gate (the bare install imports clean)
+ run: python scripts/ci/check_import_clean.py
+ - name: Test-only system deps
+ run: |
+ sudo apt-get update -qq && sudo apt-get install -y -qq libportaudio2
+ python -m pip install -e ".[telephony]"
+ # Blocking and outside the ratchet on purpose: these pin contracts that
+ # are cheap to break and expensive to notice (ADR-0011 router, AP-11
+ # scrubber, AP-4 enum parity, the one turn-language resolver, skill
+ # routing precision AND recall, the browser-auth standard).
+ - name: Contract guards
+ run: |
+ python -m pytest -q -p no:cacheprovider \
+ tests/unit/brain/test_routing.py \
+ tests/unit/brain/test_output_filter.py \
+ tests/unit/sessions/test_hangup_reason_parity.py \
+ tests/unit/core/test_turn_language.py \
+ tests/unit/skills/test_skill_routing_offline.py \
+ tests/contract/test_plugin_auth_standard.py \
+ tests/contract/test_connector_auth.py \
+ tests/contract/test_service_connectors.py \
+ tests/contract/test_plugin_availability.py \
+ tests/contract/test_home_assistant_browser_auth.py
+ python scripts/skill_relevance_calibrate.py
+ - name: ruff lint (report-only backlog)
+ continue-on-error: true
+ run: python -m ruff check jarvis/
+ - name: ruff format (report-only backlog)
+ continue-on-error: true
+ run: python -m ruff format --check jarvis/
+ - name: mypy (report-only backlog)
+ continue-on-error: true
+ run: python -m mypy jarvis/
- - name: Run four core contracts
- run: >-
- python -m pytest
- tests/unit/brain/test_routing.py
- tests/unit/brain/test_output_filter.py
- tests/unit/sessions/test_hangup_reason_parity.py
- tests/unit/core/test_turn_language.py
- -q -p no:cacheprovider
-
- # jarvisctl control-CLI unit suite across the three supported desktops.
- # jarvisctl is a thin cross-platform HTTP client (paths via platformdirs,
- # UTF-8 I/O, no Windows APIs); this job proves it imports + its unit tests
- # pass identically on Linux, macOS, and Windows. Own job (separate from the
- # main `test` matrix) so a CLI-only change gets a fast, isolated signal and
- # the suite can install just the CLI's runtime deps. fail-fast: false to see
- # all three OS legs.
- jarvisctl:
- name: jarvisctl unit (${{ matrix.os }})
- needs: configure
+ tests-linux:
+ name: tests linux ${{ matrix.shard }}/6
+ needs: detect
+ if: needs.detect.outputs.python == 'true'
strategy:
fail-fast: false
matrix:
- os: ${{ fromJSON(needs.configure.outputs.os-matrix) }}
- runs-on: ${{ matrix.os }}
- timeout-minutes: 15
-
+ shard: ${{ fromJSON(needs.detect.outputs.linux_shards) }}
+ runs-on: ubuntu-latest
+ timeout-minutes: 45
steps:
- - name: Checkout
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+ - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
persist-credentials: false
-
- - name: Set up Python 3.11
- uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
+ - uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
with:
python-version: "3.11"
-
- - name: Install package (no deps) + CLI runtime deps
- shell: bash
+ cache: pip
+ cache-dependency-path: pyproject.toml
+ - name: Install
run: |
- python -m pip install --upgrade pip
- python -m pip install -e ".[dev]" --no-deps
- # pytest is needed to RUN the suite; --no-deps above skips it (and all
- # of [dev]'s deps), so install the test runner explicitly alongside the
- # CLI's own runtime deps AND the light libs the cli_ctl test modules pull
- # in transitively (pyyaml/pydantic/loguru/dotenv/packaging, via
- # dispatch / self-control-catalog / discovery importing deeper jarvis
- # modules). Still light — no torch/audio/GUI/desktop deps.
- python -m pip install typer platformdirs click httpx rich pytest pytest-asyncio pyyaml pydantic loguru python-dotenv packaging
-
- - name: Import + --help smoke (CLI runs without desktop deps)
- # python:3.11-slim-equivalent: `--no-deps` above skipped torch / sounddevice
- # / etc., so this proves jarvis.cli_ctl imports and its --help renders on a
- # bare Linux/macOS/Windows with only typer/httpx/platformdirs/rich. No live
- # server here: the dynamic `api` build fails closed to the curated surface.
- run: |
- python -c "import jarvis.cli_ctl.__main__"
- python -m jarvis.cli_ctl --help
-
- - name: Install base runtime deps for the test suite (robust; no hand-list)
+ sudo apt-get update -qq && sudo apt-get install -y -qq libportaudio2
+ python -m pip install -e ".[dev,telephony]"
+ - name: Restore the per-file duration cache (written by main only)
+ uses: actions/cache/restore@27d5ce7f107fe9357f9df03efb73ab90386fccae # v5.0.5
+ with:
+ path: test_durations.json
+ key: test-durations-never-exact
+ restore-keys: test-durations-
+ - name: Run shard
+ continue-on-error: true
+ run: >-
+ python scripts/ci/run_tests_parallel.py tests
+ --shard ${{ matrix.shard }}/6
+ --report out/test-report-linux-${{ matrix.shard }}.json
+ --junit-out out/junit-linux-${{ matrix.shard }}.xml
+ --durations-out out/durations-linux-${{ matrix.shard }}.json
+ - name: Ratchet (a failure not in the baseline blocks)
+ run: python scripts/ci/ratchet_tests.py check --baseline scripts/ci/test-baseline-linux.json out/test-report-linux-${{ matrix.shard }}.json
+ - name: Upload shard report
+ if: always()
+ uses: actions/upload-artifact@b4b15b8c7c6ac21ea08fcf65892d2ee8f75cf882 # v4.4.3
+ with:
+ name: tests-linux-${{ matrix.shard }}
+ path: out/
+ retention-days: 14
+
+ tests-windows:
+ name: tests windows ${{ matrix.shard }}
+ needs: detect
+ if: needs.detect.outputs.python == 'true'
+ strategy:
+ fail-fast: false
+ matrix:
+ shard: ${{ fromJSON(needs.detect.outputs.windows_shards) }}
+ runs-on: windows-latest
+ timeout-minutes: 60
+ defaults:
+ run:
shell: bash
- # The cli_ctl unit tests import deeper jarvis modules that transitively
- # pull in base runtime deps (pydantic, pyyaml, loguru, …). Install the
- # package's BASE deps — torch-/GPU-free per the cloud-first base-install
- # mandate — instead of the hand-maintained dep list above, which silently
- # rots and REDS CI the moment a test imports one more transitive lib (the
- # recurring "ModuleNotFoundError: No module named 'yaml'/'pydantic'"
- # collection errors). The heavy desktop/voice extras stay OUT, so the
- # --help smoke above still proves the light install path.
- run: |
- python -m pip install -e .
- python -m pip install pytest pytest-asyncio hypothesis
-
- - name: pytest (jarvisctl unit suite)
- run: python -m pytest tests/unit/cli_ctl/ -v
-
- # Repository-wide static checks report their own result. An unrelated
- # baseline drift must not make the CLI unit suite appear broken, while any
- # newly introduced finding remains visible and requires base comparison.
- code_policy:
- name: code policy (changed routes / config / handlers)
- runs-on: ubuntu-latest
- timeout-minutes: 15
steps:
- - name: Checkout
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+ - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
fetch-depth: 0
persist-credentials: false
-
- - name: Set up Python 3.11
- uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
+ - uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
with:
python-version: "3.11"
-
- - name: Install package for reference generators
- run: python -m pip install -e .
-
- - name: Verify exact-base comparison
- run: |
- python -m pip install pytest pytest-asyncio
- python -m pytest tests/unit/ci/test_changed_baseline_gates.py -q -p no:cacheprovider
-
- - name: Check all code policies and report every finding
- shell: bash
+ cache: pip
+ cache-dependency-path: pyproject.toml
+ - name: Pick the tests (full run, or what this diff can reach)
+ id: pick
+ env:
+ FULL: ${{ needs.detect.outputs.full }}
+ BASE: ${{ needs.detect.outputs.base }}
+ SHARDS: ${{ needs.detect.outputs.windows_shards }}
run: |
- failed=0
- for check in \
- check_cli_coverage.py \
- check_danger_metadata.py \
- check_cli_install_methods.py \
- check_config_switches_wired.py \
- check_webgl_contexts_released.py; do
- python "scripts/ci/$check" || failed=1
- done
- base="${{ github.event.pull_request.base.sha }}"
- if [ -z "$base" ]; then
- base="${{ github.event.before }}"
- fi
- if [ -n "$base" ] && [ "$base" != "0000000000000000000000000000000000000000" ]; then
- python scripts/ci/check_changed_baseline_gates.py --base "$base" || failed=1
+ mkdir -p out
+ if [ "$FULL" = "true" ] || [ -z "$BASE" ]; then
+ echo "mode=all" >> "$GITHUB_OUTPUT"
else
- python scripts/ci/check_changed_baseline_gates.py || failed=1
+ git diff --name-only "$BASE" HEAD > out/changed.txt
+ python scripts/ci/select_tests.py --changed-from out/changed.txt --out out/selected.txt
fi
- python scripts/ci/gen_cli_reference.py --check || failed=1
- exit "$failed"
-
- # Keep the existing branch-protection context stable. This check is always
- # created and passes only when both independent fast safety jobs pass. The
- # long broad-suite remains visible without blocking an unrelated scoped PR.
- test:
- name: test (ubuntu-latest)
- needs: [contract_guards, code_policy]
- if: always()
- runs-on: ubuntu-latest
- timeout-minutes: 5
- steps:
- - name: Require contract and changed-code policy success
- env:
- CONTRACT_RESULT: ${{ needs.contract_guards.result }}
- CODE_POLICY_RESULT: ${{ needs.code_policy.result }}
+ count=$(python -c "import json,os; print(len(json.loads(os.environ['SHARDS'])))")
+ echo "total=$count" >> "$GITHUB_OUTPUT"
+ - name: Install
+ if: steps.pick.outputs.mode != 'none'
+ run: python -m pip install -e ".[dev,telephony]"
+ - name: Restore the per-file duration cache
+ if: steps.pick.outputs.mode != 'none'
+ uses: actions/cache/restore@27d5ce7f107fe9357f9df03efb73ab90386fccae # v5.0.5
+ with:
+ path: test_durations.json
+ key: test-durations-never-exact
+ restore-keys: test-durations-
+ - name: Run shard
+ if: steps.pick.outputs.mode != 'none'
+ continue-on-error: true
run: |
- test "$CONTRACT_RESULT" = success
- test "$CODE_POLICY_RESULT" = success
-
- # Dependency-manifest sync gate (BLOCKING). requirements.in (the source for the
- # hash-pinned requirements.txt lockfile) must mirror pyproject.toml
- # [project].dependencies exactly. When they drift, an extras-only, torch-pulling
- # package (silero-vad, sentence-transformers, …) leaks into the base lockfile,
- # baking the multi-GB, GPU-specific CUDA wheel stack into the installer and
- # bricking `pip install --require-hashes -r requirements.txt` for every
- # non-maintainer machine (nvidia-cufile is unresolvable on plain PyPI). This is
- # the guard for that shipped-broken-installer "works on my machine" bug (AP-23).
- # Runs once: pinned uv resolves every advertised target from public PyPI.
- deps-sync:
- name: deps-sync + portable install matrix
- runs-on: ubuntu-latest
- timeout-minutes: 30
+ files=()
+ if [ "${{ steps.pick.outputs.mode }}" = "selected" ]; then files=(--files-from out/selected.txt); fi
+ python scripts/ci/run_tests_parallel.py tests "${files[@]}" \
+ --shard ${{ matrix.shard }}/${{ steps.pick.outputs.total }} \
+ --report out/test-report-windows-${{ matrix.shard }}.json \
+ --junit-out out/junit-windows-${{ matrix.shard }}.xml
+ - name: Ratchet (a failure not in the baseline blocks)
+ if: steps.pick.outputs.mode != 'none'
+ run: python scripts/ci/ratchet_tests.py check --baseline scripts/ci/test-baseline-windows.json out/test-report-windows-${{ matrix.shard }}.json
+ - name: Upload shard report
+ if: always()
+ uses: actions/upload-artifact@b4b15b8c7c6ac21ea08fcf65892d2ee8f75cf882 # v4.4.3
+ with:
+ name: tests-windows-${{ matrix.shard }}
+ path: out/
+ retention-days: 14
+
+ tests-macos:
+ name: tests macos ${{ matrix.shard }}/3
+ needs: detect
+ if: needs.detect.outputs.macos == 'true' && needs.detect.outputs.python == 'true'
+ strategy:
+ fail-fast: false
+ matrix:
+ shard: [1, 2, 3]
+ runs-on: macos-latest
+ timeout-minutes: 60
steps:
- - name: Checkout
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+ - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
persist-credentials: false
-
- - name: Set up Python 3.11
- uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
+ - uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
with:
python-version: "3.11"
-
- - name: Install pinned dependency-gate tooling
- run: python -m pip install --disable-pip-version-check packaging==25.0 uv==0.11.19
-
- - name: Requirements-sync gate (BLOCKING)
- run: |
- python scripts/ci/check_requirements_sync.py
-
- # Companion gate: the compiled requirements.txt itself must stay
- # `--universal` and free of nvidia-*/torch/CUDA wheels, so a lockfile
- # regenerated the wrong way cannot silently re-brick non-maintainer
- # installs (AP-23). Stdlib only — no extra install needed.
- - name: Lockfile universal + GPU-free gate (BLOCKING)
- run: python scripts/ci/check_lockfile_universal.py
-
- # A universal solve can still hide an inactive marker branch, an sdist,
- # or a wheel for a different interpreter/architecture. Compile one PEP
- # 751 lock per CPython/OS/architecture cell, inspect only active packages,
- # and dry-run the shipped hash lock plus the advertised [full] profile.
- # The gate also runs `uv lock --check` and byte-compares a no-upgrade
- # universal/hash recompile of requirements.in with requirements.txt.
- - name: Target-resolved portable install matrix (BLOCKING)
- run: python scripts/ci/check_portable_install_matrix.py --jobs 4
-
- # macOS still ships GNU bash 3.2 (2007) as /bin/bash, while every runner and
- # dev box here has bash 4/5. A script can therefore be valid everywhere we
- # look and still fail to PARSE on a Mac - meaning not one line of it runs.
- # That shipped: install/uninstall.sh in v1.1.0/v1.1.1 died with
- # `syntax error near unexpected token ';;'` on every Mac, because bash 3.2
- # cannot read a `case` arm inside a $( ) substitution. Nothing in CI parsed a
- # shell script against 3.2, so nothing caught it. This does, for pennies: a
- # parse check in a bash:3.2 container, never an execution. Own job (stdlib +
- # Docker only, no pip install), BLOCKING.
- shell-portability:
- name: shell portability (parses on macOS bash 3.2)
- runs-on: ubuntu-latest
- timeout-minutes: 10
- steps:
- - name: Checkout
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+ cache: pip
+ cache-dependency-path: pyproject.toml
+ - name: Install
+ run: python -m pip install -e ".[dev,telephony]"
+ - name: Restore the per-file duration cache
+ uses: actions/cache/restore@27d5ce7f107fe9357f9df03efb73ab90386fccae # v5.0.5
with:
- persist-credentials: false
-
- - name: Set up Python 3.11
- uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
+ path: test_durations.json
+ key: test-durations-never-exact
+ restore-keys: test-durations-
+ - name: Run shard
+ continue-on-error: true
+ run: >-
+ python scripts/ci/run_tests_parallel.py tests --shard ${{ matrix.shard }}/3
+ --report out/test-report-macos-${{ matrix.shard }}.json
+ --junit-out out/junit-macos-${{ matrix.shard }}.xml
+ - name: Ratchet (a failure not in the baseline blocks)
+ run: python scripts/ci/ratchet_tests.py check --baseline scripts/ci/test-baseline-macos.json out/test-report-macos-${{ matrix.shard }}.json
+ - name: Upload shard report
+ if: always()
+ uses: actions/upload-artifact@b4b15b8c7c6ac21ea08fcf65892d2ee8f75cf882 # v4.4.3
with:
- python-version: "3.11"
-
- - name: bash 3.2 parse gate (BLOCKING)
- run: python scripts/ci/check_shell_bash32.py --require
-
- # Tree-wide hygiene gates that used to live ONLY in the local pre-push hook.
- # When pre-push was cut back to the two credential gates (2026-08-05), these
- # three needed a home that reports instead of blocking an unrelated push:
- #
- # * private keys — a leaked signing key is permanent (AP-29). Also still
- # runs in pre-push and pre-commit; the redundancy is deliberate.
- # * dist consistency — dist/index.html and every chunk it loads must resolve
- # to TRACKED files, or a fresh clone boots to a blank spinner while the
- # builder's machine looks fine (AP-23).
- # * brand logos — a bundled SVG is executable content; a script or remote
- # reference in one would run on render.
- #
- # Stdlib + git only, so no pip install. Runs on push AND PR. BLOCKING.
- repo-hygiene:
- name: repo-hygiene (keys / bundle / logos)
+ name: tests-macos-${{ matrix.shard }}
+ path: out/
+ retention-days: 14
+
+ test-report:
+ name: test report + floor
+ needs: [detect, tests-linux]
+ if: always() && needs.detect.outputs.python == 'true' && needs.tests-linux.result != 'cancelled'
runs-on: ubuntu-latest
timeout-minutes: 10
steps:
- - name: Checkout
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+ - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
persist-credentials: false
-
- - name: Set up Python 3.11
- uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
+ - uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
with:
python-version: "3.11"
+ - name: Download shard reports
+ uses: actions/download-artifact@fa0a91b85d4f404e444e00e005971372dc801d16 # v4.1.8
+ with:
+ pattern: tests-linux-*
+ path: reports
+ merge-multiple: true
+ - name: Min-passed floor across all Linux shards (BLOCKING)
+ run: python scripts/ci/ratchet_tests.py summary --floor --baseline scripts/ci/test-baseline-linux.json reports
+ - name: Merge the duration cache (main only)
+ if: github.event_name == 'push' && github.ref == 'refs/heads/main'
+ run: python scripts/ci/ratchet_tests.py durations --out test_durations.json reports
+ - name: Save the duration cache (main only)
+ if: github.event_name == 'push' && github.ref == 'refs/heads/main'
+ uses: actions/cache/save@27d5ce7f107fe9357f9df03efb73ab90386fccae # v5.0.5
+ with:
+ path: test_durations.json
+ key: test-durations-${{ github.run_id }}
- - name: Private-key gate (BLOCKING)
- run: python scripts/ci/check_no_private_keys.py
-
- - name: Dist consistency gate (BLOCKING)
- run: python scripts/ci/check_dist_consistency.py
-
- - name: Brand-logo gate (BLOCKING)
- run: python scripts/ci/check_brand_logos.py
-
- # AGENTS.md and .agents/ are authoritative. Claude and Codex compatibility
- # copies must match them, even when local hooks were not installed.
- - name: Agent-knowledge mirrors (BLOCKING)
- run: |
- python scripts/ci/sync_agents_md.py --check
- python scripts/ci/sync_agents_dir.py --check
- python scripts/ci/sync_codex_agents.py --check
-
- # Output Language Policy enforcement (CLAUDE.md, HIGHEST PRIORITY): block any
- # NEWLY ADDED German text from reaching GitHub. Diff-based, so the in-flight
- # DE->EN translation backlog (pre-existing German) does NOT turn this red - only
- # German added by a push/PR does. Own job (runs once, not across the OS matrix);
- # stdlib + git only, so no pip install. BLOCKING.
- language-policy:
- name: language-policy (no new German)
- # PR-only: a push to main rewrites SHAs (rebase merge), which widens the
- # diff base and would re-flag pre-existing German. The protection belongs
- # on PRs, before the change reaches main.
- if: github.event_name == 'pull_request'
+ frontend:
+ name: frontend (test + build + budget)
+ needs: detect
+ if: needs.detect.outputs.frontend == 'true'
runs-on: ubuntu-latest
- timeout-minutes: 5
+ timeout-minutes: 20
+ defaults:
+ run:
+ working-directory: jarvis/ui/web/frontend
steps:
- - name: Checkout (full history - diff needs the merge base)
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+ - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
- fetch-depth: 0
persist-credentials: false
-
- - name: Set up Python 3.11
- uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
+ - uses: actions/setup-node@820762786026740c76f36085b0efc47a31fe5020 # v7.0.0
with:
- python-version: "3.11"
-
- - name: No-new-German gate (BLOCKING)
- run: python scripts/ci/check_no_new_german.py
+ node-version: "22"
+ cache: npm
+ cache-dependency-path: jarvis/ui/web/frontend/package-lock.json
+ - run: npm ci
+ - run: npm test
+ - run: npm run build
+ # The entry chunk's size IS startup latency (AP-26's measurable half).
+ - name: Startup bundle budget
+ working-directory: ${{ github.workspace }}
+ run: python3 scripts/ci/check_frontend_bundle_budget.py
- # Privacy gate (Wave 2, layer 3): the non-bypassable backstop for the local
- # pre-push hook (.githooks/pre-push), which `--no-verify` can skip. Re-runs the
- # SAME secret / forbidden-file detection over the PR diff (reusing
- # scripts/ci/privacy_pre_push.py) and, when PRIVACY_PRIVATE_EMAILS is set as a
- # repo variable, the private-email identity check. Does NOT scan the real
- # name/PII (that is the ship skill's job to the public repo, and would
- # false-positive here). stdlib + git only, so no pip install. BLOCKING.
- #
- # Runs on push as well as PR (2026-08-05). It used to be PR-only, which meant
- # that on a repo whose maintainer pushes straight to main it ran nowhere at
- # all — and it is now one of only two layers left, since pre-push was cut back
- # to the credential gates. On push the diff base is the previous head; a first
- # push to a new branch has no previous head, so it falls back to the merge
- # base with origin/main.
- privacy-gate:
- name: privacy-gate (no secrets / no private identity)
- runs-on: ubuntu-latest
- timeout-minutes: 5
+ jarvisctl:
+ name: jarvisctl light install (${{ matrix.os }})
+ needs: detect
+ if: needs.detect.outputs.cli == 'true'
+ strategy:
+ fail-fast: false
+ matrix:
+ os: ${{ fromJSON(needs.detect.outputs.os_matrix) }}
+ runs-on: ${{ matrix.os }}
+ timeout-minutes: 20
steps:
- - name: Checkout (full history - diff needs the PR base)
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+ - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
- fetch-depth: 0
persist-credentials: false
-
- - name: Set up Python 3.11
- uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
+ - uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
with:
python-version: "3.11"
-
- - name: Resolve diff base (PR base, previous push head, or merge base)
- id: base
+ # --no-deps proves jarvis.cli_ctl imports and renders --help with only its
+ # own light runtime deps: no torch, audio or GUI stack.
+ - name: Light install + import/--help smoke
shell: bash
run: |
- base="${{ github.event.pull_request.base.sha }}"
- if [ -z "$base" ]; then
- base="${{ github.event.before }}"
- fi
- # A branch's first push reports an all-zero "before"; so does a forced
- # history rewrite. Fall back to the merge base with main, which is the
- # widest base that still excludes what main already carries.
- case "$base" in
- ""|*[!0]*) : ;;
- *) base="" ;;
- esac
- if [ -z "$base" ] || ! git cat-file -e "$base^{commit}" 2>/dev/null; then
- git fetch --no-tags origin main:refs/remotes/origin/main 2>/dev/null || true
- base="$(git merge-base HEAD refs/remotes/origin/main 2>/dev/null || echo "")"
- fi
- if [ -z "$base" ]; then
- echo "No usable diff base — scanning against the empty tree."
- base="$(git hash-object -t tree /dev/null)"
- fi
- echo "base=$base" >> "$GITHUB_OUTPUT"
- echo "Diff base: $base"
-
- - name: Privacy gate (BLOCKING - secrets + forbidden files + identity)
- env:
- PRIVACY_PRIVATE_EMAILS: ${{ vars.PRIVACY_PRIVATE_EMAILS }}
- run: python scripts/ci/privacy_scan_ci.py --base "${{ steps.base.outputs.base }}"
+ python -m pip install -e . --no-deps
+ python -m pip install typer platformdirs click httpx rich pytest pytest-asyncio pyyaml pydantic loguru python-dotenv packaging
+ python -c "import jarvis.cli_ctl.__main__"
+ python -m jarvis.cli_ctl --help
+ - name: Base install + jarvisctl unit suite
+ shell: bash
+ run: |
+ python -m pip install -e .
+ python -m pip install pytest pytest-asyncio hypothesis
+ python -m pytest tests/unit/cli_ctl/ -q -p no:cacheprovider
- # Docs privacy gate (layer-3 backstop for the .githooks/pre-push docs scan,
- # which `--no-verify` can skip). Scans the tracked docs/ tree for the
- # maintainer's real name, private email/handle, personal Windows paths, and
- # machine/account ids, using the SAME manifest the public-release scrub
- # uses (scripts/ci/privacy_gate/references/pii-scrub.tsv) so the two
- # never drift. Unlike privacy-gate above, this DOES check the real name — but
- # ONLY inside docs/, where (maintainer decision 2026-06-29) it must never
- # appear, so it cannot false-positive on code where the name lives
- # legitimately. The privacy scan itself is stdlib-only; the public-reader
- # contract also parses YAML frontmatter and therefore installs the PyYAML
- # version pinned by the universal lock. BLOCKING.
- #
- # Runs on push as well as PR (2026-08-05): both steps scan the whole tracked
- # docs/ tree rather than a diff, so there is no base-widening reason to keep
- # them off pushes — and PR-only meant they never ran on a repo whose
- # maintainer pushes straight to main.
- docs-privacy:
- name: docs-privacy (no personal data in docs/)
+ deps:
+ name: deps-sync + portable install matrix
+ needs: detect
+ if: needs.detect.outputs.deps == 'true'
runs-on: ubuntu-latest
- timeout-minutes: 5
+ timeout-minutes: 30
steps:
- - name: Checkout
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+ - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
persist-credentials: false
-
- - name: Set up Python 3.11
- uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
+ - uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
with:
python-version: "3.11"
+ - run: python -m pip install packaging==25.0 uv==0.11.19
+ - name: requirements.in mirrors pyproject (AP-23)
+ run: python scripts/ci/check_requirements_sync.py
+ - name: Lockfile universal + GPU-free
+ run: python scripts/ci/check_lockfile_universal.py
+ - name: Target-resolved portable install matrix
+ run: python scripts/ci/check_portable_install_matrix.py --jobs 4
- - name: Install public-docs parser dependency
- run: python -m pip install --no-deps pyyaml==6.0.3
-
- - name: Docs privacy gate (BLOCKING - name / email / paths / ids in docs/)
- run: python scripts/ci/docs_privacy_scan.py
-
- - name: Public reader docs contract (BLOCKING)
- run: python scripts/ci/check_public_docs.py
-
- # Frontend test + production build (was frontend.yml until 2026-08-20).
- # Own job rather than a step in `test`: it needs Node, not Python, and a
- # frontend-only change should get its signal without waiting on the OS matrix.
- frontend:
- name: frontend (test + production build)
- runs-on: ubuntu-latest
- timeout-minutes: 15
- defaults:
- run:
- working-directory: jarvis/ui/web/frontend
-
- steps:
- - name: Checkout
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
- with:
- persist-credentials: false
-
- - name: Set up Node.js 22
- uses: actions/setup-node@820762786026740c76f36085b0efc47a31fe5020 # v7.0.0
- with:
- node-version: "22"
- cache: npm
- cache-dependency-path: jarvis/ui/web/frontend/package-lock.json
-
- - name: Install locked dependencies
- id: frontend_deps
- run: npm ci
-
- - name: Run frontend tests
- run: npm test
-
- - name: Build and verify production assets
- # A failing test suite must not hide a second, independent build or
- # bundle-budget regression. The job still fails on the test result.
- if: always() && steps.frontend_deps.outcome == 'success'
- id: frontend_build
- run: npm run build
-
- # The entry chunk is parsed and executed before the UI paints a single
- # pixel, so its size IS startup latency. It guards the same regression
- # class as the Python boot budget — a statically imported view or library
- # quietly adding seconds to every launch — but it is the only HALF of that
- # pair a CI runner can measure. `check_boot_budget.py` boots the whole
- # application and needs an audio device to reach VOICE_USABLE, so it left
- # pre-push on 2026-08-05 and has no CI home; it is an on-demand local
- # command (`python scripts/ci/check_boot_budget.py`) that AP-26 asks you
- # to run by hand after touching the startup path. Do not read this step as
- # covering the Python side.
- - name: Check startup bundle budget
- if: always() && steps.frontend_build.outcome == 'success'
- working-directory: ${{ github.workspace }}
- run: python3 scripts/ci/check_frontend_bundle_budget.py
-
- # Realtime's small, blocking cross-platform contract (was
- # realtime-reliability.yml until 2026-08-20).
- #
- # Deliberately NOT `needs: configure`: this matrix is hard-coded to all three
- # OSes including macOS on EVERY run. That is the whole reason the suite is
- # small — it buys a macOS proof on every change without paying the hour-long
- # full-suite cost, which is why `test` above keeps macOS behind a dispatch.
- #
- # No job here owns a microphone, speaker, desktop session, or provider secret.
- # Physical microphone/acoustic-echo behavior, device hot-plug, and macOS TCC
- # prompts remain explicit human release sign-offs; a headless runner must never
- # turn their absence into a fake green result.
realtime-contract:
- name: realtime provider contract (${{ matrix.os }})
+ name: realtime contract (${{ matrix.os }})
+ needs: detect
+ if: needs.detect.outputs.realtime == 'true'
strategy:
fail-fast: false
matrix:
- os:
- - ubuntu-latest
- - windows-latest
- - macos-latest
+ os: [ubuntu-latest, windows-latest, macos-latest]
runs-on: ${{ matrix.os }}
timeout-minutes: 25
-
steps:
- - name: Checkout
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+ - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
persist-credentials: false
-
- - name: Set up Python 3.11
- uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
+ - uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
with:
python-version: "3.11"
-
- - name: Install portable base and focused test runner
+ - name: Portable base + focused runner
shell: bash
run: |
- python -m pip install --upgrade pip
python -m pip install -e .
python -m pip install pytest pytest-asyncio
-
- - name: Blocking provider-neutral realtime contract
- run: >-
- python -m pytest
- tests/contract/test_gpt_live.py
- tests/contract/test_realtime_provider_contract.py
- tests/contract/test_realtime_reliability_gate.py
- -q -p no:cacheprovider
+ - name: Provider-neutral realtime contract
+ run: python -m pytest tests/contract/test_gpt_live.py tests/contract/test_realtime_provider_contract.py tests/contract/test_realtime_reliability_gate.py -q -p no:cacheprovider
realtime-slim:
name: realtime on python:3.11-slim (no PortAudio)
+ needs: detect
+ if: needs.detect.outputs.realtime == 'true'
runs-on: ubuntu-latest
container: python:3.11-slim
timeout-minutes: 25
-
steps:
- - name: Checkout
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+ - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
persist-credentials: false
-
- - name: Install base without system audio libraries
+ - name: Base install without system audio
run: |
- python -m pip install --upgrade pip
python -m pip install -e .
python -m pip install pytest pytest-asyncio
-
- - name: Prove the container really has no usable PortAudio
+ - name: The container really has no usable PortAudio
run: |
python - <<'PY'
try:
@@ -843,95 +560,52 @@ jobs:
else:
raise SystemExit("python:3.11-slim unexpectedly loaded PortAudio")
PY
+ - name: Headless realtime degradation contract
+ run: python -m pytest tests/contract/test_gpt_live.py tests/contract/test_realtime_provider_contract.py tests/contract/test_realtime_reliability_gate.py -q -p no:cacheprovider
- - name: Blocking headless realtime degradation contract
- run: >-
- python -m pytest
- tests/contract/test_gpt_live.py
- tests/contract/test_realtime_provider_contract.py
- tests/contract/test_realtime_reliability_gate.py
- -q -p no:cacheprovider
-
- realtime-soak:
- name: realtime extended contract soak (not release evidence)
- # This synthetic orchestration proof must never green-light a tag. A real
- # release still needs same-SHA target measurements and manual acoustic
- # sign-off, neither of which a headless GitHub runner can produce.
+ soak:
+ name: realtime contract soak (not release evidence)
+ needs: detect
if: github.event_name == 'workflow_dispatch' && inputs.run_contract_soak
runs-on: ubuntu-latest
timeout-minutes: 25
-
steps:
- - name: Checkout
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+ - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
persist-credentials: false
-
- - name: Set up Python 3.11
- uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
+ - uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
with:
python-version: "3.11"
+ - run: python -m pip install -e .
+ - run: python scripts/realtime_reliability_gate.py --contract-soak
- - name: Install portable base
- run: |
- python -m pip install --upgrade pip
- python -m pip install -e .
-
- - name: Run provider-neutral orchestration soak
- run: python scripts/realtime_reliability_gate.py --contract-soak
-
- # Cross-platform drag-drop verification (was dragdrop-verify.yml until
- # 2026-08-20) — proves the overlay drop mechanism (tkdnd load + parse +
- # register + drop chain) actually EXECUTES on Windows, macOS AND Linux, by
- # running the same `scripts/crossplatform/verify_drop_target.py` on each.
- #
- # Gated by `configure`'s git-diff path check, because a workflow-level
- # `paths:` filter cannot apply to a single job. macOS (~10x cost) rides the
- # same dispatch-only rule as the rest of this file.
- # No explicit `name:`. A matrix job whose name interpolates ${{ matrix.os }}
- # renders that expression RAW in the check list when the job is SKIPPED — the
- # matrix is never evaluated, so a contributor reads a literal
- # "drag-drop (${{ matrix.os }})". Falling back to the job id gives
- # "dragdrop (ubuntu-latest)" when it runs and a clean "dragdrop" when it does not.
dragdrop:
- needs: configure
- if: needs.configure.outputs.run-dragdrop == 'true'
+ name: dragdrop (${{ matrix.os }})
+ needs: detect
+ if: needs.detect.outputs.dragdrop == 'true'
strategy:
fail-fast: false
matrix:
- os: ${{ fromJSON(needs.configure.outputs.dragdrop-matrix) }}
+ os: ${{ fromJSON(needs.detect.outputs.os_matrix) }}
runs-on: ${{ matrix.os }}
timeout-minutes: 15
-
steps:
- - name: Checkout
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+ - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
with:
persist-credentials: false
-
- - name: Set up Python 3.11
- uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
+ - uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
with:
python-version: "3.11"
-
- - name: Install tkinterdnd2 (+ Linux X11 runtime libs)
+ # ==0.4.2: later osx-arm64 builds are Tcl-9 and fail on Tcl-8.6 Python.
+ - name: Install tkinterdnd2 (+ Linux X11 runtime)
shell: bash
run: |
- python -m pip install --upgrade pip
- # Pin ==0.4.2: from 0.4.4.1 onward the osx-arm64 tkdnd binary is the
- # Tcl-9 build (libtcl9tkdnd2.9.5.dylib) that fails to load on the
- # standard Tcl-8.6 Python ("incompatible stubs mechanism"). 0.4.2 is the
- # highest version whose osx-arm64 binary is the Tcl-8 build
- # (libtkdnd2.9.3.dylib), which loads on Tcl-8.6 across all three OSes.
pip install "tkinterdnd2==0.4.2"
if [ "$RUNNER_OS" = "Linux" ]; then
sudo apt-get update -qq
- sudo apt-get install -y --no-install-recommends \
- python3-tk xvfb libxcursor1 libxrender1 libxext6 \
- libxft2 libxinerama1 libxi6 libxrandr2
+ sudo apt-get install -y --no-install-recommends python3-tk xvfb libxcursor1 libxrender1 libxext6 libxft2 libxinerama1 libxi6 libxrandr2
fi
-
- - name: Verify drag-drop executes on ${{ matrix.os }}
+ - name: Drag-drop executes
shell: bash
run: |
if [ "$RUNNER_OS" = "Linux" ]; then
@@ -939,3 +613,62 @@ jobs:
else
python scripts/crossplatform/verify_drop_target.py
fi
+
+ browser:
+ name: browser runtime
+ needs: detect
+ if: needs.detect.outputs.browser == 'true'
+ uses: ./.github/workflows/browser-runtime.yml
+
+ macos-desktop:
+ name: macOS desktop
+ needs: detect
+ if: needs.detect.outputs.macos_desktop == 'true' && (needs.detect.outputs.full != 'true' || needs.detect.outputs.macos == 'true')
+ uses: ./.github/workflows/macos-desktop.yml
+
+ installer:
+ name: installer smoke
+ needs: detect
+ if: needs.detect.outputs.installer == 'true'
+ uses: ./.github/workflows/installer-smoke.yml
+ with:
+ force: ${{ needs.detect.outputs.full == 'true' }}
+ include_macos: ${{ needs.detect.outputs.macos == 'true' }}
+
+ # The ONE required check. Branch protection and the merge train read only
+ # this; a new job needs nothing but a line in `needs`.
+ gate:
+ name: CI gate
+ needs:
+ - detect
+ - gates
+ - python-fast
+ - tests-linux
+ - tests-windows
+ - tests-macos
+ - test-report
+ - frontend
+ - jarvisctl
+ - deps
+ - realtime-contract
+ - realtime-slim
+ - soak
+ - dragdrop
+ - browser
+ - macos-desktop
+ - installer
+ if: always()
+ runs-on: ubuntu-latest
+ timeout-minutes: 5
+ steps:
+ - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+ with:
+ persist-credentials: false
+ - name: Evaluate every job
+ env:
+ NEEDS: ${{ toJSON(needs) }}
+ STRICT: ${{ github.event_name == 'schedule' }}
+ run: |
+ args=()
+ [ "$STRICT" = "true" ] && args+=(--strict)
+ printf '%s' "$NEEDS" | python3 scripts/ci/required_results.py "${args[@]}"
diff --git a/.github/workflows/installer-smoke.yml b/.github/workflows/installer-smoke.yml
index a878f08402..6a8119fd6e 100644
--- a/.github/workflows/installer-smoke.yml
+++ b/.github/workflows/installer-smoke.yml
@@ -26,37 +26,28 @@
name: Installer smoke
+# Called by ci.yml's `installer` lane (path-gated there) and runnable by hand.
+# `force` runs both smokes regardless of the diff (full CI runs, manual runs).
on:
- push:
- branches: [main]
- paths:
- - "install/**"
- - "tests/unit/install/test_install_sh_stage1.py"
- - "pyproject.toml"
- - "requirements.txt"
- - "jarvis/__main__.py"
- - "jarvis/setup/prefetch.py"
- - "jarvis/setup/model_report.py"
- - "jarvis/speech/wake_model_fetch.py"
- - ".github/workflows/sign-installer.yml"
- - ".github/workflows/installer-smoke.yml"
- pull_request:
- branches: [main]
- paths:
- - "install/**"
- - "tests/unit/install/test_install_sh_stage1.py"
- - "pyproject.toml"
- - "requirements.txt"
- - "jarvis/__main__.py"
- - "jarvis/setup/prefetch.py"
- - "jarvis/setup/model_report.py"
- - "jarvis/speech/wake_model_fetch.py"
- - ".github/workflows/sign-installer.yml"
- - ".github/workflows/installer-smoke.yml"
+ workflow_call:
+ inputs:
+ force:
+ type: boolean
+ default: false
+ include_macos:
+ type: boolean
+ default: false
+ tag:
+ type: string
+ default: ""
workflow_dispatch:
inputs:
+ force:
+ description: "Run both smokes regardless of the diff."
+ type: boolean
+ default: true
include_macos:
- description: "Also run the fresh-install macOS leg (~10x runner cost). On by default for a manual run, since proving macOS is usually the point of dispatching by hand."
+ description: "Also run the fresh-install macOS leg (~10x runner cost)."
type: boolean
default: true
tag:
@@ -64,12 +55,6 @@ on:
required: false
default: ""
-# A new push to the same ref cancels the previous in-flight run so a burst of
-# commits doesn't stack billable minutes.
-concurrency:
- group: installer-smoke-${{ github.workflow }}-${{ github.ref }}
- cancel-in-progress: true
-
permissions:
contents: read
@@ -97,22 +82,22 @@ jobs:
id: pick
shell: bash
run: |
- if [ "${{ github.event_name }}" = "workflow_dispatch" ] && [ "${{ inputs.include_macos }}" = "true" ]; then
+ if [ "${{ inputs.include_macos }}" = "true" ]; then
echo 'os-matrix=["ubuntu-latest","macos-latest"]' >> "$GITHUB_OUTPUT"
- echo "macOS leg INCLUDED (manual dispatch)."
+ echo "macOS leg INCLUDED."
else
echo 'os-matrix=["ubuntu-latest"]' >> "$GITHUB_OUTPUT"
- echo "macOS leg SKIPPED (cheap push/PR run). Dispatch manually to include it."
+ echo "macOS leg SKIPPED (the caller did not include macOS)."
fi
- name: Per-job path gates
id: paths
shell: bash
run: |
- if [ "${{ github.event_name }}" = "workflow_dispatch" ]; then
+ if [ "${{ inputs.force }}" = "true" ]; then
echo "run-fresh=true" >> "$GITHUB_OUTPUT"
echo "run-verify=true" >> "$GITHUB_OUTPUT"
- echo "Manual dispatch — both smokes RUN."
+ echo "Forced run — both smokes RUN."
exit 0
fi
base="${{ github.event.pull_request.base.sha }}"
@@ -374,7 +359,7 @@ jobs:
id: tag
run: |
set -euo pipefail
- INPUT_TAG="${{ github.event.inputs.tag }}"
+ INPUT_TAG="${{ inputs.tag }}"
if [ -n "$INPUT_TAG" ]; then
echo "tag=$INPUT_TAG" >> "$GITHUB_OUTPUT"
echo "Using manually-provided tag: $INPUT_TAG"
diff --git a/.github/workflows/macos-desktop.yml b/.github/workflows/macos-desktop.yml
index b2cdc49989..ce5e0b8b82 100644
--- a/.github/workflows/macos-desktop.yml
+++ b/.github/workflows/macos-desktop.yml
@@ -6,61 +6,12 @@
name: macOS desktop
-# Trigger note (2026-08-20): this ran on `pull_request` only, and the project
-# has no PR flow — 0 merge commits in the last 200 — so the macOS leg had not
-# fired in months while CLAUDE.md called macOS a first-class target "in
-# the SAME change". A non-negotiable rule whose proof never runs is a rule on
-# paper. The path filters below keep the cost honest: the expensive runners
-# wake only for a change that can actually break the desktop.
+# Called by ci.yml's `macos_desktop` lane (path-gated there; on full runs only
+# when macOS is included) and runnable by hand. The caller owns concurrency.
on:
- push:
- branches:
- - main
- paths:
- - ".github/workflows/macos-desktop.yml"
- - ".githooks/pre-push"
- - "install/**"
- - "jarvis/admin/**"
- - "jarvis/audio/**"
- - "jarvis/autostart/**"
- - "jarvis/cu/**"
- - "jarvis/platform/**"
- - "jarvis/setup/**"
- - "jarvis/trigger/**"
- - "jarvis/ui/**"
- - "jarvis/vision/**"
- - "pyproject.toml"
- - "scripts/ci/check_boot_budget.py"
- - "scripts/measure_boot.py"
- - "scripts/measure_desktop_boot.py"
- - "tests/**"
- - "uv.lock"
- pull_request:
- paths:
- - ".github/workflows/macos-desktop.yml"
- - ".githooks/pre-push"
- - "install/**"
- - "jarvis/admin/**"
- - "jarvis/audio/**"
- - "jarvis/autostart/**"
- - "jarvis/cu/**"
- - "jarvis/platform/**"
- - "jarvis/setup/**"
- - "jarvis/trigger/**"
- - "jarvis/ui/**"
- - "jarvis/vision/**"
- - "pyproject.toml"
- - "scripts/ci/check_boot_budget.py"
- - "scripts/measure_boot.py"
- - "scripts/measure_desktop_boot.py"
- - "tests/**"
- - "uv.lock"
+ workflow_call:
workflow_dispatch:
-concurrency:
- group: macos-desktop-${{ github.ref }}
- cancel-in-progress: true
-
permissions:
contents: read
diff --git a/.github/workflows/merge-train.yml b/.github/workflows/merge-train.yml
new file mode 100644
index 0000000000..85171e78ee
--- /dev/null
+++ b/.github/workflows/merge-train.yml
@@ -0,0 +1,113 @@
+# Merge train — integrates several coding agents' pull requests without a human.
+#
+# Every tick (a push to main, a finished CI run, every 15 minutes, or by hand):
+#
+# 1. Eligible PRs: same repository, base main, not a draft, head branch
+# codex/ claude/ agent/ gemini/ cursor/ bot/ — or labelled `auto-merge`.
+# `no-auto-merge`, `do-not-merge`, `wip` or `needs-human` opt a PR out.
+# Forks and Dependabot never qualify (supply-chain bumps stay human).
+# 2. A PR behind main is brought up to date by merging main into it
+# (scripts/ci/agent_integrate.py): generated files are regenerated,
+# append-only files union-merged, everything else goes to the optional AI
+# resolver or is reported with a `needs-rebase` label. No force push.
+# 3. The first up-to-date PR whose `CI gate` is green is squash-merged —
+# one per tick, so every landing is tested on top of the main it lands on.
+#
+# Tokens: with the optional INTEGRATION_TOKEN secret (a fine-grained PAT or App
+# token with contents + pull-requests write), pushes and merges fire the normal
+# pull_request / push events. Without it the train uses GITHUB_TOKEN, whose
+# pushes fire no events, so it dispatches ci.yml itself for every branch it
+# updates and for main after every merge.
+#
+# AI conflict resolution is optional: set ANTHROPIC_API_KEY (Claude Code) or
+# OPENAI_API_KEY (Codex CLI). Without a key, semantic conflicts are reported.
+#
+# Trust: the train runs the checked-out PR's own build scripts with a write
+# token, which is why forks are excluded — only people with push access to this
+# repository can put a branch on the train.
+
+name: Merge train
+
+on:
+ push:
+ branches: [main]
+ workflow_run:
+ workflows: [CI]
+ types: [completed]
+ schedule:
+ - cron: "*/15 * * * *"
+ workflow_dispatch:
+ inputs:
+ dry_run:
+ description: "Report what the train would do without pushing or merging."
+ type: boolean
+ default: false
+
+# One train at a time; a queued tick replaces an older queued one.
+concurrency:
+ group: merge-train
+ cancel-in-progress: false
+
+permissions:
+ contents: write
+ pull-requests: write
+ actions: write
+ checks: read
+
+jobs:
+ train:
+ name: merge train
+ runs-on: ubuntu-latest
+ timeout-minutes: 60
+ env:
+ GH_TOKEN: ${{ secrets.INTEGRATION_TOKEN || github.token }}
+ TOKEN_IS_BOT: ${{ secrets.INTEGRATION_TOKEN == '' }}
+ steps:
+ - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+ with:
+ fetch-depth: 0
+ token: ${{ secrets.INTEGRATION_TOKEN || github.token }}
+ - uses: actions/setup-python@5fda3b95a4ea91299a34e894583c3862153e4b97 # v7.0.0
+ with:
+ python-version: "3.11"
+ - uses: actions/setup-node@820762786026740c76f36085b0efc47a31fe5020 # v7.0.0
+ with:
+ node-version: "22"
+ - name: Regenerator dependencies (mirrors, reference docs, locks)
+ run: |
+ python -m pip install -e . --no-deps
+ python -m pip install typer platformdirs click httpx rich pyyaml pydantic loguru python-dotenv packaging uv==0.11.19
+ - name: Restore recorded conflict resolutions (git rerere)
+ uses: actions/cache@27d5ce7f107fe9357f9df03efb73ab90386fccae # v5.0.5
+ with:
+ path: .git/rr-cache
+ key: rerere-${{ github.run_id }}
+ restore-keys: rerere-
+ - name: Optional AI conflict resolver
+ id: resolver
+ env:
+ ANTHROPIC_API_KEY: ${{ secrets.ANTHROPIC_API_KEY }}
+ OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+ run: |
+ if [ -n "$ANTHROPIC_API_KEY" ]; then
+ npm install -g @anthropic-ai/claude-code >/dev/null
+ echo 'cmd=claude -p --permission-mode acceptEdits --allowedTools Read,Edit' >> "$GITHUB_OUTPUT"
+ elif [ -n "$OPENAI_API_KEY" ]; then
+ npm install -g @openai/codex >/dev/null
+ echo 'cmd=codex exec --full-auto -' >> "$GITHUB_OUTPUT"
+ else
+ echo "No resolver key configured - semantic conflicts are reported, not resolved."
+ fi
+ - name: Run the train
+ env:
+ ANTHROPIC_API_KEY: ${{ secrets.ANTHROPIC_API_KEY }}
+ OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+ CONFLICT_RESOLVER_CMD: ${{ steps.resolver.outputs.cmd }}
+ DRY_RUN: ${{ inputs.dry_run }}
+ run: |
+ git config user.name "jarvis-merge-train[bot]"
+ git config user.email "41898282+github-actions[bot]@users.noreply.github.com"
+ args=(--repo "$GITHUB_REPOSITORY")
+ [ "$DRY_RUN" = "true" ] && args+=(--dry-run)
+ [ "$TOKEN_IS_BOT" = "true" ] && args+=(--token-is-bot)
+ python scripts/ci/agent_integrate.py train "${args[@]}"