Reverse engineer anything with agents, from app behavior down to native binaries.
TypeScript agent-skillsai-agentsbinary-analysisclaude-codeclicodexcordisdecompilerdeveloper-toolsdshdsh-pluginghidrahopperllmmcpmodel-context-protocolreareverse-engineeringstatic-analysistouhou
ci: parallelize native verification and share test artifacts
morluto91f6840c35e9
diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.ymlindex b55d8dcaf..7e506e050 100644--- a/.github/workflows/ci.yml+++ b/.github/workflows/ci.yml@@ -115,14 +115,8 @@ jobs:- run: npm ci- uses: actions/download-artifact@v4with:- name: rea-dist- path: dist- - name: Generate test artifacts from the downloaded runtime- run: |- node scripts/generate-mcp-tool-catalog.mjs- node scripts/generate-skill-metadata.mjs- node scripts/generate-product-catalog.mjs- node scripts/generate-completion-ledger.mjs+ name: rea-test-runtime+ path: .- run: npm run test:ci:shard:run -- --shard=${{ matrix.shard }}- uses: actions/upload-artifact@v4if: ${{ !cancelled() }}@@ -146,11 +140,17 @@ jobs:node-version-file: .nvmrccache: npm- run: npm ci- - run: npm run build:cached+ - run: npm run test:prepare- uses: actions/upload-artifact@v4with:- name: rea-dist- path: dist+ name: rea-test-runtime+ path: |+ dist/+ skills/+ .cache/mcp-tool-catalog.json+ docs/public/product-catalog.json+ docs/verification/managed-conformance-*.json+ include-hidden-files: trueif-no-files-found: errorretention-days: 7@@ -274,7 +274,10 @@ jobs:if: needs.changes.outputs.runtime == 'true'strategy:fail-fast: false- max-parallel: 2+ # The four platform jobs use independent hosted runners; keep each+ # runner's existing heap and threadpool limits while avoiding a queued+ # second platform wave.+ max-parallel: 4matrix: ${{ fromJSON(needs.changes.outputs.matrix) }}runs-on: ${{ matrix.os }}timeout-minutes: 20@@ -308,11 +311,15 @@ jobs:run: npm run verify:inspectorapple-artifacts:- name: Real Apple artifact CLI/MCP E2E+ name: Real Apple artifact CLI/MCP E2E (${{ matrix.group }})needs: changesif: needs.changes.outputs.apple == 'true'runs-on: macos-15timeout-minutes: 15+ strategy:+ fail-fast: false+ matrix:+ group: [artifacts, native-regressions]steps:- uses: actions/checkout@v4- uses: actions/setup-node@v4@@ -320,25 +327,36 @@ jobs:node-version-file: .nvmrccache: npm- run: npm ci- - run: npm run verify:keyed-archive- - run: npm run verify:asset-catalog- - run: npm run verify:macos-bundle- - name: Legacy simulator platform verification- run: npm run verify:legacy-simulator- - name: Native installer and compiled NIB hierarchy regressions- run: npm run test:focused -- tests/boundary/filesystem/installScript.test.ts tests/boundary/filesystem/nibNativeHierarchy.test.ts tests/boundary/filesystem/interfaceBuilderBundle.test.ts- - name: Real binary metadata and Interface Builder integration- run: npm run verify:apple-dispatch && npm run verify:interface-builder- - name: Native plist CLI selection regressions- run: npm run test:focused -- tests/boundary/cli/nativePlistCli.test.ts tests/boundary/cli/nativePlistPrototypeKeyCli.test.ts tests/boundary/cli/nativePlistSelectionFailureCli.test.ts- - name: Native Swift demangling CLI and MCP regressions- run: npm run test:focused -- tests/boundary/cli/nativeDemangleCli.test.ts tests/boundary/mcp/nativeDemangleMcp.test.ts- - name: Native signature target binding and CLI/MCP recovery regressions- run: npm run test:focused -- tests/boundary/providers/native/nativeSignatureTargetBinding.test.ts tests/boundary/cli/nativeSignatureCli.test.ts tests/boundary/mcp/nativeSignatureTargetBindingMcp.test.ts- - name: Process filesystem snapshot descriptor regressions- run: npm run test:focused -- src/process/capture/FilesystemSnapshot.test.ts- - name: Native Darwin ownership and process cleanup regressions- run: npm run test:focused -- tests/boundary/process/darwinProcessRunTokenReader.test.ts tests/boundary/process/directAnalysisSignals.test.ts tests/boundary/process/processCaptureLifecycle.test.ts tests/boundary/process/processCli.test.ts tests/boundary/mcp/sessionMcp.test.ts+ - name: Verify Apple artifact formats and metadata+ if: matrix.group == 'artifacts'+ run: |+ npm run verify:keyed-archive+ npm run verify:asset-catalog+ npm run verify:macos-bundle+ npm run verify:legacy-simulator+ npm run verify:apple-dispatch+ npm run verify:interface-builder+ - name: Run native Apple and process boundary regressions+ if: matrix.group == 'native-regressions'+ run: >-+ npm run test:focused --+ tests/boundary/filesystem/installScript.test.ts+ tests/boundary/filesystem/nibNativeHierarchy.test.ts+ tests/boundary/filesystem/interfaceBuilderBundle.test.ts+ tests/boundary/cli/nativePlistCli.test.ts+ tests/boundary/cli/nativePlistPrototypeKeyCli.test.ts+ tests/boundary/cli/nativePlistSelectionFailureCli.test.ts+ tests/boundary/cli/nativeDemangleCli.test.ts+ tests/boundary/mcp/nativeDemangleMcp.test.ts+ tests/boundary/providers/native/nativeSignatureTargetBinding.test.ts+ tests/boundary/cli/nativeSignatureCli.test.ts+ tests/boundary/mcp/nativeSignatureTargetBindingMcp.test.ts+ src/process/capture/FilesystemSnapshot.test.ts+ tests/boundary/process/darwinProcessRunTokenReader.test.ts+ tests/boundary/process/directAnalysisSignals.test.ts+ tests/boundary/process/processCaptureLifecycle.test.ts+ tests/boundary/process/processCli.test.ts+ tests/boundary/mcp/sessionMcp.test.tsreconstruction-readiness:name: Reconstruction readinessdiff --git a/docs/testing.md b/docs/testing.mdindex 896fe7789..45f624923 100644--- a/docs/testing.md+++ b/docs/testing.md@@ -828,11 +828,25 @@ CI exercises the pinned Node.js runtime on native hosted runners:Package lanes assert the actual Node platform/architecture before verificationand record those values with the Node version. The four-host package matrix-runs at most two jobs concurrently with explicit timeouts and Node heap/thread-limits; Windows retains its curated capability lane. Package checks cover-installation, CLI/MCP discovery, target-free-analysis, configuration backups/recovery, Evidence and owned lifecycle; Inspector-checks execute source-owned loopback targets and special filename cases.+runs up to four jobs concurrently on independent hosted runners with explicit+timeouts and per-runner Node heap/thread limits; Windows retains its curated+capability lane. Package checks cover installation, CLI/MCP discovery,+target-free analysis, configuration backups/recovery, Evidence and owned+lifecycle; Inspector checks execute source-owned loopback targets and special+filename cases.++The Apple artifact CLI/MCP lane uses two macOS jobs: artifact-format and metadata+verifiers run together in one group, while the existing focused native and+process-boundary regressions run in the other. Both groups retain the same+`macos-15` host and timeout; the process-boundary test group remains ordered+within its Vitest run.++The Linux source-test shards download a shared runtime and generated test+metadata snapshot produced by the build job with `npm run test:prepare`. The+snapshot includes `dist/`, generated skills, the MCP tool catalog, product+catalog, and managed-conformance metadata. Each shard still installs the locked+dependencies and runs its assigned coverage-enabled tests; it no longer+regenerates the same metadata independently.These native baseline checks complement the Linux source-test shards and theseparate Apple-artifact and real-provider lanes. Actual Hopper, Ghidra, IDA,