Skip to content

Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.

devops: extract reusable PR CI triage workflow (#42090)

Simon Knottc3749105bd12
diff --git a/.github/workflows/create_test_report.yml b/.github/workflows/create_test_report.yml
index 0bc76438da..f6aed35520 100644
--- a/.github/workflows/create_test_report.yml
+++ b/.github/workflows/create_test_report.yml
@@ -116,109 +116,11 @@ jobs:
triage:
needs: merge-reports
if: ${{ needs.merge-reports.outputs.has_failures == 'true' && needs.merge-reports.outputs.pr_number && needs.merge-reports.outputs.triage_allowed == 'true' }}
- runs-on: ubuntu-latest
- timeout-minutes: 20
permissions:
+ contents: read
+ actions: read
+ pull-requests: write
copilot-requests: write
- outputs:
- has_draft: ${{ steps.triage.outputs.has_draft }}
+ uses: ./.github/workflows/pr-ci-triage.yml
+ with:
pr_number: ${{ needs.merge-reports.outputs.pr_number }}
- env:
- PR_NUMBER: ${{ needs.merge-reports.outputs.pr_number }}
- GH_TOKEN: ${{ github.token }}
- steps:
- - name: Checkout
- uses: actions/checkout@v6
-
- - name: Set up Node.js
- uses: actions/setup-node@v6
- with:
- node-version: "24"
-
- - name: Install Copilot CLI
- run: npm install -g @github/copilot
-
- - name: Triage failures with Copilot CLI
- id: triage
- env:
- COPILOT_GITHUB_TOKEN: ${{ github.token }}
- run: |
- mkdir -p output
- PROMPT=$(cat <<EOF
- Come up with a verdict on the CI test failures on pull request #$PR_NUMBER of ${{ github.repository }}: are they likely caused by this PR? Follow the pr-ci-triage guide (.github/workflows/pr-ci-triage.md) for the analysis.
-
- Write your verdict to output/triage.md as a PR comment, in the format the guide specifies and the playwright-bot-voice register (.claude/skills/playwright-bot-voice/SKILL.md).
-
- Do not post anything yourself — a later workflow step posts output/triage.md.
- EOF
- )
- copilot \
- --allow-all-tools \
- --allow-all-paths \
- --no-ask-user \
- --enable-all-github-mcp-tools \
- --share=output/copilot-session.md \
- --model claude-opus-4.8 \
- --max-ai-credits 500 \
- -p "$PROMPT"
-
- if [ -s output/triage.md ]; then
- echo "has_draft=true" >> "$GITHUB_OUTPUT"
- else
- echo "has_draft=false" >> "$GITHUB_OUTPUT"
- fi
-
- - name: Add session transcript to job summary
- if: ${{ always() }}
- run: |
- {
- echo "## CI triage session transcript (PR #$PR_NUMBER)"
- echo ''
- cat "output/copilot-session.md" 2>/dev/null || echo "(no transcript)"
- } >> "$GITHUB_STEP_SUMMARY"
-
- - name: Upload output
- if: ${{ always() }}
- uses: actions/upload-artifact@v4
- with:
- name: ci-triage-${{ needs.merge-reports.outputs.pr_number }}
- path: output/triage.md
- if-no-files-found: warn
-
- post:
- needs: triage
- if: needs.triage.outputs.has_draft == 'true'
- runs-on: ubuntu-latest
- permissions:
- pull-requests: write
- env:
- PR_NUMBER: ${{ needs.triage.outputs.pr_number }}
- GH_TOKEN: ${{ github.token }}
- WORKFLOW_URL: ${{ github.server_url }}/${{ github.repository }}/actions/runs/${{ github.run_id }}
- steps:
- - name: Checkout
- uses: actions/checkout@v6
-
- - name: Download triage output
- uses: actions/download-artifact@v4
- with:
- name: ci-triage-${{ needs.triage.outputs.pr_number }}
- path: output
-
- - name: Post triage comment
- uses: actions/github-script@v9
- with:
- script: |
- const fs = require('fs');
- const { collapsePreviousComments } = require('./tests/config/postReportComment');
- const sentinel = `<!-- playwright-ci-triage --><!-- ${context.payload.workflow_run.name} -->`;
- const prNumber = +process.env.PR_NUMBER;
- await collapsePreviousComments(github, context, prNumber, sentinel);
-
- const triage = fs.readFileSync('output/triage.md', 'utf8');
- const body = `${triage}\n\n<sub>Triaged by the Playwright bot - [agent run](${process.env.WORKFLOW_URL})</sub>\n${sentinel}\n`;
- await github.rest.issues.createComment({
- ...context.repo,
- issue_number: prNumber,
- body,
- });
diff --git a/.github/workflows/pr-ci-triage.yml b/.github/workflows/pr-ci-triage.yml
new file mode 100644
index 0000000000..07c9c7b32a
--- /dev/null
+++ b/.github/workflows/pr-ci-triage.yml
@@ -0,0 +1,134 @@
+# Reusable CI triage for PR test failures. Callable from other repos
+# (e.g. microsoft/playwright-browsers) via workflow_call.
+name: PR CI Triage
+
+on:
+ workflow_call:
+ inputs:
+ pr_number:
+ description: 'PR number to triage'
+ required: true
+ type: string
+
+permissions: {}
+
+jobs:
+ triage:
+ runs-on: ubuntu-latest
+ timeout-minutes: 20
+ permissions:
+ contents: read
+ actions: read
+ pull-requests: read
+ copilot-requests: write
+ outputs:
+ has_draft: ${{ steps.triage.outputs.has_draft }}
+ env:
+ PR_NUMBER: ${{ inputs.pr_number }}
+ TARGET_REPO: ${{ github.repository }}
+ GH_TOKEN: ${{ github.token }}
+ steps:
+ - name: Checkout
+ uses: actions/checkout@v6
+ with:
+ repository: microsoft/playwright
+ ref: main
+
+ - name: Set up Node.js
+ uses: actions/setup-node@v6
+ with:
+ node-version: '24'
+
+ - name: Install Copilot CLI
+ run: npm install -g @github/copilot
+
+ - name: Triage failures with Copilot CLI
+ id: triage
+ env:
+ COPILOT_GITHUB_TOKEN: ${{ github.token }}
+ run: |
+ set -euo pipefail
+ mkdir -p output
+ PROMPT=$(cat <<PROMPT_EOF
+ Come up with a verdict on the CI test failures on pull request #${PR_NUMBER} of ${TARGET_REPO}: are they likely caused by this PR? Follow the pr-ci-triage guide (.github/workflows/pr-ci-triage.md) for the analysis.
+
+ Write your verdict to output/triage.md as a PR comment, in the format the guide specifies and the bot voice register (.github/workflows/bot-voice.md).
+
+ Do not post anything yourself — a later workflow step posts output/triage.md.
+ PROMPT_EOF
+ )
+ copilot \
+ --allow-all-tools \
+ --allow-all-paths \
+ --no-ask-user \
+ --enable-all-github-mcp-tools \
+ --share=output/copilot-session.md \
+ --model claude-opus-4.8 \
+ --max-ai-credits 500 \
+ -p "$PROMPT"
+
+ if [ -s output/triage.md ]; then
+ echo "has_draft=true" >> "$GITHUB_OUTPUT"
+ else
+ echo "has_draft=false" >> "$GITHUB_OUTPUT"
+ fi
+
+ - name: Add session transcript to job summary
+ if: ${{ always() }}
+ run: |
+ {
+ echo "## CI triage session transcript (PR #$PR_NUMBER on $TARGET_REPO)"
+ echo ''
+ cat output/copilot-session.md 2>/dev/null || echo "(no transcript)"
+ } >> "$GITHUB_STEP_SUMMARY"
+
+ - name: Upload triage draft
+ if: ${{ always() }}
+ uses: actions/upload-artifact@v4
+ with:
+ name: ci-triage-${{ inputs.pr_number }}
+ path: output/triage.md
+ if-no-files-found: warn
+
+ post:
+ needs: triage
+ if: ${{ needs.triage.outputs.has_draft == 'true' }}
+ runs-on: ubuntu-latest
+ permissions:
+ contents: read
+ pull-requests: write
+ env:
+ PR_NUMBER: ${{ inputs.pr_number }}
+ GH_TOKEN: ${{ github.token }}
+ WORKFLOW_URL: ${{ github.server_url }}/${{ github.repository }}/actions/runs/${{ github.run_id }}
+ REPORT_NAME: ${{ github.event.workflow_run.name || github.workflow }}
+ steps:
+ - name: Checkout
+ uses: actions/checkout@v6
+ with:
+ repository: microsoft/playwright
+ ref: main
+
+ - name: Download triage draft
+ uses: actions/download-artifact@v4
+ with:
+ name: ci-triage-${{ inputs.pr_number }}
+ path: output
+
+ - name: Post triage comment
+ uses: actions/github-script@v9
+ with:
+ github-token: ${{ secrets.GITHUB_TOKEN }}
+ script: |
+ const fs = require('fs');
+ const { collapsePreviousComments } = require('./tests/config/postReportComment');
+ const sentinel = `<!-- playwright-ci-triage --><!-- ${process.env.REPORT_NAME} -->`;
+ const prNumber = +process.env.PR_NUMBER;
+ await collapsePreviousComments(github, context, prNumber, sentinel);
+ const triage = fs.readFileSync('output/triage.md', 'utf8');
+ const body = `${triage}\n\n<sub>Triaged by the Playwright bot - [agent run](${process.env.WORKFLOW_URL})</sub>\n${sentinel}\n`;
+ await github.rest.issues.createComment({
+ ...context.repo,
+ issue_number: prNumber,
+ body,
+ });