Skip to content

YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context

fix(ci): stabilize new desktop E2E coverage

Louis Beaumont42ad97c30fb9
diff --git a/apps/screenpipe-app-tauri/e2e/COVERAGE.md b/apps/screenpipe-app-tauri/e2e/COVERAGE.md
index 7270dd78b..323e92b8f 100644
--- a/apps/screenpipe-app-tauri/e2e/COVERAGE.md
+++ b/apps/screenpipe-app-tauri/e2e/COVERAGE.md
@@ -6,9 +6,9 @@ and layer declared in the manifest, weighted by confidence and criticality.
- Manifest: `e2e/coverage-map.json`
- Specs directory: `e2e/specs`
-- Mapped specs: 71
-- Declared test blocks: 218
-- Weighted coverage points: 168.0
+- Mapped specs: 72
+- Declared test blocks: 221
+- Weighted coverage points: 171.0
Confidence weights: strong=1.0, partial=0.7, conditional=0.4, smoke=0.3.
Criticality weights: high=1.0, medium=0.7, low=0.4.
@@ -19,9 +19,9 @@ can execute more runtime cases than this number shows.
| Platform | Specs | Declared tests | Weighted points | Layers | Features | Critical score |
| --- | --- | --- | --- | --- | --- | --- |
-| windows | 60 | 203 | 162.3 | 15 | 65 | 93% |
-| macos | 67 | 182 | 139.3 | 17 | 66 | 89% |
-| linux | 51 | 165 | 132.9 | 13 | 61 | 87% |
+| windows | 61 | 206 | 165.3 | 15 | 66 | 93% |
+| macos | 68 | 185 | 142.3 | 17 | 67 | 89% |
+| linux | 52 | 168 | 135.9 | 13 | 62 | 87% |
## Runtime Results
@@ -37,15 +37,15 @@ pass/fail/skip counts.
| auth | - | 1 specs / 1 tests / 1.0 pts | - |
| billing | 4 specs / 6 tests / 5.7 pts | 4 specs / 6 tests / 5.7 pts | 4 specs / 6 tests / 5.7 pts |
| capture-ocr | 2 specs / 15 tests / 6.0 pts | 4 specs / 6 tests / 2.4 pts | 1 specs / 3 tests / 1.2 pts |
-| chat-ai | 17 specs / 28 tests / 19.4 pts | 20 specs / 32 tests / 20.7 pts | 16 specs / 27 tests / 18.9 pts |
+| chat-ai | 18 specs / 31 tests / 22.4 pts | 21 specs / 35 tests / 23.7 pts | 17 specs / 30 tests / 21.9 pts |
| entitlement | - | 1 specs / 1 tests / 1.0 pts | - |
| local-api | 14 specs / 94 tests / 78.0 pts | 14 specs / 69 tests / 59.0 pts | 11 specs / 67 tests / 58.2 pts |
| notifications | 2 specs / 11 tests / 10.1 pts | 2 specs / 4 tests / 2.4 pts | 1 specs / 3 tests / 2.1 pts |
-| onboarding | 1 specs / 4 tests / 1.6 pts | 1 specs / 4 tests / 1.6 pts | 1 specs / 4 tests / 1.6 pts |
+| onboarding | 2 specs / 7 tests / 4.6 pts | 2 specs / 7 tests / 4.6 pts | 2 specs / 7 tests / 4.6 pts |
| os-integration | 5 specs / 17 tests / 16.1 pts | 5 specs / 4 tests / 1.3 pts | - |
| performance | 2 specs / 44 tests / 44.0 pts | 4 specs / 34 tests / 30.5 pts | 1 specs / 29 tests / 29.0 pts |
| pipes | 3 specs / 12 tests / 12.0 pts | 3 specs / 12 tests / 12.0 pts | 3 specs / 12 tests / 12.0 pts |
-| real-ui-e2e | 38 specs / 121 tests / 96.1 pts | 40 specs / 108 tests / 85.6 pts | 35 specs / 101 tests / 83.3 pts |
+| real-ui-e2e | 39 specs / 124 tests / 99.1 pts | 41 specs / 111 tests / 88.6 pts | 36 specs / 104 tests / 86.3 pts |
| settings | 13 specs / 33 tests / 30.6 pts | 15 specs / 28 tests / 24.3 pts | 12 specs / 25 tests / 22.6 pts |
| storage-privacy | 6 specs / 21 tests / 20.1 pts | 5 specs / 13 tests / 12.1 pts | 4 specs / 13 tests / 12.1 pts |
| tauri-command | 10 specs / 19 tests / 12.3 pts | 10 specs / 20 tests / 11.8 pts | 9 specs / 18 tests / 11.3 pts |
@@ -122,6 +122,7 @@ pass/fail/skip counts.
| chat-tool-activity.spec.ts | windows, macos, linux | chat-ai, real-ui-e2e | chat, chat-tools, pi-tool-activity, progressive-disclosure | high | strong | mixed | 3 | Mixed Python, JavaScript, Screenpipe API, file, test, recovered-error, and optional live Pi tool flows stay collapsed by default, expose only friendly activity on first expansion, and capture screenshots. |
| chat-window.spec.ts | windows, macos, linux | chat-ai, window-lifecycle, real-ui-e2e | chat, window-lifecycle | high | strong | real-user-flow | 1 | Opens Chat and focuses the composer for typing. |
| chat-within-session-context-loss.spec.ts | macos | chat-ai | chat, chat-context | medium | conditional | synthetic | 1 | macOS-only within-chat context retention regression. |
+| first-run-guide.spec.ts | windows, macos, linux | onboarding, chat-ai, real-ui-e2e | onboarding, chat, first-run-guide | high | strong | real-user-flow | 3 | Replayed first-run guide verifies the composer remains focused and clickable above its scrim, fails open when stacking defeats the lift, and remembers decline across reloads. |
| focus-server.spec.ts | windows, macos, linux | local-api, window-lifecycle, tauri-command | window-lifecycle, focus-server, deeplink | medium | partial | api | 2 | Focus server opens windows and forwards deeplink args. |
| hd-recording-pipeline.spec.ts | macos | capture-ocr, local-api, performance | capture-ocr, hd-recording, timeline | high | conditional | api | 1 | Opt-in macOS HD capture and OCR indexing. |
| help-discord-link.spec.ts | windows, macos, linux | real-ui-e2e | help | low | smoke | real-user-flow | 2 | Help section Discord invite link. |
diff --git a/apps/screenpipe-app-tauri/e2e/coverage-map.json b/apps/screenpipe-app-tauri/e2e/coverage-map.json
index 3ab72eecd..8c7484c48 100644
--- a/apps/screenpipe-app-tauri/e2e/coverage-map.json
+++ b/apps/screenpipe-app-tauri/e2e/coverage-map.json
@@ -404,6 +404,16 @@
"ux": "synthetic",
"notes": "macOS-only within-chat context retention regression."
},
+ {
+ "spec": "first-run-guide.spec.ts",
+ "platforms": ["windows", "macos", "linux"],
+ "layers": ["onboarding", "chat-ai", "real-ui-e2e"],
+ "features": ["onboarding", "chat", "first-run-guide"],
+ "criticality": "high",
+ "confidence": "strong",
+ "ux": "real-user-flow",
+ "notes": "Replayed first-run guide verifies the composer remains focused and clickable above its scrim, fails open when stacking defeats the lift, and remembers decline across reloads."
+ },
{
"spec": "focus-server.spec.ts",
"platforms": ["windows", "macos", "linux"],
diff --git a/apps/screenpipe-app-tauri/e2e/specs/chat-sidebar-pipe-inventory.spec.ts b/apps/screenpipe-app-tauri/e2e/specs/chat-sidebar-pipe-inventory.spec.ts
index 2d2e49df3..a0e219ef3 100644
--- a/apps/screenpipe-app-tauri/e2e/specs/chat-sidebar-pipe-inventory.spec.ts
+++ b/apps/screenpipe-app-tauri/e2e/specs/chat-sidebar-pipe-inventory.spec.ts
@@ -219,6 +219,9 @@ describe("chat sidebar pipe inventory", function () {
before(async () => {
await waitForAppReady();
await openHomeWindow();
+ // A prior failed/retried spec may have materialized this execution. Start
+ // from the metadata-only path so opening the row must fetch full output.
+ rmSync(GENERATED_RUN_CHAT, { force: true });
mkdirSync(PIPE_DIR, { recursive: true });
mkdirSync(CHATS_DIR, { recursive: true });
writeFileSync(
@@ -327,8 +330,10 @@ describe("chat sidebar pipe inventory", function () {
},
);
+ // Click the actual row control. Clicking the wrapper relies on its center
+ // hit-testing into this child, which is not consistent on WebKitGTK.
const newestRun = await $(
- `[data-testid="chat-row-pipe:${PIPE_NAME}:12"]`,
+ `[data-testid="chat-row-pipe:${PIPE_NAME}:12"] > button`,
);
await newestRun.click();
await browser.waitUntil(