Skip to content

YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context

fix(ci): map new chat e2e coverage

Louis Beaumont4794b851efb8
diff --git a/apps/screenpipe-app-tauri/e2e/COVERAGE.md b/apps/screenpipe-app-tauri/e2e/COVERAGE.md
index 98b59c5a2..a46eee1ea 100644
--- a/apps/screenpipe-app-tauri/e2e/COVERAGE.md
+++ b/apps/screenpipe-app-tauri/e2e/COVERAGE.md
@@ -6,9 +6,9 @@ and layer declared in the manifest, weighted by confidence and criticality.
- Manifest: `e2e/coverage-map.json`
- Specs directory: `e2e/specs`
-- Mapped specs: 63
-- Declared test blocks: 201
-- Weighted coverage points: 155.9
+- Mapped specs: 65
+- Declared test blocks: 204
+- Weighted coverage points: 157.3
Confidence weights: strong=1.0, partial=0.7, conditional=0.4, smoke=0.3.
Criticality weights: high=1.0, medium=0.7, low=0.4.
@@ -19,9 +19,9 @@ can execute more runtime cases than this number shows.
| Platform | Specs | Declared tests | Weighted points | Layers | Features | Critical score |
| --- | --- | --- | --- | --- | --- | --- |
-| windows | 54 | 188 | 150.9 | 15 | 61 | 92% |
-| macos | 60 | 167 | 128.5 | 17 | 63 | 89% |
-| linux | 46 | 152 | 122.9 | 13 | 58 | 86% |
+| windows | 56 | 191 | 152.4 | 15 | 61 | 92% |
+| macos | 62 | 170 | 129.9 | 17 | 63 | 89% |
+| linux | 48 | 155 | 124.4 | 13 | 58 | 86% |
## Runtime Results
@@ -37,7 +37,7 @@ pass/fail/skip counts.
| auth | - | 1 specs / 1 tests / 1.0 pts | - |
| billing | 4 specs / 5 tests / 4.7 pts | 4 specs / 5 tests / 4.7 pts | 4 specs / 5 tests / 4.7 pts |
| capture-ocr | 2 specs / 14 tests / 5.6 pts | 2 specs / 4 tests / 1.6 pts | 1 specs / 3 tests / 1.2 pts |
-| chat-ai | 12 specs / 20 tests / 12.9 pts | 15 specs / 24 tests / 14.3 pts | 11 specs / 19 tests / 12.4 pts |
+| chat-ai | 14 specs / 23 tests / 14.4 pts | 17 specs / 27 tests / 15.7 pts | 13 specs / 22 tests / 13.9 pts |
| entitlement | - | 1 specs / 1 tests / 1.0 pts | - |
| local-api | 14 specs / 92 tests / 76.6 pts | 13 specs / 67 tests / 57.6 pts | 11 specs / 66 tests / 57.2 pts |
| notifications | 2 specs / 11 tests / 10.1 pts | 2 specs / 4 tests / 2.4 pts | 1 specs / 3 tests / 2.1 pts |
@@ -45,7 +45,7 @@ pass/fail/skip counts.
| os-integration | 4 specs / 16 tests / 15.1 pts | 4 specs / 3 tests / 0.9 pts | - |
| performance | 2 specs / 43 tests / 43.0 pts | 4 specs / 33 tests / 29.5 pts | 1 specs / 28 tests / 28.0 pts |
| pipes | 2 specs / 11 tests / 11.0 pts | 2 specs / 11 tests / 11.0 pts | 2 specs / 11 tests / 11.0 pts |
-| real-ui-e2e | 33 specs / 108 tests / 86.7 pts | 34 specs / 95 tests / 76.2 pts | 30 specs / 89 tests / 74.3 pts |
+| real-ui-e2e | 35 specs / 111 tests / 88.2 pts | 36 specs / 98 tests / 77.7 pts | 32 specs / 92 tests / 75.8 pts |
| settings | 13 specs / 31 tests / 28.6 pts | 14 specs / 25 tests / 21.9 pts | 12 specs / 23 tests / 20.6 pts |
| storage-privacy | 6 specs / 20 tests / 19.1 pts | 5 specs / 12 tests / 11.1 pts | 4 specs / 12 tests / 11.1 pts |
| tauri-command | 8 specs / 17 tests / 10.3 pts | 9 specs / 19 tests / 10.8 pts | 8 specs / 17 tests / 10.3 pts |
@@ -100,9 +100,11 @@ pass/fail/skip counts.
| audio-fallback.spec.ts | macos | audio-device, settings, notifications | audio-device-health, settings-recording, notifications | medium | conditional | real-user-flow | 1 | Opt-in macOS cloud audio fallback seed. |
| brain-section.spec.ts | windows, macos, linux | real-ui-e2e | brain, artifacts, memories, viewer-deeplink | medium | strong | real-user-flow | 10 | Brain coverage for filters, search, delete flows, selection pruning, add memory, and inline artifact markdown preview. |
| chat-ask-user-tool-card.spec.ts | windows, macos, linux | chat-ai, real-ui-e2e | chat, chat-tools, pi-ask-user | medium | partial | mixed | 1 | Synthetic assistant tool block renders the Pi ask_user dropdown and sends the selected answer through the normal chat reply path. |
+| chat-automation-card-duplicate.spec.ts | windows, macos, linux | chat-ai, real-ui-e2e | chat, chat-sidebar-dedupe | medium | partial | real-user-flow | 1 | Home automation card clicks must create exactly one persisted conversation per card, guarding the #4719 duplicate-row path. |
| chat-composer-isolation.spec.ts | windows, macos, linux | chat-ai, real-ui-e2e | chat, chat-drafts | medium | partial | mixed | 1 | Composer draft isolation across conversations. |
| chat-connections-context-duplicate.spec.ts | windows, macos | chat-ai | chat, chat-sidebar-dedupe | medium | partial | synthetic | 1 | QUARANTINED (#4689): connections-context wrapper stripping regression. The synthetic background-router event path never persists deterministically on Linux/macOS CI; re-enable once it drives a deterministic persisted session. |
| chat-newchat-duplicate.spec.ts | windows, macos, linux | chat-ai | chat, chat-sidebar-dedupe | medium | partial | synthetic | 1 | Synthetic chat event regression for duplicate sidebar rows. |
+| chat-newchat-fresh.spec.ts | windows, macos, linux | chat-ai, real-ui-e2e | chat, chat-drafts | medium | partial | real-user-flow | 2 | The real new-chat shortcut opens a fresh chat from non-empty conversations and reuses one blank chat when pressed repeatedly. |
| chat-parallel-jobs-duplicate.spec.ts | windows, macos, linux | chat-ai | chat, chat-sidebar-dedupe | medium | partial | synthetic | 1 | Parallel auto-send prefill dedupe regression. |
| chat-prefill-context-leak.spec.ts | windows, macos, linux | chat-ai | chat, chat-prefill | medium | partial | synthetic | 1 | Pending auto-send prefill must render only the clean prompt, not the internal model context, as the user message. |
| chat-prefill-duplicate.spec.ts | macos | chat-ai | chat, chat-prefill | medium | partial | synthetic | 1 | QUARANTINED (#4610): cross-window prefill duplicate regression. The autoSend persist precondition is racy in CI — times out with 0 conversations (not the duplicate=2 it guards) ~100% Linux + ~33% macOS. Re-enable once it seeds the persisted conversation deterministically. |
diff --git a/apps/screenpipe-app-tauri/e2e/coverage-map.json b/apps/screenpipe-app-tauri/e2e/coverage-map.json
index 8ef7bb014..305e613c7 100644
--- a/apps/screenpipe-app-tauri/e2e/coverage-map.json
+++ b/apps/screenpipe-app-tauri/e2e/coverage-map.json
@@ -192,6 +192,16 @@
"ux": "mixed",
"notes": "Synthetic assistant tool block renders the Pi ask_user dropdown and sends the selected answer through the normal chat reply path."
},
+ {
+ "spec": "chat-automation-card-duplicate.spec.ts",
+ "platforms": ["windows", "macos", "linux"],
+ "layers": ["chat-ai", "real-ui-e2e"],
+ "features": ["chat", "chat-sidebar-dedupe"],
+ "criticality": "medium",
+ "confidence": "partial",
+ "ux": "real-user-flow",
+ "notes": "Home automation card clicks must create exactly one persisted conversation per card, guarding the #4719 duplicate-row path."
+ },
{
"spec": "chat-newchat-duplicate.spec.ts",
"platforms": ["windows", "macos", "linux"],
@@ -202,6 +212,16 @@
"ux": "synthetic",
"notes": "Synthetic chat event regression for duplicate sidebar rows."
},
+ {
+ "spec": "chat-newchat-fresh.spec.ts",
+ "platforms": ["windows", "macos", "linux"],
+ "layers": ["chat-ai", "real-ui-e2e"],
+ "features": ["chat", "chat-drafts"],
+ "criticality": "medium",
+ "confidence": "partial",
+ "ux": "real-user-flow",
+ "notes": "The real new-chat shortcut opens a fresh chat from non-empty conversations and reuses one blank chat when pressed repeatedly."
+ },
{
"spec": "chat-sidebar-stub-dedup.spec.ts",
"platforms": ["windows", "macos", "linux"],