Skip to content

YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context

fix(meetings): keep replay controls below video

Louis Beaumont57c519b44ea0
diff --git a/COVERAGE.md b/COVERAGE.md
index b19dfb748..3adb5417c 100644
--- a/COVERAGE.md
+++ b/COVERAGE.md
@@ -22,15 +22,15 @@ results and `cargo llvm-cov` data on top when judging release confidence.
### Tauri E2E
-- Mapped specs: 136
-- Declared test blocks: 390
-- Weighted coverage points: 311.1
+- Mapped specs: 137
+- Declared test blocks: 391
+- Weighted coverage points: 312.1
| Platform | Specs | Declared tests | Weighted points | Layers | Features | Critical score |
| --- | --- | --- | --- | --- | --- | --- |
-| windows | 105 | 333 | 276.1 | 15 | 118 | 88% |
-| macos | 132 | 352 | 280.9 | 17 | 126 | 87% |
-| linux | 93 | 291 | 245.5 | 14 | 115 | 84% |
+| windows | 106 | 334 | 277.1 | 15 | 118 | 88% |
+| macos | 133 | 353 | 281.9 | 17 | 126 | 87% |
+| linux | 94 | 292 | 246.5 | 14 | 115 | 84% |
### Core Engine
diff --git a/apps/screenpipe-app-tauri/components/meeting-notes/replay-strip.test.tsx b/apps/screenpipe-app-tauri/components/meeting-notes/replay-strip.test.tsx
index 759258727..03f977f1d 100644
--- a/apps/screenpipe-app-tauri/components/meeting-notes/replay-strip.test.tsx
+++ b/apps/screenpipe-app-tauri/components/meeting-notes/replay-strip.test.tsx
@@ -209,6 +209,29 @@ describe("ReplayStrip", () => {
expect(container.querySelector("audio, video")).toBeNull();
});
+ it("reserves a separate row for controls below the captured frame", async () => {
+ mocks.fetchFrameSamples.mockResolvedValue([
+ { frameId: 1, timestamp: transcriptAt },
+ { frameId: 2, timestamp: secondFrameAt },
+ ]);
+
+ renderReplayStrip();
+
+ await waitFor(() =>
+ expect(screen.getByTestId("replay-active-frame")).toHaveAttribute(
+ "data-frame-id",
+ "1",
+ ),
+ );
+
+ const viewport = screen.getByTestId("replay-frame-viewport");
+ const controls = screen.getByTestId("replay-controls");
+ expect(viewport.parentElement).toBe(controls.parentElement);
+ expect(viewport.className).toContain("flex-1");
+ expect(controls.className).toContain("shrink-0");
+ expect(controls.className).not.toContain("absolute");
+ });
+
it("still shows the earliest frame when the cursor precedes the first capture", async () => {
// Meeting bounds are padded (meeting_start can be minutes before the
// first captured frame). Seeking to the very start must not blank the
diff --git a/apps/screenpipe-app-tauri/components/meeting-notes/replay-strip.tsx b/apps/screenpipe-app-tauri/components/meeting-notes/replay-strip.tsx
index b2e8893c3..550439367 100644
--- a/apps/screenpipe-app-tauri/components/meeting-notes/replay-strip.tsx
+++ b/apps/screenpipe-app-tauri/components/meeting-notes/replay-strip.tsx
@@ -528,27 +528,35 @@ export function ReplayStrip({ meetingId, segments, timeRange }: ReplayStripProps
<div className="border border-border bg-muted/10">
{/* Big active frame */}
- <div className="relative aspect-video bg-background flex items-center justify-center overflow-hidden border-b border-border">
- {framesLoading ? (
- <Loader2 className="h-4 w-4 animate-spin text-muted-foreground" />
- ) : activeFrame ? (
- // eslint-disable-next-line @next/next/no-img-element
- <img
- key={activeFrame.frameId}
- data-testid="replay-active-frame"
- data-frame-id={activeFrame.frameId}
- src={appendAuthToken(`${getApiBaseUrl()}/frames/${activeFrame.frameId}`)}
- alt={`screen at ${formatClock(activeFrame.timestamp)}`}
- className="max-w-full max-h-full object-contain"
- onError={() => markFrameUnavailable(activeFrame.frameId)}
- />
- ) : (
- <span className="text-[11px] text-muted-foreground p-6">
- no screen images available during this meeting
- </span>
- )}
+ <div className="relative aspect-video bg-background flex flex-col overflow-hidden border-b border-border">
+ <div
+ data-testid="replay-frame-viewport"
+ className="flex min-h-0 flex-1 items-center justify-center overflow-hidden"
+ >
+ {framesLoading ? (
+ <Loader2 className="h-4 w-4 animate-spin text-muted-foreground" />
+ ) : activeFrame ? (
+ // eslint-disable-next-line @next/next/no-img-element
+ <img
+ key={activeFrame.frameId}
+ data-testid="replay-active-frame"
+ data-frame-id={activeFrame.frameId}
+ src={appendAuthToken(`${getApiBaseUrl()}/frames/${activeFrame.frameId}`)}
+ alt={`screen at ${formatClock(activeFrame.timestamp)}`}
+ className="max-w-full max-h-full object-contain"
+ onError={() => markFrameUnavailable(activeFrame.frameId)}
+ />
+ ) : (
+ <span className="text-[11px] text-muted-foreground p-6">
+ no screen images available during this meeting
+ </span>
+ )}
+ </div>
- <div className="absolute inset-x-0 bottom-0 flex h-10 items-center gap-2 border-t border-white/15 bg-black/75 px-2.5 text-white backdrop-blur-sm">
+ <div
+ data-testid="replay-controls"
+ className="flex h-10 shrink-0 items-center gap-2 border-t border-white/15 bg-black/75 px-2.5 text-white backdrop-blur-sm"
+ >
<button
type="button"
data-testid="replay-play-toggle"
diff --git a/apps/screenpipe-app-tauri/e2e/COVERAGE.md b/apps/screenpipe-app-tauri/e2e/COVERAGE.md
index 48b814486..8ee9a90c6 100644
--- a/apps/screenpipe-app-tauri/e2e/COVERAGE.md
+++ b/apps/screenpipe-app-tauri/e2e/COVERAGE.md
@@ -10,9 +10,9 @@ and layer declared in the manifest, weighted by confidence and criticality.
- Manifest: `e2e/coverage-map.json`
- Specs directory: `e2e/specs`
-- Mapped specs: 136
-- Declared test blocks: 390
-- Weighted coverage points: 311.1
+- Mapped specs: 137
+- Declared test blocks: 391
+- Weighted coverage points: 312.1
Confidence weights: strong=1.0, partial=0.7, conditional=0.4, smoke=0.3.
Criticality weights: high=1.0, medium=0.7, low=0.4.
@@ -23,9 +23,9 @@ can execute more runtime cases than this number shows.
| Platform | Specs | Declared tests | Weighted points | Layers | Features | Critical score |
| --- | --- | --- | --- | --- | --- | --- |
-| windows | 105 | 333 | 276.1 | 15 | 118 | 88% |
-| macos | 132 | 352 | 280.9 | 17 | 126 | 87% |
-| linux | 93 | 291 | 245.5 | 14 | 115 | 84% |
+| windows | 106 | 334 | 277.1 | 15 | 118 | 88% |
+| macos | 133 | 353 | 281.9 | 17 | 126 | 87% |
+| linux | 94 | 292 | 246.5 | 14 | 115 | 84% |
## Runtime Results
@@ -41,7 +41,7 @@ pass/fail/skip counts.
| auth | - | 1 specs / 1 tests / 1.0 pts | - |
| billing | 4 specs / 6 tests / 5.7 pts | 4 specs / 6 tests / 5.7 pts | 4 specs / 6 tests / 5.7 pts |
| capture-ocr | 2 specs / 16 tests / 6.4 pts | 8 specs / 12 tests / 4.8 pts | 1 specs / 3 tests / 1.2 pts |
-| chat-ai | 36 specs / 83 tests / 67.3 pts | 50 specs / 112 tests / 86.8 pts | 34 specs / 82 tests / 66.8 pts |
+| chat-ai | 37 specs / 84 tests / 68.3 pts | 51 specs / 113 tests / 87.8 pts | 35 specs / 83 tests / 67.8 pts |
| entitlement | - | 1 specs / 1 tests / 1.0 pts | - |
| local-api | 28 specs / 117 tests / 98.0 pts | 37 specs / 110 tests / 93.5 pts | 23 specs / 85 tests / 76.2 pts |
| notifications | 4 specs / 26 tests / 17.3 pts | 3 specs / 5 tests / 3.4 pts | 2 specs / 4 tests / 3.1 pts |
@@ -49,11 +49,11 @@ pass/fail/skip counts.
| os-integration | 7 specs / 32 tests / 26.9 pts | 14 specs / 29 tests / 17.4 pts | 2 specs / 15 tests / 10.8 pts |
| performance | 3 specs / 45 tests / 45.0 pts | 5 specs / 36 tests / 31.8 pts | 2 specs / 30 tests / 30.0 pts |
| pipes | 6 specs / 20 tests / 20.0 pts | 8 specs / 26 tests / 26.0 pts | 6 specs / 20 tests / 20.0 pts |
-| real-ui-e2e | 78 specs / 231 tests / 194.9 pts | 94 specs / 245 tests / 205.9 pts | 72 specs / 207 tests / 180.9 pts |
+| real-ui-e2e | 79 specs / 232 tests / 195.9 pts | 95 specs / 246 tests / 206.9 pts | 73 specs / 208 tests / 181.9 pts |
| settings | 15 specs / 42 tests / 39.0 pts | 17 specs / 36 tests / 31.7 pts | 14 specs / 33 tests / 30.0 pts |
| storage-privacy | 10 specs / 44 tests / 35.3 pts | 10 specs / 29 tests / 28.1 pts | 7 specs / 22 tests / 21.1 pts |
| tauri-command | 22 specs / 60 tests / 46.9 pts | 32 specs / 78 tests / 60.3 pts | 21 specs / 61 tests / 47.8 pts |
-| window-lifecycle | 21 specs / 69 tests / 57.5 pts | 21 specs / 49 tests / 34.9 pts | 15 specs / 42 tests / 32.4 pts |
+| window-lifecycle | 22 specs / 70 tests / 58.5 pts | 22 specs / 50 tests / 35.9 pts | 16 specs / 43 tests / 33.4 pts |
## Critical Feature Matrix
@@ -190,7 +190,7 @@ pass/fail/skip counts.
| meeting-note-bottom-click.spec.ts | windows, macos, linux | real-ui-e2e, local-api | meeting-notes | high | strong | real-user-flow | 3 | Seeds and opens a long meeting note, checks editor shell click focus behavior, then clicks the bottom editor line. |
| meeting-overlay-pin.spec.ts | macos | real-ui-e2e, local-api, tauri-command, os-integration | meeting-notes, meeting-overlay-stream, shortcut-overlay | medium | partial | real-user-flow | 1 | Pins the native macOS live-transcript card against a real started meeting: it opens on hover, stays visible after the pointer leaves, and the authoritative stop edge hides it and clears the pin, asserted on the AppKit panel's observed visibility. Hover and the pin toggle are driven through the controller entry points the tracking area and pin button use, because AppKit delivers no synthetic hover to a nonactivating panel. The Windows/Linux reminder webview renders the sign-in gate under E2E seeds, so that surface is covered by component tests instead. |
| meeting-overlay-stream.spec.ts | windows, macos, linux | local-api, tauri-command | meeting-notes, meeting-overlay-stream | high | strong | mixed | 1 | Starts a real isolated meeting, verifies bounded snapshot plus deterministic delta/final transcript frames, and proves the stream clears on the authoritative stop edge. |
-| meeting-replay-player.spec.ts | windows, macos, linux | real-ui-e2e, local-api | meeting-notes, meeting-replay | high | strong | real-user-flow | 1 | Seeds four stored frames, wraps their exact timestamps in an ended meeting, reopens it from the previous-meetings list, and verifies deduped silent playback, pause stability, and a review screenshot. |
+| meeting-replay-player.spec.ts | windows, macos, linux | real-ui-e2e, local-api | meeting-notes, meeting-replay | high | strong | real-user-flow | 1 | Seeds four stored frames, wraps their exact timestamps in an ended meeting, reopens it from the previous-meetings list, and verifies deduped silent playback, pause stability, unobscured frame layout, and a review screenshot. |
| meeting-restart-live-transcription.spec.ts | windows, macos, linux | real-ui-e2e, local-api | meeting-notes | high | strong | command | 1 | Opens an auto-detected meeting, runs the full stop_screenpipe/spawn_screenpipe restart the health overlay's RESTART button uses, and asserts the meeting is still open afterwards so live transcription has something to reattach to. |
| meeting-summary-recovery.spec.ts | windows, macos, linux | real-ui-e2e, local-api | meeting-notes, meeting-summary-recovery | high | strong | real-user-flow | 1 | Runs an ended meeting through real Stop -> Resume -> Stop transitions in the isolated desktop, holds both mutations to prove their pending receipts, reconciles a delayed stale started event, and captures saved-finalizing, transcript, resumed-live, the anchored Notes receipt, the Summary draft surface, ready, and failed states without launching hosted AI. |
| meeting-workspace-tabs.spec.ts | windows, macos, linux | real-ui-e2e, local-api | meeting-notes | high | strong | real-user-flow | 1 | Seeds a live meeting with notes and summary, proves the saved summary is the preferred outcome view, switches persistent tabs, resizes to 640x560, checks footer separation and horizontal overflow, captures a review screenshot, then stops from the transcript and verifies the Summary tab opens. |
diff --git a/apps/screenpipe-app-tauri/e2e/coverage-map.json b/apps/screenpipe-app-tauri/e2e/coverage-map.json
index 65a495613..d7a3e1b9a 100644
--- a/apps/screenpipe-app-tauri/e2e/coverage-map.json
+++ b/apps/screenpipe-app-tauri/e2e/coverage-map.json
@@ -2072,7 +2072,7 @@
"criticality": "high",
"confidence": "strong",
"ux": "real-user-flow",
- "notes": "Seeds four stored frames, wraps their exact timestamps in an ended meeting, reopens it from the previous-meetings list, and verifies deduped silent playback, pause stability, and a review screenshot."
+ "notes": "Seeds four stored frames, wraps their exact timestamps in an ended meeting, reopens it from the previous-meetings list, and verifies deduped silent playback, pause stability, unobscured frame layout, and a review screenshot."
},
{
"spec": "meeting-restart-live-transcription.spec.ts",
diff --git a/apps/screenpipe-app-tauri/e2e/specs/meeting-replay-player.spec.ts b/apps/screenpipe-app-tauri/e2e/specs/meeting-replay-player.spec.ts
index 42de14b65..cdf41d714 100644
--- a/apps/screenpipe-app-tauri/e2e/specs/meeting-replay-player.spec.ts
+++ b/apps/screenpipe-app-tauri/e2e/specs/meeting-replay-player.spec.ts
@@ -180,6 +180,38 @@ describe("historical meeting silent replay player", function () {
}, player)) as { audio: number; video: number; silentLabel: boolean };
expect(media).toEqual({ audio: 0, video: 0, silentLabel: true });
+ const replayLayout = (await browser.execute((element: HTMLElement) => {
+ const frame = element.querySelector<HTMLElement>(
+ '[data-testid="replay-active-frame"]',
+ );
+ const viewport = element.querySelector<HTMLElement>(
+ '[data-testid="replay-frame-viewport"]',
+ );
+ const controls = element.querySelector<HTMLElement>(
+ '[data-testid="replay-controls"]',
+ );
+ if (!frame || !viewport || !controls) return null;
+ const frameRect = frame.getBoundingClientRect();
+ const viewportRect = viewport.getBoundingClientRect();
+ const controlsRect = controls.getBoundingClientRect();
+ return {
+ frameBottom: frameRect.bottom,
+ viewportBottom: viewportRect.bottom,
+ controlsTop: controlsRect.top,
+ };
+ }, player)) as {
+ frameBottom: number;
+ viewportBottom: number;
+ controlsTop: number;
+ } | null;
+ expect(replayLayout).not.toBeNull();
+ expect(replayLayout!.frameBottom).toBeLessThanOrEqual(
+ replayLayout!.controlsTop + 1,
+ );
+ expect(replayLayout!.viewportBottom).toBeLessThanOrEqual(
+ replayLayout!.controlsTop + 1,
+ );
+
const thumbnailIds = (await browser.execute((element: HTMLElement) => {
return Array.from(
element.querySelectorAll<HTMLElement>("[data-replay-thumbnail]"),