Record your screen, ship a demo. Free and open-source, GPU-accelerated, no watermarks, no subscriptions. Windows, macOS, Linux. Actively maintained.
TypeScript cross-platformelectronffmpegopen-sourceproduct-demorustscreen-capturescreen-recorderscreen-recordingscreen-studioscreencastspeech-to-texttypescriptvideo-editingvideo-editorwaylandwgpuwhisper
docs(testing): record the mcp launch issue as #1214, fixed after this build
Etienne Lescota4017ae00af4
diff --git a/technical-documentation/testing/manual-e2e-checklist.md b/technical-documentation/testing/manual-e2e-checklist.mdindex 98b01bb79..06ef39493 100644--- a/technical-documentation/testing/manual-e2e-checklist.md+++ b/technical-documentation/testing/manual-e2e-checklist.md@@ -969,4 +969,4 @@ These checks are the human slice: an agent cannot click Apple's picker (see abov| 2026-10-14 | `main` @ `61fa43812` (includes #1227, #1228, #1229, the fixes for #1215, #1214, #1216), CI artifact `openscreen-mac-arm64` from build run 38615516865, DMG signed and notarized (`spctl`: accepted, Notarized Developer ID, M4LK7C6S84); `app.asar` and the capture helper carry the new code; About `2.0.0 (dmg)` | macOS 26.5 (25F71), Mac mini M1 (arm64), one 3840×2160 display at 2× | **Pass on the three fixes, 1 new defect, 1 leftover** | Real OS input through computer-use for the Finder launch; MCP calls from SDK clients (stdio to `Openscreen mcp`, StreamableHTTP to the in-app server); numbers are ffprobe/ffmpeg on the files. Every OpenScreen process was quit first, another session's `Openscreen mcp` of an older build included, so no old binary could take the launch. **#1214:** with an `Openscreen mcp` client session open and no GUI, `open /Applications/Openscreen.app` brings the recording bar up in about 1 s (was: exit 0 and nothing); two quick `open`s with the GUI running leave one GUI; after a quit, a double-click on OpenScreen in Finder's Applications opens the bar. **#1215:** a GIF export (`gifSize: "small"`, 778×480) read by `getFrames` through the stdio server by `projectId` (1, 6, 11 s on the ruler) and by `path`, and through the in-app server by `projectId`, gives frames of distinct moments (was "media error 4"). **#1216:** a window take of a Finder window with `systemAudio: true` while `afplay` plays speech reads −10.0 dB mean through the stdio server and −10.0 dB through the in-app server under `legacy` (was −91 dB), video 1840×872, the window only. **New defect (P1 for the in-app server on macOS 15.2+):** on a default launch (no `OPENSCREEN_MAC_SOURCE_PICKER`), in-app `startRecording` with `window` ignores the window and opens Apple's picker ("Share a Window or Entire Screen"), which waits for a click, so the call fails after 120 s with "capture had not started"; the picker then stays on screen after the timeout, and even after the app quits, until someone presses Cancel. The stdio server and a `legacy` launch are not affected (4.3 s to start). **Leftover from #1214:** the `Openscreen mcp` process turns from `UIElement` to `Foreground` within 0.3 s of the launch LaunchServices hands it, and keeps a second OpenScreen icon in the Dock; a click on it is an `activate`, so it opens the GUI rather than nothing. A bare hidden Electron 41 with the same handler, with or without a hidden window, stays `UIElement`, so the cause is in the app's CLI process and not found yet. **Not covered:** the two failure paths of #1229's audio stream (ScreenCaptureKit was not made to refuse it). || 2026-10-14 | `main` @ `4f4bb997c` (includes #1237 and #1239, the fixes for #1232 and #1233), CI artifact `openscreen-mac-arm64` from build run 38627769728, DMG signed and notarized (`spctl`: accepted, Notarized Developer ID, M4LK7C6S84); About `2.0.0 (dmg)` | macOS 26.5 (25F71), Mac mini M1 (arm64), one 3840×2160 display at 2× | **Pass, scoped to #1232 and #1233** | Every OpenScreen process quit before the install, other sessions' `Openscreen mcp` included; MCP calls from SDK clients; numbers are ffprobe/ffmpeg on the files. **#1233:** with an `Openscreen mcp` client session open and no GUI, `open /Applications/Openscreen.app` starts the GUI and the `mcp` process stays `UIElement` at 0.5, 2.5 and 8.5 s (was `Foreground` within 0.3 s, with its own Dock icon). The two OpenScreen icons left in the Dock carry no running dot once the GUI quits: they are the Dock's recent-apps entries, not processes. **#1232:** on a default launch (no `OPENSCREEN_MAC_SOURCE_PICKER`, so Apple's picker owns the bar's sources), in-app `startRecording` with `window` and `systemAudio: true` returns in 5.0 s with no picker window on screen (was a 120 s timeout and a picker left behind); the take is the window only, 1840×872, system audio at −10.3 dB, and `stopRecording` returns in 2.7 s. **Not covered:** the refusal message when Screen Recording is denied (the grant was not revoked on this Mac). || 2026-10-14 | dev, local branch `test/shader-fx-macos-e2e`: `feat/shader-effects-macos` (the Metal pass) with #1202 merged in locally, never pushed, plus a local-only line that writes each export's scene to a file. Compositor addon rebuilt from that tree (string probe `no Metal device` HIT, control `wallpaper image` HIT), `npm run build-vite` | macOS 26.5 (25F71), Mac mini M1, on mains power | Partial: agent-written shader effects only, pass | Headless, so no computer-use: `electron . --user-data-dir=<test profile> mcp` over stdio, and the addon loaded in Node for the live view (`createView`, `setScene`, `setParam` as `pushAllNativeParams` does, `presentTime`, `readFrame`). A 6 s 1920×1080 test pattern with a hand-written `.cursor.json` of three clicks. **Agent loop:** `addEffect` with a typo refused in 6 ms at the agent's line 10; the C.6 ripple accepted in 152 ms, real Metal compile included, `validated: true`, tier light; `exportVideo` then `getFrames` show the ripple after each click and nothing at 0.5 s. **Preview against export** (BT.709): 3.1/255 over the whole frame with the effect, 3.0 without; on the pixels the effect changes, 13 to 16/255 against the export with the effect and 14 to 16 against the one without on the same pixels with no effect, which is the codec on sharp edges (two exports of the same project decode to identical pixels). The live view held 29.7 fps against the 30 fps source with and without. **Export** of 180 frames at 1752×1080: 2469 ms without, 2428 with the ripple, 2375 with a heavier effect. **Driver note:** without the `setParam` calls the editor makes, the headless view draws the cursor at its default size, which reads as a preview/export mismatch. Not run: real capture, the editor UI (effects have no track until the UI PR), the in-app agent, a `text`-target effect over a real caption (`an_annotation_stays_out_of_image_effects_and_inside_text_effects` covers the routing of a figure annotation on the Metal device, not a caption). |-| 2026-10-15 | installed `v2.1.0` candidate, `release/v2.1.0` @ `912b44800`, CI-built DMG `Openscreen-macOS-Apple-Silicon-2.0.0.dmg` from build run 38370716184 (`openscreen-mac-arm64`), Developer ID signed and notarized (`spctl`: accepted, Notarized Developer ID, M4LK7C6S84), installed over `/Applications/Openscreen.app`. `release/v2.1.0` has since moved to `a6cd941f3` with the shader-effects integration, so this build is not its current head | macOS 26.5 (25F71), Mac mini M1 (arm64), one 3840×2160 display at 2×, no camera (MDM), BlackHole 2ch as the only input | Partial, 1 defect | **Targeted at the fixes that reached the release after `bd04d3a7`**, real OS mouse and keyboard through computer-use, launched with `OPENSCREEN_DIAGNOSTIC=1` and `OPENSCREEN_MAC_SOURCE_PICKER=legacy`; numbers are ffprobe/ffmpeg on the files. **Passed:** #1136, a HUD dropped at the top (bar y≈60) moves down while the language menu is open and returns to y≈60 when it closes; #1135, typing in Open project until one result is left highlights it and Enter opens it; #1138, with the project open in the editor stdio `listProjects` reports `open:true` and an `addTrim` after `createCheckpoint` is refused ("this project is open in the OpenScreen editor ..."); #1133/#1144, an identical 1.80x zoom dragged into another stops flush (16947 ms against 16947 ms, length 1727 ms kept), and changing the level of one half changes only that one and splits the pill (#1017); #1134, the first message of a new conversation shows 11:46:52 AM, not a raw ISO time; #1137/#1145, the running `Openscreen mcp` holds its own `cli-sessions/<pid>-.../Local Storage` lock while only the GUI holds the GUI's, and a GUI switched to German then relaunched with that server still running comes back in German with no language prompt; #1140/#1150, `startRecording` on a missing window answers that minimized, hidden, other-Space and behind-full-screen windows are not listed; #1141, the shipped `stopRecording` description reads "Not one per click ..."; `2c978f3c`, the 7-trim speech project exports 3651 frames at 60 fps against an exact 3652.7 for its kept 60.879 s (a per-span ceil would give 3657), audio and video within 16 ms. **Defect:** while `Openscreen mcp` runs (an agent connected over stdio), opening OpenScreen from the Dock or Finder (`open -a`) does not start the app: LaunchServices activates the headless MCP process, which shows a bare Electron menu ("Quit openscreen") and no HUD, editor or tray icon; only `open -n` started the GUI; medium. **Observations:** the agent's `setZoom` stretching one of two touching identical zooms into the other merges them (the twin is removed, one undo restores it), which reads as a merge of one pill rather than a defect; the `startRecording` refusal carries a JavaScript stack trace after its message; the export above is 1.7 frames (29 ms) short of the exact kept duration. **Skipped:** `13366eba` and `85aeaf08` (Windows WGC helper only); the rest of the file (rows above and the 2026-10-14 macOS row on `main`). |+| 2026-10-15 | installed `v2.1.0` candidate, `release/v2.1.0` @ `912b44800`, CI-built DMG `Openscreen-macOS-Apple-Silicon-2.0.0.dmg` from build run 38370716184 (`openscreen-mac-arm64`), Developer ID signed and notarized (`spctl`: accepted, Notarized Developer ID, M4LK7C6S84), installed over `/Applications/Openscreen.app`. `release/v2.1.0` has since moved to `a6cd941f3` with the shader-effects integration, so this build is not its current head | macOS 26.5 (25F71), Mac mini M1 (arm64), one 3840×2160 display at 2×, no camera (MDM), BlackHole 2ch as the only input | Pass, scoped to the fixes listed; no new defect | **Targeted at the fixes that reached the release after `bd04d3a7`**, real OS mouse and keyboard through computer-use, launched with `OPENSCREEN_DIAGNOSTIC=1` and `OPENSCREEN_MAC_SOURCE_PICKER=legacy`; numbers are ffprobe/ffmpeg on the files. **Passed:** #1136, a HUD dropped at the top (bar y≈60) moves down while the language menu is open and returns to y≈60 when it closes; #1135, typing in Open project until one result is left highlights it and Enter opens it; #1138, with the project open in the editor stdio `listProjects` reports `open:true` and an `addTrim` after `createCheckpoint` is refused ("this project is open in the OpenScreen editor ..."); #1133/#1144, an identical 1.80x zoom dragged into another stops flush (16947 ms against 16947 ms, length 1727 ms kept), and changing the level of one half changes only that one and splits the pill (#1017); #1134, the first message of a new conversation shows 11:46:52 AM, not a raw ISO time; #1137/#1145, the running `Openscreen mcp` holds its own `cli-sessions/<pid>-.../Local Storage` lock while only the GUI holds the GUI's, and a GUI switched to German then relaunched with that server still running comes back in German with no language prompt; #1140/#1150, `startRecording` on a missing window answers that minimized, hidden, other-Space and behind-full-screen windows are not listed; #1141, the shipped `stopRecording` description reads "Not one per click ..."; `2c978f3c`, the 7-trim speech project exports 3651 frames at 60 fps against an exact 3652.7 for its kept 60.879 s (a per-span ceil would give 3657), audio and video within 16 ms. **Known, already fixed:** while `Openscreen mcp` ran, opening OpenScreen from the Dock or Finder (`open -a`) activated the headless MCP process (bare "Quit openscreen" menu, no HUD); that is #1214 and #1233, fixed by `394aebef9`, `a999816b3` and `4f4bb997c`, which landed after `912b44800` and are in `release/v2.1.0` @ `a6cd941f3`, not in this build. **Observations:** the agent's `setZoom` stretching one of two touching identical zooms into the other merges them (the twin is removed, one undo restores it), which reads as a merge of one pill rather than a defect; the `startRecording` refusal carries a JavaScript stack trace after its message; the export above is 1.7 frames (29 ms) short of the exact kept duration. **Skipped:** `13366eba` and `85aeaf08` (Windows WGC helper only); the rest of the file (rows above and the 2026-10-14 macOS row on `main`). |