Record your screen, ship a demo. Free and open-source, GPU-accelerated, no watermarks, no subscriptions. Windows, macOS, Linux. Actively maintained.
TypeScript cross-platformelectronffmpegopen-sourceproduct-demorustscreen-capturescreen-recorderscreen-recordingscreen-studioscreencastspeech-to-texttypescriptvideo-editingvideo-editorwaylandwgpuwhisper
docs(preview): record the free-run decode budget and what still falls behind
Etienne Lescot7d9ad96d6bf4
diff --git a/technical-documentation/architecture/preview.md b/technical-documentation/architecture/preview.mdindex b328307e7..75be2fb7d 100644--- a/technical-documentation/architecture/preview.md+++ b/technical-documentation/architecture/preview.md@@ -257,6 +257,16 @@ a new clip). The mapping sits inIt replaced a guess from the wall clock at 1× speed, which inside a 2× speed regionre-seeked the view ten times a second; `useNativePlaybackSync` still makes that guessfor an addon that reports no position.+- **Free-run decodes every source frame.** Inside a speed region the render thread adopts+ `speed ×` the source's frame rate, so the decoder sets the ceiling: 4K at 2× needs 60+ decoded frames a second, at 4× 120. A clip without a camera used to decode its screen+ file a second time for a stand-in webcam decoder, halving that budget; the stand-in is+ now never stepped or sought, and compose takes the screen frame in its place+ (`Player::webcam_frame` in `crates/compositor/src/live.rs`). On an M1, 4K at 2× went from+ 1.2 s of source behind on average in the editor to no lag the counter could measure, and+ from 8 to 57 frames published a second in the bench.+ `cargo run --release --example live_free_run_bench_macos -- <file> <speed>` replays the+ loop and prints the lag.The overlay's rect is kept aligned with the DOM via the same primitives usedelsewhere in the renderer:@@ -356,6 +366,11 @@ was thrown away.path and not for the live view. Editing playback is therefore silent againstthe exported file; users hear audio only when the export runs. There is noflag in this branch that re-routes live audio.+- **Speeds the decoder cannot follow fall behind.** VideoToolbox decodes 4K at about 97+ frames a second on an M1, short of the 120 a 30 fps source needs at 4×. The render thread+ caps a tick at `max_steps` frames and counts at most 0.1 s of clock per tick, so the view+ loses time and the drift watch re-anchors it every 500 ms; skipping ahead to a keyframe+ instead is not implemented.- **Drift under 150 ms is left alone.** The view and the app's clock run independentlyinside the drift watch's tolerance, and a correction is a seek, not a change of pace: aview drifting slowly is re-anchored with a visible step rather than eased back.