YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context
Rust agentsagiaiai-memoryaudio-recordingcomputer-visionhermeshermes-agentllmlocal-ailocal-firstmachine-learningmcpmultimodalopenclawprivacyrewindscreen-recordingspeech-to-textycombinator
Merge branch 'main' into codex/fix-backfill-exact-frame-recovery
Ezra Ellette5e87eecae696
diff --cc docs/COVERAGE.mdindex e89d2183d,1516aff57..8bfd16266--- a/docs/COVERAGE.md+++ b/docs/COVERAGE.md@@@ -37,16 -37,16 +37,26 @@@ results and `cargo llvm-cov` data on to### Core Engine- Mapped suites: 36+- Mapped Rust files: 383+- Active test blocks: 3776+- Ignored/manual test blocks: 170+- Weighted coverage points: 3115.0++| Platform | Suites | Active tests | Ignored tests | Weighted points | Layers | Flows | Critical score |+| --- | --- | --- | --- | --- | --- | --- | --- |+| windows | 32 | 3630 | 156 | 3048.8 | 21 | 11 | 100% |+| macos | 31 | 3656 | 131 | 3037.3 | 22 | 11 | 100% |+| linux | 28 | 3213 | 131 | 2672.1 | 20 | 11 | 100% |+ - Mapped Rust files: 382+ - Active test blocks: 3777+ - Ignored/manual test blocks: 170+ - Weighted coverage points: 3115.7++ | Platform | Suites | Active tests | Ignored tests | Weighted points | Layers | Flows | Critical score |+ | --- | --- | --- | --- | --- | --- | --- | --- |+ | windows | 32 | 3631 | 156 | 3049.4 | 21 | 11 | 100% |+ | macos | 31 | 3657 | 131 | 3037.9 | 22 | 11 | 100% |+ | linux | 28 | 3214 | 131 | 2672.8 | 20 | 11 | 100% |## Refreshdiff --cc docs/coverage/CORE.mdindex fd73b53e8,666af42f8..d50d6a329--- a/docs/coverage/CORE.md+++ b/docs/coverage/CORE.md@@@ -8,11 -8,11 +8,16 @@@ confidence, and criticality- Manifest: `docs/coverage/core-engine-map.json`- Tracked crates: screenpipe-engine, screenpipe-db, screenpipe-sqlite-coordinator, screenpipe-audio, screenpipe-screen, screenpipe-a11y, screenpipe-fs- Mapped suites: 36+- Mapped Rust files: 383+- Active test blocks: 3776+- Ignored/manual test blocks: 170+- Declared test blocks: 3946+- Weighted coverage points: 3115.0+ - Mapped Rust files: 382+ - Active test blocks: 3777+ - Ignored/manual test blocks: 170+ - Declared test blocks: 3947+ - Weighted coverage points: 3115.7Confidence weights: strong=1.0, partial=0.7, conditional=0.4, smoke=0.3.Criticality weights: high=1.0, medium=0.7, low=0.4.@@@ -23,19 -23,19 +28,24 @@@ are explicitly enabled in a runtime lan| Platform | Suites | Active tests | Ignored tests | Weighted points | Layers | Flows | Critical score || --- | --- | --- | --- | --- | --- | --- | --- |+| windows | 32 | 3630 | 156 | 3048.8 | 21 | 11 | 100% |+| macos | 31 | 3656 | 131 | 3037.3 | 22 | 11 | 100% |+| linux | 28 | 3213 | 131 | 2672.1 | 20 | 11 | 100% |+ | windows | 32 | 3631 | 156 | 3049.4 | 21 | 11 | 100% |+ | macos | 31 | 3657 | 131 | 3037.9 | 22 | 11 | 100% |+ | linux | 28 | 3214 | 131 | 2672.8 | 20 | 11 | 100% |## Crate Summary| Crate | Suites | Integration files | Source unit files | Active tests | Ignored tests | Weighted points | Flows || --- | --- | --- | --- | --- | --- | --- | --- |+| screenpipe-engine | 12 | 21 | 127 | 1820 | 52 | 1401.1 | 10 |+| screenpipe-db | 5 | 65 | 26 | 595 | 26 | 566.6 | 9 |+ | screenpipe-engine | 12 | 21 | 127 | 1821 | 52 | 1401.8 | 10 |+ | screenpipe-db | 5 | 64 | 26 | 594 | 26 | 565.6 | 9 || screenpipe-sqlite-coordinator | 1 | 0 | 3 | 27 | 0 | 27.0 | 2 || screenpipe-audio | 7 | 26 | 53 | 675 | 49 | 590.3 | 5 |- | screenpipe-screen | 6 | 9 | 19 | 272 | 9 | 242.3 | 4 |+ | screenpipe-screen | 6 | 9 | 19 | 273 | 9 | 243.3 | 4 || screenpipe-a11y | 4 | 2 | 31 | 384 | 34 | 284.7 | 3 || screenpipe-fs | 1 | 0 | 1 | 3 | 0 | 3.0 | 3 |@@@ -65,25 -65,25 +75,40 @@@ bun run coverage:core -- --llvm-cov-sum| accessibility | 4 suites / 383 active / 35 ignored / 348.0 pts | 4 suites / 422 active / 10 ignored / 342.9 pts | 4 suites / 341 active / 7 ignored / 313.0 pts || audio | 9 suites / 797 active / 50 ignored / 712.3 pts | 8 suites / 791 active / 50 ignored / 708.0 pts | 7 suites / 712 active / 49 ignored / 652.8 pts || audio-device | 2 suites / 234 active / 7 ignored / 210.3 pts | 2 suites / 234 active / 7 ignored / 210.3 pts | 1 suites / 155 active / 6 ignored / 155.0 pts |+| configuration | 2 suites / 151 active / 3 ignored / 136.7 pts | 2 suites / 151 active / 3 ignored / 136.7 pts | 2 suites / 151 active / 3 ignored / 136.7 pts |+| database | 7 suites / 548 active / 22 ignored / 519.6 pts | 7 suites / 548 active / 22 ignored / 519.6 pts | 7 suites / 548 active / 22 ignored / 519.6 pts |+| db-search | 2 suites / 118 active / 9 ignored / 118.0 pts | 2 suites / 118 active / 9 ignored / 118.0 pts | 2 suites / 118 active / 9 ignored / 118.0 pts |+| engine-lifecycle | 6 suites / 254 active / 1 ignored / 229.0 pts | 6 suites / 254 active / 1 ignored / 229.0 pts | 6 suites / 250 active / 9 ignored / 228.1 pts |+| local-api | 3 suites / 476 active / 11 ignored / 336.8 pts | 3 suites / 476 active / 11 ignored / 336.8 pts | 3 suites / 476 active / 11 ignored / 336.8 pts |+| meeting | 6 suites / 1705 active / 24 ignored / 1390.9 pts | 6 suites / 1705 active / 24 ignored / 1390.9 pts | 4 suites / 1356 active / 20 ignored / 1065.6 pts |+| ocr | 4 suites / 137 active / 7 ignored / 127.7 pts | 4 suites / 130 active / 7 ignored / 125.5 pts | 3 suites / 121 active / 6 ignored / 116.5 pts |+| os-integration | 1 suites / 6 active / 0 ignored / 1.7 pts | 1 suites / 6 active / 0 ignored / 1.7 pts | - |+| performance | 13 suites / 1647 active / 80 ignored / 1457.1 pts | 14 suites / 1755 active / 84 ignored / 1500.3 pts | 13 suites / 1647 active / 80 ignored / 1457.1 pts |+| pipes | 1 suites / 539 active / 3 ignored / 377.3 pts | 1 suites / 539 active / 3 ignored / 377.3 pts | 1 suites / 539 active / 3 ignored / 377.3 pts |+| privacy | 5 suites / 1000 active / 42 ignored / 807.4 pts | 5 suites / 1039 active / 17 ignored / 802.3 pts | 5 suites / 958 active / 14 ignored / 772.3 pts |+| real-app | - | 1 suites / 108 active / 4 ignored / 43.2 pts | - |+| speaker | 2 suites / 388 active / 11 ignored / 388.0 pts | 2 suites / 388 active / 11 ignored / 388.0 pts | 2 suites / 388 active / 11 ignored / 388.0 pts |+| storage | 4 suites / 675 active / 39 ignored / 561.0 pts | 4 suites / 675 active / 39 ignored / 561.0 pts | 4 suites / 675 active / 39 ignored / 561.0 pts |+| sync | 1 suites / 539 active / 3 ignored / 377.3 pts | 1 suites / 539 active / 3 ignored / 377.3 pts | 1 suites / 539 active / 3 ignored / 377.3 pts |+ | configuration | 2 suites / 153 active / 3 ignored / 138.7 pts | 2 suites / 153 active / 3 ignored / 138.7 pts | 2 suites / 153 active / 3 ignored / 138.7 pts |+ | database | 7 suites / 547 active / 22 ignored / 518.6 pts | 7 suites / 547 active / 22 ignored / 518.6 pts | 7 suites / 547 active / 22 ignored / 518.6 pts |+ | db-search | 2 suites / 116 active / 9 ignored / 116.0 pts | 2 suites / 116 active / 9 ignored / 116.0 pts | 2 suites / 116 active / 9 ignored / 116.0 pts |+ | engine-lifecycle | 6 suites / 256 active / 1 ignored / 231.0 pts | 6 suites / 256 active / 1 ignored / 231.0 pts | 6 suites / 252 active / 9 ignored / 230.1 pts |+ | local-api | 3 suites / 474 active / 11 ignored / 334.8 pts | 3 suites / 474 active / 11 ignored / 334.8 pts | 3 suites / 474 active / 11 ignored / 334.8 pts |+ | meeting | 6 suites / 1706 active / 24 ignored / 1391.6 pts | 6 suites / 1706 active / 24 ignored / 1391.6 pts | 4 suites / 1357 active / 20 ignored / 1066.3 pts |+ | ocr | 4 suites / 137 active / 7 ignored / 127.7 pts | 4 suites / 130 active / 7 ignored / 125.5 pts | 3 suites / 121 active / 6 ignored / 116.5 pts |+ | os-integration | 1 suites / 6 active / 0 ignored / 1.7 pts | 1 suites / 6 active / 0 ignored / 1.7 pts | - |+ | performance | 13 suites / 1649 active / 80 ignored / 1459.1 pts | 14 suites / 1757 active / 84 ignored / 1502.3 pts | 13 suites / 1649 active / 80 ignored / 1459.1 pts |+ | pipes | 1 suites / 540 active / 3 ignored / 378.0 pts | 1 suites / 540 active / 3 ignored / 378.0 pts | 1 suites / 540 active / 3 ignored / 378.0 pts |+ | privacy | 5 suites / 1002 active / 42 ignored / 809.1 pts | 5 suites / 1041 active / 17 ignored / 804.0 pts | 5 suites / 960 active / 14 ignored / 774.0 pts |+ | real-app | - | 1 suites / 108 active / 4 ignored / 43.2 pts | - |+ | speaker | 2 suites / 388 active / 11 ignored / 388.0 pts | 2 suites / 388 active / 11 ignored / 388.0 pts | 2 suites / 388 active / 11 ignored / 388.0 pts |+ | storage | 4 suites / 674 active / 39 ignored / 560.0 pts | 4 suites / 674 active / 39 ignored / 560.0 pts | 4 suites / 674 active / 39 ignored / 560.0 pts |+ | sync | 1 suites / 540 active / 3 ignored / 378.0 pts | 1 suites / 540 active / 3 ignored / 378.0 pts | 1 suites / 540 active / 3 ignored / 378.0 pts || timeline | 4 suites / 1222 active / 45 ignored / 1001.5 pts | 4 suites / 1222 active / 45 ignored / 1001.5 pts | 4 suites / 1222 active / 45 ignored / 1001.5 pts || transcription | 6 suites / 870 active / 48 ignored / 680.2 pts | 5 suites / 864 active / 48 ignored / 676.0 pts | 5 suites / 864 active / 48 ignored / 676.0 pts |- | ui-events | 4 suites / 816 active / 34 ignored / 619.3 pts | 3 suites / 747 active / 5 ignored / 571.0 pts | 3 suites / 747 active / 5 ignored / 571.0 pts |- | vision-capture | 6 suites / 572 active / 32 ignored / 450.5 pts | 6 suites / 565 active / 32 ignored / 448.3 pts | 5 suites / 556 active / 31 ignored / 439.3 pts |+ | ui-events | 4 suites / 817 active / 34 ignored / 620.0 pts | 3 suites / 748 active / 5 ignored / 571.7 pts | 3 suites / 748 active / 5 ignored / 571.7 pts |+ | vision-capture | 6 suites / 573 active / 32 ignored / 451.5 pts | 6 suites / 566 active / 32 ignored / 449.3 pts | 5 suites / 557 active / 31 ignored / 440.3 pts |## Critical Flow Matrix@@@ -134,15 -134,15 +159,17 @@@| db-audio-meetings-speakers | screenpipe-db | windows, macos, linux | database, audio, meeting, speaker | audio-record-transcribe, audio-device-health, meeting-live-notes | high | strong | integration | 17 | 119 | 1 | Audio transcript dedupe, live meeting mirroring, end-generation and open-meeting invariants, liveness, and speaker reassignment coverage. || db-runtime-reliability | screenpipe-db | windows, macos, linux | database, performance | performance-liveness | high | partial | mixed | 16 | 47 | 6 | SQLite hard-fault classification, failpoint VFS injection, fresh-identity recovery verification with integrity/FK/write canaries, query cancellation, close-severs-connections regressions, multi-pool WAL parity, runtime version pinning, and WAL chaos plus memory-pressure probes, plus read-only quarantine self-heal verification for transient IOERR faults. || db-search-indexing | screenpipe-db | windows, macos, linux | db-search, ocr, accessibility, performance | local-api-search, capture-ocr-pipeline, accessibility-ui-events, performance-liveness | high | strong | mixed | 14 | 106 | 4 | FTS, tokenizer, OCR snapshot search, query planning, ordering, accessibility search, and contention coverage. |-| db-timeline-frames | screenpipe-db | windows, macos, linux | database, timeline, storage, performance | timeline-streaming, performance-liveness | high | strong | mixed | 36 | 294 | 13 | Frame/audio joins, timeline query shape, suggestions frames, write queue, DB primitives (src/db.rs split into src/db/ modules), feedback record upserts, media eviction anti-join regressions, SAF output registry, semantic storage, and timeline performance. |+| db-timeline-frames | screenpipe-db | windows, macos, linux | database, timeline, storage, performance | timeline-streaming, performance-liveness | high | strong | mixed | 37 | 295 | 13 | Frame/audio joins, timeline query shape, suggestions frames, write queue, DB primitives (src/db.rs split into src/db/ modules), feedback record upserts, media eviction anti-join regressions, SAF output registry, semantic storage, and timeline performance. || engine-api-routes | screenpipe-engine | windows, macos, linux | local-api, timeline, meeting, transcription | local-api-search, timeline-streaming, meeting-live-notes, audio-record-transcribe | high | partial | mixed | 44 | 429 | 6 | Route/unit coverage for search, health, streaming, meetings, time/timezone, and transcription. Legacy endpoint/websocket tests require local data and remain ignored. || engine-capture-timeline | screenpipe-engine | windows, macos, linux | vision-capture, timeline, storage, performance | capture-ocr-pipeline, timeline-streaming, performance-liveness | high | partial | mixed | 25 | 306 | 26 | Covers capture trigger logic, frame/audio linking, hot cache, timeline refresh regressions, fragmented MP4 extraction, and HD-mode control. Several real-data tests are intentionally ignored by default. |- | engine-config-lifecycle | screenpipe-engine | windows, macos, linux | configuration, engine-lifecycle, performance | settings-to-engine-config, engine-health-lifecycle, performance-liveness | high | strong | mixed | 13 | 123 | 1 | Fast logic coverage for the config bridge, health-endpoint identity, tray health debounce, sleep/power policies, and queue backpressure. |+ | engine-config-lifecycle | screenpipe-engine | windows, macos, linux | configuration, engine-lifecycle, performance | settings-to-engine-config, engine-health-lifecycle, performance-liveness | high | strong | mixed | 13 | 125 | 1 | Fast logic coverage for the config bridge, health-endpoint identity, tray health debounce, sleep/power policies, and queue backpressure. || engine-db-recovery-cli | screenpipe-engine | windows, macos, linux | database, engine-lifecycle | engine-health-lifecycle, performance-liveness | high | strong | unit | 1 | 29 | 0 | Exact DB/WAL/SHM working-copy preservation, rollback on archive failure, and restart repair for crashes during the multi-file generation swap. || engine-focus-os | screenpipe-engine | windows, macos | engine-lifecycle, os-integration | engine-health-lifecycle, performance-liveness | medium | conditional | unit | 3 | 6 | 0 | Platform focus-tracker parsing/helpers. These files are cfg-gated and only execute on their target OS. || engine-linux-keep-awake | screenpipe-engine | linux | engine-lifecycle | engine-health-lifecycle | high | conditional | mixed | 1 | 2 | 8 | Existing isolated-process missing/stalled bus regressions plus ignored live logind inhibitor tests. Live tests require logind and explicit execution. |+| engine-local-api-search-integration | screenpipe-engine | windows, macos, linux | local-api, db-search | local-api-search | high | strong | integration | 1 | 12 | 5 | Active /search route test builds an audio-disabled router, seeds captured-screen-shaped OCR data into an in-memory DB, and asserts the HTTP response and pagination. |+| engine-meeting-privacy-sync | screenpipe-engine | windows, macos, linux | meeting, privacy, ui-events, pipes, sync | meeting-live-notes, privacy-and-redaction, accessibility-ui-events, performance-liveness | medium | strong | unit | 32 | 539 | 3 | Unit-heavy coverage for privacy filter policy, capture exclusions, UI recorder safety, pipes/live-view/structured-output helpers, sync helpers, and CLI parsing. Meeting detection moved to the engine-meeting-watcher suite. |+ | engine-local-api-search-integration | screenpipe-engine | windows, macos, linux | local-api, db-search | local-api-search | high | strong | integration | 1 | 10 | 5 | Active /search route test builds an audio-disabled router, seeds captured-screen-shaped OCR data into an in-memory DB, and asserts the HTTP response and pagination. |+ | engine-meeting-privacy-sync | screenpipe-engine | windows, macos, linux | meeting, privacy, ui-events, pipes, sync | meeting-live-notes, privacy-and-redaction, accessibility-ui-events, performance-liveness | medium | strong | unit | 32 | 540 | 3 | Unit-heavy coverage for privacy filter policy, capture exclusions, UI recorder safety, pipes/live-view/structured-output helpers, sync helpers, and CLI parsing. Meeting detection moved to the engine-meeting-watcher suite. || engine-meeting-watcher | screenpipe-engine | windows, macos | meeting | meeting-live-notes | high | strong | mixed | 10 | 270 | 3 | Successor of src/meeting_detector.rs and src/meeting_telemetry.rs. Audio-process and UI-scan backend state machines, candidate resolution, shared telemetry, and a scored trajectory eval. ui_scan/macos.rs and ui_scan/windows.rs are cfg-gated and only execute on their target OS; both backends are null on Linux. || engine-retention-storage | screenpipe-engine | windows, macos, linux | storage, engine-lifecycle, performance | engine-health-lifecycle, performance-liveness | medium | strong | mixed | 5 | 39 | 0 | Local retention deletion (including lean-mode heavy-text stripping), cloud archive watermarking, atomic state-file replacement, and the low-disk capture monitor. || engine-telemetry-observability | screenpipe-engine | windows, macos, linux | engine-lifecycle, performance | engine-health-lifecycle, performance-liveness | medium | strong | unit | 6 | 30 | 0 | PostHog capture gating, telemetry context shaping, piggyback telemetry forwarding, crash-log helpers, resource monitoring, and the recording-coverage reliability metric. |