Skip to content

The truly free, open-source, local-first, cross-platform CapCut replacement. Scriptable through a JSON-RPC API & MCP.

docs: Enhance on the roadmap, OS-native restoration and sized shader passes left for later

Jareera85b089a3298
diff --git a/ARCHITECTURE-TODO.md b/ARCHITECTURE-TODO.md
index 3c90858f..f19a34f6 100644
--- a/ARCHITECTURE-TODO.md
+++ b/ARCHITECTURE-TODO.md
@@ -25,3 +25,17 @@ not at the history.
zoom level. The Slint repaint itself has not been measured
(`SLINT_DEBUG_PERFORMANCE` needs the window), so the target is not yet
shown either way.
+- [ ] **OS-native restoration behind Enhance.** Enhance runs restoration
+ models through `concat-vision/src/runtime.rs` on every platform. macOS 26
+ and iOS 26 carry a super-resolution scaler, frame interpolation and motion
+ blur in VideoToolbox (`VTFrameProcessor`; Rust bindings in
+ `objc2-video-toolbox`), and Windows App SDK carries a video
+ super-resolution API. Both belong behind the same enhanced-copy job as a
+ fast path chosen per platform, never as a second feature; the seam is the
+ job's per-frame step.
+- [ ] **Shader passes at a size of their own.** A `[[wgsl.pass]]` declares
+ `size` over `WIDTH` and `HEIGHT` (`concat-effects/src/manifest.rs`), but
+ `run_passes` (`concat-render/src/gpu.rs`) claims every target at the
+ source's size and ignores it. Honouring it is what a GPU upscaler package
+ (FSR 1.0, Anime4K, both MIT with WGSL ports) needs to write a larger
+ picture than it reads.
diff --git a/README.md b/README.md
index 766f8aa1..5257858d 100644
--- a/README.md
+++ b/README.md
@@ -107,4 +107,4 @@ Optional models download from the settings panel on first use and then never nee
<source media="(prefers-color-scheme: light)" srcset="https://api.star-history.com/chart?repos=jub0t/concat&type=date&legend=top-left" />
<img alt="Star History Chart" src="https://api.star-history.com/chart?repos=jub0t/concat&type=date&legend=top-left" />
</picture>
-</a>
\ No newline at end of file
+</a>
diff --git a/ROADMAP.MD b/ROADMAP.MD
index af2a504c..234d0dca 100644
--- a/ROADMAP.MD
+++ b/ROADMAP.MD
@@ -63,6 +63,7 @@
* [ ] **Smart Media Search** — Search local project media using speech, filenames, metadata, and eventually visual content.
* [ ] **Long Video → Clips** — Help identify and extract useful short-form segments from longer recordings.
* [ ] **Local Media Analysis** — Build reusable background analysis for transcripts, scenes, faces, audio, and other metadata that multiple Concat features can share.
+* [ ] 🌟 **Enhance** — Upscale, denoise and deblur footage and stills with local restoration models (Real-ESRGAN, SCUNet, NAFNet) run through the ONNX runtime on the platform's accelerator, written once as an enhanced copy the timeline reads; no filter-chain shortcuts.
### 🔌 Plugins & Extensibility
@@ -78,6 +79,7 @@
These are areas worth exploring after the core editing experience is mature:
* [ ] Optical-flow frame interpolation
+* [ ] OS-native super resolution and frame interpolation as a fast path for Enhance: VideoToolbox's `VTFrameProcessor` on macOS 26 / iOS 26, and the Windows App SDK video super-resolution API on Copilot+ PCs
* [ ] Video stabilization
* [ ] Video denoising and restoration
* [ ] Local video upscaling