Code-first video & image, rendered natively on WebGPU.
Notice: framefields
framefields is licensed under Apache-2.0. It contains no model weights or human base assets: every vision model downloads on first use from a pinned revision into the local model cache (~/.cache/framefields/models) and is verified by size and SHA-256. The licenses below apply to those downloaded weights, not to framefields' code.
Prompted tracking (SAM)
comp.vision(clip, { sam2 | sam3 }) and framefields/sam track objects with Meta's Segment Anything models: SAM 2.1 (Tiny and Small) and SAM 3. That code is written for framefields and licensed under Apache-2.0; it contains no code or weights distributed by Meta. It loads only when a clip uses sam2 or sam3.
| Model | Weights license | Acceptance |
|---|---|---|
SAM 2.1 Tiny / Small (Diffusion Studio ONNX exports of facebook/sam2.1-hiera-*) |
Apache-2.0 | none |
| SAM 3 (ONNX exports of Meta's SAM 3 checkpoints) | Meta SAM License | required at runtime |
Before SAM 3 weights are downloaded or run, you must accept Meta's SAM License (https://github.com/facebookresearch/sam3/blob/main/LICENSE): pass acceptSamLicense: true in comp.vision options (or acceptLicense: true to Sam3Tracker), or set FRAMEFIELDS_ACCEPT_SAM_LICENSE=1. Your use of SAM 3 is then governed by that license.
Depth
comp.vision(clip, { depth: true }) and withVision({ mode: "depth" }) estimate depth with Depth Anything V2 Small (onnx-community export of depth-anything/Depth-Anything-V2-Small), whose weights are Apache-2.0. The larger Depth Anything V2 checkpoints are licensed CC-BY-NC-4.0 and are not used.
Alpha matting
comp.vision(clip, { matting: true }) and VisionRunner.refineMatte resolve mask edges with ViTMatte Small trained on Distinctions-646 (Xenova ONNX export of hustvl/vitmatte-small-distinctions-646). Its weights are Apache-2.0 and the ViTMatte code is MIT.