Skip to content

Code-first video & image, rendered natively on WebGPU.

2.7 KB
Raw Blame

Framefields agent skills

Agent skills for framefields, a code-first video SDK that renders compositions natively on WebGPU in Node.js. The skills teach Claude, Codex, and other coding agents how to write, render, and check framefields compositions in your own project.

Skill Use it for
framefields Starting a project: install from npm, scaffold a composition and render script, first verified render; generating images, video and audio with AI models (ai)
framefields-compose Compositions, layer trees, layout, animation and easing, beat grids, film structure
framefields-effects Post-processing effects, color grading, VFX
framefields-vision On-device vision: detection, segmentation, pose, cutouts, and prompted tracking with SAM 2.1 / SAM 3
framefields-render Headless rendering, frame-grid inspection, pixel probes, live preview, MP4 delivery checks
framefields-cloud Rendering on framefields cloud GPUs (framefields render --cloud, renderCloud), cost plans, split renders, cloud error codes

Skills load automatically when a task matches, for example "add a film-grain pass to this scene" or "render a frame grid of intro.ts".

Installation

Install into Claude Code via the marketplace:

/plugin install framefields --marketplace gatewai-dev/framefields

How it works

This plugin contains skills and a read-only connection to the hosted Framefields MCP server for model information and price estimates. Generate media through the Framefields SDK using a separately configured gateway API key. It bundles no executables, hooks, or package launchers. The engine itself is the framefields npm package, which the skills tell your agent to add to your project (npm install framefields, Node.js 22 or later).

The connected MCP server exposes read-only tools to assist in selecting models and inputs:

  • list_models: List supported AI models, identifiers, and tasks
  • get_model_schema: Get the input and output JSON schema for any catalog model
  • estimate_generation_cost: Check published rates and estimated costs before running a script

Data and privacy

When you run code using ai, prompts, inputs and uploaded files are sent to the Framefields gateway and the provider running the selected model. The gateway stores generated outputs and usage records. The MCP connection provides model information and price estimates; it does not generate media. On-device vision downloads model weights on first use and verifies them by SHA-256. See the privacy policy for details.

License

Apache-2.0. See LICENSE.