3D engine that AI agents drive
Models and AI agents
An AI agent can build a 67js scene in two ways. With the MCP server, the agent calls tools that take JSON and return pictures, and it writes no engine code. Without MCP, the agent writes JavaScript like the code in these docs and renders it in a browser.
Three pages cover the details:
- Connect the MCP server: the launch command and the config file for nine harnesses, from Claude Code to Zed.
- Working with agents: example prompts, the real result of each tool, the render loop, skills and the no-MCP path.
- Optimise agent runs: how to cut tool calls, tokens and waiting, with measured numbers.
What the agent does
The server has 25 tools for authoring, previewing and exporting scenes. A normal session uses them in this order:
scene_capabilitiesreads the supported features and limits.scene_createmakes a scene from a recipe. A recipe is JSON with object IDs, geometry, materials, a hierarchy and a camera.scene_lookreturns a picture of the scene.scene_applychanges the scene in one batch. Each edit names the expected revision, so a stale edit fails without partial changes.scene_checkpointandscene_restoresave and return to a state.scene_reviewshows several views or variants in one picture grid.scene_export_recipeand the render job tools save the recipe, PNG images, image sequences and MP4 video.
The tools check every argument against a schema. The server never runs code that the agent writes.
These guides cover the parts of a recipe:
- Look: lights, volume fog, grading and shadows.
- Motion: keyframes for joints, materials and the camera.
- Character motion: imported characters with editable joints.
- Assets: GLB files from the catalog folder, with their textures, rigs and clips.
- Visual review: several labeled views or poses in one PNG grid.
- Render jobs: images, sequences, video and render passes.
Give the agent a brief
Start with a short brief: the subject, references, the camera, the output size, the interaction, the GPU or CPU backend and the memory budget. Ask for the smallest trial first. A prompt can look like this:
Use 67js to build an interactive mechanical study. Reuse meshes, use a 256 MiB
render budget, provide orbit and keyboard controls, pause hidden playback, and
capture a real wide and mobile preview. List unsupported features. Do not claim
speed superiority without a comparable benchmark.
An agent reads plain text best. Give it the plain-text guide, which holds all of these docs in one Markdown file, or the shorter map in llms.txt. Working with agents shows how to install the two skills that hold the scene and media procedures.
Check the work of an agent
A successful build does not prove a good picture. Ask the agent to do these checks and to report the results:
- Read the installed
VERSIONand the exports that it uses. - Use finite, invertible matrices, share geometry, and check the bounds.
- Render a frame and look at the edges and the highlights.
- Try every interaction, run the project tests and export one frame at a fixed time.
- Report the real size and the estimated memory apart from the measured process memory.
Without MCP, the agent can still save an image from a script: Render a PNG from a script without MCP has a tested example.