Skip to content

armgit / cua

Public Imported from GitHub
0

Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.

docs: add desktop workflow video recipes (#3689)

Francesco Bonacci6073a3ebcfdb
diff --git a/docs/content/docs/concepts/what-is-computer-use.mdx b/docs/content/docs/concepts/what-is-computer-use.mdx
index 7f9e1aa07e..f75944b874 100644
--- a/docs/content/docs/concepts/what-is-computer-use.mdx
+++ b/docs/content/docs/concepts/what-is-computer-use.mdx
@@ -55,6 +55,29 @@ Computer use is useful when work spans interfaces that were designed for people
In each case, the agent must connect actions across changing application state. A script or API may still cover part of the work, while computer use covers the boundaries that those interfaces cannot reach.
+### Example: lay out a map and inspect the exported PDF
+
+<VideoDemo
+ src="https://github.com/user-attachments/assets/e133cb0a-9b70-4812-9d97-76fadd67317b"
+ poster="/media/workflow-demos/map-poster.jpg"
+ title="Map layout and exported-PDF inspection on macOS"
+ aspectRatio={8 / 5}
+ autoPlay={false}
+ loop={false}
+ preload="metadata"
+>
+ Selected map-layout and PDF-inspection steps show an agent moving between applications. The
+ excerpt does not show every export step.
+</VideoDemo>
+
+Recorded on macOS with GPT-6 Astra + Cua Driver. Selected gestures play at 1x;
+setup, waits, retries and intervening edits are cut. These examples include
+foreground/desktop input and fictional data. Clip duration is not task
+completion time.
+
+Follow [Build and inspect a map](/how-to-guides/recipes/build-and-inspect-a-map)
+for the starter files, prompt, and saved-output checks.
+
## Choosing a surface
A capable agent moves between these surfaces during a single task, choosing the one that fits the next piece of work. Code and structured tool calls are usually the right fit when the job is repeatable or text-heavy, especially when the system already exposes a clear interface. UI automation becomes the better choice when the work depends on visual state or when the application is unfamiliar; it is also the fallback when there is no useful API and the path exists only inside the interface.
diff --git a/docs/content/docs/how-to-guides/driver/record-and-render-a-trajectory.mdx b/docs/content/docs/how-to-guides/driver/record-and-render-a-trajectory.mdx
index ec9459c512..b23c7c6d13 100644
--- a/docs/content/docs/how-to-guides/driver/record-and-render-a-trajectory.mdx
+++ b/docs/content/docs/how-to-guides/driver/record-and-render-a-trajectory.mdx
@@ -108,4 +108,32 @@ sudo apt install ffmpeg
are separate from the built-in trajectory renderer.
</VideoDemo>
+## Example: select interactions from several workflows
+
+<VideoDemo
+ src="https://github.com/user-attachments/assets/e9344780-e780-46e7-bcce-91f61eda9599"
+ poster="/media/workflow-demos/highlights-poster.jpg"
+ title="Selected desktop interactions with action captions"
+ aspectRatio={8 / 5}
+ autoPlay={false}
+ loop={false}
+ preload="metadata"
+>
+ Cua Driver recorded the source footage and actions. Selected cuts and the shader caption rail were
+ assembled separately in HyperFrames. The rail and action captions are separate from Cua Driver's
+ built-in trajectory renderer.
+</VideoDemo>
+
+Recorded on macOS with GPT-6 Astra + Cua Driver. Selected gestures play at 1x;
+setup, waits, retries and intervening edits are cut. These examples include
+foreground/desktop input and fictional data. Clip duration is not task
+completion time.
+
+Keep an editing disclosure beside your recording, preserve complete gestures
+where their timing matters, and verify the saved result independently of the
+clip. See the [map](/how-to-guides/recipes/build-and-inspect-a-map),
+[PDF](/how-to-guides/recipes/redact-and-annotate-a-pdf), and
+[exhibition-panel](/how-to-guides/recipes/prepare-an-exhibition-panel) recipes
+for the workflows shown here.
+
For the complete recording schemas and render options, see [MCP recording tools](/reference/cua-driver/mcp-tools#recording-tools) and the [`cua-driver recording` CLI reference](/reference/cua-driver/cli-reference#trajectory-recording).
diff --git a/docs/content/docs/how-to-guides/recipes/build-and-inspect-a-map.mdx b/docs/content/docs/how-to-guides/recipes/build-and-inspect-a-map.mdx
new file mode 100644
index 0000000000..39c38fb470
--- /dev/null
+++ b/docs/content/docs/how-to-guides/recipes/build-and-inspect-a-map.mdx
@@ -0,0 +1,101 @@
+---
+title: Build and inspect a map
+description: Turn fictional station observations into a QGIS planning map and a checked PDF handoff with Cua Driver.
+---
+
+Create an editable QGIS map from eight fictional refill-station observations, then
+use the map in a one-page LibreOffice Writer handoff. The workflow covers importing
+coordinates, calculating categories, designing a print layout, and inspecting the
+saved PDFs.
+
+The clip shows selected layout gestures in QGIS and inspection of the exported
+map in Chrome. The prompt below also includes the data preparation and handoff.
+
+<VideoDemo
+ src="https://github.com/user-attachments/assets/e133cb0a-9b70-4812-9d97-76fadd67317b"
+ poster="/media/workflow-demos/map-poster.jpg"
+ title="Build a planning map in QGIS and inspect the exported PDF"
+ aspectRatio={8 / 5}
+ autoPlay={false}
+ loop={false}
+ preload="metadata"
+>
+ Recorded on macOS with GPT-6 Astra + Cua Driver. Selected gestures play at 1x; setup, waits,
+ retries and intervening edits are cut. These examples include foreground/desktop input and
+ fictional data. Clip duration is not task completion time.
+</VideoDemo>
+
+## Prepare the apps and source files
+
+Use a Mac with QGIS, LibreOffice Writer, and Chrome installed. The recording uses
+Chrome to inspect the map PDF; you can also use Preview for PDF checks. Follow
+[Install Cua Driver](/how-to-guides/driver/install),
+grant the required [macOS permissions](/reference/cua-driver/macos-permissions), and
+[connect your agent](/how-to-guides/driver/connect-your-agent). Keep the desktop
+available while the agent works.
+
+Download these original, synthetic inputs into one working folder:
+
+- [Station observations (CSV)](/media/workflow-demos/map/stations.csv): eight
+ records with coordinates, flow in liters per minute, and elapsed days since
+ the last check.
+- [Campus and building outlines (GeoJSON)](/media/workflow-demos/map/campus.geojson):
+ one campus boundary and three buildings.
+
+All names, measurements, and geometry are invented. The coordinates near zero
+longitude and latitude deliberately place the example in the ocean. `READY` and
+`REVIEW` are planning categories, not water safety findings. No basemap or external
+map service is needed.
+
+## Ask the agent to create the map
+
+Give the agent the working folder and this bounded task:
+
+```text
+Use Cua Driver to build a fictional Morrow Field campus planning map in QGIS.
+Preserve stations.csv and campus.geojson. Save new outputs in an output folder.
+
+Import stations.csv as points: X = longitude, Y = latitude, source CRS EPSG:4326.
+Import campus.geojson with the same source CRS. Set the project CRS to EPSG:3857
+for a layout with distances in meters; do not relabel the source coordinates.
+
+Use the field calculator to create status: READY when flow_lpm >= 2.0 AND
+days_since_check <= 30; otherwise REVIEW. Compare the original numeric values
+without rounding or recalculating elapsed days. Save an editable GeoPackage.
+
+Style READY green and REVIEW amber, label all eight station IDs, and include
+category names so the result does not rely on color alone. Select the REVIEW
+features and confirm their IDs and count from the data.
+
+Create one A4 landscape layout with a title, legend, north arrow, and meter scale
+bar. Save a QGZ project with relative paths and export the map as a PDF.
+
+In LibreOffice Writer, create a one-page handoff with the map, verified category
+counts and REVIEW IDs, the classification rule, and the fictional-planning caveat.
+Save the handoff as ODT and PDF. Reopen the project and inspect both exported PDFs
+in Chrome or Preview. Report the saved files, completed checks, and any unresolved issue.
+Keep the outputs local; do not send or publish them.
+```
+
+## Verify the saved outputs
+
+Check the saved files, including the data behind the map:
+
+1. Reopen the QGZ project and confirm that its layers resolve. Check that R01 is at
+ longitude `0.00150`, latitude `0.00440`; swapped axes can look plausible in this
+ example. Confirm eight station points, one campus boundary, and three buildings.
+2. Inspect the saved status field. `READY` must contain R01–R04 and `REVIEW` must
+ contain R05–R08, with four records in each category. R01 meets both thresholds
+ exactly; R08 needs review because its flow is `1.99`.
+3. Open the map PDF in Chrome or Preview. Check all eight labels, the legend, north arrow,
+ and scale bar at readable zoom. Confirm that the page is A4 landscape and that
+ no labels or symbols are clipped.
+4. Open the handoff PDF and its editable ODT. Confirm one page, a readable map,
+ matching counts and IDs, and the statement that these are fictional planning
+ categories. Preserve the original CSV and GeoJSON alongside the saved project.
+
+## Related workflows
+
+- [Build a report in a native app](/how-to-guides/recipes/build-a-report-in-a-native-app)
+- [Redact and annotate a PDF](/how-to-guides/recipes/redact-and-annotate-a-pdf)
+- [Drive your first app](/tutorials/drive-your-first-app)
diff --git a/docs/content/docs/how-to-guides/recipes/meta.json b/docs/content/docs/how-to-guides/recipes/meta.json
index d8f91a7618..b890bbb814 100644
--- a/docs/content/docs/how-to-guides/recipes/meta.json
+++ b/docs/content/docs/how-to-guides/recipes/meta.json
@@ -1 +1,12 @@
-{ "title": "Recipes", "pages": ["automate-a-legacy-windows-app-behind-a-vpn", "export-contacts-overnight", "build-a-report-in-a-native-app", "fill-a-form-from-a-local-file"] }
+{
+ "title": "Recipes",
+ "pages": [
+ "build-and-inspect-a-map",
+ "redact-and-annotate-a-pdf",
+ "prepare-an-exhibition-panel",
+ "automate-a-legacy-windows-app-behind-a-vpn",
+ "export-contacts-overnight",
+ "build-a-report-in-a-native-app",
+ "fill-a-form-from-a-local-file"
+ ]
+}
diff --git a/docs/content/docs/how-to-guides/recipes/prepare-an-exhibition-panel.mdx b/docs/content/docs/how-to-guides/recipes/prepare-an-exhibition-panel.mdx
new file mode 100644
index 0000000000..c3e1884bf4
--- /dev/null
+++ b/docs/content/docs/how-to-guides/recipes/prepare-an-exhibition-panel.mdx
@@ -0,0 +1,110 @@
+---
+title: Prepare an exhibition panel
+description: Use GIMP, Inkscape, and LibreOffice Writer with Cua Driver to turn fictional archive objects into panels and an installation packet.
+---
+
+Crop a fictional archive ticket in GIMP, create two editable exhibition panels in
+Inkscape, and assemble a two-page installation packet in LibreOffice Writer. Keep
+the source files and inspect the exported PDFs in Preview.
+
+The clip shows selected image and panel edits in GIMP and Inkscape. The prompt
+below also includes the object key and installation packet.
+
+<VideoDemo
+ src="https://github.com/user-attachments/assets/89d570f7-e895-4b66-8c20-ded5da2926a4"
+ poster="/media/workflow-demos/archive-poster.jpg"
+ title="Prepare archive artwork in GIMP and an exhibition panel in Inkscape"
+ aspectRatio={8 / 5}
+ autoPlay={false}
+ loop={false}
+ preload="metadata"
+>
+ Recorded on macOS with GPT-6 Astra + Cua Driver. Selected gestures play at 1x; setup, waits,
+ retries and intervening edits are cut. These examples include foreground/desktop input and
+ fictional data. Clip duration is not task completion time.
+</VideoDemo>
+
+## Prepare the apps and source files
+
+Use a Mac with GIMP, Inkscape, LibreOffice Writer, and Preview installed. Follow
+[Install Cua Driver](/how-to-guides/driver/install), grant the required
+[macOS permissions](/reference/cua-driver/macos-permissions), and
+[connect your agent](/how-to-guides/driver/connect-your-agent). Keep the desktop
+available while the agent works.
+
+Download these original, synthetic inputs into one working folder:
+
+- [Archive contact sheet (PNG)](/media/workflow-demos/archive/archive-contact-sheet.png):
+ a 4200 × 3000 image containing a ticket, route card, and timetable.
+- [Blank panel guide (SVG)](/media/workflow-demos/archive/panel-starter.svg):
+ an A4 landscape page with nonprinting guides for a 15 mm safe margin.
+
+The Riverline Archive collection, transport history, and objects are invented.
+Use these captions for the fictional exhibition, **Everyday Journeys**:
+
+| Station | Object ID | Year | Caption |
+| ------- | ---------- | ---- | ----------------------------------------------------------------- |
+| A | RA-1932-01 | 1932 | A three-pence ticket links Ferry Steps and Market Square. |
+| B | RA-1956-02 | 1956 | Route 4 connects Ferry Steps, Market Square, and Hill Library. |
+| C | RA-1974-03 | 1974 | Three morning departures make the same journey in twenty minutes. |
+
+## Ask the agent to prepare the panels and packet
+
+Give the agent the working folder, the caption table, and this task:
+
+```text
+Use Cua Driver to prepare a fictional Riverline Archive / Everyday Journeys
+exhibition. Preserve both source files and save new work in an output folder.
+
+In GIMP, crop the ticket from archive-contact-sheet.png: top-left origin,
+X = 200, Y = 300, width = 1800, height = 1100 pixels. Retain all ticket text;
+do not scale or retouch it. Save riverline-hero.xcf and export riverline-hero.png.
+
+In Inkscape, use panel-starter.svg to create two A4 landscape panels. Keep text
+editable, content inside the 15 mm safe margin, body text at least 24 pt, and
+headings at least 36 pt. Use teal #164E52, oxblood #702F3B, and ivory #F5EEDC.
+The entry panel must say Riverline Archive, Everyday Journeys, START HERE,
+A > B > C, and Fictional collection. The object key must include all three
+stations, object IDs, years, and exact captions from the supplied table.
+Save riverline-entry.svg and riverline-object-key.svg. Export each as PDF and
+as a 1782 × 1260 PNG.
+
+In LibreOffice Writer, create an A4 portrait installation packet with exactly
+two pages and an explicit page break. Page 1 needs the exhibition title,
+proportional ticket image, caption table, and fictional-collection notice.
+Page 2 needs both panel images and this illustrative plan: a 3600 mm wall;
+A, B, and C centered at 600, 1800, and 3000 mm from its left end; object centers
+1400 mm high; label centers 1200 mm high; and 1500 mm of clear approach depth.
+Place the entry panel left of A and the object key right of C. Include a checklist
+to confirm object order, measure centers, keep the approach clear, proof labels,
+and check glare. Label these as illustrative targets, not measured venue
+conditions or formal accessibility compliance.
+
+Save riverline-installation.odt and export riverline-installation.pdf. Reopen
+the editable files in their apps and inspect the exported PDFs in Preview.
+Report output files, completed checks, and unresolved issues. Keep the outputs
+local; do not send or publish them.
+```
+
+## Verify the saved artwork and packet
+
+Inspect both the editable files and the exports:
+
+1. Reopen the XCF in GIMP. Confirm a 1800 × 1100 canvas with all ticket text intact,
+ then compare it with the exported PNG.
+2. Reopen both SVGs in Inkscape. Select text to confirm it remains editable. Check
+ the A4 landscape size, safe margins, station order, IDs, years, and captions.
+3. Open the panel PDFs in Preview at full-page and text-detail zoom. Confirm that
+ no content is clipped and that the PNG exports retain the same proportions.
+4. Reopen the ODT and its exported PDF. Confirm exactly two pages, a proportional
+ ticket image, all three object records, both panel images, and every installation
+ measurement. Check for clipped text or an extra page.
+
+The installation measurements are part of the fictional exercise. A real venue
+needs its own measurements and accessibility review.
+
+## Related workflows
+
+- [Build and inspect a map](/how-to-guides/recipes/build-and-inspect-a-map)
+- [Redact and annotate a PDF](/how-to-guides/recipes/redact-and-annotate-a-pdf)
+- [Build a report in a native app](/how-to-guides/recipes/build-a-report-in-a-native-app)
diff --git a/docs/content/docs/how-to-guides/recipes/redact-and-annotate-a-pdf.mdx b/docs/content/docs/how-to-guides/recipes/redact-and-annotate-a-pdf.mdx
new file mode 100644
index 0000000000..6f65a17090
--- /dev/null
+++ b/docs/content/docs/how-to-guides/recipes/redact-and-annotate-a-pdf.mdx
@@ -0,0 +1,100 @@
+---
+title: Redact and annotate a PDF
+description: Use Preview and LibreOffice Writer with Cua Driver to prepare a fictional review copy and check the saved redactions.
+---
+
+Remove four fictional production details from a two-page PDF in Preview, add a
+review annotation, and create an editable handoff in LibreOffice Writer. Verify
+the saved review copy by inspecting both pages and checking extracted text.
+
+The clip shows selected redaction and annotation steps in Preview. The prompt
+below also includes the handoff and saved-file checks.
+
+<VideoDemo
+ src="https://github.com/user-attachments/assets/5ef3bec8-70a5-45f5-8eb3-930a345b9019"
+ poster="/media/workflow-demos/pdf-poster.jpg"
+ title="Redact and annotate a vendor proof in Preview"
+ aspectRatio={8 / 5}
+ autoPlay={false}
+ loop={false}
+ preload="metadata"
+>
+ Recorded on macOS with GPT-6 Astra + Cua Driver. Selected gestures play at 1x; setup, waits,
+ retries and intervening edits are cut. These examples include foreground/desktop input and
+ fictional data. Clip duration is not task completion time.
+</VideoDemo>
+
+## Prepare the apps and source file
+
+Use a Mac with Preview and LibreOffice Writer installed. Follow
+[Install Cua Driver](/how-to-guides/driver/install),
+grant the required [macOS permissions](/reference/cua-driver/macos-permissions), and
+[connect your agent](/how-to-guides/driver/connect-your-agent). Keep the desktop
+available while the agent works.
+
+Download the [fictional vendor proof (PDF)](/media/workflow-demos/pdf/willowfen-vendor-proof-SOURCE.pdf)
+into a working folder. The two A4 pages contain invented workshop details and four
+marked redaction targets. All organizations, figures, and contacts are fictional;
+the addresses use the reserved `.invalid` domain. The source is intentionally
+unredacted so you can practice on a duplicate.
+
+## Ask the agent to prepare a review copy
+
+Give the agent the working folder and this task:
+
+```text
+Use Cua Driver to prepare a local review copy of willowfen-vendor-proof-SOURCE.pdf
+in Preview. Preserve the original. Duplicate it before editing, and confirm that
+the active document is the copy before applying any irreversible redaction.
+
+Use Preview's actual Redact tool to remove the complete line below each marker:
+- Page 1, R1: Supplier cost.
+- Page 1, R2: Internal reference.
+- Page 2, R3: Supplier contact.
+- Page 2, R4: Internal contingency.
+The R1-R4 markers may remain. Do not substitute shapes or highlights for Redact.
+If Redact is unavailable, stop and report the limitation.
+
+Keep the title, date, time, location, participant count, public fee, materials,
+booking address, schedule, access notes, and complete room diagram. Add REVIEW
+COPY in page 1's outlined annotation area without covering other text. Save as
+willowfen-vendor-proof-REVIEW.pdf, then close and reopen it in Preview.
+
+In LibreOffice Writer, create a one-page handoff with the workshop title,
+review-only status, source and review filenames, the four removed categories
+without their values, retained public facts, page count, and verification results.
+Save willowfen-release-handoff.odt and export willowfen-release-handoff.pdf.
+
+Inspect both review PDF pages and the handoff PDF in Preview. Report the files
+and the checks that passed. If extraction has not been checked, state that it
+remains unverified. Keep all outputs local; do not send or publish them.
+```
+
+## Verify removal and the handoff
+
+Check the saved PDF itself before treating the review copy as complete:
+
+1. Compare the original file's hash before and after the task to confirm that the
+ source is unchanged. Confirm that the review PDF still has two A4 pages.
+2. Reopen the review PDF in Preview and inspect both pages at readable zoom. The
+ four complete target lines must be absent, while the public facts, room diagram,
+ and `REVIEW COPY` annotation remain legible.
+3. Extract text from the saved review PDF with a PDF inspection tool, such as
+ Poppler's `pdftotext`. Search for each original target line and its value from
+ the source. Any remaining target text is a failed redaction check.
+4. Inspect the handoff ODT and PDF. Confirm one page, correct filenames, and the
+ four removed categories without their values. Record unperformed or failed
+ checks accurately.
+
+Text extraction is one check, not proof by itself: image content can remain
+visible without appearing in extracted text. A black rectangle can also hide
+text while leaving it recoverable. Use actual redaction, inspect rendered pages,
+and check extraction together. For documents beyond this synthetic exercise,
+also inspect metadata, annotations, and attachments for information that should
+not be shared.
+
+## Related workflows
+
+- [Build a report in a native app](/how-to-guides/recipes/build-a-report-in-a-native-app)
+- [Prepare an exhibition panel](/how-to-guides/recipes/prepare-an-exhibition-panel)
+- [Drive your first app](/tutorials/drive-your-first-app)
diff --git a/docs/content/docs/index.mdx b/docs/content/docs/index.mdx
index 610d3af729..00e443fe30 100644
--- a/docs/content/docs/index.mdx
+++ b/docs/content/docs/index.mdx
@@ -41,7 +41,41 @@ the SDK, or an app-hosted service should own the runtime.
## Cua Driver in action
-These recordings show agents operating desktop apps while the user's active window stays in place. Each demo was recorded by the Cua team on the named platform.
+See agents work across real desktop apps. Each example identifies its platform,
+workflow, and input scope.
+
+### Real desktop workflows with GPT-6 Astra + Cua Driver
+
+Map layouts, PDF review, and design edits across macOS apps:
+
+<VideoDemo
+ src="https://github.com/user-attachments/assets/e9344780-e780-46e7-bcce-91f61eda9599"
+ poster="/media/workflow-demos/highlights-poster.jpg"
+ title="Real desktop workflows with GPT-6 Astra + Cua Driver"
+ aspectRatio={8 / 5}
+ autoPlay={false}
+ loop={false}
+ preload="metadata"
+>
+ Selected interactions from QGIS, Preview, GIMP, and Inkscape, with the recorded agent cursor and
+ action captions.
+</VideoDemo>
+
+Recorded on macOS with GPT-6 Astra + Cua Driver. Selected gestures play at 1x;
+setup, waits, retries and intervening edits are cut. These examples include
+foreground/desktop input and fictional data. Clip duration is not task
+completion time.
+
+Try a workflow with starter files and output checks:
+
+- [Build and inspect a map](/how-to-guides/recipes/build-and-inspect-a-map).
+- [Redact and annotate a PDF](/how-to-guides/recipes/redact-and-annotate-a-pdf).
+- [Prepare an exhibition panel](/how-to-guides/recipes/prepare-an-exhibition-panel).
+
+### Background examples on Windows and Linux
+
+These recordings show agents operating desktop apps while the user's active window
+stays in place. Each demo was recorded by the Cua team on the named platform.
<div className="not-prose my-8 grid gap-5 md:grid-cols-2">
<VideoDemo
diff --git a/docs/content/docs/tutorials/drive-your-first-app.mdx b/docs/content/docs/tutorials/drive-your-first-app.mdx
index c6da960390..2fb0e8b4f7 100644
--- a/docs/content/docs/tutorials/drive-your-first-app.mdx
+++ b/docs/content/docs/tutorials/drive-your-first-app.mdx
@@ -319,6 +319,21 @@ platform differences.
You installed Cua Driver, checked its daemon and desktop access, connected your
agent, and verified a result computed inside a desktop app.
+## Try a real workflow
+
+Use a bounded task to connect app actions with a saved result. These macOS
+examples include edited recordings, fictional starter files, and output checks:
+
+- [Build and inspect a map](/how-to-guides/recipes/build-and-inspect-a-map):
+ load spatial data, prepare a print layout, and inspect the exported PDF.
+- [Redact and annotate a PDF](/how-to-guides/recipes/redact-and-annotate-a-pdf):
+ prepare a review copy in Preview and check the saved redactions.
+- [Prepare an exhibition panel](/how-to-guides/recipes/prepare-an-exhibition-panel):
+ crop an archive image and edit a panel across GIMP and Inkscape.
+
+These runs include foreground/desktop input. Use a separate desktop or VM when
+you need to keep working independently during the task.
+
## Next steps
- [Connect your agent](/how-to-guides/driver/connect-your-agent): register Cua Driver with Cursor, Antigravity, OpenCode, OpenClaw, Pi, and more.
diff --git a/docs/content/docs/use-cua-with/codex.mdx b/docs/content/docs/use-cua-with/codex.mdx
index 5cc74c5ff5..557c84416c 100644
--- a/docs/content/docs/use-cua-with/codex.mdx
+++ b/docs/content/docs/use-cua-with/codex.mdx
@@ -26,4 +26,11 @@ cua-driver skills status
Continue with [Connect your agent to Cua Driver](/how-to-guides/driver/connect-your-agent#codex) and [Install the Cua Driver agent skill](/how-to-guides/driver/install-agent-skill).
+Then try a complete workflow: [build a map](/how-to-guides/recipes/build-and-inspect-a-map),
+[review a PDF](/how-to-guides/recipes/redact-and-annotate-a-pdf), or
+[prepare an exhibition panel](/how-to-guides/recipes/prepare-an-exhibition-panel).
+Each recipe includes fictional starter files, output checks, and an edited
+macOS recording made with GPT-6 Astra + Cua Driver. These runs include
+foreground/desktop input.
+
Upstream: [Codex MCP documentation](https://learn.chatgpt.com/docs/extend/mcp?surface=cli).
diff --git a/docs/content/docs/use-cua-with/openai.mdx b/docs/content/docs/use-cua-with/openai.mdx
index 204ff3aebe..2907acdcfe 100644
--- a/docs/content/docs/use-cua-with/openai.mdx
+++ b/docs/content/docs/use-cua-with/openai.mdx
@@ -14,4 +14,10 @@ OpenAI Codex supports local MCP servers in its CLI, IDE extension, and desktop a
Cua Driver supplies desktop state and actions. Codex owns the model interaction, reasoning loop, and tool selection.
+For recorded GPT-6 Astra + Cua Driver examples with starter files and output
+checks, try [map layout](/how-to-guides/recipes/build-and-inspect-a-map),
+[PDF review](/how-to-guides/recipes/redact-and-annotate-a-pdf), or
+[exhibition-panel editing](/how-to-guides/recipes/prepare-an-exhibition-panel).
+The clips show selected macOS interactions, including foreground/desktop input.
+
See OpenAI's current [Codex MCP documentation](https://learn.chatgpt.com/docs/extend/mcp?surface=cli) for supported transports and configuration.
diff --git a/docs/public/media/workflow-demos/archive-poster.jpg b/docs/public/media/workflow-demos/archive-poster.jpg
new file mode 100644
index 0000000000..f5b3ff27ae
Binary files /dev/null and b/docs/public/media/workflow-demos/archive-poster.jpg differ
diff --git a/docs/public/media/workflow-demos/archive/archive-contact-sheet.png b/docs/public/media/workflow-demos/archive/archive-contact-sheet.png
new file mode 100644
index 0000000000..af8c43f261
Binary files /dev/null and b/docs/public/media/workflow-demos/archive/archive-contact-sheet.png differ
diff --git a/docs/public/media/workflow-demos/archive/panel-starter.svg b/docs/public/media/workflow-demos/archive/panel-starter.svg
new file mode 100644
index 0000000000..55b90430f2
--- /dev/null
+++ b/docs/public/media/workflow-demos/archive/panel-starter.svg
@@ -0,0 +1,10 @@
+<svg xmlns="http://www.w3.org/2000/svg" xmlns:sodipodi="http://sodipodi.sourceforge.net/DTD/sodipodi-0.dtd" xmlns:inkscape="http://www.inkscape.org/namespaces/inkscape" width="297mm" height="210mm" viewBox="0 0 297 210">
+<title>Empty A4 landscape archive panel guide</title>
+<desc>Blank design input. Nonprinting guides mark a 15 mm safe margin. Create final artwork in Inkscape.</desc>
+<sodipodi:namedview id="namedview" showguides="true">
+<sodipodi:guide position="15,0" orientation="1,0"/>
+<sodipodi:guide position="282,0" orientation="1,0"/>
+<sodipodi:guide position="0,15" orientation="0,1"/>
+<sodipodi:guide position="0,195" orientation="0,1"/>
+</sodipodi:namedview>
+</svg>
diff --git a/docs/public/media/workflow-demos/highlights-poster.jpg b/docs/public/media/workflow-demos/highlights-poster.jpg
new file mode 100644
index 0000000000..09b899c37f
Binary files /dev/null and b/docs/public/media/workflow-demos/highlights-poster.jpg differ
diff --git a/docs/public/media/workflow-demos/map-poster.jpg b/docs/public/media/workflow-demos/map-poster.jpg
new file mode 100644
index 0000000000..e11227353c
Binary files /dev/null and b/docs/public/media/workflow-demos/map-poster.jpg differ
diff --git a/docs/public/media/workflow-demos/map/campus.geojson b/docs/public/media/workflow-demos/map/campus.geojson
new file mode 100644
index 0000000000..947b4b4927
--- /dev/null
+++ b/docs/public/media/workflow-demos/map/campus.geojson
@@ -0,0 +1,149 @@
+{
+ "type": "FeatureCollection",
+ "features": [
+ {
+ "type": "Feature",
+ "id": "C01",
+ "properties": {
+ "feature_id": "C01",
+ "name": "Morrow Field campus (fictional)",
+ "kind": "campus"
+ },
+ "geometry": {
+ "type": "Polygon",
+ "coordinates": [
+ [
+ [
+ 0.001,
+ 0.001
+ ],
+ [
+ 0.007,
+ 0.001
+ ],
+ [
+ 0.007,
+ 0.005
+ ],
+ [
+ 0.001,
+ 0.005
+ ],
+ [
+ 0.001,
+ 0.001
+ ]
+ ]
+ ]
+ }
+ },
+ {
+ "type": "Feature",
+ "id": "B01",
+ "properties": {
+ "feature_id": "B01",
+ "name": "Linen Hall",
+ "kind": "building"
+ },
+ "geometry": {
+ "type": "Polygon",
+ "coordinates": [
+ [
+ [
+ 0.0018,
+ 0.002
+ ],
+ [
+ 0.003,
+ 0.002
+ ],
+ [
+ 0.003,
+ 0.003
+ ],
+ [
+ 0.0018,
+ 0.003
+ ],
+ [
+ 0.0018,
+ 0.002
+ ]
+ ]
+ ]
+ }
+ },
+ {
+ "type": "Feature",
+ "id": "B02",
+ "properties": {
+ "feature_id": "B02",
+ "name": "Reed Studio",
+ "kind": "building"
+ },
+ "geometry": {
+ "type": "Polygon",
+ "coordinates": [
+ [
+ [
+ 0.004,
+ 0.0032
+ ],
+ [
+ 0.0052,
+ 0.0032
+ ],
+ [
+ 0.0052,
+ 0.0041
+ ],
+ [
+ 0.004,
+ 0.0041
+ ],
+ [
+ 0.004,
+ 0.0032
+ ]
+ ]
+ ]
+ }
+ },
+ {
+ "type": "Feature",
+ "id": "B03",
+ "properties": {
+ "feature_id": "B03",
+ "name": "Pebble Annex",
+ "kind": "building"
+ },
+ "geometry": {
+ "type": "Polygon",
+ "coordinates": [
+ [
+ [
+ 0.0052,
+ 0.0016
+ ],
+ [
+ 0.0063,
+ 0.0016
+ ],
+ [
+ 0.0063,
+ 0.0026
+ ],
+ [
+ 0.0052,
+ 0.0026
+ ],
+ [
+ 0.0052,
+ 0.0016
+ ]
+ ]
+ ]
+ }
+ }
+ ]
+}
diff --git a/docs/public/media/workflow-demos/map/stations.csv b/docs/public/media/workflow-demos/map/stations.csv
new file mode 100644
index 0000000000..344145ea20
--- /dev/null
+++ b/docs/public/media/workflow-demos/map/stations.csv
@@ -0,0 +1,9 @@
+station_id,location_name,longitude,latitude,flow_lpm,days_since_check
+R01,North garden,0.00150,0.00440,2.00,30
+R02,Upper walk,0.00340,0.00440,2.00,12
+R03,East grove,0.00650,0.00430,2.80,30
+R04,West court,0.00140,0.00310,3.10,7
+R05,Middle walk,0.00350,0.00280,1.90,10
+R06,East court,0.00665,0.00300,2.60,31
+R07,South garden,0.00200,0.00140,1.50,45
+R08,Lower walk,0.00450,0.00135,1.99,30
diff --git a/docs/public/media/workflow-demos/pdf-poster.jpg b/docs/public/media/workflow-demos/pdf-poster.jpg
new file mode 100644
index 0000000000..354334ec5a
Binary files /dev/null and b/docs/public/media/workflow-demos/pdf-poster.jpg differ
diff --git a/docs/public/media/workflow-demos/pdf/willowfen-vendor-proof-SOURCE.pdf b/docs/public/media/workflow-demos/pdf/willowfen-vendor-proof-SOURCE.pdf
new file mode 100644
index 0000000000..0d42a3bb94
--- /dev/null
+++ b/docs/public/media/workflow-demos/pdf/willowfen-vendor-proof-SOURCE.pdf
@@ -0,0 +1,99 @@
+%PDF-1.4
+%���� ReportLab Generated PDF document (opensource)
+1 0 obj
+<<
+/F1 2 0 R /F2 3 0 R /F3 4 0 R
+>>
+endobj
+2 0 obj
+<<
+/BaseFont /Helvetica /Encoding /WinAnsiEncoding /Name /F1 /Subtype /Type1 /Type /Font
+>>
+endobj
+3 0 obj
+<<
+/BaseFont /Helvetica-Bold /Encoding /WinAnsiEncoding /Name /F2 /Subtype /Type1 /Type /Font
+>>
+endobj
+4 0 obj
+<<
+/BaseFont /Times-Roman /Encoding /WinAnsiEncoding /Name /F3 /Subtype /Type1 /Type /Font
+>>
+endobj
+5 0 obj
+<<
+/Contents 10 0 R /MediaBox [ 0 0 595.2756 841.8898 ] /Parent 9 0 R /Resources <<
+/Font 1 0 R /ProcSet [ /PDF /Text /ImageB /ImageC /ImageI ]
+>> /Rotate 0 /Trans <<
+
+>>
+ /Type /Page
+>>
+endobj
+6 0 obj
+<<
+/Contents 11 0 R /MediaBox [ 0 0 595.2756 841.8898 ] /Parent 9 0 R /Resources <<
+/Font 1 0 R /ProcSet [ /PDF /Text /ImageB /ImageC /ImageI ]
+>> /Rotate 0 /Trans <<
+
+>>
+ /Type /Page
+>>
+endobj
+7 0 obj
+<<
+/PageMode /UseNone /Pages 9 0 R /Type /Catalog
+>>
+endobj
+8 0 obj
+<<
+/Author (Synthetic Demo Studio) /CreationDate (D:20000101000000+00'00') /Creator (Synthetic fixture generator) /Keywords (fictional, private-demo, synthetic, input) /ModDate (D:20000101000000+00'00') /Producer (ReportLab PDF Library - \(opensource\))
+ /Subject (Fictional workshop source; private-demo input; no real people or accounts) /Title (Fictional vendor proof | private-demo input) /Trapped /False
+>>
+endobj
+9 0 obj
+<<
+/Count 2 /Kids [ 5 0 R 6 0 R ] /Type /Pages
+>>
+endobj
+10 0 obj
+<<
+/Filter [ /ASCII85Decode /FlateDecode ] /Length 1426
+>>
+stream
+Gau`S>Ar7S'RnZ;3)@Fm1lOt^]&_+MQ,]2,)6t/jO,?WORO-CDjJMbI4!YQ])k<_\$nMQ+;UIM^GOD@C>l7+:n$2u(cJe>K!bIIsJGR3>Hicn-O>r$t('9=QMg^IYl@k0aqqt!ib[XCMa9.6G8tm_oTG=^-i"5K##GT1NKMN-9GZrI%0qb\c@KR7WV#r0l+H/Ia/T9S!`HX.0(H9GM/n$Z,,oQU^ZcVE0nf-Y>6N4e4p#<ar&]aW5QcJls1^s.#O$[[@>S8%^%"];2]4Cauc!Zj6km_)Sdd6`(D*!=A0$3P$al3jjEkRhp+;+4l76j16_h[Rd3XGB_0f6[ocT2AN29^Q%Co#1m,WNrs[k)I;TCQt_*DNnFZLQa!:Z-<b22--5q;Z:oELEXeJ5QM[LW\M2ZNljLW82NU]3T'#%WPM#l>\*qb_iN9@A2CL[oV7Y8D;HT&8KI90nWA6#Q"9F<Y."O2cVN)J?C?d)X`mE&=Bkjm.&o?k^1]L!dV$_YZ?b1+82^_,)8j$QUe!5`/J^F.>\-(#u+8V!Fd47`o3M-4f>J@?=Uj^)k$"U+ZST%Aa%m82[h4bH-$mVeAD)5<`pE:0me%oO##$XqGM&8qLE%+<GoNZ#K"^K72TY+C3/$+)5K+:_4&eT41_BJaX$RLh?HN'%DfbQVIp8fomC9fgZ/bd/UMW$$,g'a@&d-!b&o?c]CO_j.cMI1GSEBsOX4Wt"OkM,ri3O>DD=@?_S"bX.g=O;UsCX6QRr(n4"l"'g,MK&8Sqh"e[CQfLN,l!A\`]?V1%j"e%f=](YU4^VUc#GHE0-K8#YJQ$FtgrWOd]`a&45,HFFS]E`2qSUdA>KmUtNDRW7QGOQheQ.b2=,[CU-]5=93*e]LKJS?n:P^.l?Sgl$q[9$ptHg.KFtr</\T\k5ON'tUEuf"s8RVV!!rj,Nq>PoJB@IYY+eHfErR@RF:+mtRQl-ad_U4\?,R.6bUYeZ[@R&%`09!)(]fg%B40CUtif'mA><JbXfT_mA]*M:5])J_[oj1Yf.\)ees\Z5EiV&O-Wi-rS1U79qJu+5[u"Y9lhK^uJL$j8!ljbZ_F0Q,_m]k_lJ/:7BXMS&hPEaO^K^U>;K+lUm$EZNMj;"e[ZX?gC&*;m*o6_1Z*FP4d_qgOJH@5)sqn&XhJj`m[&loT#Z4'"EH#(R2N7(:WNRJ]W/*^ib7Ph2.\QE9i<](pJf8#4pYo>?=p\V<[n-dtDDq'A#+$BW.3f):#aOElS);_`aLOj6$EO@O52$95t,nS*<@&RpUh4Mb_F+2g8-afqQg2pI\hZ8ZDQ[VHZpqjJ%Tk$H*?s-K[bn:clmF$)<mPG[ji<ptpWV_Vo1RHH4D<MA)g-:4`@k01Qn/N8!p1eGAi(Ddc\-^@;:cDRGml-k>T1oSiSsK2aBt]a`4,E;fpC<#Bu~>endstream
+endobj
+11 0 obj
+<<
+/Filter [ /ASCII85Decode /FlateDecode ] /Length 1609
+>>
+stream
+Gau`SgN)%,&:N_Clr0h,`!gW3kbn8D2ju.X/'IYYOelHD/M@H&g%F6HEKS1MACm9t9V$15969hY%M"!mJI)8fqgVoQSBp0C'`gX0rW%V,*9La%k<YJ+-#!cr,&"h"4pd.HJG(^rD6QQ!87Nf/E=sad-tkJ#HjE(9SUf(?&VX#8DjUj<=;4;:Z)C10\&9(/.)ZF5g#a%IHp8O1VtX9W"?sZpfl]?.TAY$CG*2b*o=n]4_%t0+)9%ELGoVYDT7k-\D".cV(+osEIR#?+J9U8=E]Sj=flVOoR'YNRTQ0RKHB6/Bo'6ih74b,H6:Dc4"CZ-3i%Y$;)8a<IJI2NmN[=<i\9UTPb#Fj`Ec85<Q$G6uR#e,.Za&J#2S(u>Vf8&QS\fJ(ro7\[email protected]@IjGcBEfk$bg)s]]Gh_rg,$gVZMFjMXBour9b!Z]\tZ1u+rR+8KZ"=82[i%>30<I>=>K"SMaXI?KYt=OA_pB)&/)"Ef56Y8h,+4Cf)nnQGh&%:O0EAW]!n>8fBMSH;BHX;3C4$8,mNsQRGj$NDVDiWA7$lo@(eU7!_I2>Bsc\2^./lo)s+/8.`g=%WulJ\li&"1^:>2=f^l%<(0TN\QFBT?6,.6D+'Y?\O8C<nqdJHp,U%a%TFQVV*`8j;`hg(8[$$L_l2JKB;N#cJ(#(\To"\?/,>)nMLi'*+[jIkqjp&a@AKZ@Eisk$r2Z1u(PedoS'4pJ!p#a(G^b$ggKMo>K,a8Si<^J,&-al*X&/3ta_N>GUXAu!K)`9p5ND"MT:D1Z>.IV6"CG!Nlf>d@n]205pc%s^$JtPsF;Ro38PCkjZZK6XZ!2VJ6lo#4:nb&?5SUYn1)L,76$>0tTB%/RpP(9m4-Jma@8Ei^@9R5&7O*7<r:3Y5Ma,jmb9:E3bi-1m9MTog+ZRD+s,2%u7+pXge@J4L%R<-qk`jVRQ/q)PG+HIrA"+05"AWOunj;?WBNj4/r(`U]4Et!EHZKsTp8*iR)*1P?]B2L4,<")/b`?<YjL-9<Tp7/OY3\aIfVX>\58)k]!GO]S<@@4ii*OWqA[>^P`2^%-YDEa^4m28Drm@hLhp5HE0hBips[2GC_Sj?dcHU>;C`[*t<6ChVoB.QG"^#d(STifmCmWZ#37\`7C:?i=m93jC[*K"dr`FFXl'+E?eFl0nQ.kch?D;sI)Kg+S1UModK%(d3>V<a!k0%-5Y_qK`Eok>(00(DZ>=!nO@oPC">Ip`BL-A#B]#3!!sY1pD3$Wq!9T`Cd*&?k`@bVsRS;.."eI7LF@43)f,Ib+2='al$')-Lq9Y'r0*mb/.!YTnG9MUFOf6*%c&Fk?*&I^R@^(--Z:Y@CmRf57irk<68nYg>ObG"9uOjBtN`SK,PeEAX)]1NU)\[g>$F);Zq4;Rl`h*N(S49i<rHnQL*(ISC!NE&5+4Xi`u>O>h<Sjo$WMrH_<t^HNHFffVL_qW(6"Ml$sV5?YBDF]d-h=]m;98-\g*/cX_LTZgFjWpst)B;HoL_!\eZ?VVcXSH5'#hIKgGl1R[jYM[>_h?&2SH=`FAQS8#@?0[L'H09E,K=^;iB.jt$l1u2bp=Nsl'Q3TOqPhif=RPHc\-=)N(X[Z156~>endstream
+endobj
+xref
+0 12
+0000000000 65535 f
+0000000061 00000 n
+0000000112 00000 n
+0000000219 00000 n
+0000000331 00000 n
+0000000440 00000 n
+0000000644 00000 n
+0000000848 00000 n
+0000000916 00000 n
+0000001345 00000 n
+0000001410 00000 n
+0000002928 00000 n
+trailer
+<<
+/ID
+[<c8f9545b8cfecb030af9f811fe465d1b><c8f9545b8cfecb030af9f811fe465d1b>]
+% ReportLab generated PDF document -- digest (opensource)
+
+/Info 8 0 R
+/Root 7 0 R
+/Size 12
+>>
+startxref
+4629
+%%EOF
diff --git a/docs/scripts/check-links.ts b/docs/scripts/check-links.ts
index 32608165c9..a216f01676 100644
--- a/docs/scripts/check-links.ts
+++ b/docs/scripts/check-links.ts
@@ -128,6 +128,8 @@ export async function checkLinks(files: FileObject[], scanned: ScanResult, check
'.mp4',
'.webm',
'.pdf',
+ '.csv',
+ '.geojson',
'.css',
'.js',
'.woff',
diff --git a/docs/src/components/video-demo.tsx b/docs/src/components/video-demo.tsx
index 3db282a384..effa095e90 100644
--- a/docs/src/components/video-demo.tsx
+++ b/docs/src/components/video-demo.tsx
@@ -6,6 +6,10 @@ interface VideoDemoProps {
title: string;
sourceUrl?: string;
className?: string;
+ aspectRatio?: number;
+ autoPlay?: boolean;
+ loop?: boolean;
+ preload?: 'none' | 'metadata' | 'auto';
children?: ReactNode;
}
@@ -14,7 +18,18 @@ function withDocsBasePath(path: string) {
return `/docs${path}`;
}
-export function VideoDemo({ src, poster, title, sourceUrl, className, children }: VideoDemoProps) {
+export function VideoDemo({
+ src,
+ poster,
+ title,
+ sourceUrl,
+ className,
+ aspectRatio = 16 / 9,
+ autoPlay = false,
+ loop = false,
+ preload = 'metadata',
+ children,
+}: VideoDemoProps) {
const mediaSrc = withDocsBasePath(src);
const mediaPoster = withDocsBasePath(poster);
@@ -29,11 +44,15 @@ export function VideoDemo({ src, poster, title, sourceUrl, className, children }
>
<video
aria-label={title}
- className="block aspect-video w-full bg-black object-contain"
+ autoPlay={autoPlay}
+ className="block w-full bg-black object-contain"
controls
+ loop={loop}
+ muted
playsInline
poster={mediaPoster}
- preload="metadata"
+ preload={preload}
+ style={{ aspectRatio }}
>
<source src={mediaSrc} type="video/mp4" />
<a href={mediaSrc}>Open the video.</a>