Skip to content

Computer use for the Pi coding agent — Windows apps, browsers and desktops through native UI trees, screenshots and real input.

docs: explain deferred Computer Use metadata and source compatibility

alexshpunt-clanker[bot]a798aa70af17
diff --git a/README.md b/README.md
index c8062e6..a587f51 100644
--- a/README.md
+++ b/README.md
@@ -44,7 +44,7 @@ Native capture and input come from our fork of [Cua Driver](https://github.com/t
Every action has its own tool with typed fields: `computer_open`, `computer_click`, `computer_type`, `computer_wait`, `computer_browser` and so on. They stay out of the tool list until the agent looks for them with `tool_search`, so a session that never touches the computer pays nothing for them.
-If you have [Pi Agent IDE](https://github.com/alexshpunt/pi-agent-ide), looking goes through its `read`, `search` and `delete` tools, so the agent uses the same tools for files and windows, and the results show up in the IDE's tool panels. Without the IDE, computer use adds `computer_read`, `computer_search` and `computer_delete` instead. Both modes take the same addresses, return the same results and work from Codemode scripts. Each Pi session picks the mode itself, so you don't configure anything.
+If you have [Pi Agent IDE](https://github.com/alexshpunt/pi-agent-ide), looking goes through its `read`, `search` and `delete` tools, so the agent uses the same tools for files and windows, and the results show up in the IDE's tool panels. Without the IDE, computer use adds `computer_read`, `computer_search` and `computer_delete` instead. Both modes take the same addresses, return the same results and work from Codemode scripts. Each Pi session picks the mode itself, so you don't configure anything. Computer-address help in the shared tools loads on demand too; [Computer resources](docs/computer-resources.md) explains discovery.
### YOLO and Safe mode
diff --git a/docs/computer-resources.md b/docs/computer-resources.md
index acd88d6..fbdc675 100644
--- a/docs/computer-resources.md
+++ b/docs/computer-resources.md
@@ -2,6 +2,8 @@
- Load the `computer_*` tools with `tool_search`, one group per query: `computer open window`, `computer wait browser`, `computer files clipboard record`, `computer click hover drag scroll`, `computer type press select timeline`, `computer view viewport`.
- The `/computer-*` commands belong to the user: when a refusal names one, ask the user to run it.
+- In IDE mode, native discovery of a `computer_*` action or `ide_capability_computer` loads computer-address help into the shared tools. Use the loader for a resource-only workflow. The first associated Codemode call loads that help too; `searchTools`, `describeTool` and `describeNamespace` leave it unloaded.
+- Ordinary file calls and a direct computer-address {read} do not activate schema help. A direct computer-address {read} still works and loads this guide.
## Addresses
diff --git a/docs/setup.md b/docs/setup.md
index 758227b..45c3244 100644
--- a/docs/setup.md
+++ b/docs/setup.md
@@ -84,7 +84,7 @@ The marker check and driver dispatch are separate native operations, not an atom
## Development
-Load exactly one copy of the extension: point its package entry in your Pi settings at the checkout you are working on, and point it back when you are done. Loading the package and a project wrapper together registers every tool twice. In a fresh checkout run `npm ci --ignore-scripts --legacy-peer-deps`, then `npm run dev:ide -- /absolute/path/to/pi-agent-ide` to link the IDE SDK.
+Load exactly one copy of the extension: point its package entry in your Pi settings at the checkout you are working on, and point it back when you are done. Loading the package and a project wrapper together registers every tool twice. In a fresh checkout run `npm ci --ignore-scripts --legacy-peer-deps`, then `npm run dev:ide -- /absolute/path/to/pi-agent-ide` to link the IDE SDK. Check that the linked source exports `pi-agent-ide/api/capabilities`; a matching version alone does not establish API availability.
```bash
npm run typecheck