Computer use for the Pi coding agent — Windows apps, browsers and desktops through native UI trees, screenshots and real input.
TypeScript accessibilityagent-toolsai-agentbrowser-automationcomputer-usecuadesktop-automationelectronpipi-coding-agentpi-extensionpi-packageplaywrighttypescriptui-automationvisionwebview2windowswindows-automationwsl
fix: ship the operating skill from the package skills directory
alexshpunt-clanker[bot]7bc0d92ad3b1
diff --git a/README.md b/README.mdindex 38c072b..dc5ca14 100644--- a/README.md+++ b/README.md@@ -183,7 +183,7 @@ I use this every day on real tasks, but I can only test the machines, apps and w| Document | Contents || --------------------------------------------------------- | --------------------------------------------------------------------- || [Computer resources](docs/computer-resources.md) | The agent guide `docs:computer`: rules the tool fields do not give |-| [Operating skill](.pi/skills/computer-use/SKILL.md) | How the agent observes, plans, acts and verifies |+| [Operating skill](skills/computer-use/SKILL.md) | How the agent observes, plans, acts and verifies || [Complete input](docs/complete-input.md) | Keys, pointer, drags, sequences and their limits || [Semantic actions](docs/semantic-actions.md) | UI Automation invoke, select and set value || [UI resources and hints](docs/ui-resources.md) | The native UI tree, hints and local UI operations |diff --git a/docs/complete-input.md b/docs/complete-input.mdindex c2635f7..a0fa3fa 100644--- a/docs/complete-input.md+++ b/docs/complete-input.md@@ -89,4 +89,4 @@ The area at or nearest to the input point comes first, otherwise the largest. InThis shows a stroke on a canvas or a moved sprite when the UI tree says nothing. Changes under 12 pixels and caret-shaped spots do not count. When the first capture shows no change, it looks again for up to 300 ms, then says `Nothing changed in the UI or the window's pixels within N ms`; check the target before repeating the action. When something changed, it captures until the window settles, for up to 1 second.-See the [operating skill](../.pi/skills/computer-use/SKILL.md).+See the [operating skill](../skills/computer-use/SKILL.md).diff --git a/docs/observation-granularity.md b/docs/observation-granularity.mdindex a178f1e..d6f251c 100644--- a/docs/observation-granularity.md+++ b/docs/observation-granularity.md@@ -24,4 +24,4 @@ Use UI-only when current reported labels, values and supported native control acImage-only accepts image guides but rejects UI query, walk limits and enabled hint labels. UI-only accepts UI query/walk limits but rejects hints and guides. Full keeps the existing controls. Invalid combinations fail explicitly rather than silently changing mode.-This avoids unnecessary capture work; it does not guarantee fresh paint, instant input or a fixed speedup. Temporal sequence frames remain read-only. See [the computer-use skill](../.pi/skills/computer-use/SKILL.md) for reaction loops.+This avoids unnecessary capture work; it does not guarantee fresh paint, instant input or a fixed speedup. Temporal sequence frames remain read-only. See [the computer-use skill](../skills/computer-use/SKILL.md) for reaction loops.diff --git a/package.json b/package.jsonindex 91fcfeb..53aeb0c 100644--- a/package.json+++ b/package.json@@ -53,7 +53,7 @@"./src/index.ts"],"skills": [- "./.pi/skills/computer-use"+ "./skills"],"image": "https://raw.githubusercontent.com/alexshpunt/pi-agent-computer-use/develop/assets/banner.png"},@@ -97,7 +97,7 @@"native-runtime/win32-x64/runtime/","native-runtime/win32-x64/runtime.source","vscode-browser-bridge/",- ".pi/skills/computer-use/",+ "skills/","docs/","assets/banner.png","LICENSE",diff --git a/.pi/skills/computer-use/SKILL.md b/skills/computer-use/SKILL.mdsimilarity index 100%rename from .pi/skills/computer-use/SKILL.mdrename to skills/computer-use/SKILL.md