Computer use for the Pi coding agent — Windows apps, browsers and desktops through native UI trees, screenshots and real input.
TypeScript accessibilityagent-toolsai-agentbrowser-automationcomputer-usecuadesktop-automationelectronpipi-coding-agentpi-extensionpi-packageplaywrighttypescriptui-automationvisionwebview2windowswindows-automationwsl
Skill: send a manoeuvre against a moving target as one timeline (LPT-960)
alexshpunt-clanker[bot]d267d325dd09
diff --git a/.pi/skills/computer-use/SKILL.md b/.pi/skills/computer-use/SKILL.mdindex 4f9e2d4..d3e18ec 100644--- a/.pi/skills/computer-use/SKILL.md+++ b/.pi/skills/computer-use/SKILL.md@@ -33,7 +33,7 @@ Know the target, expected effect and stopping point before input. The input toolReported disabled controls cannot act. A ref or locator is pressed through UI Automation in the background; when the element has no pattern for the action the call uses the real pointer and says so. Points, drags, keys and typing are real input: the window comes to the front. If a UI Automation press is delivered but the app does not react, click the point instead. If real input refuses because the human is using the computer, wait the stated time; never race the human. If it refuses because another window covers the point, deal with the window it names first. Never replace a refusal with global input, another backend or a browser script.-For timed input, a button or key held across moves, wheel during a drag, raw relative motion for pointer-locked apps or a pen with pressure and tilt, use one `computer_timeline`. Stop at navigation, a new dialog, changed layout or an effect requiring a new decision. Several known steps go into one Codemode script that checks each receipt. Stop on an `unknown` outcome or cancellation; never replay completed or uncertain input.+For timed input, a button or key held across moves, wheel during a drag, raw relative motion for pointer-locked apps or a pen with pressure and tilt, use one `computer_timeline`. Each input call returns only after its change list: about 0.2 s after the input on a light page and up to 2 s on a heavy animated one. Against a moving target, such as traffic in a game, send the whole manoeuvre as one timeline planned from a measured motion model rather than a loop of short calls with feedback between them. Stop at navigation, a new dialog, changed layout or an effect requiring a new decision. Several known steps go into one Codemode script that checks each receipt. Stop on an `unknown` outcome or cancellation; never replay completed or uncertain input.## Check