Computer use for the Pi coding agent — Windows apps, browsers and desktops through native UI trees, screenshots and real input.
TypeScript accessibilityagent-toolsai-agentbrowser-automationcomputer-usecuadesktop-automationelectronpipi-coding-agentpi-extensionpi-packageplaywrighttypescriptui-automationvisionwebview2windowswindows-automationwsl
Docs: soften Firefox note (LPT-968)
alexshpunt-clanker[bot]7ccfb6759d24
diff --git a/docs/computer-resources.md b/docs/computer-resources.mdindex e157e86..3b48f76 100644--- a/docs/computer-resources.md+++ b/docs/computer-resources.md@@ -199,7 +199,7 @@ Each page snapshot lists the tabs (`Tab t1 (active): title | url | load state`),A visible Chromium window shrinks for a moment while Chrome takes a screenshot with a clip or scale of its own, so the human would see a flash on every element crop and every page action's pixel comparison. The browser worker therefore takes one plain viewport screenshot, which does not move the window, and the host derives the image from it: an element crop is cut from it at the element's pixels, and the page image used by the change list is scaled to one pixel per CSS pixel (exactly `innerWidth` x `innerHeight`). The image the agent gets and its coordinates stay the same; an element crop is the same size as Chrome's own, and its pixels match except for slight resampling at fractional device pixels.-The worker falls back to Chrome's own screenshot, which can flash, when the derived image would not be exact: an element that is not wholly inside the viewport (for example taller than the window), a pinch-zoomed page, or a page that scrolls or resizes during the capture. Firefox does not flash and takes the same path.+The worker falls back to Chrome's own screenshot, which can flash, when the derived image would not be exact: an element that is not wholly inside the viewport (for example taller than the window), a pinch-zoomed page, or a page that scrolls or resizes during the capture. In testing Firefox showed no flash with this path.### Attach to a running browserdiff --git a/src/driver.ts b/src/driver.tsindex 4b3d1dd..69cec14 100644--- a/src/driver.ts+++ b/src/driver.ts@@ -87,7 +87,7 @@ export const WINDOW_RESTORE_RUNTIME = {/** Window management plus every earlier native capability; `windows-desktop` selects these bytes. Browser pages use Playwright, not this runtime. */export const WINDOW_MANAGEMENT_RUNTIME = {source: "e2c256dedd2deb04c4c2aff386118259fd193185", version: "0.37.0",- sha256: "a0dcdc383306e3476932e2527a220afeb0a7cd8b58fec6456f975c5ced0be3d4",+ sha256: "e37cbfb042853e7aea5cd78655d4058c09abf23146adf7975e7f6f087cd5cf6b",} as const;const forkRuntimes = {"windows-desktop": WINDOW_MANAGEMENT_RUNTIME,