Computer use for the Pi coding agent — Windows apps, browsers and desktops through native UI trees, screenshots and real input.
TypeScript accessibilityagent-toolsai-agentbrowser-automationcomputer-usecuadesktop-automationelectronpipi-coding-agentpi-extensionpi-packageplaywrighttypescriptui-automationvisionwebview2windowswindows-automationwsl
Commits on main
test: tool_search loads the typed tools per query (LPT-934)
4d1b17a alexshpunt-clanker[bot] committed 25 days ago
feat: typed computer_wait and computer_browser (LPT-934 step 2)
93e47cc alexshpunt-clanker[bot] committed 25 days ago
Merge pull request #67 from alexshpunt/feat/lpt-934-typed-tools
8a760da alexshpunt-clanker[bot] committed 25 days ago
docs: name computer_delete among the standalone tools (LPT-934)
5a451fb alexshpunt-clanker[bot] committed 25 days ago
fix: Delete's force option resolves through the IDE and malformed addresses refuse (LPT-934)
93625d9 alexshpunt-clanker[bot] committed 25 days ago
test: live computer_window and Delete on a configured machine (LPT-934)
d70fbfe alexshpunt-clanker[bot] committed 25 days ago
feat: typed computer_open, computer_window, computer_display and Delete for computer resources (LPT-934)
73e7b1f alexshpunt-clanker[bot] committed 25 days ago
Merge pull request #66 from alexshpunt/feat/lpt-932-short-addresses
73556ac alexshpunt-clanker[bot] committed 25 days ago
Tests read short addresses from presented text (LPT-932)
78f61cb alexshpunt-clanker[bot] committed 25 days ago
Short addresses and agent-given window names (LPT-932)
8e7d0a2 alexshpunt-clanker[bot] committed 25 days ago
Merge pull request #65 from alexshpunt/feat/lpt-925-contact-sheet
06614ac alexshpunt-clanker[bot] committed 25 days ago
Read a sequence as one contact sheet or per-pixel composite (LPT-925)
dc79ae3 alexshpunt-clanker[bot] committed 25 days ago
Merge pull request #64 from alexshpunt/feat/lpt-929-machine-addresses
e9ecdf8 alexshpunt-clanker[bot] committed 25 days ago
Live check: a display reference is unknown on another machine (LPT-924)
6436b77 alexshpunt-clanker[bot] committed 25 days ago
Route every computer address to the machine that issued it (LPT-929, LPT-924)
7d3fa3b alexshpunt-clanker[bot] committed 25 days ago
Merge pull request #63 from alexshpunt/fix/lpt-907-dpi-unaware-overviews
dc4252d alexshpunt-clanker[bot] committed 26 days ago
Pin runtime f754b104: overviews of DPI-unaware windows fill the image and match their UI (LPT-907)
005cf46 alexshpunt-clanker[bot] committed 26 days ago
Merge pull request #62 from alexshpunt/feat/lpt-916-jumping-cursor
24c59fe alexshpunt-clanker[bot] committed 26 days ago
Agent cursor setting tolerates a driver without an overlay; live click speed check (LPT-916)
7e9ebf4 alexshpunt-clanker[bot] committed 26 days ago
The agent cursor jumps to each action point instead of gliding (LPT-916)
857dd97 alexshpunt-clanker[bot] committed 26 days ago
Merge pull request #61 from alexshpunt/feat/lpt-915-pixel-diff
7e5bdcc alexshpunt-clanker[bot] committed 26 days ago
Follow-ups keep their session and stop after a cancel (LPT-915)
3ec69ac alexshpunt-clanker[bot] committed 26 days ago
Group pixel changes into areas, crop the largest, document the pixel change list (LPT-915)
31b985f alexshpunt-clanker[bot] committed 26 days ago
WIP: actions report the changed area of the window's pixels (LPT-915)
04e3a54 alexshpunt-clanker[bot] committed 26 days ago
Merge pull request #60 from alexshpunt/feat/lpt-914-diff-by-default
45d4171 alexshpunt-clanker[bot] committed 26 days ago
Report what every element action changed, by default (LPT-914)
eddae01 alexshpunt-clanker[bot] committed 26 days ago
Merge pull request #59 from alexshpunt/feat/lpt-911-full-uia-tree
02996ef alexshpunt-clanker[bot] committed 26 days ago