Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.
Rust agentai-agentapplecomputer-usecomputer-use-agentcontainerizationcuadesktop-automationhacktoberfestlumemacosmanusoperatorswiftvirtualizationvirtualization-frameworkwindowswindows-sandbox
Commits on main
perf(cua-driver): leaner window reads: collapse closed menus, drop noise rows and metadata (#4892)
c1c2b5f Francesco Bonacci committed 1 month ago
fix(cua-driver): one-turn route for background-refused batch steps and index-less name misses (#4891)
0188a55 Francesco Bonacci committed 1 month ago
fix(keyvault): delete items whose delivery target or import is gone (#4889)
cf1217c ddupont committed 1 month ago
feat(cua-driver): capture GNOME windows from their own actor (WinRects v10) (#4882)
78212ad Francesco Bonacci committed 1 month ago
perf(cua-driver): reuse one session-bus connection for the GNOME helper (#4879)
48cc491 Francesco Bonacci committed 1 month ago
fix(cua-driver): run menu-bar item tokens as invoke_menu and keep rows for stale-token re-finds (#4886)
4c2403f Francesco Bonacci committed 1 month ago
fix(cua-driver): scroll Electron windows in the background through accessibility (#4861)
ea32762 Francesco Bonacci committed 1 month ago
feat(spaces): empty home with one-click Linux and macOS create (#4870)
2e4736b injaneity committed 1 month ago
feat(cua-driver): add display_only to get_window_state for live previews (#4881)
4cbd096 Francesco Bonacci committed 1 month ago
fix(cua-driver): wait for EIS to acknowledge libei input before replying (#4880)
9487b0f Francesco Bonacci committed 1 month ago
fix(cua-driver): pass CUA_DRIVER_RS_ENABLE_WAYLAND through to embedded hosts (#4877)
07cbc6c Francesco Bonacci committed 1 month ago
fix(cli): unselect a direct cua do target that stops answering (#4868)
97ef165 injaneity committed 1 month ago
fix(cua-driver): refuse background pixel clicks LibreOffice cannot receive (#4864)
49e924c Francesco Bonacci committed 1 month ago
fix(cua-driver): break same-name ties by exact role and the acting tool in run_actions finds (#4863)
2ad9d62 Francesco Bonacci committed 1 month ago
fix(cua-spacesd): connect hosted machines through HTTP proxies (#4778)
853e2c5 injaneity committed 1 month ago
fix(cua-driver): say when a tooltip needs the app under the pointer active (#4865)
7dbead0 Francesco Bonacci committed 1 month ago
fix(cua-driver): accept invoke_menu and zoom shapes models send, point named direct actions to run_actions (#4862)
7b3a8ee Francesco Bonacci committed 1 month ago
fix(cua-driver): refuse background submits into a Chromium address bar (#4856)
3532ba5 Francesco Bonacci committed 1 month ago
fix(cua-driver): make run_actions take the shapes models send and recover from stale targets (#4859)
6e74bfa Francesco Bonacci committed 1 month ago
fix(cua-driver): let a get_window_state query search the whole window (#4855)
902934b Francesco Bonacci committed 1 month ago
fix(cua-driver): accept common spellings of key names on macOS (#4858)
b7fef18 Francesco Bonacci committed 1 month ago
fix(cua-driver): post a mouse-moved event after a desktop pointer warp on macOS (#4854)
7de3dbc Francesco Bonacci committed 1 month ago
fix(cua-driver): list the menu items when an invoke_menu segment is missing (#4857)
54656d6 Francesco Bonacci committed 1 month ago
feat(cua-driver): experimental run_script tool (JavaScript, opt-in) (#4822)
45469a5 Francesco Bonacci committed 1 month ago
fix(cua-spaces): name a local Space what it was created as (#4849)
b0a6348 ddupont committed 1 month ago
fix(spaces): boot local Windows VMs from AHCI like the image build (#4851)
7d0354f ddupont committed 1 month ago
fix(cua-spacesd): stream 6K displays and carry tool results over 4 MiB (#4850)
a88f100 ddupont committed 1 month ago
fix(spaces): register gVisor with --allow-suid so the Space user can sudo and mount FUSE (#4852)
cacc440 ddupont committed 1 month ago
fix(cua-vmm): detect live processes on Windows in pid_alive (#4845)
43e4c42 ddupont committed 1 month ago