Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.
Rust agentai-agentapplecomputer-usecomputer-use-agentcontainerizationcuadesktop-automationhacktoberfestlumemacosmanusoperatorswiftvirtualizationvirtualization-frameworkwindowswindows-sandbox
refactoring
Dillon DuPontda6917f83b84
diff --git a/notebooks/app_screenshots.py b/notebooks/diorama/draw.pysimilarity index 98%rename from notebooks/app_screenshots.pyrename to notebooks/diorama/draw.pyindex 42449b5271..99148ac32c 100644--- a/notebooks/app_screenshots.py+++ b/notebooks/diorama/draw.py@@ -1,8 +1,18 @@#!/usr/bin/env python3-"""App Screenshots - A standalone script to capture screenshots of running macOS applications+"""Diorama Renderer - A tool for rendering selective views of macOS desktops-This script captures screenshots of all running macOS applications and their windows,-preserving z-order information to allow for recomposition of the desktop.+This script renders filtered views of the macOS desktop, preserving only selected applications+while maintaining system UI elements like menubar and dock. Each "diorama" shows a consistent+view of the system while isolating specific applications.++The image is "smart resized" to remove any empty space around the menubar and dock.++Key features:+- Captures shared window state, z-order and position information+- Filters windows by application based on whitelist+- Preserves system context (menubar, dock) in each view+- Preserves menu-owning / keyboard-focused window in each view+- Supports parallel views of the same desktop for multi-agent systems"""import sys@@ -16,7 +26,7 @@ import ioimport asyncioimport functools-from ui_bounds_helper import (+from safezone import (get_menubar_bounds,get_dock_bounds,)diff --git a/notebooks/ui_bounds_helper.py b/notebooks/diorama/safezone.pysimilarity index 98%rename from notebooks/ui_bounds_helper.pyrename to notebooks/diorama/safezone.pyindex da5d0ec829..122b668ff5 100644--- a/notebooks/ui_bounds_helper.py+++ b/notebooks/diorama/safezone.py@@ -1,6 +1,6 @@#!/usr/bin/env python3"""-UI Bounds Helper - A utility to get accurate bounds for macOS UI elements+UI Safezone Helper - A utility to get accurate bounds for macOS UI elementsThis module provides helper functions to get accurate bounds for macOS UI elementslike the menubar and dock, which are needed for proper screenshot composition.