Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.
Rust agentai-agentapplecomputer-usecomputer-use-agentcontainerizationcuadesktop-automationhacktoberfestlumemacosmanusoperatorswiftvirtualizationvirtualization-frameworkwindowswindows-sandbox
Remove patch, use official mlx-vlm
Dillon DuPontc8e423625703
diff --git a/libs/agent/README.md b/libs/agent/README.mdindex 31d1accd3d..d1c82a5e25 100644--- a/libs/agent/README.md+++ b/libs/agent/README.md@@ -34,10 +34,7 @@ pip install "cua-agent[anthropic]" # Anthropic Cua Looppip install "cua-agent[uitars]" # UI-Tars supportpip install "cua-agent[omni]" # Cua Loop based on OmniParser (includes Ollama for local models)pip install "cua-agent[ui]" # Gradio UI for the agent--# For local UI-TARS with MLX support, you need to manually install mlx-vlm:-pip install "cua-agent[uitars-mlx]"-pip install git+https://github.com/ddupont808/mlx-vlm.git@stable/fix/qwen2-position-id # PR: https://github.com/Blaizzy/mlx-vlm/pull/349+pip install "cua-agent[uitars-mlx]" # MLX UI-Tars support```## Rundiff --git a/libs/agent/pyproject.toml b/libs/agent/pyproject.tomlindex 8ea6a3fc11..cb8617126a 100644--- a/libs/agent/pyproject.toml+++ b/libs/agent/pyproject.toml@@ -4,7 +4,7 @@ build-backend = "pdm.backend"[project]name = "cua-agent"-version = "0.1.0"+version = "0.2.0"description = "CUA (Computer Use) Agent for AI-driven computer interaction"readme = "README.md"authors = [@@ -38,8 +38,7 @@ uitars = ["httpx>=0.27.0,<0.29.0",]uitars-mlx = [- # The mlx-vlm package needs to be installed manually with:- # pip install git+https://github.com/ddupont808/mlx-vlm.git@stable/fix/qwen2-position-id+ "mlx-vlm>=0.1.27"]ui = ["gradio>=5.23.3,<6.0.0",@@ -88,9 +87,8 @@ all = ["requests>=2.31.0,<3.0.0","ollama>=0.4.7,<0.5.0","gradio>=5.23.3,<6.0.0",- "python-dotenv>=1.0.1,<2.0.0"- # mlx-vlm needs to be installed manually with:- # pip install git+https://github.com/ddupont808/mlx-vlm.git@stable/fix/qwen2-position-id+ "python-dotenv>=1.0.1,<2.0.0",+ "mlx-vlm>=0.1.27"][tool.pdm]diff --git a/scripts/playground.sh b/scripts/playground.shindex 4cdb1ffa97..9be712d289 100755--- a/scripts/playground.sh+++ b/scripts/playground.sh@@ -209,13 +209,6 @@ echo "📦 Updating C/ua packages..."pip install -U pip setuptools wheel Cmakepip install -U cua-computer "cua-agent[all]"-# Install mlx-vlm on Apple Silicon Macs-if [[ $(uname -m) == 'arm64' ]]; then- echo "Installing mlx-vlm for Apple Silicon Macs..."- pip install git+https://github.com/Blaizzy/mlx-vlm.git- # pip install git+https://github.com/ddupont808/mlx-vlm.git@stable/fix/qwen2-position-id-fi-# Create a simple demo scriptmkdir -p "$DEMO_DIR"