Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.
Rust agentai-agentapplecomputer-usecomputer-use-agentcontainerizationcuadesktop-automationhacktoberfestlumemacosmanusoperatorswiftvirtualizationvirtualization-frameworkwindowswindows-sandbox
latest notebook
Dillon DuPontaf4a328cec04
diff --git a/notebooks/ollama_nb.ipynb b/notebooks/ollama_nb.ipynbindex 52303fa87a..7bb572842b 100644--- a/notebooks/ollama_nb.ipynb+++ b/notebooks/ollama_nb.ipynb@@ -23,10 +23,19 @@"source": ["## π» Prerequisites\n","\n",- "- Install [Ollama](https://ollama.com/) (optional, but recommended for this notebook)\n",- "- Install [Docker Desktop](https://www.docker.com/products/docker-desktop/).\n",- "- Install Python dependencies for this repo (we recommend [pdm](https://pdm-project.org/en/latest/#recommended-installation-method)).\n",- "- Ensure you can run Jupyter notebooks in this repository's `.venv`.\n"+ "The easiest way to get started is by getting set up with the Cua development repository.\n",+ "\n",+ "Install [Docker](https://www.docker.com/products/docker-desktop/), [pdm](https://pdm-project.org/en/latest/#recommended-installation-method), and [Ollama](https://ollama.com/) (optional, but recommended for this notebook).\n",+ "\n",+ "Clone the Cua repository:\n",+ "\n",+ "`git clone https://github.com/trycua/cua`\n",+ "\n",+ "Install the project dependencies:\n",+ "\n",+ "`cd cua && pdm install`\n",+ "\n",+ "Now, you should be able to run the `notebooks/hud_hackathon.ipynb` notebook in VS Code with the `.venv` virtual environment selected."]},{@@ -210,7 +219,7 @@"import logging\n","\n","agent_composed = ComputerAgent(\n",- " model=\"openai/computer-use-preview+ollama/gemma3:4b\",\n",+ " model=\"anthropic/claude-3-5-sonnet-20241022+ollama/gemma3:4b\",\n"," tools=[computer],\n"," trajectory_dir='trajectories',\n"," only_n_most_recent_images=3,\n",@@ -228,16 +237,18 @@"id": "section-3-conceptual","metadata": {},"source": [- "## 3) Customize your agent (ideas only)\n",+ "## 3) Customize your agent π οΈ\n","\n",- "Rather than providing runnable code here, see the Cua docs for a full menu of customization options: https://docs.trycua.com/docs/agent-sdk/customizing-computeragent\n",+ "For a few customization options, see: https://docs.trycua.com/docs/agent-sdk/customizing-computeragent\n","\n","Levels of customization you can explore:\n","\n","1) Simple β Prompt engineering\n","2) Easy β Tools\n","3) Intermediate β Callbacks\n",- "4) Expert β Custom agent via `register_agent` (see `libs/python/agent/agent/decorators.py` β `register_agent`)\n"+ "4) Expert β Custom agent via `register_agent` (see `libs/python/agent/agent/decorators.py` β `register_agent`)\n",+ "\n",+ "or, incorporate the ComputerAgent into your own agent framework!\n"]},{