Skip to content

armgit / cua

Public Imported from GitHub
0

Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.

latest notebook

Dillon DuPontaf4a328cec04
diff --git a/notebooks/ollama_nb.ipynb b/notebooks/ollama_nb.ipynb
index 52303fa87a..7bb572842b 100644
--- a/notebooks/ollama_nb.ipynb
+++ b/notebooks/ollama_nb.ipynb
@@ -23,10 +23,19 @@
"source": [
"## πŸ’» Prerequisites\n",
"\n",
- "- Install [Ollama](https://ollama.com/) (optional, but recommended for this notebook)\n",
- "- Install [Docker Desktop](https://www.docker.com/products/docker-desktop/).\n",
- "- Install Python dependencies for this repo (we recommend [pdm](https://pdm-project.org/en/latest/#recommended-installation-method)).\n",
- "- Ensure you can run Jupyter notebooks in this repository's `.venv`.\n"
+ "The easiest way to get started is by getting set up with the Cua development repository.\n",
+ "\n",
+ "Install [Docker](https://www.docker.com/products/docker-desktop/), [pdm](https://pdm-project.org/en/latest/#recommended-installation-method), and [Ollama](https://ollama.com/) (optional, but recommended for this notebook).\n",
+ "\n",
+ "Clone the Cua repository:\n",
+ "\n",
+ "`git clone https://github.com/trycua/cua`\n",
+ "\n",
+ "Install the project dependencies:\n",
+ "\n",
+ "`cd cua && pdm install`\n",
+ "\n",
+ "Now, you should be able to run the `notebooks/hud_hackathon.ipynb` notebook in VS Code with the `.venv` virtual environment selected."
]
},
{
@@ -210,7 +219,7 @@
"import logging\n",
"\n",
"agent_composed = ComputerAgent(\n",
- " model=\"openai/computer-use-preview+ollama/gemma3:4b\",\n",
+ " model=\"anthropic/claude-3-5-sonnet-20241022+ollama/gemma3:4b\",\n",
" tools=[computer],\n",
" trajectory_dir='trajectories',\n",
" only_n_most_recent_images=3,\n",
@@ -228,16 +237,18 @@
"id": "section-3-conceptual",
"metadata": {},
"source": [
- "## 3) Customize your agent (ideas only)\n",
+ "## 3) Customize your agent πŸ› οΈ\n",
"\n",
- "Rather than providing runnable code here, see the Cua docs for a full menu of customization options: https://docs.trycua.com/docs/agent-sdk/customizing-computeragent\n",
+ "For a few customization options, see: https://docs.trycua.com/docs/agent-sdk/customizing-computeragent\n",
"\n",
"Levels of customization you can explore:\n",
"\n",
"1) Simple β€” Prompt engineering\n",
"2) Easy β€” Tools\n",
"3) Intermediate β€” Callbacks\n",
- "4) Expert β€” Custom agent via `register_agent` (see `libs/python/agent/agent/decorators.py` β†’ `register_agent`)\n"
+ "4) Expert β€” Custom agent via `register_agent` (see `libs/python/agent/agent/decorators.py` β†’ `register_agent`)\n",
+ "\n",
+ "or, incorporate the ComputerAgent into your own agent framework!\n"
]
},
{