Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.
Rust agentai-agentapplecomputer-usecomputer-use-agentcontainerizationcuadesktop-automationhacktoberfestlumemacosmanusoperatorswiftvirtualizationvirtualization-frameworkwindowswindows-sandbox
fix cuabench links (#735)
Sarina Lia5d1f469ffa2
diff --git a/docs/content/docs/cuabench/guide/fundamentals/registry.mdx b/docs/content/docs/cuabench/guide/fundamentals/registry.mdxindex c12169649c..35f62a8fd0 100644--- a/docs/content/docs/cuabench/guide/fundamentals/registry.mdx+++ b/docs/content/docs/cuabench/guide/fundamentals/registry.mdx@@ -3,7 +3,7 @@ title: Registrydescription: The Cua-Bench registry of tasks and datasets.----The [Cua-Bench registry](https://cuabench.ai/cuabench/registry) contains a collection of pre-built tasks and datasets for evaluating computer-use agents.+The [Cua-Bench registry](https://cua.ai/docs/cuabench/guide/fundamentals/registry) contains a collection of pre-built tasks and datasets for evaluating computer-use agents.Datasets are now part of the main [cua repository](https://github.com/trycua/cua) at [`libs/cua-bench/datasets`](https://github.com/trycua/cua/tree/main/libs/cua-bench/datasets).@@ -50,9 +50,9 @@ export CUA_REGISTRY_HOME=/path/to/your/datasets## Available Datasets-| Dataset | Tasks | Description | Golden Environment |-|---------|-------|-------------|-------------------|-| `cua-bench-basic` | 13 | Basic UI interaction tasks (clicking, typing, dragging) | `simulated` |+| Dataset | Tasks | Description | Golden Environment |+| ----------------- | ----- | ------------------------------------------------------- | ------------------ |+| `cua-bench-basic` | 13 | Basic UI interaction tasks (clicking, typing, dragging) | `simulated` |## Dataset Structure@@ -78,11 +78,7 @@ libs/cua-bench/datasets/"version": "1.0.0","description": "Basic UI interaction tasks","platform": "simulated",- "tasks": [- "click-button",- "typing-input",- "drag-slider"- ]+ "tasks": ["click-button", "typing-input", "drag-slider"]}```@@ -96,11 +92,12 @@ To contribute tasks to the registry:4. Test locally with `cb interact tasks/your_task`5. Submit a pull request to the main repository-See [Creating Tasks](/cuabench/guide/creating-tasks) for task development guidance.+See [Creating Tasks](/cuabench/guide/examples/universal-task) for task development guidance.## Registry LocationBy default, datasets are stored at:+- **Default**: `~/.cua/cua/libs/cua-bench/datasets/`- **Custom**: Set `CUA_REGISTRY_HOME` environment variablediff --git a/docs/content/docs/cuabench/guide/getting-started/first-steps.mdx b/docs/content/docs/cuabench/guide/getting-started/first-steps.mdxindex adc34ed54b..046ca5d7fe 100644--- a/docs/content/docs/cuabench/guide/getting-started/first-steps.mdx+++ b/docs/content/docs/cuabench/guide/getting-started/first-steps.mdx@@ -108,7 +108,7 @@ Open the URL in your browser to explore the full execution trace.Scale up to run an entire benchmark dataset with multiple tasks.-The Cua-Bench CLI can run many different computer-use benchmarks and versions of benchmarks. To see available datasets, run `cb dataset list` or visit the [registry](http://cuabench.ai/cuabench/registry/).+The Cua-Bench CLI can run many different computer-use benchmarks and versions of benchmarks. To see available datasets, run `cb dataset list` or visit the [registry](https://cua.ai/docs/cuabench/guide/fundamentals/registry).### Step 1: Explore a Single Taskdiff --git a/docs/content/docs/cuabench/guide/getting-started/introduction.mdx b/docs/content/docs/cuabench/guide/getting-started/introduction.mdxindex 0fee429386..9c042a793a 100644--- a/docs/content/docs/cuabench/guide/getting-started/introduction.mdx+++ b/docs/content/docs/cuabench/guide/getting-started/introduction.mdx@@ -6,7 +6,11 @@ description: A benchmark to measure the capabilities of computer-use agents in d**Cua-Bench** is a framework and set of tasks for evaluating how well AI agents can accomplish complex tasks on a desktop computer using primarily the keyboard and mouse, or on a mobile device using primarily the touchscreen.<div className="not-prose relative rounded-xl overflow-hidden my-8 w-full">- <img src="/docs/img/cua_bench_screenshots.png" alt="Cua" className="w-full h-auto rounded-xl border" />+ <img+ src="/docs/img/cua_bench_screenshots.png"+ alt="Cua"+ className="w-full h-auto rounded-xl border"+ /></div>Examples of Cua-Bench tasks are:@@ -30,7 +34,7 @@ Each task in Cua-Bench includes:- a test script to verify if the agent completed the task successfully- a reference ("oracle") solution that solves the task-Check out our existing tasks [here](https://cuabench.ai/cuabench/registry)+Check out our existing tasks [here](https://cua.ai/docs/cuabench/guide/fundamentals/registry)# An environment harness@@ -42,4 +46,4 @@ After [installing the package](/cuabench/guide/getting-started/installation), yo1. [Install the CLI](/cuabench/guide/getting-started/installation)2. [Run your first benchmark](/cuabench/guide/getting-started/first-steps)-3. [Create custom tasks](/cuabench/guide/fundamentals/tasks)\ No newline at end of file+3. [Create custom tasks](/cuabench/guide/fundamentals/tasks)diff --git a/libs/cua-bench/README.md b/libs/cua-bench/README.mdindex 1510d2c271..31db1f5cd4 100644--- a/libs/cua-bench/README.md+++ b/libs/cua-bench/README.md@@ -428,11 +428,11 @@ cb status # Show system status## Documentation-- **Full Documentation**: https://cuabench.ai/-- **Getting Started**: https://cuabench.ai/cuabench/guide/getting-started-- **CLI Reference**: https://cuabench.ai/cuabench/reference/cli-reference-- **SDK Reference**: https://cuabench.ai/cuabench/reference/sdk-reference-- **Creating Tasks**: https://cuabench.ai/cuabench/guide/creating-tasks+- **Full Documentation**: https://cua.ai/docs/cuabench+- **Getting Started**: https://cua.ai/docs/cuabench/guide/getting-started/introduction+- **CLI Reference**: https://cua.ai/docs/cuabench/reference/cli-reference+- **SDK Reference**: https://cua.ai/docs/cuabench/reference/sdk-reference+- **Creating Tasks**: https://cua.ai/docs/cuabench/guide/examples/universal-task## Examples