Skip to content

armgit / cua

Public Imported from GitHub
0

Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.

fix cuabench links (#735)

Sarina Lia5d1f469ffa2
diff --git a/docs/content/docs/cuabench/guide/fundamentals/registry.mdx b/docs/content/docs/cuabench/guide/fundamentals/registry.mdx
index c12169649c..35f62a8fd0 100644
--- a/docs/content/docs/cuabench/guide/fundamentals/registry.mdx
+++ b/docs/content/docs/cuabench/guide/fundamentals/registry.mdx
@@ -3,7 +3,7 @@ title: Registry
description: The Cua-Bench registry of tasks and datasets.
---
-The [Cua-Bench registry](https://cuabench.ai/cuabench/registry) contains a collection of pre-built tasks and datasets for evaluating computer-use agents.
+The [Cua-Bench registry](https://cua.ai/docs/cuabench/guide/fundamentals/registry) contains a collection of pre-built tasks and datasets for evaluating computer-use agents.
Datasets are now part of the main [cua repository](https://github.com/trycua/cua) at [`libs/cua-bench/datasets`](https://github.com/trycua/cua/tree/main/libs/cua-bench/datasets).
@@ -50,9 +50,9 @@ export CUA_REGISTRY_HOME=/path/to/your/datasets
## Available Datasets
-| Dataset | Tasks | Description | Golden Environment |
-|---------|-------|-------------|-------------------|
-| `cua-bench-basic` | 13 | Basic UI interaction tasks (clicking, typing, dragging) | `simulated` |
+| Dataset | Tasks | Description | Golden Environment |
+| ----------------- | ----- | ------------------------------------------------------- | ------------------ |
+| `cua-bench-basic` | 13 | Basic UI interaction tasks (clicking, typing, dragging) | `simulated` |
## Dataset Structure
@@ -78,11 +78,7 @@ libs/cua-bench/datasets/
"version": "1.0.0",
"description": "Basic UI interaction tasks",
"platform": "simulated",
- "tasks": [
- "click-button",
- "typing-input",
- "drag-slider"
- ]
+ "tasks": ["click-button", "typing-input", "drag-slider"]
}
```
@@ -96,11 +92,12 @@ To contribute tasks to the registry:
4. Test locally with `cb interact tasks/your_task`
5. Submit a pull request to the main repository
-See [Creating Tasks](/cuabench/guide/creating-tasks) for task development guidance.
+See [Creating Tasks](/cuabench/guide/examples/universal-task) for task development guidance.
## Registry Location
By default, datasets are stored at:
+
- **Default**: `~/.cua/cua/libs/cua-bench/datasets/`
- **Custom**: Set `CUA_REGISTRY_HOME` environment variable
diff --git a/docs/content/docs/cuabench/guide/getting-started/first-steps.mdx b/docs/content/docs/cuabench/guide/getting-started/first-steps.mdx
index adc34ed54b..046ca5d7fe 100644
--- a/docs/content/docs/cuabench/guide/getting-started/first-steps.mdx
+++ b/docs/content/docs/cuabench/guide/getting-started/first-steps.mdx
@@ -108,7 +108,7 @@ Open the URL in your browser to explore the full execution trace.
Scale up to run an entire benchmark dataset with multiple tasks.
-The Cua-Bench CLI can run many different computer-use benchmarks and versions of benchmarks. To see available datasets, run `cb dataset list` or visit the [registry](http://cuabench.ai/cuabench/registry/).
+The Cua-Bench CLI can run many different computer-use benchmarks and versions of benchmarks. To see available datasets, run `cb dataset list` or visit the [registry](https://cua.ai/docs/cuabench/guide/fundamentals/registry).
### Step 1: Explore a Single Task
diff --git a/docs/content/docs/cuabench/guide/getting-started/introduction.mdx b/docs/content/docs/cuabench/guide/getting-started/introduction.mdx
index 0fee429386..9c042a793a 100644
--- a/docs/content/docs/cuabench/guide/getting-started/introduction.mdx
+++ b/docs/content/docs/cuabench/guide/getting-started/introduction.mdx
@@ -6,7 +6,11 @@ description: A benchmark to measure the capabilities of computer-use agents in d
**Cua-Bench** is a framework and set of tasks for evaluating how well AI agents can accomplish complex tasks on a desktop computer using primarily the keyboard and mouse, or on a mobile device using primarily the touchscreen.
<div className="not-prose relative rounded-xl overflow-hidden my-8 w-full">
- <img src="/docs/img/cua_bench_screenshots.png" alt="Cua" className="w-full h-auto rounded-xl border" />
+ <img
+ src="/docs/img/cua_bench_screenshots.png"
+ alt="Cua"
+ className="w-full h-auto rounded-xl border"
+ />
</div>
Examples of Cua-Bench tasks are:
@@ -30,7 +34,7 @@ Each task in Cua-Bench includes:
- a test script to verify if the agent completed the task successfully
- a reference ("oracle") solution that solves the task
-Check out our existing tasks [here](https://cuabench.ai/cuabench/registry)
+Check out our existing tasks [here](https://cua.ai/docs/cuabench/guide/fundamentals/registry)
# An environment harness
@@ -42,4 +46,4 @@ After [installing the package](/cuabench/guide/getting-started/installation), yo
1. [Install the CLI](/cuabench/guide/getting-started/installation)
2. [Run your first benchmark](/cuabench/guide/getting-started/first-steps)
-3. [Create custom tasks](/cuabench/guide/fundamentals/tasks)
\ No newline at end of file
+3. [Create custom tasks](/cuabench/guide/fundamentals/tasks)
diff --git a/libs/cua-bench/README.md b/libs/cua-bench/README.md
index 1510d2c271..31db1f5cd4 100644
--- a/libs/cua-bench/README.md
+++ b/libs/cua-bench/README.md
@@ -428,11 +428,11 @@ cb status # Show system status
## Documentation
-- **Full Documentation**: https://cuabench.ai/
-- **Getting Started**: https://cuabench.ai/cuabench/guide/getting-started
-- **CLI Reference**: https://cuabench.ai/cuabench/reference/cli-reference
-- **SDK Reference**: https://cuabench.ai/cuabench/reference/sdk-reference
-- **Creating Tasks**: https://cuabench.ai/cuabench/guide/creating-tasks
+- **Full Documentation**: https://cua.ai/docs/cuabench
+- **Getting Started**: https://cua.ai/docs/cuabench/guide/getting-started/introduction
+- **CLI Reference**: https://cua.ai/docs/cuabench/reference/cli-reference
+- **SDK Reference**: https://cua.ai/docs/cuabench/reference/sdk-reference
+- **Creating Tasks**: https://cua.ai/docs/cuabench/guide/examples/universal-task
## Examples