Skip to content

armgit / cua

Public Imported from GitHub
0

Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.

Update Agent Loop Test (#530)

Adamce100d40bbfa
diff --git a/.github/workflows/test-cua-models.yml b/.github/workflows/test-cua-models.yml
index 646bf7ecd0..d002ff790a 100644
--- a/.github/workflows/test-cua-models.yml
+++ b/.github/workflows/test-cua-models.yml
@@ -5,7 +5,7 @@ name: Test CUA Supporting Models
on:
pull_request:
- branches: [ main, master ]
+ branches: [main, master]
workflow_dispatch:
inputs:
test_models:
@@ -95,17 +95,15 @@ jobs:
pip install "cua-agent[uitars-hf]"
pip install pytest
- - name: Set up environment variables
- run: |
- echo "ANTHROPIC_API_KEY=${{ secrets.ANTHROPIC_API_KEY }}" >> $GITHUB_ENV
- echo "OPENAI_API_KEY=${{ secrets.OPENAI_API_KEY }}" >> $GITHUB_ENV
- echo "GOOGLE_API_KEY=${{ secrets.GOOGLE_API_KEY }}" >> $GITHUB_ENV
- echo "OPENROUTER_API_KEY=${{ secrets.OPENROUTER_API_KEY }}" >> $GITHUB_ENV
-
- name: Test model with agent loop
run: |
cd tests/agent_loop_testing
python agent_test.py --model "${{ matrix.model }}"
+ env:
+ ANTHROPIC_API_KEY: ${{ secrets.ANTHROPIC_API_KEY }}
+ # OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+ # GOOGLE_API_KEY: ${{ secrets.GOOGLE_API_KEY }}
+ # OPENROUTER_API_KEY: ${{ secrets.OPENROUTER_API_KEY }}
- name: Upload test results
if: always()
diff --git a/tests/agent_loop_testing/README.md b/tests/agent_loop_testing/README.md
index 48712d901a..7f4b9efe3b 100644
--- a/tests/agent_loop_testing/README.md
+++ b/tests/agent_loop_testing/README.md
@@ -12,7 +12,7 @@ python tests/agent_loop_testing/agent_test.py --model anthropic/claude-sonnet-4-
- Tests real CUA ComputerAgent SDK
- Uses mock computer (only screenshots, no real actions)
-- Agent tries to "Open Safari browser"
+- Agent tries to "Open Safari browser"
- Runs up to 5 iterations
- Shows agent responses and tool calls
@@ -67,4 +67,4 @@ Iteration 3:
✅ Iterations: 3
✅ Screenshots: 3
✅ Agent executed successfully
-```
\ No newline at end of file
+```