Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.
Rust agentai-agentapplecomputer-usecomputer-use-agentcontainerizationcuadesktop-automationhacktoberfestlumemacosmanusoperatorswiftvirtualizationvirtualization-frameworkwindowswindows-sandbox
Upgrade Claude 3.5 snapshot to a version with computer use support
James Murdza9a4c7215d841
diff --git a/docs/content/docs/agent-sdk/custom-computer-handlers.mdx b/docs/content/docs/agent-sdk/custom-computer-handlers.mdxindex a5b059600a..e087fc2127 100644--- a/docs/content/docs/agent-sdk/custom-computer-handlers.mdx+++ b/docs/content/docs/agent-sdk/custom-computer-handlers.mdx@@ -34,7 +34,7 @@ You can then use this as a tool for your agent:from agent import ComputerAgentagent = ComputerAgent(- model="anthropic/claude-3-5-sonnet-20240620",+ model="anthropic/claude-3-5-sonnet-20241022",tools=[custom_computer],)@@ -122,7 +122,7 @@ class MyCustomComputer(AsyncComputerHandler):custom_computer = MyCustomComputer()agent = ComputerAgent(- model="anthropic/claude-3-5-sonnet-20240620",+ model="anthropic/claude-3-5-sonnet-20241022",tools=[custom_computer],)diff --git a/docs/content/docs/agent-sdk/prompt-caching.mdx b/docs/content/docs/agent-sdk/prompt-caching.mdxindex 4c69f99f96..5049b4bb5f 100644--- a/docs/content/docs/agent-sdk/prompt-caching.mdx+++ b/docs/content/docs/agent-sdk/prompt-caching.mdx@@ -36,7 +36,7 @@ With the OpenAI provider, prompt caching is handled automatically for prompts of```pythonfrom agent import ComputerAgentagent = ComputerAgent(- model="anthropic/claude-3-5-sonnet-20240620",+ model="anthropic/claude-3-5-sonnet-20241022",use_prompt_caching=True,)```diff --git a/docs/content/docs/agent-sdk/sandboxed-tools.mdx b/docs/content/docs/agent-sdk/sandboxed-tools.mdxindex 0d71f8ef95..8fafce7a70 100644--- a/docs/content/docs/agent-sdk/sandboxed-tools.mdx+++ b/docs/content/docs/agent-sdk/sandboxed-tools.mdx@@ -25,7 +25,7 @@ from computer import Computercomputer = Computer(...)agent = ComputerAgent(- model="anthropic/claude-3-5-sonnet-20240620",+ model="anthropic/claude-3-5-sonnet-20241022",tools=[computer, read_file],)```diff --git a/docs/content/docs/agent-sdk/supported-agents/computer-use-agents.mdx b/docs/content/docs/agent-sdk/supported-agents/computer-use-agents.mdxindex 7aeab0432d..44ab41d1f1 100644--- a/docs/content/docs/agent-sdk/supported-agents/computer-use-agents.mdx+++ b/docs/content/docs/agent-sdk/supported-agents/computer-use-agents.mdx@@ -16,7 +16,7 @@ Claude models with computer-use capabilities:- Claude 4.1: `claude-opus-4-1-20250805`- Claude 4: `claude-opus-4-20250514`, `claude-sonnet-4-20250514`- Claude 3.7: `claude-3-7-sonnet-20250219`-- Claude 3.5: `claude-3-5-sonnet-20240620`+- Claude 3.5: `claude-3-5-sonnet-20241022````pythonagent = ComputerAgent("claude-3-5-sonnet-20241022", tools=[computer])diff --git a/docs/content/docs/agent-sdk/supported-agents/grounding-models.mdx b/docs/content/docs/agent-sdk/supported-agents/grounding-models.mdxindex 61c9a70bf9..65d254fef4 100644--- a/docs/content/docs/agent-sdk/supported-agents/grounding-models.mdx+++ b/docs/content/docs/agent-sdk/supported-agents/grounding-models.mdx@@ -16,7 +16,7 @@ All models that support `ComputerAgent.run()` also support `ComputerAgent.predic- Claude 4.1: `claude-opus-4-1-20250805`- Claude 4: `claude-opus-4-20250514`, `claude-sonnet-4-20250514`- Claude 3.7: `claude-3-7-sonnet-20250219`-- Claude 3.5: `claude-3-5-sonnet-20240620`+- Claude 3.5: `claude-3-5-sonnet-20241022`### OpenAI CUA Preview- Computer-use-preview: `computer-use-preview`diff --git a/examples/agent_examples.py b/examples/agent_examples.pyindex 4d211f7f27..816c18510e 100644--- a/examples/agent_examples.py+++ b/examples/agent_examples.py@@ -48,7 +48,7 @@ async def run_agent_example():# model="anthropic/claude-opus-4-20250514",# model="anthropic/claude-sonnet-4-20250514",# model="anthropic/claude-3-7-sonnet-20250219",- # model="anthropic/claude-3-5-sonnet-20240620",+ # model="anthropic/claude-3-5-sonnet-20241022",# == UI-TARS ==# model="huggingface-local/ByteDance-Seed/UI-TARS-1.5-7B",diff --git a/libs/python/agent/README.md b/libs/python/agent/README.mdindex f34692dbfa..35bb37433a 100644--- a/libs/python/agent/README.md+++ b/libs/python/agent/README.md@@ -84,7 +84,7 @@ if __name__ == "__main__":### Anthropic Claude (Computer Use API)```pythonmodel="anthropic/claude-3-5-sonnet-20241022"-model="anthropic/claude-3-5-sonnet-20240620"+model="anthropic/claude-3-7-sonnet-20250219"model="anthropic/claude-opus-4-20250514"model="anthropic/claude-sonnet-4-20250514"```diff --git a/libs/python/agent/agent/ui/gradio/app.py b/libs/python/agent/agent/ui/gradio/app.pyindex b7112f04d6..196194de18 100644--- a/libs/python/agent/agent/ui/gradio/app.py+++ b/libs/python/agent/agent/ui/gradio/app.py@@ -114,14 +114,14 @@ MODEL_MAPPINGS = {"Anthropic: Claude 4 Opus (20250514)": "anthropic/claude-opus-4-20250514","Anthropic: Claude 4 Sonnet (20250514)": "anthropic/claude-sonnet-4-20250514","Anthropic: Claude 3.7 Sonnet (20250219)": "anthropic/claude-3-7-sonnet-20250219",- "Anthropic: Claude 3.5 Sonnet (20240620)": "anthropic/claude-3-5-sonnet-20240620",+ "Anthropic: Claude 3.5 Sonnet (20241022)": "anthropic/claude-3-5-sonnet-20241022",},"omni": {"default": "omniparser+openai/gpt-4o","OMNI: OpenAI GPT-4o": "omniparser+openai/gpt-4o","OMNI: OpenAI GPT-4o mini": "omniparser+openai/gpt-4o-mini","OMNI: Claude 3.7 Sonnet (20250219)": "omniparser+anthropic/claude-3-7-sonnet-20250219",- "OMNI: Claude 3.5 Sonnet (20240620)": "omniparser+anthropic/claude-3-5-sonnet-20240620",+ "OMNI: Claude 3.5 Sonnet (20241022)": "omniparser+anthropic/claude-3-5-sonnet-20241022",},"uitars": {"default": "huggingface-local/ByteDance-Seed/UI-TARS-1.5-7B" if is_mac else "ui-tars",diff --git a/libs/python/agent/agent/ui/gradio/ui_components.py b/libs/python/agent/agent/ui/gradio/ui_components.pyindex bc6978f73b..d197919b70 100644--- a/libs/python/agent/agent/ui/gradio/ui_components.py+++ b/libs/python/agent/agent/ui/gradio/ui_components.py@@ -38,13 +38,13 @@ def create_gradio_ui() -> gr.Blocks:"Anthropic: Claude 4 Opus (20250514)","Anthropic: Claude 4 Sonnet (20250514)","Anthropic: Claude 3.7 Sonnet (20250219)",- "Anthropic: Claude 3.5 Sonnet (20240620)",+ "Anthropic: Claude 3.5 Sonnet (20241022)",]omni_models = ["OMNI: OpenAI GPT-4o","OMNI: OpenAI GPT-4o mini","OMNI: Claude 3.7 Sonnet (20250219)",- "OMNI: Claude 3.5 Sonnet (20240620)"+ "OMNI: Claude 3.5 Sonnet (20241022)"]# Check if API keys are availablediff --git a/libs/python/agent/example.py b/libs/python/agent/example.pyindex 485f484e7c..fc4dc1b13d 100644--- a/libs/python/agent/example.py+++ b/libs/python/agent/example.py@@ -98,7 +98,7 @@ async def main():# model="anthropic/claude-opus-4-20250514",# model="anthropic/claude-sonnet-4-20250514",# model="anthropic/claude-3-7-sonnet-20250219",- # model="anthropic/claude-3-5-sonnet-20240620",+ # model="anthropic/claude-3-5-sonnet-20241022",# == UI-TARS ==# model="huggingface-local/ByteDance-Seed/UI-TARS-1.5-7B",diff --git a/notebooks/agent_nb.ipynb b/notebooks/agent_nb.ipynbindex 61e7288a5a..66b6620346 100644--- a/notebooks/agent_nb.ipynb+++ b/notebooks/agent_nb.ipynb@@ -442,7 +442,7 @@"source": ["anthropic_agent = ComputerAgent(\n"," tools=[computer],\n",- " model=\"anthropic/claude-3-5-sonnet-20240620\",\n",+ " model=\"anthropic/claude-3-5-sonnet-20241022\",\n"," trajectory_dir=str(Path(\"trajectories\")),\n"," verbosity=logging.INFO\n",")\n"