👾 Open Computer Use – Open-Source Alternative to Codex Computer Use
computer-use-cli
Small Go CLI for probing Codex desktop-control tooling.
This directory is intended to be run from scripts/computer-use-cli/ inside the repo:
cd scripts/computer-use-cli
go run . list-tools --transport app-server
go run . call list_apps --transport direct --server-bin /path/to/open-computer-use
go run . call-seq --transport direct --server-bin /path/to/open-computer-use --calls-file /tmp/calls.json
It supports two transports:
direct: talk to a stdio MCP server directly with the official Go MCP SDK transport layer.app-server: talk tocodex app-server, create an ephemeral thread, then proxymcpServer/tool/callthrough the signed Codex host.
auto is the default:
- for the official bundled proprietary
computer-use, it usesapp-server; this is currently reliable for inventory probes, not raw tool calls - for explicitly provided non-Sky binaries such as
open-computer-use, it usesdirect
Commands
go run . resolve-server
go run . list-tools --transport app-server
go run . call list_apps --transport direct --server-bin /path/to/open-computer-use
go run . call get_app_state --transport direct --server-bin /path/to/open-computer-use --args '{"app":"TextEdit"}'
go run . call-seq --transport direct --server-bin /path/to/open-computer-use --calls-file /tmp/calls.json
Explicit transport examples:
go run . list-tools --transport app-server
go run . list-tools --transport direct --server-bin /path/to/open-computer-use
go run . call list_apps --transport direct --server-bin /path/to/open-computer-use
go run . call-seq --transport direct --server-bin /path/to/open-computer-use --calls-file /tmp/calls.json
Flags can appear either before or after the tool name for call:
go run . call --server-bin /path/to/server list_apps
go run . call list_apps --server-bin /path/to/server
call creates a fresh ephemeral app-server thread per invocation. If you need get_app_state
followed by one or more action tools in the same official computer-use session, use
call-seq with a JSON array:
[
{"tool": "get_app_state", "args": {"app": "TextEdit"}},
{"tool": "set_value", "args": {"app": "TextEdit", "element_index": "2", "value": "cursor probe 01\ncursor probe 02"}},
{"tool": "scroll", "args": {"app": "TextEdit", "element_index": "1", "direction": "down", "pages": 1}}
]
This repo includes a ready-to-run example at
../../examples/textedit-overlay-seq.json.
Before running it, make sure TextEdit already has a normal document window
open; otherwise get_app_state may only expose the application root and the
hard-coded element_index values in the sample will no longer line up.
Default target
By default, the CLI auto-discovers the official bundled computer-use plugin under:
~/.codex/plugins/cache/openai-bundled/computer-use/<version>
For local compatibility testing, auto-discovery currently prefers a non-translocated
1.0.750 root at ~/.codex/plugins/computer-use when that root is present and
its plugin manifest reports 1.0.750. If that root is not available, the CLI
falls back to the installed cache version under ~/.codex/plugins/cache/...,
then to the newest installed version. Use an explicit version selector when you
need a different target:
COMPUTER_USE_PLUGIN_VERSION=1.0.755 go run . resolve-server
go run . resolve-server --plugin-version latest
go run . list-tools --transport app-server --plugin-version host
You can override that with:
COMPUTER_USE_PLUGIN_ROOT=/path/to/plugin-root
COMPUTER_USE_PLUGIN_VERSION=1.0.755
COMPUTER_USE_SERVER_BIN=/path/to/server-binary
or the equivalent flags:
--plugin-root /path/to/plugin-root
--plugin-version 1.0.755
--server-bin /path/to/server-binary
--plugin-root and --server-bin take precedence over --plugin-version.
The version selector affects CLI target resolution, direct launches, and the
temporary mcp_servers."computer-use" override passed to codex app-server.
Use --plugin-version host when you want app-server mode to leave the Codex
host config untouched. Codex CLI config overrides do not parse quoted dotted
keys, so the app-server override intentionally uses mcp_servers.computer-use.*.
For app-server mode, you can also override the Codex host binary:
CODEX_APP_SERVER_BIN=/Applications/Codex.app/Contents/Resources/codex
go run . list-tools --transport app-server
Verified behavior in this workspace
- Direct mode successfully connects to the local
open-computer-usestdio server and can bothlist-toolsandcall list_apps. - Direct mode against the official bundled proprietary
computer-useexits during initialization when launched outside Codex. - That same failure reproduces with the official Go SDK example client
examples/client/listfeatures, so the issue is not specific to this CLI. - App-server mode can still list the official bundled
computer-usetools through a signed Codex binary. - As of official bundled
computer-use1.0.755, rawmcpServer/tool/callfrom this external helper can returnSender process is not authenticatedeven though Apple Events/TCC accepts the request. The supported path for official tool calls is a normal Codex agent/tool invocation; this helper should not be treated as a general bypass for the proprietary service-side sender authorization. - For local compatibility tests, this CLI now prefers bundled
computer-use1.0.750from the non-quarantined~/.codex/plugins/computer-useroot and passes the resolved target tocodex app-serveras a temporary MCP override. In this workspace, cache copies withcom.apple.quarantinecan be AppTranslocated and returnApple event error -1708; the non-translocated root can calllist_apps.
Example working invocation against open-computer-use:
go run . list-tools \
--transport direct \
--server-bin ~/.codex/plugins/cache/open-computer-use-local/open-computer-use/1.1.2/scripts/launch-open-computer-use.sh
Example working comparison flow against a local repo build:
swift build --product OpenComputerUse
cd scripts/computer-use-cli
go run . call-seq \
--transport direct \
--plugin-root ../.. \
--server-bin ../../.build/debug/OpenComputerUse \
--calls-file ../../examples/textedit-overlay-seq.json
Example inventory probe against the official bundled computer-use:
go run . list-tools --transport app-server