👾 Open Computer Use – Open-Source Alternative to Codex Computer Use
Swift accessibilityai-agentai-agentsclaude-codecodexcodex-computer-usecomputer-usecomputer-use-agentcross-platformcuadesktop-automationgemini-cligui-automationmacosmcpmodel-context-protocolopen-computer-useopen-computer-use-mcpopenai-codexopencode
chore(release): 发布 0.3.5
ifuryst386a260d1ab8
diff --git a/apps/OpenComputerUseLinux/main.go b/apps/OpenComputerUseLinux/main.goindex 5c1346e..7a5c555 100644--- a/apps/OpenComputerUseLinux/main.go+++ b/apps/OpenComputerUseLinux/main.go@@ -20,7 +20,7 @@ import ("time")-var version = "0.3.4"+var version = "0.3.5"var clickMethodValues = []string{"auto", "accessibility", "app_post", "sky_click", "global"}diff --git a/apps/OpenComputerUseSmokeSuite/Sources/OpenComputerUseSmokeSuite/main.swift b/apps/OpenComputerUseSmokeSuite/Sources/OpenComputerUseSmokeSuite/main.swiftindex b8b1ff0..9375572 100644--- a/apps/OpenComputerUseSmokeSuite/Sources/OpenComputerUseSmokeSuite/main.swift+++ b/apps/OpenComputerUseSmokeSuite/Sources/OpenComputerUseSmokeSuite/main.swift@@ -35,7 +35,7 @@ final class MCPClient {_ = try request(method: "initialize", params: ["clientInfo": ["name": "OpenComputerUseSmokeSuite",- "version": "0.3.4",+ "version": "0.3.5",],"capabilities": [:],"protocolVersion": "2025-03-26",diff --git a/apps/OpenComputerUseWindows/main.go b/apps/OpenComputerUseWindows/main.goindex 8e25c11..c70ed60 100644--- a/apps/OpenComputerUseWindows/main.go+++ b/apps/OpenComputerUseWindows/main.go@@ -17,7 +17,7 @@ import ("time")-var version = "0.3.4"+var version = "0.3.5"var clickMethodValues = []string{"auto", "accessibility", "app_post", "sky_click", "global"}diff --git a/docs/ARCHITECTURE.md b/docs/ARCHITECTURE.mdindex 2eeafa2..ac464ef 100644--- a/docs/ARCHITECTURE.md+++ b/docs/ARCHITECTURE.md@@ -86,7 +86,7 @@- `CGEvent.postToPid` 定向发送键盘事件,避免为了 `type_text` / `press_key` 抢前台;`type_text` 会把文本按 Unicode extended grapheme cluster 聚合成小批量 `keyboardSetUnicodeString` 事件,避免中文标点、emoji / 代理对和组合字符被逐个 UTF-16 code unit 拆开后在 Electron 富文本输入框里乱序或变形。如果当前 focused element 的 `AXValue` 可设置,`type_text` 会优先按可编辑内容追加并写回 `AXValue`,这覆盖 Feishu / Electron 富文本输入框不可靠接收后台键盘事件的场景,并会过滤已知占位提示,避免把 placeholder 拼进草稿;如果当前 focused element 不是可编辑文本目标,`type_text` 会报错要求先 click 文本输入区或使用 `set_value`,不再把无效果的后台键盘投递当成成功;`press_key` 的 xdotool parser 覆盖官方 binary key table 里常见的 `BackSpace`、`Page_Up`、`Prior` / `Next`、`F1...F12` 和 `KP_*` alias- `scroll.pages` 对齐官方 `1.0.755` 的 `number` schema,支持小数页数;整数页且目标暴露 `AXScroll*ByPage` 时优先走 AX action,否则用 `CGEvent.postToPid` 向目标进程定向发送 scroll event- `drag` 仍是 coordinate-only API,但默认不再使用全局 `.cghidEventTap` mouse event;默认改为 `CGEvent.postToPid` 定向发送 mouse move / down / dragged / up 事件,避免移动用户真实硬件光标;这些 coordinate tool 的 `x/y` 先按 screenshot pixel 坐标解释,再依据截图像素尺寸与目标 window bounds 的比例映射回 window point / Quartz global 坐标,避免 Retina 窗口上把 2x 像素误当成 1x point 导致点击落到错误位置- - `click` / `scroll` / `drag` 在环境变量未开启的默认配置下不会走全局 `.cghidEventTap`,因此不会移动或抢占用户真实鼠标;`OPEN_COMPUTER_USE_ALLOW_GLOBAL_POINTER_FALLBACKS=1` 是全局指针能力的进程级安全门,显式 `click_method=global` 仍必须通过这层授权。默认路径不再为了 fallback 调用 `NSRunningApplication.activate`。`drag` 的结果会在 snapshot 文本之后、截图之前附带一条 `Drag delivered via ...` 文本项,说明本次走的是 `app_post` 定向投递还是全局指针路径;默认路径下同时说明 `postToPid` 事件不经过 window server,因此无法驱动窗口移动、文本拖选、Finder 拖放这类 window server 拖拽会话。`drag` 的 tool description 也同步说明了这一限制和对应环境变量+ - `click` / `scroll` / `drag` 在环境变量未开启的默认配置下不会走全局 `.cghidEventTap`,因此不会移动或抢占用户真实鼠标;`OPEN_COMPUTER_USE_ALLOW_GLOBAL_POINTER_FALLBACKS=1` 是全局指针能力的进程级安全门,显式 `click_method=global` 仍必须通过这层授权。默认路径不再为了 fallback 调用 `NSRunningApplication.activate`。`drag` 的结果会在 snapshot 文本之后、截图之前附带一条 `Drag delivered via ...` 文本项,说明本次走的是 `app_post` 定向投递还是全局指针路径;默认路径下同时说明 `postToPid` 事件不经过 window server,因此无法驱动窗口移动、文本拖选、Finder 拖放这类 window server 拖拽会话。`drag` 的 tool description 也同步说明了这一限制和对应环境变量。显式开启全局路径后,拖拽使用默认 event source 向 HID tap 投递,按距离插值并为每步写入位移 delta;macOS 26+ 的 down / dragged / up 还会共享一个手势事件编号,使 window server 能识别窗口移动、文本拖选和 Finder 拖放所需的真实拖拽会话### 4. Fixture Bridgediff --git a/docs/histories/2026-09/20260910-1226-release-0-3-5.md b/docs/histories/2026-09/20260910-1226-release-0-3-5.mdnew file mode 100644index 0000000..a39ef19--- /dev/null+++ b/docs/histories/2026-09/20260910-1226-release-0-3-5.md@@ -0,0 +1,37 @@+## [2026-09-10 12:26] | Task: 发布 0.3.5++### 🤖 Execution Context+* **Agent ID**: `/root`+* **Base Model**: GPT-6+* **Runtime**: Codex++### 📥 User Query+> bump一个小版本直接发++### 🛠 Changes Overview+**Scope:** 跨平台版本源与发布文档。++- 将 plugin manifest、Swift runtime / smoke / 测试、Linux / Windows runtime 和 Go helper 的版本从 0.3.4 对齐到 0.3.5。+- 汇总 macOS 全局拖拽修复、投递路径说明和 Go MCP SDK 更新,新增英文 GitHub Release notes 与功能发布记录。++### 🧠 Design Intent (Why)+以 patch release 交付已有修复,保持 tag、运行时版本、npm 包和 DMG 制品一致。++### 📁 Files Modified+- `plugins/open-computer-use/.codex-plugin/plugin.json`+- `packages/OpenComputerUseKit/Sources/OpenComputerUseKit/OpenComputerUseVersion.swift`+- `packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift`+- `apps/OpenComputerUseSmokeSuite/Sources/OpenComputerUseSmokeSuite/main.swift`+- `apps/OpenComputerUseLinux/main.go`+- `apps/OpenComputerUseWindows/main.go`+- `scripts/computer-use-cli/main.go`+- `scripts/computer-use-cli/README.md`+- `docs/ARCHITECTURE.md`+- `docs/releases/feature-release-notes.md`+- `docs/releases/github/v0.3.5.md`++### Validation+- Release notes 校验、`make check-docs` 与 `git diff --check` 通过。+- `swift test`:167 项测试,1 项跳过,0 失败;Linux、Windows 和 Go helper 的 `go test ./...` 全部通过。+- npm staging 完成,三个包均为 0.3.5,包含 macOS universal、Linux / Windows 双架构运行时和 `ocu` 入口。+- universal DMG 构建通过,产物为 `CursorMotion-0.3.5.dmg`。diff --git a/docs/releases/feature-release-notes.md b/docs/releases/feature-release-notes.mdindex 7d25e5f..f57aff0 100644--- a/docs/releases/feature-release-notes.md+++ b/docs/releases/feature-release-notes.md@@ -4,6 +4,7 @@| 日期 | 功能域 | 用户价值 | 变更摘要 || --- | --- | --- | --- |+| 2026-09-10 | macOS 拖拽修复 | 显式开启全局指针路径后,窗口移动、文本拖选与 Finder 拖放可收到启动真实拖拽所需的事件;默认路径的限制也会明确呈现。 | 发布 `0.3.5`:补齐拖拽位移、手势事件编号与 HID 投递时序,增加投递路径说明;同步升级 Go MCP SDK 到 `v1.4.1`。 || 2026-09-08 | drag 投递路径可见性 | 在默认安全配置下调用 `drag` 做窗口移动、文本拖选或 Finder 拖放时,结果会明确说明事件只投递给目标进程、为何没有效果,以及需要设置哪个环境变量,不再表现为“成功但无效果”。 | `drag` 结果新增一条 `Drag delivered via app_post` / `Drag delivered via global pointer path` 文本项;tool description 补充默认路径限制与 `OPEN_COMPUTER_USE_ALLOW_GLOBAL_POINTER_FALLBACKS=1` 说明;skill 文档新增 Drag Delivery 章节;默认行为与安全门本身不变。 || 2026-09-08 | macOS 应用定位与 secondary action | 按名称定位应用时减少误选后台 helper,执行 secondary action 时避免动作错配。 | 发布 `0.3.4`:优先匹配普通应用;支持 Safari custom action 短名称,并修复过滤后的动作映射和名称冲突。 || 2026-09-06 | macOS secondary action | Agent 可以通过 Safari 暴露的 `close tab` secondary action 可靠关闭标签页,不会因内部动作被过滤而误执行另一项动作。 | macOS renderer 将 `Name:close tab ...` 形式的 AppKit custom action descriptor 显示为短名称,executor 从同一组过滤后的 raw actions 做等价名称匹配,并拒绝歧义匹配;短名称与其他原始 action 冲突时保留完整 descriptor,避免误执行同名原始动作。 |diff --git a/docs/releases/github/v0.3.5.md b/docs/releases/github/v0.3.5.mdnew file mode 100644index 0000000..3ba0566--- /dev/null+++ b/docs/releases/github/v0.3.5.md@@ -0,0 +1,6 @@+## What's Changed++* Fix macOS global-pointer drags so window moves, text selection, and Finder drag-and-drop receive the motion and gesture events needed to start a real drag session.+* Report the drag delivery path and explain when window-server dragging requires `OPEN_COMPUTER_USE_ALLOW_GLOBAL_POINTER_FALLBACKS=1`.++**Full Changelog**: https://github.com/iFurySt/open-codex-computer-use/compare/v0.3.4...v0.3.5diff --git a/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/OpenComputerUseVersion.swift b/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/OpenComputerUseVersion.swiftindex 48b8c19..33e45e2 100644--- a/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/OpenComputerUseVersion.swift+++ b/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/OpenComputerUseVersion.swift@@ -1,6 +1,6 @@import Foundation-public let openComputerUseVersion = "0.3.4"+public let openComputerUseVersion = "0.3.5"public func resolvedOpenComputerUseVersion(bundle: Bundle = .main) -> String {if let version = bundle.object(forInfoDictionaryKey: "CFBundleShortVersionString") as? String,diff --git a/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift b/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swiftindex 4e7ea17..250f5f2 100644--- a/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift+++ b/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift@@ -604,7 +604,7 @@ final class OpenComputerUseKitTests: XCTestCase {func testInitializeResponseContainsToolsCapability() throws {let server = StdioMCPServer(service: ComputerUseService())- let response = server.handle(line: #"{"jsonrpc":"2.0","id":1,"method":"initialize","params":{"protocolVersion":"2025-03-26","clientInfo":{"name":"test","version":"0.3.4"},"capabilities":{}}}"#)+ let response = server.handle(line: #"{"jsonrpc":"2.0","id":1,"method":"initialize","params":{"protocolVersion":"2025-03-26","clientInfo":{"name":"test","version":"0.3.5"},"capabilities":{}}}"#)XCTAssertNotNil(response)XCTAssertTrue(response!.contains(#""name":"open-computer-use""#))XCTAssertTrue(response!.contains(#""tools":{"listChanged":false}"#))@@ -613,7 +613,7 @@ final class OpenComputerUseKitTests: XCTestCase {func testInitializeResponseContainsComputerUseInstructions() throws {let server = StdioMCPServer(service: ComputerUseService())let response = try XCTUnwrap(- server.handle(line: #"{"jsonrpc":"2.0","id":1,"method":"initialize","params":{"protocolVersion":"2025-03-26","clientInfo":{"name":"test","version":"0.3.4"},"capabilities":{}}}"#)+ server.handle(line: #"{"jsonrpc":"2.0","id":1,"method":"initialize","params":{"protocolVersion":"2025-03-26","clientInfo":{"name":"test","version":"0.3.5"},"capabilities":{}}}"#))let data = try XCTUnwrap(response.data(using: .utf8))let json = try XCTUnwrap(JSONSerialization.jsonObject(with: data) as? [String: Any])diff --git a/plugins/open-computer-use/.codex-plugin/plugin.json b/plugins/open-computer-use/.codex-plugin/plugin.jsonindex 1e9ea32..3aae196 100644--- a/plugins/open-computer-use/.codex-plugin/plugin.json+++ b/plugins/open-computer-use/.codex-plugin/plugin.json@@ -1,6 +1,6 @@{"name": "open-computer-use",- "version": "0.3.4",+ "version": "0.3.5","description": "Open-source cross-platform Computer Use MCP server packaged as a Codex plugin.","author": {"name": "Leo",diff --git a/scripts/computer-use-cli/README.md b/scripts/computer-use-cli/README.mdindex 6659398..3cfd4f4 100644--- a/scripts/computer-use-cli/README.md+++ b/scripts/computer-use-cli/README.md@@ -131,7 +131,7 @@ Example working invocation against `open-computer-use`:```bashgo run . list-tools \--transport direct \- --server-bin ~/.codex/plugins/cache/open-computer-use-local/open-computer-use/0.3.4/scripts/launch-open-computer-use.sh+ --server-bin ~/.codex/plugins/cache/open-computer-use-local/open-computer-use/0.3.5/scripts/launch-open-computer-use.sh```Example working comparison flow against a local repo build:diff --git a/scripts/computer-use-cli/main.go b/scripts/computer-use-cli/main.goindex d0d8c70..d6fe344 100644--- a/scripts/computer-use-cli/main.go+++ b/scripts/computer-use-cli/main.go@@ -21,7 +21,7 @@ import (const (cliName = "computer-use-cli"- cliVersion = "0.3.4"+ cliVersion = "0.3.5"defaultTimeout = 60 * time.SecondpluginRootEnvVar = "COMPUTER_USE_PLUGIN_ROOT"pluginVersionEnvVar = "COMPUTER_USE_PLUGIN_VERSION"