👾 Open Computer Use – Open-Source Alternative to Codex Computer Use
Swift accessibilityai-agentai-agentsclaude-codecodexcodex-computer-usecomputer-usecomputer-use-agentcross-platformcuadesktop-automationgemini-cligui-automationmacosmcpmodel-context-protocolopen-computer-useopen-computer-use-mcpopenai-codexopencode
Avoid merging counter text siblings
Leo2df9037c2fe8
diff --git a/docs/histories/2026-05/20260507-2017-avoid-counter-text-merge.md b/docs/histories/2026-05/20260507-2017-avoid-counter-text-merge.mdnew file mode 100644index 0000000..f0e7932--- /dev/null+++ b/docs/histories/2026-05/20260507-2017-avoid-counter-text-merge.md@@ -0,0 +1,25 @@+# 避免合并计数文本 sibling++## 用户诉求++持续对比 Lark / Electron app 的 `get_app_state` 返回,修正和官方 `computer-use` 不一致的 state rendering 细节。++## 主要改动++- 调整 `mergeTextOnlySiblings` 规则:当 sibling 文本包含 `数字/数字` 计数形态时,不再把整组文本合并成一行 summary。+- 增加单元测试覆盖 `["消息", "126/126"]` 不应合并。++## 设计动机++官方 Lark 样本会把“消息”和未读/总数计数分别渲染为独立 text 节点。开源版之前输出 `text 消息 126/126`,信息仍在但结构更粗,和官方 tree 形状不一致。这个规则只针对明确的计数 sibling,避免大范围放弃短文本合并带来的节点预算压力。++## 验证++- Lark 本地回归确认输出变为独立的 `text 消息` 和 `text 126/126`。+- `swift test --filter AccessibilityRendererOnlyMergesShortTextOnlySiblingRuns`+- `./scripts/build-open-computer-use-app.sh debug`++## 受影响文件++- `packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swift`+- `packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift`diff --git a/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swift b/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swiftindex 8adf9cd..17167e9 100644--- a/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swift+++ b/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swift@@ -1264,10 +1264,18 @@ func shouldMergeTextOnlySiblings(_ texts: [String]) -> Bool {return false}+ if texts.contains(where: isSiblingCounterText(_:)) {+ return false+ }+let totalLength = texts.reduce(0) { $0 + $1.count }return texts.count <= 8 && totalLength <= 220}+private func isSiblingCounterText(_ text: String) -> Bool {+ text.range(of: #"^\d+\s*/\s*\d+$"#, options: .regularExpression) != nil+}+private func isPlainGenericTextContainer(_ element: AXUIElement, children: [AXUIElement], depth: Int = 0) -> Bool {for child in children {let childRole = stringValue(of: child, attribute: kAXRoleAttribute) ?? ""diff --git a/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift b/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swiftindex 0784f63..95b8547 100644--- a/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift+++ b/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift@@ -650,6 +650,7 @@ final class OpenComputerUseKitTests: XCTestCase {"🍒水果:黄瓜","※注意:餐食饮品等仅供职场便利,请勿带离工区",]))+ XCTAssertFalse(shouldMergeTextOnlySiblings(["消息", "126/126"]))}func testAccessibilityRendererRendersSummariesWithImagesAsChildren() {