Skip to content

👾 Open Computer Use – Open-Source Alternative to Codex Computer Use

Avoid merging counter text siblings

Leo2df9037c2fe8
diff --git a/docs/histories/2026-05/20260507-2017-avoid-counter-text-merge.md b/docs/histories/2026-05/20260507-2017-avoid-counter-text-merge.md
new file mode 100644
index 0000000..f0e7932
--- /dev/null
+++ b/docs/histories/2026-05/20260507-2017-avoid-counter-text-merge.md
@@ -0,0 +1,25 @@
+# 避免合并计数文本 sibling
+
+## 用户诉求
+
+持续对比 Lark / Electron app 的 `get_app_state` 返回,修正和官方 `computer-use` 不一致的 state rendering 细节。
+
+## 主要改动
+
+- 调整 `mergeTextOnlySiblings` 规则:当 sibling 文本包含 `数字/数字` 计数形态时,不再把整组文本合并成一行 summary。
+- 增加单元测试覆盖 `["消息", "126/126"]` 不应合并。
+
+## 设计动机
+
+官方 Lark 样本会把“消息”和未读/总数计数分别渲染为独立 text 节点。开源版之前输出 `text 消息 126/126`,信息仍在但结构更粗,和官方 tree 形状不一致。这个规则只针对明确的计数 sibling,避免大范围放弃短文本合并带来的节点预算压力。
+
+## 验证
+
+- Lark 本地回归确认输出变为独立的 `text 消息` 和 `text 126/126`。
+- `swift test --filter AccessibilityRendererOnlyMergesShortTextOnlySiblingRuns`
+- `./scripts/build-open-computer-use-app.sh debug`
+
+## 受影响文件
+
+- `packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swift`
+- `packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift`
diff --git a/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swift b/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swift
index 8adf9cd..17167e9 100644
--- a/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swift
+++ b/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swift
@@ -1264,10 +1264,18 @@ func shouldMergeTextOnlySiblings(_ texts: [String]) -> Bool {
return false
}
+ if texts.contains(where: isSiblingCounterText(_:)) {
+ return false
+ }
+
let totalLength = texts.reduce(0) { $0 + $1.count }
return texts.count <= 8 && totalLength <= 220
}
+private func isSiblingCounterText(_ text: String) -> Bool {
+ text.range(of: #"^\d+\s*/\s*\d+$"#, options: .regularExpression) != nil
+}
+
private func isPlainGenericTextContainer(_ element: AXUIElement, children: [AXUIElement], depth: Int = 0) -> Bool {
for child in children {
let childRole = stringValue(of: child, attribute: kAXRoleAttribute) ?? ""
diff --git a/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift b/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift
index 0784f63..95b8547 100644
--- a/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift
+++ b/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift
@@ -650,6 +650,7 @@ final class OpenComputerUseKitTests: XCTestCase {
"🍒水果:黄瓜",
"※注意:餐食饮品等仅供职场便利,请勿带离工区",
]))
+ XCTAssertFalse(shouldMergeTextOnlySiblings(["消息", "126/126"]))
}
func testAccessibilityRendererRendersSummariesWithImagesAsChildren() {