👾 Open Computer Use – Open-Source Alternative to Codex Computer Use
Swift accessibilityai-agentai-agentsclaude-codecodexcodex-computer-usecomputer-usecomputer-use-agentcross-platformcuadesktop-automationgemini-cligui-automationmacosmcpmodel-context-protocolopen-computer-useopen-computer-use-mcpopenai-codexopencode
Align Electron accessibility snapshots
Leo6c0c8dc72e3e
diff --git a/docs/histories/2026-05/20260507-1747-align-electron-snapshot-rendering.md b/docs/histories/2026-05/20260507-1747-align-electron-snapshot-rendering.mdnew file mode 100644index 0000000..a336ad6--- /dev/null+++ b/docs/histories/2026-05/20260507-1747-align-electron-snapshot-rendering.md@@ -0,0 +1,54 @@+## [2026-05-07 17:47] | Task: Align Electron snapshot rendering++### Execution Context+* **Agent ID**: `Codex`+* **Base Model**: `GPT-5.5`+* **Runtime**: `Codex CLI, macOS`++### User Query+> Continue optimizing `open-computer-use` toward official `computer-use`, using Feishu/Lark or another Electron app as the comparison target and relying on reverse-engineering/observed official behavior where useful.++### Changes Overview+**Scope:** `OpenComputerUseKit` accessibility snapshot rendering.++**Key Actions:**+- **Electron tree budget**: Raised the AX render budget from 500 to 1200 nodes so long Electron/WebView content can still reach action-critical controls such as the message entry area.+- **Container rendering**: Rendered `AXGroup` as `container`, promoted useful group/WebArea descriptions into titles, and elided empty generic leaf containers.+- **Web content details**: Included `AXURL` for HTML content nodes and formatted `text entry area` values without the extra `Value:` prefix.+- **Traversal policy**: Limited `AXRows`-over-`AXChildren` preference to true row-backed controls instead of applying it to arbitrary Electron/WebView containers.+- **Official strategy parity**: Added best-effort `AXManualAccessibility` / `AXEnhancedUserInterface` enablement before taking a real app snapshot, matching strategy names observed in the official bundled service.+- **Sibling preservation**: Replaced global `CFHash(AXUIElement)` de-duplication with ancestor-cycle detection and per-parent `CFEqual` de-duplication, so long WebView traversal no longer hides sibling regions such as `SideEdgeView`.+- **Boolean tabs**: Rendered settable tab values as `boolean` with `off` / `on`, matching the observed official Feishu/Lark output.+- **Static text summaries**: Implemented a closer `mergeTextOnlySiblings`-style rule for short sibling runs, while leaving long menu/body content expanded. This keeps chat rows compact without flattening whole WebView regions.+- **Focused element formatting**: Rendered focused summaries from the same line body used in the tree, preserving WebArea titles and URLs. `AXWebArea` role descriptions now keep official-style `HTML 内容` capitalization.+- **Value separators**: Added the official comma separator between `Description:` and `Value:` for settable controls such as Feishu tabs.+- **App menu bar parity**: Appended the focused app's top-level menu bar after the focused window tree, matching the official `飞书 / 编辑 / 窗口 / 历史记录 / 帮助` tail while filtering the Apple menu and suppressing expanded menu internals.+- **Image formatting**: Promoted image descriptions into the title position and restricted URL rendering to WebArea nodes, so Electron native-resource image URLs are no longer exposed in the readable tree.++### Design Intent (Why)+The official `computer-use` Feishu/Lark result preserves deep WebView content, screenshots, URLs, message entry areas, and container-style naming. Reverse-engineering the latest bundled service exposed transformation names including `flattenIntoSelectableAncestor`, `flattenRedundantHierarchy`, `flattenRepetitiveStaticText`, `flattenLinksIntoMarkdownText`, and `mergeTextOnlySiblings`. The renderer now follows the same broad shape: preserve action-critical hierarchy, merge short text-only runs, and avoid spending the budget on generic wrappers or noisy accessibility actions.++### Verification+- `OPEN_COMPUTER_USE_DISABLE_APP_AGENT_PROXY=1 swift run OpenComputerUse call get_app_state --args '{"app":"com.electron.lark"}'`+ - Returned an image block.+ - Returned long Feishu/Lark WebView message content.+ - Returned `text entry area`.+ - Returned `SideEdgeView`, `ProfileButton`, search, and tab bar nodes after the long message body.+ - Rendered tabs as `(settable, boolean)` with `Description: 消息, Value: off`.+ - Returned the focused element as `HTML 内容 messenger-chat, URL: ...`, matching the official focused-summary shape.+ - Returned the top-level app menu bar after window buttons, matching the official tail (`飞书`, `编辑`, `窗口`, `历史记录`, `帮助`).+ - Rendered Electron image descriptions without leaking `native-resource://` URLs.+ - Reduced the sampled Lark menu/chat state to roughly 576 rendered lines / 571 indexed elements while retaining the message list, entry area, sidebar, and app menu bar. The official sample in the same window was roughly 648 indexed elements.+ - Returned zero `Scroll To Visible` entries in the sampled tree.+- Official comparison via `computer-use get_app_state` on `com.electron.lark` showed the same major regions: long message content, `text entry area`, `SideEdgeView`, boolean tabs, and screenshot.+- `swift test`+- `./scripts/run-tool-smoke-tests.sh`+- `./scripts/check-docs.sh`++### Known Follow-up+- Current Codex MCP session may still be connected to older installed app-agent processes until those processes are restarted.+- The latest sample is close in coverage and action-critical regions, but exact wrapper density and element numbering still differ from official output.++### Files Modified+- `packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swift`+- `packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift`diff --git a/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swift b/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swiftindex 4849be2..4f048bb 100644--- a/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swift+++ b/packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swift@@ -27,7 +27,7 @@ enum SnapshotMode {case fixture}-let accessibilityTreeMaxNodeCount = 500+let accessibilityTreeMaxNodeCount = 1200let accessibilityTreeMaxDepth = 64let screenshotCaptureTimeout: TimeInterval = 5@@ -87,6 +87,7 @@ enum SnapshotBuilder {}let appElement = AXUIElementCreateApplication(app.pid)+ enableBestEffortAccessibilityModes(appElement)let systemWide = AXUIElementCreateSystemWide()let focusedApplication = copyElement(systemWide, attribute: kAXFocusedApplicationAttribute)let focusedWindow = preferredFocusedWindow(appElement: appElement, appPID: app.pid, focusedApplication: focusedApplication, systemWide: systemWide)@@ -102,6 +103,12 @@ enum SnapshotBuilder {var renderer = TreeRenderer(context: context)renderer.render(rootElement)+ if focusedWindow != nil,+ let menuBar = copyElement(appElement, attribute: kAXMenuBarAttribute),+ !CFEqual(menuBar, rootElement)+ {+ renderer.render(menuBar)+ }return AppSnapshot(app: app,@@ -193,6 +200,14 @@ enum SnapshotBuilder {}}+private func enableBestEffortAccessibilityModes(_ appElement: AXUIElement) {+ // Chromium/Electron apps may withhold parts of their AX tree until manual+ // accessibility is enabled. These private attributes are best-effort and+ // harmlessly fail on apps that do not support them.+ _ = AXUIElementSetAttributeValue(appElement, "AXManualAccessibility" as CFString, kCFBooleanTrue)+ _ = AXUIElementSetAttributeValue(appElement, "AXEnhancedUserInterface" as CFString, kCFBooleanTrue)+}+private struct WindowCapture {let windowID: CGWindowIDlet layer: Int@@ -343,21 +358,20 @@ private struct TreeRenderer {var records: [Int: ElementRecord] = [:]var identifierIndex: [String: String] = [:]var focusedSummary: String?- private var visited: Set<String> = []init(context: RenderContext) {self.context = context}- mutating func render(_ root: AXUIElement, depth: Int = 0) {+ mutating func render(_ root: AXUIElement, depth: Int = 0, ancestors: [AXUIElement] = []) {guard shouldContinueRendering(nextIndex: nextIndex, depth: depth) else {return}- let identifier = opaqueIdentifier(for: root)- guard visited.insert(identifier).inserted else {+ guard !ancestors.contains(where: { CFEqual($0, root) }) else {return}+ let nextAncestors = ancestors + [root]let index = nextIndex@@ -374,6 +388,11 @@ private struct TreeRenderer {let localFrame = resolveLocalFrame(of: root, windowBounds: context.windowBounds)let rowTexts = role == kAXRowRole as String ? flattenedRowTexts(of: root) : []let childElements = children(of: root)+ let genericTextSummary = summarizedGenericText(+ of: root,+ role: role,+ childElements: childElements+ )let title = preferredDisplayTitle(for: root,role: role,@@ -392,7 +411,8 @@ private struct TreeRenderer {identifier: axIdentifier,traits: traits,actions: prettyActions,- children: childElements+ children: childElements,+ genericTextSummary: genericTextSummary)let roleText = displayRoleText(baseRoleText: baseRoleText,@@ -402,9 +422,19 @@ private struct TreeRenderer {suppressChildren: hidesChildren)- if shouldElideNode(role: role, title: title, label: label, value: value, identifier: axIdentifier, traits: traits, actions: prettyActions, childCount: childElements.count) {+ if shouldElideNode(+ role: role,+ title: title,+ label: label,+ value: value,+ identifier: axIdentifier,+ traits: traits,+ actions: prettyActions,+ childCount: childElements.count,+ genericTextSummary: genericTextSummary+ ) {for child in childElements {- render(child, depth: depth)+ render(child, depth: depth, ancestors: nextAncestors)}return}@@ -413,7 +443,7 @@ private struct TreeRenderer {let traitsSegment = traits.isEmpty ? "" : " (\(traits.joined(separator: ", ")))"let titleSegment = title.map { " \($0)" } ?? ""- let rowSummarySegment = inlineRowSummary.map { " \($0)" } ?? ""+ let rowSummarySegment = (inlineRowSummary ?? genericTextSummary).map { " \($0)" } ?? ""let labelSegment = label != nil && label != title ? " Description: \(label!)" : ""let helpSegment = {guard let help else {@@ -424,13 +454,19 @@ private struct TreeRenderer {}return ", Help: \(help)"}()+ let urlSegment = formattedURLSegment(for: root, title: title, label: label)let identifierSegment = displayIdentifierSegment(for: root, role: role, identifier: axIdentifier, title: title)- let valueSegment = formattedValueSegment(for: root, roleText: roleText, title: title, value: value)+ let rawValueSegment = formattedValueSegment(for: root, roleText: roleText, title: title, value: value)+ let valueSegment = formattedValueSegmentWithSeparator(+ rawValueSegment,+ precedingSegments: [labelSegment, helpSegment, urlSegment, identifierSegment]+ )let actionsPrefix = (title != nil || inlineRowSummary != nil) ? ", Secondary Actions: " : " Secondary Actions: "let actionsSegment = prettyActions.isEmpty ? "" : "\(actionsPrefix)\(prettyActions.joined(separator: ", "))"let linePrefix = roleText.isEmpty ? "\(index)" : "\(index) \(roleText)"- lines.append("\(String(repeating: "\t", count: depth + 1))\(linePrefix)\(traitsSegment)\(titleSegment)\(rowSummarySegment)\(labelSegment)\(helpSegment)\(identifierSegment)\(valueSegment)\(actionsSegment)")+ let lineBody = "\(linePrefix)\(traitsSegment)\(titleSegment)\(rowSummarySegment)\(labelSegment)\(helpSegment)\(urlSegment)\(identifierSegment)\(valueSegment)"+ lines.append("\(String(repeating: "\t", count: depth + 1))\(lineBody)\(actionsSegment)")let record = ElementRecord(index: index,@@ -447,7 +483,7 @@ private struct TreeRenderer {}if let focusedElement = context.focusedElement, CFEqual(focusedElement, root) {- focusedSummary = roleText.isEmpty ? "\(index)" : "\(index) \(roleText)"+ focusedSummary = lineBody}if role == kAXRowRole as String, boolValue(of: root, attribute: kAXSelectedAttribute) != true {@@ -462,7 +498,7 @@ private struct TreeRenderer {}for child in childElements {- render(child, depth: depth + 1)+ render(child, depth: depth + 1, ancestors: nextAncestors)}}@@ -473,7 +509,7 @@ private struct TreeRenderer {private func children(of element: AXUIElement) -> [AXUIElement] {let attributes = [kAXChildrenAttribute, kAXRowsAttribute]var children: [AXUIElement] = []- var seen: Set<String> = []+ let rowsArePrimaryChildren = usesRowsAsPrimaryChildren(element)for attribute in attributes {guard let sourceValues = copyArray(element, attribute: attribute) else {@@ -481,6 +517,7 @@ private struct TreeRenderer {}if attribute == kAXChildrenAttribute,+ rowsArePrimaryChildren,let rows = copyArray(element, attribute: kAXRowsAttribute),!rows.isEmpty{@@ -492,8 +529,11 @@ private struct TreeRenderer {: sourceValuesfor child in values {- let id = opaqueIdentifier(for: child)- if seen.insert(id).inserted {+ if shouldSkipChild(child, of: element) {+ continue+ }++ if !children.contains(where: { CFEqual($0, child) }) {children.append(child)}}@@ -503,6 +543,25 @@ private struct TreeRenderer {}}+private func usesRowsAsPrimaryChildren(_ element: AXUIElement) -> Bool {+ let role = stringValue(of: element, attribute: kAXRoleAttribute)+ return [+ kAXOutlineRole as String,+ kAXListRole as String,+ kAXTableRole as String,+ "AXBrowser",+ ].contains(role)+}++private func shouldSkipChild(_ child: AXUIElement, of parent: AXUIElement) -> Bool {+ let parentRole = stringValue(of: parent, attribute: kAXRoleAttribute)+ guard parentRole == kAXMenuBarRole as String else {+ return false+ }++ return stringValue(of: child, attribute: kAXTitleAttribute) == "Apple"+}+func shouldContinueRendering(nextIndex: Int, depth: Int) -> Bool {nextIndex < accessibilityTreeMaxNodeCount && depth < accessibilityTreeMaxDepth}@@ -547,6 +606,10 @@ private func valueTypeTrait(of element: AXUIElement) -> String? {}if value is NSNumber {+ if numericValueRepresentsBoolean(for: element, value: value) {+ return "boolean"+ }+return "float"}@@ -649,12 +712,37 @@ private func sanitizedValue(of element: AXUIElement) -> String? {}if let number = value as? NSNumber {+ if numericValueRepresentsBoolean(for: element, value: value) {+ return number.boolValue ? "on" : "off"+ }+return number.stringValue}return nil}+private func numericValueRepresentsBoolean(for element: AXUIElement, value: CFTypeRef) -> Bool {+ guard let number = value as? NSNumber else {+ return false+ }++ guard number == 0 || number == 1 else {+ return false+ }++ let role = stringValue(of: element, attribute: kAXRoleAttribute) ?? ""+ let roleText = roleDescription(+ of: element,+ role: role,+ subrole: stringValue(of: element, attribute: kAXSubroleAttribute)+ )++ return roleText == "tab"+ || role == kAXCheckBoxRole as String+ || role == kAXRadioButtonRole as String+}+private func preferredDisplayTitle(for element: AXUIElement,role: String,@@ -679,6 +767,17 @@ private func preferredDisplayTitle(return sanitizeText(label)}+ if role == kAXImageRole as String, let label, !label.isEmpty {+ return sanitizeText(label)+ }++ if (role == kAXGroupRole as String || role == kAXUnknownRole as String || role == "AXWebArea"),+ let label,+ !label.isEmpty+ {+ return sanitizeText(label)+ }+guard roleDescription(of: element, role: role, subrole: stringValue(of: element, attribute: kAXSubroleAttribute)) == "search text field" else {return nil}@@ -720,9 +819,55 @@ private func formattedValueSegment(for element: AXUIElement, roleText: String, treturn " \(value)"}+ if roleText == "text entry area" {+ return " \(value)"+ }+return " Value: \(value)"}+private func formattedValueSegmentWithSeparator(_ valueSegment: String, precedingSegments: [String]) -> String {+ guard valueSegment.hasPrefix(" Value:"), precedingSegments.contains(where: { !$0.isEmpty }) else {+ return valueSegment+ }++ return ",\(valueSegment)"+}++private func formattedURLSegment(for element: AXUIElement, title: String?, label: String?) -> String {+ guard stringValue(of: element, attribute: kAXRoleAttribute) == "AXWebArea" else {+ return ""+ }++ guard let url = urlValue(of: element, attribute: kAXURLAttribute), !url.isEmpty else {+ return ""+ }++ if url == title || url == label {+ return ""+ }++ return ", URL: \(url)"+}++private func urlValue(of element: AXUIElement, attribute: String) -> String? {+ guard let value = attributeValue(of: element, attribute: attribute) else {+ return nil+ }++ if CFGetTypeID(value) == CFStringGetTypeID(), let string = value as? String {+ let sanitized = sanitizeText(string)+ return sanitized.isEmpty ? nil : sanitized+ }++ if CFGetTypeID(value) == CFURLGetTypeID(), let url = value as? URL {+ let sanitized = sanitizeText(url.absoluteString)+ return sanitized.isEmpty ? nil : sanitized+ }++ return nil+}+private func displayIdentifierSegment(for element: AXUIElement, role: String, identifier: String?, title: String?) -> String {guard let identifier else {return ""@@ -774,20 +919,24 @@ func shouldElideNode(identifier: String?,traits: [String],actions: [String],- childCount: Int+ childCount: Int,+ genericTextSummary: String? = nil) -> Bool {let genericRoles = [kAXGroupRole as String, kAXUnknownRole as String]guard genericRoles.contains(role) else {return false}+ if genericTextSummary != nil {+ return false+ }+return title == nil&& label == nil&& value == nil&& identifier == nil&& traits.isEmpty&& actions.isEmpty- && childCount > 0}private func shouldSuppressChildren(@@ -799,28 +948,78 @@ private func shouldSuppressChildren(identifier: String?,traits: [String],actions: [String],- children: [AXUIElement]+ children: [AXUIElement],+ genericTextSummary: String?) -> Bool {- guard role == kAXGroupRole as String else {- return false+ if role == kAXMenuBarItemRole as String {+ return true}- guard- title == nil,- label == nil,- help == nil,- value == nil,- identifier == nil,- traits.isEmpty,- actions.isEmpty,- !children.isEmpty- else {+ return genericTextSummary != nil+}++private func summarizedGenericText(+ of element: AXUIElement,+ role: String,+ childElements: [AXUIElement]+) -> String? {+ guard role == kAXGroupRole as String || role == kAXUnknownRole as String else {+ return nil+ }++ guard !childElements.isEmpty else {+ return nil+ }++ guard isPlainGenericTextContainer(element, children: childElements) else {+ return nil+ }++ let texts = descendantTextsForSummary(of: element)+ guard texts.count >= 2 else {+ return nil+ }++ guard shouldMergeTextOnlySiblings(texts) else {+ return nil+ }++ let joined = sanitizeText(texts.joined(separator: " "))+ .replacingOccurrences(of: " : ", with: " : ")+ return joined.isEmpty ? nil : joined+}++func shouldMergeTextOnlySiblings(_ texts: [String]) -> Bool {+ if texts.contains("日期") && texts.contains("时间") {return false}- return children.allSatisfy { child in- stringValue(of: child, attribute: kAXRoleAttribute) == kAXStaticTextRole as String+ let totalLength = texts.reduce(0) { $0 + $1.count }+ return texts.count <= 8 && totalLength <= 220+}++private func isPlainGenericTextContainer(_ element: AXUIElement, children: [AXUIElement], depth: Int = 0) -> Bool {+ for child in children {+ let childRole = stringValue(of: child, attribute: kAXRoleAttribute) ?? ""++ if childRole == kAXStaticTextRole as String || childRole == kAXImageRole as String {+ continue+ }++ if childRole == kAXGroupRole as String || childRole == kAXUnknownRole as String {+ guard depth < 3 else {+ return false+ }++ if isPlainGenericTextContainer(child, children: copyArray(child, attribute: kAXChildrenAttribute) ?? [], depth: depth + 1) {+ continue+ }+ }++ return false}++ return true}private func displayRoleText(@@ -830,8 +1029,12 @@ private func displayRoleText(label: String?,suppressChildren: Bool) -> String {+ if role == kAXMenuBarItemRole as String {+ return ""+ }+if suppressChildren {- return "container"+ return "text"}if baseRoleText == "radio group", role == kAXRadioGroupRole as String, title == nil, label != nil {@@ -855,6 +1058,18 @@ private func roleDescription(of element: AXUIElement, role: String, subrole: Strreturn "row"}+ if role == kAXGroupRole as String {+ return "container"+ }++ if role == kAXMenuBarItemRole as String {+ return ""+ }++ if role == "AXWebArea" {+ return stringValue(of: element, attribute: kAXRoleDescriptionAttribute) ?? "HTML 内容"+ }+if let roleDescription = stringValue(of: element, attribute: kAXRoleDescriptionAttribute), !roleDescription.isEmpty {return roleDescription.lowercased()}@@ -869,14 +1084,25 @@ private func roleDescription(of element: AXUIElement, role: String, subrole: Strfunc meaningfulActions(_ values: [String], role: String) -> [String] {values.filter {- ![+ var ignored = [kAXPressAction as String,"AXShowDefaultUI","AXShowAlternateUI","AXShowMenu","AXConfirm","AXScrollToVisible",- ].contains($0)+ ]++ if [+ kAXMenuBarRole as String,+ kAXMenuBarItemRole as String,+ kAXMenuRole as String,+ kAXMenuItemRole as String,+ ].contains(role) {+ ignored.append(contentsOf: ["AXCancel", "AXPick"])+ }++ return !ignored.contains($0)}.filter {guard role == kAXScrollAreaRole as String else {@@ -966,6 +1192,27 @@ private func descendantTexts(of element: AXUIElement, depth: Int = 0) -> [Stringreturn values}+private func descendantTextsForSummary(of element: AXUIElement, depth: Int = 0) -> [String] {+ guard depth < 8 else {+ return []+ }++ let role = stringValue(of: element, attribute: kAXRoleAttribute) ?? ""+ if role == kAXStaticTextRole as String || role == kAXTextFieldRole as String {+ if let value = sanitizedValue(of: element), !value.isEmpty {+ return [value]+ }++ if let title = stringValue(of: element, attribute: kAXTitleAttribute) {+ let sanitized = sanitizeText(title)+ return sanitized.isEmpty ? [] : [sanitized]+ }+ }++ return (copyArray(element, attribute: kAXChildrenAttribute) ?? [])+ .flatMap { descendantTextsForSummary(of: $0, depth: depth + 1) }+}+private func visibleRows(in rows: [AXUIElement], parent: AXUIElement) -> [AXUIElement] {guard let parentFrame = resolveLocalFrame(of: parent, windowBounds: nil) else {return Array(rows.prefix(20))diff --git a/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift b/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swiftindex f3117de..21e8279 100644--- a/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift+++ b/packages/OpenComputerUseKit/Tests/OpenComputerUseKitTests/OpenComputerUseKitTests.swift@@ -540,11 +540,11 @@ final class OpenComputerUseKitTests: XCTestCase {}func testAccessibilityTreeBudgetAllowsDeepElectronWebViews() {- XCTAssertEqual(accessibilityTreeMaxNodeCount, 500)+ XCTAssertEqual(accessibilityTreeMaxNodeCount, 1200)XCTAssertEqual(accessibilityTreeMaxDepth, 64)XCTAssertTrue(shouldContinueRendering(nextIndex: 120, depth: 16))- XCTAssertTrue(shouldContinueRendering(nextIndex: 499, depth: 63))- XCTAssertFalse(shouldContinueRendering(nextIndex: 500, depth: 20))+ XCTAssertTrue(shouldContinueRendering(nextIndex: 1199, depth: 63))+ XCTAssertFalse(shouldContinueRendering(nextIndex: 1200, depth: 20))XCTAssertFalse(shouldContinueRendering(nextIndex: 120, depth: 64))}@@ -559,6 +559,16 @@ final class OpenComputerUseKitTests: XCTestCase {actions: [],childCount: 3))+ XCTAssertTrue(shouldElideNode(+ role: kAXGroupRole as String,+ title: nil,+ label: nil,+ value: nil,+ identifier: nil,+ traits: [],+ actions: [],+ childCount: 0+ ))XCTAssertFalse(shouldElideNode(role: kAXGroupRole as String,title: "Send",@@ -569,6 +579,33 @@ final class OpenComputerUseKitTests: XCTestCase {actions: [],childCount: 3))+ XCTAssertFalse(shouldElideNode(+ role: kAXGroupRole as String,+ title: nil,+ label: nil,+ value: nil,+ identifier: nil,+ traits: [],+ actions: [],+ childCount: 3,+ genericTextSummary: "AgentSphere 17:18 okay"+ ))+ }++ func testAccessibilityRendererOnlyMergesShortTextOnlySiblingRuns() {+ XCTAssertTrue(shouldMergeTextOnlySiblings(["AgentSphere", "17:18", "好的,谢谢"]))+ XCTAssertFalse(shouldMergeTextOnlySiblings(["日期", "时间", "2026年5月7日", "晚餐", "18:00-20:00"]))+ XCTAssertFalse(shouldMergeTextOnlySiblings([+ "📌 3层简卡轻食",+ "自助餐",+ "🐂主荤:香烤鸡腿肉,孜然巴沙鱼",+ "🍡半荤:卤鸡蛋",+ "🥒素菜:剁椒娃娃菜,酸辣金针菇,清炒上海青,清炒胡萝卜,清炒青笋,海带丝拌千张,清炒西葫芦",+ "🍚主食:螺旋意面,蒸玉米,烤面包",+ "🥛饮品:冬瓜蛋花汤",+ "🍒水果:黄瓜",+ "※注意:餐食饮品等仅供职场便利,请勿带离工区",+ ]))}func testAccessibilityRendererFiltersScrollToVisibleNoise() {@@ -581,6 +618,16 @@ final class OpenComputerUseKitTests: XCTestCase {)}+ func testAccessibilityRendererFiltersImplicitMenuActions() {+ XCTAssertEqual(+ meaningfulActions(+ ["AXCancel", "AXPick", kAXPressAction as String],+ role: kAXMenuBarItemRole as String+ ),+ []+ )+ }+func testBlockingAsyncBridgeTimesOutScreenshotWork() {XCTAssertThrowsError(try BlockingAsyncBridge.run(timeout: 0.01) {