👾 Open Computer Use – Open-Source Alternative to Codex Computer Use
Swift accessibilityai-agentai-agentsclaude-codecodexcodex-computer-usecomputer-usecomputer-use-agentcross-platformcuadesktop-automationgemini-cligui-automationmacosmcpmodel-context-protocolopen-computer-useopen-computer-use-mcpopenai-codexopencode
Add TextEdit overlay cursor sequence
Leo0fc780d3a301
diff --git a/docs/histories/2026-04/20260422-1124-add-textedit-overlay-sequence.md b/docs/histories/2026-04/20260422-1124-add-textedit-overlay-sequence.mdnew file mode 100644index 0000000..e955316--- /dev/null+++ b/docs/histories/2026-04/20260422-1124-add-textedit-overlay-sequence.md@@ -0,0 +1,22 @@+## [2026-04-22 11:24] | Task: 新增 TextEdit overlay cursor 测试序列++### Execution Context+* **Agent ID**: `Codex`+* **Base Model**: `GPT-5.4`+* **Runtime**: `Codex CLI on macOS + SwiftPM`++### User Query+> `examples/textedit-overlay-seq.json` 这个帮我编排一下多个 tool 调用,用来测试最新的 cursor 效果。++### Changes Overview+**Scope:** 手工测试样例++**Key Actions:**+- **[Root examples]**: 新增根目录 `examples/textedit-overlay-seq.json`,补齐文档里引用的样例路径。+- **[Cursor-focused sequence]**: 编排 `get_app_state -> set_value -> click -> set_value -> click -> set_value`,中间穿插状态刷新,便于观察连续 `click` / `set_value` 之间 cursor 是否保留 idle 位置。+- **[Visible target spread]**: 将 click 目标改成 TextEdit rich text toolbar 的对齐按钮,避免窗口中心 click 和正文中心几乎重合导致后续位移不可见。+- **[Observation text]**: 在写入 TextEdit 的文本里明确标记 A/B/C 三段,便于手工观察每次 overlay movement 的起点和终点。++### Files Modified+- `examples/textedit-overlay-seq.json`+- `docs/histories/2026-04/20260422-1124-add-textedit-overlay-sequence.md`diff --git a/examples/textedit-overlay-seq.json b/examples/textedit-overlay-seq.jsonnew file mode 100644index 0000000..fae7fbd--- /dev/null+++ b/examples/textedit-overlay-seq.json@@ -0,0 +1,74 @@+[+ {+ "tool": "get_app_state",+ "args": {+ "app": "TextEdit"+ }+ },+ {+ "tool": "set_value",+ "args": {+ "app": "TextEdit",+ "element_index": "2",+ "value": "Overlay cursor sequence A\n\nThe first visual cursor move should start from the fresh session origin.\nThe next move should continue from the idle cursor position instead of restarting at (0,0)."+ }+ },+ {+ "tool": "get_app_state",+ "args": {+ "app": "TextEdit"+ }+ },+ {+ "tool": "click",+ "args": {+ "app": "TextEdit",+ "element_index": "36",+ "click_count": 1,+ "mouse_button": "left"+ }+ },+ {+ "tool": "get_app_state",+ "args": {+ "app": "TextEdit"+ }+ },+ {+ "tool": "set_value",+ "args": {+ "app": "TextEdit",+ "element_index": "2",+ "value": "Overlay cursor sequence B\n\nThis set_value should move back from the toolbar click resting point.\nIf the idle lifecycle is working, the cursor should not disappear and re-enter from the lower-left origin between calls."+ }+ },+ {+ "tool": "get_app_state",+ "args": {+ "app": "TextEdit"+ }+ },+ {+ "tool": "click",+ "args": {+ "app": "TextEdit",+ "element_index": "35",+ "click_count": 1,+ "mouse_button": "left"+ }+ },+ {+ "tool": "get_app_state",+ "args": {+ "app": "TextEdit"+ }+ },+ {+ "tool": "set_value",+ "args": {+ "app": "TextEdit",+ "element_index": "2",+ "value": "Overlay cursor sequence C\n\nFinal state after set_value -> click -> set_value -> click -> set_value.\nThe cursor should remain idle at the final text target until the process exits or a turn-ended notification clears it."+ }+ }+]