Skip to content

👾 Open Computer Use – Open-Source Alternative to Codex Computer Use

Add TextEdit overlay cursor sequence

Leo0fc780d3a301
diff --git a/docs/histories/2026-04/20260422-1124-add-textedit-overlay-sequence.md b/docs/histories/2026-04/20260422-1124-add-textedit-overlay-sequence.md
new file mode 100644
index 0000000..e955316
--- /dev/null
+++ b/docs/histories/2026-04/20260422-1124-add-textedit-overlay-sequence.md
@@ -0,0 +1,22 @@
+## [2026-04-22 11:24] | Task: 新增 TextEdit overlay cursor 测试序列
+
+### Execution Context
+* **Agent ID**: `Codex`
+* **Base Model**: `GPT-5.4`
+* **Runtime**: `Codex CLI on macOS + SwiftPM`
+
+### User Query
+> `examples/textedit-overlay-seq.json` 这个帮我编排一下多个 tool 调用,用来测试最新的 cursor 效果。
+
+### Changes Overview
+**Scope:** 手工测试样例
+
+**Key Actions:**
+- **[Root examples]**: 新增根目录 `examples/textedit-overlay-seq.json`,补齐文档里引用的样例路径。
+- **[Cursor-focused sequence]**: 编排 `get_app_state -> set_value -> click -> set_value -> click -> set_value`,中间穿插状态刷新,便于观察连续 `click` / `set_value` 之间 cursor 是否保留 idle 位置。
+- **[Visible target spread]**: 将 click 目标改成 TextEdit rich text toolbar 的对齐按钮,避免窗口中心 click 和正文中心几乎重合导致后续位移不可见。
+- **[Observation text]**: 在写入 TextEdit 的文本里明确标记 A/B/C 三段,便于手工观察每次 overlay movement 的起点和终点。
+
+### Files Modified
+- `examples/textedit-overlay-seq.json`
+- `docs/histories/2026-04/20260422-1124-add-textedit-overlay-sequence.md`
diff --git a/examples/textedit-overlay-seq.json b/examples/textedit-overlay-seq.json
new file mode 100644
index 0000000..fae7fbd
--- /dev/null
+++ b/examples/textedit-overlay-seq.json
@@ -0,0 +1,74 @@
+[
+ {
+ "tool": "get_app_state",
+ "args": {
+ "app": "TextEdit"
+ }
+ },
+ {
+ "tool": "set_value",
+ "args": {
+ "app": "TextEdit",
+ "element_index": "2",
+ "value": "Overlay cursor sequence A\n\nThe first visual cursor move should start from the fresh session origin.\nThe next move should continue from the idle cursor position instead of restarting at (0,0)."
+ }
+ },
+ {
+ "tool": "get_app_state",
+ "args": {
+ "app": "TextEdit"
+ }
+ },
+ {
+ "tool": "click",
+ "args": {
+ "app": "TextEdit",
+ "element_index": "36",
+ "click_count": 1,
+ "mouse_button": "left"
+ }
+ },
+ {
+ "tool": "get_app_state",
+ "args": {
+ "app": "TextEdit"
+ }
+ },
+ {
+ "tool": "set_value",
+ "args": {
+ "app": "TextEdit",
+ "element_index": "2",
+ "value": "Overlay cursor sequence B\n\nThis set_value should move back from the toolbar click resting point.\nIf the idle lifecycle is working, the cursor should not disappear and re-enter from the lower-left origin between calls."
+ }
+ },
+ {
+ "tool": "get_app_state",
+ "args": {
+ "app": "TextEdit"
+ }
+ },
+ {
+ "tool": "click",
+ "args": {
+ "app": "TextEdit",
+ "element_index": "35",
+ "click_count": 1,
+ "mouse_button": "left"
+ }
+ },
+ {
+ "tool": "get_app_state",
+ "args": {
+ "app": "TextEdit"
+ }
+ },
+ {
+ "tool": "set_value",
+ "args": {
+ "app": "TextEdit",
+ "element_index": "2",
+ "value": "Overlay cursor sequence C\n\nFinal state after set_value -> click -> set_value -> click -> set_value.\nThe cursor should remain idle at the final text target until the process exits or a turn-ended notification clears it."
+ }
+ }
+]