🙌 OpenHands: AI-Driven Development
docs(verify-openhands): map maintenance through main@ed815e141 (#18085)
Engel Nysta2a74bdbe76d
diff --git a/.agents/skills/verify-openhands/references/feature-map/F05-composer.md b/.agents/skills/verify-openhands/references/feature-map/F05-composer.mdindex 1432a53c0b..b767fb5da6 100644--- a/.agents/skills/verify-openhands/references/feature-map/F05-composer.md+++ b/.agents/skills/verify-openhands/references/feature-map/F05-composer.md@@ -86,7 +86,7 @@ Preconditions:- `conversation wait <id>` right after sending returns at once with the previous `finished` status. Use `conversation wait <id> --fresh`; `--until running` then a terminal wait only works for turns longer than the poll interval (a `Reply with only` turn on deepseek-flash can finish first, and `--until running` then times out).- The slash menu stays open while you type a command; press Escape before Enter or Enter selects the highlighted option instead of sending.- Conversation drafts are saved 500 ms after the last keystroke and not flushed on unmount (the home draft is): navigating sooner restores the older draft (fail row) (#17926). Wait a second before navigating when testing restoration.-- Escape should close the `+` tools menu. Known failure (reproduced 2026-10-06): `testid=tools-context-menu` stays open and focus stays on `chat-plus-button`; #18044 fixed Escape for other popups (#17933, closed) and left this menu as a follow-up; its repro is in [this #17933 comment](https://github.com/OpenHands/OpenHands/issues/17933#issuecomment-5987090872). Repro candidate, not yet filed. Click `chat-plus-button` again or choose an item. A menu left open covers attachments in screenshots. The narrow-width "More input actions" overflow menu ignores Escape too (reproduced 2026-10-06; a follow-up noted in the fix PR #18015, not filed yet): close it with its trigger or an outside click (`browser mouse-click 160 100` at `narrow`).+- Escape should close the `+` tools menu. Known failure (reproduced 2026-10-06): `testid=tools-context-menu` stays open and focus stays on `chat-plus-button` (#18094; #18044 fixed Escape for the other popups and left this menu out). Click `chat-plus-button` again or choose an item. A menu left open covers attachments in screenshots. The narrow-width "More input actions" overflow menu ignores Escape too (reproduced 2026-10-06; a follow-up noted in the fix PR #18015, not filed yet): close it with its trigger or an outside click (`browser mouse-click 160 100` at `narrow`).- After a client-side switch between conversations (a sidebar row, or a user-message branch in `F06.branch-from-here`) Send keeps the previous conversation's state (repro candidate, not filed yet). Switching from an empty composer to one with a saved draft restores the text next to a disabled Send; this is a race (Send came up enabled in 1 of 7 tries), so one enabled reading does not show the bug is gone. Switching from a composer with text to an empty one leaves Send enabled, and clicking it does nothing. Typing or `browser reload` fixes it, and Enter in the field sends the restored text anyway. Read `browser enabled 'testid=submit-button'` after a reload, or after typing.- Uploaded chips and thumbnails have no test ids. Their remove buttons are named `Remove <file name>` (file chip) and `Remove image` (thumbnail), and Send, Stop and Play read `Send message`, `Stop` and `Resume the agent task` (#18033); select by those names, or by text/alt.- `browser upload` feeds the hidden input directly. To drive the real path, `+` > Add Files and Images, use `control-openhands browser upload-via 'testid=add-files-and-images-button' <file>`, which answers the native file chooser.diff --git a/.agents/skills/verify-openhands/references/feature-map/F07-conversation-page.md b/.agents/skills/verify-openhands/references/feature-map/F07-conversation-page.mdindex 8b42eea77f..53421220ff 100644--- a/.agents/skills/verify-openhands/references/feature-map/F07-conversation-page.md+++ b/.agents/skills/verify-openhands/references/feature-map/F07-conversation-page.md@@ -20,8 +20,8 @@ Source: `src/routes/conversation.tsx`, `src/components/features/conversation/`,- `F07.menu-open`: the "..." menu opens under the title; Escape closes it and returns focus to "...", and so does an outside click (without the focus move).- `F07.menu-items-by-state`: Show Available Hooks and Stop Conversation appear only while the conversation is active.- `F07.skills-modal`: Show Available Skills lists the loaded skills with expandable rows and Refresh.-- `F07.hooks-modal`: Show Available Hooks lists hooks or "No hooks configured for this conversation."-- `F07.skills-modal-project`: a workspace with `.agents/skills/<name>/SKILL.md` adds a "Project skills" section above the public ones; each row expands to its triggers and body, and the list is re-read from the workspace when the dialog opens or Refresh is clicked.+- `F07.hooks-modal`: Show Available Hooks lists the workspace's `.openhands/hooks.json` hooks by event (read when it first opens for a conversation after a page load, and on Refresh; a reopen within 5 minutes of the last read shows the cached list), or "No hooks configured for this conversation."+- `F07.skills-modal-project`: a workspace with `.agents/skills/<name>/SKILL.md` adds a "Project skills" section above the public ones; each row expands to its triggers and body. The list is read with the page and on Refresh; opening the dialog within 10 minutes of the last read shows the cached list.- `F07.agent-tools-modal`: Show Agent Tools & Metadata shows the system message and the tool list.- `F07.export-transcript`: Export… downloads a Markdown or HTML transcript with optional tool details and timestamps.- `F07.download-zip`: Download conversation data downloads `conversation_<id>.zip`.@@ -68,9 +68,9 @@ Preconditions:- **Branch from a message (`F07.branch-from-message`).** On `/conversations/<id>` (`control-openhands browser goto /conversations/<id>`; Stop with confirmation ended on `/conversations`) run `control-openhands browser hover 'testid=agent-message'`, then `control-openhands browser click 'testid=agent-message >> role=button[name="Branch from here"]' --expect-url '/conversations/(?!<id>)[0-9a-f-]+'`, `control-openhands browser text 'testid=conversation-name-title'` (`QA_F07 renamed (branch)`) and `control-openhands browser count 'testid=chat-interface >> testid=user-message'` (`1`, the history is copied up to that reply). Back on `/conversations/<id>` (`control-openhands browser goto /conversations/<id>`), `control-openhands browser hover 'testid=user-message'` and `control-openhands browser click 'testid=user-message >> role=button[name="Branch from here"]' --expect-url '/conversations/(?!<id>)[0-9a-f-]+'` (it prints `/conversations/<branch-id>`): the new branch has `0` user messages and `control-openhands browser text 'testid=chat-input'` reads the original prompt `Reply with the single word: pong`, still there a few seconds later and not sent (`control-openhands conversation events <branch-id> --kinds MessageEvent` has count `0`).- **Delete with confirmation (`F07.delete-confirm`).** On a disposable conversation (for example the branch from `F07.branch-from-message`) run `control-openhands browser click 'testid=chat-pane-header >> testid=ellipsis-button'`, `control-openhands browser click 'testid=conversation-name-context-menu >> testid=delete-button'` and `control-openhands browser snapshot 'role=dialog'`: `Confirm Delete Are you sure you want to delete the "<title>" conversation? This action cannot be undone.` with `Cancel` and `Confirm Delete`. `control-openhands browser click 'role=dialog >> role=button[name="Cancel"]'` keeps the URL. Repeat the two clicks, then `control-openhands browser click 'role=dialog >> role=button[name="Confirm Delete"]' --expect-url '/conversations$'`; `control-openhands api GET '/api/conversations?ids=<id>'` returns `[null]` and `browser goto /conversations/<id>` redirects as in `F07.missing-redirect`.- **Paused conversation (`F07.menu-items-by-state`, `F07.status-menu`).** Run `control-openhands browser goto /conversations/<running-id>`, open the "..." menu and `control-openhands browser testids 'testid=conversation-name-context-menu'`: `show-hooks-button` and `stop-button` are absent. Close it with `control-openhands browser mouse-click 900 500`. Run `control-openhands browser click 'testid=server-status-menu-trigger'` and `control-openhands browser text 'testid=server-status-context-menu'` (`Server Stopped` / `Start Runtime`), then `control-openhands browser click 'testid=server-status-context-menu >> testid=start-server-button'` and `control-openhands conversation wait <running-id> --until running,finished,idle --timeout 60`. The status is `running` again and the menu reads `Running` / `Stop Runtime`.-- **Hooks (`F07.hooks-modal`).** On an active conversation open the "..." menu, `control-openhands browser click 'testid=conversation-name-context-menu >> testid=show-hooks-button'` and `control-openhands browser text 'testid=hooks-modal'`. It reads `Available Hooks`, the workspace explanation and `No hooks configured for this conversation.`; `control-openhands browser click 'testid=hooks-modal >> testid=refresh-hooks'` keeps it, `control-openhands browser click 'testid=close-hooks-modal'` closes it.+- **Hooks (`F07.hooks-modal`).** On `/conversations/<running-id>` (no workspace attached; Paused conversation left the browser there) open the "..." menu, `control-openhands browser click 'testid=conversation-name-context-menu >> testid=show-hooks-button'` and `control-openhands browser text 'testid=hooks-modal'`. It reads `Available Hooks`, the workspace explanation and `No hooks configured for this conversation.` (the backend workspace root has no `hooks.json`). Run `control-openhands browser network --clear` and `control-openhands browser click 'testid=hooks-modal >> testid=refresh-hooks'`: the text stays and `control-openhands browser network` shows `POST /api/hooks`. `control-openhands browser click 'testid=close-hooks-modal'` closes it.- **Skills (`F07.skills-modal`).** Open the menu, `control-openhands browser click 'testid=conversation-name-context-menu >> testid=show-skills-button'`, `control-openhands browser snapshot 'role=dialog'` (`Public skills 12` and one button per skill), `control-openhands browser click 'testid=skills-modal >> role=button[name="github Knowledge"]'`; the row expands to `Triggers` and `Content`. `control-openhands browser press Escape` closes it (`browser count 'testid=skills-modal'` is `0`).-- **Project skills and configured hooks (`F07.skills-modal-project`, `F07.hooks-modal`).** Arrange (outside the UI) a project skill and a hook in the git fixture: `mkdir -p <run>/workspace/qa-f07-repo/.agents/skills/qa-f07-skill <run>/workspace/qa-f07-repo/.openhands`, write `<run>/workspace/qa-f07-repo/.agents/skills/qa-f07-skill/SKILL.md` with front matter `name: qa-f07-skill`, `description: QA fixture skill for F07.`, `triggers: [qaf07trigger]` and the body `QA_F07 skill body.`, and write `<run>/workspace/qa-f07-repo/.openhands/hooks.json` as `{"pre_tool_use":[{"matcher":"terminal","hooks":[{"type":"command","command":"true","timeout":10}]}]}`. Then `control-openhands conversation start --workspace qa-f07-repo --prompt "Reply with the single word: hi" --wait --timeout 240` prints `<hooks-id>`; `control-openhands api GET /api/conversations/<hooks-id>` shows that `hook_config.pre_tool_use` holds the `terminal` matcher. On `/conversations/<hooks-id>` open the menu, `control-openhands browser click 'testid=conversation-name-context-menu >> testid=show-skills-button'` and `control-openhands browser snapshot 'role=dialog'`: `Project skills 1` with `button "qa-f07-skill AgentSkills"` above `Public skills 12`. `control-openhands browser click 'testid=skills-modal >> role=button[name="qa-f07-skill AgentSkills"]'` expands it to `Triggers qaf07trigger Content QA_F07 skill body.`; `control-openhands browser click 'testid=skills-modal >> testid=refresh-skills'` re-reads the workspace (`browser network` shows `POST /api/skills`). Close with `control-openhands browser press Escape`. Hooks: open the menu, `control-openhands browser click 'testid=conversation-name-context-menu >> testid=show-hooks-button'` and `control-openhands browser text 'testid=hooks-modal'` should list a `Pre Tool Use` event with `Matcher` `terminal` and `Commands` `true`; today it reads `No hooks configured for this conversation.` even after `refresh-hooks` (see Gotchas).+- **Project skills and configured hooks (`F07.skills-modal-project`, `F07.hooks-modal`).** Arrange (outside the UI) a project skill and a hook in the git fixture: `mkdir -p <run>/workspace/qa-f07-repo/.agents/skills/qa-f07-skill <run>/workspace/qa-f07-repo/.openhands`, write `<run>/workspace/qa-f07-repo/.agents/skills/qa-f07-skill/SKILL.md` with front matter `name: qa-f07-skill`, `description: QA fixture skill for F07.`, `triggers: [qaf07trigger]` and the body `QA_F07 skill body.`, and write `<run>/workspace/qa-f07-repo/.openhands/hooks.json` as `{"pre_tool_use":[{"matcher":"terminal","hooks":[{"type":"command","command":"true","timeout":10}]}]}`. Then `control-openhands conversation start --workspace qa-f07-repo --prompt "Reply with the single word: hi" --wait --timeout 240` prints `<hooks-id>`; `control-openhands api GET /api/conversations/<hooks-id>` shows that `hook_config.pre_tool_use` holds the `terminal` matcher. On `/conversations/<hooks-id>` open the menu, `control-openhands browser click 'testid=conversation-name-context-menu >> testid=show-skills-button'` and `control-openhands browser snapshot 'role=dialog'`: `Project skills 1` with `button "qa-f07-skill AgentSkills"` above `Public skills 12`. `control-openhands browser click 'testid=skills-modal >> role=button[name="qa-f07-skill AgentSkills"]'` expands it to `Triggers qaf07trigger Content QA_F07 skill body.`; `control-openhands browser click 'testid=skills-modal >> testid=refresh-skills'` re-reads the workspace (`browser network` shows `POST /api/skills`). Close with `control-openhands browser press Escape`. Hooks: open the menu, `control-openhands browser click 'testid=conversation-name-context-menu >> testid=show-hooks-button'` and `control-openhands browser snapshot 'testid=hooks-modal'`: one collapsed event, `button "Pre Tool Use 1 hook"`. `control-openhands browser click 'testid=hooks-modal >> role=button[name="Pre Tool Use 1 hook"]'` expands it to `Matcher terminal Commands true Type: command Timeout: 10s` (`control-openhands browser screenshot --feature F07.hooks-modal --name workspace-hooks`). Close it with `control-openhands browser click 'testid=close-hooks-modal'` and write `<run>/workspace/qa-f07-repo/.openhands/hooks.json` as `{"pre_tool_use":[{"matcher":"terminal","hooks":[{"type":"command","command":"true","timeout":10}]}],"stop":[{"hooks":[{"type":"command","command":"echo qa-f07-stop"}]}]}`. A reopen keeps the list it read: run `control-openhands browser network --clear`, open the menu, `control-openhands browser click 'testid=conversation-name-context-menu >> testid=show-hooks-button'` again, then `control-openhands browser network --filter /api/hooks` (no request) and `control-openhands browser snapshot 'testid=hooks-modal'` (still only `button "Pre Tool Use 1 hook"`). Refresh re-reads the file: `control-openhands browser click 'testid=hooks-modal >> testid=refresh-hooks'`, then `control-openhands browser network --filter /api/hooks` shows `POST /api/hooks` and the snapshot adds `button "Stop 1 hook"`; `control-openhands browser click 'testid=hooks-modal >> role=button[name="Stop 1 hook"]'` expands it to `Matcher * Commands echo qa-f07-stop Type: command Timeout: 60s` (the SDK defaults). Close with `control-openhands browser click 'testid=close-hooks-modal'`.- **Agent tools (`F07.agent-tools-modal`).** Open the menu, `control-openhands browser click 'testid=conversation-name-context-menu >> testid=show-agent-tools-button'`; the dialog `testid=system-message-modal` has tabs `System Message` (selected, the system prompt) and `Available Tools`. `control-openhands browser click 'role=dialog >> role=tab[name="Available Tools"]'`, `control-openhands browser count 'testid=system-message-modal >> testid=toggle-button'` (`9`), `control-openhands browser click 'testid=system-message-modal >> testid=toggle-button >> nth=0'` expands `terminal` with its description. Close with `control-openhands browser click 'testid=close-system-message-modal'`.- **Export transcript (`F07.export-transcript`).** Open the menu, `control-openhands browser click 'testid=conversation-name-context-menu >> testid=export-transcript-button'`; `control-openhands browser snapshot 'role=dialog'` shows `Export conversation`, radio `Markdown document (.md)` checked, `Standalone web page (.html)`, and checkboxes `Include tool call details` and `Include timestamps` checked. `control-openhands browser click 'testid=confirm-transcript-export'` then `control-openhands browser downloads --last 1 --inspect`: a `<ms>-conversation-<id>.md` (the harness prefixes a timestamp to the suggested `conversation-<id>.md`) lands in `<run>/private/downloads` starting `# QA_F07 renamed`, `**Model:** deepseek/deepseek-flash`, `## User` with `<sub>` timestamps. Reopen, `control-openhands browser click 'role=dialog >> role=radio[name="Standalone web page (.html)"]'`, `control-openhands browser click 'role=dialog >> role=checkbox[name="Include timestamps"]'`, export: the `.html` has `<title>QA_F07 renamed</title>` and no timestamps. Reopen once more: `control-openhands browser click 'testid=cancel-transcript-export'` closes it without a download (the file count in `<run>/private/downloads` is unchanged); `browser press Escape` and `testid=close-transcript-export-modal` close it too.- **Download data (`F07.download-zip`).** Open the menu, `control-openhands browser click 'testid=conversation-name-context-menu >> testid=download-trajectory-button'`, then `control-openhands browser downloads`. A `<ms>-conversation_<id>.zip` lands in `<run>/private/downloads`; `browser downloads --last 1 --inspect` lists `<id-without-dashes>/base_state.json` and `bash_events/`, and every LLM `api_key` in `base_state.json` is masked as asterisks (`**********`).@@ -90,10 +90,10 @@ Preconditions:- `stop-button`, `show-skills-button`, `show-hooks-button` and `show-agent-tools-button` also exist in the composer, and `ellipsis-button` in sidebar rows: always scope to `testid=chat-pane-header` or `testid=conversation-name-context-menu`.- Stop Runtime (status menu) and Stop Conversation (menu) both navigate to `/conversations`. On a finished local conversation the agent server keeps `finished`; use a running conversation to see `paused` and Start Runtime.- Rename has no Escape-to-cancel: Escape leaves the input open and the next blur saves whatever was typed.-- Expected: Escape closes the status-dot menu, as it closes the "..." and Git actions menus. Known failure: the menu stays open (`browser count 'testid=server-status-context-menu'` stays `1`), so close it with an outside click (`browser mouse-click 900 500`). Repro candidate, not yet filed: it was listed in a comment on #17933, which #18044 closed while leaving this menu for a follow-up.+- Expected: Escape closes the status-dot menu, as it closes the "..." and Git actions menus. Known failure (reproduced 2026-10-06): the menu stays open (`browser count 'testid=server-status-context-menu'` stays `1`) (#18094), so close it with an outside click (`browser mouse-click 900 500`).- The status menu reads `Running` / `Stop Runtime` for a finished local conversation too; only a paused one shows `Server Stopped` / `Start Runtime`.- Panel and Overview columns animate: read their state with `browser wait <sel> --state hidden|visible`, not an immediate `browser visible`.-- The Skills dialog re-reads the workspace each time it opens, so a project skill added while the dialog is closed appears without Refresh.+- The Skills dialog shows the list read with the page or at the last Refresh: a project skill added later appears after Refresh (or `browser reload`), not on reopening the dialog within 10 minutes. Its own text says to click Refresh.- `tabs-pane-header` and `conversation-overview-column` stay in the DOM when hidden: assert with `browser visible` or `aria-pressed`, not `count`.- `browser visible 'testid=usage-panel'` right after Display Usage and Cost can read `false`; `browser wait` first.- Exports and the zip land in `<run>/private/downloads`; the transcript holds the prompts and the zip holds the full event store. Review before sharing.@@ -104,5 +104,7 @@ Preconditions:- The repo, branch and Pull/Push chips come from `git remote get-url origin` in the workspace, read when the page loads: reload after changing the remote.- The Usage tab logs `GET /api/llm/balance` 404 on a local backend (F27); count it in `browser errors --app-only` but it is not an F07 failure.- The overview's Automations section has no opener in the UI (the overview menu offers Workspace and Git sections only).-- Known product issue (repro candidate, #17924): on a local backend the Hooks dialog shows `No hooks configured`, even for a conversation started with workspace hooks. `getHooks` in `src/api/conversation-service/agent-server-conversation-service.api.ts` always returns an empty list, although the conversation's `hook_config` holds the workspace `.openhands/hooks.json` and the dialog says hooks are loaded from the workspace.+- The Hooks dialog shows the workspace's `hooks.json` as of its last read (its first open for the conversation after a page load, or Refresh), not the hooks the conversation started with: after the hooks steps above, `browser goto /conversations/<git-id>` (started before the file existed; its `hook_config` is `null`) and opening the dialog lists both events too. A reopen within 5 minutes of that read shows the same list and sends no request: click Refresh after editing `hooks.json`.+- Expected: a prompt- or agent-type hook shows its text under Commands (the `prompt`, or an agent hook's `system_prompt`). Known failure (reproduced 2026-10-06): write `<run>/workspace/qa-f07-repo/.openhands/hooks.json` as `{"stop":[{"hooks":[{"type":"prompt","prompt":"QA_F07 prompt hook"}]}],"session_start":[{"hooks":[{"type":"agent","system_prompt":"QA_F07 agent hook"}]}]}`, open the Hooks dialog on `/conversations/<hooks-id>`, click `testid=hooks-modal >> testid=refresh-hooks`, then `role=button[name="Stop 1 hook"]` and `role=button[name="Session Start 1 hook"]` inside `testid=hooks-modal`. They expand to `Matcher * Commands Type: prompt Timeout: 60s` and `Matcher * Commands Type: agent Timeout: 60s`, and `browser text 'testid=hooks-modal >> pre'` returns two empty strings, although the server sends both texts (`control-openhands api POST /api/hooks --write --data '{"project_dir":"<run>/workspace/qa-f07-repo"}'` has them in `prompt` and `system_prompt`, with `command` empty) (#18089). Write the two-event `hooks.json` back and Refresh afterwards.+- Expected: with the Agent Server down, Refresh in the Hooks dialog shows a fetch error about hooks. Known failure (reproduced 2026-10-06): after `control-openhands service stop agent-server` on an open dialog, `refresh-hooks` and `browser wait 'testid=hooks-modal >> text=Failed to fetch' --timeout 30000`, it reads `Failed to fetch skills. Please try again later.` (the shared `COMMON$FETCH_ERROR` string) (#18088). Run it last, or `restart` afterwards.- After the user-message branch in `F07.branch-from-message`, Send stays disabled next to the prefilled text (`browser enabled 'testid=submit-button'` is `false`; repro candidate, not filed yet, see F05 Gotchas). Enter in the field sends it.diff --git a/.agents/skills/verify-openhands/references/feature-map/F08-workspace-files-and-changes.md b/.agents/skills/verify-openhands/references/feature-map/F08-workspace-files-and-changes.mdindex 3d9d726ba3..fa089c7ba7 100644--- a/.agents/skills/verify-openhands/references/feature-map/F08-workspace-files-and-changes.md+++ b/.agents/skills/verify-openhands/references/feature-map/F08-workspace-files-and-changes.md@@ -104,7 +104,7 @@ Preconditions:- When the drawer is closed, its tabs stay mounted at width 0. `browser count 'testid=files-tab'` is `1` even then, so assert with `browser visible` or `right-panel-toggle` `aria-pressed`.- The tab row is a `tablist "Conversation panels"` of `role=tab` controls, each named after its tab even when inactive (#17612), so `role=tab[name="Commits"]` finds the Commits tab whether or not it is active; `role=button[name="Commits"]` finds nothing. `aria-selected` marks the selected tab. The `conversation-tab-*` test ids still work.- The tab row ends with the ellipsis menu (`Customize tabs`), then the `VSCode` button (`drawer-vscode-link`, named `Open in VS Code`) when the runtime reports a running editor. #17660 removed that button and #18048 restored it, so on a checkout between the two the drawer has no editor control at all.-- The overflow menu is not a `role=menu`. Escape should close it. Known failure (reproduced 2026-10-06): the `conversation-tabs-menu-*` rows stay and focus stays on the ellipsis; #18044 fixed Escape for other popups (#17933, closed) and left this menu as a follow-up; its repro is in [this #17933 comment](https://github.com/OpenHands/OpenHands/issues/17933#issuecomment-5987090872). Repro candidate, not yet filed. Close it by choosing a row or with `browser mouse-click` outside.+- The overflow menu is not a `role=menu`. Escape should close it. Known failure (reproduced 2026-10-06): the `conversation-tabs-menu-*` rows stay and focus stays on the ellipsis (#18094; #18044 fixed Escape for the other popups and left this menu out). Close it by choosing a row or with `browser mouse-click` outside.- The Files list and the open preview do not follow bash edits: `use-auto-refresh-files-on-edit.ts` refreshes the file queries only for file-editor observations, and its comment says shell observations skip them on purpose (so that every shell command does not reload canvas iframes). This map still expects files the agent writes to appear (`F08.files-auto-refresh`), so the bash case stays a fail row. Click `files-tab-refresh` once before asserting on files the agent made with the shell. Since #18032 that one click also re-reads the open file (the content fetch revalidates instead of using the browser HTTP cache, and the rich preview gets a new `?v=`), and a page reload shows the current body without a click.- The chat also fetches the file list (to linkify paths). A conversation page left open while the agent works can therefore show a stale tree the moment the drawer first opens.- Binary detection is a NUL-byte sniff of the first 8 KB, and the Office message also needs that sniff to trip. A 4-byte `PK\003\004` "pptx" or random bytes without a NUL render as text in the plain viewer. Fixtures must contain a NUL.diff --git a/.agents/skills/verify-openhands/references/feature-map/F19-plugins.md b/.agents/skills/verify-openhands/references/feature-map/F19-plugins.mdindex ad5a9a09a2..b7f50787fc 100644--- a/.agents/skills/verify-openhands/references/feature-map/F19-plugins.md+++ b/.agents/skills/verify-openhands/references/feature-map/F19-plugins.md@@ -68,12 +68,12 @@ Preconditions:- **Install from a card (`F19.install-card`).** Run `control-openhands browser toasts --clear`, `control-openhands browser click 'testid=plugin-install-magic-test'`, `control-openhands browser wait 'testid=plugin-toggle-magic-test' --timeout 60000` and `control-openhands browser toasts` (`Plugin installed.`). `control-openhands browser text 'testid=plugin-version-magic-test'` is `v1.0.0` and `control-openhands browser eval "[...document.querySelectorAll('[data-testid^=plugin-card-]')].map(e=>e.dataset.testid)[0]"` is `plugin-card-magic-test`. After `control-openhands browser reload` and `control-openhands browser click 'testid=plugins-filter-installed'`, `browser count '[data-testid^="plugin-card-"]'` is `1`, and `control-openhands api GET /api/plugins/installed` lists `magic-test` with `"enabled": true`. Click `testid=plugins-filter-all`.- **Enable switch (`F19.enable-toggle`).** Run `control-openhands browser attr 'testid=plugin-toggle-magic-test' aria-checked` (`true`) and `control-openhands browser attr 'testid=plugin-toggle-magic-test' aria-label` (`Disable plugin`), `control-openhands browser hover 'testid=plugin-toggle-magic-test'`, `control-openhands browser click 'testid=plugin-toggle-magic-test'`, wait three seconds, then `browser attr ... aria-checked` again (`false`, with `aria-label` `Enable plugin`); after `control-openhands browser reload` it is still `false` and `api GET /api/plugins/installed` shows `"enabled": false`. Today the disable is often lost: the reload's concurrent reads hit the metadata race (Gotchas) and the API, then the switch, read `"enabled": true` again (2 of 3 trials; the PATCH itself returns 200). If that happens, disable it once more before the modal step, which needs the plugin disabled. In the modal: `control-openhands browser click 'testid=plugin-card-magic-test'`, `control-openhands browser click 'testid=plugin-detail-modal >> text="Disabled"'`, then `control-openhands browser eval "document.querySelector('[data-testid=plugin-modal-toggle-magic-test]').checked"` (`true`); the API shows `"enabled": true` and, after closing the modal, the card switch's `aria-checked` is `true`.- **Enabled plugins auto-load (`F19.enabled-autoload`).** With `magic-test` enabled, run `control-openhands conversation start --prompt "alakazam" --wait --timeout 240` and `control-openhands browser text 'testid=agent-message >> nth=-1'`: `The magic worked! Plugin loaded successfully. 🎩✨`. Then `control-openhands browser goto /plugins`, disable it with the card switch (hover, click; API `"enabled": false`) and run the same `conversation start`: the reply is an ordinary request for a task, without the phrase. `browser goto /plugins` again; `magic-test` stays installed and disabled. Today the revisit often re-enables it (API `"enabled": true`, `installed_at` reset; see Gotchas), so re-check the API before relying on the disabled state.-- **Update (`F19.refresh`).** Run `control-openhands browser click 'testid=plugin-card-magic-test'`, `control-openhands browser toasts --clear`, `control-openhands browser click 'testid=plugin-detail-refresh-magic-test'`, wait a few seconds, then `control-openhands browser toasts`. Expected `Plugin updated.` (the toast fades fast: read `control-openhands browser toasts --history`). Whether it works depends on the recorded source. After a catalog install it usually fails (see Gotchas): `control-openhands browser text 'testid=plugin-source-magic-test'` reads `local` instead of the catalog path, and the toast is `HTTP request failed (500 Internal Server Error): … Unable to parse extension source: local …`, shown twice. On a plugin whose source survived (the GitHub install in **Add plugin from GitHub**, `browser text 'testid=plugin-source-magic-test'` = `github:OpenHands/extensions`), the same click logs `Updating extension magic-test from github:OpenHands/extensions` and `toasts --history` shows `Plugin updated.` Close the modal.+- **Update (`F19.refresh`).** Run `control-openhands browser click 'testid=plugin-card-magic-test'`, `control-openhands browser toasts --clear`, `control-openhands browser click 'testid=plugin-detail-refresh-magic-test'`, wait a few seconds, then `control-openhands browser toasts`. Expected `Plugin updated.` (the toast fades fast: read `control-openhands browser toasts --history`). Whether it works depends on the recorded source (`control-openhands browser text 'testid=plugin-source-magic-test'`): with the catalog path it does. Known failure (reproduced 2026-10-06): a page revisit after a catalog install usually rewrites the source to `local` (OpenHands/software-agent-sdk#5496, see Gotchas), and Update then answers 500 with one toast carrying the server's reason, `Unable to parse extension source: local. Expected formats: 'github:owner/repo', git URL, or local path` (`browser screenshot --feature F19.refresh --name local-source-error`). On a plugin whose source survived (the GitHub install in **Add plugin from GitHub**, `browser text 'testid=plugin-source-magic-test'` = `github:OpenHands/extensions`), the same click logs `Updating extension magic-test from github:OpenHands/extensions` and `toasts --history` shows `Plugin updated.` Close the modal.- **Start a conversation from an installed plugin (`F19.start-conversation`).** Run `control-openhands browser click 'testid=plugin-card-magic-test'`, `control-openhands browser click 'testid=plugin-detail-start-conversation-magic-test' --expect-url '/launch\?plugins='` and `control-openhands browser eval "JSON.parse(atob(new URLSearchParams(location.search).get('plugins')))"`. Expected: the plugin's real source. Today it is `[{"source":"local","ref":null,"repo_path":null}]` and the modal title is `Launch local`; after `control-openhands browser check 'testid=trust-checkbox'` and `control-openhands browser click 'testid=start-conversation-button' --expect-url '/conversations/[0-9a-f-]+'`, `control-openhands browser type 'testid=chat-input' 'alakazam'` and `control-openhands browser press Enter --selector 'testid=chat-input'` leave the message at `Sending...` (still after 25 s) with the banner `Unable to parse plugin source: local. Expected formats: 'github:owner/repo', git URL, or local path` (`control-openhands browser screenshot --feature F19.start-conversation --name local-source-conversation`). When the installed plugin kept its source (the GitHub install below), the link carries it: `[{"source":"github:OpenHands/extensions","ref":"<resolved commit>","repo_path":"plugins/magic-test"}]` and the title is `Launch magic-test`.- **Uninstall (`F19.uninstall`).** Run `control-openhands browser goto /plugins`, `control-openhands browser toasts --clear`, `control-openhands browser click 'testid=plugin-card-magic-test'`, `control-openhands browser click 'testid=plugin-detail-uninstall-magic-test'`, then `control-openhands browser count 'testid=plugin-detail-modal'` (`0`), `control-openhands browser count 'testid=confirmation-modal'` (`0`: no confirmation), `control-openhands browser toasts` (`Plugin uninstalled.`) and `control-openhands browser count 'testid=plugin-install-magic-test'` (`1`). After `control-openhands browser reload` the Install button is still there, `browser text 'testid=plugin-source-magic-test'` is the catalog path again and `api GET /api/plugins/installed` returns `{"plugins": []}`.- **Install from the modal (`F19.install-modal`).** Run `control-openhands browser toasts --clear`, `control-openhands browser click 'testid=plugin-card-city-weather'`, `control-openhands browser click 'testid=plugin-detail-install-city-weather'`, `control-openhands browser wait 'testid=plugin-detail-uninstall-city-weather' --timeout 60000` and `control-openhands browser toasts` (`Plugin installed.`). The modal stays open (`browser count 'testid=plugin-detail-modal'` is `1`), `control-openhands browser eval "document.querySelector('[data-testid=plugin-modal-toggle-city-weather]').checked"` is `true`, and `control-openhands browser snapshot 'testid=plugin-detail-modal >> footer'` lists **Update**, **Uninstall**, **Start Conversation**, **Close**. Clean up with `control-openhands browser click 'testid=plugin-detail-uninstall-city-weather'`; `browser count 'testid=plugin-install-city-weather'` is `1`.- **Cancel Add plugin (`F19.add-plugin-cancel`).** Run `control-openhands browser click 'testid=plugins-add-plugin-button'`, `control-openhands browser fill 'testid=add-plugin-source-input' qa-typed` and `control-openhands browser click 'testid=add-plugin-modal-close'`; `control-openhands browser count 'testid=add-plugin-modal'` is `0`. Reopen it: `control-openhands browser value 'testid=add-plugin-source-input'` is empty. Type again and close with `control-openhands browser click 'testid=add-plugin-modal-dismiss'` (count `0`); reopen and `control-openhands browser press Escape` (count `0`); reopen and `control-openhands browser mouse-click 20 500` on the backdrop (count `0`). `api GET /api/plugins/installed` still returns `{"plugins": []}` and `browser network` shows no `POST /api/plugins/install`.-- **Add plugin form and error (`F19.add-plugin`, `F19.add-plugin-error`).** Run `control-openhands browser click 'testid=plugins-add-plugin-button'` and `control-openhands browser snapshot 'testid=add-plugin-modal'`: heading `Add a plugin`, `Install a plugin from a Git source or local path.`, textbox `Source` (placeholder `github:owner/repo, a Git URL, or a local path`), `Ref Optional`, `Path Optional`, **Close** and a disabled **Install**. `control-openhands browser fill 'testid=add-plugin-source-input' ' '` keeps `control-openhands browser enabled 'testid=add-plugin-submit'` at `false`; `control-openhands browser fill 'testid=add-plugin-source-input' qa-not-a-source` turns it `true`. Run `control-openhands browser toasts --clear`, `control-openhands browser click 'testid=add-plugin-submit'`, wait a few seconds, then `control-openhands browser toasts`, `control-openhands browser count 'testid=add-plugin-modal'` (`1`) and `control-openhands browser value 'testid=add-plugin-source-input'` (`qa-not-a-source`). Expected one toast with the server's reason (the Agent Server answers 400 `Failed to fetch plugin source. Check that the source is valid.`); today two identical toasts read `Disconnected (check URL or network). Check that the backend URL is correct…` (`browser screenshot --feature F19.add-plugin-error --name toast`).+- **Add plugin form and error (`F19.add-plugin`, `F19.add-plugin-error`).** Run `control-openhands browser click 'testid=plugins-add-plugin-button'` and `control-openhands browser snapshot 'testid=add-plugin-modal'`: heading `Add a plugin`, `Install a plugin from a Git source or local path.`, textbox `Source` (placeholder `github:owner/repo, a Git URL, or a local path`), `Ref Optional`, `Path Optional`, **Close** and a disabled **Install**. `control-openhands browser fill 'testid=add-plugin-source-input' ' '` keeps `control-openhands browser enabled 'testid=add-plugin-submit'` at `false`; `control-openhands browser fill 'testid=add-plugin-source-input' qa-not-a-source` turns it `true`. Run `control-openhands browser toasts --clear`, `control-openhands browser click 'testid=add-plugin-submit'`, wait a few seconds, then `control-openhands browser toasts --history`, `control-openhands browser count 'testid=add-plugin-modal'` (`1`) and `control-openhands browser value 'testid=add-plugin-source-input'` (`qa-not-a-source`). The history holds one toast with the server's reason: the Agent Server answers 400 `Failed to fetch plugin source. Check that the source is valid.`, and the toast shows that text (`browser screenshot --feature F19.add-plugin-error --name toast`).- **Add plugin from GitHub (`F19.add-plugin`).** In the same modal run `control-openhands browser fill 'testid=add-plugin-source-input' 'github:OpenHands/extensions'`, `control-openhands browser fill 'testid=add-plugin-repo-path-input' 'plugins/magic-test'`, `control-openhands browser toasts --clear`, `control-openhands browser click 'testid=add-plugin-submit'` and `control-openhands browser text 'testid=add-plugin-submit'` (`Installing…`), then `control-openhands browser wait 'testid=add-plugin-modal' --state hidden --timeout 120000` and `control-openhands browser toasts` (`Plugin installed.`). `api GET /api/plugins/installed` lists `magic-test` with four files (`.claude-plugin/plugin.json`, `.codex-plugin/plugin.json`, `.plugin/plugin.json`, `skills/magic-word/SKILL.md`) with `"source": "github:OpenHands/extensions"`, `"repo_path": "plugins/magic-test"` and a commit in `resolved_ref`; the card's `plugin-source-magic-test` reads `github:OpenHands/extensions`. The metadata race (Gotchas) can still turn it into `"source": "local"` with `repo_path: null`. Without GitHub access expect the error toast of the previous bullet instead. Clean up: `testid=plugin-card-magic-test` → `testid=plugin-detail-uninstall-magic-test`.- **Installed coordinates (`F19.installed-coordinates`).** Needs GitHub access like the previous bullet. Run `control-openhands browser click 'testid=plugins-add-plugin-button'`, `control-openhands browser fill 'testid=add-plugin-source-input' 'github:OpenHands/extensions'`, `control-openhands browser fill 'testid=add-plugin-ref-input' main`, `control-openhands browser fill 'testid=add-plugin-repo-path-input' 'plugins/city-weather'`, `control-openhands browser click 'testid=add-plugin-submit'` and `control-openhands browser wait 'testid=add-plugin-modal' --state hidden --timeout 120000` (`toasts --history`: `Plugin installed.`). `control-openhands browser text 'testid=plugin-source-city-weather'` is `github:OpenHands/extensions`; `control-openhands browser click 'testid=plugin-card-city-weather'` and `control-openhands browser snapshot 'testid=plugin-detail-modal'` show the header paragraph `github:OpenHands/extensions` and the text `v1.0.0 Ref <40-hex commit> Path plugins/city-weather Enabled` (the API's `resolved_ref`), and Files lists `.claude-plugin` and `.codex-plugin` that the catalog copy lacks. Clean up with `control-openhands browser click 'testid=plugin-detail-uninstall-city-weather'`; the card's source is the catalog path again.- **Local plugin (`F19.local-plugin`).** After arranging `qa-local-plugin` (Preconditions), run `control-openhands browser reload`, `control-openhands browser text 'testid=plugin-local-badge-qa-local-plugin'` (`Local`), and `control-openhands browser count` on `testid=plugin-install-qa-local-plugin`, `testid=plugin-toggle-qa-local-plugin` and `testid=plugin-source-qa-local-plugin` (all `0`). `control-openhands browser click 'testid=plugins-filter-local'` leaves one card; under `plugins-filter-available` `browser count 'testid=plugin-card-qa-local-plugin'` is `0`. Back on All, `control-openhands browser click 'testid=plugin-card-qa-local-plugin'` and `control-openhands browser snapshot 'testid=plugin-detail-modal'`: no source line, pills `Local v1.0.0`, the bundled skill and Files, and only a **Close** button in the footer (`browser screenshot --feature F19.local-plugin --name modal`). Close with Escape. Clean up: `rm -rf "$OH_VERIFY_RUN/private/home/.agents/plugins/qa-local-plugin"`, `control-openhands browser reload`; the card count for `qa-local-plugin` is `0`.@@ -91,7 +91,8 @@ Preconditions:- The card switch swaps its icon on hover. A plain `browser click` that moves the pointer onto it from elsewhere (for example right after clicking a filter segment) is often swallowed (#17941): no `PATCH /api/plugins/installed/<name>` shows in `browser network`. Run `browser hover` on the switch first, then click, and assert `aria-checked` and the API, not the click result.- Installed plugins lose their source and their enabled state, intermittently (OpenHands/software-agent-sdk#5496). The Agent Server rewrites `<run>/private/plugins/installed/.installed.json` with a plain truncate-and-write on every load (SDK `InstallationMetadata.save_to_dir`), so a concurrent `GET /api/plugins/installed` (page loads fire several) can read an empty file: it logs `Failed to load installed extension metadata … Invalid JSON: EOF while parsing` and `Discovered untracked extension`, then saves every plugin with `"source": "local"`, `"enabled": true` and a fresh `installed_at`. It hit catalog installs in most trials and a disabled plugin on 2 of 3 page revisits; GitHub installs kept their source in this run. Once it hits, the card shows `local`, **Update** fails with a 500, **Start Conversation** builds an unusable `/launch` link, and a disabled plugin silently auto-loads again. Prove the launch path from a card that is not installed, and re-read the API after every navigation.-- Plugin mutation errors show the same toast twice: the hook's `onError` and the global `MutationCache` handler both fire (#17954). Install errors that the server answers with 400 show the misleading `Disconnected (check URL or network)` text (#17954); read the real reason in the run's `private/stack.log`.+- A failed plugin install, update or uninstall shows one toast with the server's reason (enable uses the same handler; its failure is not driven here). A response with no reason in it, such as the ingress's 502 while the Agent Server is stopped, shows the generic `An error occurred`; read the cause in the run's `private/stack.log`.+- Installing a plugin whose name is already installed should point the user to **Update** or **Uninstall**, as Apps do (`F20.install-duplicate`). Known failure (reproduced 2026-10-06): with the catalog `magic-test` installed, **Add plugin** with `github:OpenHands/extensions` and Path `plugins/magic-test` answers 409 and toasts the server's `Plugin already installed. Use force=true to overwrite.`, which the form cannot do (`browser screenshot --feature F19.add-plugin-error --name duplicate-409`) (#18090).- **Uninstall** acts immediately, with no confirmation (MCP server delete and App uninstall confirm).- `/launch` with a `message` starts the agent as soon as **Start Conversation** is clicked. Prefer links without a message and send `alakazam` yourself; a `city-weather` launch with a message makes the agent call an external weather API (stop it with `testid=stop-button`).- Edited launch parameters cannot be observed after creation: the conversation's client metadata (`localStorage['openhands-agent-server-conversation-metadata']`) strips them and the Agent Server does not return a conversation's plugins. Proving delivery needs request-body capture (harness gap).diff --git a/.agents/skills/verify-openhands/references/feature-map/F20-canvas-apps.md b/.agents/skills/verify-openhands/references/feature-map/F20-canvas-apps.mdindex 285c3dd68d..05a71fcf6c 100644--- a/.agents/skills/verify-openhands/references/feature-map/F20-canvas-apps.md+++ b/.agents/skills/verify-openhands/references/feature-map/F20-canvas-apps.md@@ -17,7 +17,7 @@ Source: `src/routes/canvas-extensions.tsx`, `src/routes/canvas-extension-page.ts- `F20.install-error`: a failed install toasts the server's reason (`Could not read canvas extension source: …`) and keeps the form open with the input, for local paths and for unreachable Git sources alike.- `F20.git-tree-url`: a Git host folder URL (`…/<owner>/<repo>/tree/<ref>/<path>`) pasted into **App source** is split into source, ref and path; the card shows the repo URL as source, **Ref** (resolved commit) and **Path**.- `F20.git-ref-path`: the **Ref** and **Path** fields apply to a Git source, including the placeholder's `github:owner/repo` shorthand; the card keeps the source as typed and shows the resolved commit and the path. Enter in a field submits the form.-- `F20.install-duplicate`: installing an app whose name is already installed is refused (`409`): the form stays open with its input, the toast says the app is already installed, and the existing card is unchanged. Today the toast also tells the user to `Use force=true to overwrite.`, which the form cannot do (see Gotchas).+- `F20.install-duplicate`: installing an app whose name is already installed is refused (`409`): the form stays open with its input, the toast says the app is already installed and points to **Update** or **Uninstall** on its card, and the existing card is unchanged.- `F20.card`: each card shows the display name, source, a `role=switch` (**Enable**/**Disable**), the description, `Disabled`/`Enabled`, `v<version>` and `Pages: N` pills, each page title, and **Update** and **Uninstall** buttons.- `F20.enable-confirm`: switching a disabled app on (click or Space) opens a trust confirmation (`confirmation-modal`) with **Cancel** and **Enable trusted app**; Cancel, Escape and a backdrop click leave it disabled, confirming enables it (persists after reload).- `F20.rail-entry`: an enabled app's page appears in the main sidebar rail as `sidebar-canvas-extension-<name>-<pageId>` linking to `/extensions/<name>/<path>`.@@ -57,7 +57,7 @@ Preconditions:- **Command-menu entry (`F20.entry-points`).** From `/` run `control-openhands browser press Control+k`, `control-openhands browser type 'testid=command-menu >> role=combobox' Apps` and `control-openhands browser snapshot 'testid=command-menu'`: it reads `No commands found`. Then `control-openhands browser fill 'testid=command-menu >> role=combobox' Customize`, `control-openhands browser press Enter`, `control-openhands browser wait-url '/mcp(\?|$)'` and `control-openhands browser click 'testid=sidebar-extensions-/apps' --expect-url '/apps(\?|$)'`. `control-openhands browser goto /extensions` and `control-openhands browser snapshot 'testid=not-found-screen'` show the app's not-found page, like any unknown path: heading `Page not found`, `This address does not match any page. Check the URL, or go back to the home page.` and link `Home`.- **Add form and its closers (`F20.add-modal`).** On `/apps` (`control-openhands browser goto /apps`; the previous bullet ends on the `/extensions` not-found page) run `control-openhands browser click 'testid=canvas-extensions-add-button'` and `control-openhands browser snapshot 'testid=add-canvas-extension-modal'`: heading `Add app`, intro `Install from a Git source or a path on the active Agent Server. The app will be installed disabled.`, textboxes `App source`, `Ref Optional`, `Path Optional`, buttons `Close` and `Install [disabled]`. After `control-openhands browser fill 'testid=add-canvas-extension-source-input' ' '`, `control-openhands browser enabled 'testid=add-canvas-extension-submit'` is still `false`. Each of `control-openhands browser click 'testid=add-canvas-extension-dismiss'`, `control-openhands browser click 'testid=add-canvas-extension-modal-close'`, `control-openhands browser press Escape` and `control-openhands browser mouse-click 20 500` (backdrop) closes it: `control-openhands browser count 'testid=add-canvas-extension-modal'` is `0` (reopen with `canvas-extensions-add-button` between them).- **Install error, local path (`F20.install-error`).** Open the form, run `control-openhands browser fill 'testid=add-canvas-extension-source-input' /nonexistent/qa-app`, `control-openhands browser click 'testid=add-canvas-extension-submit'`, then `control-openhands browser toasts`: `Could not read canvas extension source: Local extension path does not exist: /nonexistent/qa-app`. `browser count 'testid=add-canvas-extension-modal'` stays `1` and the input keeps its value. `control-openhands browser errors --app-only` lists the expected `400` on `POST /api/canvas-extensions/install`.-- **Install error, Git source (`F20.install-error`).** In the same form run `control-openhands browser fill 'testid=add-canvas-extension-source-input' 'http://127.0.0.1:9/qa-owner/qa-missing'`, `control-openhands browser click 'testid=add-canvas-extension-submit'`, `control-openhands browser wait 'testid=add-canvas-extension-submit >> text=Install' --timeout 60000`, then `control-openhands browser toasts` and `control-openhands browser screenshot --feature F20.install-error --name git-misreported`. Expected: `Could not read canvas extension source: Failed to fetch extension from http://127.0.0.1:9/qa-owner/qa-missing` (the server's 400 detail). Today the toast reads `Disconnected (check URL or network). Check that the backend URL is correct …` (see Gotchas).+- **Install error, Git source (`F20.install-error`).** In the same form run `control-openhands browser toasts --clear`, `control-openhands browser fill 'testid=add-canvas-extension-source-input' 'http://127.0.0.1:9/qa-owner/qa-missing'`, `control-openhands browser click 'testid=add-canvas-extension-submit'`, `control-openhands browser wait 'testid=add-canvas-extension-submit >> text=Install' --timeout 60000`, then `control-openhands browser toasts --history` and `control-openhands browser screenshot --feature F20.install-error --name git-server-reason`. The history holds one toast with the server's 400 detail, `Could not read canvas extension source: Failed to fetch extension from http://127.0.0.1:9/qa-owner/qa-missing` (`browser toasts` may still list the local-path toast below it). The form stays open with the URL.- **Install the demo (`F20.install`).** In the open form run `control-openhands browser fill 'testid=add-canvas-extension-source-input' "$PWD/src/fixtures/canvas-extensions/demo-page"` and `control-openhands browser click 'testid=add-canvas-extension-submit' --observe 'testid=add-canvas-extension-submit'`: the observed states are `Install`, `Installing… [disabled]`, `<absent>`. `control-openhands browser toasts` shows `App installed. Review it here, then enable it when you are ready.` Then `control-openhands browser reload`, `control-openhands browser attr 'testid=canvas-extension-card-demo-page >> role=switch' aria-checked` (`false`) and `control-openhands browser count 'testid=sidebar-canvas-extension-demo-page-hello'` (`0`).- **Card (`F20.card`).** Run `control-openhands browser snapshot 'testid=canvas-extension-card-demo-page'`: heading `Demo page`, the source path, switch `Enable`, `A dependency-free fixture for the Canvas Extension page ABI.`, text `Disabled v0.1.0 Pages: 1`, list item `Hello from an extension`, buttons `Update` and `Uninstall`. `control-openhands browser screenshot --feature F20.card --name disabled`.- **Trust confirmation (`F20.enable-confirm`).** Run `control-openhands browser click 'testid=canvas-extension-card-demo-page >> role=switch'` and `control-openhands browser snapshot 'testid=confirmation-modal'`: the paragraph `This app runs trusted JavaScript inside Agent Canvas and can make authenticated requests to the active Agent Server. Review its source and revision before enabling it.`, buttons `Cancel` and `Enable trusted app`. `control-openhands browser click 'testid=confirmation-modal >> testid=cancel-button'` closes it and `aria-checked` stays `false`. Keyboard: `control-openhands browser focus 'testid=canvas-extension-card-demo-page >> role=switch'` and `control-openhands browser press Space` open it again (`browser count 'testid=confirmation-modal'` is `1`); `control-openhands browser press Escape` closes it and `api GET /api/canvas-extensions/installed` still says `"enabled": false`. Backdrop: click the switch again, `control-openhands browser mouse-click 20 500`, then `browser count 'testid=confirmation-modal'` is `0` and the API still says `"enabled": false`. Reopen with the click, then `control-openhands browser click 'testid=confirmation-modal >> testid=confirm-button'`, `control-openhands browser reload` and read `aria-checked`: `true`; `control-openhands browser text 'testid=canvas-extension-card-demo-page'` contains `Enabled`.@@ -68,12 +68,12 @@ Preconditions:- **Phone (`F20.phone`).** Run `control-openhands browser viewport phone`, `control-openhands browser goto /customize` (the URL stays `/customize`), `control-openhands browser click 'testid=extensions-mobile-hub >> testid=sidebar-extensions-/apps' --expect-url '/apps(\?|$)'`, `control-openhands browser bbox 'testid=canvas-extensions-screen'` (`insideViewport` `true`, `pageHorizontalOverflow` `false`) and `control-openhands browser screenshot --feature F20.phone --name apps`. Open the form with `canvas-extensions-add-button`; `control-openhands browser bbox 'testid=add-canvas-extension-modal'` is inside the viewport with no page overflow; close it with `add-canvas-extension-dismiss`. Then `control-openhands browser click 'testid=sidebar-mobile-menu-toggle'`, `control-openhands browser visible 'testid=sidebar-mobile-drawer >> testid=sidebar-canvas-extension-demo-page-hello'` (`true`), `control-openhands browser click 'testid=sidebar-mobile-drawer >> testid=sidebar-canvas-extension-demo-page-hello' --expect-url '/extensions/demo-page/hello(\?|$)'` and `control-openhands browser bbox 'role=main[name="Hello from an extension"]'` (inside, no overflow). Return with `control-openhands browser viewport desktop`.- **Update (`F20.refresh`).** Note `installed_at` from `control-openhands api GET /api/canvas-extensions/installed`, then on `/apps` (`control-openhands browser goto /apps`; Phone ends on the extension page) run `control-openhands browser click 'testid=canvas-extension-refresh-demo-page'` and `control-openhands browser toasts` (`App updated.`). The API shows a newer `installed_at` and keeps `"enabled": true`; `browser count 'testid=sidebar-canvas-extension-demo-page-hello'` stays `1`.- **Survives a restart (`F20.persist-restart`).** Run `control-openhands restart`, `control-openhands doctor`, `control-openhands browser goto /`, `control-openhands browser wait 'testid=sidebar-canvas-extension-demo-page-hello' --timeout 15000`, then `control-openhands browser goto /apps` and read the switch's `aria-checked`: `true`.-- **Update with the backend down (`F20.refresh`).** On `/apps` run `control-openhands service stop agent-server`, `control-openhands browser click 'testid=canvas-extension-refresh-demo-page'` and `control-openhands browser toasts`: `HTTP request failed (502 Bad Gateway): "Bad Gateway: connect ECONNREFUSED 127.0.0.1:<agent-server-port>"`, and the card still shows `Enabled`. Bring the stack back with `control-openhands restart` and `control-openhands doctor` before going on.+- **Update with the backend down (`F20.refresh`).** On `/apps` run `control-openhands service stop agent-server`, `control-openhands browser click 'testid=canvas-extension-refresh-demo-page'` and `control-openhands browser toasts`: one toast, `An error occurred` (the ingress answers the Update's `POST /api/canvas-extensions/install` with a `502` that carries no server reason; see Gotchas), and the card still shows `Enabled` (`browser screenshot --feature F20.refresh --name backend-down`). Bring the stack back with `control-openhands restart` and `control-openhands doctor` before going on.- **Disable (`F20.disable`).** On `/apps` run `control-openhands browser click 'testid=canvas-extension-card-demo-page >> role=switch'`; `control-openhands browser count 'testid=confirmation-modal'` is `0` and `control-openhands browser wait 'testid=sidebar-canvas-extension-demo-page-hello' --state detached --timeout 10000` succeeds. After `control-openhands browser reload` the switch's `aria-checked` is `false`; `control-openhands browser goto /extensions/demo-page/hello` and `browser snapshot 'role=main'` show `Not available`.- **Uninstall (`F20.uninstall`).** Re-enable the demo on `/apps` (`control-openhands browser goto /apps`, since Disable ends on the extension page; the switch, then `testid=confirmation-modal >> testid=confirm-button`, then `browser wait 'testid=sidebar-canvas-extension-demo-page-hello'`). Run `control-openhands browser click 'testid=canvas-extension-uninstall-demo-page'` and `control-openhands browser snapshot 'testid=confirmation-modal'`: `Uninstall Demo page from this backend?`, buttons `Cancel` and `Confirm`. `control-openhands browser press Escape` leaves `browser count 'testid=canvas-extension-card-demo-page'` at `1`; so does clicking Uninstall again and `control-openhands browser click 'testid=confirmation-modal >> testid=cancel-button'`. Click Uninstall again, `control-openhands browser click 'testid=confirmation-modal >> testid=confirm-button'` and `control-openhands browser toasts` (`App uninstalled.`); `control-openhands browser wait 'testid=sidebar-canvas-extension-demo-page-hello' --state detached --timeout 10000` succeeds. After `control-openhands browser reload` the card count is `0`, the page shows `No apps are installed on this backend.`, and `/extensions/demo-page/hello` shows `Not available`.- **Local source plus Path (`F20.install`).** Run `control-openhands browser goto /apps` (the Uninstall check ends on `/extensions/demo-page/hello`), `control-openhands browser click 'testid=canvas-extensions-add-button'`, `control-openhands browser fill 'testid=add-canvas-extension-source-input' "$PWD/src/fixtures/canvas-extensions"`, `control-openhands browser fill 'testid=add-canvas-extension-repo-path-input' demo-page`, `control-openhands browser click 'testid=add-canvas-extension-submit'` and `control-openhands browser wait 'testid=add-canvas-extension-modal' --state detached --timeout 30000`. The toast is `App installed. …` and `api GET /api/canvas-extensions/installed` shows `"source"` ending in `/src/fixtures/canvas-extensions/demo-page` with `"repo_path": null`. Uninstall it as above (switch untouched, so no rail check).- **Git tree URL (`F20.git-tree-url`).** Needs the Git precondition (upstream reachable, fixture identical). Run `control-openhands browser click 'testid=canvas-extensions-add-button'`, `control-openhands browser fill 'testid=add-canvas-extension-source-input' 'https://github.com/OpenHands/OpenHands/tree/main/src/fixtures/canvas-extensions/demo-page'` (Ref and Path empty), `control-openhands browser click 'testid=add-canvas-extension-submit' --observe 'testid=add-canvas-extension-submit'` (`Installing… [disabled]` for about 0.4 to 2 s, then `<absent>`) and `control-openhands browser wait 'testid=add-canvas-extension-modal' --state detached --timeout 90000`; the toast is `App installed. …`. After `control-openhands browser reload`, `control-openhands browser snapshot 'testid=canvas-extension-card-demo-page'` shows source `https://github.com/OpenHands/OpenHands`, switch `Enable`, term `Ref` with the 40-character commit from the precondition and term `Path` with `src/fixtures/canvas-extensions/demo-page`; `api GET /api/canvas-extensions/installed` has the same `source`, `resolved_ref` and `repo_path`. `control-openhands browser screenshot --feature F20.git-tree-url --name card`.-- **Duplicate install (`F20.install-duplicate`).** With the Git-installed demo present, run `control-openhands browser errors --clear`, `control-openhands browser click 'testid=canvas-extensions-add-button'`, `control-openhands browser fill 'testid=add-canvas-extension-source-input' "$PWD/src/fixtures/canvas-extensions/demo-page"`, `control-openhands browser click 'testid=add-canvas-extension-submit'` and `control-openhands browser wait 'testid=add-canvas-extension-submit >> text=Install' --timeout 30000`. `control-openhands browser toasts` reads `Canvas extension already installed. Use force=true to overwrite.` (expected: no `force=true` hint, see Gotchas), `browser count 'testid=add-canvas-extension-modal'` stays `1`, `browser count '[data-testid^="canvas-extension-card-"]'` stays `1`, `api GET /api/canvas-extensions/installed` still shows the GitHub `source`, and `browser errors --app-only` lists the expected `409` on `POST /api/canvas-extensions/install`. Close the form with `control-openhands browser press Escape`.+- **Duplicate install (`F20.install-duplicate`).** With the Git-installed demo present, run `control-openhands browser errors --clear`, `control-openhands browser click 'testid=canvas-extensions-add-button'`, `control-openhands browser fill 'testid=add-canvas-extension-source-input' "$PWD/src/fixtures/canvas-extensions/demo-page"`, `control-openhands browser click 'testid=add-canvas-extension-submit'` and `control-openhands browser wait 'testid=add-canvas-extension-submit >> text=Install' --timeout 30000`. `control-openhands browser toasts` reads `This app is already installed. Use Update or Uninstall on its card.` (`browser screenshot --feature F20.install-duplicate --name already-installed`), `browser count 'testid=add-canvas-extension-modal'` stays `1`, `browser count '[data-testid^="canvas-extension-card-"]'` stays `1`, `api GET /api/canvas-extensions/installed` still shows the GitHub `source`, and `browser errors --app-only` lists the expected `409` on `POST /api/canvas-extensions/install`. Close the form with `control-openhands browser press Escape`.- **Busy lock (`F20.busy-lock`).** Needs the Git-installed demo from the Git tree URL bullet: its Update re-clones in about 0.4 to 2 s, so issue the next commands in the same shell line as the click. Disabled app: run `control-openhands browser click 'testid=canvas-extension-refresh-demo-page'`, then at once `control-openhands browser press Space --selector 'testid=canvas-extension-card-demo-page >> role=switch'` (focuses the switch, then presses Space) and `control-openhands browser eval "[document.querySelector('[data-testid=canvas-extension-uninstall-demo-page]').disabled, document.querySelector('[data-testid=canvas-extension-card-demo-page] [role=switch]').disabled, document.activeElement.tagName].join(' ')"`, which reads `true true BODY` (Uninstall and the switch are both disabled, and the busy switch takes no focus), then `control-openhands browser count 'testid=confirmation-modal'` (`0`: Space did nothing). Read the three values in that one `eval`: each `browser enabled` call takes about 150 ms and can land after a short Update. If the `eval` reads `false` for either control, the Update ended mid-line and Space may have reached an idle switch: close any trust dialog with `control-openhands browser click 'testid=confirmation-modal >> testid=cancel-button'` and run the line again. Once `control-openhands browser toasts --history` shows `App updated.`, the keyboard works again: `browser enabled` on the switch is `true`, and `browser focus` on it, `browser press Space` and `browser count 'testid=confirmation-modal'` give `1`. Close the dialog with `testid=confirmation-modal >> testid=cancel-button`; `api GET /api/canvas-extensions/installed --pick canvas_extensions.0.enabled` is still `false`. Enabled app (only when the card's Ref equals the precondition's commit): enable it through the trust dialog and wait for `sidebar-canvas-extension-demo-page-hello`, then repeat the same line (click Update, Space on the switch, the `eval` reads `true true BODY`, no dialog). If the `eval` reads `false` for either control there and Space reached the idle switch, it turned the app off with no dialog (`api GET /api/canvas-extensions/installed --pick canvas_extensions.0.enabled` is `false`): enable it again through the trust dialog, wait for `sidebar-canvas-extension-demo-page-hello` and repeat the line. A few seconds later `api GET /api/canvas-extensions/installed --pick canvas_extensions.0.enabled` is still `true`, and after `browser reload` the switch's `aria-checked` is `true` and `browser count 'testid=sidebar-canvas-extension-demo-page-hello'` is `1`. Clean up: uninstall as above and confirm `api GET /api/canvas-extensions/installed --pick canvas_extensions` is `[]`.- **Ref and Path with the `github:` shorthand (`F20.git-ref-path`).** Needs the Git precondition. Run `control-openhands browser click 'testid=canvas-extensions-add-button'`, `control-openhands browser fill 'testid=add-canvas-extension-source-input' 'github:OpenHands/OpenHands'`, `control-openhands browser fill 'testid=add-canvas-extension-ref-input' main`, `control-openhands browser fill 'testid=add-canvas-extension-repo-path-input' src/fixtures/canvas-extensions/demo-page`, `control-openhands browser focus 'testid=add-canvas-extension-repo-path-input'`, `control-openhands browser press Enter` (Enter submits) and `control-openhands browser wait 'testid=add-canvas-extension-modal' --state detached --timeout 90000`; the toast is `App installed. …`. After `control-openhands browser reload`, `browser snapshot 'testid=canvas-extension-card-demo-page'` shows source `github:OpenHands/OpenHands`, `Ref` with the precondition's commit and `Path` `src/fixtures/canvas-extensions/demo-page`. Uninstall it as above.- **List error with Retry (`F20.load-error`).** Blocked: it needs an Agent Server whose `GET /api/canvas-extensions/installed` fails with a non-404 while its health checks pass. `control-openhands service stop agent-server` then `control-openhands browser goto /apps` shows the app-wide **Manage backends** gate (`Disconnected`) instead of the page, and on an already loaded page the cached list stays on screen.@@ -84,11 +84,11 @@ Preconditions:- The card's refresh button (`canvas-extension-refresh-<name>`) is labelled **Update**, not "Refresh".- The trust confirmation has no title and reuses the shared `confirmation-modal`; its body repeats the amber notice. Keyboard focus is not moved into it: after Space on the switch, Tab lands on the card's **Update** button behind the dialog.- `nav_label` is dropped by the Agent Server: `GET /api/canvas-extensions/installed` returns pages with only `id`, `title` and `path` (Agent Server 1.50.1), so the rail shows the page title (OpenHands/software-agent-sdk#5501). Keep `F20.rail-label` failing until the backend returns it.-- Install and update errors go through the shared error toast, which rewrites any message containing "failed to fetch" into the generic `Disconnected (check URL or network)…` text (#17954). Every unreachable Git source hits this because the server's detail says `Failed to fetch extension from <url>`; the local-path error is shown verbatim.+- Install and update errors show the server's reason as sent, even when it says `Failed to fetch extension from <url>` (an unreachable Git source). A response with no reason in it, such as the ingress's `502` while the Agent Server is stopped, shows the generic `An error occurred`. Only a request that gets no response at all shows `Disconnected (check URL or network)…`; no `control-openhands` verb takes the ingress offline, so that state is not driven here.- The page states (empty, error, unsupported) and the `/extensions/...` unavailable card have no test ids; assert on text with `browser snapshot`.- The Agent Server fetches Git sources with a shallow clone and appends `.git` to the repo URL: a test Git server must speak smart HTTP and answer both `qa-repo` and `qa-repo.git`.- The Git bullets read the public upstream repo, so they depend on its `main` still holding the identical fixture; the precondition's `diff -r` guards that. A Git install or Update clones in about 0.4 to 2 s here (Updates measured about 0.4 to 1.5 s on 2026-10-06), long enough for the busy-lock checks when they run in the same shell line as the click and read both controls in one `eval`; on a slower network raise the `wait` timeouts, not the expectations.-- A duplicate install surfaces the Agent Server's API hint verbatim (`Canvas extension already installed. Use force=true to overwrite.`); the form has no force option, so the user's only path is **Update** or **Uninstall** on the existing card. Keep `F20.install-duplicate` failing on the `force=true` wording until the UI rewrites it.+- A duplicate install answers `409` with the Agent Server's API hint (`Canvas extension already installed. Use force=true to overwrite.`); the form has no force option, so the toast replaces it with the Update/Uninstall advice. Plugins still show their 409 hint verbatim (F19 Gotchas).- Busy states with a local-path source last about 50 ms: `--observe` catches `Installing…`, but checking that controls are disabled during Update needs a Git source (an upstream Update lasts about 0.4 to 2 s).- `control-openhands launch` passes the launcher only a fixed list of environment variables (path, locale, proxy) plus its own flags: `OH_AGENT_SERVER_VERSION=<old>` in the environment is ignored (the run still gets the pinned server); use `--sdk-ref v<version>`. Any server older than 1.47.0 is gated by Canvas before `/apps` renders.- Stopping the Agent Server makes the next full page load show the **Manage backends** gate; always `restart` and `doctor` afterwards.diff --git a/.agents/skills/verify-openhands/references/feature-map/F23-automation-detail.md b/.agents/skills/verify-openhands/references/feature-map/F23-automation-detail.mdindex 360fa9e9bf..25b74d8080 100644--- a/.agents/skills/verify-openhands/references/feature-map/F23-automation-detail.md+++ b/.agents/skills/verify-openhands/references/feature-map/F23-automation-detail.md@@ -4,13 +4,14 @@ The detail page (`/automations/<id>`) shows one automation: a **Back toAutomations** link, a header with the name, an **Active**/**Inactive** badge,**Run now**, an on/off switch and a kebab (Export, Tarball, Edit, Turn on/off,Delete); a **Why this is paused** banner when it was turned off; the Prompt (or,-for a script automation, the Script bundle); Configuration (trigger, schedule or-event source/type/filter, LLM profile); an Activity card (Created, Last run);+for a script automation, the Script bundle); Configuration (repositories,+trigger, schedule or event source/type/filter, LLM profile); a **Plugins** card+when it has plugins; an Activity card (Created, Last run);and the **Activity Log** of runs with status, summary, cost, a logs dialog, alink to each run's conversation and JSON/CSV export. The **Edit automation**dialog changes name, prompt, agent and LLM profile, timeout and the schedule.-Source: `src/routes/automation-detail.tsx`, `src/components/features/automations/detail/`, `src/components/features/automations/delete-confirmation-modal.tsx`, `src/hooks/query/use-automation-detail.ts`, `src/hooks/query/use-bash-command-logs.ts`, `src/hooks/query/use-automation-tarball-files.ts`, `src/utils/automation-schedule.ts`, `src/utils/automation-timeout.ts`, `src/utils/automation-disabled-reason.ts`, `src/utils/automation-activity-log-export.ts`.+Source: `src/routes/automation-detail.tsx`, `src/components/features/automations/detail/`, `src/components/features/automations/delete-confirmation-modal.tsx`, `src/hooks/query/use-automation-detail.ts`, `src/utils/automation-preset-sources.ts`, `src/hooks/query/use-bash-command-logs.ts`, `src/hooks/query/use-automation-tarball-files.ts`, `src/utils/automation-schedule.ts`, `src/utils/automation-timeout.ts`, `src/utils/automation-disabled-reason.ts`, `src/utils/automation-activity-log-export.ts`.## Sub-features@@ -38,9 +39,9 @@ Source: `src/routes/automation-detail.tsx`, `src/components/features/automations- `F23.prompt-collapse`: a prompt taller than about 10 lines is clipped to 240 px with a fade (`automation-prompt-fade`) and **View More**; **View Less** collapses it again.- `F23.configuration`: a cron automation shows Trigger **Schedule**, the Schedule and **LLM profile** (`Active profile` or the profile name).- `F23.configuration-event`: an event automation shows Trigger **Event**, **Event Source**, **Event Type** and **Filter**, truncated at 60 characters with **Show more**/**Show less**.-- `F23.plugins-repo`: an automation created with repositories and plugins shows **Repositories** (with a branch badge) and a **Plugins** card with one chip per plugin.+- `F23.plugins-repo`: an automation created with repositories and plugins shows **Repositories** (one `owner/repo` row each, with a branch badge for its ref) and a **Plugins** card with one chip per plugin.- `F23.script-section`: a script (tarball) automation shows **Script** with the entrypoint and the bundle's files in place of the Prompt.-- `F23.export`: kebab **Export** downloads `<name-slug>.automation.json` (`version`, `kind: "automation"`, `spec`).+- `F23.export`: kebab **Export** downloads `<name-slug>.automation.json` (`version`, `kind: "automation"`, `spec`); an automation's first repository and its plugins go into `spec` as `repository`, `branch` and `plugins`.- `F23.tarball`: kebab **Tarball** downloads the automation's code bundle.- `F23.delete`: kebab **Delete** asks `Delete "<name>"? This cannot be undone.`; Cancel keeps it, Delete removes it and returns to `/automations`.- `F23.edit-open`: kebab **Edit** opens **Edit automation** prefilled with Name, Prompt ("Edits apply to future runs only."), Agent profile, LLM profile, Timeout (seconds) with its hint, and the schedule.@@ -96,10 +97,10 @@ Preconditions:- **Custom cron (`F23.edit-cron`).** Open QA_F23 Fail and Edit. `control-openhands browser value 'testid=edit-automation-frequency'` is `Custom` and `control-openhands browser enabled 'testid=edit-automation-frequency'` and `... 'testid=edit-automation-time'` are `false`; `testid=edit-automation-cron` holds `0 0 1 1 *` (placeholder `*/10 * * * *`). Fill the cron with `not a cron`, click Save, and `control-openhands browser text 'testid=edit-automation-cron >> xpath=ancestor::label[1]'` adds `Enter a valid cron expression`; with `0 0 31 2 *` it reads `This cron expression will never run`. Fill `0 0 2 1 *` and `testid=edit-automation-timeout` with `1` (this makes the next run fail), Save, `browser wait-text 'Automation updated'`; after a reload the Configuration shows `0 0 2 1 *`.- **Failed run, its row and Debug with OpenHands (`F23.run-status-polling`, `F23.run-no-conversation`, `F23.run-logs-modal`, `F23.debug-with-openhands`).** On QA_F23 Fail (timeout `1` from the previous bullet) click `role=button[name="Run now"]` and `control-openhands browser wait-text 'Automation dispatched'`. The run stays Running for about 3-4 minutes and ends `FAILED` (poll `control-openhands api GET /api/automation/v1/<id>/runs`; drive the event automation bullets meanwhile). Then `control-openhands browser goto /automations`, open QA_F23 Fail, `control-openhands browser wait 'testid=automation-activity-log >> testid=run-status-icon-failed'` and `control-openhands browser text 'testid=automation-activity-log'`: the newest row reads `<time>`, `Timed out: command timed out or was killed`, `Failed`. Expected beside the time: `No Conversation` (this is a prompt automation); today it reads `No conversation — this run executed a script. Use View logs for its output.` Run `control-openhands browser click 'testid=automation-activity-log >> title=View logs >> nth=0'` and `control-openhands browser snapshot 'role=dialog'`: `Run` `FAILED`, `Task` `No task outcome reported.`, `System` `Error: Timed out: command timed out or was killed` and `Status detail: ...`, the Output tab with the `[setup] Fetching SDK version ...` lines, and button `Debug with OpenHands`. Screenshot with `--feature F23.debug-with-openhands --name failed-logs`. `control-openhands browser click 'testid=debug-automation-button' --expect-url '/conversations/'` opens a new conversation; `control-openhands conversation events <conversation id from browser url> --kinds MessageEvent` starts `The scheduled automation "QA_F23 Fail" failed during a run. Please investigate the error and fix the root cause.`, and `control-openhands browser eval "document.body.innerText.includes('Timed out: command timed out or was killed')"` is `true` (the page also shows the run id). The agent then works on that prompt with the active profile.- **Task outcome badge (`F23.run-task-outcome`).** Arrange (API, arrange only) `control-openhands api POST /api/automation/v1/preset/prompt --write --data '{"name":"QA_F23 Blocked","prompt":"Do not run any tools. Call the finish tool right away with status \"blocked\" and outcome_summary \"QA blocked on purpose\".","trigger":{"type":"cron","schedule":"0 0 1 1 *","timezone":"UTC"},"enabled":true}'` (a good thing to do while the Fail run is still running). Open QA_F23 Blocked, click `role=button[name="Run now"]`, and poll `control-openhands browser text 'testid=automation-activity-log'` until it leaves Running (about 35 s): `<time>`, `QA blocked on purpose`, a cost such as `$0.0016`, `Blocked`; `control-openhands browser testids 'testid=automation-activity-log'` lists `run-status-icon-warning` (not `-completed`) although `api GET /api/automation/v1/<id>/runs` has `status` `COMPLETED` and `run_metadata.finish_tool_response.status` `blocked`. `control-openhands browser click 'testid=automation-activity-log >> title=View logs'` and `browser snapshot 'role=dialog'`: `Run` `COMPLETED`, `Task` `Blocked` / `QA blocked on purpose` / `Task metadata` `{ "message": ... }`. Screenshot with `--feature F23.run-task-outcome --name blocked`, Escape. `partial_success` (**Partial**) and an unknown status (**Needs review**, `run-status-icon-needs-review`) follow the same path; only `blocked` was driven.-- **Event automation (`F23.prompt-collapse`, `F23.configuration-event`, `F23.plugins-repo`).** Open QA_F23 Event. `control-openhands browser bbox 'testid=automation-prompt-content'` is 240 px high, `testid=automation-prompt-fade` is present and `control-openhands browser text 'testid=automation-prompt-toggle'` is `View More`; screenshot with `--feature F23.prompt-collapse --name collapsed`. Click the toggle: height 360, no fade, text `View Less`; click again to collapse. `control-openhands browser text 'role=heading[name="Configuration"] >> xpath=ancestor::div[2]'` reads `Trigger Event`, `Event Source github`, `Event Type pull_request.opened`, `Filter pull_request.draft == `false` && pull_request.base.ref == re…`, `Show more`, `LLM profile Active profile`. `control-openhands browser click 'role=button[name="Show more"]'` shows the full filter and `control-openhands browser attr 'role=button[name="Show less"]' aria-expanded` is `true`. Expected: **Repositories** `https://github.com/qa-example/qa-repo` with a `main` badge and a **Plugins** card with `github:qa-example/qa-plugin`. Today `control-openhands browser count 'role=heading[name="Plugins"]'` is `0` and no Repositories field renders (see Gotchas); screenshot with `--feature F23.plugins-repo --name event-no-plugins`.+- **Event automation (`F23.prompt-collapse`, `F23.configuration-event`, `F23.plugins-repo`, `F23.export`).** Open QA_F23 Event. `control-openhands browser bbox 'testid=automation-prompt-content'` is 240 px high, `testid=automation-prompt-fade` is present and `control-openhands browser text 'testid=automation-prompt-toggle'` is `View More`; screenshot with `--feature F23.prompt-collapse --name collapsed`. Click the toggle: height 360, no fade, text `View Less`; click again to collapse. `control-openhands browser text 'role=heading[name="Configuration"] >> xpath=ancestor::div[2]'` reads `Repositories qa-example/qa-repo main`, `Trigger Event`, `Event Source github`, `Event Type pull_request.opened`, `Filter pull_request.draft == `false` && pull_request.base.ref == re…`, `Show more`, `LLM profile Active profile`. `control-openhands browser click 'role=button[name="Show more"]'` shows the full filter and `control-openhands browser attr 'role=button[name="Show less"]' aria-expanded` is `true`. `control-openhands browser text 'testid=automation-repository'` is `qa-example/qa-repo` / `main` (the fixture's `https://github.com/qa-example/qa-repo` as `owner/repo`, with its branch badge) and `control-openhands browser text 'role=heading[name="Plugins"] >> xpath=ancestor::div[2]'` is `Plugins` / `github:qa-example/qa-plugin`; screenshot with `--feature F23.plugins-repo --name event-repo-plugins`. Export keeps them: `control-openhands browser click 'role=button[name="Automation actions"]'`, `control-openhands browser click 'role=list >> has-text=Tarball >> role=button[name="Export"]'` and `control-openhands browser downloads --last 1 --contains '"branch": "main"'` (`qa-f23-event.automation.json`, `contains` `true`); `--contains '"repository": "https://github.com/qa-example/qa-repo"'` and `--contains 'github:qa-example/qa-plugin'` are `true` too (the `--inspect` head ends inside the long prompt).- **Event trigger in Edit (`F23.edit-event-readonly`).** On QA_F23 Event open Edit: `control-openhands browser count 'testid=edit-automation-frequency'` is `0` and `control-openhands browser text 'role=form[name="Edit automation"] >> text=Event Source >> xpath=ancestor::div[2]'` reads `Trigger Event / Event Source github / Event Type pull_request.opened / Filter <full filter>`. Screenshot with `--feature F23.edit-event-readonly --name event`, then Cancel.- **Phone (`F23.phone`).** Run `control-openhands browser viewport phone`, open QA_F23 Pong, `control-openhands browser bbox 'role=heading[name="QA_F23 Pong"] >> xpath=ancestor::div[3]'` (`insideViewport` `true`, `pageHorizontalOverflow` `false`) and `control-openhands browser screenshot --feature F23.phone --name detail` (the name and Run now wrap). Open Edit, then `control-openhands browser bbox 'role=form[name="Edit automation"] >> xpath=..'` and `control-openhands browser bbox 'testid=edit-automation-save'`. Expected: both `insideViewport` `true`. Today the dialog is about 940 px high with `y` about `-48`, Save sits at `y` 831 (`insideViewport` `false`), the X at a negative `y` (about -30), and `control-openhands browser scroll 'testid=edit-automation-save'` cannot move it; screenshot with `--feature F23.phone --name edit-weekly`. Cancel and `control-openhands browser viewport desktop`.-- **Run now and save errors (`F23.run-now-error`, `F23.edit-save-error`).** Arrange a stale page: open QA_F23 Fail, then `control-openhands api DELETE /api/automation/v1/<Fail id> --write`. Run `control-openhands browser toasts --history --clear` (empties the toast history), click `role=button[name="Run now"]`, then `control-openhands browser toasts --history` and `control-openhands browser screenshot --feature F23.run-now-error --name toasts`: exactly one toast, `Automation not found`, and no `Request failed with status code 404`. Expected: the page then shows **Automation not found**: `control-openhands browser wait 'role=heading[name="QA_F23 Fail"]' --state detached --timeout 15000` succeeds (the not-found state takes about 7 s, as in States) and `control-openhands browser snapshot 'role=paragraph >> text=Automation not found >> xpath=..'` lists link `Back to Automations` (do not use `wait-text 'Automation not found'` here: the toast has the same text). Known failure: the wait times out and the page keeps heading `QA_F23 Fail`, `Active` and an enabled **Run now** (`control-openhands browser enabled 'role=button[name="Run now"]'` is `true`) until a reload (#18062). The save error does not reuse that page (it is gone once #18062 is fixed): arrange a second fixture, `control-openhands api POST /api/automation/v1/preset/prompt --write --data '{"name":"QA_F23 Stale","prompt":"Reply with the single word: pong.","trigger":{"type":"cron","schedule":"0 0 1 1 *","timezone":"UTC"},"enabled":false}'` (`body.id` is `<stale-id>`), then open QA_F23 Stale (`control-openhands browser goto /automations` and the card heading, as in Preconditions), `control-openhands browser click 'role=button[name="Automation actions"]'` and `control-openhands browser click 'role=list >> has-text=Tarball >> role=button[name="Edit"]'`. With the dialog open, `control-openhands api DELETE /api/automation/v1/<stale-id> --write` and `control-openhands browser toasts --history --clear`. Fill `testid=edit-automation-name` with `QA_F23 Stale renamed` and click `testid=edit-automation-save`: the dialog stays open (`browser count 'testid=edit-automation-save'` `1`, `browser value 'testid=edit-automation-name'` still `QA_F23 Stale renamed`), and `control-openhands browser toasts --history` holds exactly one toast, `Automation not found`; screenshot with `--feature F23.edit-save-error --name toast`. Close it with `control-openhands browser click 'testid=edit-automation-cancel'`. `browser errors --app-only` lists the induced `POST /api/automation/v1/<Fail id>/dispatch` and `PATCH /api/automation/v1/<stale-id>` 404s; both fixtures are already deleted.+- **Run now and save errors (`F23.run-now-error`, `F23.edit-save-error`).** Arrange a stale page: open QA_F23 Fail, then `control-openhands api DELETE /api/automation/v1/<Fail id> --write`. Run `control-openhands browser toasts --history --clear` (empties the toast history), click `role=button[name="Run now"]`, then `control-openhands browser toasts --history` and `control-openhands browser screenshot --feature F23.run-now-error --name toasts`: exactly one toast, `Automation not found`, and no `Request failed with status code 404`. Expected: the page then shows **Automation not found**: `control-openhands browser wait 'role=heading[name="QA_F23 Fail"]' --state detached --timeout 15000` succeeds (the not-found state takes about 7 s, as in States) and `control-openhands browser snapshot 'role=paragraph >> text=Automation not found >> xpath=..'` lists link `Back to Automations` (do not use `wait-text 'Automation not found'` here: the toast has the same text). Once the heading is gone, run `control-openhands browser toasts --history` again: it still holds only `Automation not found` (a late second toast, `Request failed with status code 404`, would come from the page's own refetch of the deleted automation). Known failure: the wait times out and the page keeps heading `QA_F23 Fail`, `Active` and an enabled **Run now** (`control-openhands browser enabled 'role=button[name="Run now"]'` is `true`) until a reload (#18062). The save error does not reuse that page (it is gone once #18062 is fixed): arrange a second fixture, `control-openhands api POST /api/automation/v1/preset/prompt --write --data '{"name":"QA_F23 Stale","prompt":"Reply with the single word: pong.","trigger":{"type":"cron","schedule":"0 0 1 1 *","timezone":"UTC"},"enabled":false}'` (`body.id` is `<stale-id>`), then open QA_F23 Stale (`control-openhands browser goto /automations` and the card heading, as in Preconditions), `control-openhands browser click 'role=button[name="Automation actions"]'` and `control-openhands browser click 'role=list >> has-text=Tarball >> role=button[name="Edit"]'`. With the dialog open, `control-openhands api DELETE /api/automation/v1/<stale-id> --write` and `control-openhands browser toasts --history --clear`. Fill `testid=edit-automation-name` with `QA_F23 Stale renamed` and click `testid=edit-automation-save`: the dialog stays open (`browser count 'testid=edit-automation-save'` `1`, `browser value 'testid=edit-automation-name'` still `QA_F23 Stale renamed`), and `control-openhands browser toasts --history` holds exactly one toast, `Automation not found`; screenshot with `--feature F23.edit-save-error --name toast`. Close it with `control-openhands browser click 'testid=edit-automation-cancel'`. `browser errors --app-only` lists the induced `POST /api/automation/v1/<Fail id>/dispatch` and `PATCH /api/automation/v1/<stale-id>` 404s; both fixtures are already deleted.- **Load more runs (`F23.activity-log-more`).** Not run: it needs more than 20 runs of one automation (about 35 s and one model call each). With them, `control-openhands browser click 'testid=automation-activity-log >> role=button[name="Load more"]'` grows the list from 20 to 40 rows.- **Script automation (`F23.script-section`).** Arrange a script automation through F22's bundle entry (UI arrange; F22 owns the creation proof): `control-openhands browser goto /automations/templates`, `control-openhands browser click 'testid=recommended-automation-card-news-digest' --expect-url '/automations/new/news-digest'`, `control-openhands browser fill 'testid=setup-field-schedule' '0 0 1 1 *'`, `control-openhands browser click 'testid=setup-continue-button'`, `control-openhands browser wait 'testid=setup-review' --timeout 10000`, `control-openhands browser click 'testid=setup-continue-button' --expect-url '/automations/[0-9a-f-]{8,}' --timeout 60000`. The detail page of **Daily news digest** shows `role=heading[name="Script"]` and no Prompt (`browser count 'role=heading[name="Prompt"]'` is `0`); `control-openhands browser text 'testid=automation-script-entrypoint'` is `python3 main.py`, and `browser eval "Array.from(document.querySelectorAll('[data-testid=automation-script-file]')).map(e=>e.innerText.split('\n').slice(0,2).join(' | '))"` lists `main.py | Entrypoint` first, then `config.json` (both with line-numbered source). Screenshot with `--feature F23.script-section --name news-digest`. `automation-script-unavailable` (bundle unreadable) was not reached. Do not Run now: the script fetches public feeds and starts a model-backed conversation. Delete it in the Delete bullet.- **Delete (`F23.delete`).** Open QA_F23 Event, click the kebab and `role=list >> has-text=Tarball >> role=button[name="Delete"]`. `control-openhands browser snapshot 'role=dialog[name="Delete automation"]'` shows `Delete "QA_F23 Event"? This cannot be undone.`, `Cancel` and `Delete` (the same dialog as F21.delete). `control-openhands browser click 'role=dialog[name="Delete automation"] >> role=button[name="Cancel"]'` keeps the page (`control-openhands browser count 'role=dialog[name="Delete automation"]'` is `0`). Reopen and `control-openhands browser click 'role=dialog[name="Delete automation"] >> role=button[name="Delete"]' --expect-url '/automations(\?|$)'`; `control-openhands api GET /api/automation/v1` no longer lists it. Delete QA_F23 Pong, QA_F23 Blocked and Daily news digest the same way (and QA_F23 Fail if the error bullet was skipped); `api GET /api/automation/v1` shows `"total": 0`.@@ -115,7 +116,7 @@ Preconditions:- Known defect: clearing **Time of day** on a preset schedule is silently ignored (#17948); Save closes the dialog with no request and no message.- On a local backend the Logs dialog reads every run's output from the server-level `/api/bash/bash_events/search`, with or without a conversation. It caches what it fetched: reload before checking its requests with `browser network`.- Known defect: prompt runs also have a `bash_command_id`, so every row shows the logs icon, and a prompt run that ended without a conversation is labelled as a script run (`F23.run-no-conversation`) (#17948).-- Known defect: the Repositories, Plugins and Notification fields read top-level `repository`, `branch`, `plugins` and `notification`, which this automation service (1.17.0) does not return: it keeps repos and plugins under `preset_metadata`. They never render on a local stack (#17952).+- The automation service (1.19.0 here) keeps repos and plugins only under `preset_metadata`; the UI reads them from there. Repositories show `owner/repo` without the host (a GitLab URL reads like a GitHub one), a repo without a ref gets no badge, and Export keeps only the first repository (all plugins). The **Notification** field reads a top-level `notification` that the service has no field for, so it never renders on a local stack (#16644 tracks removing or mapping it).- The Schedule field shows the raw cron (`0 9 * * *`) and no timezone: the service returns no `schedule_human` and no top-level `timezone`, so the Edit dialog also omits its `Timezone:` hint.- `run-phase` never appeared in the log here (`phase_code` stays `null` on the local service), so the phase chip is not reachable on this stack.- An LLM profile that does not exist (`model: "qa-no-such-profile"`) does not fail the run: it ran and succeeded with the active profile. Use timeout `1` to get a failed run; it takes several minutes to fail.diff --git a/.agents/skills/verify-openhands/references/feature-map/F24-git-sync.md b/.agents/skills/verify-openhands/references/feature-map/F24-git-sync.mdindex 5a2958ebe1..d562c9e930 100644--- a/.agents/skills/verify-openhands/references/feature-map/F24-git-sync.md+++ b/.agents/skills/verify-openhands/references/feature-map/F24-git-sync.md@@ -28,7 +28,7 @@ Source: `src/routes/automation-git-sync.tsx`, `src/components/features/automatio- `F24.pause`: turning **Enable Git Sync** off and saving (no reachability check) shows `Disabled`, disables **Sync now** and keeps the configuration; turning it back on restores `Enabled`.- `F24.sync-disabled-error`: **Sync now** on a page that still shows `Enabled` after sync was turned off elsewhere shows the toast `Enable Git Sync before triggering a sync.`; the pill catches up on the next idle poll (≤ 15 s).- `F24.background-sync`: with an interval set, the backend runs cycles on its own and the open page picks up the new commit on its idle poll, without a reload.-- `F24.repo-link`: an http(s) repository is shown as a link (new tab) to the browsable URL without `.git` and without embedded credentials; a local path stays plain text.+- `F24.repo-link`: an http(s) repository is shown as a link (new tab) to the browsable URL without `.git` and without embedded credentials, and the link text drops the credentials too; a local path stays plain text.- `F24.repo-link-ssh`: an scp-style ssh remote (`git@host:org/repo.git`) is also shown as a link, rebuilt over https (`https://host/org/repo`); the label keeps the configured value.- `F24.sync-delete`: deleting a synced automation raises Pending changes; the next cycle commits the removal of its `<path>/<slug>/` folder.- `F24.field-defaults`: emptying **Branch** or **Path** and saving clears the override instead of storing an empty value: the card and inputs fall back to `main` and `automations`.@@ -67,9 +67,9 @@ Preconditions:- **Encryption key (`F24.encryption`).** `control-openhands browser attr 'testid=git-sync-encryption-key-input' placeholder` is `No encryption key set`. Fill it with `qa-f24-dummy-key`, click Save (no `Checking repository...`: the key is not checked), wait for `Git Sync settings saved.`, `control-openhands browser reload`: `browser text 'testid=git-sync-encryption-pill'` is `Encrypted`, the placeholder is `An encryption key is currently set` and the input value is `""`. Mark the automation changed (PATCH `{"enabled":true}`), reload, click **Sync now** and wait as in Commit author; `git -C <repo-path> show qa-sync:qa-automations/qa-f24-sync/automation.yaml | head -c 20` starts with `gAAAAA` (ciphertext, not YAML). Then fill the key input with any text, run `control-openhands browser click 'testid=git-sync-clear-encryption-key-switch >> xpath=ancestor::label'`: `control-openhands browser enabled 'testid=git-sync-encryption-key-input'` is `false` and its value is `""`. Click Save, wait for the toast, reload: the pill is `Not encrypted`, the placeholder `No encryption key set`, and the clear switch is unchecked again.- **Access token (`F24.token`).** `control-openhands browser attr 'testid=git-sync-token-input' type` is `password` and the placeholder `Leave blank to keep the current token`. Fill it with `qa-dummy-token`, run `control-openhands browser network --clear`, click Save with `--observe 'testid=git-sync-save-button' --observe-ms 2000` (shows `Checking repository...`), wait for the toast; `control-openhands browser network --last 6` lists `/api/automation/v1/git-sync/check` then `/api/automation/v1/git-sync/config`. After reload the token input is `""`. Run `control-openhands browser click 'testid=git-sync-clear-token-switch >> xpath=ancestor::label'`; `browser enabled 'testid=git-sync-token-input'` is `false`. Click Save, wait for the toast, reload; `browser eval "document.querySelector('[data-testid=git-sync-clear-token-switch]').checked"` is `false`.- **Interval (`F24.interval`).** Fill `testid=git-sync-interval-input` with `300`, Save, wait for the toast, reload: the card's `Sync every (seconds)` field reads `Every 300s` (`control-openhands browser text 'role=heading[name="Sync Status"] >> xpath=ancestor::div[2]'`) and the input value is `300`. Fill it with `''`, Save, reload: `Manual only` and input `0`. Fill `-5` and click Save: `browser eval "document.querySelector('[data-testid=git-sync-interval-input]').validationMessage"` is `Value must be greater than or equal to 0.`; reload to drop the draft.-- **Pause and resume (`F24.pause`).** Click `testid=git-sync-enabled-switch >> xpath=ancestor::label`; `browser enabled 'testid=git-sync-save-and-sync-button'` is `false`. Run `control-openhands browser network --clear`, click Save, wait for the toast; `control-openhands browser network` lists no `git-sync/check`. After reload the pill is `Disabled`, `enabled 'testid=git-sync-now-button'` is `false` and the card still shows `<repo-path>`; screenshot `--feature F24.pause --name disabled`. Click the switch label again, Save, wait for the toast: the pill is `Enabled`.+- **Pause and resume (`F24.pause`).** Click `testid=git-sync-enabled-switch >> xpath=ancestor::label`; `browser enabled 'testid=git-sync-save-and-sync-button'` is `false`. Run `control-openhands browser network --clear`, click Save, wait for the toast; `control-openhands browser network` lists no `git-sync/check`. After reload the pill is `Disabled`, `enabled 'testid=git-sync-now-button'` is `false` and the card still shows `<repo-path>`; screenshot `--feature F24.pause --name disabled`. The switch's help text (`control-openhands browser text 'testid=git-sync-enabled-switch >> xpath=ancestor::label/following-sibling::p'`) is `Sync is on as soon as a repository is configured. Turn this off to pause syncing without losing the configuration.` Click the switch label again, Save, wait for the toast: the pill is `Enabled`.- **Trigger while disabled elsewhere (`F24.sync-disabled-error`).** With the page showing `Enabled`, arrange `control-openhands api PUT /api/automation/v1/git-sync/config --write --data '{"enabled":false}'` (another admin pausing), then immediately `control-openhands browser click 'testid=git-sync-now-button'` and `control-openhands browser wait-text 'Enable Git Sync before triggering a sync.' --timeout 5000`. The pill still says `Enabled` at first; `control-openhands browser wait 'testid=git-sync-enabled-pill >> has-text=Disabled' --timeout 20000` succeeds within about 15 s. `browser errors --app-only` lists the induced `503` on `/api/automation/v1/git-sync/sync` (expected). Turn sync back on through the form (switch label, Save).-- **Repository link (`F24.repo-link`).** Fill `testid=git-sync-repo-url-input` with `https://qa-user:[email protected]/qa-org/qa-repo.git`, click Save, `browser wait 'testid=git-sync-check-failure' --timeout 30000` (git's output redacts the URL as `https://***@git.example.invalid/...`; the failure itself is `CONNECT tunnel failed, response 502` behind the sandbox proxy, a resolve error elsewhere), click Save again, wait for the toast, reload. `control-openhands browser attr 'testid=git-sync-repo-link' href` is `https://git.example.invalid/qa-org/qa-repo` and `attr ... target` is `_blank`. Expected: the link text hides the credentials too. Today `control-openhands browser text 'testid=git-sync-repo-link'` is `https://qa-user:[email protected]/qa-org/qa-repo.git` (fail; see Gotchas). Screenshot with `control-openhands browser screenshot 'role=heading[name="Sync Status"] >> xpath=ancestor::div[2]' --feature F24.repo-link --name https-link`. Restore: fill the URL with `"$OH_VERIFY_RUN/workspace/qa-sync-remote"`, Save, wait for the toast; `browser count 'testid=git-sync-repo-link'` is `0` (a local path is plain text).+- **Repository link (`F24.repo-link`).** Fill `testid=git-sync-repo-url-input` with `https://qa-user:[email protected]/qa-org/qa-repo.git`, click Save, `browser wait 'testid=git-sync-check-failure' --timeout 30000` (git's output redacts the URL as `https://***@git.example.invalid/...`; the failure itself is `CONNECT tunnel failed, response 502` behind the sandbox proxy, a resolve error elsewhere), click Save again, wait for the toast, reload. `control-openhands browser attr 'testid=git-sync-repo-link' href` is `https://git.example.invalid/qa-org/qa-repo` and `attr ... target` is `_blank`. `control-openhands browser text 'testid=git-sync-repo-link'` is `https://git.example.invalid/qa-org/qa-repo.git`: the link text drops `qa-user:qa-pass@` and keeps `.git`. Screenshot with `control-openhands browser screenshot 'role=heading[name="Sync Status"] >> xpath=ancestor::div[2]' --feature F24.repo-link --name https-link`. Restore: fill the URL with `"$OH_VERIFY_RUN/workspace/qa-sync-remote"`, Save, wait for the toast; `browser count 'testid=git-sync-repo-link'` is `0` (a local path is plain text).- **Interval cycle (`F24.background-sync`).** Read the current short commit from the card (`control-openhands browser text 'text=Last synced commit >> xpath=ancestor::div[1]/..'`, `<old-hash>`). Fill `testid=git-sync-interval-input` with `20`, Save, wait for the toast; the card reads `Every 20s`. Mark the automation changed (PATCH `{"enabled":false}`), do not reload, and run `control-openhands browser wait 'text="<old-hash>"' --state detached --timeout 60000`. It succeeds within about 35 s (interval plus the page's 15 s idle poll); the card shows a new hash and `Last synced / Ns ago`, matching `git -C <repo-path> log --oneline -1 qa-sync`. Set the interval back to `0` (fill, Save, toast) so later bullets are not raced by background cycles.- **Sync a deletion (`F24.sync-delete`).** Arrange the deletion (owned by F21): `control-openhands api DELETE /api/automation/v1/<automation-id> --write` (status `204`). `control-openhands browser reload`; `browser text 'text=Pending changes >> xpath=ancestor::div[1]/..'` is `Pending changes / 1`. Run `control-openhands browser click 'testid=git-sync-now-button' --observe 'testid=git-sync-activity-row' --observe-ms 6000` (`Syncing... / started 0s ago / 1 pending` → `Sync complete`); Pending changes reads `0`. `git -C <repo-path> log --oneline -1 qa-sync` is a new `Sync automations from agent server` commit matching the card's Last synced commit, and `git -C <repo-path> ls-tree -r --name-only qa-sync` lists only the fixture's `README.md` and `src/...` files: `qa-automations/qa-f24-sync/` is gone.- **Empty branch and path (`F24.field-defaults`).** Run `control-openhands browser fill 'testid=git-sync-branch-input' ''` and `browser fill 'testid=git-sync-path-input' ''`, then `browser click 'testid=git-sync-save-button' --observe 'testid=git-sync-save-button' --observe-ms 2000` (`Checking repository...`: the branch changed; `main` exists in the fixture, so the check passes) and `browser wait-text 'Git Sync settings saved.' --timeout 10000`. After `browser reload` the card reads Branch `main` and Path `automations`, `browser value 'testid=git-sync-branch-input'` is `main` and `browser value 'testid=git-sync-path-input'` is `automations`; `control-openhands api GET /api/automation/v1/git-sync/status` has `"branch": "main"` and `"path": "automations"`. Do not press **Sync now** here: `main` is the fixture's checked-out branch.@@ -85,7 +85,7 @@ Preconditions:## Gotchas-- Configuring a repository is what turns sync on: the backend's pause switch defaults to on, so the first save of a URL flips the pill to `Enabled` even though the switch was never touched, and clearing the URL turns it off again. The switch's help text (`Turning it on requires a backend that was started with git sync enabled.`) is stale: this run has no `AUTOMATION_GIT_SYNC_*` variables and enabling works (#17950).+- Configuring a repository is what turns sync on: the backend's pause switch defaults to on, so the first save of a URL flips the pill to `Enabled` even though the switch was never touched, and clearing the URL turns it off again. The help text under the switch says so (`Sync is on as soon as a repository is configured. ...`). A pause is the exception: it survives clearing and re-entering the URL, so the pill stays `Disabled` until the switch is turned back on.- A local path (or `file://` URL) is a valid remote, which is what makes this family drivable without credentials. Use a branch other than the fixture's checked-out `main`: git's default `receive.denyCurrentBranch` refuses pushes to a non-bare repo's checked-out branch (not driven here; every recipe uses `qa-sync`).- The reachability check runs only when repository URL, branch or token changed (`git ls-remote`, 20 s timeout). Interval, path, author, encryption key and the enable switch save without it. A check that cannot run at all (old backend, network error) never blocks a save.- The second Save after a failed check saves the same values without checking again; editing any checked field re-arms the check.@@ -94,9 +94,8 @@ Preconditions:- Save's label cycles `Save Changes` → `Checking repository...` (only when a checked field changed) → `Saving...` → `Save Changes` in about 100 ms against a local repo; `--observe 'testid=git-sync-save-button'` records it.- Saving an encryption key does not re-encrypt what is already in the repository: files stay readable YAML until each automation changes and is exported again (observed; the help text says files are encrypted "before they are committed") (OpenHands/automation#551).- Nothing on the page says whether a token is stored: the token placeholder is always `Leave blank to keep the current token`, and the author fields always reload blank. Prove author changes from the commit (`git log --format='%an <%ae>'`).-- The Repository field shows `repo_url` verbatim. A URL with embedded credentials (`https://user:token@host/...`) is displayed in clear text as the link's label, while the href and the check output redact them (`F24.repo-link` fail; Canvas UI) (#17950). Never type a real token into the URL.+- The card's Repository value drops embedded credentials, as link text and as plain text: an http(s) URL loses its whole `user:token@` (a token alone in the user slot too), other schemes keep the user and lose only the password (`ssh://git@host:2222/...`), and the rest stays as configured. The Repository URL input and `GET /api/automation/v1/git-sync/status` still carry the credentials, so a screenshot of the form shows them. Never type a real token into the URL.- The page has no Automate sub-navigation (Dashboard / Templates) and no command-menu entry; leave through **Back to Automations** (`role=link`, not a button).-- Unused strings `AUTOMATIONS$GIT_SYNC$ENABLE_BLOCKED_ERROR` and `NOT_LOCAL_*` exist in translations; no current UI path shows them.- Deleted automations stay in Pending changes until a cycle pushes the removal; after cleanup with sync off the card can read `Pending changes 2`. **Sync a deletion** pushes it while the repository is still configured.- An untouched **Enable Git Sync** switch follows the server: after another admin pauses sync, the next idle poll flips both the pill and the switch off, so turning it back on is one label click plus Save.- `F24.unsupported` needs `--automation-ref` (uvx fetches `git+https://github.com/OpenHands/[email protected]`); without GitHub access it stays blocked. The control CLI does not forward `OH_AUTOMATION_VERSION`, so a PyPI release cannot be selected directly.diff --git a/.agents/skills/verify-openhands/references/feature-map/README.md b/.agents/skills/verify-openhands/references/feature-map/README.mdindex ce903e8949..da10de8bdf 100644--- a/.agents/skills/verify-openhands/references/feature-map/README.md+++ b/.agents/skills/verify-openhands/references/feature-map/README.md@@ -5,6 +5,8 @@ of Agent Canvas. Read this index before driving the app, then open the matchingfeature file and run its recipe with `control-openhands`. The map is not a claimthat every row passes today; the run's evidence ledger is.+Maintenance baseline: main@ed815e141409c7b52991ab8d13c553b595da9165 (2026-10-06). The next maintenance pass starts from this commit; a pass proposes the next baseline in its PR, and merging that PR accepts it.+## Baseline preconditions- `control-openhands` is on `PATH` (see [the skill](../../SKILL.md)).@@ -247,7 +249,7 @@ How to write and prove new entries: [../mapping.md](../mapping.md).| F21 | [Automations dashboard and actions](F21-automations-dashboard.md) | cards and list, filters, sort, Run now, enable, export, import, delete, pin | `/automations` | LLM; automation service | 34 || F22 | [Creating automations](F22-automation-creation.md) | templates, setup dialog, custom automations, import | `/automations/templates`, `/automations/new/<id>` | LLM | 28 || F23 | [Automation detail, runs and editing](F23-automation-detail.md) | detail page, runs, logs, edit dialog, triggers, debug | `/automations/<id>` | LLM; runs | 39 |-| F24 | [Automation Git Sync](F24-git-sync.md) | configure, sync cycles, encryption, status | `/automations/git-sync` | `fixture git-remote` | 26 |+| F24 | [Automation Git Sync](F24-git-sync.md) | configure, sync cycles, encryption, status | `/automations/git-sync` | `fixture git-repo` | 26 || F25 | [Backends, Cloud and sharing](F25-backends-and-cloud.md) | add, edit, remove and switch backends, per-backend consent, Cloud login, shared pages | backend selector | a second stack; Cloud account (blocked) | 27 || F26 | [Launcher modes, Docker, desktop and library](F26-runtime-variants.md) | launcher flags, partial stacks, LAN bind, Docker, Electron, embeddable library | a terminal | Docker/Electron where available | 27 || F27 | [Workspace tools](F27-workspace-tools.md) | terminal, browser, planner, task list, usage, `canvas_ui_control` | drawer tabs | LLM | 29 |diff --git a/.agents/skills/verify-openhands/references/maintenance.md b/.agents/skills/verify-openhands/references/maintenance.mdindex 2629b825a1..f782f79e61 100644--- a/.agents/skills/verify-openhands/references/maintenance.md+++ b/.agents/skills/verify-openhands/references/maintenance.md@@ -28,8 +28,18 @@ Record the UTC run time, budget (model, spend), accounts available and permittedside effects. Fetch `main` and freeze its full SHA as TARGET. Check`git rev-parse --is-shallow-repository`; deepen until BASE is present (an emptylog from a shallow clone is not "no changes"). BASE is the previous completed-pass's recorded TARGET; on a first run, the last first-parent commit before the-agreed cutoff (`git rev-list --first-parent -1 --before="$CUTOFF" "$TARGET"`).+pass's recorded TARGET, kept on the `Maintenance baseline` line of+[the map index](feature-map/README.md); on a first run, the last first-parent+commit before the agreed cutoff+(`git rev-list --first-parent -1 --before="$CUTOFF" "$TARGET"`). A pass that+changes the map updates that line to its TARGET in its PR, so merging the PR+accepts the new baseline.++A daily pass may be a **delta pass**: source and live coverage only for the+features whose paths changed in BASE..TARGET (§3) and for rows that link an+issue closed since BASE. It says "delta" in its report. A full pass is still+needed now and then (weekly, or before a release), because Agent Server and+automation releases change behavior without touching this repository.```shgit merge-base --is-ancestor "$BASE" "$TARGET"