Skip to content

🙌 OpenHands: AI-Driven Development

docs(verify-openhands): map maintenance 2026-10-08 (#18183)

Engel Nyst8793c111c68d
diff --git a/.agents/skills/verify-openhands/references/feature-map/F02-app-shell.md b/.agents/skills/verify-openhands/references/feature-map/F02-app-shell.md
index 66d2d3a02c..46e1e40e31 100644
--- a/.agents/skills/verify-openhands/references/feature-map/F02-app-shell.md
+++ b/.agents/skills/verify-openhands/references/feature-map/F02-app-shell.md
@@ -10,7 +10,7 @@ a top bar or the chat header. A user can pin Customize or Automate as the page
`/` opens. A Ctrl/Cmd+K command menu searches pages, settings and actions.
Failed requests show error toasts.
-Source: `src/components/features/sidebar/`, `src/components/features/command-menu/`, `src/stores/sidebar-store.ts`, `src/stores/command-menu-store.ts`, `src/hooks/use-pinned-home-route.ts`, `src/routes/index-home.tsx`, `src/utils/mobile-section-nav.ts`, `src/components/features/settings/agent-canvas-version-tile.tsx`, `src/components/features/alerts/alert-banner.tsx`, `src/utils/custom-toast-handlers.tsx`.
+Source: `src/components/features/sidebar/`, `src/components/features/command-menu/`, `src/stores/sidebar-store.ts`, `src/stores/command-menu-store.ts`, `src/hooks/use-pinned-home-route.ts`, `src/routes/index-home.tsx`, `src/utils/mobile-section-nav.ts`, `src/components/features/settings/agent-canvas-version-tile.tsx`, `src/components/features/alerts/alert-banner.tsx`, `src/utils/custom-toast-handlers.tsx`, `src/components/features/setup-guide/`, `src/api/cloud/setup-state-service.api.ts`.
## Sub-features
@@ -35,6 +35,7 @@ Source: `src/components/features/sidebar/`, `src/components/features/command-men
- `F02.checklist-minimize`: the card header minimizes and expands the card, and the state survives a reload.
- `F02.checklist-hide`: the **Show Getting Started checklist** switch in Settings → Application hides the card (it stays hidden after a reload) and can show it again.
- `F02.checklist-all-complete`: the card disappears once all six items are complete. Completion is recomputed from current data, so deleting the automation or the MCP server brings the card back.
+- `F02.super-admin-setup-guide`: on an OpenHands Enterprise (cloud) backend with `ENABLE_SUPER_ADMIN`, the first Super Admin (`/me` permissions include `manage_super_admins`) sees a floating **Setup guide** panel in the lower-right corner with `n/4` progress, the steps Add an LLM, Choose an automation template, Add an integration, Invite users and Optional: SAML / instance, a `Next: <step>` status and a **Start** link for that step (the positive Enterprise path remains unverified here). Close collapses it to a pill that reopens it. While the guide loads or shows, the **Getting started** card is hidden. Local backends never show it and make no `/api/admin/setup-state` request (#17969).
- `F02.update-tile`: when npm `latest` is newer than the running version, a **New version** tile (`agent-canvas-version-tile`) opens an update modal with the npm and Docker commands. The tile is never shown in locked-Cloud mode.
- `F02.alert-banner`: when the server config reports maintenance, faulty models or an error message, a dismissible banner (`alert-banner`) appears at the top of the content area.
- `F02.settings-404-modal`: if the backend's settings return 404, the LLM settings modal opens by itself. Other settings fetch errors show a toast.
@@ -82,6 +83,7 @@ Preconditions:
- **Minimize (`F02.checklist-minimize`).** Run `control-openhands browser click 'testid=sidebar-onboarding-checklist-toggle'`, `control-openhands browser attr 'testid=sidebar-onboarding-checklist' data-minimized` (`true`) and `browser count 'testid=sidebar-onboarding-checklist >> role=listitem'` (`0`). After `control-openhands browser reload` the attribute is still `true` and the toggle's `aria-label` is `Expand checklist`. Click the toggle again to restore `false`.
- **Hide from settings (`F02.checklist-hide`).** Run `control-openhands browser goto /settings/app` and `control-openhands browser click 'text=Show Getting Started checklist'`; `browser count 'testid=sidebar-onboarding-checklist'` is `0`. After `control-openhands browser reload` the count is still `0`, and `control-openhands browser eval "document.querySelector('[data-testid=show-getting-started-checklist-switch]').checked"` is `false`. Click the same text again; the count is `1`.
- **All complete (`F02.checklist-all-complete`).** Start with the four items above done (`5 complete` would mean one fixture is left over). Arrange two fixtures: a minimal stdio MCP server, `control-openhands fixture file --name qa-f02-mcp.py --content "$(printf '%s\n' 'import sys,json' 'for line in sys.stdin:' ' m=json.loads(line)' ' if "id" not in m: continue' ' r={}' ' if m.get("method")=="initialize": r={"protocolVersion":m["params"].get("protocolVersion","2024-11-05"),"capabilities":{"tools":{}},"serverInfo":{"name":"qa","version":"1"}}' ' elif m.get("method")=="tools/list": r={"tools":[]}' ' sys.stdout.write(json.dumps({"jsonrpc":"2.0","id":m["id"],"result":r})+"\n"); sys.stdout.flush()')"`, and `control-openhands fixture file --name qa-f02.automation.json --content '{"version":1,"kind":"automation","spec":{"name":"QA_F02 Done","trigger":{"type":"cron","schedule":"0 0 1 1 *","timezone":"UTC"},"enabled":false,"prompt":"Reply with the single word: pong. Do not run any tools."}}'`. Add the server in the UI: `control-openhands browser goto /mcp`, `control-openhands browser click 'testid=mcp-add-custom-server'`, `control-openhands browser click 'testid=server-type-dropdown'`, `control-openhands browser click 'role=option[name="STDIO"]'`, `control-openhands browser fill 'testid=name-input' qa_f02_mcp`, `control-openhands browser fill 'testid=command-input' python3`, `control-openhands browser fill 'testid=args-input' "$OH_VERIFY_RUN/evidence/_fixtures/qa-f02-mcp.py"`, `control-openhands browser click 'testid=mcp-custom-editor >> testid=submit-button'` and `control-openhands browser wait 'testid=mcp-custom-editor' --state detached`. The header reads `5 complete`. Import the automation: `control-openhands browser goto /automations`, `control-openhands browser click 'testid=automations-add-automation'`, `control-openhands browser click 'testid=automations-import-automation'`, `control-openhands browser upload 'testid=automations-import-file' "$OH_VERIFY_RUN/evidence/_fixtures/qa-f02.automation.json"`, `control-openhands browser click 'testid=import-automation-confirm'` and `control-openhands browser wait 'testid=import-automation-modal' --state detached`. Now `browser count 'testid=sidebar-onboarding-checklist'` is `0`, still `0` after `control-openhands browser reload`, and `control-openhands browser screenshot 'aside[data-collapsed]' --feature F02.checklist-all-complete --name rail` shows the rail without the card. Restore and prove it comes back: open the card's kebab with `control-openhands browser click '[data-testid^="automation-card-"] >> has-text=QA_F02 Done >> role=button[name="Automation actions"]'`, then `control-openhands browser click 'role=list >> has-text=Export >> role=button[name="Delete"]'`, `control-openhands browser click 'role=heading[name="Delete automation"] >> xpath=.. >> role=button[name="Delete"]'` and `control-openhands browser reload`; the card count is `1` again (`5 complete`). Then `control-openhands browser goto /mcp`, `control-openhands browser click 'testid=mcp-server-detail-qa_f02_mcp'`, `control-openhands browser click 'testid=mcp-custom-editor-delete'`, `control-openhands browser click 'testid=confirmation-modal >> testid=confirm-button'` and `control-openhands browser reload`; `testid=mcp-installed-empty` is back and the card reads `4 complete`.
+- **Setup guide (`F02.super-admin-setup-guide`).** Local: `control-openhands browser count 'testid=super-admin-setup-guide'` is `0` at `desktop` and `phone`, `browser count 'testid=sidebar-onboarding-checklist'` is `1`, and `control-openhands browser network --filter setup-state` reports `total` `0`. The positive path is blocked locally: it needs an OHE backend with `ENABLE_SUPER_ADMIN` whose `/api/admin/setup-state` returns a `guide_org_id`, `guide_dismissed` `false` and at least one unfinished required step, signed in as the first Super Admin.
- **Update tile (`F02.update-tile`).** The tile is blocked in an up-to-date checkout or without registry access. Check with `control-openhands browser count 'testid=agent-canvas-version-tile'`. When the count is `1`, click it; the modal has `agent-canvas-update-command-npm`, `agent-canvas-update-command-docker` and `agent-canvas-update-check-button`. The manual check runs either way: on `/settings/app` (`control-openhands browser goto /settings/app`; the previous bullet ends on `/mcp`), `testid=agent-canvas-update-badge` reads `Up to date` (or `New version`), `control-openhands browser click 'testid=agent-canvas-update-toggle'` opens `agent-canvas-update-modal`, and `control-openhands browser click 'testid=agent-canvas-update-check-button'` reports the result in `agent-canvas-update-status` (`You're running the latest version. What's new` when current). Close it with `control-openhands browser click 'testid=close-agent-canvas-update-modal'`.
- **Error toast (`F02.error-toasts`).** Run `control-openhands browser goto /conversations/00000000-0000-0000-0000-000000000001` and `control-openhands browser wait-text 'This conversation does not exist'`. The URL becomes `/conversations`, and `control-openhands browser screenshot --feature F02.error-toasts --name missing-conversation` shows a top-right error toast. It is the only toast: `control-openhands browser toasts` lists just the "This conversation does not exist, or you do not have permission to access it…" text, and `control-openhands browser toasts --history` has no entry containing `this UI does not understand`. `control-openhands browser wait 'text=This conversation does not exist' --state hidden` passes within 30 s.
- **Check for errors.** Run `control-openhands browser errors --app-only` after each group; it reports `pageErrors` `0` and `appErrors` `0`. External `registry.npmjs.org` and `cdn.simpleicons.org` failures are sandbox noise.
diff --git a/.agents/skills/verify-openhands/references/feature-map/F03-home.md b/.agents/skills/verify-openhands/references/feature-map/F03-home.md
index 9ec1b7edac..f6401db625 100644
--- a/.agents/skills/verify-openhands/references/feature-map/F03-home.md
+++ b/.agents/skills/verify-openhands/references/feature-map/F03-home.md
@@ -87,9 +87,9 @@ Starting work:
- **Entry points (`F03.home-entry-points`).** `control-openhands browser goto /conversations` and `control-openhands browser count 'testid=home-chat-launcher'` is `1` (same for `/`). From `/settings/secrets` (`control-openhands browser goto /settings/secrets`), `control-openhands browser press Control+k`, `control-openhands browser type 'testid=command-menu >> role=combobox' 'New chat'`, `control-openhands browser snapshot 'testid=command-menu'` (one option `New chat Start a fresh OpenHands conversation. Go` [selected]), `control-openhands browser press Enter`, `control-openhands browser url`: `/conversations`. From `/settings/secrets` (`control-openhands browser goto /settings/secrets` again), `control-openhands browser click 'testid=sidebar-conversations-link' --expect-url '/conversations(\?|$)'` and `browser count 'testid=home-chat-launcher'` is `1`.
- **`/model` on home (`F03.home-model-command`).** `control-openhands api GET /api/profiles` shows `active_profile` `deepseek-flash`. Run `control-openhands browser goto /` (Entry points ended on `/conversations`). The draft from the earlier bullets is still in the composer: clear it with `control-openhands browser fill 'testid=chat-input' ''` (typing would append). Run `control-openhands browser type 'testid=chat-input' '/model deepseek-pro'`, `control-openhands browser press Escape --selector 'testid=chat-input'` (closes the slash menu), `control-openhands browser press Enter --selector 'testid=chat-input'`. The URL stays `/`, `chat-input` is empty, the composer's model pill (`browser text 'testid=chat-input-llm-profile'`) reads `deepseek-pro`, `api GET /api/profiles` shows `active_profile` `deepseek-pro`, and `api GET '/api/conversations/search?limit=20'` lists no new conversation. Restore with the same steps and `/model deepseek-flash`.
- **Launch without a folder (`F03.launch-without-workspace`, `F03.draft-persistence`).** Run `control-openhands browser goto /conversations` (no workspace is picked yet; the pill reads Open Workspace), then fill `chat-input` with `Reply with only the word ok.` and click `testid=home-chat-launcher >> testid=submit-button` with `--expect-url '/conversations/[^/]+$'`. `control-openhands conversation wait <id> --timeout 180` reports `workspace` `<run>/private/home/workspace/project/<id without dashes>`. This is the first successful launch: `control-openhands browser click 'testid=sidebar-conversations-link' --expect-url '/conversations$'` shows an empty `chat-input` and `browser storage --session` no longer lists `oh:home-prompt-draft`.
-- **Plugins (`F03.plugin-picker`).** Run `control-openhands browser goto /conversations` (a fresh page), `control-openhands browser click 'testid=open-plugin-picker'` and `control-openhands browser wait 'testid=plugin-picker-loading' --state hidden --timeout 60000`; cards `plugin-picker-card-<name>` are listed. `control-openhands browser fill 'testid=plugin-picker-search-input' weather` leaves one card (`control-openhands browser count '[data-testid^="plugin-picker-card-"]'` is `1`); `zzz-none` makes `browser text 'testid=plugin-picker'` read `No plugins available.` With `weather` again, `control-openhands browser click 'testid=plugin-picker-toggle-city-weather'`: the footer reads `1 selected` and `control-openhands browser attr 'testid=plugin-picker-toggle-city-weather' aria-label` is `Remove`. `control-openhands browser click 'testid=plugin-picker-done'`, then `control-openhands browser text 'testid=plugin-picker-count'` is `1`; reopening keeps the switch checked, and `testid=plugin-picker-close` also closes it.
+- **Plugins (`F03.plugin-picker`).** Run `control-openhands browser goto /conversations` (a fresh page), `control-openhands browser click 'testid=open-plugin-picker'` and `control-openhands browser wait 'testid=plugin-picker-loading' --state hidden --timeout 60000`; cards `plugin-picker-card-<name>` are listed. `control-openhands browser fill 'testid=plugin-picker-search-input' weather` leaves one card (`control-openhands browser count '[data-testid^="plugin-picker-card-"]'` is `1`); `zzz-none` makes `browser text 'testid=plugin-picker'` read `No plugins available.` With `weather` again, `control-openhands browser click 'testid=plugin-picker-toggle-city-weather' --hover-first 150`: the footer reads `1 selected` and `control-openhands browser attr 'testid=plugin-picker-toggle-city-weather' aria-label` is `Remove`. `control-openhands browser click 'testid=plugin-picker-done'`, then `control-openhands browser text 'testid=plugin-picker-count'` is `1`; reopening keeps the switch checked, and `testid=plugin-picker-close` also closes it. On hover-swapping cards, use `--hover-first 150` for subsequent Add/Remove clicks too and assert both the label and `aria-checked`; the shared index gotcha explains why a plain mouse click can be swallowed (including at phone width).
- **Plugin reaches the agent (`F03.launch-with-plugin`).** With `city-weather` attached, start the no-folder launch above without its `goto` (a page load drops the attached plugin), then `control-openhands api GET '/api/conversations/<id>/events/search?limit=20'`: the system prompt contains `city-weather:now` (a conversation started without the plugin has none). Back on `/conversations` (`control-openhands browser goto /conversations`), `control-openhands browser count 'testid=plugin-picker-count'` is `0`.
-- **Creation failure (`F03.create-error-toast`).** Fill `chat-input` with `QA error path`, run `control-openhands service stop agent-server`, then `control-openhands browser click 'testid=home-chat-launcher >> testid=submit-button' --observe 'role=status' --observe-ms 4000` and `control-openhands browser toasts`. Expected: `Creating conversation…` replaced by one error toast and the text still in the composer. Today there are three identical `HTTP request failed (502 Bad Gateway)` toasts and the composer is empty (the draft only returns after a reload); `browser screenshot --feature F03.create-error-toast --name toasts`. Bring the stack back with `control-openhands restart` and `control-openhands browser reload`.
+- **Creation failure (`F03.create-error-toast`).** Fill `chat-input` with `QA error path`, run `control-openhands service stop agent-server`, then clear the observation window with `control-openhands browser toasts --clear`. Start genuine temporal evidence before submitting: `control-openhands browser record start --feature F03.create-error-toast --name failed-launch`. Run `control-openhands browser click 'testid=home-chat-launcher >> testid=submit-button' --observe 'role=status' --observe-ms 500`, then immediately `control-openhands browser screenshot --feature F03.create-error-toast --name toasts` (this early still may show the loading state). Keep recording and wait for the real error with `control-openhands browser wait-text 'HTTP request failed (502 Bad Gateway)' --timeout 15000`, then `control-openhands browser wait 'role=status >> has-text=Creating conversation…' --state hidden --timeout 15000`. `browser toasts` and `browser toasts --history` show `Creating conversation…` replaced by exactly one error toast, such as `HTTP request failed (502 Bad Gateway): "Bad Gateway: connect ECONNREFUSED 127.0.0.1:<port+1>"` (transport detail is preserved by design, #17985). Count every new error toast in this window; an additional toast is a failure to record, not one to discard. `browser text 'testid=chat-input'` still reads `QA error path` and `browser enabled 'testid=home-chat-launcher >> testid=submit-button'` is `true`. Stop the recording with `control-openhands browser record stop`; inspect its loading→error transition and recovered prompt, paired with the full screenshot. Bring the stack back with `control-openhands restart` and `control-openhands browser reload`; the prompt remains `QA error path`.
Workspaces:
@@ -145,5 +145,5 @@ Phone and cleanup:
- Deleting the last automation leaves its id in the pinned localStorage key (pruning skips an empty list); the grid still hides it.
- Pinned cards reorder only by mouse drag; there is no keyboard or menu alternative. Drive it with `browser drag <handle> --by DX,DY --steps 20`; `browser drag <handle> <target>` reports ok but leaves the order unchanged.
- `VITE_HOME_AUTOMATIONS_DEMO=true` (build-time) swaps the home automation sections for demo data; never verify against such a build.
-- Known issue #17936: a failed launch from Home shows three identical error toasts and clears the composer (`F03.create-error-toast`).
+- When the Agent Server is stopped, background refetches can add a generic `An error occurred` toast (#18051). For `F03.create-error-toast`, retain the complete video and toast history and report any extra toast with its timing; do not waive it from the count.
- The workspace combobox uses one message for an empty list and for a search with no match: both read `No workspaces yet` (`workspace-dropdown-empty`), with **+ Add Workspace** still below it (#18037).
diff --git a/.agents/skills/verify-openhands/references/feature-map/F04-conversation-list.md b/.agents/skills/verify-openhands/references/feature-map/F04-conversation-list.md
index 5aa11d81ad..5ba4b3e21d 100644
--- a/.agents/skills/verify-openhands/references/feature-map/F04-conversation-list.md
+++ b/.agents/skills/verify-openhands/references/feature-map/F04-conversation-list.md
@@ -87,7 +87,7 @@ Preconditions:
- **New conversation in a folder (`F04.folder-new-conversation`).** Run `control-openhands browser goto /`, then `control-openhands browser click 'role=button[name="Start new conversation in qa-f04-folder"]' --expect-url '/conversations/'` (returns the new `/conversations/<id>`), then `control-openhands browser count '[data-testid^="thread-folder-ws-"][data-testid$="qa-f04-folder"] >> testid=conversation-card'`; it grows by one. Repeating `browser goto /` plus the click for `qa-f04-repo` 18 times arranges the data for the next two bullets.
- **Folder preview (`F04.folder-preview-more`).** With more than five conversations in `qa-f04-repo`, `control-openhands browser count '[data-testid^="thread-folder-ws-"][data-testid$="qa-f04-repo"] >> testid=conversation-card'` is `5` and `control-openhands browser text '[data-testid^="thread-folder-view-more-ws-"][data-testid$="qa-f04-repo"]'` is `More`. Click that button: every loaded row shows and the label is `Less`; click again: `5`.
- **Reorder folders (`F04.folder-reorder`).** In By workspace mode read the order with `control-openhands browser eval "[...document.querySelectorAll('[data-testid^=thread-folder-drag-]')].map(e=>e.textContent.trim())"`, then run `control-openhands browser drag '[data-testid^="thread-folder-drag-ws-"][data-testid$="qa-f04-folder"]' '[data-testid^="thread-folder-drag-ws-"][data-testid$="qa-f04-repo"]' --position before`. The same eval now starts with `qa-f04-folder`, `qa-f04-repo`, also after `browser reload`, and `control-openhands browser eval "JSON.parse(localStorage.getItem('conversation-panel-preferences')).state.groupFolderOrder"` lists the `ws:<path>` keys in that order.
-- **Load more (`F04.load-more`).** In By date mode (More options → `testid=organize-chronological`, or the Recent preset) with 22 or more conversations, `control-openhands browser count 'testid=conversation-panel-list-scroll >> testid=conversation-card'` is `20`. Run `control-openhands browser click 'testid=load-more-conversations'` and `control-openhands browser wait 'testid=load-more-conversations' --state detached --timeout 15000`; the count is the total (`23` with 23 conversations). In By workspace mode (`organize-grouped`, then `browser reload`) the same click adds the later rows to their own folders: with the 3 oldest rows in No workspace and none of them loaded, `testid=thread-folder-__none_workspace` appears only after the click and `browser count 'testid=conversation-card'` grows by 3 (6 → 9 with the folder previews). A folder that already shows five rows keeps the extra ones behind its More.
+- **Load more (`F04.load-more`).** In By date mode (More options → `testid=organize-chronological`, or the Recent preset) with 22 or more conversations, `control-openhands browser count 'testid=conversation-panel-list-scroll >> testid=conversation-card'` is `20`. Run `control-openhands browser click 'testid=load-more-conversations'` and `control-openhands browser wait 'testid=load-more-conversations' --state detached --timeout 15000`; the count is the total (`23` with 23 conversations). In By workspace mode (`organize-grouped`, then `browser reload`) the same click adds the later rows to their own folders: with the oldest rows in No workspace and none of them loaded, `testid=thread-folder-__none_workspace` appears only after the click and `browser count 'testid=conversation-card'` grows by the number of unloaded No workspace rows (6 → 9 with three such rows, 5 → 7 with two). A folder that already shows five rows keeps the extra ones behind its More.
- **Organize (`F04.organize`).** Run `control-openhands browser click 'testid=conversation-layouts-toggle'`, `control-openhands browser click 'testid=advanced-options-row'`, `control-openhands browser snapshot 'testid=advanced-conversation-options-modal'` (sections Organize, Sort by, Threads, Additional, Automations, Metadata), `control-openhands browser click 'testid=organize-chronological'` (`browser attr 'testid=organize-chronological' aria-checked` is `true`), `control-openhands browser click 'testid=advanced-options-close'`, `control-openhands browser reload`, then `control-openhands browser count '[data-testid^=thread-folder-ws-]'`. The count is `0` and the rows form one list; `organize-grouped` brings the folders back.
- **Header divider (`F04.list-header`).** With more rows than fit (By date mode with 20 loaded rows, as Organize leaves it; By workspace mode previews too few rows to scroll), `control-openhands browser eval "document.querySelector('[data-testid=older-conversations-summary]').parentElement.classList.contains('border-border')"` is `false`; after `control-openhands browser scroll 'testid=conversation-panel-list-scroll' --by 300` it is `true`, and `false` again after `--by -300`.
- **Rename (`F04.card-rename`).** Pick the oldest untitled conversation (`b8d99...` from the picker step; the sort check below needs an old one). It is beyond the first 20 rows after a reload, so first run `control-openhands browser click 'testid=load-more-conversations'` and `control-openhands browser wait 'testid=load-more-conversations' --state detached --timeout 15000`. Then run `control-openhands browser scroll 'testid=conversation-card >> has-text=Conversation <id5>'` (the first five characters of its id), `control-openhands browser hover 'testid=conversation-card >> has-text=Conversation <id5>'`, `control-openhands browser click 'testid=conversation-card >> has-text=Conversation <id5> >> testid=ellipsis-button'`, `control-openhands browser click 'testid=context-menu >> testid=edit-button'`, `control-openhands browser fill 'input[data-testid=conversation-card-title]' 'QA_F04 renamed'`, `control-openhands browser press Enter`, then `control-openhands browser toasts` (`Conversation title updated successfully`), `control-openhands browser reload` and `control-openhands browser count 'testid=conversation-card-title >> has-text=QA_F04 renamed'` (`1`).
diff --git a/.agents/skills/verify-openhands/references/feature-map/F05-composer.md b/.agents/skills/verify-openhands/references/feature-map/F05-composer.md
index 5990a5efe2..3f28cb0c06 100644
--- a/.agents/skills/verify-openhands/references/feature-map/F05-composer.md
+++ b/.agents/skills/verify-openhands/references/feature-map/F05-composer.md
@@ -61,7 +61,7 @@ Preconditions:
- **Draft survives navigation (`F05.draft-persistence`).** Run `control-openhands browser type 'testid=chat-input' 'QA draft text'` and wait out the 500 ms save: `control-openhands browser eval "new Promise(r=>setTimeout(()=>r(JSON.parse(localStorage.getItem('conversation-state-<id>')).draftMessage),1500))"` returns `QA draft text`. Then `control-openhands browser click 'testid=backend-selector-settings-link' --expect-url settings`, `control-openhands browser back` and the `innerText` eval above: `QA draft text`. `control-openhands browser reload` restores it again. Clear with `control-openhands browser fill 'testid=chat-input' ''` and wait a second before navigating.
- **Home draft (`F05.draft-persistence`).** Run `control-openhands browser goto /`, `control-openhands browser type 'testid=chat-input' 'QA home draft'`, `control-openhands browser goto /settings/secrets`, `control-openhands browser goto /`, then the `innerText` eval: `QA home draft`; `control-openhands browser storage --session` lists `oh:home-prompt-draft`. Clear with `control-openhands browser fill 'testid=chat-input' ''`.
- **Auto-resize (`F05.composer-resize`).** On `/conversations/<id>` (`control-openhands browser goto /conversations/<id>`; Home draft left `/`) type `line`, then eight times `control-openhands browser press Shift+Enter` and `control-openhands browser type 'testid=chat-input' 'lineN'` (`line2`…`line9`): `control-openhands browser bbox 'testid=chat-input'` grows by 20 px per line, from `height` `20` to `180`; after `control-openhands browser fill 'testid=chat-input' ''` it is `20`. `control-openhands browser count '#resize-grip'` is `1`. `control-openhands browser drag '#resize-grip' --by 0,-200` makes the empty field `220` high and `control-openhands browser drag '#resize-grip' --by 0,150` brings it to `70`; after `control-openhands browser reload` it is `20` again (the dragged height is not kept).
-- **Tools menu and macros (`F05.plus-menu`).** On `/conversations/<id>` run `control-openhands browser click 'testid=chat-plus-button'` and `control-openhands browser testids 'testid=tools-context-menu'`: `macros-button`, `show-skills-button`, `show-hooks-button`, `show-agent-tools-button`, `add-files-and-images-button` (no `git-tools-button` outside a repository). `control-openhands browser hover 'testid=macros-button'` shows `macros-submenu` with `increase-test-coverage-button`, `fix-readme-button`, `auto-merge-prs-button`, `clean-dependencies-button`. `control-openhands browser click 'testid=fix-readme-button'` closes the menu and fills the composer with `Please look at the README and make the following improvements…`; the `testid=user-message` count is unchanged. Clear with `control-openhands browser fill 'testid=chat-input' ''`.
+- **Tools menu and macros (`F05.plus-menu`).** On `/conversations/<id>` run `control-openhands browser click 'testid=chat-plus-button'` and `control-openhands browser testids 'testid=tools-context-menu'`: `macros-button`, `show-skills-button`, `show-hooks-button`, `show-agent-tools-button`, `add-files-and-images-button` (no `git-tools-button` outside a repository). `control-openhands browser hover 'testid=macros-button'` shows `macros-submenu` with `increase-test-coverage-button`, `fix-readme-button`, `auto-merge-prs-button`, `clean-dependencies-button`. `control-openhands browser click 'testid=fix-readme-button'` closes the menu and fills the composer with `Please look at the README and make the following improvements…`; the `testid=user-message` count is unchanged. Clear with `control-openhands browser fill 'testid=chat-input' ''`. Open the menu again and `control-openhands browser press Escape`: `browser count 'testid=tools-context-menu'` is `0` and `control-openhands browser eval "document.activeElement.dataset.testid"` is `chat-plus-button`.
- **Show dialogs (`F05.plus-menu`).** For each of `show-skills-button`, `show-hooks-button`, `show-agent-tools-button`: `control-openhands browser click 'testid=chat-plus-button'`, `control-openhands browser click 'testid=show-hooks-button'` (etc.), `control-openhands browser text 'role=dialog'` (starts `Available Skills`, `Available Hooks`, `Agent Tools & Metadata`), then `control-openhands browser press Escape` and `control-openhands browser count 'role=dialog'`: `0`.
- **Agent profile before start (`F05.agent-profile-switch`).** Run `control-openhands browser goto /`, `control-openhands browser click 'testid=chat-plus-button'`, `control-openhands browser hover 'testid=switch-agent-profile-button'` and `control-openhands browser text 'testid=agent-profile-submenu'`: `AVAILABLE PROFILES`, `default` (checked; `chat-input-agent-profile-option-default`), `Manage agent profiles`. `control-openhands browser click 'testid=agent-profile-submenu >> text=Manage agent profiles' --expect-url 'settings/agents'` lands on `/settings/agents`. In a started conversation (`control-openhands browser goto /conversations/<id>`) `control-openhands browser click 'testid=chat-plus-button'` then `control-openhands browser count 'testid=switch-agent-profile-button'` is `0`.
- **Attach a file and an image (`F05.attach-files`).** On `/conversations/<id>` run `control-openhands browser upload 'testid=upload-image-input' "$OH_VERIFY_RUN/evidence/_fixtures/qa-image.png" "$OH_VERIFY_RUN/evidence/_fixtures/qa-note.txt"` and `control-openhands browser screenshot 'testid=interactive-chat-box' --feature F05.attach-files --name attached`: a `qa-note.txt TXT` chip and a thumbnail. `control-openhands browser count 'testid=interactive-chat-box >> alt=qa-image.png'` is `1`. `control-openhands browser click 'role=button[name="Upload as file"]'` turns the image toggle into `Do not upload as file` (`control-openhands browser attr 'role=button[name="Do not upload as file"]' aria-pressed` is `true`); click it again to restore. The remove buttons are named: `control-openhands browser snapshot 'testid=interactive-chat-box'` lists `button "Remove qa-note.txt"` and `button "Remove image"`. Remove the image with `control-openhands browser click 'testid=interactive-chat-box >> role=button[name="Remove image"]'`; the `alt=qa-image.png` count is `0`. Then `control-openhands browser type 'testid=chat-input' 'Reply with only the content of the attached file.'`, `control-openhands browser press Enter --selector 'testid=chat-input'`, wait as in Type and send, and `control-openhands browser text 'testid=user-message >> nth=-1'`: it ends `NEW FILES ADDED: qa-note.txt`. `control-openhands conversation events <id> --kinds MessageEvent --last 3` shows the reply `QA attachment 7731`, and `qa-note.txt` sits in the conversation `workspace` printed by `control-openhands conversation status <id>`.
@@ -91,7 +91,7 @@ Preconditions:
- `conversation wait <id>` right after sending returns at once with the previous `finished` status. Use `conversation wait <id> --fresh`; `--until running` then a terminal wait only works for turns longer than the poll interval (a `Reply with only` turn on deepseek-flash can finish first, and `--until running` then times out).
- The slash menu stays open while you type a command; press Escape before Enter or Enter selects the highlighted option instead of sending.
- Conversation drafts are saved 500 ms after the last keystroke and not flushed on unmount (the home draft is): navigating sooner restores the older draft (fail row) (#17926). Wait a second before navigating when testing restoration.
-- Escape should close the `+` tools menu. Known failure (reproduced 2026-10-06): `testid=tools-context-menu` stays open and focus stays on `chat-plus-button` (#18094; #18044 fixed Escape for the other popups and left this menu out). Click `chat-plus-button` again or choose an item. A menu left open covers attachments in screenshots. The narrow-width "More input actions" overflow menu ignores Escape too (reproduced 2026-10-06; a follow-up noted in the fix PR #18015, not filed yet): close it with its trigger or an outside click (`browser mouse-click 160 100` at `narrow`).
+- Escape closes the `+` tools menu (`browser count 'testid=tools-context-menu'` is `0`) and returns focus to `chat-plus-button`, whether focus was on the trigger or on a menu item. A menu left open covers attachments in screenshots. Escape should also close the narrow-width "More input actions" overflow menu and return focus to its trigger. Known failure (reproduced 2026-10-08): `browser count 'testid=chat-input-overflow-menu'` stays `1` and the trigger's `aria-expanded` stays `true`, with focus on the trigger or on a menu item (#18172): close it with its trigger or an outside click (`browser mouse-click 160 100` at `narrow`).
- After a client-side switch between conversations (a sidebar row, or a user-message branch in `F06.branch-from-here`) Send keeps the previous conversation's state (repro candidate, not filed yet). Switching from an empty composer to one with a saved draft restores the text next to a disabled Send; this is a race (Send came up enabled in 1 of 7 tries), so one enabled reading does not show the bug is gone. Switching from a composer with text to an empty one leaves Send enabled, and clicking it does nothing. Typing or `browser reload` fixes it, and Enter in the field sends the restored text anyway. Read `browser enabled 'testid=submit-button'` after a reload, or after typing.
- Uploaded chips and thumbnails have no test ids. Their remove buttons are named `Remove <file name>` (file chip) and `Remove image` (thumbnail), and Send, Stop and Play read `Send message`, `Stop` and `Resume the agent task` (#18033); select by those names, or by text/alt.
- `browser upload` feeds the hidden input directly. To drive the real path, `+` > Add Files and Images, use `control-openhands browser upload-via 'testid=add-files-and-images-button' <file>`, which answers the native file chooser.
diff --git a/.agents/skills/verify-openhands/references/feature-map/F07-conversation-page.md b/.agents/skills/verify-openhands/references/feature-map/F07-conversation-page.md
index 52064c0086..034d9317c9 100644
--- a/.agents/skills/verify-openhands/references/feature-map/F07-conversation-page.md
+++ b/.agents/skills/verify-openhands/references/feature-map/F07-conversation-page.md
@@ -90,7 +90,7 @@ Preconditions:
- `stop-button`, `show-skills-button`, `show-hooks-button` and `show-agent-tools-button` also exist in the composer, and `ellipsis-button` in sidebar rows: always scope to `testid=chat-pane-header` or `testid=conversation-name-context-menu`.
- Stop Runtime (status menu) and Stop Conversation (menu) both navigate to `/conversations`. On a finished local conversation the agent server keeps `finished`; use a running conversation to see `paused` and Start Runtime.
- Rename has no Escape-to-cancel: Escape leaves the input open and the next blur saves whatever was typed.
-- Expected: Escape closes the status-dot menu, as it closes the "..." and Git actions menus. Known failure (reproduced 2026-10-06): the menu stays open (`browser count 'testid=server-status-context-menu'` stays `1`) (#18094), so close it with an outside click (`browser mouse-click 900 500`).
+- Escape closes the status-dot menu, as it closes the "..." and Git actions menus (`browser count 'testid=server-status-context-menu'` is `0`). A menu opened by click or Enter returns focus to `server-status-menu-trigger`; one opened by hover closes without moving focus (focus left on a menu item falls to `body`). Touch taps cannot be driven with the CLI, so the tap path is unverified.
- The status menu reads `Running` / `Stop Runtime` for a finished local conversation too; only a paused one shows `Server Stopped` / `Start Runtime`.
- Panel and Overview columns animate: read their state with `browser wait <sel> --state hidden|visible`, not an immediate `browser visible`.
- The Skills dialog shows the list read with the page or at the last Refresh: a project skill added later appears after Refresh (or `browser reload`), not on reopening the dialog within 10 minutes. Its own text says to click Refresh.
diff --git a/.agents/skills/verify-openhands/references/feature-map/F08-workspace-files-and-changes.md b/.agents/skills/verify-openhands/references/feature-map/F08-workspace-files-and-changes.md
index fa089c7ba7..e93d61af35 100644
--- a/.agents/skills/verify-openhands/references/feature-map/F08-workspace-files-and-changes.md
+++ b/.agents/skills/verify-openhands/references/feature-map/F08-workspace-files-and-changes.md
@@ -104,7 +104,7 @@ Preconditions:
- When the drawer is closed, its tabs stay mounted at width 0. `browser count 'testid=files-tab'` is `1` even then, so assert with `browser visible` or `right-panel-toggle` `aria-pressed`.
- The tab row is a `tablist "Conversation panels"` of `role=tab` controls, each named after its tab even when inactive (#17612), so `role=tab[name="Commits"]` finds the Commits tab whether or not it is active; `role=button[name="Commits"]` finds nothing. `aria-selected` marks the selected tab. The `conversation-tab-*` test ids still work.
- The tab row ends with the ellipsis menu (`Customize tabs`), then the `VSCode` button (`drawer-vscode-link`, named `Open in VS Code`) when the runtime reports a running editor. #17660 removed that button and #18048 restored it, so on a checkout between the two the drawer has no editor control at all.
-- The overflow menu is not a `role=menu`. Escape should close it. Known failure (reproduced 2026-10-06): the `conversation-tabs-menu-*` rows stay and focus stays on the ellipsis (#18094; #18044 fixed Escape for the other popups and left this menu out). Close it by choosing a row or with `browser mouse-click` outside.
+- The overflow menu is not a `role=menu`. Escape closes it and returns focus to the tab bar's `ellipsis-button`, both in the desktop drawer and on the phone `/panel` page; choosing a row or an outside click (`browser mouse-click`) closes it too.
- The Files list and the open preview do not follow bash edits: `use-auto-refresh-files-on-edit.ts` refreshes the file queries only for file-editor observations, and its comment says shell observations skip them on purpose (so that every shell command does not reload canvas iframes). This map still expects files the agent writes to appear (`F08.files-auto-refresh`), so the bash case stays a fail row. Click `files-tab-refresh` once before asserting on files the agent made with the shell. Since #18032 that one click also re-reads the open file (the content fetch revalidates instead of using the browser HTTP cache, and the rich preview gets a new `?v=`), and a page reload shows the current body without a click.
- The chat also fetches the file list (to linkify paths). A conversation page left open while the agent works can therefore show a stale tree the moment the drawer first opens.
- Binary detection is a NUL-byte sniff of the first 8 KB, and the Office message also needs that sniff to trip. A 4-byte `PK\003\004` "pptx" or random bytes without a NUL render as text in the plain viewer. Fixtures must contain a NUL.
diff --git a/.agents/skills/verify-openhands/references/feature-map/F10-llm-profiles.md b/.agents/skills/verify-openhands/references/feature-map/F10-llm-profiles.md
index 6588c58206..41e8bb8fe2 100644
--- a/.agents/skills/verify-openhands/references/feature-map/F10-llm-profiles.md
+++ b/.agents/skills/verify-openhands/references/feature-map/F10-llm-profiles.md
@@ -98,7 +98,7 @@ Preconditions:
- **Phone layout (`F10.phone`).** Run `control-openhands browser viewport phone`, `control-openhands browser goto /settings/llm`, `control-openhands browser bbox 'testid=add-llm-profile'`, `control-openhands browser bbox 'testid=profile-row >> nth=0'` and `control-openhands browser screenshot --feature F10.phone --name list`: `insideViewport` `true`, `pageHorizontalOverflow` `false`. Open a row menu: `browser bbox 'testid=profile-actions-menu'` is inside the viewport. Open Edit: `browser bbox 'testid=profile-name-input'` is 348 px wide inside the 390 px viewport and `pageHorizontalOverflow` is `false` (`llm-settings-screen` may report `insideViewport` `false` when the edited profile's form is taller than the screen; only the overflow flag matters). Return with `control-openhands browser click 'testid=cancel-profile-btn'` and `control-openhands browser viewport desktop`.
- **Default profile drives a conversation (`F10.default-used`).** Make a profile with a distinct model Default through the row menu (for example `QA_pro-copy-1`, `deepseek/deepseek-v4-pro`, then `wait-text 'Switched to profile "QA_pro-copy-1"'`), and run `control-openhands conversation start --prompt "Reply with exactly the word: pong" --wait --timeout 180`. The JSON has `"status": "finished"` and `"model": "deepseek/deepseek-v4-pro"`. The browser is now on the conversation page: `control-openhands browser goto /settings/llm` before driving this family again.
- **Persistence across a restart (`F10.list`).** `control-openhands restart`, `control-openhands doctor`, `control-openhands browser goto /settings/llm`: the same rows and the same Default badge are back.
-- **Load error (`F10.list-states`, blocked).** `control-openhands service stop agent-server` and `control-openhands browser reload` do not reach `testid=profiles-load-error`: the whole app is replaced by the disconnected-backend screen (`testid=agent-server-onboarding-screen`, toasts `HTTP request failed (502 Bad Gateway) ...`). The list error needs `/api/profiles` alone to fail. Bring the stack back with `control-openhands restart`.
+- **Load error (`F10.list-states`, blocked).** `control-openhands service stop agent-server` and `control-openhands browser reload` do not reach `testid=profiles-load-error`: the whole app is replaced by the disconnected-backend screen (`testid=agent-server-onboarding-screen`, toasts `An error occurred` (twice, one after the other) and `Could not connect to the configured agent server. Make sure it is running and reachable, then reload the page.` (#18051); the Manage backends row detail still reads `HTTP request failed (502 Bad Gateway): "Bad Gateway: connect ECONNREFUSED 127.0.0.1:<agent-server port>"`). The list error needs `/api/profiles` alone to fail. Bring the stack back with `control-openhands restart`.
- **Cleanup.** Run `control-openhands browser goto /settings/llm` (the Load error bullet left the disconnected-backend screen), then delete every `QA_*`, `deepseek-chat` and `deepseek-v3` profile through the row menu, linked ones first; `control-openhands browser count 'testid=profile-group-header'` drops to `0` once no linked row is left (`F10.list-grouped`). Then delete `QA_ds_conn` (`testid=provider-connection-row >> has-text=QA_ds_conn >> testid=provider-connection-menu-trigger`, `testid=provider-connection-actions-menu >> testid=provider-connection-delete`, `testid=delete-provider-connection-confirm`; toast `Connection "QA_ds_conn" deleted`). With no profiles left, `testid=profiles-empty` returns and `api GET /api/profiles` is `{"profiles":[],"active_profile":null}`.
## Gotchas
diff --git a/.agents/skills/verify-openhands/references/feature-map/F13-agent-profiles.md b/.agents/skills/verify-openhands/references/feature-map/F13-agent-profiles.md
index cc324f9cfb..734c02c32b 100644
--- a/.agents/skills/verify-openhands/references/feature-map/F13-agent-profiles.md
+++ b/.agents/skills/verify-openhands/references/feature-map/F13-agent-profiles.md
@@ -64,7 +64,7 @@ Preconditions:
- **Set as active (`F13.set-active`).** Run `control-openhands browser click 'testid=agent-profile-row >> has-text=QA_oh >> testid=agent-profile-menu-trigger'`, `control-openhands browser click 'testid=agent-profile-set-active'` and `control-openhands browser wait-text 'Switched to profile "QA_oh"' --timeout 10000`. After `browser reload`, `browser count 'testid=agent-profile-row >> has-text=QA_oh >> testid=agent-profile-active-badge'` and `browser count 'testid=agent-profile-active-badge'` are both `1`. Reopen the QA_oh menu: `browser enabled 'testid=agent-profile-set-active'` is `false` (screenshot `--feature F13.set-active --name menu`); `control-openhands browser press Escape` closes it (`browser count 'testid=agent-profile-actions-menu'` is `0`).
- **Pill wins over a pinned LLM (`F13.llm-pill-precedence`).** With `QA_oh` active (pinned to `deepseek-pro`) and the Home pill on `deepseek-flash` (`browser text 'testid=chat-input-llm-profile'` on `/`), run `control-openhands conversation start --prompt "Reply with only: qa-profile-ok" --wait --timeout 240`. The output's `model` is `deepseek/deepseek-flash`, and `control-openhands api GET /api/conversations/<id>` (id from that output) has `"launched_agent_profile": null` and `tool_concurrency_limit` `1`: the profile was not applied.
- **Active profile drives the launch (`F13.active-drives-conversation`).** Run `control-openhands browser goto /settings/agents` (the previous `conversation start` left the browser on the conversation), edit `QA_oh`, run `control-openhands browser choose 'testid=agent-profile-llm-selector' 'deepseek-flash (deepseek/deepseek-flash)'` (the toggle-button opener failed 5 of 5 times here: see Gotchas), check `browser value 'testid=agent-profile-llm-selector'`, Save (`Profile "QA_oh" updated`). Run the same `conversation start` again; `api GET /api/conversations/<id>` now has `launched_agent_profile.agent_profile_id` equal to QA_oh's id from `api GET /api/agent-profiles` and `tool_concurrency_limit` `2`; `control-openhands conversation events <id> --kinds MessageEvent` contains `qa-profile-ok`.
-- **MCP scope (`F13.mcp-scope`).** With `qa_mcp_a` and `qa_mcp_b` arranged, `browser goto /settings/agents`, Edit `QA_oh`: `browser value 'testid=agent-settings-mcp-mode'` is `All servers` and the eval below (with `+(i.disabled?'(disabled)':'')` appended) shows both `=true(disabled)`. Pick `Choose servers` from `testid=agent-settings-mcp-mode`; `control-openhands browser eval "[...document.querySelectorAll('[data-testid=agent-settings-mcp-list] input')].map(i=>i.dataset.testid+'='+i.checked)"` shows both `=true`. Run `control-openhands browser click 'testid=agent-settings-mcp-list >> text=qa_mcp_b'` (now `false`), Save; `api GET /api/agent-profiles/QA_oh` has `mcp_server_refs` `["qa_mcp_a"]`. Dangling: arrange `control-openhands api DELETE /api/settings/mcp/qa_mcp_a --write`, `browser reload`, Edit `QA_oh`: `control-openhands browser text 'testid=agent-settings-mcp-dangling'` is `qa_mcp_a is no longer configured. Saving with it selected will stop this agent from starting — clear it or re-add the server.` (screenshot `--feature F13.mcp-scope --name dangling`). Leave without saving, `browser goto /`, `browser reload`, `control-openhands browser fill 'testid=chat-input' 'Reply with only: qa-dangling'`, `control-openhands browser click 'testid=submit-button'` and `control-openhands browser toasts`: the launch is refused (`POST /api/conversations` 422 in `browser errors --app-only`) with `MCP server ref(s) not present in the user's MCP config: 'qa_mcp_a'` in the toast. Clear it: `control-openhands browser goto /settings/agents`, Edit `QA_oh`, `browser click 'testid=agent-settings-mcp-list >> text=qa_mcp_a'` (the warning count drops to `0`), pick `All servers`, Save; `mcp_server_refs` is `null`.
+- **MCP scope (`F13.mcp-scope`).** With `qa_mcp_a` and `qa_mcp_b` arranged, `browser goto /settings/agents`, Edit `QA_oh`: `browser value 'testid=agent-settings-mcp-mode'` is `All servers` and the eval below (with `+(i.disabled?'(disabled)':'')` appended) shows both `=true(disabled)`. Pick `Choose servers` from `testid=agent-settings-mcp-mode`; `control-openhands browser eval "[...document.querySelectorAll('[data-testid=agent-settings-mcp-list] input')].map(i=>i.dataset.testid+'='+i.checked)"` shows both `=true`. Run `control-openhands browser click 'testid=agent-settings-mcp-list >> text=qa_mcp_b'` (now `false`), Save; `api GET /api/agent-profiles/QA_oh` has `mcp_server_refs` `["qa_mcp_a"]`. Dangling: arrange `control-openhands api DELETE /api/settings/mcp/qa_mcp_a --write`, `browser reload`, Edit `QA_oh`: `control-openhands browser text 'testid=agent-settings-mcp-dangling'` is `qa_mcp_a is no longer configured. Saving with it selected will stop this agent from starting — clear it or re-add the server.` (screenshot `--feature F13.mcp-scope --name dangling`). Leave without saving, `browser goto /`, `browser reload`, `control-openhands browser fill 'testid=chat-input' 'Reply with only: qa-dangling'`, `control-openhands browser click 'testid=submit-button' --observe 'role=status' --observe-ms 4000` and `control-openhands browser toasts --history` (QA_oh must still be active and pinned to the pill's LLM, as `F13.active-drives-conversation` leaves it; otherwise the launch skips the profile and nothing is refused): the launch is refused (one `POST /api/conversations` 422 in `browser errors --app-only`; earlier failures in the session are listed too): `browser toasts --history` shows `Creating conversation…`, then one toast carrying the server's `detail.message` (`MCP server(s) not configured: qa_mcp_a` on Agent Server 1.53.0), and `browser text 'testid=chat-input'` still reads `Reply with only: qa-dangling`. Clear the composer with `browser fill 'testid=chat-input' ''`, then clear the ref: `control-openhands browser goto /settings/agents`, Edit `QA_oh`, `browser click 'testid=agent-settings-mcp-list >> text=qa_mcp_a'` (the warning count drops to `0`), pick `All servers`, Save; `mcp_server_refs` is `null`.
- **Credential fields per preset (`F13.acp-preset-credentials`).** In the Add editor, `control-openhands browser choose 'testid=agent-type-selector' 'ACP (external subprocess)'`, then for each of `Codex`, `Gemini CLI` and `Custom` run `control-openhands browser choose 'testid=agent-preset-selector' '<preset>'` and `control-openhands browser testids --hidden --filter settings-acp`: Codex lists `settings-acp-secret-OPENAI_API_KEY` (input), `-CODEX_AUTH_JSON` (textarea), `-OPENAI_BASE_URL`; Gemini CLI lists `-GOOGLE_APPLICATION_CREDENTIALS_JSON` (textarea), `-GOOGLE_CLOUD_PROJECT`, `-GOOGLE_CLOUD_LOCATION`, `-GOOGLE_GENAI_USE_VERTEXAI`, `-GEMINI_API_KEY`, `-GEMINI_BASE_URL`; Custom lists nothing and `browser eval "document.body.innerText.includes('Credentials')"` is `false`. For Gemini, `control-openhands browser wait 'testid=settings-acp-auth-checking' --state detached --timeout 15000`, then `browser testids --hidden --filter settings-acp-auth` has count `0` (no login, no stored credential); `browser eval "document.querySelector('[data-testid=settings-acp-secret-GEMINI_API_KEY]').type"` is `password`, `GOOGLE_CLOUD_PROJECT` is `text`. Screenshot `--feature F13.acp-preset-credentials --name gemini` after `browser scroll 'testid=settings-acp-secret-GOOGLE_APPLICATION_CREDENTIALS_JSON'`. Cancel (Codex shows `settings-acp-auth-configured` instead while `OPENAI_API_KEY` from `F13.acp-credentials` is still saved).
- **Menu keyboard (`F13.menu-keyboard`).** Run `control-openhands browser goto /settings/agents`. It needs a non-active row: run `control-openhands browser click 'testid=add-agent-profile'`, `control-openhands browser fill 'testid=agent-profile-name-input' QA_kb`, `control-openhands browser click 'testid=save-agent-profile-btn'` and `control-openhands browser wait-text 'Profile "QA_kb" created' --timeout 10000`. Open its menu with `control-openhands browser click 'testid=agent-profile-row >> has-text=QA_kb >> testid=agent-profile-menu-trigger'` and right away run `control-openhands browser eval "document.activeElement?.dataset?.testid"`, then `control-openhands browser press ArrowDown` and the same eval. Expected: `agent-profile-edit`, then `agent-profile-set-active` (opening the menu moves focus to its first item, as the LLM profile menu does in `F10.actions-menu`). Known failure: both evals read `agent-profile-menu-trigger`; focus stays on the trigger and ArrowDown does nothing (#18060). Then run `control-openhands browser focus 'testid=agent-profile-edit'`, and `control-openhands browser press ArrowDown` followed by that eval four times: `agent-profile-set-active`, `agent-profile-delete`, `agent-profile-edit`, `agent-profile-set-active`; `browser press ArrowUp` returns to `agent-profile-edit`. `control-openhands browser press Escape` closes the menu (`control-openhands browser count 'testid=agent-profile-actions-menu'` is `0`); reopen it, run `control-openhands browser focus 'testid=agent-profile-delete'` and `control-openhands browser press Tab`: closed; reopen it and run `control-openhands browser mouse-click 900 600`: closed. Active row: open its menu with `control-openhands browser click '[data-testid=agent-profile-row]:has([data-testid=agent-profile-active-badge]) >> testid=agent-profile-menu-trigger'` (`control-openhands browser snapshot 'testid=agent-profile-actions-menu'` shows `menuitem "Set as active" [disabled]`), run `control-openhands browser focus 'testid=agent-profile-edit'`, then `control-openhands browser press ArrowDown` and the eval, then `control-openhands browser press ArrowUp` and the eval. Expected: `agent-profile-delete` (the disabled **Set as active** is skipped), then `agent-profile-edit`. Known failure: `agent-profile-edit` (ArrowDown tries to focus the disabled item, which cannot take focus), then `agent-profile-delete` (ArrowUp wraps) (#18060). With the menu still open, run `control-openhands browser focus 'testid=agent-profile-edit'` and `control-openhands browser press Enter`: `control-openhands browser text 'testid=agent-profile-editor-title'` is `Edit agent profile`. Leave the editor with `control-openhands browser click 'testid=cancel-agent-profile-btn'` (`browser count 'testid=add-agent-profile'` is `1`). Delete `QA_kb`: reopen its menu, `control-openhands browser click 'testid=agent-profile-delete'`, `control-openhands browser click 'testid=delete-agent-profile-confirm'` and `control-openhands browser wait-text 'Profile "QA_kb" deleted' --timeout 10000`.
- **Delete (`F13.delete`).** Run `control-openhands browser click 'testid=agent-profile-row >> has-text=QA_acp_renamed >> testid=agent-profile-menu-trigger'`, `control-openhands browser click 'testid=agent-profile-delete'`; `control-openhands browser text 'role=dialog'` reads `Delete Profile` and `Are you sure you want to delete the profile "QA_acp_renamed"? This action cannot be undone.` `control-openhands browser click 'role=dialog >> role=button[name="Cancel"]'` keeps the row (count `1`). Repeat and `control-openhands browser click 'testid=delete-agent-profile-confirm'`, `browser wait-text 'Profile "QA_acp_renamed" deleted' --timeout 10000`, `browser reload`: count `0`. Delete the active `QA_oh` the same way: after `browser reload`, `browser count 'testid=agent-profile-active-badge'` is `0` and `api GET /api/agent-profiles` has `active_agent_profile_id` `null`. Delete `QA_codex` and `default`: the list again shows one row, `default` / `deepseek-flash` / `Default`, with a new id (the server re-seeds it).
@@ -86,6 +86,6 @@ Preconditions:
- ACP credentials are global secrets, not profile fields: cancelling the editor saves nothing, but saving any ACP profile with a typed credential writes it to Settings → Secrets (F14) for every conversation.
- **Choose secrets** on an ACP profile also selects provider secret names that are not saved (`CODEX_AUTH_JSON`, `OPENAI_BASE_URL`); they show as switches without descriptions.
- The empty state (`agent-profiles-empty`) and the load-error state (`agent-profiles-load-error`) are not reachable on a local backend: deleting the last profile re-seeds `default`, and with the agent-server stopped the app swaps to **Manage backends** after a reload, or keeps the cached list without one.
-- A launch refused for a dangling MCP ref shows two identical raw-JSON toasts for one submit and clears the composer, so the typed prompt is lost (reported as a product bug; see the evidence under `F13.mcp-scope`) (#17936).
+- The refused-launch toast text comes from the Agent Server and changes between versions (`MCP server(s) not configured: <name>` on 1.53.0): assert that one toast names the server and the prompt stays, not the exact wording.
- Row-menu keyboard: on the active row, ArrowDown from **Edit** keeps focus on Edit because the handler moves focus to the next item without skipping the disabled **Set as active**, and a disabled button cannot take focus; reach **Delete** with ArrowUp. Opening the menu also leaves focus on the trigger (`F13.menu-keyboard`, an accessibility bug). Both are open as #18060. The LLM profile menu on Settings → LLM had the same defects: #18019 fixed only that menu (`F10.actions-menu`) and closed #17934, so #17934 being closed says nothing about this menu.
- #18035 (closed #17939) gave the Add editor its own description and translated the Parallel tool calls field. A checkout without it shows the LLM page's `Configure your LLM settings below, then click Save to create this profile.` and logs `[i18n] Missing translation for key "SCHEMA$TOOL_CONCURRENCY_LIMIT$LABEL"` / `$DESCRIPTION` whenever the editor renders.
diff --git a/.agents/skills/verify-openhands/references/feature-map/F16-application-settings.md b/.agents/skills/verify-openhands/references/feature-map/F16-application-settings.md
index f9d8341a17..9b6cdc3de5 100644
--- a/.agents/skills/verify-openhands/references/feature-map/F16-application-settings.md
+++ b/.agents/skills/verify-openhands/references/feature-map/F16-application-settings.md
@@ -89,5 +89,5 @@ Preconditions:
- `browser eval` wraps its argument as an expression: statements separated by `;` fail with `SyntaxError: Unexpected token ';'`; wrap them in `(() => { ...; return x; })()`.
- With `service stop agent-server`, a `browser reload` of `/settings/app` shows the backend-unavailable screen (`agent-server-onboarding-screen`, Manage backends), not the form: stop the service only after the page is loaded, and `restart` afterwards.
- Known product bugs (repro candidates): git identity never reaches the agent (#17899); switches are not keyboard reachable or announced (#17900); a failed save discards the user's edits (`F16.save-states`) (#17927).
-- Known issue #17898: a build with `VITE_DO_NOT_TRACK=1` still initializes PostHog and loads scripts from the telemetry host, also with analytics off (`F16.analytics`).
+- The harness builds with `VITE_DO_NOT_TRACK=1`, so PostHog never starts: `browser network --filter 'posthog|z\.openhands\.dev'` reports `total` `0`, also after analytics consent is granted (#18086). A browser-only Do Not Track setting, and a non-DNT build where consent starts PostHog, cannot be driven with the harness (`F16.analytics`).
- The title model's clear button has no test id: the recipe's xpath relies on DOM nesting to skip the unnamed `Show suggestions` button. If both ever match, Playwright's strict mode fails the click instead of pressing the wrong one; report it as harness drift.
diff --git a/.agents/skills/verify-openhands/references/feature-map/F17-mcp-servers.md b/.agents/skills/verify-openhands/references/feature-map/F17-mcp-servers.md
index 527526ee2b..01c992287a 100644
--- a/.agents/skills/verify-openhands/references/feature-map/F17-mcp-servers.md
+++ b/.agents/skills/verify-openhands/references/feature-map/F17-mcp-servers.md
@@ -99,6 +99,7 @@ Preconditions:
## Gotchas
+- Server errors on MCP mutations (a 404 on a server that is already removed, a 502 while the Agent Server is down) toast the server's message (`MCP server '<id>' was not found`), or `An error occurred` when the body has none (#18051). Expected: one toast per failed action. Known failure (reproduced 2026-10-08): a failed delete from the editor or a failed card toggle shows two identical toasts, one from the caller and one from the global mutation handler (#18181). Count them with `click ... --observe 'role=status'` or `browser toasts --history`.
- Desktop `/customize` is a client-side redirect: `browser url` may still read `/customize` for a moment; use `wait-url '/mcp(\?|$)'`.
- From 768 to 1023 px the sidebar rail stays and the top bar is gone, so a Customize detail page shows neither the aside nor a Back chevron; the rail's **Customize** link (`sidebar-skills-link`, unscoped at this width) returns to the hub.
- On a phone the drawer and the hidden desktop rail both render `sidebar-skills-link`; scope it with `testid=sidebar-mobile-drawer >> ...` or the click fails with a strict-mode error, even though `browser testids` lists it once.
diff --git a/.agents/skills/verify-openhands/references/feature-map/F21-automations-dashboard.md b/.agents/skills/verify-openhands/references/feature-map/F21-automations-dashboard.md
index aa9c5567bb..c3e207845f 100644
--- a/.agents/skills/verify-openhands/references/feature-map/F21-automations-dashboard.md
+++ b/.agents/skills/verify-openhands/references/feature-map/F21-automations-dashboard.md
@@ -26,7 +26,7 @@ Source: `src/routes/automations-list.tsx`, `src/components/features/automations/
- `F21.add-menu`: the header **Add Automation** menu offers **Create Automation** and **Import automation**; Create Automation opens the **How to create an automation** dialog (instructions, docs link, Create Automation), which X and Escape close.
- `F21.empty-state`: with zero automations the page shows **No automations configured**, the "Create an automation" instructions, a docs link, **Create Automation** and the Recommended automations rail; the view toggle is disabled.
- `F21.empty-rail`: a Recommended automations card on the empty dashboard opens its template setup at `/automations/new/<template-id>` (F22 owns the setup flow).
-- `F21.overview-tiles`: four tiles summarize the loaded org list: Automations (`N active`), Needs attention (`Latest run failed` or `No latest-run failures`), Total runs and Average duration.
+- `F21.overview-tiles`: four tiles summarize the loaded org list: Automations (`N active`), Needs attention (`Latest run failed` or `No latest-run failures`; an enabled automation counts when its latest run is Failed or its task outcome is `failed` or `blocked`, while Partial and Needs review do not count), Total runs and Average duration.
- `F21.search`: the search box narrows the visible automations client-side by name, prompt, repository or model; the tiles do not change.
- `F21.filters`: the **Filters** popover filters by status (All / Active / Needs attention / Disabled) and trigger (All / Scheduled / Event-driven), counts non-default choices in a badge and offers **Reset all**; it stays open while the user changes several choices.
- `F21.sort`: Sort (Latest run / Most runs / Name) orders automations inside each group and counts as a non-default choice.
diff --git a/.agents/skills/verify-openhands/references/feature-map/F23-automation-detail.md b/.agents/skills/verify-openhands/references/feature-map/F23-automation-detail.md
index 25b74d8080..8372d09066 100644
--- a/.agents/skills/verify-openhands/references/feature-map/F23-automation-detail.md
+++ b/.agents/skills/verify-openhands/references/feature-map/F23-automation-detail.md
@@ -28,7 +28,7 @@ Source: `src/routes/automation-detail.tsx`, `src/components/features/automations
- `F23.run-now-error`: a failed dispatch shows exactly one error toast with the API message; when the automation is gone (`Automation not found`), the page then shows the **Automation not found** state.
- `F23.run-status-polling`: while a run is Pending or Running the log refetches every 3 s, so Pending → Running → Successful/Failed, the summary, the cost and the conversation link appear without a reload; the Activity card's **Last run** updates too.
- `F23.activity-log`: **Activity Log** shows **No activity yet** with Export disabled before the first run, then one row per run (newest first): start time, summary, cost (`$0.0000` format, `run-cost`), a logs icon, status badge (`run-status-icon-<status>`).
-- `F23.run-task-outcome`: a Completed run whose agent finished with a task outcome other than success shows that outcome instead of **Successful**: `blocked` and `partial_success` read **Blocked** / **Partial** with `run-status-icon-warning`, an unrecognised status reads **Needs review** (`run-status-icon-needs-review`); the row summary is the agent's `outcome_summary`, and the Logs dialog's Task section repeats it.
+- `F23.run-task-outcome`: a Completed run whose agent finished with a task outcome other than success shows that outcome instead of **Successful**: `blocked` and `partial_success` read **Blocked** / **Partial** with `run-status-icon-warning`, `unknown` and any unrecognised status string read **Needs review** (`run-status-icon-needs-review`), and a finish response without a string `status` (summary only, custom fields only, a non-string status, or not an object) is expected to read **Successful**, and an `outcome_summary`, when it has one, is still shown (#17682); the row summary is the agent's `outcome_summary`, and the Logs dialog's Task section repeats it.
- `F23.activity-log-more`: with more than 20 runs a **Load more** button grows the page by 20.
- `F23.run-no-conversation`: a finished run without a conversation reads **No Conversation**; only a script run (no agent) gets "No conversation — this run executed a script. Use View logs for its output."
- `F23.run-linked-conversation`: a run row with a conversation is a link labelled `View conversation for run at <time>` to `/conversations/<conversation_id>`, whose title is `<automation name> — <UTC timestamp>`.
@@ -96,7 +96,7 @@ Preconditions:
- **Cleared time (`F23.edit-time-cleared`).** Reopen Edit, `control-openhands browser fill 'testid=edit-automation-time' ''`, `control-openhands browser network --clear`, click Save. Expected: an inline message and the dialog stays open. Today the dialog closes as if saved, `browser network --last 20` shows no PATCH and the schedule stays `30 10 * * 3`.
- **Custom cron (`F23.edit-cron`).** Open QA_F23 Fail and Edit. `control-openhands browser value 'testid=edit-automation-frequency'` is `Custom` and `control-openhands browser enabled 'testid=edit-automation-frequency'` and `... 'testid=edit-automation-time'` are `false`; `testid=edit-automation-cron` holds `0 0 1 1 *` (placeholder `*/10 * * * *`). Fill the cron with `not a cron`, click Save, and `control-openhands browser text 'testid=edit-automation-cron >> xpath=ancestor::label[1]'` adds `Enter a valid cron expression`; with `0 0 31 2 *` it reads `This cron expression will never run`. Fill `0 0 2 1 *` and `testid=edit-automation-timeout` with `1` (this makes the next run fail), Save, `browser wait-text 'Automation updated'`; after a reload the Configuration shows `0 0 2 1 *`.
- **Failed run, its row and Debug with OpenHands (`F23.run-status-polling`, `F23.run-no-conversation`, `F23.run-logs-modal`, `F23.debug-with-openhands`).** On QA_F23 Fail (timeout `1` from the previous bullet) click `role=button[name="Run now"]` and `control-openhands browser wait-text 'Automation dispatched'`. The run stays Running for about 3-4 minutes and ends `FAILED` (poll `control-openhands api GET /api/automation/v1/<id>/runs`; drive the event automation bullets meanwhile). Then `control-openhands browser goto /automations`, open QA_F23 Fail, `control-openhands browser wait 'testid=automation-activity-log >> testid=run-status-icon-failed'` and `control-openhands browser text 'testid=automation-activity-log'`: the newest row reads `<time>`, `Timed out: command timed out or was killed`, `Failed`. Expected beside the time: `No Conversation` (this is a prompt automation); today it reads `No conversation — this run executed a script. Use View logs for its output.` Run `control-openhands browser click 'testid=automation-activity-log >> title=View logs >> nth=0'` and `control-openhands browser snapshot 'role=dialog'`: `Run` `FAILED`, `Task` `No task outcome reported.`, `System` `Error: Timed out: command timed out or was killed` and `Status detail: ...`, the Output tab with the `[setup] Fetching SDK version ...` lines, and button `Debug with OpenHands`. Screenshot with `--feature F23.debug-with-openhands --name failed-logs`. `control-openhands browser click 'testid=debug-automation-button' --expect-url '/conversations/'` opens a new conversation; `control-openhands conversation events <conversation id from browser url> --kinds MessageEvent` starts `The scheduled automation "QA_F23 Fail" failed during a run. Please investigate the error and fix the root cause.`, and `control-openhands browser eval "document.body.innerText.includes('Timed out: command timed out or was killed')"` is `true` (the page also shows the run id). The agent then works on that prompt with the active profile.
-- **Task outcome badge (`F23.run-task-outcome`).** Arrange (API, arrange only) `control-openhands api POST /api/automation/v1/preset/prompt --write --data '{"name":"QA_F23 Blocked","prompt":"Do not run any tools. Call the finish tool right away with status \"blocked\" and outcome_summary \"QA blocked on purpose\".","trigger":{"type":"cron","schedule":"0 0 1 1 *","timezone":"UTC"},"enabled":true}'` (a good thing to do while the Fail run is still running). Open QA_F23 Blocked, click `role=button[name="Run now"]`, and poll `control-openhands browser text 'testid=automation-activity-log'` until it leaves Running (about 35 s): `<time>`, `QA blocked on purpose`, a cost such as `$0.0016`, `Blocked`; `control-openhands browser testids 'testid=automation-activity-log'` lists `run-status-icon-warning` (not `-completed`) although `api GET /api/automation/v1/<id>/runs` has `status` `COMPLETED` and `run_metadata.finish_tool_response.status` `blocked`. `control-openhands browser click 'testid=automation-activity-log >> title=View logs'` and `browser snapshot 'role=dialog'`: `Run` `COMPLETED`, `Task` `Blocked` / `QA blocked on purpose` / `Task metadata` `{ "message": ... }`. Screenshot with `--feature F23.run-task-outcome --name blocked`, Escape. `partial_success` (**Partial**) and an unknown status (**Needs review**, `run-status-icon-needs-review`) follow the same path; only `blocked` was driven.
+- **Task outcome badge (`F23.run-task-outcome`).** Arrange (API, arrange only) `control-openhands api POST /api/automation/v1/preset/prompt --write --data '{"name":"QA_F23 Blocked","prompt":"Do not run any tools. Call the finish tool right away with status \"blocked\" and outcome_summary \"QA blocked on purpose\".","trigger":{"type":"cron","schedule":"0 0 1 1 *","timezone":"UTC"},"enabled":true}'` (a good thing to do while the Fail run is still running). Open QA_F23 Blocked, click `role=button[name="Run now"]`, and poll `control-openhands browser text 'testid=automation-activity-log'` until it leaves Running (about 35 s): `<time>`, `QA blocked on purpose`, a cost such as `$0.0016`, `Blocked`; `control-openhands browser testids 'testid=automation-activity-log'` lists `run-status-icon-warning` (not `-completed`) although `api GET /api/automation/v1/<id>/runs` has `status` `COMPLETED` and `run_metadata.finish_tool_response.status` `blocked`. `control-openhands browser click 'testid=automation-activity-log >> title=View logs'` and `browser snapshot 'role=dialog'`: `Run` `COMPLETED`, `Task` `Blocked` / `QA blocked on purpose` / `Task metadata` `{ "message": ... }`. Screenshot with `--feature F23.run-task-outcome --name blocked`, Escape. `partial_success` (**Partial**, `run-status-icon-warning`) and `unknown` (**Needs review**, `run-status-icon-needs-review`) follow the same path with the same prompt shape. The normal automation 1.19.0 prompt/plugin presets configure SDK 1.53.0 FinishTool with the required `TaskOutcome.status`, limited to `success`, `partial_success`, `blocked`, `failed` and `unknown`; SDK custom response schemas are a separate producer boundary. Its normal prompt path therefore does not establish the new fallback for a finish response without a string status. That positive boundary needs a genuine completed run from a legacy or custom-schema producer whose real finish arguments have that shape; a run with no finish metadata checks only the ordinary Completed fallback. Arbitrary unrecognised strings and summary retention on a failed run need the corresponding genuine producer too. Until available, record those checks as blocked and do not treat injected run metadata or mocked LLM output as live proof (#17682).
- **Event automation (`F23.prompt-collapse`, `F23.configuration-event`, `F23.plugins-repo`, `F23.export`).** Open QA_F23 Event. `control-openhands browser bbox 'testid=automation-prompt-content'` is 240 px high, `testid=automation-prompt-fade` is present and `control-openhands browser text 'testid=automation-prompt-toggle'` is `View More`; screenshot with `--feature F23.prompt-collapse --name collapsed`. Click the toggle: height 360, no fade, text `View Less`; click again to collapse. `control-openhands browser text 'role=heading[name="Configuration"] >> xpath=ancestor::div[2]'` reads `Repositories qa-example/qa-repo main`, `Trigger Event`, `Event Source github`, `Event Type pull_request.opened`, `Filter pull_request.draft == `false` && pull_request.base.ref == re…`, `Show more`, `LLM profile Active profile`. `control-openhands browser click 'role=button[name="Show more"]'` shows the full filter and `control-openhands browser attr 'role=button[name="Show less"]' aria-expanded` is `true`. `control-openhands browser text 'testid=automation-repository'` is `qa-example/qa-repo` / `main` (the fixture's `https://github.com/qa-example/qa-repo` as `owner/repo`, with its branch badge) and `control-openhands browser text 'role=heading[name="Plugins"] >> xpath=ancestor::div[2]'` is `Plugins` / `github:qa-example/qa-plugin`; screenshot with `--feature F23.plugins-repo --name event-repo-plugins`. Export keeps them: `control-openhands browser click 'role=button[name="Automation actions"]'`, `control-openhands browser click 'role=list >> has-text=Tarball >> role=button[name="Export"]'` and `control-openhands browser downloads --last 1 --contains '"branch": "main"'` (`qa-f23-event.automation.json`, `contains` `true`); `--contains '"repository": "https://github.com/qa-example/qa-repo"'` and `--contains 'github:qa-example/qa-plugin'` are `true` too (the `--inspect` head ends inside the long prompt).
- **Event trigger in Edit (`F23.edit-event-readonly`).** On QA_F23 Event open Edit: `control-openhands browser count 'testid=edit-automation-frequency'` is `0` and `control-openhands browser text 'role=form[name="Edit automation"] >> text=Event Source >> xpath=ancestor::div[2]'` reads `Trigger Event / Event Source github / Event Type pull_request.opened / Filter <full filter>`. Screenshot with `--feature F23.edit-event-readonly --name event`, then Cancel.
- **Phone (`F23.phone`).** Run `control-openhands browser viewport phone`, open QA_F23 Pong, `control-openhands browser bbox 'role=heading[name="QA_F23 Pong"] >> xpath=ancestor::div[3]'` (`insideViewport` `true`, `pageHorizontalOverflow` `false`) and `control-openhands browser screenshot --feature F23.phone --name detail` (the name and Run now wrap). Open Edit, then `control-openhands browser bbox 'role=form[name="Edit automation"] >> xpath=..'` and `control-openhands browser bbox 'testid=edit-automation-save'`. Expected: both `insideViewport` `true`. Today the dialog is about 940 px high with `y` about `-48`, Save sits at `y` 831 (`insideViewport` `false`), the X at a negative `y` (about -30), and `control-openhands browser scroll 'testid=edit-automation-save'` cannot move it; screenshot with `--feature F23.phone --name edit-weekly`. Cancel and `control-openhands browser viewport desktop`.
@@ -108,6 +108,7 @@ Preconditions:
## Gotchas
+- The Logs dialog's panel should keep its content reachable at every width (`F23.run-logs-modal`). Known failure (reproduced 2026-10-08): with a long task summary (the dialog drops the `outcome_summary` line breaks, so ask for about 1,500 characters, for example 12 lines of about 120 characters), the panel (`max-h-[80vh]`) does not scroll, and at `phone` the Output/Error tabs and the Output box sit below the viewport (`browser bbox 'role=dialog >> role=tab[name="Error"]'` `insideViewport` `false`, and `browser scroll` cannot reach it). At `desktop` that run still fits; about twice as much text pushes the Output box up to about 200 px below the panel. A short run fits at `desktop`; at `phone` even a ~200-character summary with metadata leaves the Output box about 15 px below the panel (#18173). `browser bbox 'role=dialog'` measures the full-screen wrapper, not the panel: measure the panel with `browser eval`.
- The detail page has no `main` landmark: `browser snapshot 'role=main'` times out. Snapshot the page, or scope by section headings (`role=heading[name="Configuration"] >> xpath=ancestor::div[2]`).
- The kebab menu has no test ids; `role=list >> has-text=Tarball` scopes the detail kebab (the dashboard kebab has no Tarball, so F21 uses `has-text=Export`).
- Both the X and the footer button of the Edit dialog are named **Cancel**; use `testid=edit-automation-cancel` for the footer and `role=form[name="Edit automation"] >> xpath=.. >> role=button[name="Cancel"] >> nth=0` for the X. The dialog has no `role=dialog`.
diff --git a/.agents/skills/verify-openhands/references/feature-map/F24-git-sync.md b/.agents/skills/verify-openhands/references/feature-map/F24-git-sync.md
index d562c9e930..7db86c6484 100644
--- a/.agents/skills/verify-openhands/references/feature-map/F24-git-sync.md
+++ b/.agents/skills/verify-openhands/references/feature-map/F24-git-sync.md
@@ -64,7 +64,7 @@ Preconditions:
- **Configure and Save and sync (`F24.save-and-sync`).** Run `control-openhands browser fill 'testid=git-sync-repo-url-input' "$OH_VERIFY_RUN/workspace/qa-sync-remote"`, `control-openhands browser fill 'testid=git-sync-branch-input' qa-sync`, `control-openhands browser fill 'testid=git-sync-path-input' qa-automations`, then `control-openhands browser click 'testid=git-sync-save-and-sync-button' --observe 'testid=git-sync-activity-row' --observe-ms 10000`. The observation goes `Syncing... started 0s ago` → `Sync complete` within a few seconds; `browser count 'testid=git-sync-check-failure'` and `browser count 'testid=git-sync-error-banner'` are `0` (a successful cycle clears the last error). The toast `Git Sync settings saved.` also fires, but it is gone before a 10 s observation ends; to see it, run `control-openhands browser wait-text 'Git Sync settings saved.' --timeout 5000` right after the click instead of `--observe`. The card text (as in Unconfigured card) shows `<repo-path>`, `qa-sync`, `qa-automations`, a 7-character commit and `Last synced / Ns ago`. `git -C <repo-path> log --oneline qa-sync` shows the fixture's `Initial fixture commit` (the cycle created the branch).
- **Sync a changed automation (`F24.sync-now`).** Create `QA_F24 Sync` (Preconditions), `control-openhands browser reload`, then `control-openhands browser text 'text=Pending changes >> xpath=ancestor::div[1]/..'` (`Pending changes / 1`) and `control-openhands browser attr 'text=Pending changes >> xpath=ancestor::div[1]/.. >> span.text-warning' class` (`text-warning`). Screenshot with `control-openhands browser screenshot --feature F24.sync-now --name pending`. Run `control-openhands browser click 'testid=git-sync-now-button' --observe 'testid=git-sync-activity-row' --observe-ms 8000`: `Syncing... / started 0s ago / 1 pending`, then `control-openhands browser text 'testid=git-sync-activity-row'` is `Sync complete` and Pending changes reads `0`. `git -C <repo-path> log --oneline qa-sync` has a new `Sync automations from agent server` commit whose short hash matches the card's Last synced commit, and `git -C <repo-path> ls-tree -r --name-only qa-sync` lists `qa-automations/qa-f24-sync/automation.yaml` and `qa-automations/qa-f24-sync/tarball/...`.
- **Commit author (`F24.author`).** Run `control-openhands browser fill 'testid=git-sync-author-email-input' not-an-email`, `control-openhands browser network --clear`, `control-openhands browser click 'testid=git-sync-save-button'`, then `control-openhands browser eval "document.querySelector('[data-testid=git-sync-author-email-input]').validationMessage"` (`Please include an '@' in the email address. 'not-an-email' is missing an '@'.`); `control-openhands browser network` lists no `git-sync/config` request. Fill `testid=git-sync-author-name-input` with `'QA F24 Bot'` and `testid=git-sync-author-email-input` with `[email protected]`, click Save, `control-openhands browser wait-text 'Git Sync settings saved.' --timeout 10000`, `control-openhands browser reload`; `control-openhands browser value 'testid=git-sync-author-name-input'` is `""` (the fields never show the stored author). Mark the automation changed (PATCH `{"enabled":false}`), `control-openhands browser reload`, click `testid=git-sync-now-button`, `control-openhands browser wait '[data-testid=git-sync-activity-row]:not([data-state=running])' --timeout 30000`; then `git -C <repo-path> log -1 --format='%an <%ae>' qa-sync` is `QA F24 Bot <[email protected]>`.
-- **Encryption key (`F24.encryption`).** `control-openhands browser attr 'testid=git-sync-encryption-key-input' placeholder` is `No encryption key set`. Fill it with `qa-f24-dummy-key`, click Save (no `Checking repository...`: the key is not checked), wait for `Git Sync settings saved.`, `control-openhands browser reload`: `browser text 'testid=git-sync-encryption-pill'` is `Encrypted`, the placeholder is `An encryption key is currently set` and the input value is `""`. Mark the automation changed (PATCH `{"enabled":true}`), reload, click **Sync now** and wait as in Commit author; `git -C <repo-path> show qa-sync:qa-automations/qa-f24-sync/automation.yaml | head -c 20` starts with `gAAAAA` (ciphertext, not YAML). Then fill the key input with any text, run `control-openhands browser click 'testid=git-sync-clear-encryption-key-switch >> xpath=ancestor::label'`: `control-openhands browser enabled 'testid=git-sync-encryption-key-input'` is `false` and its value is `""`. Click Save, wait for the toast, reload: the pill is `Not encrypted`, the placeholder `No encryption key set`, and the clear switch is unchecked again.
+- **Encryption key (`F24.encryption`).** `control-openhands browser attr 'testid=git-sync-encryption-key-input' placeholder` is `No encryption key set`. Fill it with `qa-f24-dummy-key`, click Save (no `Checking repository...`: the key is not checked), wait for `Git Sync settings saved.`, `control-openhands browser reload`: `browser text 'testid=git-sync-encryption-pill'` is `Encrypted`, the placeholder is `An encryption key is currently set` and the input value is `""`. Before changing the automation, run `control-openhands api GET /api/automation/v1/git-sync/status`, record `git -C <repo-path> rev-parse qa-sync`, click **Sync now** and wait as in Commit author, then read the head again and `git -C <repo-path> show qa-sync:qa-automations/qa-f24-sync/automation.yaml | head -c 20`. Expected: the key save alone causes a new commit and ciphertext (`gAAAAA`); known failure #551: `dirty_count` is `0`, the head is unchanged and the export stays plaintext. Record this outcome before any PATCH. Continue the separate dirty-export check: mark the automation changed (PATCH `{"enabled":true}` if the Commit author bullet left it disabled, otherwise `{"enabled":false}`; `api GET /api/automation/v1/git-sync/status` must show `dirty_count` ≥ 1), reload, click **Sync now** and wait as in Commit author; the same git read starts with `gAAAAA`. This PATCH arranges a dirty automation; its passing export does not prove the key-save re-export contract. Record the encrypted head, fill the key input with a different dummy key, Save, wait for the toast, reload and **Sync now** without changing the automation. Expected: the head and ciphertext change for the new key; known failure #551: `dirty_count` stays `0` and the head and ciphertext remain unchanged. If that failure occurs, arrange ciphertext under the new key with a separate enabled-state PATCH and sync before the clear test; do not count that repair as a key-rotation pass. Then fill the key input with any text, run `control-openhands browser click 'testid=git-sync-clear-encryption-key-switch >> xpath=ancestor::label'`: `control-openhands browser enabled 'testid=git-sync-encryption-key-input'` is `false` and its value is `""`. Click Save, wait for the toast, reload: the pill is `Not encrypted`, the placeholder `No encryption key set`, and the clear switch is unchecked again. Record the encrypted head, read `git-sync/status`, click **Sync now** and wait without changing the automation, then compare the head and exported file. Expected: a new commit contains plaintext; known failure #551: `dirty_count` is `0`, the head is unchanged and ciphertext remains despite the `Not encrypted` pill. Repeat the non-dirty set, rotate and clear checks at `browser viewport phone`, arranging plaintext before set and ciphertext before rotate/clear; record desktop and phone separately with the actual selected backend in each evidence entry.
- **Access token (`F24.token`).** `control-openhands browser attr 'testid=git-sync-token-input' type` is `password` and the placeholder `Leave blank to keep the current token`. Fill it with `qa-dummy-token`, run `control-openhands browser network --clear`, click Save with `--observe 'testid=git-sync-save-button' --observe-ms 2000` (shows `Checking repository...`), wait for the toast; `control-openhands browser network --last 6` lists `/api/automation/v1/git-sync/check` then `/api/automation/v1/git-sync/config`. After reload the token input is `""`. Run `control-openhands browser click 'testid=git-sync-clear-token-switch >> xpath=ancestor::label'`; `browser enabled 'testid=git-sync-token-input'` is `false`. Click Save, wait for the toast, reload; `browser eval "document.querySelector('[data-testid=git-sync-clear-token-switch]').checked"` is `false`.
- **Interval (`F24.interval`).** Fill `testid=git-sync-interval-input` with `300`, Save, wait for the toast, reload: the card's `Sync every (seconds)` field reads `Every 300s` (`control-openhands browser text 'role=heading[name="Sync Status"] >> xpath=ancestor::div[2]'`) and the input value is `300`. Fill it with `''`, Save, reload: `Manual only` and input `0`. Fill `-5` and click Save: `browser eval "document.querySelector('[data-testid=git-sync-interval-input]').validationMessage"` is `Value must be greater than or equal to 0.`; reload to drop the draft.
- **Pause and resume (`F24.pause`).** Click `testid=git-sync-enabled-switch >> xpath=ancestor::label`; `browser enabled 'testid=git-sync-save-and-sync-button'` is `false`. Run `control-openhands browser network --clear`, click Save, wait for the toast; `control-openhands browser network` lists no `git-sync/check`. After reload the pill is `Disabled`, `enabled 'testid=git-sync-now-button'` is `false` and the card still shows `<repo-path>`; screenshot `--feature F24.pause --name disabled`. The switch's help text (`control-openhands browser text 'testid=git-sync-enabled-switch >> xpath=ancestor::label/following-sibling::p'`) is `Sync is on as soon as a repository is configured. Turn this off to pause syncing without losing the configuration.` Click the switch label again, Save, wait for the toast: the pill is `Enabled`.
@@ -92,7 +92,7 @@ Preconditions:
- The activity row (`git-sync-activity-row`, `data-state` `running`/`succeeded`/`failed`) is page state: it disappears on reload and does not appear for a background cycle that starts and ends between two idle polls (15 s). Assert background cycles through the commit hash, not the row.
- Toasts (`Git Sync settings saved.`, `Enable Git Sync before triggering a sync.`) last a few seconds: read them with `browser wait-text` immediately after the click, never after a long `--observe` window.
- Save's label cycles `Save Changes` → `Checking repository...` (only when a checked field changed) → `Saving...` → `Save Changes` in about 100 ms against a local repo; `--observe 'testid=git-sync-save-button'` records it.
-- Saving an encryption key does not re-encrypt what is already in the repository: files stay readable YAML until each automation changes and is exported again (observed; the help text says files are encrypted "before they are committed") (OpenHands/automation#551).
+- Expected: setting, rotating or clearing an encryption key re-exports every automation: the next sync rewrites plaintext as ciphertext (`gAAAAA…`), rewrites ciphertext with the new key, or restores plaintext after clearing. Known failure (reproduced 2026-10-08, automation 1.19.0, desktop and phone, selected backend Local): each key-only save leaves `dirty_count` at `0`; **Sync now** reports `Sync complete` without a new commit. Setting a key leaves existing files plaintext, rotating retains the old ciphertext, and clearing retains ciphertext despite the `Not encrypted` pill. A separate automation change does export under the current key setting, but does not satisfy key-only re-export (OpenHands/automation#551, fixed by OpenHands/automation#563 after the 1.19.0 release; re-drive once `config/defaults.json` `versions.automation` includes it).
- Nothing on the page says whether a token is stored: the token placeholder is always `Leave blank to keep the current token`, and the author fields always reload blank. Prove author changes from the commit (`git log --format='%an <%ae>'`).
- The card's Repository value drops embedded credentials, as link text and as plain text: an http(s) URL loses its whole `user:token@` (a token alone in the user slot too), other schemes keep the user and lose only the password (`ssh://git@host:2222/...`), and the rest stays as configured. The Repository URL input and `GET /api/automation/v1/git-sync/status` still carry the credentials, so a screenshot of the form shows them. Never type a real token into the URL.
- The page has no Automate sub-navigation (Dashboard / Templates) and no command-menu entry; leave through **Back to Automations** (`role=link`, not a button).
diff --git a/.agents/skills/verify-openhands/references/feature-map/F25-backends-and-cloud.md b/.agents/skills/verify-openhands/references/feature-map/F25-backends-and-cloud.md
index 789395d535..de188e9c3d 100644
--- a/.agents/skills/verify-openhands/references/feature-map/F25-backends-and-cloud.md
+++ b/.agents/skills/verify-openhands/references/feature-map/F25-backends-and-cloud.md
@@ -31,7 +31,7 @@ Source: `src/components/features/backends/`, `src/contexts/active-backend-contex
- `F25.edit-backend`: the pencil opens "Edit backend" pre-filled (key masked) with a `Connected · Local v<version>` badge; empty name and invalid host show `Name is required` and `Enter a valid URL (e.g. http://localhost:8080)` and disable Save; Save re-tests the connection, keeps the modal open with `Could not connect to <host>` on failure, and persists on success.
- `F25.edit-cancel`: **Cancel** and the X in Edit backend close only the Edit modal and discard the draft; Manage backends stays open with the stored values.
- `F25.edit-escape`: Escape in the Edit modal should not discard the draft (the modal disables Escape). Known failure, see Gotchas.
-- `F25.health-status`: a backend that stops answering turns its dot red (`Disconnected`) within one 10 s probe; its Manage row reads `Disconnected (check URL or network)` with a red detail line and cannot be selected.
+- `F25.health-status`: a backend that stops answering turns its dot red (`Disconnected`) within one health probe (every 30 s for local and remote agent servers; Cloud backends every 5 min and not on window focus or reconnect, #18128); its Manage row reads `Disconnected (check URL or network)` with a red detail line and cannot be selected.
- `F25.recovery-gate`: reloading while the active backend is down shows only `agent-server-onboarding-screen` with Manage backends in recovery mode (no X, no Done, Escape ignored, primary **Add Backend**); choosing a healthy row restores the app.
- `F25.remove-backend`: the trash icon asks `Remove backend "<name>"? If it is active, the app will switch back to Local.`; Cancel keeps it, Confirm removes it and an active removed backend falls back to Local (BM-003).
- `F25.collapsed-entry`: with the rail collapsed, the backend icon's popover offers the same Add Backend and Manage Backends items, and both modals open.
@@ -43,6 +43,7 @@ Source: `src/components/features/backends/`, `src/contexts/active-backend-contex
- `F25.cloud-log-back-in`: a logged-out Cloud row shows `Logged out` and a **Log back in** button that reruns the device flow.
- `F25.cloud-settings-link`: with a Cloud backend active the gear next to the selector opens `<cloud host>/settings?org=<org>` in a new tab.
- `F25.cloud-sandbox-states`: Cloud conversations show waiting, archived and error sandbox states in chat.
+- `F25.cloud-org-suspended`: when a Cloud call made for the selected organization (`X-Org-Id`) fails with 403 and `detail` `Organization is suspended` or `User membership is suspended`, the app is replaced by `<org> is suspended. Contact your administrator to restore access.` (or `Your access to <org> is suspended. Contact your administrator to restore it.`), then `Switch to another workspace` and one button per other organization (`Personal Workspace` for the user's own). A button selects that organization and the app returns; with no other organization only the message shows. A reload clears the in-memory record. Blocked here: needs an OpenHands Enterprise instance with `ENABLE_SUPER_ADMIN` where a Super Admin suspended the organization or this member's membership, signed in as a non-Super-Admin member with that organization selected (#17988).
- `F25.locked-cloud`: a Canvas served with `--lock-to-cloud <url>` shows only the Cloud login (no close) on first run, and its selector footer reads **Reconnect to Cloud** with no add, edit or remove.
## How to get to it (user POV)
@@ -65,7 +66,7 @@ Preconditions:
- A second stack to add as a backend, started without a browser and never driven directly: `export OH_VERIFY_RUN_2=$(OH_VERIFY_RUN= control-openhands launch --new --build never --no-browser --print-run)`, then `control-openhands status --run "$OH_VERIFY_RUN_2"`; its `baseUrl` is `<second-url>` below and its key is `$OH_VERIFY_RUN_2/private/session-key`. It has no conversations.
- No backend named `QA_Second` or `QA_Renamed` exists (the selector lists only `Local`).
- Bullets run in order: Add creates `QA_Second`, Edit renames it to `QA_Renamed`, Remove deletes it.
-- Blocked here (no OpenHands Cloud account): approving the device flow, `F25.cloud-org-rows`, `F25.cloud-log-back-in`, `F25.cloud-settings-link`, `F25.cloud-sandbox-states`, `F25.share-publicly` (toggle), and `F25.locked-cloud`, which also needs a launcher flag (see Gotchas).
+- Blocked here (no OpenHands Cloud account): approving the device flow, `F25.cloud-org-rows`, `F25.cloud-log-back-in`, `F25.cloud-settings-link`, `F25.cloud-sandbox-states`, `F25.cloud-org-suspended` (also needs a suspended OpenHands Enterprise organization or membership), `F25.share-publicly` (toggle), and `F25.locked-cloud`, which also needs a launcher flag (see Gotchas).
- **Open the selector (`F25.selector-dropdown`).** From `/conversations` run `control-openhands browser click 'testid=backend-selector'` and `control-openhands browser snapshot 'testid=backend-selector'`. The snapshot shows `listbox` with `option "Connected Local"`, a separator, `button "Add Backend"` and `button "Manage Backends"`. Screenshot with `control-openhands browser screenshot --feature F25.selector-dropdown --name open`. Hover opens it too: `browser press Escape`, move the pointer away with `control-openhands browser hover 'testid=command-menu-trigger'` (hovering a selector the pointer is already on does nothing), `control-openhands browser hover 'testid=backend-selector'`, then the same snapshot shows `combobox "Local" [expanded]` and the two footer buttons.
- **Add Backend modal (`F25.add-backend-modal`).** Run `control-openhands browser click 'testid=add-backend-menu-item'` and `control-openhands browser snapshot 'testid=add-backend-modal'`: heading `Choose how you want to connect`, link `Compare Cloud, self-hosted, and Enterprise deployment options` (`/url: https://docs.openhands.dev/overview/introduction`, text `Learn more`) and tab `OpenHands Cloud ...` `[selected]` next to tab `Agent-server ...`. `control-openhands browser press Escape` leaves `browser count 'testid=add-backend-modal'` at `1`; `control-openhands browser click 'testid=add-backend-close'` makes it `0`.
@@ -83,7 +84,7 @@ Preconditions:
- **Edit validation and errors (`F25.edit-backend`).** Open Manage Backends, `control-openhands browser click 'testid=manage-backends-edit-QA_Second'`, then `browser value 'testid=edit-backend-host'` (`<second-url>`), `browser attr 'testid=edit-backend-api-key' type` (`password`) and `browser text 'testid=edit-backend-status'` (`Connected`, `·`, `Local`, `v1.50.1` on separate lines). Fill `edit-backend-name` with an empty string and `edit-backend-host` with `not a host`, then `browser focus 'testid=edit-backend-api-key'` and `browser snapshot 'testid=edit-backend-form'`: alerts `Name is required` and `Enter a valid URL (e.g. http://localhost:8080)`; `browser enabled 'testid=edit-backend-submit'` is `false`.
- **Escape in Edit (`F25.edit-escape`).** In the same Edit modal press `control-openhands browser press Escape`. Expected: the Edit modal stays (it disables Escape) or only it closes. Today `browser count 'testid=edit-backend-modal'` and `browser count 'testid=manage-backends-modal'` are both `0`: the whole stack closes and the draft is lost. Nothing was saved (`browser snapshot 'testid=backend-selector'` still reads `QA_Second`).
- **Edit and save (`F25.edit-backend`).** Reopen Manage Backends and the pencil. Fill `edit-backend-host` with `http://127.0.0.1:9`, `browser click 'testid=edit-backend-submit'`, `browser wait 'testid=edit-backend-error' --timeout 10000`: the text starts `Could not connect to http://127.0.0.1:9` and the modal stays. Fill the host back with `<second-url>` and `edit-backend-name` with `QA_Renamed`, click `edit-backend-submit`, then `control-openhands browser wait 'testid=edit-backend-modal' --state detached --timeout 10000`; `browser count 'testid=manage-backends-row-QA_Renamed'` is `1`. Click `manage-backends-done`, `browser reload`: the selector reads `QA_Renamed`.
-- **Health status (`F25.health-status`).** Run `control-openhands service stop agent-server --run "$OH_VERIFY_RUN_2"`, then on the open page `control-openhands browser wait 'testid=backend-selector >> role=status[name="Disconnected"]' --timeout 25000`. `browser click 'testid=backend-selector'` and `browser snapshot 'testid=backend-selector'` show `option "Disconnected QA_Renamed"` next to `option "Connected Local"`. In Manage Backends `browser text 'testid=manage-backends-status-QA_Renamed'` is `Disconnected (check URL or network)`, `testid=manage-backends-status-detail-QA_Renamed` repeats it with `Check that the backend URL is correct ...`, and `browser enabled 'testid=manage-backends-row-QA_Renamed >> role=button >> nth=0'` is `false`. An error toast with the same text also appears. Screenshot with `--feature F25.health-status --name manage-down`.
+- **Health status (`F25.health-status`).** With QA_Renamed the active backend (as the Edit bullet's reload leaves it; the closed selector shows only the active backend's dot), run `control-openhands service stop agent-server --run "$OH_VERIFY_RUN_2"`, then on the open page `control-openhands browser wait 'testid=backend-selector >> role=status[name="Disconnected"]' --timeout 40000`. `browser click 'testid=backend-selector'` and `browser snapshot 'testid=backend-selector'` show `option "Disconnected QA_Renamed"` next to `option "Connected Local"`. In Manage Backends `browser text 'testid=manage-backends-status-QA_Renamed'` is `Disconnected (check URL or network)`, `testid=manage-backends-status-detail-QA_Renamed` repeats it with `Check that the backend URL is correct ...`, and `browser enabled 'testid=manage-backends-row-QA_Renamed >> role=button >> nth=0'` is `false`. An error toast with the same text also appears. Screenshot with `--feature F25.health-status --name manage-down`.
- **Recovery gate (`F25.recovery-gate`).** Close the modal, `control-openhands browser reload`, then `control-openhands browser wait 'testid=manage-backends-modal' --timeout 20000`. `browser testids` lists `agent-server-onboarding-screen` and the Manage rows but no sidebar; `browser count 'testid=close-manage-backends-modal'` and `browser count 'testid=manage-backends-done'` are `0`, and `browser press Escape` leaves the modal (`count` `1`). `control-openhands browser click 'testid=manage-backends-row-Local >> role=button >> nth=0'` and `browser wait 'testid=agent-server-onboarding-screen' --state detached --timeout 15000` restore the app: selector `Local`, card count `1`. Screenshot the gate with `--feature F25.recovery-gate --name gate` before choosing.
- **Remove the active backend (`F25.remove-backend`).** Run `control-openhands restart --run "$OH_VERIFY_RUN_2"`, `browser click 'testid=backend-selector'`, `browser wait 'testid=backend-selector >> role=option[name="Connected QA_Renamed"]' --timeout 25000` and click that option (selector reads `QA_Renamed`). Open Manage Backends, `control-openhands browser click 'testid=manage-backends-remove-QA_Renamed'`; `browser text 'testid=confirmation-modal'` reads `Remove backend "QA_Renamed"? If it is active, the app will switch back to Local.` `control-openhands browser click 'testid=confirmation-modal >> role=button[name="Cancel"]'` keeps the row (`count 'testid=manage-backends-row-QA_Renamed'` `1`). Click the trash again, then `control-openhands browser click 'testid=confirmation-modal >> testid=confirm-button'`: the row count is `0`. Click Done and `browser reload`: the selector reads `Local`, `browser count 'testid=backend-selector >> role=option'` (dropdown open) is `1`, and the card count is `1`.
- **Add from Manage, Edit Cancel and X (`F25.manage-add`, `F25.edit-cancel`).** The second stack is running again after the previous bullet. Run `browser goto /conversations/<id>`, `browser wait 'testid=chat-interface'`, open the selector, click `manage-backends-menu-item`, then `control-openhands browser click 'testid=manage-backends-add'` and `control-openhands browser wait 'testid=add-backend-modal' --timeout 5000` (`visible`); `browser count 'testid=manage-backends-modal'` is `1` underneath. `browser click 'testid=add-backend-close'`: the Add count is `0` and the Manage count stays `1`. Click `manage-backends-add` again, `add-backend-option-agent-server`, fill `add-backend-name` with `QA_Second`, `add-backend-host` with `<second-url>` and `add-backend-api-key` with `--value-file "$OH_VERIFY_RUN_2/private/session-key"`, then `browser click 'testid=add-backend-submit' --expect-url '/conversations(\?|$)'`: the URL is `/conversations`, `count 'testid=add-backend-modal'` is `0`, `count 'testid=manage-backends-modal'` is still `1`, `count 'testid=manage-backends-row-QA_Second'` is `1` and the selector reads `QA_Second` (screenshot `--feature F25.manage-add --name after-add`). No consent prompt this time: it is stored on the second backend. Then `control-openhands browser click 'testid=manage-backends-edit-QA_Second'`, `browser fill 'testid=edit-backend-name' QA_Draft` and `control-openhands browser click 'testid=edit-backend-cancel'`: `count 'testid=edit-backend-modal'` `0`, `count 'testid=manage-backends-modal'` `1`, row `QA_Second` `1`, row `QA_Draft` `0`. Repeat with `control-openhands browser click 'testid=edit-backend-close'`: same counts, and reopening the pencil shows `browser value 'testid=edit-backend-name'` `QA_Second`; leave with `edit-backend-cancel`. Remove it again: `browser click 'testid=manage-backends-remove-QA_Second'`, `browser click 'testid=confirmation-modal >> testid=confirm-button'`, `browser click 'testid=manage-backends-done'` and `browser reload`: the selector reads `Local`.
@@ -91,7 +92,7 @@ Preconditions:
- **Phone (`F25.phone`).** Run `control-openhands browser viewport phone`, `browser goto /conversations`, `control-openhands browser click 'testid=sidebar-mobile-menu-toggle'`, `control-openhands browser click 'testid=sidebar-mobile-drawer >> testid=backend-selector'`, `browser click 'testid=add-backend-menu-item'`, `browser click 'testid=add-backend-option-agent-server'` and `control-openhands browser bbox 'testid=add-backend-modal'`: `insideViewport` `true`, `pageHorizontalOverflow` `false`. Screenshot `--feature F25.phone --name add-modal`. Close it (the drawer stays open), open Manage Backends from the drawer selector the same way and check `bbox 'testid=manage-backends-modal'` the same. Return with `browser viewport desktop`.
- **Device verify page (`F25.device-verify-page`).** Run `control-openhands browser goto /oauth/device/verify` and `browser snapshot`: heading `Device Authorization`, `Enter the code displayed on your device:`, textbox `Device Code:` and button `Continue`, inside the normal app shell. `control-openhands browser fill 'role=textbox[name="Device Code:"]' QA-0000` and `browser click 'role=button[name="Continue"]'` go straight to the result: heading `Error`, `Failed to authorize device. Please try again.`, button `Try Again`; `browser network --filter verify-authenticated` shows `POST /oauth/device/verify-authenticated` `404`. Then `control-openhands browser goto '/oauth/device/verify?user_code=QA-0000'`: heading `Device Authorization Request`, `DEVICE CODE`, `QA-0000`, `Security Notice`, buttons `Cancel` and `Authorize Device` (screenshot `--feature F25.device-verify-page --name with-code`). `browser click 'role=button[name="Cancel"]'` does nothing in a tab the page did not open (URL unchanged). `browser click 'role=button[name="Authorize Device"]'` and `browser wait 'role=heading[name="Error"]'` show the same Error card; **Try Again** reloads to the request.
- **Shared view (`F25.shared-conversation-view`).** Run `control-openhands browser goto /shared/conversations/<id>` and `control-openhands browser wait-text 'Conversation not found' --timeout 15000`. The page has no sidebar; `browser network --filter shared` shows `GET /api/shared-conversations` and `/api/shared-events/search` `404`. Screenshot `--feature F25.shared-conversation-view --name local-not-found`.
-- **No Public Share locally (`F25.share-publicly`).** Run `browser goto /conversations/<id>`, `control-openhands browser click 'testid=conversation-name >> testid=ellipsis-button'` and `control-openhands browser count 'testid=share-publicly-button'`: `0` on a local backend (`browser testids --filter button` lists `rename-button`, `show-skills-button`, `show-agent-tools-button`, `export-transcript-button`, `download-trajectory-button`, `display-cost-button` and `delete-button`; `show-hooks-button` and `stop-button` appear only when hooks exist or the conversation is running). The toggle, `copy-share-link-button` and `open-share-link-button` need a Cloud backend: blocked.
+- **No Public Share locally (`F25.share-publicly`).** Run `browser goto /conversations/<id>`, `control-openhands browser click 'testid=conversation-name >> testid=ellipsis-button'` and `control-openhands browser count 'testid=share-publicly-button'`: `0` on a local backend (`browser testids --filter button` lists `rename-button`, `show-skills-button`, `show-agent-tools-button`, `export-transcript-button`, `download-trajectory-button`, `display-cost-button` and `delete-button`; `show-hooks-button` and `stop-button` appear only while the conversation is active (idle, running, waiting for confirmation or finished), so a paused or errored conversation has neither). The toggle, `copy-share-link-button` and `open-share-link-button` need a Cloud backend: blocked.
- **Cleanup.** `browser press Escape`, then `control-openhands stop --run "$OH_VERIFY_RUN_2"` and `unset OH_VERIFY_RUN_2`. The conversation stays with this run's state.
- **Errors.** `control-openhands browser errors --app-only` after the family shows no page errors. Expected app-origin entries: `POST /oauth/device/verify-authenticated` 404 (twice), the shared-view 404s, the warning `Scripts may close only the windows that were opened by them.` from the device-verify Cancel, and a burst of CORS `console.error`s for `<second-url>` while the second agent server is stopped or restarting (see Gotchas).
@@ -111,7 +112,7 @@ Preconditions:
- The device-flow popup survives errors: every failed attempt leaves an `about:blank` tab (#17953). Cancel closes it; after an error close it with `browser close-tab`.
- With the default host the device flow talks to the real `app.all-hands.dev` (`POST /oauth/device/authorize`, then token polling). Starting and cancelling is harmless; never approve a code.
- While the second stack's agent server is stopped or restarting, its ingress answers without CORS headers, so the browser logs `Access to fetch at '<second-url>/api/settings' ... blocked by CORS policy` (also `/server_info`, `/api/conversations/search`, `/api/llm/models/verified`). That is the dead upstream, not a CORS bug; a healthy second stack sends `access-control-allow-origin` for this origin.
-- Health is probed every 10 s, so allow up to 25 s for a dot to change. While the active backend is down, any reload lands on the recovery gate: drive the disconnected rows on the page that was already loaded.
+- Local and remote backends are probed every 30 s (settings + server_info), Cloud backends every 5 min (#18128), so allow up to 40 s for a local dot to change. While the active backend is down, any reload lands on the recovery gate: drive the disconnected rows on the page that was already loaded.
- `/oauth/device/verify` is a Cloud page that also ships in Canvas: on a local stack its POST target does not exist, so Authorize always ends in `Error`. The "Authentication Required" state is unreachable (`useIsAuthed` always resolves `true`).
- `/shared/conversations/<id>` on a local backend also raises a raw toast `HTTP request failed (404 Not Found): {"detail":"Not Found"}` next to `Conversation not found` (#17953).
- Known failure (repro candidate, not an exemption): `F25.edit-escape` closes the Manage modal underneath and drops the Edit draft (Cancel and X close only Edit, `F25.edit-cancel`) (#17953).
diff --git a/.agents/skills/verify-openhands/references/feature-map/F26-runtime-variants.md b/.agents/skills/verify-openhands/references/feature-map/F26-runtime-variants.md
index 737dc333a6..73d7e9171a 100644
--- a/.agents/skills/verify-openhands/references/feature-map/F26-runtime-variants.md
+++ b/.agents/skills/verify-openhands/references/feature-map/F26-runtime-variants.md
@@ -39,11 +39,12 @@ Source: `bin/agent-canvas.mjs`, `scripts/dev-with-automation.mjs`, `scripts/dev-
- `F26.lib-build`: `npm run build:lib` produces `dist/` where every `package.json` `exports` target exists and the main entry exports `AgentServerUIProviders`, `AgentServerUIRoot`, `CloudOrganizationBoundary` and the telemetry helpers.
- `F26.lib-style-scope`: all bundled CSS is scoped under `[data-agent-server-ui]`, and theme tokens such as `--oh-color-base` live on that scope root (observable in the standalone app).
- `F26.lib-host-app`: mounted in a separate host app, Canvas styles stay inside the scope and `styleOverrides` restyle it. Blocked: no host-app example exists.
-- `F26.docker-image`: `docker run ghcr.io/openhands/agent-canvas` serves Canvas at `/canvas`; without `AGENT_CANVAS_ALLOW_LAN_SESSION_KEY=true` the UI asks for the key. Blocked without a Docker daemon.
+- `F26.docker-image`: `docker run ghcr.io/openhands/agent-canvas` serves Canvas at `/canvas`; without `AGENT_CANVAS_ALLOW_LAN_SESSION_KEY=true` the UI asks for the key. Blocked without a Docker daemon. Known failure (reproduced 2026-10-08): on a host whose kernel has no IPv6 (no `/proc/net/if_inet6`), `docker/entrypoint.sh` starts the static server with `--host ::`, which exits with `listen EAFNOSUPPORT: address family not supported :::8000`, and the container stops within about half a minute of start, with exit code `0` (#18178).
- `F26.docker-conversation-runtime`: `OH_CONVERSATION_RUNTIME=docker` runs each new conversation in its own container. Blocked without a Docker daemon.
- `F26.helm-chart`: `helm install agent-canvas ./helm/agent-canvas` runs the Docker image as a Kubernetes StatefulSet with a PVC and an Ingress. Blocked without `helm` and a cluster.
- `F26.desktop-boot-splash`: the Electron app first shows a dark splash (logo, **OpenHands Agent Canvas**, spinner, `Starting backend services…`, then live service-log lines, a first-launch note and **Show details**).
- `F26.desktop-main-window`: after boot a native window with a File/Edit/View/Window menu loads `http://localhost:8000` with the key injected (first run, no API-key screen).
+- `F26.desktop-macos-titlebar`: on macOS the desktop window hides the native title bar and reserves a 28 px drag band (`titlebar-drag-region`, `aria-hidden`) above the shell, so the sidebar logo clears the traffic lights and the window can be dragged; the band is dropped in native fullscreen, also after a reload while fullscreen. Linux and Windows windows and browser tabs render no band (`window.desktopShell` is undefined in a tab; `platform` is `linux` on Linux). The band is rendered by the root layout, its error shell and the config-loading spinner, not by the first-run onboarding screen. Blocked without macOS (#17474).
- `F26.desktop-external-links`: external links in the desktop window open in the system browser for allowed schemes only. Not driven: the harness cannot click inside the Electron window.
## How to get to it (user POV)
@@ -93,7 +94,7 @@ Preconditions:
- **Library build (`F26.lib-build`).** Never build inside the shared checkout (it regenerates i18n and typegen files the other runs hash); build in a copy: `L=$OH_VERIFY_RUN/private/f26-lib; mkdir -p $L; tar --exclude=./node_modules --exclude=./build --exclude=./.git --exclude=./dist -cf - . | tar -xf - -C $L; ln -s "$PWD/node_modules" $L/node_modules; (cd $L && npm run build:lib); echo "exit=$?"`. It ends with `âś“ built in` and `exit=0` (about 30 s). Then `(cd $L && node -e 'const p=require("./package.json"),fs=require("fs");let ok=0,miss=[];for(const[k,v]of Object.entries(p.exports))for(const f of(typeof v==="string"?[v]:Object.values(v)))fs.existsSync(f)?ok++:miss.push(k+" -> "+f);console.log(JSON.stringify({entries:Object.keys(p.exports),ok,missing:miss}))')` prints 9 entries (`.`, `./browser`, `./conversation`, `./files`, `./settings`, `./sidebar`, `./terminal`, `./i18n`, `./package.json`), `ok` 25 and `missing` `[]`. `grep -ohE 'AgentServerUIProviders|AgentServerUIRoot|CloudOrganizationBoundary|configureTelemetry|setTelemetryConsent' $L/dist/lib/index.d.ts | sort -u` lists all five. Remove the copy with `rm -rf $L`.
- **Style scope (`F26.lib-style-scope`).** On your run's home page (`control-openhands browser goto /`) run `control-openhands browser eval "(() => { let total=0, unscoped=[]; for (const sh of document.styleSheets) { let rules; try { rules = sh.cssRules } catch { continue } const walk = (rs) => { for (const r of rs) { if (r.selectorText) { total++; if (!r.selectorText.includes('data-agent-server-ui')) unscoped.push(r.selectorText) } else if (r.cssRules) walk(r.cssRules) } }; walk(rules) } return { scopeRoots: document.querySelectorAll('[data-agent-server-ui]').length, total, unscopedCount: unscoped.length, sample: unscoped.slice(0, 12) } })()"`. `total` is in the thousands and `unscopedCount` is `2`: only `.go<hash>` and `.go<hash> > *`, react-hot-toast's runtime classes. `control-openhands browser eval "getComputedStyle(document.querySelector('[data-agent-server-ui]')).getPropertyValue('--oh-color-base').trim()"` is `#181818`. This proves the bundle is scoped, not that a host page is unaffected (`F26.lib-host-app`).
-- **Blocked (`F26.lib-host-app`, `F26.docker-image`, `F26.docker-conversation-runtime`, `F26.helm-chart`).** `docker info` ends with `failed to connect to the docker API at unix:///var/run/docker.sock` here: record both Docker rows `blocked` naming the missing daemon. With a daemon, run the image with `-p 127.0.0.1:8000:8000`, open `http://localhost:8000/canvas` and expect `testid=api-key-entry-screen` unless `-e AGENT_CANVAS_ALLOW_LAN_SESSION_KEY=true` is set. Record `F26.lib-host-app` `blocked` naming the missing host-app example. `command -v helm kubectl` prints nothing here: record `F26.helm-chart` `blocked` naming the missing `helm` binary and cluster; with them, `helm lint helm/agent-canvas` and `helm template qa helm/agent-canvas` render the StatefulSet, Service and Ingress, and `helm install` follows `helm/agent-canvas/README.md`.
+- **Blocked (`F26.lib-host-app`, `F26.docker-image`, `F26.docker-conversation-runtime`, `F26.helm-chart`).** If `docker info` cannot reach the daemon but `dockerd` is installed, start it (`setsid dockerd`); without one, record both Docker rows `blocked` naming the missing daemon. With a daemon, run the image with `-p 127.0.0.1:8000:8000`, open `http://localhost:8000/canvas` and expect the **Add a backend** step (`testid=onboarding-step-check-backend`, Next disabled until a key is typed); `onboarding-skip` leads to `testid=api-key-entry-screen`. With `-e AGENT_CANVAS_ALLOW_LAN_SESSION_KEY=true` the key is injected and first run opens on Choose your agent, under the telemetry consent dialog. `npm run build:docker` behind a TLS-intercepting proxy needs the proxy CA inside the build stages, and Docker Hub may answer 429. Record `F26.lib-host-app` `blocked` naming the missing host-app example. `command -v helm kubectl` prints nothing here: record `F26.helm-chart` `blocked` naming the missing `helm` binary and cluster; with them, `helm lint helm/agent-canvas` and `helm template qa helm/agent-canvas` render the StatefulSet, Service and Ingress, and `helm install` follows `helm/agent-canvas/README.md`.
- **Desktop splash and window (`F26.desktop-boot-splash`, `F26.desktop-main-window`).** Start a private display and the app in one process group: `Q=$OH_VERIFY_RUN/private/f26-desktop; mkdir -p $Q/shots; setsid nohup sh -c "echo \$\$ > $Q/pgid; Xvfb :78 -screen 0 1440x1000x24 -nolisten tcp & sleep 1; DISPLAY=:78 HOME=$Q/home OH_CANVAS_SAFE_STATE_DIR=$Q/state LOCAL_BACKEND_API_KEY=qa-f26-desktop-key OH_SECRET_KEY=qa-f26-secret DO_NOT_TRACK=1 exec node_modules/.bin/electron --no-sandbox electron" > $Q/desktop.log 2>&1 &`, then capture frames: `for i in $(seq 1 40); do sleep 1; DISPLAY=:78 import -window root $Q/shots/s$(printf %02d $i).png; done`. Read the frames: the first seconds show the splash (logo, `OpenHands Agent Canvas`, `AI coding agent interface`, spinner, `Starting backend services…`, then lines such as `agent-server: {"asctime": ...`, the note `First launch downloads Python + the OpenHands agent server.` and a **Show details** button); a later frame shows the main window with a `File Edit View Window` menu and the first-run **Choose your agent** step under the consent dialog naming `the local backend "Local" at http://localhost:8000` (about 30 s on a warm cache, minutes on the first download). Copy the frames you cite into `$OH_VERIFY_RUN/evidence/F26.desktop-boot-splash/` and `.../F26.desktop-main-window/`. Stop in two steps: `kill -TERM $(cat $Q/pgid)` signals only the Electron launcher (it quits and stops its backend services); after about 10 s ports 8000, 18000, 18001 and 3001 are free again. Then `kill -TERM -- -$(cat $Q/pgid)` ends Xvfb; `ps -o pid,cmd -g $(cat $Q/pgid)` lists nothing.
- **External links (`F26.desktop-external-links`).** Not driven: record `not-run` (harness gap: no verb clicks inside the Electron window or observes the OS browser handoff).
diff --git a/.agents/skills/verify-openhands/references/feature-map/README.md b/.agents/skills/verify-openhands/references/feature-map/README.md
index c4c502176c..f5105d5162 100644
--- a/.agents/skills/verify-openhands/references/feature-map/README.md
+++ b/.agents/skills/verify-openhands/references/feature-map/README.md
@@ -230,7 +230,7 @@ How to write and prove new entries: [../mapping.md](../mapping.md).
| ID | Family | What it covers | Entry points | Needs | Sub-features |
|---|---|---|---|---|---|
| F01 | [First run, onboarding and sign-in](F01-first-run-and-sign-in.md) | telemetry consent, onboarding modal, public-mode backend step and API-key screen, route error page | any URL on a fresh browser profile; `launch --public` | fresh run or `browser reset`; LLM for say-hello | 22 |
-| F02 | [App shell, sidebar and command menu](F02-app-shell.md) | rail and phone drawer, collapse, home pinning, getting-started checklist, command menu, toasts | every page; `Control+k` / `Meta+k` | baseline; LLM for checklist progress | 25 |
+| F02 | [App shell, sidebar and command menu](F02-app-shell.md) | rail and phone drawer, collapse, home pinning, getting-started checklist, command menu, toasts | every page; `Control+k` / `Meta+k` | baseline; LLM for checklist progress | 26 |
| F03 | [Home and starting work](F03-home.md) | home composer, workspace picker, plugin picker, recommended automations rail, no-LLM banner | `/`, **New Chat**, command menu | runs before and after `llm preset`; fixture repo | 39 |
| F04 | [Conversation list and folders](F04-conversation-list.md) | sidebar list, View presets, workspace folders, tags, rename/pin/archive/delete, load more | sidebar on every page | several conversations; fixture repos | 40 |
| F05 | [Composer, slash commands and plan mode](F05-composer.md) | send, drafts, attachments, model pill, slash commands, `/goal`, plan mode, dictation | home and conversation composer | LLM | 25 |
@@ -253,11 +253,11 @@ How to write and prove new entries: [../mapping.md](../mapping.md).
| F22 | [Creating automations](F22-automation-creation.md) | templates, setup dialog, custom automations, import | `/automations/templates`, `/automations/new/<id>` | LLM | 29 |
| F23 | [Automation detail, runs and editing](F23-automation-detail.md) | detail page, runs, logs, edit dialog, triggers, debug | `/automations/<id>` | LLM; runs | 39 |
| F24 | [Automation Git Sync](F24-git-sync.md) | configure, sync cycles, encryption, status | `/automations/git-sync` | `fixture git-repo` | 26 |
-| F25 | [Backends, Cloud and sharing](F25-backends-and-cloud.md) | add, edit, remove and switch backends, per-backend consent, Cloud login, shared pages | backend selector | a second stack; Cloud account (blocked) | 28 |
-| F26 | [Launcher modes, Docker, desktop and library](F26-runtime-variants.md) | launcher flags, partial stacks, LAN bind, Docker, Electron, embeddable library | a terminal | Docker/Electron where available | 31 |
+| F25 | [Backends, Cloud and sharing](F25-backends-and-cloud.md) | add, edit, remove and switch backends, per-backend consent, Cloud login, shared pages | backend selector | a second stack; Cloud account (blocked) | 29 |
+| F26 | [Launcher modes, Docker, desktop and library](F26-runtime-variants.md) | launcher flags, partial stacks, LAN bind, Docker, Electron, embeddable library | a terminal | Docker/Electron where available | 32 |
| F27 | [Workspace tools](F27-workspace-tools.md) | terminal, browser, planner, task list, usage, `canvas_ui_control` | drawer tabs | LLM | 30 |
-27 families, 740 sub-features. `control-openhands map ids` lists every ID with its file.
+27 families, 743 sub-features. `control-openhands map ids` lists every ID with its file.
### Neighbouring families
@@ -276,8 +276,9 @@ Everything else a user can reach is mapped. These are left out on purpose:
- `src/components/features/context-menu`: a shared menu primitive, not a feature of its own. Its behavior is checked through the menus that use it (F04, F07, F21, F27).
- OpenHands Cloud behavior (Cloud login and device flow, organizations, sharing, task URLs, sandbox pause): needs a Cloud account. The recipes are written up to that point and recorded as `blocked` (for example `F07.cloud-only` and the Cloud rows of F25).
-- Suspended Cloud workspaces (`src/components/features/backends/cloud-organization-boundary.tsx`, added by [#17988](https://github.com/OpenHands/OpenHands/pull/17988)) are not yet live-mapped. The alert needs a real selected Cloud organization whose scoped request receives HTTP 403 with `detail: "Organization is suspended"` or `detail: "User membership is suspended"`; checking recovery also needs another accessible workspace. Desktop/phone alerts, workspace switching and request/backend/organization isolation remain blocked until those genuine states are available. An unrelated 403 is not that prerequisite.
-- `src/components/features/setup-guide`: the enterprise Super Admin setup guide added by [#17969](https://github.com/OpenHands/OpenHands/pull/17969) is not yet live-mapped. It needs an authenticated enterprise Cloud backend with a selected organization whose `/me` permissions include `manage_super_admins`, plus a genuine `/api/admin/setup-state` response with a non-null `guide_org_id`, `guide_dismissed: false`, and at least one unfinished required guide step. A local backend cannot establish those prerequisites. Progress, step destinations, collapse/reopen, server-driven guide removal, progress persistence and desktop/phone layouts remain blocked until an entitled account can drive them; source inspection is not runtime proof.
+- Suspended Cloud workspaces (`src/components/features/backends/cloud-organization-boundary.tsx`, [#17988](https://github.com/OpenHands/OpenHands/pull/17988)): **Mapped prerequisites/local absence:** [`F25.cloud-org-suspended`](F25-backends-and-cloud.md) records the expected alert and the prerequisite; a local backend can check only that the Cloud suspension surface is absent. **Positive paths not live-mapped:** the selected Cloud organization must receive a genuine scoped HTTP 403 with `detail: "Organization is suspended"` or `detail: "User membership is suspended"`; recovery also needs another accessible workspace. Desktop/phone alerts, workspace switching and request/backend/organization isolation remain blocked until those genuine states are available. An unrelated 403 is not that prerequisite.
+- Enterprise Super Admin setup guide (`src/components/features/setup-guide`, [#17969](https://github.com/OpenHands/OpenHands/pull/17969)): **Mapped prerequisites/local absence:** [`F02.super-admin-setup-guide`](F02-app-shell.md) records its prerequisites and the local check for no guide or `/api/admin/setup-state` request. **Positive paths not live-mapped:** an authenticated enterprise Cloud backend must have a selected organization whose `/me` permissions include `manage_super_admins`, plus a genuine `/api/admin/setup-state` response with a non-null `guide_org_id`, `guide_dismissed: false`, and at least one unfinished required guide step. A local backend cannot establish those prerequisites. Progress, step destinations, collapse/reopen, server-driven guide removal, progress persistence and desktop/phone layouts remain blocked until an entitled account can drive them; source inspection is not runtime proof.
+- Setup-guide continuation and Canvas tours ([#18138](https://github.com/OpenHands/OpenHands/pull/18138), `src/components/features/setup-guide/`, `src/components/features/manifest/manifest-setup-dialog.tsx`, `src/hooks/mutation/use-add-mcp-server.ts`) are **not live-mapped**. They share `F02.super-admin-setup-guide`'s genuine Cloud account and setup-state prerequisites above, with the next required step set to `first-automation` or `add-integration`. Verification additionally needs a successful direct automation creation or MCP-server addition and a subsequent server response confirming that step complete; assisted setup and out-of-order or unconfirmed completion have different control flow. The next Canvas step/tour, Cloud-host same-tab invitation handoff with `org` and `setup_tour`, standalone/Electron Start fallback, and tour entry via `setup_tour` remain blocked across desktop/phone and those deployment boundaries. The invitation handoff also needs an accessible enterprise invitation page for the guide organization. No positive recipe is accepted from source or mocked enterprise responses.
- Locked-to-Cloud deployments: `scripts/static-server.mjs --lock-to-cloud` exists, but `bin/agent-canvas.mjs` does not forward it, so `control-openhands launch` cannot start that mode.
- Page-local load errors (for example the LLM profiles or apps list failing while the rest of the backend works) need fault injection; stopping a service with `service stop` replaces the whole app with the backend-unavailable screen instead. The pages' empty and error copy is mapped where reachable.
- Real microphone dictation, native file dialogs outside the browser, and Electron window chrome beyond what F26 drives.
diff --git a/.agents/skills/verify-openhands/scripts/browser-daemon.mjs b/.agents/skills/verify-openhands/scripts/browser-daemon.mjs
index 81b34ebb7a..f3acdbb62c 100755
--- a/.agents/skills/verify-openhands/scripts/browser-daemon.mjs
+++ b/.agents/skills/verify-openhands/scripts/browser-daemon.mjs
@@ -1594,7 +1594,7 @@ const server = createServer(async (req, res) => {
.split("\n")
.slice(0, 14)
.join("\n");
- let hint;
+ let hint = error?.hint;
if (/strict mode violation/.test(message)) {
hint =
'Several elements match. Scope it (`testid=dialog >> role=button[name="Save"]`) or add `>> nth=0` after checking `browser testids`.';
@@ -1606,6 +1606,7 @@ const server = createServer(async (req, res) => {
JSON.stringify({
ok: false,
error: message,
+ code: Number.isInteger(error?.code) ? error.code : undefined,
hint,
url: activePage.url(),
failureScreenshot: await failureShot(),
diff --git a/.agents/skills/verify-openhands/scripts/control-openhands.mjs b/.agents/skills/verify-openhands/scripts/control-openhands.mjs
index 7f63db1b1c..96d45ba8da 100755
--- a/.agents/skills/verify-openhands/scripts/control-openhands.mjs
+++ b/.agents/skills/verify-openhands/scripts/control-openhands.mjs
@@ -398,7 +398,7 @@ async function browserCall(run, cmd, args = {}, { timeout = 120_000 } = {}) {
const result = await response.json();
if (!result.ok) {
throw new CliError(result.error, {
- code: 1,
+ code: Number.isInteger(result.code) ? result.code : 1,
hint: result.hint,
extra: { url: result.url, failureScreenshot: result.failureScreenshot },
});