🙌 OpenHands: AI-Driven Development
docs(verify-openhands): map maintenance 2026-10-20 (#18718)
Engel Nystf78800ba4632
diff --git a/.agents/skills/verify-openhands/references/feature-map/F04-conversation-list.md b/.agents/skills/verify-openhands/references/feature-map/F04-conversation-list.mdindex b83415feba..f20266896f 100644--- a/.agents/skills/verify-openhands/references/feature-map/F04-conversation-list.md+++ b/.agents/skills/verify-openhands/references/feature-map/F04-conversation-list.md@@ -49,7 +49,7 @@ Source: `src/components/features/sidebar/sidebar-conversation-list.tsx`, `src/co- `F04.download`: ⋮ → Download conversation data saves `conversation_<id>.zip`.- `F04.download-error`: a failed download shows one toast and closes the ⋮ menu. When the Agent Server is down behind a plain-text 502 ingress response, the toast uses the generic error fallback rather than raw transport text.- `F04.archive`: ⋮ → Archive Conversation asks for confirmation, hides and unpins the row, and leaves the conversation if it was open.-- `F04.show-archived-unarchive`: Show archived brings archived rows back with an `Archived` chip; Unarchive restores a row without confirmation.+- `F04.show-archived-unarchive`: Show archived brings archived rows back with an `Archived` chip, a dimmed title and a grey archive icon in place of the status dot; Unarchive restores a row without confirmation. A conversation whose runtime is missing and cannot be resumed counts as archived: it is hidden by default, shown the same way under Show archived, and its ⋮ menu offers neither Archive nor Unarchive.- `F04.delete`: ⋮ → Delete Conversation asks for confirmation, deletes it on the server and leaves it if it was open.- `F04.delete-all`: View → Delete all asks for confirmation with a count and deletes every conversation. Known failure (reproduced 2026-10-17, [#17919](https://github.com/OpenHands/OpenHands/issues/17919)): only loaded pages are deleted; with 26 stored conversations and 20 loaded, six remain after confirming Delete all.- `F04.collapsed-rail`: the collapsed sidebar rail shows no conversation list; expanding brings it back.@@ -88,7 +88,7 @@ Preconditions:- **New conversation in a folder (`F04.folder-new-conversation`).** Run `control-openhands browser goto /`, then `control-openhands browser click 'role=button[name="Start new conversation in qa-f04-folder"]' --expect-url '/conversations/'` (returns the new `/conversations/<id>`), then `control-openhands browser count '[data-testid^="thread-folder-ws-"][data-testid$="qa-f04-folder"] >> testid=conversation-card'`; it grows by one. Repeating `browser goto /` plus the click for `qa-f04-repo` 18 times arranges the data for the next two bullets.- **Folder preview (`F04.folder-preview-more`).** With more than five conversations in `qa-f04-repo`, `control-openhands browser count '[data-testid^="thread-folder-ws-"][data-testid$="qa-f04-repo"] >> testid=conversation-card'` is `5` and `control-openhands browser text '[data-testid^="thread-folder-view-more-ws-"][data-testid$="qa-f04-repo"]'` is `More`. Click that button: every loaded row shows and the label is `Less`; click again: `5`.- **Reorder folders (`F04.folder-reorder`).** In By workspace mode read the order with `control-openhands browser eval "[...document.querySelectorAll('[data-testid^=thread-folder-drag-]')].map(e=>e.textContent.trim())"`, then run `control-openhands browser drag '[data-testid^="thread-folder-drag-ws-"][data-testid$="qa-f04-folder"]' '[data-testid^="thread-folder-drag-ws-"][data-testid$="qa-f04-repo"]' --position before`. The same eval now starts with `qa-f04-folder`, `qa-f04-repo`, also after `browser reload`, and `control-openhands browser eval "JSON.parse(localStorage.getItem('conversation-panel-preferences')).state.groupFolderOrder"` lists the `ws:<path>` keys in that order.-- **Load more (`F04.load-more`).** In By date mode (More options → `testid=organize-chronological`, or the Recent preset) with 22 or more conversations, `control-openhands browser count 'testid=conversation-panel-list-scroll >> testid=conversation-card'` is `20`. Run `control-openhands browser click 'testid=load-more-conversations'` and `control-openhands browser wait 'testid=load-more-conversations' --state detached --timeout 15000`; the count is the total (`23` with 23 conversations). In By workspace mode (`organize-grouped`, then `browser reload`) the same click adds the later rows to their own folders: with the oldest rows in No workspace and none of them loaded, `testid=thread-folder-__none_workspace` appears only after the click and `browser count 'testid=conversation-card'` grows by the number of unloaded No workspace rows (6 → 9 with three such rows, 5 → 7 with two). A folder that already shows five rows keeps the extra ones behind its More.+- **Load more (`F04.load-more`).** In By date mode (More options → `testid=organize-chronological`, or the Recent preset) with 22 or more conversations, `control-openhands browser count 'testid=conversation-panel-list-scroll >> testid=conversation-card'` is `20`. Run `control-openhands browser click 'testid=load-more-conversations'` and `control-openhands browser wait 'testid=load-more-conversations' --state detached --timeout 15000`; the count is the total (`23` with 23 conversations). In By workspace mode (`organize-grouped`, then `browser reload`) the same click adds the later rows to their own folders: with the oldest rows in No workspace and none of them loaded, `testid=thread-folder-__none_workspace` appears only after the click and `browser count 'testid=conversation-card'` grows by the number of unloaded No workspace rows (6 → 9 with three such rows, 5 → 7 with two). A folder already shown before the click keeps its later-page rows behind its More, even when it shows fewer than five rows.- **Organize (`F04.organize`).** Run `control-openhands browser click 'testid=conversation-layouts-toggle'`, `control-openhands browser click 'testid=advanced-options-row'`, `control-openhands browser snapshot 'testid=advanced-conversation-options-modal'` (sections Organize, Sort by, Threads, Additional, Automations, Metadata), `control-openhands browser click 'testid=organize-chronological'` (`browser attr 'testid=organize-chronological' aria-checked` is `true`), `control-openhands browser click 'testid=advanced-options-close'`, `control-openhands browser reload`, then `control-openhands browser count '[data-testid^=thread-folder-ws-]'`. The count is `0` and the rows form one list; `organize-grouped` brings the folders back.- **Header divider (`F04.list-header`).** With more rows than fit (By date mode with 20 loaded rows, as Organize leaves it; By workspace mode previews too few rows to scroll), `control-openhands browser eval "document.querySelector('[data-testid=older-conversations-summary]').parentElement.classList.contains('border-border')"` is `false`; after `control-openhands browser scroll 'testid=conversation-panel-list-scroll' --by 300` it is `true`, and `false` again after `--by -300`.- **Rename (`F04.card-rename`).** Pick the oldest untitled conversation (`b8d99...` from the picker step; the sort check below needs an old one). It is beyond the first 20 rows after a reload, so first run `control-openhands browser click 'testid=load-more-conversations'` and `control-openhands browser wait 'testid=load-more-conversations' --state detached --timeout 15000`. Then run `control-openhands browser scroll 'testid=conversation-card >> has-text=Conversation <id5>'` (the first five characters of its id), `control-openhands browser hover 'testid=conversation-card >> has-text=Conversation <id5>'`, `control-openhands browser click 'testid=conversation-card >> has-text=Conversation <id5> >> testid=ellipsis-button'`, `control-openhands browser click 'testid=context-menu >> testid=edit-button'`, `control-openhands browser fill 'input[data-testid=conversation-card-title]' 'QA_F04 renamed'`, `control-openhands browser press Enter`, then `control-openhands browser toasts` (`Conversation title updated successfully`), `control-openhands browser reload` and `control-openhands browser count 'testid=conversation-card-title >> has-text=QA_F04 renamed'` (`1`).@@ -111,7 +111,8 @@ Preconditions:- **Download (`F04.download`).** Open ⋮ and run `control-openhands browser click 'testid=context-menu >> testid=download-trajectory-button'`, then `control-openhands browser downloads`. A file `…-conversation_<id>.zip` lands in `<run>/private/downloads`; `control-openhands browser downloads --last 1 --inspect` lists `<id-hex>/base_state.json` and `meta.json` for any row, plus event folders such as `bash_events/` for a conversation that ran (the `pong` row; it is the oldest, so Load more first).- **Download failure (`F04.download-error`).** With ⋮ already open on a row, run `control-openhands browser errors --clear` and `control-openhands service stop agent-server`, click `testid=context-menu >> testid=download-trajectory-button`, then `control-openhands browser toasts --history` and `control-openhands browser count 'testid=context-menu'`. There is exactly one toast, `Couldn't download the conversation data: An error occurred`, and the menu is closed (`0`). The download request returned a plain-text ingress 502; `getApiErrorMessage` intentionally omits raw transport text and falls back to this generic message when the response body has no usable error field. `control-openhands browser errors --app-only` has `pageErrors` `0`; its 502 request and console error are the outage itself. Run `control-openhands restart` and `control-openhands doctor` afterwards.- **Archive (`F04.archive`).** Open a conversation from its row, open ⋮ and run `control-openhands browser click 'testid=context-menu >> testid=archive-button'`; `control-openhands browser snapshot 'role=dialog'` reads `Archive conversation` and `Archive "<title>"? The conversation stays available with its full history and can be restored from Show archived.` `control-openhands browser click 'role=dialog >> testid=cancel-button'` keeps the row. Repeat and `control-openhands browser click 'role=dialog >> testid=confirm-button' --expect-url '/conversations(\?|$)'`; the row count is `0`, also after `browser reload`. Archiving a pinned row removes the Pinned section.-- **Show archived and Unarchive (`F04.show-archived-unarchive`).** In More options click `testid=toggle-show-archived` (`aria-checked` `true`) and `testid=advanced-options-close`; `control-openhands browser count 'testid=conversation-card >> has-text=Conversation <id5> >> testid=conversation-card-archived-chip'` is `1` and the ⋮ menu offers `Unarchive Conversation`. `control-openhands browser click 'testid=context-menu >> testid=unarchive-button'` opens no dialog (`browser count 'role=dialog'` `0`) and the chip count drops to `0`. Turn Show archived off again.+- **Show archived and Unarchive (`F04.show-archived-unarchive`).** In More options click `testid=toggle-show-archived` (`aria-checked` `true`) and `testid=advanced-options-close`; `control-openhands browser count 'testid=conversation-card >> has-text=Conversation <id5> >> testid=conversation-card-archived-chip'` is `1` and the ⋮ menu offers `Unarchive Conversation`. The row also has `testid=conversation-status-archived` and its `conversation-card-title` carries `opacity-60`. `control-openhands browser click 'testid=context-menu >> testid=unarchive-button'` opens no dialog (`browser count 'role=dialog'` `0`), the chip count drops to `0` and the dot returns to `conversation-status-active`. Turn Show archived off again.+- **Missing runtime (`F04.show-archived-unarchive`).** Create two empty conversations from the picker (`launch-no-workspace`) and archive one through ⋮. Add `"OH_CONVERSATION_RUNTIME":"docker","OH_BIND_HOST":"127.0.0.1"` to `$OH_VERIFY_RUN/private/launcher-env.json`, then run `control-openhands restart` and `control-openhands doctor`. No Docker daemon is needed: conversations created in local mode have no runtime identity, so `control-openhands api GET '/api/conversations/search?limit=5'` shows `runtime_info` `runtime_status` `missing` with `can_resume` `false`. After `control-openhands browser goto /`, both rows are hidden (`No conversations found`). With Show archived on, each row has `conversation-card-archived-chip` `Archived`, `conversation-status-archived` and a title with `opacity-60`. Each ⋮ menu (`control-openhands browser testids 'testid=context-menu'`) has no `archive-button` and no `unarchive-button`, including the explicitly archived row. Opening one shows `Sandbox no longer available`. Repeat at phone width in the drawer. Restore by removing both keys, then `restart` and `doctor`.- **Delete (`F04.delete`).** Open a conversation from its row, open ⋮ and run `control-openhands browser click 'testid=context-menu >> testid=delete-button'`; the dialog reads `Confirm Delete` and `Are you sure you want to delete the "<title>" conversation? This action cannot be undone.` with `cancel-button` and `confirm-button`. `control-openhands browser click 'role=dialog >> testid=cancel-button'` keeps the row. Repeat and `control-openhands browser click 'role=dialog >> testid=confirm-button' --expect-url '/conversations(\?|$)'`; after `browser reload` the row count is `0` and `control-openhands api GET /api/conversations/<id>` is `404`.- **Phone (`F04.phone`).** Run `control-openhands browser viewport phone`, `control-openhands browser goto /`, `control-openhands browser click 'testid=sidebar-mobile-menu-toggle'`, then `control-openhands browser bbox 'testid=sidebar-mobile-drawer >> testid=conversation-panel'` (`insideViewport` `true`, `pageHorizontalOverflow` `false`) and `control-openhands browser screenshot --feature F04.phone --name drawer`. Hover a row in the drawer and click its `testid=ellipsis-button`; `control-openhands browser bbox 'testid=context-menu'` is inside the viewport. `control-openhands browser mouse-click 380 20` closes the menu (`browser count 'testid=context-menu'` `0`) and the drawer (`control-openhands browser wait 'testid=sidebar-mobile-drawer' --state hidden --timeout 5000`; an immediate `visible` still reads `true` during the slide-out). Reopen the drawer and `control-openhands browser click 'testid=sidebar-mobile-drawer >> testid=conversation-card >> has-text=QA_F04 renamed' --expect-url '/conversations/'`; `control-openhands browser wait 'testid=sidebar-mobile-drawer' --state hidden --timeout 5000` succeeds. Return with `control-openhands browser viewport desktop`.- **A later-page pin (`F04.pin`).** With more than 20 conversations as the pagination precondition already arranges, choose Recent, reload, click `role=button[name="Load more"]`, and pin a conversation from the newly loaded rows (`browser hover` its `conversation-card`, then click its `[data-testid^=conversation-pin-toggle-]`). Read the pinned section, then `control-openhands browser reload` and `control-openhands browser count 'testid=conversation-panel-pinned-section'`. Known failure (reproduced 2026-10-12, [#16399](https://github.com/OpenHands/OpenHands/issues/16399)): the later-page pin is pruned on first-page reload even though the conversation still exists. Tested with 23 empty conversations and one older pin.@@ -143,10 +144,8 @@ Preconditions:- Model-written titles vary from run to run; match finished conversations on a word from the prompt (`has-text=pong`), never on the whole title.- Opening a conversation from the sidebar never changes its tags, also right after an automation setup conversation (one tagged `automationsetup: draft`): the other conversation keeps its tags and opens as a normal chat (recipe in F07 `F07.open-by-url`). A conversation that did get the tag loses it with Edit tags (`remove-tag-automationsetup`).- Known issue #17919: Delete all deletes only the loaded pages, and its dialog states that smaller count (`F04.delete-all`).-- Known issue [#18155](https://github.com/OpenHands/OpenHands/issues/18155) (`F04.show-archived-unarchive`): Missing-runtime conversations shown as Archived but never hidden, chipped, or unarchivable. Live prerequisite: A Cloud sandbox or local runtime that becomes MISSING and non-resumable; ordinary local pause remains resumable.- Known issue [#17497](https://github.com/OpenHands/OpenHands/issues/17497) (`F04.card`): Corrupted conversation data breaks the entire conversation history list instead of handling individual broken conversations. Live prerequisite: The original corrupted persisted conversation or a deterministic corruption fixture after model-switch failure and fork.- Known issue [#17257](https://github.com/OpenHands/OpenHands/issues/17257) (`F04.start-task-cards`): Cloud provisioning has no in-progress start-task cards because the list hook always returns an empty array. Live prerequisite: An authenticated Cloud backend producing an in-progress sandbox/repository start task.-- Known issue [#16750](https://github.com/OpenHands/OpenHands/issues/16750) (`F04.card`): Conversation list does not load while automation is running. Live prerequisite: A prompt automation or native delegated task that remains running during conversation-list reload; no usable model is configured here.- Known issue [#15946](https://github.com/OpenHands/OpenHands/issues/15946) (`F04.card`): Show conversations hidden by active/stale agent-server leases. Live prerequisite: A copied lease-bearing persisted conversation and second owner/expired-lease state; never alter another live run's state.- Known issue [OpenHands/software-agent-sdk#4987](https://github.com/OpenHands/software-agent-sdk/issues/4987) (`F04.card`): Autotitle input has broken user-message separators and emoji-list formatting; verify the resulting visible title with a real provider. Live prerequisite: A working autotitle model and captured title-generation input/output; Canvas only consumes the resulting server title.- Known issue [OpenHands/software-agent-sdk#4537](https://github.com/OpenHands/software-agent-sdk/issues/4537) (`F04.card`): A native delegated task can freeze the sidebar conversation list and cause request timeouts until it ends. Live prerequisite: A working model with native TaskTool delegation holding the parent state lock during list reload.diff --git a/.agents/skills/verify-openhands/references/feature-map/F05-composer.md b/.agents/skills/verify-openhands/references/feature-map/F05-composer.mdindex ab41d9e038..46080890b9 100644--- a/.agents/skills/verify-openhands/references/feature-map/F05-composer.md+++ b/.agents/skills/verify-openhands/references/feature-map/F05-composer.md@@ -94,7 +94,7 @@ Preconditions:- **Overflow menu (`F05.overflow-menu`).** Run `control-openhands browser viewport narrow` and `control-openhands browser snapshot 'testid=interactive-chat-box'`: the model pill is gone and `button "More input actions"` appears (at `phone` and `350x800` the pill stays inline). `control-openhands browser click 'role=button[name="More input actions"]' --observe '[data-testid=chat-input-overflow-menu]' --observe-ms 1000`: `observed` goes from `<absent>` to `Model` (the menu appears in the observed sequence; its delay varies from run to run, so do not assert a time) and has no later `<absent>`. `control-openhands browser count 'testid=chat-input-overflow-menu'` is `1` and `control-openhands browser attr 'role=button[name="More input actions"]' aria-expanded` is `true`. Run `control-openhands browser click 'testid=overflow-model-button'`; `control-openhands browser text 'testid=chat-input-overflow-menu'` reads `Model`, `AVAILABLE PROFILES`, `deepseek-flash` / `deepseek/deepseek-flash`, `deepseek-pro` / `deepseek/deepseek-v4-pro`, `LLM Profiles`. Run `control-openhands browser bbox 'testid=chat-input-llm-profile-option-deepseek-flash'` and `control-openhands browser bbox 'role=link[name="LLM Profiles"]'`. Expected: both `insideViewport` `true`. Known failure (#18063): the submenu opens to the right of the menu, so the profile row starts at x about 270 with width 210 and the `LLM Profiles` link sits at y about 725, below the 700 px viewport (both `insideViewport` `false`); the profile clicks below still work because the first two rows keep a strip of about 50 px on screen (from x about 270 to the 320 px edge), while a click on the `LLM Profiles` link times out (`browser screenshot --feature F05.overflow-menu --name model-submenu-narrow`). `control-openhands browser click 'testid=chat-input-llm-profile-option-deepseek-pro'` and `control-openhands browser wait-text 'Switched to profile' --timeout 15000` close the menu (count `0`), and `control-openhands conversation status <id>` shows `deepseek/deepseek-v4-pro`. Switch back the same way: the trigger, `testid=overflow-model-button`, then `testid=chat-input-llm-profile-option-deepseek-flash` (`conversation status <id>` shows `deepseek/deepseek-flash`). Open the menu once more; a second click on the trigger closes it (`aria-expanded` `false`). Escape closes it too: record it with `control-openhands browser record start --feature F05.overflow-menu --name escape-narrow`, open the menu, `control-openhands browser press Escape` and `control-openhands browser wait 'testid=chat-input-overflow-menu' --state detached --timeout 3000`; `browser attr 'role=button[name="More input actions"]' aria-expanded` is `false` and `control-openhands browser eval "document.activeElement.getAttribute('aria-label')"` is `More input actions`. Repeat with focus on a menu item (`control-openhands browser focus 'testid=overflow-model-button'` before Escape) and with the Model submenu open (`browser focus 'testid=chat-input-llm-profile-option-deepseek-flash'`): the same result. `control-openhands browser record stop --gif`. Return with `control-openhands browser viewport desktop`.- **Context window (`F05.context-window-meter`).** Run `control-openhands browser attr 'testid=context-window-meter' aria-label` (`Context window usage: 1% used (99% left)`), `control-openhands browser click 'testid=context-window-meter'` and `control-openhands browser text 'testid=context-window-meter-popover'` (`Context Window`, the percentage, `Compact context`, tokens such as `11.7k / 1.0M`, `Usage`). `control-openhands browser click 'testid=context-window-meter-bar-button'` (the progress bar) closes the popover and opens the Usage tab (`control-openhands browser testids --filter usage` lists `conversation-tab-usage`, `usage-panel`). The popover's `Usage` row does the same: from another tab (`control-openhands browser click 'testid=conversation-tab-files'`), reopen the ring, `control-openhands browser click 'testid=context-window-plan-usage'` and `control-openhands browser wait 'testid=usage-panel'` (the panel mounts a moment later; an immediate `count` is `0`). Reopen the ring, then `control-openhands browser click 'testid=context-window-compact-button' --observe '[role=status]' --observe-ms 25000`: `Context compaction started`, then `Context compacted`; `control-openhands conversation events <id> --kinds CondensationRequest,Condensation --last 5` lists both kinds.- **Stop and resume (`F05.stop-resume`) with a queued follow-up (`F05.queued-message`).** Send `Run this shell command: sleep 25 && echo slept. Then reply with only: done` (type + Enter as above), `control-openhands conversation wait <id> --until running --timeout 30` and `control-openhands browser wait 'testid=stop-button'`; `control-openhands browser attr 'testid=stop-button' aria-label` is `Stop`. While it runs, `control-openhands browser enabled 'testid=submit-button'` is `false` with an empty field; type `Also reply with: queued-ok` (enabled turns `true`) and press Enter. Run `control-openhands browser click 'testid=stop-button'` and `control-openhands browser wait 'testid=play-button' --timeout 30000`; `control-openhands browser text 'testid=interactive-chat-box'` ends `Stopped`, `control-openhands browser attr 'testid=play-button' aria-label` is `Resume the agent task` and `control-openhands conversation status <id>` is `paused`. Run `control-openhands browser click 'testid=play-button'`, wait for `running` then the terminal state: the last agent message is `done queued-ok` and `testid=user-message >> has-text=queued-ok` counts `1`.-- **Slash menu (`F05.slash-menu`).** On a cleared composer run `control-openhands browser type 'testid=chat-input' '/'`, `control-openhands browser count 'testid=slash-command-menu >> role=option'` (37 with the bundled skills) and `control-openhands browser text 'testid=slash-command-menu'`: `Commands`, then `/btw`, `/model`, `/goal`, `/plan`, `/code` with descriptions, then skills (`/agent-creator`, …); no `/new` on the local backend. Type `mo`: the count drops (descriptions match too). `control-openhands browser attr 'testid=slash-command-menu >> role=option >> nth=0' aria-selected` is `true`; after `control-openhands browser press ArrowDown` the selected option is `/plan` (read it with `control-openhands browser text 'testid=slash-command-menu >> [aria-selected=true]'`). `control-openhands browser press Escape` closes the menu and keeps `/mo`. On `/btw`, `control-openhands browser press Tab` leaves `/btw ` in the field; on `/model ` (trailing space) the menu lists `/model deepseek-flash` and `/model deepseek-pro`, and `control-openhands browser press Enter` inserts `/model deepseek-flash ` instead of sending.+- **Slash menu (`F05.slash-menu`).** On a cleared composer run `control-openhands browser type 'testid=chat-input' '/'`, `control-openhands browser count 'testid=slash-command-menu >> role=option'` (38 with the bundled skills) and `control-openhands browser text 'testid=slash-command-menu'`: `Commands`, then `/btw`, `/model`, `/goal`, `/plan`, `/code` with descriptions, then skills (`/agent-creator`, …); no `/new` on the local backend. Type `mo`: the count drops (descriptions match too). `control-openhands browser attr 'testid=slash-command-menu >> role=option >> nth=0' aria-selected` is `true`; after `control-openhands browser press ArrowDown` the selected option is `/plan` (read it with `control-openhands browser text 'testid=slash-command-menu >> [aria-selected=true]'`). `control-openhands browser press Escape` closes the menu and keeps `/mo`. On `/btw`, `control-openhands browser press Tab` leaves `/btw ` in the field; on `/model ` (trailing space) the menu lists `/model deepseek-flash` and `/model deepseek-pro`, and `control-openhands browser press Enter` inserts `/model deepseek-flash ` instead of sending.- **`/model` (`F05.slash-model`).** Type `/model deepseek-pro`, `control-openhands browser press Escape` (close the menu), `control-openhands browser press Enter --selector 'testid=chat-input'`: `Switched to profile` appears, the pill reads `deepseek-pro` and `conversation status <id>` shows `deepseek/deepseek-v4-pro`. Bare `/model` (Escape, Enter) adds `Available profiles (2)` to `testid=model-messages`; `control-openhands browser click 'testid=model-messages >> role=button[name="Expand"]'` and `control-openhands browser click 'role=button[name="Toggle details for deepseek-pro"]'` show `model: deepseek/deepseek-v4-pro`, `base_url: —`, `api_key: set`. `/model qa-nope` (Escape, Enter) toasts `Profile 'qa-nope' not found` (`control-openhands browser toasts`) and the pill keeps `deepseek-pro`. Restore with `/model deepseek-flash`.- **`/btw` (`F05.slash-btw`).** Note `control-openhands conversation events <id> --kinds MessageEvent` count, type `/btw Reply with only: side-ok`, Escape, Enter. `control-openhands browser text 'testid=btw-messages'` is `BTW:` + the question and `testid=btw-spinner` counts `1`; after the answer the card shows `Got it`. `control-openhands browser click 'testid=btw-messages >> role=button[name="Expand"]'` reveals `side-ok`; `control-openhands browser click 'testid=btw-messages >> role=button[name="Got it"]'` removes the card (count `0`). The MessageEvent count is unchanged. Bare `/btw` (Escape, Enter) clears the field and `control-openhands browser toasts` shows `Please provide a question — e.g. /btw <question>`; `control-openhands browser count 'testid=btw-messages'` stays `0`.- **`/goal` (`F05.slash-goal`).** Bare `/goal` + Enter: `control-openhands browser toasts` shows `Please provide an objective — e.g. /goal <objective>`. Send `/goal --max 1 Reply with only: goal-ok`: `control-openhands browser text 'testid=goal-status'` reads `Goal: … Round 0/1 running Stop`; `control-openhands browser wait 'testid=goal-done' --timeout 150000`, then `Round 1/1 complete score 100%`. Send `/goal --max 2 Reply with only: goal-two` and at once `control-openhands browser click 'testid=goal-status >> nth=-1 >> testid=goal-stop'`; `control-openhands browser wait 'testid=goal-resume'` and the banner reads `Round 0/2 interrupted Resume`. `control-openhands browser click 'testid=goal-resume'` sets it `running`; poll `control-openhands browser text 'testid=goal-status >> nth=-1'` until a new row ends `Round 1/2 complete score 100%`. The old `Round 0/2 interrupted` row no longer offers Resume: `control-openhands browser count 'testid=goal-resume'` is `0`. After `control-openhands browser reload`, `control-openhands browser count 'testid=goal-status'` is `3` and the `goal-resume` count is still `0`.diff --git a/.agents/skills/verify-openhands/references/feature-map/F06-agent-activity.md b/.agents/skills/verify-openhands/references/feature-map/F06-agent-activity.mdindex 878a75057b..c88af69b51 100644--- a/.agents/skills/verify-openhands/references/feature-map/F06-agent-activity.md+++ b/.agents/skills/verify-openhands/references/feature-map/F06-agent-activity.md@@ -15,7 +15,7 @@ Source: `src/components/features/chat/chat-interface.tsx`, `src/components/conve## Sub-features- `F06.empty-state-suggestions`: an empty conversation shows "Let's start building!" with four suggestion chips; a chip fills the composer with its prompt.-- `F06.user-and-agent-messages`: user and agent bubbles; a long user message is clipped with a gradient and expands on click ("View More").+- `F06.user-and-agent-messages`: user and agent bubbles; a long user message is clipped with a gradient and expands on click ("View More"). Drag-selecting inside a message keeps the selection in the message list. Known failure (reproduced 2026-10-20, [#18673](https://github.com/OpenHands/OpenHands/issues/18673)): on a reply taller than the viewport, scrolled up from the bottom (`browser eval` setting `document.querySelector("[data-testid=chat-scroll-container]").scrollTop = 700`), `control-openhands browser drag 'testid=agent-message >> nth=0 >> css=p,li >> nth=<an item about 370 px from the top>' --by 0,600 --steps 150` ends the selection in `chat-git-control-bar` (the composer pill text is selected) and jumps the feed to its bottom; `--by 0,-400` ends it in the header (`conversation-git-actions-toggle`). Read the `getSelection()` focus node with `browser eval`. A drag that stays inside the feed keeps the focus in `markdown-renderer`.- `F06.message-copy`: hovering a bubble shows Copy to clipboard; it copies the message's markdown source and the label flips to Copied to clipboard for 2 s.- `F06.code-block-copy`: hovering a fenced code block in an agent reply shows its own Copy button, which copies only the code.- `F06.timestamps`: hovering a bubble or tool title shows the event's local date and time.@@ -72,7 +72,7 @@ Preconditions:- The harness browser grants clipboard access: `control-openhands browser clipboard` reads what a Copy button wrote and `browser clipboard --write qa-empty` resets it first.- A terminal call can come back as "The terminal session was reset..." after this run's agent server restarts; the model reruns it, which turns one action into a group of two (see Gotchas).-- **One run that exercises the stream (`F06.markdown-rendering`, `F06.event-groups`, `F06.thinking`, `F06.events-match`).** Run `control-openhands conversation start --prompt "Run the terminal command 'echo qa-f06-hello', then create a file qa_f06.txt containing the word hi. Finally reply with a markdown table with columns Step and Result (two rows) followed by a python code block that prints 1." --wait --timeout 300`, then `control-openhands browser testids 'testid=chat-interface'` and `control-openhands browser snapshot 'testid=agent-message'`. The testids include `user-message`, `event-group` ("3 actions completed"), `agent-message`, `markdown-table-scroll` with `markdown-table-scroll-fade-left`/`-right`; the snapshot shows a `table` with column headers Step and Result and a `code` block `print(1)`. Compare with `control-openhands conversation events <id>`: one user and one agent `MessageEvent`, three `ActionEvent`s (`terminal`, `file_editor`, `canvas_ui_control`), matching one `user-message`, one group of three rows and one `agent-message`. The thinking row (`collapsible-thinking`) lives inside the group, so it is listed only after the next bullet expands it.+- **One run that exercises the stream (`F06.markdown-rendering`, `F06.event-groups`, `F06.thinking`, `F06.events-match`).** Run `control-openhands conversation start --prompt "Run the terminal command 'echo qa-f06-hello', then create a file qa_f06.txt containing the word hi. Finally reply with a markdown table with columns Step and Result (two rows) followed by a python code block that prints 1." --wait --timeout 300`, then `control-openhands browser testids 'testid=chat-interface'` and `control-openhands browser snapshot 'testid=agent-message'`. The testids include `user-message`, `event-group` ("3 actions completed"), `agent-message`, `markdown-table-scroll` with `markdown-table-scroll-fade-left`/`-right`; the snapshot shows a `table` with column headers Step and Result and a `code` block `print(1)`. Compare with `control-openhands conversation events <id>`: one user and one agent `MessageEvent`, three `ActionEvent`s (`terminal`, `file_editor`, `canvas_ui_control`), matching one `user-message`, one group of three rows and one `agent-message` for the reply, plus one more `agent-message` before the group when the first action carries thought text (such as `I'll run the command and create the file.`); scope later reply checks with `testid=agent-message >> nth=-1`. The thinking row (`collapsible-thinking`) lives inside the group, so it is listed only after the next bullet expands it.- **Expand a group and its rows (`F06.event-groups`, `F06.thinking`, `F06.tool-visualizers`).** Run `control-openhands browser click 'testid=event-group-toggle'` (label becomes Collapse actions), `control-openhands browser text 'testid=event-group'` (three titles, e.g. "Echo test string in terminal", "Create qa_f06.txt containing hi"; titles are model-written), then `control-openhands browser click 'testid=event-group-content >> role=button[name="Expand"][exact] >> nth=0'` twice (each click expands the next collapsed row). The group text now contains `echo qa-f06-hello` and its output `qa-f06-hello`, the file path chip (`testid=file-path-chip`) and the content `hi`. `control-openhands browser click 'testid=collapsible-thinking-toggle >> nth=0'` reveals `collapsible-thinking-content`. Take `control-openhands browser screenshot 'testid=chat-interface' --feature F06.tool-visualizers --name bash-and-file`.- **Open files from the stream (`F06.workspace-path-links`).** On the same page the agent may already have opened the file; run `control-openhands browser click 'testid=file-quick-row-close-qa_f06.txt'` and check `control-openhands browser count 'testid=file-quick-row-item-qa_f06.txt'` is `0`. Run `control-openhands browser click 'testid=agent-message >> testid=markdown-file-path-link'`: the count is `1` and `control-openhands browser text 'testid=file-content-viewer-plain'` is `hi`. Close it again and `control-openhands browser click 'testid=file-path-chip'` (inside the expanded file-editor row): the count is `1` again.- **Markdown file preview (`F06.markdown-file-preview`).** Run `control-openhands conversation start --prompt "Use the file_editor tool to create the file qa_notes.md containing a heading '# QA Notes' and one bullet '- first'. Do nothing else and reply DONE." --wait --timeout 150`. Without any click, `control-openhands browser text 'testid=markdown-file-preview'` reads `QA Notes first qa_notes.md View` (rendered heading and bullet, then the file name) and `count 'testid=event-group'` is `0`. `control-openhands browser count 'testid=file-quick-row-item-qa_notes.md'` is `0`; `control-openhands browser click 'testid=markdown-file-preview-view'` makes it `1` and `control-openhands browser text 'testid=file-content-viewer-markdown'` reads `QA Notes first`. Then `control-openhands browser goto /conversations/<stream id>` to return to the stream conversation for the next bullets.@@ -108,7 +108,7 @@ Preconditions:- **Phone (`F06.phone`).** Run `control-openhands browser viewport phone`, open the table conversation (`control-openhands browser goto /conversations/<stream id>`), `control-openhands browser bbox 'testid=chat-interface'` (`insideViewport` `true`, `pageHorizontalOverflow` `false`) and `control-openhands browser bbox 'testid=markdown-table-scroll'` (`scrollWidth` larger than `clientWidth`: the table scrolls inside itself). `control-openhands browser screenshot --feature F06.phone --name conversation`, then `control-openhands browser viewport desktop`.- After each group run `control-openhands browser errors --app-only`. Outages driven with `service stop` log connection-refused console errors by design; `pageErrors` must stay `0`.-- **Planner discovery with many children (`F06.tool-visualizers`).** Expected: reloading a parent still discovers its `plannerparent`-tagged planner when it has 100 child conversations. Known failure (reproduced 2026-10-19, SDK 1.55.1, [OpenHands/software-agent-sdk#5790](https://github.com/OpenHands/software-agent-sdk/issues/5790)): the unchunked 100-ID request returns 500, shows `Internal Server Error` and omits the planner session connection. A99-child control returns 200 and opens both planner and parent sockets. A newer Agent Server answers the 100-ID request with 422 (at most 99 IDs), so discovery also needs the UI to split the child-ID batch. These are genuine idle API-created children, without a model run or browser-storage changes; a new parent ID has no UI-created planner hint.+- **Planner discovery with many children (`F06.tool-visualizers`).** Expected: reloading a parent still discovers its `plannerparent`-tagged planner when it has 100 child conversations. Remaining Canvas discovery gap (reproduced 2026-10-20, Agent Server 1.56.0): [SDK#5790](https://github.com/OpenHands/software-agent-sdk/issues/5790) is closed, fixed by [SDK#5795](https://github.com/OpenHands/software-agent-sdk/pull/5795). The server now correctly rejects more than 99 IDs with 422; Canvas still sends an unchunked 100-ID request, which toasts `List should have at most 99 items after validation, not 100` and omits the planner session connection, so discovery needs the UI to split the child-ID batch. A 99-child control returns 200 and opens both planner and parent sockets. These are genuine idle API-created children, without a model run or browser-storage changes; a new parent ID has no UI-created planner hint.```sh known-bug F06.tool-visualizers planner-batch-100control-openhands browser viewport desktopQA_ID="$(python3 - <<'PY'@@ -141,7 +141,7 @@ Preconditions:control-openhands browser goto "/conversations/$QA_ID"control-openhands browser wait 'testid=chat-input'control-openhands browser screenshot --feature F06.tool-visualizers --name planner-batch-100- control-openhands assert --field recent.0.status --equals 200 --bug-shows 500 -- browser network --filter "ids=$QA_PLANNER" # bug+ control-openhands assert --field recent.0.status --equals 200 --bug-shows 422 -- browser network --filter "ids=$QA_PLANNER" # bug```Regression check (`F06.markdown-rendering`, toml-chat):diff --git a/.agents/skills/verify-openhands/references/feature-map/F07-conversation-page.md b/.agents/skills/verify-openhands/references/feature-map/F07-conversation-page.mdindex 35288afeef..64c2564af5 100644--- a/.agents/skills/verify-openhands/references/feature-map/F07-conversation-page.md+++ b/.agents/skills/verify-openhands/references/feature-map/F07-conversation-page.md@@ -16,7 +16,7 @@ Source: `src/routes/conversation.tsx`, `src/components/features/conversation/`,- `F07.history-skeleton`: opening a conversation shows a message skeleton until its history has loaded.- `F07.panel-route`: at phone width (up to 1024 px) the header panel button opens `/conversations/<id>/panel`, the tabs panel full width with a Back button; wider, that URL redirects to `/conversations/<id>` with the drawer open beside the chat.- `F07.rename-inline`: double-click the title (or menu Rename), Enter or blur saves with a toast; an empty value reverts.-- `F07.status-menu`: hovering the status dot (or tapping it on touch) opens a menu with the state and Stop Runtime (active) or Start Runtime (paused).+- `F07.status-menu`: hovering the status dot (or tapping it on touch) opens a menu with the state and Stop Runtime (active) or Start Runtime (paused). A conversation whose runtime is missing and cannot be resumed shows neither, and its dot agrees with the sidebar's archive icon. Known failure (reproduced twice 2026-10-20, [#18715](https://github.com/OpenHands/OpenHands/issues/18715)): with the F04 "Missing runtime" arrangement, the page shows `Sandbox no longer available` but the header dot stays green and `browser text 'testid=server-status-context-menu'` reads `Running` / `Stop Runtime`; clicking Stop Runtime gets a 404 from `/interrupt` and the toasts `Failed to stop conversation` and `Conversation not found`.- `F07.menu-open`: the "..." menu opens under the title; Escape closes it and returns focus to "...", and so does an outside click (without the focus move).- `F07.menu-items-by-state`: Show Available Hooks and Stop Conversation appear only while the conversation is active.- `F07.skills-modal`: Show Available Skills lists the loaded skills with expandable rows and Refresh.@@ -32,7 +32,7 @@ Source: `src/routes/conversation.tsx`, `src/components/features/conversation/`,- `F07.right-panel-toggle`: the header panel button shows and hides the right tabs panel (closed again after a reload).- `F07.overview-toggle`: the header (i) button shows and hides the Overview column, which is exclusive with the right panel. At phone width it should reveal the Overview content on click. Known failure (reproduced twice 2026-10-19, [#16792](https://github.com/OpenHands/OpenHands/issues/16792)): at 390×844 the label changes from Show overview to Hide overview, but neither the Overview panel nor a phone dropdown renders.- `F07.git-actions-menu`: the header Git actions menu offers Commits, Pull, Push, Create PR and Create New Branch; each pre-fills the composer without sending, and Send becomes enabled so the user can submit or edit the prompt.-- `F07.git-control-bar`: under the composer, a folder workspace shows an inert workspace chip and the branch; with a GitHub `origin` the repo and branch chips link to GitHub and Pull, Push and Pull Request appear. The chip icons are visible in every theme. Known failure (reproduced twice 2026-10-19, [#18657](https://github.com/OpenHands/OpenHands/issues/18657)): in Light+ and Solarized Light the workspace (forked-repo) and branch chip icons are drawn white (`browser eval` of the `svg` computed `color` in `testid=chat-git-control-bar` is `rgb(255, 255, 255)`) on the light surface, so they are invisible at desktop and phone width; the default dark theme is unaffected.+- `F07.git-control-bar`: under the composer, a folder workspace shows an inert workspace chip and the branch; with a GitHub `origin` the repo and branch chips link to GitHub and Pull, Push and Pull Request appear. The chip icons are visible in every theme. `browser eval` of the workspace (forked-repo), branch, external-link and Pull/Push/Pull Request icon `svg` computed `color` in `testid=chat-git-control-bar` equals its chip label's (`rgb(31, 31, 31)` in Light+, `rgb(0, 43, 54)` in Solarized Light, white in the default dark theme), at desktop and phone width; the GitHub logo in the repo chip keeps its own visible colour.- `F07.git-control-bar-send`: the Pull, Push and Pull Request chips send their git prompt to the agent at once.- `F07.cloud-only`: Share publicly, Connect Repo, `task-<uuid>` start URLs, paused-sandbox resume, archived read-only state and the shared-conversation redirect exist only on a Cloud backend.- `F07.phone`: at 390 px the header keeps its controls and the info dialogs fit the viewport.@@ -83,7 +83,7 @@ Preconditions:- **Panel route (`F07.panel-route`).** Run `control-openhands browser viewport phone`, open `/conversations/<id>` (`control-openhands browser goto /conversations/<id>`), `control-openhands browser click 'testid=right-panel-toggle' --expect-url '/panel$'` and `control-openhands browser testids --filter mobile` (`conversation-mobile-panel-top`, `conversation-mobile-panel-back`), then `control-openhands browser click 'testid=conversation-mobile-panel-back' --expect-url '/conversations/[0-9a-f-]+$'`. Direct entry at phone width: `control-openhands browser goto /conversations/<id>/panel` and `control-openhands browser wait 'testid=conversation-mobile-panel-back'` succeed (`control-openhands browser screenshot --feature F07.panel-route --name phone-direct`). The panel page serves every width up to 1024 px: after `control-openhands browser viewport tablet` the URL still ends `/panel` and `control-openhands browser count 'testid=conversation-mobile-panel-back'` is `1`. Wider, there is no panel page: run `control-openhands browser viewport desktop`, then `control-openhands browser wait-url '/conversations/[0-9a-f-]+$'` (the app replaces `/panel` with `/conversations/<id>`), `control-openhands browser count 'testid=conversation-mobile-panel-back'` (`0`) and `control-openhands browser attr 'testid=right-panel-toggle' aria-pressed` (`true`: the drawer is open beside the chat). A desktop-width visit lands the same way (#18045): `control-openhands browser goto /conversations/<id>/panel`, `control-openhands browser wait-url '/conversations/[0-9a-f-]+$'`, the same count (`0`) and `aria-pressed` (`true`); `control-openhands browser screenshot --feature F07.panel-route --name desktop-redirect` shows the chat with the drawer open beside it.- **Git control bar (`F07.git-control-bar`).** On `/conversations/<git-id>` (`control-openhands browser goto /conversations/<git-id>`; Panel route ends on `/conversations/<id>`) run `control-openhands browser snapshot 'testid=interactive-chat-box'`: `button "qa-f07-repo" [disabled]` and the branch text `main`, no Pull/Push. Add a GitHub origin to the fixture (arrange step, outside the UI): `git -C <run>/workspace/qa-f07-repo remote add origin https://github.com/qa-example/qa-f07-repo.git`. Then `control-openhands browser reload` and the snapshot again: link `qa-example/qa-f07-repo` (`https://github.com/qa-example/qa-f07-repo`), link `main` (`…/tree/main`) and buttons `Pull`, `Push`, `Pull Request`.- **Pull sends at once (`F07.git-control-bar-send`).** Run `control-openhands browser click 'testid=interactive-chat-box >> role=button[name="Pull"][exact]'` and `control-openhands browser wait 'testid=user-message >> has-text=Please pull the latest code' --timeout 15000`; `conversation status <git-id>` is `running`. Stop it right away with Stop Conversation as in `F07.stop-confirm` (the fake remote cannot be pulled). Push and Pull Request are blocked: they need a real remote and GitHub credentials.-- **Cloud-only (`F07.cloud-only`).** Blocked without a Cloud backend. On local, confirm the absence: the menu testids (see `F07.menu-open`) have no `share-publicly-button`, and the git control bar shows no `Connect Repo` chip. With Cloud: the menu's **Share publicly** switch (`share-publicly-button`, then `copy-share-link-button`, `open-share-link-button`), the repo chip **Connect Repo** opening the Open repository modal (`close-open-repository-modal`), `/conversations/task-<uuid>` while a conversation starts, and the `Unavailable for Archives` tooltips (see F25).+- **Cloud-only (`F07.cloud-only`).** Blocked without a Cloud backend. On local, confirm the absence: the menu testids (see `F07.menu-open`) have no `share-publicly-button`, and the git control bar shows no `Connect Repo` chip. With Cloud: the menu's **Share publicly** switch (`share-publicly-button`, then `copy-share-link-button`, `open-share-link-button`), the repo chip **Connect Repo** opening the Open repository modal (`close-open-repository-modal`), `/conversations/task-<uuid>` while a conversation starts, and the `Unavailable for Archives` tooltips (see F25). Connect Repo saves on the server: picking a repository and branch and clicking Launch sends `PATCH https://app.all-hands.dev/api/v1/app-conversations/<id>` (`200`, toast `Repository updated successfully`) and the agent is asked to clone it; after deleting this conversation's entry from localStorage `openhands-agent-server-conversation-metadata` and `browser reload`, the git bar still shows the repository and branch.- **Phone (`F07.phone`).** Run `control-openhands browser viewport phone`, `control-openhands browser testids 'testid=chat-pane-header'` (adds `sidebar-mobile-menu-toggle`; all header controls visible), open each info dialog from the menu and `control-openhands browser bbox 'testid=skills-modal'` (likewise `hooks-modal`, `system-message-modal`): `insideViewport` is `true` and `pageHorizontalOverflow` `false`. Then `control-openhands browser click 'testid=chat-pane-header >> testid=ellipsis-button'` and `control-openhands browser bbox 'testid=conversation-name-context-menu'`: inside the viewport too (`x` about 133, `width` about 249 when the menu lists `Show Agent Tools & Metadata`; about 143 and 239 without that row, e.g. a conversation whose system prompt event is not loaded), and `control-openhands browser screenshot --feature F07.phone --name header-menu` shows every label whole (`Show Available Skills`, `Download conversation data`, `Delete Conversation`). `control-openhands browser press Escape` closes it. Return with `control-openhands browser viewport desktop`.- **Whitespace-only header rename (`F07.rename-inline`).** After the named-title check, run `control-openhands browser network --clear`, double-click `testid=conversation-name-title`, fill `testid=conversation-name-input` with one space, and `control-openhands browser press Enter`. Read `control-openhands browser network --filter '/api/conversations' --bodies`, then reload and read the title. Expected: restore the previous title with no write. Known failure (reproduced 2026-10-12, [#17061](https://github.com/OpenHands/OpenHands/issues/17061)): Canvas submits `PATCH` with an empty title. Agent Server 1.54.0 rejects it with 422 and restores the prior title; a persistently blank server title was not observed.@@ -170,7 +170,6 @@ control-openhands assert --field count --equals 1 --bug-shows 0 -- browser count- An agent hook shows its `system_prompt`, the text it runs with, even when it also carries a `prompt`, and an agent hook with only a `prompt` shows no box. With `{"session_start":[{"hooks":[{"type":"agent","prompt":"QA_F07 stray prompt","system_prompt":"QA_F07 agent system prompt"}]}],"stop":[{"hooks":[{"type":"agent","prompt":"QA_F07 prompt only"}]}]}` in `hooks.json`, close, reopen and Refresh the dialog, then expand both events: `Session Start 1 hook` reads `Matcher * Commands QA_F07 agent system prompt Type: agent Timeout: 60s`, `Stop 1 hook` reads `Matcher * Commands Type: agent Timeout: 60s`, and `control-openhands browser count 'text=QA_F07 stray prompt'` and `browser count 'text=QA_F07 prompt only'` are `0` (`browser screenshot --feature F07.hooks-modal --name agent-hook-system-prompt`). Agent hooks in `hooks.json` really run on the next turn in that workspace (the session-start one shows a `Hook: SessionStart failed` row), so write the recipe's two-event `hooks.json` (`pre_tool_use` and `stop`) back and Refresh afterwards.- With the Agent Server down, Refresh in the Hooks dialog shows its own fetch error (#18177): after `control-openhands service stop agent-server` on an open dialog, `refresh-hooks` and `browser wait 'testid=hooks-modal >> text=Failed to fetch hooks' --timeout 30000`, the dialog reads `Failed to fetch hooks. Please try again later.` under its explanation (`browser count 'testid=hooks-modal >> text=Failed to fetch skills'` is `0`). The 502s and the closed WebSocket that `browser errors --app-only` then lists are the outage itself. Run it last, or `restart` afterwards.- After the user-message branch in `F07.branch-from-message`, Send stays disabled next to the prefilled text (`browser enabled 'testid=submit-button'` is `false`; Known failure #18202, see F05 Gotchas). Enter in the field sends it.-- Known issue [#18136](https://github.com/OpenHands/OpenHands/issues/18136) (`F07.cloud-only`): Connect Repo on a cloud conversation does not save the repository on the server. Live prerequisite: An authenticated Cloud sandbox/repository provider and a second fresh browser to compare server repository metadata.- Known issue [#17494](https://github.com/OpenHands/OpenHands/issues/17494) (`F07.export-transcript`): Transcript export leaks raw i18n template for ACP tool calls without a title. Live prerequisite: An authenticated ACP session that emits a titleless tool call, then Markdown and HTML export.- Known issue [#16876](https://github.com/OpenHands/OpenHands/issues/16876) (`F07.history-skeleton`): Planning-agent history flag stays true forever when sub-conversations fetch fails — infinite chat loading skeleton. Live prerequisite: A real planning sub-conversation whose batch lookup fails or yields null, with the main history available.- Known issue [#16727](https://github.com/OpenHands/OpenHands/issues/16727) (`F07.open-by-url`): Conversation corrupted after VM restart: "Missing event file". Live prerequisite: A disposable VM interrupted at the event-write boundary or the original missing-event persisted fixture.diff --git a/.agents/skills/verify-openhands/references/feature-map/F10-llm-profiles.md b/.agents/skills/verify-openhands/references/feature-map/F10-llm-profiles.mdindex 6e8a73b42e..8063e7f914 100644--- a/.agents/skills/verify-openhands/references/feature-map/F10-llm-profiles.md+++ b/.agents/skills/verify-openhands/references/feature-map/F10-llm-profiles.md@@ -196,7 +196,6 @@ control-openhands assert --field toasts.0.text --matches 'configured model.*16,0- Known issue [OpenHands/software-agent-sdk#4934](https://github.com/OpenHands/software-agent-sdk/issues/4934): Switching to a MiniMax M3 profile can fail because the SDK sends unsupported reasoning_effort. The runtime switch needs approved working credentials for the starting model and MiniMax route; the reported provider rejection cannot be proved with a loopback connection error. (`F10.schema-validation`, `F10.default-used`).- Known issue [OpenHands/software-agent-sdk#4613](https://github.com/OpenHands/software-agent-sdk/issues/4613): A namespaced model such as openai/openai/example-model can have its inner provider prefix stripped again in Responses API and reach the provider as example-model. Reproduction needs an approved OpenAI-compatible endpoint serving the namespaced model and its exact stored API-mode settings; a loopback connection refusal cannot prove the outbound identifier. (`F10.custom-model`).- Known issue [OpenHands/software-agent-sdk#4511](https://github.com/OpenHands/software-agent-sdk/issues/4511): Disabling prompt caching can still emit cache_control on preexisting cache-marked tool messages. The report only supplies a Python serializer reproduction; a Canvas check needs the exact persisted/tool-message precondition and a provider request that exposes the cache markers, with approved model access. (`F10.schema-validation`).-- Known issue [OpenHands/software-agent-sdk#4250](https://github.com/OpenHands/software-agent-sdk/issues/4250): A Cloud Workers AI configuration can fail on context-window validation or be routed as OpenAI with an invalid Cloudflare key. Reproduction needs a disposable OpenHands Cloud account, its Workers AI endpoint/key and the exact saved model configuration; the report supplies no complete configuration steps. (`F10.custom-model`, `F10.default-used`).- Known issue [OpenHands/software-agent-sdk#4247](https://github.com/OpenHands/software-agent-sdk/issues/4247): An LM Studio configuration can fail with LLM Provider NOT provided although its models endpoint works. Reproduction needs the reachable LM Studio service and the exact model ID/provider-qualified config, which the report does not supply as text; the reported CLI/Docker SDK 1.16.1 installation is not this source stack. (`F10.custom-model`).- Known issue [OpenHands/software-agent-sdk#5890](https://github.com/OpenHands/software-agent-sdk/issues/5890): Switching the conversation LLM can lose the managed-key refresh-on401 hook. Blocked: needs an approved managed-key refresh source and an allow-listed real model endpoint that returns 401 and accepts the refreshed key. Refused loopback cannot establish the refresh/retry outcome; do not supply a fake successful completion. (`F10.edit`, `F10.default-used`).- Known issue [OpenHands/software-agent-sdk#5862](https://github.com/OpenHands/software-agent-sdk/issues/5862): DeepSeek invalid-key401 responses can be classified as bad-request errors. Blocked by this pass's loopback-only provider routing: a real invalid-key validation request to DeepSeek must be authorized to capture its actual 401 shape. No usable key or successful inference is needed, but a loopback connection error does not prove this classification. (`F10.create-validation`).diff --git a/.agents/skills/verify-openhands/references/feature-map/F13-agent-profiles.md b/.agents/skills/verify-openhands/references/feature-map/F13-agent-profiles.mdindex ff665864f2..75f74e4c57 100644--- a/.agents/skills/verify-openhands/references/feature-map/F13-agent-profiles.md+++ b/.agents/skills/verify-openhands/references/feature-map/F13-agent-profiles.md@@ -59,7 +59,7 @@ Preconditions:- **ACP form (`F13.acp-form`).** In the Add editor run `control-openhands browser click 'testid=agent-type-selector'` and `control-openhands browser click 'role=option[name="ACP (external subprocess)"]'`. `control-openhands browser value 'testid=agent-preset-selector'` is `Claude Code`, `browser value 'testid=agent-command-input'` is `npx -y --prefer-offline @agentclientprotocol/[email protected]` and `browser value 'testid=agent-model-selector'` is `Agent default`; `agent-profile-no-llm` is gone (ACP needs no LLM profile). The preset list (`control-openhands browser click 'div:has(> div > input[data-testid=agent-preset-selector]) >> role=button[name="Show suggestions"]'`, then `control-openhands browser snapshot 'role=listbox'`) is `Claude Code`, `Codex`, `Gemini CLI`, `Pi`, `OpenCode`, `Custom` (`browser press Escape`). Pick `Codex` and `Gemini CLI` from `testid=agent-preset-selector`: the command becomes `npx -y --prefer-offline @agentclientprotocol/[email protected]` / `npx -y --prefer-offline @google/[email protected] --acp` and the model `Agent default` / `gemini-2.5-pro` (the models come from the agent since #18131: `F13.acp-model-discovery`). Pick `Custom`: the command is empty and Save is disabled. `control-openhands browser fill 'testid=agent-command-input' 'npx -y qa-custom-acp --stdio'` enables Save. Filling the exact Codex command flips the preset to `Codex`; appending ` --verbose` flips it back to `Custom`. Model override: with a built-in preset, run `control-openhands browser choose 'testid=agent-model-selector' 'Custom'` (or open the model list with its toggle button and `control-openhands browser click 'role=option[name="Custom"][exact]'`); `control-openhands browser count 'testid=agent-model-input'` is `1` and empty. The **Custom** preset shows `agent-model-input` directly (no model list).- **Create an ACP profile (`F13.create`).** With preset `Custom`, fill `testid=agent-profile-name-input` with `QA_acp_custom`, `testid=agent-command-input` with `'npx -y qa-custom-acp --stdio'` and `testid=agent-model-input` with `qa-model`, click `testid=save-agent-profile-btn`, then `control-openhands browser wait-text 'Profile "QA_acp_custom" created' --timeout 10000`, `control-openhands browser reload` and `control-openhands browser text 'testid=agent-profile-row >> has-text=QA_acp_custom'`: `QA_acp_custom` / `ACP (external subprocess)`. `control-openhands api GET /api/agent-profiles/QA_acp_custom` shows `acp_server` `custom`, the command and `acp_model` `qa-model`.- **Pi and OpenCode presets (`F13.acp-local-presets`).** For each of `OpenCode` and `Pi`: run `control-openhands browser click 'testid=add-agent-profile'`, `control-openhands browser choose 'testid=agent-type-selector' 'ACP (external subprocess)'` and `control-openhands browser choose 'testid=agent-preset-selector' '<preset>'`. `browser value 'testid=agent-command-input'` is `npx -y --prefer-offline [email protected] acp` / `npx -y --prefer-offline [email protected] --package=@earendil-works/[email protected] pi-acp` (the versions follow `@openhands/typescript-client`). Fill `testid=agent-profile-name-input` with `QA_opencode` / `QA_pi`, run `control-openhands browser wait 'testid=agent-model-discovering' --state detached --timeout 120000`, click `testid=save-agent-profile-btn` and `control-openhands browser wait-text 'Profile "<name>" created' --timeout 10000`. `control-openhands api GET /api/agent-profiles/<name>` has `acp_server` `opencode` / `pi`, `acp_command` `null` and `acp_model` `null`, and after `browser reload` both rows read `<name>` / `ACP (external subprocess)`. Cloud hides both presets (blocked here: needs a Cloud backend).-- **Models from the agent (`F13.acp-model-discovery`).** In a new ACP editor, each built-in preset pick first shows (unless a successful lookup for that preset and secret set is cached, about 5 minutes: OpenCode then skips it) `control-openhands browser text 'testid=agent-model-discovering'` `Asking <agent> which models it offers…` (the agent-server runs the agent CLI through npx for `POST /api/acp/models`; the first lookup can take a minute while npx downloads it). Wait with `control-openhands browser wait 'testid=agent-model-discovering' --state detached --timeout 120000`, then read `control-openhands browser testids --hidden --filter agent-model`. In this sandbox (no Claude, Codex, Gemini or Pi login for the agent-server): Claude Code fails to start and shows `agent-model-list-after-first-conversation` (`Claude Code's models appear here after your first conversation with it. You can also switch models from the chat.`); Codex, Gemini CLI and Pi need a login and show `agent-model-discovery-needs-auth` (`Sign in or add credentials above to see the models <agent> offers.`), with the model left at `Agent default` (`gemini-2.5-pro` for Gemini); `<run>/private/stack.log` logs `ACP model discovery failed: server=<key> code=ACPInitError|ACPAuthRequired`. OpenCode needs no key: `browser value 'testid=agent-model-selector'` is `Agent default (OpenCode/Big Pickle)` and the list (open it with `browser click 'div:has(> div > input[data-testid=agent-model-selector]) >> role=button[name="Show suggestions"]'`, then `browser snapshot 'role=listbox'`) has that entry, a non-empty list of the models OpenCode reports live (12 on 2026-10-13, such as `OpenCode/Big Pickle` and `OpenCode/Exo Free`) and `Custom` (screenshot `--feature F13.acp-model-discovery --name opencode-models`). Edit `QA_opencode`: Save is disabled until `control-openhands browser choose 'testid=agent-model-selector' 'OpenCode/Exo Free'`; Save (`Profile "QA_opencode" updated`) stores `acp_model` `opencode/exo-free`, and reopening shows `OpenCode/Exo Free` with Save disabled. With a saved `OPENAI_API_KEY` (even a dummy, `F13.acp-credentials`) Codex lists its models and shows `Agent default (GPT-6-Astra)`. Lookups never add a conversation to the list (`api GET "/api/conversations/search?limit=20"` stays empty).+- **Models from the agent (`F13.acp-model-discovery`).** In a new ACP editor, each built-in preset pick first shows (unless a successful lookup for that preset and secret set is cached, about 5 minutes: OpenCode then skips it) `control-openhands browser text 'testid=agent-model-discovering'` `Asking <agent> which models it offers…` (the agent-server runs the agent CLI through npx for `POST /api/acp/models`; the first lookup can take a minute while npx downloads it). Wait with `control-openhands browser wait 'testid=agent-model-discovering' --state detached --timeout 120000`, then read `control-openhands browser testids --hidden --filter agent-model`. In this sandbox (no Claude, Codex, Gemini or Pi login for the agent-server): Claude Code fails to start and shows `agent-model-list-after-first-conversation` (`Claude Code's models appear here after your first conversation with it. You can also switch models from the chat.`); Codex, Gemini CLI and Pi need a login and show `agent-model-discovery-needs-auth` (`Sign in or add credentials above to see the models <agent> offers.`), with the model left at `Agent default` (`gemini-2.5-pro` for Gemini); `<run>/private/stack.log` logs `ACP model discovery failed: server=<key> code=ACPInitError|ACPAuthRequired`. OpenCode needs no key: `browser value 'testid=agent-model-selector'` is `Agent default (OpenCode/Big Pickle)` and the list (open it with `browser click 'div:has(> div > input[data-testid=agent-model-selector]) >> role=button[name="Show suggestions"]'`, then `browser snapshot 'role=listbox'`) has that entry, a non-empty list of the models OpenCode reports live (it follows OpenCode's live catalog, such as `OpenCode/Big Pickle` and `OpenCode/Beam Free`) and `Custom` (screenshot `--feature F13.acp-model-discovery --name opencode-models`). Edit `QA_opencode`: Save is disabled until `control-openhands browser choose 'testid=agent-model-selector' 'OpenCode/Beam Free'` (or another listed model than the default); Save (`Profile "QA_opencode" updated`) stores `acp_model` `opencode/beam-free`, and reopening shows `OpenCode/Beam Free` with Save disabled. With a saved `OPENAI_API_KEY` (even a dummy, `F13.acp-credentials`) Codex lists its models and shows `Agent default (GPT-6-Astra)`. Lookups never add a conversation to the list (`api GET "/api/conversations/search?limit=20"` stays empty).- **Edit and rename (`F13.edit`).** Run `control-openhands browser click 'testid=agent-profile-row >> has-text=QA_acp_custom >> testid=agent-profile-menu-trigger'`; `control-openhands browser snapshot 'testid=agent-profile-actions-menu'` lists `Edit`, `Set as active`, `Delete`. Click `testid=agent-profile-edit`: the title is `Edit agent profile`, the description `Editing profile "QA_acp_custom" - save to apply changes`, the type/preset/command/model values are the stored ones, and Save is disabled. Note the `id` from `api GET /api/agent-profiles`, fill the name with `QA_acp_renamed`, click Save, `control-openhands browser wait-text 'Profile "QA_acp_renamed" updated' --timeout 10000` and `browser reload`: `browser count 'testid=agent-profile-row >> has-text=QA_acp_custom'` is `0`, the renamed row is `1` and `api GET /api/agent-profiles` shows the same id under the new name. Back/Cancel: open any editor, change a field, click `testid=back-to-agent-profiles` (or `testid=cancel-agent-profile-btn`); `browser count 'testid=add-agent-profile'` is `1` and the API is unchanged.- **Credentials (`F13.acp-credentials`).** In a new ACP editor with preset `Claude Code`, `control-openhands browser testids --hidden --filter acp` lists `settings-acp-secret-CLAUDE_CODE_OAUTH_TOKEN`, `-ANTHROPIC_API_KEY`, `-ANTHROPIC_BASE_URL` and one banner (`settings-acp-auth-detected` when the agent-server machine has a Claude CLI login: `You're already signed in to Claude Code — you can leave the fields below blank.`). `control-openhands browser attr 'testid=settings-acp-secret-ANTHROPIC_API_KEY' type` is `password`. Fill `settings-acp-secret-CLAUDE_CODE_OAUTH_TOKEN` with `qa-dummy-oauth` and `settings-acp-secret-ANTHROPIC_API_KEY` with `qa-dummy-key`; `control-openhands browser text 'testid=acp-credential-conflict-warning'` is `Setting ANTHROPIC_API_KEY alongside CLAUDE_CODE_OAUTH_TOKEN breaks its authentication — leave one of them blank.` (screenshot `--feature F13.acp-credentials --name conflict` after `browser scroll 'testid=acp-credential-conflict-warning'`). In every theme the banner text reaches 4.5:1: the detected banner (`settings-acp-auth-detected`) uses success text on a success tint (Light+ about 5.2:1) and the configured banner (`settings-acp-auth-configured`) neutral text on the raised surface (Light+ about 14:1); screenshot `--feature F13.acp-credentials --name detected-banner-lightplus`. Cancel; `api GET /api/settings/secrets` gains nothing. Saved credential: new profile `QA_codex`, ACP, preset `Codex`, fill `testid=settings-acp-secret-OPENAI_API_KEY` with `qa-dummy-openai`, Save (`Profile "QA_codex" created`); `api GET /api/settings/secrets` now lists `OPENAI_API_KEY` and the profile has `acp_server` `codex`, `acp_command` `null`, `acp_model` `null` (the agent's own default since #18131). Reopen it: `control-openhands browser testids --hidden --filter settings-acp-auth` shows `settings-acp-auth-configured` (`Credentials for Codex are configured — you can leave the fields below blank.`) and `control-openhands browser attr 'testid=settings-acp-secret-OPENAI_API_KEY' placeholder` is `Already saved — leave blank to keep` with an empty value.- **Secrets scope (`F13.secrets-scope`).** In the `QA_codex` editor, `control-openhands browser eval "[...document.querySelectorAll('[data-testid=agent-settings-secret-list] input')].map(i=>i.closest('li').innerText.split('\n')[0]+'='+i.checked+(i.disabled?'(disabled)':''))"` shows every name `=true(disabled)` under `No profile restriction`. Open `testid=agent-settings-secrets-mode`, `control-openhands browser click 'role=option[name="Choose secrets"]'` and rerun the eval: `OPENHANDS_AUTOMATION_API_KEY=false`, `OPENAI_API_KEY=true`, `CODEX_AUTH_JSON=true`, `OPENAI_BASE_URL=true`. Save (`Profile "QA_codex" updated`); `api GET /api/agent-profiles/QA_codex` has those three in `secret_refs`, and after `browser reload` and Edit the mode and switches are the same. On an OpenHands profile, Choose starts with nothing selected; a switch toggles by its name: in the Add editor pick `Choose secrets`, then `control-openhands browser click 'testid=agent-settings-secret-list >> text=OPENHANDS_AUTOMATION_API_KEY'` turns `document.querySelector('[data-testid=agent-settings-secret-OPENHANDS_AUTOMATION_API_KEY]').checked` from `false` to `true`.diff --git a/.agents/skills/verify-openhands/references/feature-map/F18-skills.md b/.agents/skills/verify-openhands/references/feature-map/F18-skills.mdindex f99e2487c1..d9b224d01c 100644--- a/.agents/skills/verify-openhands/references/feature-map/F18-skills.md+++ b/.agents/skills/verify-openhands/references/feature-map/F18-skills.md@@ -51,7 +51,7 @@ Source: `src/routes/skills-settings.tsx`, `src/components/features/skills/`, `srPreconditions:- Baseline state (launched, doctored, `onboard --skip` done); desktop viewport unless a bullet says otherwise.-- A fresh run lists only the bundled catalog, `<N>` skills, all with source `public`. `<N>` is the catalog length the checkout bundles: run `node --input-type=module -e "import {SKILLS_CATALOG} from '@openhands/extensions/skills'; console.log(SKILLS_CATALOG.length)"` in the checkout (68 with `@openhands/extensions` 0.29.0, #17998). The Source and Type facet groups stay hidden until a personal/project skill exists. `add-javadoc` and `flarglebargle` are off; `docker` is on (recommended).+- A fresh run lists only the bundled catalog, `<N>` skills, all with source `public`. `<N>` is the catalog length the checkout bundles: run `node --input-type=module -e "import {SKILLS_CATALOG} from '@openhands/extensions/skills'; console.log(SKILLS_CATALOG.length)"` in the checkout (69 with `@openhands/extensions` 0.31.0). The Source and Type facet groups stay hidden until a personal/project skill exists. `add-javadoc` and `flarglebargle` are off; `docker` is on (recommended).- `F18.skill-in-chat`, `F18.toggle-local`, `F18.copy-source` and `F18.install-banner` need an active LLM profile (`control-openhands llm preset deepseek`). `F18.install-banner` also needs the agent to reach github.com.- Personal skill fixture (arranged through the agent, not proof): run `control-openhands conversation start --prompt 'Use one shell command to create the file ~/.agents/skills/qa-hello/SKILL.md (create the folders) with exactly these 7 lines: "---", "name: qa-hello", "description: QA test skill that answers qa-ping with QA-PONG-7731.", "triggers:", "- qa-ping", "---", "When the user says qa-ping, reply with exactly QA-PONG-7731 and nothing else." Then reply done.' --wait --timeout 240`. Afterwards `/skills` shows `<N+1> result(s)` and a `qa-hello` card (type pill `Auto-discovery`), and the Enabled facet count goes from 12 to 13.- Project skill fixture for `F18.project-skill` (arranged, not proof; no model needed), in this family's own repo so the commit never lands in F08's `qa-repo`: `control-openhands fixture git-repo --name qa-f18-repo`, then `control-openhands fixture skill --repo qa-f18-repo --name qa-f18-skill --trigger qa-f18-ping --commit`: it writes `<run>/workspace/qa-f18-repo/.agents/skills/qa-f18-skill/SKILL.md` (`scope` `project`) and commits it in the fixture repo (`committed.sha` and `committed.message` `Add qa-f18-skill skill`; `git -C "$OH_VERIFY_RUN/workspace/qa-f18-repo" log --oneline` lists `Add qa-f18-skill skill` above `Initial fixture commit`). A re-run reports the same `committed.sha` with `committed.unchanged` `true`. Without `--commit` the file stays uncommitted, and a New Worktree checkout holds only committed files. A fixture skill's name must not be a substring of its trigger (see Gotchas).@@ -60,7 +60,7 @@ Preconditions:- **Open from the sidebar (`F18.page`).** From `/` run `control-openhands browser click 'testid=sidebar-skills-link' --expect-url '/mcp(\?|$)'`, `control-openhands browser click 'testid=sidebar-extensions-/skills' --expect-url '/skills(\?|$)'`, then `control-openhands browser text 'testid=skills-settings-description'` (`Discover skills to add to your workspace. Search above the cards or filter by state, recommendation, and category, then open a card to see its details and use the skill. Enable or disable default skills. Disabled skills will not be loaded into agent context.`, describing this layout since #18035), `control-openhands browser text 'testid=skills-new-conversation-notice'` (`Skill changes apply to new conversations only.`) and `control-openhands browser text 'testid=skills-result-summary'` (`<N> result(s)` on a fresh run). `control-openhands browser screenshot --feature F18.page --name desktop` shows the Customize nav, the facet rail and the card grid.- **Command-menu entry (`F18.page`).** From `/` run `control-openhands browser press Control+k`, `control-openhands browser type 'testid=command-menu >> role=combobox' Skills`, `control-openhands browser snapshot 'testid=command-menu'` (one option, `Customize Browse skills, plugins, and integrations. Go`), `control-openhands browser press Enter`, `control-openhands browser wait-url '/mcp(\?|$)'`, then `control-openhands browser click 'testid=sidebar-extensions-/skills' --expect-url '/skills(\?|$)'`.-- **Search (`F18.search`).** On `/skills` run `control-openhands browser fill 'testid=skills-search-input' docker`, `control-openhands browser text 'testid=skills-result-summary'` (`6 result(s)` on a fresh run: content matches count too) and, a second later, `control-openhands browser url` (ends in `/skills?q=docker`); `control-openhands browser eval "history.length"` is the same before and after typing. Then `control-openhands browser fill 'testid=skills-search-input' zzqa-nomatch` and `control-openhands browser text 'testid=skills-no-match'`: `No skills match your search.` with `0 result(s)`. Clear with `control-openhands browser click 'testid=skills-toolbar >> role=button[name="Clear search"]'`; `control-openhands browser value 'testid=skills-search-input'` is empty, the full count is back and `?q=` leaves the URL.+- **Search (`F18.search`).** On `/skills` run `control-openhands browser fill 'testid=skills-search-input' docker`, `control-openhands browser text 'testid=skills-result-summary'` (`5 result(s)` on a fresh run: content matches count too) and, a second later, `control-openhands browser url` (ends in `/skills?q=docker`); `control-openhands browser eval "history.length"` is the same before and after typing. Then `control-openhands browser fill 'testid=skills-search-input' zzqa-nomatch` and `control-openhands browser text 'testid=skills-no-match'`: `No skills match your search.` with `0 result(s)`. Clear with `control-openhands browser click 'testid=skills-toolbar >> role=button[name="Clear search"]'`; `control-openhands browser value 'testid=skills-search-input'` is empty, the full count is back and `?q=` leaves the URL.- **Back and forward (`F18.search-history`).** Run `control-openhands browser goto '/skills?q=docker'`, `control-openhands browser click 'testid=skill-facet-state-enabled'` (pushes `?q=docker&state=enabled`), `control-openhands browser fill 'testid=skills-search-input' github`, wait a second, then `control-openhands browser back` and `control-openhands browser value 'testid=skills-search-input'`: `docker`, URL `/skills?q=docker`. `control-openhands browser forward` gives `github` and `/skills?q=github&state=enabled`.- **Facets (`F18.facets`).** On `/skills` run `control-openhands browser click 'testid=skill-facet-recommendation-recommended'` (URL `?recommendation=recommended`, `12 result(s)`), `control-openhands browser click 'testid=skill-facet-state-enabled'` (URL `?state=enabled&recommendation=recommended`: canonical order, not click order), `control-openhands browser attr 'testid=skill-facet-state-enabled' aria-checked` (`true`), `control-openhands browser enabled 'testid=skill-facet-state-disabled'` (`false`, its count reads `0`), `control-openhands browser click 'testid=skill-facet-category-agent-authoring'` (`8 result(s)`), then `control-openhands browser click 'testid=skills-clear-filters'`: URL `/skills`, all results, and `control-openhands browser count 'testid=skills-clear-filters'` is `0`.- **Source and Type facets (`F18.facets`).** With the `qa-hello` fixture, `control-openhands browser text 'testid=skill-facet-group-source'` lists `This project 1` and `Built in <N>`, and `testid=skill-facet-group-type` lists `Auto-discovery 1` and `Trigger-based <N>`. `control-openhands browser click 'testid=skill-facet-source-project'` gives `?source=project` and `1 result(s)`; after Clear filters, `control-openhands browser click 'testid=skill-facet-type-agentskills'` gives `?type=agentskills` and only `qa-hello` (`control-openhands browser eval "[...document.querySelectorAll('[data-testid^=skill-name-]')].map(e=>e.textContent).join(',')"`). Clear filters again.@@ -71,10 +71,10 @@ Preconditions:- **Toggle a built-in skill (`F18.toggle`).** Run `control-openhands browser attr 'testid=skill-toggle-add-javadoc' aria-checked` (`false`; `aria-label` is `Enable skill`), `control-openhands browser click 'testid=skill-toggle-add-javadoc'` (no modal opens; `aria-checked` turns `true` and the Enabled facet count goes up by one), wait a second, `control-openhands browser reload` and read `aria-checked` again: `true`. `control-openhands api GET /api/settings --pick misc_settings.app_preferences.enabled_skills` lists `add-javadoc` (`--pick` paths start inside `body`). To switch an enabled skill off from its card, `control-openhands browser hover 'testid=skill-toggle-add-javadoc'` first (`attr ... data-showing-remove` is `true`), then click (see Gotchas).- **Toggle a personal skill (`F18.toggle-local`).** Run `control-openhands browser hover 'testid=skill-toggle-qa-hello'`, `control-openhands browser click 'testid=skill-toggle-qa-hello'`, wait a second, `control-openhands browser reload` and `control-openhands browser attr 'testid=skill-toggle-qa-hello' aria-checked` (`false`). `control-openhands api GET /api/settings` shows `disabled_skills: ["qa-hello"]` under `body.misc_settings.app_preferences` and `enabled_skills` without it. `control-openhands conversation start --prompt "qa-ping" --wait --timeout 240`, then `control-openhands api GET '/api/conversations/<id>/events/search?limit=5' --max-bytes 2000000` (id from `conversation start`): the user `MessageEvent` has `"activated_skills": []`. Back on `/skills` (`control-openhands browser goto /skills`; `conversation start` left the browser on the conversation), click the toggle on again (no hover needed), start another `qa-ping` conversation: `"activated_skills": ["qa-hello"]` and `control-openhands browser text 'testid=agent-message >> nth=-1'` is `QA-PONG-7731`; `disabled_skills` is `[]` again.- **Skill reaches chat (`F18.skill-in-chat`).** Run `control-openhands browser goto /skills` (the previous bullet ends on a conversation), `control-openhands browser click 'testid=skill-toggle-flarglebargle'` (`aria-checked` `true`), then `control-openhands conversation start --prompt "flarglebargle" --wait --timeout 240`, `control-openhands conversation events <id> --kinds MessageEvent --from-start` (the user row has `skills: ["flarglebargle"]`; the `events/search?limit=5` read this bullet used before can miss the user row) and `control-openhands browser text 'testid=agent-message >> nth=-1'` (a reply praising how smart the user is). `control-openhands browser screenshot --feature F18.skill-in-chat --name enabled`. Switch it off again on `/skills` (`control-openhands browser goto /skills`, hover, click; `enabled_skills` no longer lists it) and start another conversation with `--prompt "flarglebargle. Do not run any tools; reply in one line."`: the user row has no `skills`, and the agent does not praise the user (2026-10-08: `Flarglebargle to you too — what would you like help with?`).-- **Project skill in a workspace (`F18.project-skill`).** With the committed `qa-f18-skill` fixture, run `control-openhands browser goto /skills`, `control-openhands browser reload` and `control-openhands browser count 'testid=skill-card-qa-f18-skill'`: `0` (the catalog lists the Agent Server's own skills, not a workspace's). Then `control-openhands conversation start --workspace qa-f18-repo --prompt "qa-f18-ping" --wait --timeout 240` (note `<repo-skill-id>`; its `workspace` is the fixture's path) and, in the chat it leaves open, `control-openhands browser text 'testid=generic-event-message-title'` (`Skill Ready`; with a model a second title, `Invoked skill qa-f18-skill`, can follow, because the agent may also call `invoke_skill`), `control-openhands browser click 'role=button[name="Expand"]'` and `control-openhands browser count 'role=button[name="qa-f18-skill"]'` (`1`, under `Triggered Skill Knowledge:`); `control-openhands browser screenshot --feature F18.project-skill --name skill-ready`. With an LLM the agent also obeys the skill, and this is the moment to read it, while the chat is still open: `control-openhands browser text 'testid=agent-message >> nth=-1'` ends with `QA_SKILL_OK`; without a key the conversation ends in `error` right after the events below and that reply check is blocked (prerequisite: `DEEPSEEK_API_KEY`). Agent side, `control-openhands conversation events <repo-skill-id> --grep qa-f18-skill --from-start` matches the `SystemPromptEvent` (its `<available_skills>` lists `<name>qa-f18-skill</name>`) and the user `MessageEvent` (`skills: ["qa-f18-skill"]`, with excerpts showing `"activated_skills":["qa-f18-skill"]` and the `…/qa-f18-repo/.agents/skills/qa-f18-skill/SKILL.md` path). New Worktree: run `control-openhands workspace open qa-f18-repo --mode new_worktree` (it picks the mode in the preview bar's selector and prints `mode` `new_worktree` and `preview` `qa-f18-repo` / `New Worktree`; `control-openhands browser text 'testid=home-git-control-bar-preview'` reads the same two lines), then `control-openhands conversation start --stay --prompt "qa-f18-ping" --wait --timeout 240` (note `<worktree-id>`): its `workspace` is `/tmp/conversation-worktrees/<worktree-id>/qa-f18-repo`, a worktree of the fixture on branch `openhands/<worktree-id>` (read-only check: `git -C /tmp/conversation-worktrees/<worktree-id>/qa-f18-repo log --oneline` lists `Add qa-f18-skill skill` above `Initial fixture commit`), `control-openhands browser text 'testid=generic-event-message-title'` is `Skill Ready` again (and the same reply check applies here, with a key), and `control-openhands conversation events <worktree-id> --grep qa-f18-skill --from-start` matches the same events with the worktree's `SKILL.md` path (a `ConversationStateUpdateEvent` carrying the agent context matches in both conversations too). Restore the mode: `control-openhands workspace open qa-f18-repo --mode local_repo` (`mode` `local_repo`, `preview` `qa-f18-repo` / `Local Repo`).+- **Project skill in a workspace (`F18.project-skill`).** With the committed `qa-f18-skill` fixture, run `control-openhands browser goto /skills`, `control-openhands browser reload` and `control-openhands browser count 'testid=skill-card-qa-f18-skill'`: `0` (the catalog lists the Agent Server's own skills, not a workspace's). Then `control-openhands conversation start --workspace qa-f18-repo --prompt "qa-f18-ping" --wait --timeout 240` (note `<repo-skill-id>`; its `workspace` is the fixture's path) and, in the chat it leaves open, `control-openhands browser text 'testid=generic-event-message-title'` (`Skill Ready`; with a model a second title can follow, because the agent may also call `invoke_skill`: the action's summary, such as `Load qa-f18-skill instructions`, or `Invoked skill qa-f18-skill` when it has none), `control-openhands browser click 'role=button[name="Expand"][exact] >> nth=0'` and `control-openhands browser count 'role=button[name="qa-f18-skill"]'` (`1`, under `Triggered Skill Knowledge:`); `control-openhands browser screenshot --feature F18.project-skill --name skill-ready`. With an LLM the agent also obeys the skill, and this is the moment to read it, while the chat is still open: `control-openhands browser text 'testid=agent-message >> nth=-1'` ends with `QA_SKILL_OK`; without a key the conversation ends in `error` right after the events below and that reply check is blocked (prerequisite: `DEEPSEEK_API_KEY`). Agent side, `control-openhands conversation events <repo-skill-id> --grep qa-f18-skill --from-start` matches the `SystemPromptEvent` (its `<available_skills>` lists `<name>qa-f18-skill</name>`) and the user `MessageEvent` (`skills: ["qa-f18-skill"]`, with excerpts showing `"activated_skills":["qa-f18-skill"]` and the `…/qa-f18-repo/.agents/skills/qa-f18-skill/SKILL.md` path). New Worktree: run `control-openhands workspace open qa-f18-repo --mode new_worktree` (it picks the mode in the preview bar's selector and prints `mode` `new_worktree` and `preview` `qa-f18-repo` / `New Worktree`; `control-openhands browser text 'testid=home-git-control-bar-preview'` reads the same two lines), then `control-openhands conversation start --stay --prompt "qa-f18-ping" --wait --timeout 240` (note `<worktree-id>`): its `workspace` is `/tmp/conversation-worktrees/<worktree-id>/qa-f18-repo`, a worktree of the fixture on branch `openhands/<worktree-id>` (read-only check: `git -C /tmp/conversation-worktrees/<worktree-id>/qa-f18-repo log --oneline` lists `Add qa-f18-skill skill` above `Initial fixture commit`), `control-openhands browser text 'testid=generic-event-message-title'` is `Skill Ready` again (and the same reply check applies here, with a key), and `control-openhands conversation events <worktree-id> --grep qa-f18-skill --from-start` matches the same events with the worktree's `SKILL.md` path (a `ConversationStateUpdateEvent` carrying the agent context matches in both conversations too). Restore the mode: `control-openhands workspace open qa-f18-repo --mode local_repo` (`mode` `local_repo`, `preview` `qa-f18-repo` / `Local Repo`).- **Deleted personal skill (`F18.skill-deleted`).** Run `control-openhands fixture skill --name qa-gone --trigger qa-farewell`, `control-openhands browser goto /skills`, `control-openhands browser reload`, `control-openhands browser count 'testid=skill-card-qa-gone'` (`1`; `control-openhands browser attr 'testid=skill-source-qa-gone' title` is the run's `…/private/home/.agents/skills/qa-gone/SKILL.md` path and `control-openhands browser text 'testid=skills-result-summary'` counts one result more than before) and `control-openhands browser screenshot --feature F18.skill-deleted --name present`. Prove it loads: `control-openhands conversation start --prompt "qa-farewell" --wait --timeout 240` (note `<gone-a>`), `control-openhands browser text 'testid=generic-event-message-title'` (`Skill Ready`) and `control-openhands conversation events <gone-a> --grep qa-gone --from-start`: the `SystemPromptEvent` and the user `MessageEvent` match, the latter with `skills: ["qa-gone"]`. Delete the folder (outside the UI; it is inside the run): `rm -rf "$OH_VERIFY_RUN/private/home/.agents/skills/qa-gone"`. Then `control-openhands browser goto /skills`, `control-openhands browser reload`, `control-openhands browser count 'testid=skill-card-qa-gone'` (`0`; the summary is back to its earlier count), `control-openhands conversation start --prompt "qa-farewell. Do not run any tools; reply in one line." --wait --timeout 240` (note `<gone-b>`; with a model, a bare `qa-farewell` sent deepseek-flash searching the disk for the word, and it quoted the run's `stack.log` line `Skill 'qa-gone' triggered by keyword 'qa-farewell'`, so `--grep qa-gone` matched 9 tool rows although the skill was not loaded), `control-openhands browser count 'text=Skill Ready'` (`0`; `control-openhands browser screenshot --feature F18.skill-deleted --name absent`) and `control-openhands conversation events <gone-b> --grep qa-gone --from-start`: `count` is `0`, and `control-openhands conversation events <gone-b> --kinds MessageEvent --from-start` shows the user message without a `skills` row. No model is needed: the skill set is fixed before the first model call.- **Both personal skill folders (`F18.personal-skill-dirs`).** The `qa-gone` bullet above used `~/.agents/skills`. For the other folder, write a fixture into the stack's persistence folder (outside the UI, inside the run; `fixture skill` writes only `~/.agents/skills`): `mkdir -p "$OH_VERIFY_RUN/private/skills/qa-legacy"` and a `SKILL.md` there with the front matter `name: qa-legacy`, `description: QA fixture skill in the persistence-dir skills folder.`, `triggers: [qa-legacy-ping]` and the body `When this skill is active, end your reply with the word QA_LEGACY_OK.` (`$OH_VERIFY_RUN/private` is the Agent Server's `OH_PERSISTENCE_DIR`, which replaces `~/.openhands`). Run `control-openhands browser goto /skills`, `control-openhands browser reload`, `control-openhands browser count 'testid=skill-card-qa-legacy'` (`1`) and `control-openhands browser attr 'testid=skill-source-qa-legacy' title` (`…/private/skills/qa-legacy/SKILL.md`). Then `control-openhands conversation start --prompt "qa-legacy-ping. Do not run any tools; reply in one line." --wait --timeout 240` (note `<legacy-id>`): `control-openhands browser text 'testid=generic-event-message-title'` is `Skill Ready`, `control-openhands conversation events <legacy-id> --kinds MessageEvent --from-start` shows the user row with `skills: ["qa-legacy"]`, and with a model `control-openhands browser text 'testid=agent-message >> nth=-1'` ends with `QA_LEGACY_OK` (`control-openhands browser screenshot --feature F18.personal-skill-dirs --name persistence-dir-skill`). Clean up with `rm -rf "$OH_VERIFY_RUN/private/skills/qa-legacy"`, `browser goto /skills`, `browser reload`; the card count is `0`.-- **Save failure (`F18.toggle-error`).** Run `control-openhands browser goto /skills`, wait for `testid=skill-toggle-add-javadoc` and note its `aria-checked` (`true` when this follows the toggle bullet, which left `add-javadoc` on). Then `control-openhands service stop agent-server`, `control-openhands browser click 'testid=skill-toggle-add-javadoc' --timeout 5000` (the card flips at once), wait about 2 s (the `PATCH /api/settings` is tried three times before the error shows; `browser network` lists three `502`s) and `control-openhands browser toasts --history`: `HTTP request failed (502 Bad Gateway): "Bad Gateway: connect ECONNREFUSED 127.0.0.1:<agent-server port>"`. `control-openhands browser screenshot --feature F18.toggle-error --name toast`. Run `control-openhands restart --timeout 240`, `control-openhands browser goto /skills`: `aria-checked` on `testid=skill-toggle-add-javadoc` is back to the value noted before the click and `enabled_skills` is unchanged. Clear the expected 502 noise with `control-openhands browser errors --clear`.+- **Save failure (`F18.toggle-error`).** Run `control-openhands browser goto /skills`, wait for `testid=skill-toggle-add-javadoc` and note its `aria-checked` (`true` when this follows the toggle bullet, which left `add-javadoc` on). Then `control-openhands service stop agent-server`, `control-openhands browser click 'testid=skill-toggle-add-javadoc' --timeout 5000` (the card flips at once), wait about 2 s (the `PATCH /api/settings` is tried three times before the error shows; `browser network` lists three `502`s) and `control-openhands browser toasts --history`: `An error occurred` (the 502 body is not JSON, so the generic message shows; a background settings refetch can add a second identical toast). `control-openhands browser screenshot --feature F18.toggle-error --name toast`. Run `control-openhands restart --timeout 240`, `control-openhands browser goto /skills`: `aria-checked` on `testid=skill-toggle-add-javadoc` is back to the value noted before the click and `enabled_skills` is unchanged. Clear the expected 502 noise with `control-openhands browser errors --clear`.- **Detail modal and switch (`F18.detail-modal`).** With `add-javadoc` on, run `control-openhands browser click 'testid=skill-card-add-javadoc'`, `control-openhands browser testids 'testid=skill-detail-modal'` (name, source, `skill-modal-enable-row-add-javadoc`, description, pills incl. license `MIT`, `skill-modal-field-content-add-javadoc`, `skill-detail-close`, `skill-detail-use-skill-add-javadoc`) and `control-openhands browser enabled 'testid=skill-detail-use-skill-add-javadoc'` (`true`). Switch off with `control-openhands browser click 'testid=skill-modal-enable-row-add-javadoc >> text=Enabled'`; `control-openhands browser eval "document.querySelector('[data-testid=skill-modal-toggle-add-javadoc]').checked"` is `false`, the row reads `Disabled`, `enabled` on Use skill is `false` and the card toggle behind reads `aria-checked` `false`. `control-openhands browser screenshot --feature F18.detail-modal --name disabled`. Close, reload: the card stays off and `enabled_skills` no longer lists `add-javadoc`.- **Close the modal (`F18.detail-close`).** With `testid=skill-card-docker` opened each time, each of `control-openhands browser click 'testid=skill-detail-modal-close'`, `control-openhands browser click 'testid=skill-detail-close'`, `control-openhands browser press Escape` and `control-openhands browser mouse-click 100 500` (backdrop) leaves `control-openhands browser count 'testid=skill-detail-modal'` at `0`.- **Pill overflow in the modal (`F18.detail-pills`).** Run `control-openhands browser click 'testid=skill-card-add-javadoc'`, `control-openhands browser text 'testid=skill-modal-pills-add-javadoc'` (at desktop: `Trigger-based`, `Code quality & review`, `MIT`, `+4`; license and compatibility appear only in the modal), `control-openhands browser attr 'testid=skill-modal-pills-add-javadoc-overflow' aria-label` (`Show 4 more` at desktop; `Show 5 more` at phone width), `control-openhands browser click 'testid=skill-modal-pills-add-javadoc-overflow'` and `control-openhands browser text 'testid=skill-modal-pills-add-javadoc-overflow-popover'` (`Requires Java source files`, `javadoc`, `java documentation`, `document java` at desktop; `MIT` joins them at phone width); `count 'testid=skill-detail-modal'` stays `1`. `control-openhands browser screenshot --feature F18.detail-pills --name popover`. Close the popover with `control-openhands browser click 'testid=skill-modal-description-add-javadoc'`; `control-openhands browser count 'testid=skill-modal-pills-add-javadoc-overflow-popover'` is `0` while the detail modal stays open. Reopen it with `control-openhands browser click 'testid=skill-modal-pills-add-javadoc-overflow'`. With focus on the overflow trigger, run `control-openhands browser record start --feature F18.detail-pills --name escape`, `control-openhands browser press Escape` and `control-openhands browser wait 'testid=skill-modal-pills-add-javadoc-overflow-popover' --state detached`. `control-openhands browser count 'testid=skill-detail-modal'` stays `1`; focus returns to the overflow trigger. Press Escape again and `control-openhands browser wait 'testid=skill-detail-modal' --state detached`, then `control-openhands browser record stop`. Repeat this modal/pill sequence at `browser viewport phone`, then restore `browser viewport desktop`.@@ -114,5 +114,5 @@ Preconditions:- `conversation events --grep` searches whole events, the user's message text included: a trigger that contains the skill name (`qa-gone-ping` for `qa-gone`) matches the user `MessageEvent` even when the skill is not loaded. Give fixture skills a trigger that does not contain their name, or grep for `<name>qa-gone</name>`.- `fixture skill --repo` writes the project `SKILL.md` and records it in the repo only with `--commit` (`committed.sha`; a re-run reports `unchanged`); a New Worktree conversation checks out the repo's commits, so pass `--commit`. Workspace skills are loaded per conversation and never appear on `/skills`.- Without an LLM key the skill set is still observable: the `SystemPromptEvent` (available skills), the user `MessageEvent` (`activated_skills`) and the chat's **Skill Ready** row (`generic-event-message-title`; Expand lists the skills under `Triggered Skill Knowledge:`) all exist before the first model call, after which the conversation ends in `error`.-- Known issue [#16298](https://github.com/OpenHands/OpenHands/issues/16298): A Slack-monitor setup can leave the agent without the expected skill. The report omits the concrete monitor setup and loaded skill name/version; reproducing the runtime also needs an approved model and a configured Slack integration. Listing the bundled catalog alone cannot settle it. (`F18.skill-in-chat`).+- Known issue [#18716](https://github.com/OpenHands/OpenHands/issues/18716) (`F18.skill-in-chat`): the bundled `slack-channel-monitor` skill (trigger `/slack-monitor:poll`) is off by default, and launching the **Slack channel monitor** template only pre-fills `/slack-monitor:poll`: sent while the skill is off, the user `MessageEvent` activates no skill and `conversation events <id> --grep slack-channel-monitor --from-start` matches nothing. Enabled on `/skills` first, the same launch shows **Skill Ready** with `skills: ["slack-channel-monitor"]`. The Slack integration itself needs a Slack account.- Known issue [#15458](https://github.com/OpenHands/OpenHands/issues/15458): The global Skills page can list AGENTS.md files from cloned automation-run worktrees. The report says the discovery trigger is unknown; replay needs the affected automation workspace/discovery-root layout or captured request parameters, rather than only a normal project-skill fixture. (`F18.page`, `F18.project-skill`).diff --git a/.agents/skills/verify-openhands/references/feature-map/F22-automation-creation.md b/.agents/skills/verify-openhands/references/feature-map/F22-automation-creation.mdindex 8ccc4af5ef..dca0557690 100644--- a/.agents/skills/verify-openhands/references/feature-map/F22-automation-creation.md+++ b/.agents/skills/verify-openhands/references/feature-map/F22-automation-creation.md@@ -14,12 +14,12 @@ starts genuine model assistance through `automation_form_update`. The setup pagedraft validation, Test and Create each have their own IDs in F28. **Add Automation → Import automation** readsan exported JSON file, previews it and creates it disabled.-Source: `src/routes/automation-templates.tsx`, `src/routes/automation-setup-route.tsx`, `src/routes/automation-setup-new.tsx`, `src/components/features/automations/` (`recommended-automations-launcher.tsx`, `recommended-automations-section.tsx`, `responder-deployment-modal.tsx`, `create-instructions.tsx`, `import-automation-modal.tsx`, `agent-profile-selector.tsx`, `setup/`), `src/components/features/conversation/conversation-main/conversation-main.tsx`, `src/components/features/manifest/`, `src/manifests/`, `src/hooks/use-start-automation-setup.ts`, `src/hooks/use-launch-skill-in-chat.ts`, `src/hooks/use-responder-url-secret.ts`, `src/utils/automation-export.ts`, `src/api/automation-service/automation-service.api.ts`, `src/api/automation-form-client-tool.ts`, `src/api/automation-form-session.ts`, `src/services/automation-form.ts`, `src/constants/automation-form.ts`, `node_modules/@openhands/extensions/automations/`.+Source: `src/routes/automation-templates.tsx`, `src/routes/automation-setup-route.tsx`, `src/routes/automation-setup-new.tsx`, `src/components/features/automations/` (`recommended-automations-launcher.tsx`, `recommended-automations-section.tsx`, `responder-deployment-modal.tsx`, `create-instructions.tsx`, `import-automation-modal.tsx`, `agent-profile-selector.tsx`, `setup/`), `src/components/features/conversation/conversation-main/conversation-main.tsx`, `src/components/features/manifest/`, `src/manifests/`, `src/hooks/use-start-automation-setup.ts`, `src/hooks/use-launch-skill-in-chat.ts`, `src/hooks/use-responder-url-secret.ts`, `src/utils/automation-export.ts`, `src/utils/automation-catalog.ts`, `src/api/automation-service/automation-service.api.ts`, `src/api/automation-form-client-tool.ts`, `src/api/automation-form-session.ts`, `src/services/automation-form.ts`, `src/constants/automation-form.ts`, `node_modules/@openhands/extensions/automations/`.## Sub-features- `F22.templates-page`: `/automations/templates` shows the h1 **Templates**, a description, a search box, **Start from a proven workflow** with a count badge (6) and a **Beta** section (17).-- `F22.template-card`: each card shows an icon or logo stack, name, category, two-line description, a plus badge and integration pills (`N MCPs to connect before launch`, `Needs external setup` for Jira/Bitbucket; `Connected` once installed, which needs a working integration and was not reached here); a `+N` overflow button opens a popover without launching the card.+- `F22.template-card`: each card shows an icon or logo stack, name, category, two-line description, a plus badge and integration pills (`N MCPs to connect before launch`; `Needs external setup` only for an integration with no installable MCP or native connection, which no current catalog entry has; `Connected` once installed, which needs a working integration and was not reached here); a `+N` overflow button opens a popover without launching the card.- `F22.templates-search`: the search box narrows cards by name, category, description, launch prompt and integration names; a query that matches nothing should say so.- `F22.template-launch-setup`: a card whose entry ships a setup form (custom-automation, news-digest, github-pr-reviewer, qa-changes, …) navigates to `/automations/new/<id>`.- `F22.template-launch-conversation`: a card without a setup form and with no installable integration missing creates a conversation and pre-fills its composer with the entry's launch command (for example `/ticket-to-code-change:setup`); nothing is sent until the user presses send.@@ -71,7 +71,7 @@ Preconditions:- Blocked here: completing `F22.template-mcp-install-queue` (and launching a card whose only missing integration is installable, such as `research-brief-writer`) needs a real Slack, Linear or Tavily credential: the install dialog tests the connection before saving.- **Templates page (`F22.templates-page`).** From `/` run `control-openhands browser click 'testid=sidebar-automations-link' --expect-url '/automations$'`, `control-openhands browser click 'testid=automations-navbar-desktop >> testid=automations-navigation-templates' --expect-url '/automations/templates'`, `control-openhands browser text 'role=main >> role=heading[level=1]'` (`Templates`), `control-openhands browser count '[data-testid^="recommended-automation-card-"]'` (`23`) and `control-openhands browser count 'testid=recommended-automations-beta-section >> [data-testid^="recommended-automation-card-"]'` (`17`); `browser text 'testid=recommended-automations-beta-heading'` is `Beta` and `17`. `control-openhands browser snapshot 'role=main' --max-lines 60` shows `heading "Start from a proven workflow"` with the count `6`. Take `control-openhands browser screenshot --feature F22.templates-page --name grid`. `control-openhands browser goto /automations/templates` renders the same page.-- **Cards and pills (`F22.template-card`).** Run `control-openhands browser testids 'testid=recommended-automation-card-research-brief-writer' --hidden`: `recommended-automation-icon-…`, `recommended-automation-plus-…`, `recommended-automation-pills-…` and `recommended-automation-pills-research-brief-writer-overflow` (`Show 1 more`). `control-openhands browser testids 'role=main' --hidden --filter integration` lists `automation-integration-external-jira` and `automation-integration-external-bitbucket` (`Needs external setup`). `control-openhands browser click 'testid=recommended-automation-pills-research-brief-writer-overflow'` opens a popover (`browser snapshot 'role=dialog'`: `dialog: 2 MCPs to connect before launch`) and the URL stays `/automations/templates`; `control-openhands browser press Escape` closes it (`browser count 'role=dialog'` `0`).+- **Cards and pills (`F22.template-card`).** Run `control-openhands browser testids 'testid=recommended-automation-card-research-brief-writer' --hidden`: `recommended-automation-icon-…`, `recommended-automation-plus-…`, `recommended-automation-pills-…` and `recommended-automation-pills-research-brief-writer-overflow` (`Show 1 more`). `control-openhands browser count '[data-testid^="automation-integration-external-"]'` is `0`: Jira and Bitbucket connect through the installable Atlassian Rovo MCP, so `jira-issue-to-bitbucket-pr` shows `Atlassian Rovo`, `Bitbucket` and `2 MCPs to connect before launch`. `control-openhands browser click 'testid=recommended-automation-pills-research-brief-writer-overflow'` opens a popover (`browser snapshot 'role=dialog'`: `dialog: 2 MCPs to connect before launch`) and the URL stays `/automations/templates`; `control-openhands browser press Escape` closes it (`browser count 'role=dialog'` `0`).- **Search (`F22.templates-search`).** Run `control-openhands browser fill 'role=main >> placeholder=Search automations...' tavily` and `control-openhands browser testids 'role=main' --filter recommended-automation-card`: only `recommended-automation-card-research-brief-writer` (matched through its Tavily integration). Then `control-openhands browser fill 'role=main >> placeholder=Search automations...' qa-no-such-template`, `control-openhands browser count 'testid=recommended-automations-section'` and `control-openhands browser screenshot --feature F22.templates-search --name no-match`. Expected: a "no templates match" message. Actual: the count is `0` and `browser text 'role=main'` is only the title and description; the area under the search box is blank (recorded as `fail`). Clear with `control-openhands browser fill 'role=main >> placeholder=Search automations...' ''` (23 cards again).- **Card opens setup, prerequisites (`F22.template-launch-setup`, `F22.setup-prerequisites`).** Run `control-openhands browser click 'testid=recommended-automation-card-custom-automation' --expect-url '/automations/new/custom-automation'` and `control-openhands browser snapshot 'testid=setup-dialog'`: heading `Before you start`, `GitHub Optional. Used when you choose a GitHub repository…`, link `Manage integrations` (`/mcp`) and `Continue`; `control-openhands browser enabled 'testid=setup-continue-button'` is `true` (an optional integration only warns). Run `control-openhands browser click 'testid=setup-continue-button'`; the heading becomes `Custom automation` and `browser testids 'testid=setup-dialog'` lists `setup-action-kind`, `setup-field-schedule` (`0 9 * * *`), `setup-field-timezone` (`UTC`), `setup-field-name`, `setup-field-model`, `setup-field-timeout`, `setup-field-prompt`, `setup-field-repository` and `setup-field-ref`. There is no Trigger selector here because this deployment only supports `cron`, and no `automation-agent-profile` because the default Prompt action cannot take one (`F22.setup-agent-profile`).- **Validation (`F22.setup-form-validation`).** Click `testid=setup-continue-button` with the form untouched: `control-openhands browser text 'testid=setup-field-name-error'` and `... 'testid=setup-field-prompt-error'` are `This field is required.` Fill `testid=setup-field-timeout` with `5000`, `testid=setup-field-name` with `QA_F22 Custom`, `testid=setup-field-prompt` with `Reply with the single word: pong. Do not run any tools.`, click Continue: `browser text 'testid=setup-field-timeout-error'` is `Must be at most 1800.` Fill the timeout with `60`. Service preflight: `control-openhands browser fill 'testid=setup-field-schedule' 'every day'`, `control-openhands browser press Tab`, `control-openhands browser wait 'testid=setup-field-schedule-error' --timeout 5000`, then `browser text 'testid=setup-field-schedule-error'`: `Value error, Invalid cron expression: every day` (from `POST /api/automation/v1/validate`, see `browser network --last 5`). Fill the schedule with `0 0 1 1 *`, press Tab, and `control-openhands browser wait 'testid=setup-field-schedule-error' --state detached --timeout 5000` succeeds.@@ -131,6 +131,8 @@ Preconditions:- Dashboard draft Delete asks in the named dialog `role=dialog[name="Delete draft?"]` (F21.saved-drafts). Deleting a draft also removes its materialized test automation.- A card click and a deep link are different paths: from the grid, GitHub/Slack-only responders (`qa-changes`, `github-agents-md-maintainer`, `slack-channel-monitor`, …) first show the responder choice and then the GitHub/Slack install dialog, so their setup form is reachable locally only by URL (`/automations/new/<id>`).- A card's `N MCPs to connect before launch` pill counts optional integrations too: Custom automation shows `1 MCPs to connect before launch` for GitHub, yet opens its setup at once because GitHub is optional there ([#17959](https://github.com/OpenHands/OpenHands/issues/17959)).+- On an OpenHands Enterprise (self-hosted) backend, whose web-client config reports `feature_flags.deployment_mode` `self_hosted`, the Templates grid, the Home and empty-dashboard rails (F03, F21.empty-rail) and the onboarding section hide `github-repo-monitor`, `slack-standup-digest`, `github-issue-triage`, `github-delivery-watchdog`, `github-stale-ci-pr-closer` and `custom-automation` (`getHiddenAutomationIds`, `src/utils/automation-catalog.ts`): those instances have native integrations for them. OpenHands Cloud and local backends hide none, so the local counts (23 template cards; 15 rail cards) include them. The hidden case needs a self-hosted OpenHands Enterprise backend.+- Expected: launching a template with no setup form gives the agent the skill its pre-filled command belongs to. Known failure (reproduced twice 2026-10-20, [#18716](https://github.com/OpenHands/OpenHands/issues/18716)): the card only pre-fills the skill's trigger (`/slack-monitor:poll`, `/standup-digest:setup`, `/linear-triage:setup`, `/ticket-to-code-change:setup`, `/research-brief:setup`), and those skills are off by default, so the sent command loads no skill and the agent answers that it is not installed. Repro: the **Responder launch with Slack configured (`F22.responder-local-launch`)** arrangement, send the pre-filled `/slack-monitor:poll` with ` Do not run any tools.` appended, then `control-openhands conversation events <id> --kinds MessageEvent` (user row `skills` null).- The featured-section copy says picking a card opens "a pre-filled conversation"; most featured cards open a setup form instead.- The setup dialog's comboboxes (Action, Agent profile, Timezone, LLM profile) are autocomplete inputs: click the field and pick the option in the same breath, scoped as `role=listbox >> role=option[name="…"]`. A `browser snapshot` between the two closes the listbox (reproduced twice), and the option click then times out after 30 s; click the field again.- Service preflight runs 400 ms after a blur, not on every keystroke; `browser press Tab` then `browser wait` for the `-error` element.diff --git a/.agents/skills/verify-openhands/references/feature-map/F25-backends-and-cloud.md b/.agents/skills/verify-openhands/references/feature-map/F25-backends-and-cloud.mdindex 66b285174c..32cffee49b 100644--- a/.agents/skills/verify-openhands/references/feature-map/F25-backends-and-cloud.md+++ b/.agents/skills/verify-openhands/references/feature-map/F25-backends-and-cloud.md@@ -44,7 +44,7 @@ Source: `src/components/features/backends/`, `src/contexts/active-backend-contex- `F25.device-verify-page`: `/oauth/device/verify` shows a "Device Authorization" code form; with `?user_code=` it shows "Device Authorization Request", the code, a Security Notice and Cancel / Authorize Device. On a local stack Authorize and Continue end in the `Error` card with **Try Again**.- `F25.shared-conversation-view`: `/shared/conversations/<id>` is a standalone read-only page (no app shell); on a local backend it reads `Conversation not found`.- `F25.share-publicly`: on a Cloud backend the conversation menu has a **Public Share** toggle with copy-link and open-link buttons; on a local backend the item is absent.-- `F25.cloud-org-rows`: each Cloud backend appears once per organization as `<name> – <org>` (`Personal Workspace` for the user's own), and choosing one scopes lists to that org.+- `F25.cloud-org-rows`: each Cloud backend appears once per organization (`Personal Workspace` for the user's own): as `<name> – <org>` while several backends are registered, and as the org name alone when that Cloud backend is the only one. The menu grows to its longest label, never narrower than the selector and at most `min(26rem, 100vw - 2rem)`. Each row and the selector carry the full label as a `title`; the closed selector shows the active org's label, ending in an ellipsis when it is cut off and not focused. Choosing a row scopes lists to that org.- `F25.cloud-log-back-in`: a logged-out Cloud row shows `Logged out` and a **Log back in** button that reruns the device flow.- `F25.cloud-settings-link`: with a Cloud backend active the gear next to the selector opens `<cloud host>/settings?org=<org>` in a new tab.- `F25.cloud-sandbox-states`: Cloud conversations show waiting, archived and error sandbox states in chat.@@ -76,7 +76,7 @@ Preconditions:- No backend named `QA_Second` or `QA_Renamed` exists (the selector lists only `Local`).- Bullets run in order: Add creates `QA_Second`, Edit renames it to `QA_Renamed`, Remove deletes it.- The Managed Agents rows need the bridge, which every `control-openhands launch` run has: `control-openhands browser eval "!!window.marsBridge"` is `true` and `curl -s <baseUrl>/mars/health` answers `{"ok":true,"authRequired":true}`. `F25.digitalocean-agents` and `F25.digitalocean-backend-removal` stay blocked without a DigitalOcean account.-- Cloud account: where this machine's proxy injects OpenHands Cloud credentials (`curl -s -o /dev/null -w '%{http_code}' https://app.all-hands.dev/api/organizations` is `200` without a token), the **Cloud backend** bullet below can approve the device flow in its popup; otherwise it is blocked. Additional fixtures are required for: `F25.cloud-log-back-in` (needs a logged-out Cloud row), org switching in `F25.cloud-org-rows` (needs a second organization), the archived and error states of `F25.cloud-sandbox-states`, `F25.cloud-org-suspended` (also needs a suspended OpenHands Enterprise organization or membership), `F25.share-publicly` (toggle), and `F25.locked-cloud`, which also needs a launcher flag (see Gotchas).+- Cloud account: where this machine's proxy injects OpenHands Cloud credentials (`curl -s -o /dev/null -w '%{http_code}' https://app.all-hands.dev/api/organizations` is `200` without a token), the **Cloud backend** bullet below can approve the device flow in its popup; otherwise it is blocked. Approving creates an API key named `Device Link Access Key (<code>)` on the account: delete that key on the Cloud API keys page when done, and leave the account's other keys alone. Additional fixtures are required for: `F25.cloud-log-back-in` (needs a logged-out Cloud row), org switching in `F25.cloud-org-rows` (needs a second organization), the archived and error states of `F25.cloud-sandbox-states`, `F25.cloud-org-suspended` (also needs a suspended OpenHands Enterprise organization or membership), `F25.share-publicly` (toggle), and `F25.locked-cloud`, which also needs a launcher flag (see Gotchas).- **Open the selector (`F25.selector-dropdown`).** From `/conversations` run `control-openhands browser click 'testid=backend-selector'` and `control-openhands browser snapshot 'testid=backend-selector'`. The snapshot shows `listbox` with `option "Connected Local"`, a separator, `button "Add Backend"` and `button "Manage Backends"`. Screenshot with `control-openhands browser screenshot --feature F25.selector-dropdown --name open`. Hover opens it too: `browser press Escape`, move the pointer away with `control-openhands browser hover 'testid=command-menu-trigger'` (hovering a selector the pointer is already on does nothing), `control-openhands browser hover 'testid=backend-selector'`, then the same snapshot shows `combobox "Local" [expanded]` and the two footer buttons.- **Add Backend modal (`F25.add-backend-modal`).** Run `control-openhands browser click 'testid=add-backend-menu-item'` and `control-openhands browser snapshot 'testid=add-backend-modal'`: heading `Choose how you want to connect`, link `Compare Cloud, self-hosted, and Enterprise deployment options` (`/url: https://docs.openhands.dev/overview/introduction`, text `Learn more`) and tab `OpenHands Cloud ...` `[selected]` next to tab `Agent-server ...`. Keyboard focus: `control-openhands browser eval "(()=>{const a=document.activeElement;const d=document.querySelector('[data-testid=add-backend-modal]');return {tid:a.getAttribute('data-testid'),inDialog:!!(d&&d.contains(a))}})()"` is `{tid: "add-backend-close", inDialog: true}` right after opening; after eight `control-openhands browser press Tab` and three `browser press Shift+Tab` (reading the same eval after each) `inDialog` stays `true` (Tab past **Advanced** wraps to the close button), and `browser press q` then `control-openhands browser eval "document.querySelector('[data-testid=chat-input]').textContent"` is `""` (nothing reaches the Home composer behind). `browser screenshot --feature F25.add-backend-modal --name focus-trap-open`. `control-openhands browser press Escape` leaves `browser count 'testid=add-backend-modal'` at `1`; `control-openhands browser click 'testid=add-backend-close'` makes it `0`, and `control-openhands browser eval "!!document.activeElement.closest('[data-testid=backend-selector]')"` is `true` (focus is back on the selector). Keyboard focus in a light theme: arrange `control-openhands browser eval "localStorage.setItem('openhands-color-theme','light-plus')"` and `browser reload`, reopen the modal, run `control-openhands browser focus 'testid=add-backend-option-cloud'` and `browser press ArrowRight`, then `control-openhands browser eval "getComputedStyle(document.activeElement).outlineColor"`. Expected: the theme's focus colour (`--oh-focus`, `#007ACC` in Light+). Connection tabs, the guidance toggle and the DigitalOcean provider choice use the theme focus role and preserve host `--oh-focus` overrides; default focus contrast is at least 3:1 against base, modal, raised and hovered neutral surfaces in all five themes. Solarized Light uses `#227FBE`. Check the settled outline after its transition, preserving the 2 px width and existing offsets. Restore with `browser eval "localStorage.removeItem('openhands-color-theme')"`.@@ -103,7 +103,7 @@ Preconditions:- **Providers tab (`F25.providers-tab`).** On the default run `browser eval "!!window.marsBridge"` is `true` (Preconditions); `curl -s "http://127.0.0.1:$(control-openhands status | jq -r .ports.frontend)/mars/health"` (the static child behind the ingress) returns the HTML index, not JSON: one bridge per stack. Open Add Backend: the tablist adds `tab "Providers Connect through DigitalOcean and more."` (`testid=add-backend-option-providers`); `control-openhands browser click 'testid=add-backend-option-providers'` and `browser snapshot 'testid=add-backend-providers-panel'` show `button "DigitalOcean Your team's OpenHands agents"` and `More providers coming soon.` (`browser screenshot --feature F25.add-backend-modal --name with-providers-tab`). At phone width the modal stays inside the viewport with the three tab titles cut to `Ope…`, `Age…`, `Pro…` (`--feature F25.providers-tab --name phone-tabs`).- **DigitalOcean sign-in (`F25.digitalocean-sign-in`).** On the default run, run `control-openhands browser click 'testid=add-backend-provider-digitalocean'` and `browser wait 'testid=managed-agents-sign-in'`: heading `Connect your DigitalOcean team`, `textbox "Personal access token"` (`browser attr 'testid=managed-agents-token' type` is `password`), link `Create a token` (`/url: https://cloud.digitalocean.com/account/api/tokens`) and `button "Connect with token" [disabled]`; no OAuth button in a browser (`browser count 'testid=managed-agents-oauth'` is `0`). Fill `testid=managed-agents-token` with `dop_v1_qa_invalid_token_0000` and click `testid=managed-agents-token-submit`: `browser text 'testid=managed-agents-auth-error'` reads `That does not look like a DigitalOcean personal access token.` (`POST /mars/rpc/savePat` `500`). Fill a well-formed dummy, `dop_v1_` plus 64 zeros, and submit again: after a few seconds the error reads `401 Unauthorized` (`POST /mars/rpc/savePat` `401`, DigitalOcean's answer; `browser screenshot --feature F25.digitalocean-sign-in --name rejected-token`). Never type a real token here. `control-openhands browser click 'testid=add-backend-providers-back'` returns to the Providers panel (`browser count 'testid=managed-agents-sign-in'` is `0`; the providers panel itself stays mounted behind the sign-in screen, so its count is `1` either way); close with `testid=add-backend-close`. At phone width the sign-in screen fits (`bbox 'testid=add-backend-modal'` `insideViewport` `true`). Both errors also raise an error toast with the same text. Expected on a page served without a baked key (F26 `--host 0.0.0.0`, Docker), once the server's key was typed on the API-key screen: the same two answers as above. Known failure (reproduced 2026-10-14, #18434): every token, even the malformed one, ends in `session key required` (`POST /mars/rpc/getAuthState` and `savePat` `401`), because the web bridge client sends only the baked page key, never the typed one; it predates #18349 (BASE with `MARS_WEB=1` fails the same way). A `--frontend-only` page connected to another stack's backend fails the same way for a different reason (the typed key belongs to the other stack); #18434 leaves that case to a maintainer decision.- **Managed Agents with an account (`F25.digitalocean-agents`, `F25.digitalocean-backend-removal`).** Blocked: needs a DigitalOcean account with Managed Agents. With one, after a real token the panel lists agents (`digitalocean-agent-<id>`), **New Agent** opens `digitalocean-new-agent-form` (name, size), a session's Connect adds a backend and the sidebar shows `mars-session-panel`; removing that backend opens `mars-backend-removal-modal` with `disconnect-only-button` and `stop-session-button`.-- **Cloud backend (`F25.cloud-device-flow`, `F25.cloud-org-rows`, `F25.cloud-settings-link`, `F25.share-publicly`, `F25.cloud-sandbox-states`).** Only with a Cloud account (Preconditions); it creates a device grant and one conversation on that account, and shows the account's own conversations in the sidebar (keep those screenshots private). Reopen Add Backend on the Cloud tab, `browser click 'testid=add-backend-login-button'`, then `control-openhands browser tab 1` (the verify popup: `Device Authorization Request`, the code, **Authorize Device**), `control-openhands browser click 'role=button[name="Authorize Device"]'` (`Success!`) and `control-openhands browser tab 0`. Within about 15 s (token polling answers `400` until approved, then `200`) `browser count 'testid=add-backend-modal'` is `0`, the popup is gone and `browser snapshot 'testid=backend-selector'` reads `combobox "OpenHands Cloud": OpenHands Cloud – Personal Workspace`; the registry holds `{name: "OpenHands Cloud", host: "https://app.all-hands.dev", kind: "cloud"}` (`browser eval "JSON.parse(localStorage.getItem('openhands-backends')).map(b=>({name:b.name,host:b.host,kind:b.kind}))"`). Open the selector: `option "Connected OpenHands Cloud – Personal Workspace"` (one option per organization) next to `Connected Local`; Manage Backends shows the row with `Personal Workspace` and the `Cloud` pill. `browser attr 'testid=backend-selector-settings-link' href` is `https://app.all-hands.dev/settings?org=<org id>` with `target` `_blank`; clicking it opens that tab (`browser wait-tab 'app.all-hands.dev/settings'`, then `browser close-tab 1`, `browser tab 0`). Start one conversation from Home: fill `testid=chat-input` with `Reply with exactly: QA_F25_CLOUD. Do not run any tools.` and `browser click 'testid=submit-button' --expect-url '/conversations/'`: the URL is `/conversations/task-<id>` while the sandbox starts (toasts `Creating conversation…`, `Sending...`), then moves to `/conversations/<id>?backend=<cloud id>&org=<org id>` and the reply `QA_F25_CLOUD` appears (about a minute). Its `conversation-name >> ellipsis-button` menu has `share-publicly-button` (**Public Share**, off); do not flip it unless the conversation may be public. Delete it with `delete-button` and `'role=dialog >> testid=confirm-button'`, then remove the Cloud backend in Manage Backends (`manage-backends-remove-OpenHands Cloud`, confirm): after `browser reload` the selector reads `Local`.+- **Cloud backend (`F25.cloud-device-flow`, `F25.cloud-org-rows`, `F25.cloud-settings-link`, `F25.share-publicly`, `F25.cloud-sandbox-states`).** Only with a Cloud account (Preconditions); it creates a device grant and one conversation on that account, and shows the account's own conversations in the sidebar (keep those screenshots private). Reopen Add Backend on the Cloud tab, `browser click 'testid=add-backend-login-button'`, then `control-openhands browser tab 1` (the verify popup: `Device Authorization Request`, the code, **Authorize Device**), `control-openhands browser click 'role=button[name="Authorize Device"]'` (`Success!`) and `control-openhands browser tab 0`. Within about 15 s (token polling answers `400` until approved, then `200`) `browser count 'testid=add-backend-modal'` is `0`, the popup is gone and `browser snapshot 'testid=backend-selector'` reads `combobox "OpenHands Cloud – Personal Workspace"` (for about a second, until `/me` answers, the org's raw name shows in place of `Personal Workspace`); the registry holds `{name: "OpenHands Cloud", host: "https://app.all-hands.dev", kind: "cloud"}` (`browser eval "JSON.parse(localStorage.getItem('openhands-backends')).map(b=>({name:b.name,host:b.host,kind:b.kind}))"`). Open the selector: `option "Connected OpenHands Cloud – Personal Workspace"` (one option per organization) next to `Connected Local`; Manage Backends shows the row with `Personal Workspace` and the `Cloud` pill. `browser attr 'testid=backend-selector-settings-link' href` is `https://app.all-hands.dev/settings?org=<org id>` with `target` `_blank`; clicking it opens that tab (`browser wait-tab 'app.all-hands.dev/settings'`, then `browser close-tab 1`, `browser tab 0`). Start one conversation from Home: fill `testid=chat-input` with `Reply with exactly: QA_F25_CLOUD. Do not run any tools.` and `browser click 'testid=submit-button' --expect-url '/conversations/'`: the URL is `/conversations/task-<id>` while the sandbox starts (toasts `Creating conversation…`, `Sending...`), then moves to `/conversations/<id>?backend=<cloud id>&org=<org id>` and the reply `QA_F25_CLOUD` appears (about a minute). Expected: the user message is confirmed (no `Sending...`) and sits above the reply. Known failure (reproduced twice 2026-10-20, [#18717](https://github.com/OpenHands/OpenHands/issues/18717)): the reply and its hook rows render first and the user bubble below them keeps `Sending...`, turning into `Failed to send` with Retry and Dismiss after 150 s; `browser events --kinds websocket-created` shows an `after_seq` past the user `MessageEvent`; `browser reload` restores the order. Its `conversation-name >> ellipsis-button` menu has `share-publicly-button` (**Public Share**, off); do not flip it unless the conversation may be public. With only the Cloud backend registered (remove `Local` in Manage Backends; restore it afterwards with `browser reset` and `onboard --skip`), the option reads `Connected Personal Workspace` and the combobox `Personal Workspace`. Delete it with `delete-button` and `'role=dialog >> testid=confirm-button'`, then remove the Cloud backend in Manage Backends (`manage-backends-remove-OpenHands Cloud`, confirm): after `browser reload` the selector reads `Local`.- **Device verify page (`F25.device-verify-page`).** Run `control-openhands browser goto /oauth/device/verify` and `browser snapshot`: heading `Device Authorization`, `Enter the code displayed on your device:`, textbox `Device Code:` and button `Continue`, inside the normal app shell. `control-openhands browser fill 'role=textbox[name="Device Code:"]' QA-0000` and `browser click 'role=button[name="Continue"]'` go straight to the result: heading `Error`, `Failed to authorize device. Please try again.`, button `Try Again`; `browser network --filter verify-authenticated` shows `POST /oauth/device/verify-authenticated` `404`. Then `control-openhands browser goto '/oauth/device/verify?user_code=QA-0000'`: heading `Device Authorization Request`, `DEVICE CODE`, `QA-0000`, `Security Notice`, buttons `Cancel` and `Authorize Device` (screenshot `--feature F25.device-verify-page --name with-code`). `browser click 'role=button[name="Cancel"]'` does nothing in a tab the page did not open (URL unchanged). `browser click 'role=button[name="Authorize Device"]'` and `browser wait 'role=heading[name="Error"]'` show the same Error card; **Try Again** reloads to the request. In Light+ and Solarized Light (arrange `localStorage.setItem('openhands-color-theme', ...)` as in the Add Backend bullet), `?user_code=QA-NOT-REAL` keeps the Security Notice heading and instruction at least 4.5:1 on their amber tint, at desktop and phone width (2026-10-17: 5.03:1 and 13.58:1 in Light+, 5.53:1 and 11.84:1 in Solarized Light; `--name notice-light-plus-phone`). Known issue [#18527](https://github.com/OpenHands/OpenHands/issues/18527): current target warning text, Authorize normal/hover and error icons pass their respective contrast thresholds in all five themes at desktop/phone (minimum warning 5.03:1, body 11.80:1, button 10.78:1 and icon 4.62:1). This is a target-only observation, not paired attribution of the warning fix or retirement of #18527; device-flow error and Solarized awaiting text still reproduce failures in the separate entry above.- **Shared view (`F25.shared-conversation-view`).** Run `control-openhands browser goto /shared/conversations/<id>` and `control-openhands browser wait-text 'Conversation not found' --timeout 15000`. The page has no sidebar; `browser network --filter shared` shows `GET /api/shared-conversations` and `/api/shared-events/search` `404`, and `control-openhands browser toasts --history` stays `[]` (the page shows its own not-found state, no toast). Screenshot `--feature F25.shared-conversation-view --name local-not-found`.- **No Public Share locally (`F25.share-publicly`).** Run `browser goto /conversations/<id>`, `control-openhands browser click 'testid=conversation-name >> testid=ellipsis-button'` and `control-openhands browser count 'testid=share-publicly-button'`: `0` on a local backend (`browser testids --filter button` lists `rename-button`, `show-skills-button`, `show-agent-tools-button`, `export-transcript-button`, `download-trajectory-button`, `display-cost-button` and `delete-button`; `show-hooks-button` and `stop-button` appear only while the conversation is active (idle, running, waiting for confirmation or finished), so a paused or errored conversation has neither). The toggle, `copy-share-link-button` and `open-share-link-button` need a Cloud backend: blocked.diff --git a/.agents/skills/verify-openhands/references/feature-map/F26-runtime-variants.md b/.agents/skills/verify-openhands/references/feature-map/F26-runtime-variants.mdindex b326b45d34..c1bdcb4e80 100644--- a/.agents/skills/verify-openhands/references/feature-map/F26-runtime-variants.md+++ b/.agents/skills/verify-openhands/references/feature-map/F26-runtime-variants.md@@ -106,7 +106,7 @@ Preconditions:- **External links (`F26.desktop-external-links`).** Use the healthy owned Electron shell and actual rendered Markdown links; CDP user clicks are available. For a harmless destination, an owned OS-browser wrapper must execute real Chromium with a disposable profile and an exact test-host-to-loopback resolver rule; log only invocation booleans and the owned HTTP destination’s GET count. Do not replace the OS browser with an echo-only handler or inject DOM/events. Clear consent/onboarding through ordinary UI first; a public user-message API with `run:false` can supply the Markdown without model calls. Expected behavior remains an allowed link reaching the real system browser. Observed 2026-10-17 on frozen `61a3bd93e642`, source-built Linux: two actual `_blank` Markdown link clicks kept one Electron page but produced no owned browser-wrapper invocation or destination GET, including with an owned XDG browser association. A separate real `xdg-open` control with that same association launched Chromium and reached the destination. Record this as an observed failed handoff/intake candidate with origin unconfirmed, not a passing prerequisite check or a proven new product root cause. An inert custom-scheme Markdown link had its href removed by the sanitizer and invoked no handler; that proves this renderer refusal only, not the direct Electron popup-policy branches. Main-window navigation, OAuth redirect, nested-popup and actual provider authentication remain separate unproved paths. Preserve safe screenshots/receipts, stop only owned Electron/Chromium/Xvfb groups, verify all owned ports closed, and purge private state. Manual receipt provenance must name its actual URL/ports/viewport rather than reuse an old run URL.- **KV survives authentication rotation (`F26.session-key-rotated`, `F26.session-key-persist`).** With no explicit `AUTOMATION_KV_SECRET`, create an owned inert automation and PUT a harmless marker to `/api/automation/v1/kv/qa-session-rotation?automation_id=<id>` through `api --write`; GET must return that marker. Run `restart --rotate-key` and `doctor`, then GET again using the helper's fresh private key. Expected: rotating authentication preserves encrypted automation state. Known failure, reproduced 2026-10-12 against automation 1.19.3: the pre-rotation read is 200 and the fresh-auth read is 500 `Failed to decrypt value` ([#18301](https://github.com/OpenHands/OpenHands/issues/18301)). This uses only disposable state and does not establish the original incident's data-loss history.-- **Partial SQLite migration startup (`F26.runtime-services`).** Stop only the owned automation service, make a cold backup of `<run>/private/automation/automations.db`, and confirm its `automation_git_sync_org_config` already has `consecutive_auth_failures`. In that disposable DB only, set `alembic_version.version_num` to `028`; restart with a bounded timeout (`timeout 200 control-openhands restart`). Expected: required-service startup fails explicitly or the partial schema recovers without corrupting state. Observed 2026-10-17 against automation 1.20.1: migration 029 reports the duplicate column and exits 3, then the launcher prints `✗ The automation backend exited during startup (code 3). ...`, stops every service and exits (`F26.automation-startup-failure`); `restart` answers `The launcher exited before the stack became ready.` and `status` shows `launcherAlive` `false`. The schema itself is not repaired; that half stays open in [#18299](https://github.com/OpenHands/OpenHands/issues/18299). Restore the cold backup, restart and doctor before continuing. Never apply this fixture to an operator database.+- **Partial SQLite migration startup (`F26.runtime-services`).** Stop only the owned automation service, make a cold backup of `<run>/private/automation/automations.db`, and confirm its `automation_git_sync_org_config` already has `consecutive_auth_failures`. In that disposable DB only, set `alembic_version.version_num` to `028`; restart with a bounded timeout (`timeout 200 control-openhands restart`). Expected: required-service startup fails explicitly or the partial schema recovers without corrupting state. With automation 1.22.0, migration 029 reports `duplicate column name: consecutive_auth_failures` and exits 3, then the launcher prints `✗ The automation backend exited during startup (code 3). ...`, stops every service and exits (`F26.automation-startup-failure`); `restart` answers `The launcher exited before the stack became ready.`, `status` shows `launcherAlive` `false`, and `alembic_version` stays `028`. The schema is not repaired: [OpenHands/automation#575](https://github.com/OpenHands/automation/issues/575) tracks that half. Restore the cold backup, restart and doctor before continuing. Never apply this fixture to an operator database.- **Occupied internal frontend port (`F26.cli-port-in-use`).** Reserve a loopback frontend port in an owned listener and run the genuine launcher with separate free ingress/backend/automation ports. The reported default-port branch can also be observed read-only when port 3001 is already occupied; do not stop its owner. Expected: an occupied internal frontend port receives a free fallback while explicit service-port conflicts keep their existing semantics. Known failure, reproduced 2026-10-12: `agent-canvas --port 18940` exits 1 with `frontend: port 3001`, despite the ingress override ([#17546](https://github.com/OpenHands/OpenHands/issues/17546), [#16226](https://github.com/OpenHands/OpenHands/issues/16226)). An explicit `OH_CANVAS_SAFE_VITE_PORT` is a current workaround; it does not provide automatic fallback.- **Required frontend death (`F26.runtime-services`).** After a healthy private launch, identify only its required static-server PID using launcher ancestry plus its owned frontend port, then send that child SIGKILL. Open `/` and check the owned launcher's liveness and authenticated `/api/settings`. Expected: an unexpected required-service death stops the stack and reports failure. Known failure, reproduced 2026-10-12: the launcher and backend remain alive, settings returns 200, and the main UI returns 502 **Bad Gateway** ([#16927](https://github.com/OpenHands/OpenHands/issues/16927)). This live trigger is SIGKILL, not a port-race EADDRINUSE; the failing required-child exit branch is shared. Restart and doctor to restore the run.- **Static-server credential argv (`F26.runtime-services`).** Inspect only this run's owned static-server process for the frontend port. Read the private key in memory and retain booleans indicating whether `--session-api-key` is present and whether that literal key occurs in argv; never print argv or the key. Expected: other host users cannot recover the session key from command-line arguments. Known failure, reproduced 2026-10-12: both booleans are true for the owned static frontend ([#16383](https://github.com/OpenHands/OpenHands/issues/16383)). A Docker-container variant is a separate check; record image availability and its actual outcome rather than inferring it from this host-process check.diff --git a/.agents/skills/verify-openhands/references/feature-map/README.md b/.agents/skills/verify-openhands/references/feature-map/README.mdindex 5660a6d9fd..2b45ddeac9 100644--- a/.agents/skills/verify-openhands/references/feature-map/README.md+++ b/.agents/skills/verify-openhands/references/feature-map/README.md@@ -5,7 +5,7 @@ of Agent Canvas. Read this index before driving the app, then open the matchingfeature file and run its recipe with `control-openhands`. The map is not a claimthat every row passes today; the run's evidence ledger is.-Maintenance baseline: main@79abd32d856d86a551898ba14ce03f686d453663 (2026-10-19). The next maintenance pass starts from this commit; a pass proposes the next baseline in its PR, and merging that PR accepts it.+Maintenance baseline: main@1f7b1e69a19c1ce6162463427fb59fb0106ea780 (2026-10-20). The next maintenance pass starts from this commit; a pass proposes the next baseline in its PR, and merging that PR accepts it.## Baseline preconditions@@ -22,15 +22,6 @@ Maintenance baseline: main@79abd32d856d86a551898ba14ce03f686d453663 (2026-10-19)rate limit), `llm preset deepseek --no-validate` still saves the profiles:recipes that only need a conversation to exist can run on, and everyrecipe that reads a model reply is `blocked`, never a pass.-- Known issue [OpenHands/software-agent-sdk#6088](https://github.com/OpenHands/software-agent-sdk/issues/6088)- (reproduced 2026-10-19): a fresh install of the pinned Agent Server 1.55.1- resolves litellm 1.106.0 next to mcp 1.30.0. From then on every model call- fails with `cannot import name 'CacheableResult' from 'mcp.types'`, and the- conversation ends in `error`. `doctor` stays `ok`. To run model-backed recipes- meanwhile, write `$OH_VERIFY_RUN/private/home/.config/uv/uv.toml` containing- `[exclude-newer-package]` and `litellm = "2026-10-18T00:00:00Z"`, then run- `control-openhands restart`. That run's Agent Server then installs litellm- 1.105.1.- For critic checks, use an available, authorized OpenHands (`openhands/…`) or compatible OpenHands LLM-proxy profile, regardless of the main profile used for the pass. Its LLM key is reused when Critic API Key is empty. For a non-default proxy deployment, use its compatible critic endpoint. Restore the previous profile afterwards; see [F06](F06-agent-activity.md). Do not declare the critic blocked merely because the main model uses another provider. This does not authorize new credentials, additional budget, or sending private test data to another service.- The browser is at the desktop viewport (1440×1000) unless a recipe saysotherwise; `control-openhands browser viewport phone` is 390×844.diff --git a/.pr/bugs/2026-10-20/cloud-first-message-pending/after-reload.png b/.pr/bugs/2026-10-20/cloud-first-message-pending/after-reload.pngnew file mode 100644index 0000000000..4c077efe56Binary files /dev/null and b/.pr/bugs/2026-10-20/cloud-first-message-pending/after-reload.png differdiff --git a/.pr/bugs/2026-10-20/cloud-first-message-pending/failed-to-send-before-reload.png b/.pr/bugs/2026-10-20/cloud-first-message-pending/failed-to-send-before-reload.pngnew file mode 100644index 0000000000..2baddb3919Binary files /dev/null and b/.pr/bugs/2026-10-20/cloud-first-message-pending/failed-to-send-before-reload.png differdiff --git a/.pr/bugs/2026-10-20/cloud-first-message-pending/sending-below-reply.png b/.pr/bugs/2026-10-20/cloud-first-message-pending/sending-below-reply.pngnew file mode 100644index 0000000000..1185d95bc3Binary files /dev/null and b/.pr/bugs/2026-10-20/cloud-first-message-pending/sending-below-reply.png differdiff --git a/.pr/bugs/2026-10-20/missing-runtime-header-status/after-stop-runtime-desktop.png b/.pr/bugs/2026-10-20/missing-runtime-header-status/after-stop-runtime-desktop.pngnew file mode 100644index 0000000000..c94217a94bBinary files /dev/null and b/.pr/bugs/2026-10-20/missing-runtime-header-status/after-stop-runtime-desktop.png differdiff --git a/.pr/bugs/2026-10-20/missing-runtime-header-status/header-menu-desktop.png b/.pr/bugs/2026-10-20/missing-runtime-header-status/header-menu-desktop.pngnew file mode 100644index 0000000000..9d8245d4d0Binary files /dev/null and b/.pr/bugs/2026-10-20/missing-runtime-header-status/header-menu-desktop.png differdiff --git a/.pr/bugs/2026-10-20/missing-runtime-header-status/header-menu-phone.png b/.pr/bugs/2026-10-20/missing-runtime-header-status/header-menu-phone.pngnew file mode 100644index 0000000000..a405dac34eBinary files /dev/null and b/.pr/bugs/2026-10-20/missing-runtime-header-status/header-menu-phone.png differdiff --git a/.pr/bugs/2026-10-20/template-skill-off/prefill-skill-off.png b/.pr/bugs/2026-10-20/template-skill-off/prefill-skill-off.pngnew file mode 100644index 0000000000..e517746fd4Binary files /dev/null and b/.pr/bugs/2026-10-20/template-skill-off/prefill-skill-off.png differdiff --git a/.pr/bugs/2026-10-20/template-skill-off/sent-skill-off.png b/.pr/bugs/2026-10-20/template-skill-off/sent-skill-off.pngnew file mode 100644index 0000000000..946e5f0c79Binary files /dev/null and b/.pr/bugs/2026-10-20/template-skill-off/sent-skill-off.png differdiff --git a/.pr/bugs/2026-10-20/template-skill-off/sent-skill-on.png b/.pr/bugs/2026-10-20/template-skill-off/sent-skill-on.pngnew file mode 100644index 0000000000..9448391786Binary files /dev/null and b/.pr/bugs/2026-10-20/template-skill-off/sent-skill-on.png differdiff --git a/.pr/map-maintenance/2026-10-20/F04-archived-row.png b/.pr/map-maintenance/2026-10-20/F04-archived-row.pngnew file mode 100644index 0000000000..3569ba5c28Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/F04-archived-row.png differdiff --git a/.pr/map-maintenance/2026-10-20/F04-load-more-grouped.png b/.pr/map-maintenance/2026-10-20/F04-load-more-grouped.pngnew file mode 100644index 0000000000..93a82ea792Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/F04-load-more-grouped.png differdiff --git a/.pr/map-maintenance/2026-10-20/F04-missing-runtime-hidden.png b/.pr/map-maintenance/2026-10-20/F04-missing-runtime-hidden.pngnew file mode 100644index 0000000000..806ffe7a15Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/F04-missing-runtime-hidden.png differdiff --git a/.pr/map-maintenance/2026-10-20/F04-missing-runtime-shown.png b/.pr/map-maintenance/2026-10-20/F04-missing-runtime-shown.pngnew file mode 100644index 0000000000..8feef76d26Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/F04-missing-runtime-shown.png differdiff --git a/.pr/map-maintenance/2026-10-20/F05-slash-menu.png b/.pr/map-maintenance/2026-10-20/F05-slash-menu.pngnew file mode 100644index 0000000000..b85396928bBinary files /dev/null and b/.pr/map-maintenance/2026-10-20/F05-slash-menu.png differdiff --git a/.pr/map-maintenance/2026-10-20/F06-drag-select-escapes.png b/.pr/map-maintenance/2026-10-20/F06-drag-select-escapes.pngnew file mode 100644index 0000000000..91b32d0505Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/F06-drag-select-escapes.png differdiff --git a/.pr/map-maintenance/2026-10-20/F06-events-match.png b/.pr/map-maintenance/2026-10-20/F06-events-match.pngnew file mode 100644index 0000000000..6cd33ed079Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/F06-events-match.png differdiff --git a/.pr/map-maintenance/2026-10-20/F06-planner-batch-100-422.png b/.pr/map-maintenance/2026-10-20/F06-planner-batch-100-422.pngnew file mode 100644index 0000000000..028ef9782cBinary files /dev/null and b/.pr/map-maintenance/2026-10-20/F06-planner-batch-100-422.png differdiff --git a/.pr/map-maintenance/2026-10-20/F07-cloud-connect-repo-after-reload.png b/.pr/map-maintenance/2026-10-20/F07-cloud-connect-repo-after-reload.pngnew file mode 100644index 0000000000..8791bf4100Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/F07-cloud-connect-repo-after-reload.png differdiff --git a/.pr/map-maintenance/2026-10-20/F07-git-control-bar-lightplus.png b/.pr/map-maintenance/2026-10-20/F07-git-control-bar-lightplus.pngnew file mode 100644index 0000000000..83e0a54722Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/F07-git-control-bar-lightplus.png differdiff --git a/.pr/map-maintenance/2026-10-20/F07-git-control-bar-solarized-phone.png b/.pr/map-maintenance/2026-10-20/F07-git-control-bar-solarized-phone.pngnew file mode 100644index 0000000000..1fc111bd17Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/F07-git-control-bar-solarized-phone.png differdiff --git a/.pr/map-maintenance/2026-10-20/F13-opencode-beam-free.png b/.pr/map-maintenance/2026-10-20/F13-opencode-beam-free.pngnew file mode 100644index 0000000000..0c438ec064Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/F13-opencode-beam-free.png differdiff --git a/.pr/map-maintenance/2026-10-20/F18-catalog-69.png b/.pr/map-maintenance/2026-10-20/F18-catalog-69.pngnew file mode 100644index 0000000000..f0fb3c0adeBinary files /dev/null and b/.pr/map-maintenance/2026-10-20/F18-catalog-69.png differdiff --git a/.pr/map-maintenance/2026-10-20/F18-project-skill.png b/.pr/map-maintenance/2026-10-20/F18-project-skill.pngnew file mode 100644index 0000000000..12a50dc629Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/F18-project-skill.png differdiff --git a/.pr/map-maintenance/2026-10-20/F18-search-docker-5.png b/.pr/map-maintenance/2026-10-20/F18-search-docker-5.pngnew file mode 100644index 0000000000..65f1b885a2Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/F18-search-docker-5.png differdiff --git a/.pr/map-maintenance/2026-10-20/F18-toggle-error-toast.png b/.pr/map-maintenance/2026-10-20/F18-toggle-error-toast.pngnew file mode 100644index 0000000000..f31fe63d31Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/F18-toggle-error-toast.png differdiff --git a/.pr/map-maintenance/2026-10-20/F22-template-card-overflow.png b/.pr/map-maintenance/2026-10-20/F22-template-card-overflow.pngnew file mode 100644index 0000000000..606a5606efBinary files /dev/null and b/.pr/map-maintenance/2026-10-20/F22-template-card-overflow.png differdiff --git a/.pr/map-maintenance/2026-10-20/F25-org-rows-cloud-only.png b/.pr/map-maintenance/2026-10-20/F25-org-rows-cloud-only.pngnew file mode 100644index 0000000000..a1195cc487Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/F25-org-rows-cloud-only.png differdiff --git a/.pr/map-maintenance/2026-10-20/F25-org-rows-two-backends.png b/.pr/map-maintenance/2026-10-20/F25-org-rows-two-backends.pngnew file mode 100644index 0000000000..8d5c7134c8Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/F25-org-rows-two-backends.png differdiff --git a/.pr/map-maintenance/2026-10-20/README-fresh-install-model-call.png b/.pr/map-maintenance/2026-10-20/README-fresh-install-model-call.pngnew file mode 100644index 0000000000..c2f2961434Binary files /dev/null and b/.pr/map-maintenance/2026-10-20/README-fresh-install-model-call.png differ