Skip to content

The fastest, cheapest, most efficient open-source agent harness. Run more than 500 agents on a $10 VPS.

test(e2e): stop scheduling the deleted native settings-ai-skills spec

M3gA-Mind7fbd862614b5
diff --git a/app/scripts/e2e-run-all-flows.sh b/app/scripts/e2e-run-all-flows.sh
index 7958c9734b..e7223e48fd 100755
--- a/app/scripts/e2e-run-all-flows.sh
+++ b/app/scripts/e2e-run-all-flows.sh
@@ -357,7 +357,6 @@ if should_run_suite "settings"; then
echo "## Running suite: settings"
run "test/e2e/specs/settings-data-management.spec.ts" "settings-data" "settings"
run "test/e2e/specs/memory-plan-required.spec.ts" "memory-plan-required" "settings"
- run "test/e2e/specs/settings-ai-skills.spec.ts" "settings-ai-skills" "settings"
run "test/e2e/specs/settings-account-preferences.spec.ts" "settings-account" "settings"
run "test/e2e/specs/settings-advanced-config.spec.ts" "settings-advanced" "settings"
run "test/e2e/specs/settings-feature-preferences.spec.ts" "settings-features" "settings"
diff --git a/docs/TEST-COVERAGE-MATRIX.md b/docs/TEST-COVERAGE-MATRIX.md
index 7f161b3ab0..f072fc2f58 100644
--- a/docs/TEST-COVERAGE-MATRIX.md
+++ b/docs/TEST-COVERAGE-MATRIX.md
@@ -584,8 +584,8 @@ The thread JSONL store moved to `tinyagents_session::threads` (`vendor/tinyagent
| ID | Feature | Layer | Test path(s) | Status | Notes |
| ------- | ---------------------------------------------------- | ----------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
-| 13.3.1 | Model Configuration | WD+PW | `app/test/e2e/specs/settings-ai-skills.spec.ts`, `app/test/playwright/specs/settings-ai-skills.spec.ts` (`the routing page shows the core-pinned default model and keeps it across a reload`) | ✅ | Was 🟡: both layers asserted only that the LLM tab mounts, so nothing configured anything. The PW case now pins the contract — what the core holds in `default_model` is what the routing page shows, before and after a reload, with no write-back on render. Driven over `inference_update_model_settings` rather than through the picker dialog on purpose: the picker is being rebuilt under #6395, so a click-through spec would be rewritten with it and meanwhile cover nothing. The picker → core direction stays at VU (`AIPanel.test.tsx`). |
-| 13.3.2 | Skill Toggle | WD | `skill-lifecycle.spec.ts`, `app/test/e2e/specs/settings-ai-skills.spec.ts` | ✅ | |
+| 13.3.1 | Model Configuration | PW | `app/test/playwright/specs/settings-ai-skills.spec.ts` (`the routing page shows the core-pinned default model and keeps it across a reload`) | ✅ | Was 🟡: both layers asserted only that the LLM tab mounts, so nothing configured anything. The PW case now pins the contract — what the core holds in `default_model` is what the routing page shows, before and after a reload, with no write-back on render. Driven over `inference_update_model_settings` rather than through the picker dialog on purpose: the picker is being rebuilt under #6395, so a click-through spec would be rewritten with it and meanwhile cover nothing. The picker → core direction stays at VU (`AIPanel.test.tsx`). |
+| 13.3.2 | Skill Toggle | WD | `skill-lifecycle.spec.ts` | ✅ | |
| 13.3.3 | Azure deployment name (off-catalog model id) | VU | `app/src/components/settings/panels/__tests__/azureDeployment.test.ts`, `app/src/components/settings/panels/__tests__/ModelEntryField.test.tsx`, `app/src/components/settings/panels/__tests__/AIPanel.test.tsx` | ✅ | Azure routes by deployment name, not the base model id its `/models` catalog lists (#5213). Covers endpoint-host detection (incl. dot-boundary lookalikes and the excluded Foundry serverless hosts), `/openai/v1` base-URL detection and its inline nudge, the shared entry-mode field used by both pickers (free text, catalog, loading, probe-error branches), no auto-seeding of a catalog id for Azure, the deployment name surviving verbatim into persisted routing, and a provider staying creatable when the live `/models` probe fails |
| 13.3.4 | ChatGPT sign-in in AI settings | VU | `app/src/components/settings/oauth/__tests__/OpenAiOAuthConnect.test.tsx`, `app/src/components/settings/panels/__tests__/AIPanel.test.tsx` | ✅ | Mocked core RPCs cover sign-in, disconnect, provider/routing persistence, failure paths, and delayed initial status. Live desktop OAuth remains a release smoke check. |
| 13.3.5 | OpenRouter sign-in (PKCE) in AI settings | RU+VU | `crates/openhuman-app/src/loopback_oauth_tests.rs`, `app/src/utils/__tests__/openrouterOAuth.test.ts`, `app/src/utils/__tests__/loopbackOauthListener.test.ts`, `app/src/components/settings/panels/__tests__/AIPanel.test.tsx` | ✅ | A pending sign-in stays dismissable (Cancel/Esc/click-outside abort the flow and free the loopback port); Deny, `error=` and missing-code callbacks get a "Sign-in was not completed." page and a dialog error instead of "You're signed in."; cancel clears the listener timeout so a retry is not stopped; the key exchange honours the abort signal (#6263). Live Authorize remains a release smoke check. |