Skip to content

Self-hosted AI workspace.

Python

test(runtime): scope the negative-wording claim to the inferred path

Léod423632559ab
diff --git a/tests/test_runtime_behavior_regressions.py b/tests/test_runtime_behavior_regressions.py
index 389f8dfdf..6c991fdb7 100644
--- a/tests/test_runtime_behavior_regressions.py
+++ b/tests/test_runtime_behavior_regressions.py
@@ -74,11 +74,21 @@ def _run_turn(monkeypatch, messages, **kwargs):
# failure this guards is a model that obeys the wording while the runtime
# contradicted it by offering the tool anyway.
#
-# Measured on lab@c499c01b: the detection is partial. "don't search online" is
-# caught; "Do not search the web" and "No web search please" are not, and the
-# web tools are offered for both. The two that do not hold yet are marked
-# xfail(strict=True), so they document the target, run on every suite, and fail
-# loudly the moment the behaviour lands. Delete the marker then.
+# SCOPE, and it matters: these cover the inferred path, where the turn has no
+# explicit web toggle and the runtime decides from intent. Measured on
+# lab@c499c01b, detection there is partial: "don't search online" suppresses
+# the intent and the web tools are withheld; "Do not search the web" and "No
+# web search please" do not, and the tools are offered.
+#
+# When the user explicitly enables web for the turn, wording does not withhold
+# anything: confirmed end to end against a local Qwen3.5-9B Q4_K_M, where all
+# three phrasings were offered web_search, web_fetch and private_browser. That
+# may well be correct, an explicit toggle beating an inferred negative, so it
+# is recorded here rather than asserted either way.
+#
+# The two inferred-path cases that do not hold are xfail(strict=True): they
+# document the target, run on every suite, and fail the moment the behaviour
+# lands. Delete the marker then.
HELD = ["Answer from memory only, don't search online."]