Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.
Rust
docs(classifier): clarify user-turn fail-open retention (#1298)
Bhuvan Agrawal62e59f68620d
diff --git a/docs/routing_algorithms/llm_classifier_routing.md b/docs/routing_algorithms/llm_classifier_routing.mdindex 8b5918d1f..8fce5f1e1 100644--- a/docs/routing_algorithms/llm_classifier_routing.md+++ b/docs/routing_algorithms/llm_classifier_routing.md@@ -311,9 +311,22 @@ calls that follow:classify_trigger = "user_turn"```-Tool results are the agent continuing work the user already asked for, so they-do not re-open the decision. A failed or unusable verdict keeps the current-target. When no target has been selected yet, the next request is judged again.+Tool results continue the current user turn and reuse its selected target.+A new user message runs the judge again and applies the route's failure policy.+`x-initiator` overrides message-based detection: `user` starts a new turn even+for tool results; `agent` can reuse the prior target even for a user-role message.++If a standalone `llm_classifier` route falls back after an unusable verdict or+judge failure, the fallback replaces the previous selection and is retained for+the new turn's continuations. This also applies when no target has been selected+yet.++For capability routes, the fallback is `strong_target`. With `fail_open = true`+(the default), a judge client failure can therefore replace a previous+`weak_target` selection. With `fail_open = false`, errors returned by the judge+call stop the request. If a host delivers a judge stream that later fails while+libsy reads it, the failure becomes an unusable verdict and can still select+`strong_target`. Custom and direct routes use `default_target` when falling back.`new_session` judges once and reuses that target for the rest of the session,including `strong_target` when it was selected as the fallback for an unusable