Skip to content

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

Rust
456 B
Raw Blame
# SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: Apache-2.0

"""Candidate-bound Switchyard routing plugins for LiteLLM."""

from .random_routing_plugin import RandomRoutingPlugin
from .stage_routing_plugin import StageRoutingPlugin
from .switchyard_routing_plugin import SwitchyardRoutingPlugin

__all__ = ["RandomRoutingPlugin", "StageRoutingPlugin", "SwitchyardRoutingPlugin"]