Skip to content

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

Rust
619 B
Raw Blame
# SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: Apache-2.0

# Strategic merge patch for Dynamo's existing switchyard-preproc Deployment.
spec:
  replicas: 1
  strategy:
    type: Recreate
    rollingUpdate: null
  template:
    spec:
      containers:
      - name: preproc
        env:
        - name: ROUTES_CONFIG
          value: /etc/switchyard/routes.toml
        - name: METRICS_CONFIG
          value: /etc/switchyard/metrics.toml
      volumes:
      - name: routing-config
        configMap:
          name: switchyard-task-config