Skip to content

Agent Mesh

fix(k8s): bind openrouter-canary litellm proxy to loopback and allow unset master key

Antonio Ojeaababa9987f27
diff --git a/.github/k8s/sam-node-openrouter-template.yaml b/.github/k8s/sam-node-openrouter-template.yaml
index ae22d884..53321905 100644
--- a/.github/k8s/sam-node-openrouter-template.yaml
+++ b/.github/k8s/sam-node-openrouter-template.yaml
@@ -40,6 +40,8 @@ spec:
image: ghcr.io/berriai/litellm:main-latest
command:
- "litellm"
+ - "--host"
+ - "127.0.0.1"
- "--model"
- "openrouter/auto"
- "--port"
@@ -50,8 +52,8 @@ spec:
secretKeyRef:
name: openrouter-secret-${ENV_NAME}
key: api-key
- ports:
- - containerPort: 4000
+ - name: LITELLM_DANGEROUSLY_PERMIT_WEAK_OR_UNSET_MASTER_KEY
+ value: "true"
resources:
requests:
cpu: 100m
diff --git a/site/content/docs/guides/exposing-services.md b/site/content/docs/guides/exposing-services.md
index 4b2f1708..13a83755 100644
--- a/site/content/docs/guides/exposing-services.md
+++ b/site/content/docs/guides/exposing-services.md
@@ -108,7 +108,9 @@ same pod or on the same host:
```
```bash
-OPENROUTER_API_KEY=... litellm --model openrouter/auto --port 4000
+OPENROUTER_API_KEY=... \
+ LITELLM_DANGEROUSLY_PERMIT_WEAK_OR_UNSET_MASTER_KEY=true \
+ litellm --host 127.0.0.1 --model openrouter/auto --port 4000
```
The key never leaves the proxy. Callers on the mesh authenticate with their