Skip to content

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

fix(ci): skip smoke OpenAI eval cleanly when OPENAI_API_KEY secret unset

chopratejasa281de6bb027
diff --git a/.github/workflows/eval.yml b/.github/workflows/eval.yml
index bdce0020f..640904fc7 100644
--- a/.github/workflows/eval.yml
+++ b/.github/workflows/eval.yml
@@ -46,10 +46,21 @@ jobs:
print(f'CCR Round-trip: {result.passed_cases}/{result.total_cases} passed')
assert result.passed, f'CCR failures: {result.errors}'
"
- - name: Run built-in tool output eval
- run: python -m headroom.evals quick -n 8 --provider openai --model gpt-4o-mini
+ # OPENAI_API_KEY is intentionally not set in the public OSS repo
+ # (the secret list is empty). The CCR round-trip step above is the
+ # mandatory gate; this step only runs when an operator has wired
+ # OPENAI_API_KEY as a repo secret (e.g. on a downstream fork). When
+ # missing, emit a loud GitHub `::warning::` annotation so the skip
+ # is visible in the run summary — never a silent pass.
+ - name: Run built-in tool output eval (skipped when OPENAI_API_KEY unset)
env:
OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+ run: |
+ if [ -z "${OPENAI_API_KEY}" ]; then
+ echo "::warning title=Smoke eval skipped::OPENAI_API_KEY is not configured for this repo; only the CCR round-trip gate ran. Wire the secret to enable the live OpenAI eval."
+ exit 0
+ fi
+ python -m headroom.evals quick -n 8 --provider openai --model gpt-4o-mini
# Full Tier 1 suite, weekly or manual (~$3-5, ~30-45 min)
weekly-suite: