Skip to content

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

Rust
1.7 KB
Raw Blame

craft-taskgen docs

Three buckets:

  • runbooks/ — operational walkthroughs. Read these to do something.
  • reference/ — definitions, schemas, calibration data. Read these to understand what something means.
  • analyses/ — frozen-in-time research writeups. Read these for evidence, not procedures.

Runbooks

File When to read
runbooks/running-a-batch.md Launching a deterministic repo batch through the Tools pipeline
runbooks/baseline-reproducibility.md Running scripts/run-baselines.sh; reasoning-effort matrix; version pins
runbooks/task-review-workflow.md Auditing accepted tasks across multi-trial baselines

Reference

File What it documents
reference/task-format.md CRAFT task directory format spec (task.toml, solve.sh, tests, etc.)
reference/pipeline-state-machine.md Stage transitions and state.json schema
reference/easiness-heuristics.md Objective rules that flag accepted tasks as "too easy"
reference/n-parallel-calibration-apr25.md Calibration that drove build_n_candidates=3
reference/adapter-reproducibility.md Adapter-author migration guide for version pinning
reference/planning-scorer-phase.{mmd,png} Mermaid + render of the planning-scorer phase

Analyses

Date-prefixed (newest first). See analyses/README.md for context on each.