Skip to content

Guides and resources for AI engineers: an agents course, five handbooks, a hands-on second-brain project and a vetted reading list.

701 B
Raw Blame

Eval engineering

Measurement as the discipline of AI products: golden sets, judges that do not lie, agent trajectories — and your first suite built in an afternoon.

The handbook for module 5 of the agents course: the module teaches the idea once; this holds the full menu — techniques, tools and builds. Read it on the site or dip in below.

  1. Why Evals
  2. Designing Evals
  3. LLM as Judge
  4. Agent Evals
  5. Eval Tooling
  6. Build: Read Your Traces
  7. Build: the Suite
  8. Build: the Gate
  9. Eval Resources