Awesome list for AI agent harness engineering: tools, patterns, evals, memory, MCP, permissions, observability, and orchestration.
Python agent-harnessagent-memoryagent-orchestrationai-agent-harnessai-agentsawesome-listcontext-engineeringharness-engineeringmcp
Add Self-Harness paper to Generators & Meta-Harnesses section
ai-boostce167db0a8af
diff --git a/README.md b/README.mdindex 7c19778..a8fe377 100644--- a/README.md+++ b/README.md@@ -384,6 +384,7 @@ Real repositories worth studying — each with a note on *why* it's worth your t- [neosigmaai/auto-harness](https://github.com/neosigmaai/auto-harness) — April 2026 open-source self-improving agentic system: bring your own coding agent, automatically mine failures from benchmark runs, optimize the harness through iterative edits, and gate changes against regressions. Supports Terminal-Bench 2.0 and tau-bench with Harbor and Docker evaluation backends. The `PROGRAM.md` pattern — human writes the optimization directive, agent executes the harness engineering loop — is the most accessible entry point for teams wanting meta-harness optimization without building infrastructure from scratch. - [agentic-harness-engineering](https://github.com/china-qijizhifeng/agentic-harness-engineering) — Observability-driven automatic evolution of coding-agent harnesses that decomposes the scaffold into seven orthogonal, git-tracked components and iteratively improves them through trace distillation and evidence-backed edits. Ranked #3 on Terminal-Bench 2.0 (84.7%) with demonstrated cross-model transfer, showing that evolved harness components generalize beyond benchmark-specific tuning. - [Meta-Harness: End-to-End Optimization of Model Harnesses](https://arxiv.org/abs/2603.28052) — Treats the entire harness (system prompt, tool definitions, context management, completion logic) as a joint optimization target rather than hand-tuning each piece. The key insight: give the proposer agent filesystem access to all prior harness candidates, scores, and execution traces — 10M-token diagnostic context vs. the 26K in prior work — so it can trace failures back to specific harness decisions.+- [Self-Harness: Harnesses That Improve Themselves](https://arxiv.org/abs/2606.09498) — June 2026 proposal for a self-improving harness loop: the agent mines its own failure traces, proposes minimal harness edits, and validates them through regression testing. Improves Terminal-Bench-2.0 pass rates by 20+ percentage points across MiniMax, Qwen, and GLM without requiring stronger external agents, showing that model-specific harness tuning can be automated rather than hand-engineered.- [HyperAgents: Self-Improving AI Systems](https://pooya.blog/blog/hyperagents-self-improving-ai-meta-research-2026/) — Meta's framework integrating task-solving and meta-level improvement into a unified, editable program with metacognitive self-modification. Improved paper-review tasks from 0.0 to 0.710, transferred to Olympiad math grading at 0.630 improvement@50 score. Shows how agents can be designed to modify their own harness (prompts, tools, strategy) based on execution history — the ultimate meta-harness where the agent itself evolves the scaffolding.- [AutoAgent](https://github.com/kevinrgu/autoagent) — Open-source library (April 2026) that automates the harness engineering loop itself: give it a task and a benchmark, and it iterates overnight on system prompts, tool configurations, agent orchestration, and routing — keeping or discarding each change based on score. In a 24-hour run, hit #1 on SpreadsheetBench (96.5%) and the top GPT-5 score on TerminalBench (55.1%), beating every hand-engineered entry. The `program.md` separation of concerns (human writes the directive, agent engineers the harness) is the most practical meta-harness pattern published so far. - [metaharness](https://github.com/SuperagenticAI/metaharness) — Open-source Python library (April 2026) that implements an outer optimization loop around executable harnesses for coding agents. Inspired by the Meta-Harness paper, it treats `AGENTS.md`, setup scripts, validation logic, and test flows as optimizable artifacts rather than static configs — with filesystem-backed run stores, environment snapshots, and scoped write enforcement. The most practical reference for teams who want to improve harness *code* rather than just prompts. 