Multi-tier framework for evaluating AI agent skills and plugins with quality gates, security scanning, harness compatibility checks, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior. Ships reusable CI templates that bring every check to any repository.
Python agent-evaluationagent-pluginsagent-securityagent-skillsagentic-aibenchmarkci-templatesclaude-codecodexevaluateevaluationharnesspluginplugin-evaluationsecurity-scannerskill-evalskill-evaluationskill-evaluatorskill-gap-analysisskills
<svg xmlns="http://www.w3.org/2000/svg" width="250" height="112" viewBox="0 0 250 112" role="img"><title>Run the CLI directly</title><rect x="1" y="1" width="248" height="110" rx="12" fill="#0d1117" stroke="#273129" stroke-width="1"/><g transform="translate(16 14) scale(0.7916666666666666)" fill="none" stroke="#76b900" stroke-width="2.6" stroke-linecap="round" stroke-linejoin="round"><rect x="5" y="9" width="38" height="30" rx="5"/><path d="m13 19 6 5-6 5"/><path d="M23 30h10"/></g><text x="16" y="79" font-family="Inter, ui-sans-serif, -apple-system, BlinkMacSystemFont, 'Segoe UI', Helvetica, Arial, sans-serif" font-size="14.5" font-weight="700" fill="#ffffff">Run the CLI directly</text><text x="16" y="98" font-family="Inter, ui-sans-serif, -apple-system, BlinkMacSystemFont, 'Segoe UI', Helvetica, Arial, sans-serif" font-size="11.5" fill="#9bb08f">On your machine</text></svg>