Multi-tier framework for evaluating AI agent skills and plugins with quality gates, security scanning, harness compatibility checks, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior. Ships reusable CI templates that bring every check to any repository.
Python agent-evaluationagent-pluginsagent-securityagent-skillsagentic-aibenchmarkci-templatesclaude-codecodexevaluateevaluationharnesspluginplugin-evaluationsecurity-scannerskill-evalskill-evaluationskill-evaluatorskill-gap-analysisskills
Commits on main
Merge branch 'main' into fix/christopherk/tier3-agent-visible-fixture-isolation
5b9b630 Narendran Raghavan committed 3 months ago
Merge pull request #40 from NVIDIA/fix/christopherk/stable-oss-boundary-anchors
8895c21 Narendran Raghavan committed 3 months ago
Merge branch 'main' into feat/christopherk/docs-only-ci
c47a2aa Narendran Raghavan committed 3 months ago
fix(ci): avoid benchmark scanner regex backtracking
29cbc33 Narendran Raghavan committed 3 months ago
Merge remote-tracking branch 'origin/main' into fix/christopherk/tier3-agent-visible-fixture-isolation
281d632 Narendran Raghavan committed 3 months ago
fix(reporting): enforce benchmark publication evidence
492a699 Narendran Raghavan committed 3 months ago
Merge remote-tracking branch 'origin/main' into fix/christopherk/issue-30-keyword-boundaries
3a3405e Narendran Raghavan committed 3 months ago
fix(quality): cover remaining context false positives
30c04be Narendran Raghavan committed 3 months ago
Merge branch 'main' into fix/christopherk/stable-oss-boundary-anchors
8d5cd87 Narendran Raghavan committed 3 months ago
Merge pull request #36 from NVIDIA/feat/christopherk/issue-32-relevance-aware-links
e5e0702 Narendran Raghavan committed 3 months ago
Merge branch 'main' into fix/christopherk/tier3-agent-visible-fixture-isolation
98ccc3c Christopher Kevin committed 3 months ago
Merge branch 'main' into fix/christopherk/issue-30-keyword-boundaries
7bf77ac Christopher Kevin committed 3 months ago
Fix Tier 2 discovery for contained compatibility alias
2a3ace4 Christopher Kevin committed 3 months ago
Merge branch 'main' into feat/christopherk/docs-only-ci
b92ab6d Christopher Kevin committed 3 months ago
docs: link the NVIDIA Verified Skills docs from SkillEvaluator (#46)
0827e0f Moshe Abramovitch committed 3 months ago
feat(reporting): roll out unified benchmark publication card
a8e40ee Narendran Raghavan committed 3 months ago