Skip to content

Multi-tier framework for evaluating AI agent skills and plugins with quality gates, security scanning, harness compatibility checks, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior. Ships reusable CI templates that bring every check to any repository.

Commits on main

fix(tier3): retry malformed structured judge responses (#78)
Christopher Kevin committed 2 months ago
5387261
df62d82
b9d2f96
fix(tier3): fail fast on rejected credentials (#75)
Christopher Kevin committed 2 months ago
7119e2a
fix(tier3): score Harbor single-step null results (#74)
Christopher Kevin committed 2 months ago
0d5a9b8
Merge pull request #76 from NVIDIA/naren/release-v0.2.1
Narendran Raghavan committed 2 months ago
236accd
chore(release): prepare v0.2.1
Narendran Raghavan committed 2 months ago
0691c64
e3910c2
fix(tier3): redact persisted reward artifacts
Christopher Kevin committed 3 months ago
3daa3fd
fix(tier3): preserve trusted negative-control evidence
Christopher Kevin committed 3 months ago
1cd1c07
283bd22
Fix quality scoring with CommonMark structural parsing (#53)
Christopher Kevin committed 3 months ago
68013df
7a16f6b
fix(tier3): enforce structured insight grounding
rookepoole committed 3 months ago
f0aef86
fix(tier3): isolate custom verifier judge models
Christopher Kevin committed 3 months ago
090bb71
Merge branch 'main' into feat/christopherk/judge-model-override
Narendran Raghavan committed 3 months ago
7666460
Merge pull request #47 from NVIDIA/naren/rollout-benchmark-pr25
Narendran Raghavan committed 3 months ago
8850da0
Merge branch 'main' into fix/issue-57-negative-control-insights
Narendran Raghavan committed 3 months ago
eed4780
Merge branch 'main' into naren/rollout-benchmark-pr25
Narendran Raghavan committed 3 months ago
d39eb52
1cec101
fix(tier3): ground negative-control insights
rookepoole committed 3 months ago
829ea30
Merge branch 'main' into fix/issue-57-negative-control-insights
Narendran Raghavan committed 3 months ago
b6a0c0b