Skip to content

Multi-tier framework for evaluating AI agent skills and plugins with quality gates, security scanning, harness compatibility checks, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior. Ships reusable CI templates that bring every check to any repository.

Commits on main

fix(reporting): address benchmark publication follow-up
Narendran Raghavan committed 3 months ago
5a909a8
ef9ca72
Merge pull request #52 from NVIDIA/naren/release-v0.2.0
Narendran Raghavan committed 3 months ago
48f02d3
fix(tier3): handle negative controls in insights
rookepoole committed 3 months ago
b5b479e
fix(tier3): normalize judge model aliases
Christopher Kevin committed 3 months ago
2e34871
fix(tier3): enforce judge overrides at job scope
Christopher Kevin committed 3 months ago
aeb80cb
fix(tier3): propagate judge model overrides
Christopher Kevin committed 3 months ago
ec59f5a
fix(reporting): enforce benchmark publication evidence
Narendran Raghavan committed 3 months ago
ee9fd4d
chore(release): prepare v0.2.0
Narendran Raghavan committed 3 months ago
3937ce3
fix(reporting): clarify benchmark fixture scanner scope
Narendran Raghavan committed 3 months ago
dc1a6ca
Merge branch 'main' into naren/rollout-benchmark-pr25
Narendran Raghavan committed 3 months ago
6cdde2b
1dababe
3a9a0f8
e62c573
fix(cli): clarify tier gating metadata handling
Narendran Raghavan committed 3 months ago
047daca
fix(reporting): align blocking Tier 3 skip status
Narendran Raghavan committed 3 months ago
1bab43a
docs: document explicit tier gating
Narendran Raghavan committed 3 months ago
adf3fa0
fix(reporting): honor explicit blocking gates
Narendran Raghavan committed 3 months ago
55d2e27
feat(validate): add explicit tier gating controls
Narendran Raghavan committed 3 months ago
755bb8c
docs: explain boundary-aware quality matching
Narendran Raghavan committed 3 months ago
d9fe1e0
docs: complete benchmark publication guidance
Narendran Raghavan committed 3 months ago
bad7e02
merge(main): refresh benchmark publication rollout
Narendran Raghavan committed 3 months ago
e5056a7
c3e927d
5917f18
Merge branch 'main' into feat/christopherk/docs-only-ci
Narendran Raghavan committed 3 months ago
818a992