Skip to content

Multi-tier framework for evaluating AI agent skills and plugins with quality gates, security scanning, harness compatibility checks, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior. Ships reusable CI templates that bring every check to any repository.

Commits on main

d34500f
5426d87
docs: add docs/livestream/blog links to README (#159)
Moshe Abramovitch committed 1 month ago
41e5469
docs: link SkillEvaluator research paper (#146)
Christopher Kevin committed 2 months ago
5c73273
test: stabilize FIFO subprocess checks (#148)
Deepak Jain (DJ) committed 2 months ago
14d47f1
chore(release): prepare v0.3.0 (#144)
Narendran Raghavan committed 2 months ago
ac0a049
fix(embedding): reject non-progressing chunk windows (#142)
Deepak Jain (DJ) committed 2 months ago
cdb4dbb
d4bcb3f
feat(cli): parallel catalog validation and fleet rollup (#123)
Mohammed Imran Khan committed 2 months ago
baf43f5
2af26f5
efcd97a
fix: map Harbor trial folders to eval case ids (#104)
Mohammed Imran Khan committed 2 months ago
d979722
Fix empty process-control environment resets (#133)
RyaliNvidia committed 2 months ago
7e189c6
104ccb7
Honor SkillSpector analysis completeness (#112)
Tomauskasz committed 2 months ago
ff349e0
fix: accept UTF-8 BOM in SKILL.md frontmatter (#99)
Mohammed Imran Khan committed 2 months ago
121261e
fix(tier3): decode native Codex exec calls (#111)
Tomauskasz committed 2 months ago
73b27da
fix: evaluate full SPDX license expressions (#98)
Mohammed Imran Khan committed 2 months ago
7ddcafb
fix: flag Windows PII usernames that start with s (#95)
Mohammed Imran Khan committed 2 months ago
b882b16
fix: treat tools/ as an executable directory (#103)
Mohammed Imran Khan committed 2 months ago
c923d77
fix: do not let frontmatter MIT hide a GPL LICENSE file (#97)
Mohammed Imran Khan committed 2 months ago
3bfba44
feat: add SARIF reporter for GitHub Code Scanning (#117)
Mohammed Imran Khan committed 2 months ago
ea9b239
fix: keep --llm-verify file reads inside the skill (#101)
Mohammed Imran Khan committed 2 months ago
f1a5b4c
fix: skip gitleaks test dirs, not substring names (#102)
Mohammed Imran Khan committed 2 months ago
14a888e