Multi-tier framework for evaluating AI agent skills and plugins with quality gates, security scanning, harness compatibility checks, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior. Ships reusable CI templates that bring every check to any repository.
Python agent-evaluationagent-pluginsagent-securityagent-skillsagentic-aibenchmarkci-templatesclaude-codecodexevaluateevaluationharnesspluginplugin-evaluationsecurity-scannerskill-evalskill-evaluationskill-evaluatorskill-gap-analysisskills
# SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: Apache-2.0
# SkillEvaluator public runtime image.
#
# The image installs every public optional dependency. Tier 3 still requires
# credentials for the selected provider and agent at runtime.
FROM python:3.12-slim
ENV PIP_NO_INPUT=1 \
PYTHONDONTWRITEBYTECODE=1
WORKDIR /app
COPY . /app
RUN python -m pip install --no-cache-dir --upgrade pip && \
python -m pip install --no-cache-dir ".[all]" && \
skillevaluator --help >/dev/null
RUN useradd --create-home --uid 10001 --shell /usr/sbin/nologin skillevaluator && \
mkdir /app/reports && \
chown skillevaluator:skillevaluator /app/reports
USER skillevaluator
ENTRYPOINT ["skillevaluator"]
CMD ["--help"]