Updated 1d ago
by NVIDIA
SkillEvaluator
Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.
571 GitHub stars (571)
+52 in 20 days
| Period | New stars |
|---|---|
| Sep 27 | 0 |
| Sep 28 | +3 |
| Sep 29 | +5 |
| Sep 30 | +1 |
| Oct 1 | +1 |
| Oct 2 | +3 |
| Oct 3 | +1 |
| Oct 4 | +1 |
| Oct 5 | +2 |
| Oct 6 | +4 |
| Oct 7 | +4 |
| Oct 8 | +2 |
| Oct 9 | +6 |
| Oct 10 | +2 |
| Oct 11 | +1 |
| Oct 12 | +5 |
| Oct 13 | +2 |
| Oct 14 | +2 |
| Oct 15 | +5 |
| Oct 16 | +2 |
- 6 skills (6 skills found in its SKILL.md files)
- 66 forks (66 forks)
- 1d ago last update (Last updated 1d ago)
Install
Skills CLI
npx skills add NVIDIA/SkillEvaluator
Asks which skills and agents to install. Just one: npx skills add NVIDIA/SkillEvaluator --skill simple — add -g for every project.
Claude Code
git clone https://github.com/NVIDIA/SkillEvaluatorcp -r "SkillEvaluator/tests/fixtures/skills/simple" ~/.claude/skills/
Copies the simple skill into ~/.claude/skills/ for every project (use .claude/skills/ for one project). Repeat for the other skills listed below.
Plugin
/plugin marketplace add NVIDIA/SkillEvaluator
Run inside Claude Code if the repository ships a plugin marketplace, then pick plugins from /plugin.
Skills can run code on your machine — read the SKILL.md first.
What it does
In the author's own words, from each skill's SKILL.md.
-
simple
Summarize short user notes into clear action items.
tests/fixtures/skills/simple/SKILL.md on GitHub (opens in a new tab) -
api-caller
Call any REST API dynamically. Make GET, POST, PUT, DELETE requests to any endpoint with custom headers and JSON body.
src/skillevaluator/tier3/reference_skills/api-caller/SKILL.md on GitHub (opens in a new tab) -
calculator
Evaluate mathematical expressions and unit conversions. Handles arithmetic, percentages, exponents, and common unit conversions (temperature, distance, weight). No external dependencies.
src/skillevaluator/tier3/reference_skills/calculator/SKILL.md on GitHub (opens in a new tab) -
create-custom-grader
Use when converting an existing benchmark, rubric, verifier, task YAML/JSON, or domain check into SkillEvaluator BYOG/BYOT custom evaluation.
src/skillevaluator/tier3/reference_skills/create-custom-grader/SKILL.md on GitHub (opens in a new tab) -
task-list
Required for 4+ step requests; add tasks at start and update status after each step.
src/skillevaluator/tier3/reference_skills/task-list/SKILL.md on GitHub (opens in a new tab) -
text-analyzer
Analyze text content and produce statistics including word count, line count, character count, most frequent words, and readability metrics. Works on any plain text input provided inline or from a file path.
src/skillevaluator/tier3/reference_skills/text-analyzer/SKILL.md on GitHub (opens in a new tab)
No skill matches that filter.
Review before you install
A skill is a set of instructions and scripts your agent will follow, and it can run code on your machine. Read the SKILL.md and any scripts first — this listing is not a security review.
Similar skills
-
SkillSpectorby NVIDIA Security scanner for AI agent skills. Detect vulnerabilities, malicious patterns, security risks, prompt injection, data exfiltration, and…
-
-
reaby morluto Reverse engineer anything with agents, from app behavior down to native binaries.
-
ponytailby DietrichGebert Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.
-
agent-skillsby addyosmani Production-grade engineering skills for AI coding agents.
-
paperclipby paperclipai The open-source app everyone uses to manage agents at work