Updated 2mo ago
by Galileo-Agent-Labs
eval-engineer
Bring Galileo powered eval workflows into Claude Code and Codex.
43 GitHub stars (43)
+1 in 20 days
| Period | New stars |
|---|---|
| Sep 27 | 0 |
| Sep 28 | 0 |
| Sep 29 | 0 |
| Sep 30 | 0 |
| Oct 1 | 0 |
| Oct 2 | 0 |
| Oct 3 | 0 |
| Oct 4 | 0 |
| Oct 5 | 0 |
| Oct 6 | 0 |
| Oct 7 | 0 |
| Oct 8 | 0 |
| Oct 9 | 0 |
| Oct 10 | 0 |
| Oct 11 | 0 |
| Oct 12 | 0 |
| Oct 13 | +1 |
| Oct 14 | 0 |
| Oct 15 | 0 |
| Oct 16 | 0 |
- 8 skills (8 skills found in its SKILL.md files)
- 9 forks (9 forks)
- 2mo ago last update (Last updated 2mo ago)
Install
Skills CLI
npx skills add Galileo-Agent-Labs/eval-engineer
Asks which skills and agents to install. Just one: npx skills add Galileo-Agent-Labs/eval-engineer --skill eval-audit — add -g for every project.
Claude Code
git clone https://github.com/Galileo-Agent-Labs/eval-engineercp -r "eval-engineer/skills/eval-audit" ~/.claude/skills/
Copies the eval-audit skill into ~/.claude/skills/ for every project (use .claude/skills/ for one project). Repeat for the other skills listed below.
Plugin
/plugin marketplace add Galileo-Agent-Labs/eval-engineer
Run inside Claude Code if the repository ships a plugin marketplace, then pick plugins from /plugin.
Skills can run code on your machine — read the SKILL.md first.
What it does
In the author's own words, from each skill's SKILL.md.
-
eval-audit
Use when the user asks for an AI app audit, launch readiness review, safety/security review, OWASP agentic risk check, metric coverage review, or production RCA gap review.
skills/eval-audit/SKILL.md on GitHub (opens in a new tab) -
eval-cost
Use when the user asks to make an AI app cheaper or faster, reduce tokens, latency, model/tool/retrieval/rerank/self-check/retry/evaluator cost, or compare cost before/after.
skills/eval-cost/SKILL.md on GitHub (opens in a new tab) -
eval-dataset
Use when the user asks to turn a failure into an eval, create/review/accept/reject dataset cases, or convert Galileo traces, metric gaps, or production examples into cases.
skills/eval-dataset/SKILL.md on GitHub (opens in a new tab) -
eval-diagnose
Use when Galileo evidence is available and the user asks why a trace, session, log stream, experiment, metric, or AI app behavior failed, regressed, or became unsafe.
skills/eval-diagnose/SKILL.md on GitHub (opens in a new tab) -
eval-engineer
Use when a user is unsure which Eval Engineer command to run for AI agents/RAG apps, needs onboarding/status for a .galileo workspace, or asks where to start.
skills/eval-engineer/SKILL.md on GitHub (opens in a new tab) -
eval-fetch
Use when a user asks to fetch Galileo evidence, provides Galileo URLs or IDs, says "fetch this Galileo link", or needs traces, sessions, experiments, or log streams saved locally.
skills/eval-fetch/SKILL.md on GitHub (opens in a new tab) -
eval-measure
Use when the user asks if an AI app is measured correctly, needs Galileo metrics, expected-output contracts, metric profiles, eval gates, or measurement before optimizing.
skills/eval-measure/SKILL.md on GitHub (opens in a new tab) -
eval-setup
Use when the user asks to set up Eval Engineer, check .galileo readiness, create workspace scaffolding, or configure editable files, verification commands, app type, or evidence paths.
skills/eval-setup/SKILL.md on GitHub (opens in a new tab)
No skill matches that filter.
Review before you install
A skill is a set of instructions and scripts your agent will follow, and it can run code on your machine. Read the SKILL.md and any scripts first — this listing is not a security review.