Updated 5mo ago
by Qwen-Applications
Skill-RM
Skill-RM: Unifying Heterogeneous Evaluation Criteria via Agent Skill
26 GitHub stars (26)
+1 in 30 days
| Period | New stars |
|---|---|
| Oct 1 | 0 |
| Oct 2 | 0 |
| Oct 3 | 0 |
| Oct 4 | 0 |
| Oct 5 | 0 |
| Oct 6 | 0 |
| Oct 7 | 0 |
| Oct 8 | 0 |
| Oct 9 | 0 |
| Oct 10 | 0 |
| Oct 11 | 0 |
| Oct 12 | 0 |
| Oct 13 | 0 |
| Oct 14 | 0 |
| Oct 15 | 0 |
| Oct 16 | 0 |
| Oct 17 | 0 |
| Oct 18 | 0 |
| Oct 19 | 0 |
| Oct 20 | 0 |
| Oct 21 | 0 |
| Oct 22 | 0 |
| Oct 23 | 0 |
| Oct 24 | 0 |
| Oct 25 | 0 |
| Oct 26 | 0 |
| Oct 27 | 0 |
| Oct 28 | +1 |
| Oct 29 | 0 |
| Oct 30 | 0 |
| Oct 31 | 0 |
| Nov 1 | 0 |
| Nov 2 | 0 |
| Nov 3 | 0 |
| Nov 4 | 0 |
| Nov 5 | 0 |
- 4 skills (4 skills found in its SKILL.md files)
- 1 forks (1 forks)
- 5mo ago last update (Last updated 5mo ago)
Install
Skills CLI
npx skills add Qwen-Applications/Skill-RM
Asks which skills and agents to install. Just one: npx skills add Qwen-Applications/Skill-RM --skill instruction_following — add -g for every project.
Claude Code
git clone https://github.com/Qwen-Applications/Skill-RMcp -r "Skill-RM/skills/instruction_following" ~/.claude/skills/
Copies the instruction_following skill into ~/.claude/skills/ for every project (use .claude/skills/ for one project). Repeat for the other skills listed below.
Plugin
/plugin marketplace add Qwen-Applications/Skill-RM
Run inside Claude Code if the repository ships a plugin marketplace, then pick plugins from /plugin.
Skills can run code on your machine — read the SKILL.md first.
What it does
In the author's own words, from each skill's SKILL.md.
-
instruction_following
Use this skill when judging instruction following for IF-RewardBench-style samples. It is especially useful when the sample contains exact constraints, a visible checklist, format requirements, word/count limits, language restrictions, or multiple sub-instructions that should be decomposed before the final benchmark judgment.
skills/instruction_following/ on GitHub (opens in a new tab)SKILL.md -
reward_judge_fair
Use this Skill-RM reward judge to compare candidate responses for a visible user request with generic rubric, principles, bias controls, output contract, and Python sandbox checks over visible text.
skills/reward_judge_fair/ on GitHub (opens in a new tab)SKILL.md -
reward_judge_operational
Use this Skill-RM reward judge when response judging may benefit from resource-rich evidence: benchmark/task metadata, visible references or ground truth, checklists, verifier signals, code/math/factuality tool protocols, same-backbone judging pipeline signals, or bias-control resources. Load it when these resources can materially change the verdict; do not load it merely to be thorough.
skills/reward_judge_operational/ on GitHub (opens in a new tab)SKILL.md -
instruction_following_pointwise
Use this skill when judging a single candidate response for instruction following and a scalar score is needed. It is especially useful when the sample contains exact constraints, a visible checklist, verifier resources, format requirements, word/count limits, language restrictions, or multiple sub-instructions that should be decomposed before scoring.
integrations/verl/ on GitHub (opens in a new tab)recipe/ skill_rm_if_pointwise/ skills/ instruction_following_pointwise/ SKILL.md
No skill matches that filter.
Review before you install
A skill is a set of instructions and scripts your agent will follow, and it can run code on your machine. Read the SKILL.md and any scripts first — this listing is not a security review.