Updated 4mo ago
by Qwen-Applications
Skill-RM
Skill-RM: Unifying Heterogeneous Evaluation Criteria via Agent Skill
25 GitHub stars (25)
Steady at 25 stars — no new stars in the 16 days since Sep 30.
- 4 skills (4 skills found in its SKILL.md files)
- 1 forks (1 forks)
- 4mo ago last update (Last updated 4mo ago)
Install
Skills CLI
npx skills add Qwen-Applications/Skill-RM
Asks which skills and agents to install. Just one: npx skills add Qwen-Applications/Skill-RM --skill instruction_following — add -g for every project.
Claude Code
git clone https://github.com/Qwen-Applications/Skill-RMcp -r "Skill-RM/skills/instruction_following" ~/.claude/skills/
Copies the instruction_following skill into ~/.claude/skills/ for every project (use .claude/skills/ for one project). Repeat for the other skills listed below.
Plugin
/plugin marketplace add Qwen-Applications/Skill-RM
Run inside Claude Code if the repository ships a plugin marketplace, then pick plugins from /plugin.
Skills can run code on your machine — read the SKILL.md first.
What it does
In the author's own words, from each skill's SKILL.md.
-
instruction_following
Use this skill when judging instruction following for IF-RewardBench-style samples. It is especially useful when the sample contains exact constraints, a visible checklist, format requirements, word/count limits, language restrictions, or multiple sub-instructions that should be decomposed before the final benchmark judgment.
skills/instruction_following/SKILL.md on GitHub (opens in a new tab) -
reward_judge_fair
Use this Skill-RM reward judge to compare candidate responses for a visible user request with generic rubric, principles, bias controls, output contract, and Python sandbox checks over visible text.
skills/reward_judge_fair/SKILL.md on GitHub (opens in a new tab) -
reward_judge_operational
Use this Skill-RM reward judge when response judging may benefit from resource-rich evidence: benchmark/task metadata, visible references or ground truth, checklists, verifier signals, code/math/factuality tool protocols, same-backbone judging pipeline signals, or bias-control resources. Load it when these resources can materially change the verdict; do not load it merely to be thorough.
skills/reward_judge_operational/SKILL.md on GitHub (opens in a new tab) -
instruction_following_pointwise
Use this skill when judging a single candidate response for instruction following and a scalar score is needed. It is especially useful when the sample contains exact constraints, a visible checklist, verifier resources, format requirements, word/count limits, language restrictions, or multiple sub-instructions that should be decomposed before scoring.
integrations/verl/recipe/skill_rm_if_pointwise/skills/instruction_following_pointwise/SKILL.md on GitHub (opens in a new tab)
No skill matches that filter.
Review before you install
A skill is a set of instructions and scripts your agent will follow, and it can run code on your machine. Read the SKILL.md and any scripts first — this listing is not a security review.