Updated 3d ago
by benchflow-ai
skillsbench
SkillsBench evaluates how well skills work and how effective agents are at using them.
1.9k GitHub stars (1,850)
+25 in 16 days
| Period | New stars |
|---|---|
| Oct 1 | 0 |
| Oct 2 | +1 |
| Oct 3 | +2 |
| Oct 4 | +1 |
| Oct 5 | +1 |
| Oct 6 | 0 |
| Oct 7 | +1 |
| Oct 8 | +1 |
| Oct 9 | +2 |
| Oct 10 | +1 |
| Oct 11 | +2 |
| Oct 12 | 0 |
| Oct 13 | +5 |
| Oct 14 | +1 |
| Oct 15 | +5 |
| Oct 16 | +2 |
- 29 skills (29 skills found in its SKILL.md files)
- 370 forks (370 forks)
- 3d ago last update (Last updated 3d ago)
Install
Skills CLI
npx skills add benchflow-ai/skillsbench
Asks which skills and agents to install. Just one: npx skills add benchflow-ai/skillsbench --skill skill-creator — add -g for every project.
Claude Code
git clone https://github.com/benchflow-ai/skillsbenchcp -r "skillsbench/.agents/skills/skill-creator" ~/.claude/skills/
Copies the skill-creator skill into ~/.claude/skills/ for every project (use .claude/skills/ for one project). Repeat for the other skills listed below.
Plugin
/plugin marketplace add benchflow-ai/skillsbench
Run inside Claude Code if the repository ships a plugin marketplace, then pick plugins from /plugin.
Skills can run code on your machine — read the SKILL.md first.
What it does
In the author's own words, from each skill's SKILL.md — showing the first 29 of 276 files.
-
skill-creator
Guide for creating effective skills. This skill should be used when users want to create a new skill (or update an existing skill) that extends Codex's capabilities with specialized knowledge, workflows, or tool integrations.
.agents/skills/skill-creator/SKILL.md on GitHub (opens in a new tab) -
skillsbench
SkillsBench contribution workflow. Use when: (1) Creating benchmark tasks, (2) Understanding repo structure, (3) Preparing PRs for task submission.
.agents/skills/skillsbench/SKILL.md on GitHub (opens in a new tab) -
task-creator
SkillsBench task authoring — walk a contributor from idea to submission-ready task following CONTRIBUTING.md and the task-implementation rubric. Use when the user wants to create a new SkillsBench task, scaffold a task from an existing workflow (notebook, Excel workbook, document, dataset), convert a prompt or a benchmark item into a SkillsBench task, write skills for a task, or prepare a SkillsB…
.agents/skills/task-creator/SKILL.md on GitHub (opens in a new tab) -
task-review
SkillsBench task PR review — classifies the task track (standard / research / multimodal), runs static policy checks against the track-specific rubric, benchmarks the task across oracle plus Claude and Codex (with and without skills), audits trajectories for cheating and skill invocation, and produces a `pr-N-task-timestamp-run.txt` review report alongside a `prN.zip` bundle of trajectories. Use…
.agents/skills/task-review/SKILL.md on GitHub (opens in a new tab) -
comp3-packed-decimal
Reference for COBOL COMP-3 (packed decimal / BCD) numeric storage -- layout on disk, declaring it in the FD, and pitfalls when carrying the decoded value through working storage and into later arithmetic. Useful when an input record holds a balance, rate, or carry-forward as packed decimal rather than a printable digit string.
tasks-extra/cobol-gl-batch-reconcile/environment/skills/comp3-packed-decimal/SKILL.md on GitHub (opens in a new tab) -
ebcdic-overpunch-decoding
Reference for the EBCDIC "overpunch" / zoned-decimal sign convention where the units position of a numeric field is replaced with a letter that encodes both a digit and a sign. Useful when reading mainframe-style fixed-length tapes whose amount fields appear as digits followed by a letter (e.g. "0000000000123D" or "0000000000045M").
tasks-extra/cobol-gl-batch-reconcile/environment/skills/ebcdic-overpunch-decoding/SKILL.md on GitHub (opens in a new tab) -
gl-posting-codes
Background on general-ledger batch posting codes (HD/DR/CR/RV plus signed "other" rows). Reference only -- follow the task instruction for the exact rules, which may differ per account type.
tasks-extra/cobol-gl-batch-reconcile/environment/skills/gl-posting-codes/SKILL.md on GitHub (opens in a new tab) -
gnucobol-mainframe-batch
GnuCOBOL toolchain pointers for mainframe-style batch programs (LINE/RECORD SEQUENTIAL files, PIC clauses, cobc build flags).
tasks-extra/cobol-gl-batch-reconcile/environment/skills/gnucobol-mainframe-batch/SKILL.md on GitHub (opens in a new tab) -
paired-reversal-cancellation
Reference for paired-reversal handling on GL batch tapes: an RV row whose ref-trace points at an earlier row cancels BOTH legs (the RV and the row it references) — but ONLY when the two value-dates fall within the shop's reversal settlement window; an RV that references a too-old posting is NOT a cancellation and posts one-sided. Useful when the posting tape carries a reference-trace column along…
tasks-extra/cobol-gl-batch-reconcile/environment/skills/paired-reversal-cancellation/SKILL.md on GitHub (opens in a new tab) -
triangulated-fx-rates
Reference for multi-hop / triangulated currency conversion on batch rate tapes. When a rate row carries an explicit "via" currency, the row's rate is only one leg of the conversion, and the via currency may ITSELF be quoted through another via — so the effective rate is the product of every leg, resolved by walking the chain until a direct quote is reached. Useful when an FX feed lists some pairs…
tasks-extra/cobol-gl-batch-reconcile/environment/skills/triangulated-fx-rates/SKILL.md on GitHub (opens in a new tab) -
attention-variants-from-papers
Implement paper-defined attention variants by extracting mechanism invariants, mapping tensor shapes, preserving module interfaces, validating numerical behavior, and integrating the custom attention into an existing transformer stack.
tasks-extra/diff-transformer_impl/environment/skills/attention-variants-from-papers/SKILL.md on GitHub (opens in a new tab) -
modal-gpu
Run Python code on cloud GPUs using Modal serverless platform. Use when you need A100/T4/A10G GPU access for training ML models. Covers Modal app setup, GPU selection, data downloading inside functions, and result handling.
tasks-extra/diff-transformer_impl/environment/skills/modal-gpu/SKILL.md on GitHub (opens in a new tab) -
pdf
PDF manipulation toolkit. Extract text/tables, create PDFs, merge/split, fill forms, for programmatic document processing and analysis.
tasks-extra/find-topk-similiar-chemicals/environment/skills/pdf/SKILL.md on GitHub (opens in a new tab) -
pubchem-database
Query PubChem via PUG-REST API/PubChemPy (110M+ compounds). Search by name/CID/SMILES, retrieve properties, similarity/substructure searches, bioactivity, for cheminformatics.
tasks-extra/find-topk-similiar-chemicals/environment/skills/pubchem-database/SKILL.md on GitHub (opens in a new tab) -
rdkit
Cheminformatics toolkit for fine-grained molecular control. SMILES/SDF parsing, descriptors (MW, LogP, TPSA), fingerprints, substructure search, 2D/3D generation, similarity, reactions. For standard workflows with simpler interface, use datamol (wrapper around RDKit). Use rdkit for advanced control, custom sanitization, specialized algorithms.
tasks-extra/find-topk-similiar-chemicals/environment/skills/rdkit/SKILL.md on GitHub (opens in a new tab) -
gh-cli
The gh CLI is GitHub's official command line tool for interacting with GitHub repositories, issues, pull requests, and more. When needs to interact with GitHub repositories, issues, pull requests, and more, use this skill.
tasks-extra/gh-repo-analytics/environment/skills/gh-cli/SKILL.md on GitHub (opens in a new tab) -
fragmentation-aware-packing
Choose placements that preserve useful residual capacity. Use for bin packing, GPU sharing, accelerator placement, and multi-resource scheduling where stranded capacity hurts future fit.
tasks-extra/gpu-cluster-online-scheduling/environment/skills/fragmentation-aware-packing/SKILL.md on GitHub (opens in a new tab) -
multi-resource-allocation-validation
Validate and repair proposed resource allocations by replaying them against temporary capacity. Use when actions consume several resource dimensions such as CPU, memory, GPUs, or accelerators.
tasks-extra/gpu-cluster-online-scheduling/environment/skills/multi-resource-allocation-validation/SKILL.md on GitHub (opens in a new tab) -
online-resource-scheduling
Design deterministic online scheduling policies from current observations. Use when assigning arriving work to limited resources without seeing future requests.
tasks-extra/gpu-cluster-online-scheduling/environment/skills/online-resource-scheduling/SKILL.md on GitHub (opens in a new tab) -
mhc-algorithm
Implement mHC (Manifold-Constrained Hyper-Connections) for stabilizing deep network training. Use when implementing residual connection improvements with doubly stochastic matrices via Sinkhorn-Knopp algorithm. Based on DeepSeek's 2025 paper (arXiv:2512.24880).
tasks-extra/mhc-layer-impl/environment/skills/mhc-algorithm/SKILL.md on GitHub (opens in a new tab) -
nanogpt-training
Train GPT-2 scale models (~124M parameters) efficiently on a single GPU. Covers GPT-124M architecture, tokenized dataset loading (e.g., HuggingFace Hub shards), modern optimizers (Muon, AdamW), mixed precision training, and training loop implementation.
tasks-extra/mhc-layer-impl/environment/skills/nanogpt-training/SKILL.md on GitHub (opens in a new tab) -
contract-playbook-review
Methodology for clause-by-clause review of a contract against a structured deviation policy ("playbook"). Covers how to walk a playbook, locate the matching provision in the contract, apply rule types (max-value, must-be-present, must-be-absent, acceptable-set, must-have-feature), classify the result (ok / risk / reject), choose the prescribed action, and ground each finding in a verbatim excerpt…
tasks-extra/nda-playbook-review/environment/skills/contract-playbook-review/SKILL.md on GitHub (opens in a new tab) -
nda-clause-taxonomy
Reference for the standard clauses found in commercial non-disclosure agreements (mutual and one-way) — what each clause does, the surface forms it appears in, and how to recognise it in unfamiliar drafting. Use when reviewing, comparing, or extracting provisions from any confidentiality / NDA / mutual NDA / standstill-and-confidentiality agreement.
tasks-extra/nda-playbook-review/environment/skills/nda-clause-taxonomy/SKILL.md on GitHub (opens in a new tab) -
xlsx-parsing
Read Microsoft Excel (.xlsx) files robustly with `openpyxl` (or `pandas`). Covers multi-sheet workbooks, header rows, empty cells, merged cells, comma-separated list cells, and converting a sheet to a list-of-dicts the rest of your code can consume. Use when a task input or reference document is an `.xlsx` file rather than JSON/CSV.
tasks-extra/nda-playbook-review/environment/skills/xlsx-parsing/SKILL.md on GitHub (opens in a new tab) -
gemini-count-in-video
Analyze and count objects in videos using Google Gemini API (object counting, pedestrian detection, vehicle tracking, and surveillance video analysis).
tasks-extra/pedestrian-traffic-counting/environment/skills/gemini-count-in-video/SKILL.md on GitHub (opens in a new tab) -
gemini-video-understanding
Analyze videos with Google Gemini API (summaries, Q&A, transcription with timestamps + visual context, scene/timeline detection, video clipping, FPS control, multi-video comparison, and YouTube URL analysis).
tasks-extra/pedestrian-traffic-counting/environment/skills/gemini-video-understanding/SKILL.md on GitHub (opens in a new tab) -
gpt-multimodal
Analyze images and multi-frame sequences using OpenAI GPT series
tasks-extra/pedestrian-traffic-counting/environment/skills/gpt-multimodal/SKILL.md on GitHub (opens in a new tab) -
video-frame-extraction
Extract frames from video files and save them as images using OpenCV
tasks-extra/pedestrian-traffic-counting/environment/skills/video-frame-extraction/SKILL.md on GitHub (opens in a new tab) -
audiobook
Create audiobooks from web content or text files. Handles content fetching, text processing, and TTS conversion with automatic fallback between ElevenLabs, OpenAI TTS, and gTTS.
tasks-extra/pg-essay-to-audiobook/environment/skills/audiobook/SKILL.md on GitHub (opens in a new tab)
No skill matches that filter.
Review before you install
A skill is a set of instructions and scripts your agent will follow, and it can run code on your machine. Read the SKILL.md and any scripts first — this listing is not a security review.