OpenJudge

In the author's own words, from each skill's SKILL.md.

• claude-authenticity

  Detect whether an API endpoint is backed by genuine Claude (not a wrapper, proxy, or impersonator) using 9 weighted rule-based checks that mirror the claude-verify project. Also extracts injected system prompts from providers that override Claude's identity. Fully self-contained — copy the code below and run, no extra packages beyond httpx. Use when the user wants to verify a Claude API key or en…

  skills/claude-authenticity/SKILL.md on GitHub (opens in a new tab)

• find-skills-combo

  Discover and recommend **combinations** of agent skills to complete complex, multi-faceted tasks. Provides two recommendation strategies — **Maximum Quality** (best skill per subtask) and **Minimum Dependencies** (fewest installs). Use this skill whenever the user wants to find skills, asks "how do I do X", "find a skill for X", or describes a task that likely requires multiple capabilities worki…

  skills/find-skills-combo/SKILL.md on GitHub (opens in a new tab)

• mmx-cli

  Generate text, images, video, speech, and music via the MiniMax AI platform. Covers text generation (MiniMax-M3 model), image generation (image-01), video generation (Hailuo-2.3), speech synthesis (speech-2.8-hd, 300+ voices), music generation (music-2.6 with lyrics, cover, and instrumental), and web search. Use when the user needs to create AI-generated multimedia content, produce narrated audio…

  skills/mmx-cli/SKILL.md on GitHub (opens in a new tab)

• 00-academic-router

  Use when the user wants help with academic papers or citations but it's unclear which specific workflow fits — reviewing a paper, checking a BibTeX file for fake references, or benchmarking multiple LLMs on reference-recommendation accuracy. Also use when the user mentions paper review, peer review, BibTeX verification, citation checking, reference hallucination, or academic literature accuracy a…

  skills/academic-eval/00-academic-router/SKILL.md on GitHub (opens in a new tab)

• 01-paper-review

  Review academic papers for correctness, quality, and novelty using OpenJudge's multi-stage pipeline. Supports PDF files and LaTeX source packages (.tar.gz/.zip). Covers 10 disciplines: cs, medicine, physics, chemistry, biology, economics, psychology, environmental_science, mathematics, social_sciences. Use when the user asks to review, evaluate, critique, or assess a research paper, check referen…

  skills/academic-eval/01-paper-review/SKILL.md on GitHub (opens in a new tab)

• 02-bib-verify

  Verify a BibTeX file for hallucinated or fabricated references by cross-checking every entry against CrossRef, arXiv, and DBLP. Reports each reference as verified, suspect, or not found, with field-level mismatch details (title, authors, year, DOI). Use when the user wants to check a .bib file for fake citations, validate references in a paper, or audit bibliography entries for accuracy.

  skills/academic-eval/02-bib-verify/SKILL.md on GitHub (opens in a new tab)

• 03-ref-hallucination-arena

  Benchmark LLM reference recommendation capabilities by verifying every cited paper against Crossref, PubMed, arXiv, and DBLP. Measures hallucination rate, per-field accuracy (title/author/year/DOI), discipline breakdown, and year constraint compliance. Supports tool-augmented (ReAct + web search) mode. Use when the user asks to evaluate, benchmark, or compare models on academic reference hallucin…

  skills/academic-eval/03-ref-hallucination-arena/SKILL.md on GitHub (opens in a new tab)

• 00-arena-router

  Use when the user wants to compare or benchmark multiple LLMs/agents arena-style but it's unclear which specific workflow fits — a general-purpose win-rate comparison on a custom task, or a benchmark specifically about reference/citation hallucination rate. Also use when the user mentions model arena, agent arena, pairwise model comparison, win-rate ranking, or comparing models on a task and hasn…

  skills/arena-eval/00-arena-router/SKILL.md on GitHub (opens in a new tab)

• 01-auto-arena

  Automatically evaluate and compare multiple AI models or agents without pre-existing test data. Generates test queries from a task description, collects responses from all target endpoints, auto-generates evaluation rubrics, runs pairwise comparisons via a judge model, and produces win-rate rankings with reports and charts. Supports checkpoint resume, incremental endpoint addition, and judge mode…

  skills/arena-eval/01-auto-arena/SKILL.md on GitHub (opens in a new tab)

• 02-ref-hallucination-arena

  Benchmark LLM reference recommendation capabilities by verifying every cited paper against Crossref, PubMed, arXiv, and DBLP. Measures hallucination rate, per-field accuracy (title/author/year/DOI), discipline breakdown, and year constraint compliance. Supports tool-augmented (ReAct + web search) mode. Use when the user asks to evaluate, benchmark, or compare models on academic reference hallucin…

  skills/arena-eval/02-ref-hallucination-arena/SKILL.md on GitHub (opens in a new tab)

• meta-eval

  Use when the user wants to build an evaluation system for an LLM/agent application but doesn't know where to start — they have traces, prompts, RAG pipelines, or nothing at all. Also use when the user mentions evaluation, eval, benchmarking, testing LLM quality, measuring agent performance, assessing RAG accuracy, or wants to compare prompts/models. This skill is the entry router: it asks diagnos…

  skills/eval_pipeline/00-meta-eval/SKILL.md on GitHub (opens in a new tab)

• eval-design

  Use when the user needs to design evaluation datasets, create test cases, stratify samples, generate adversarial examples, extract eval dimensions from traces/specs, or build a labeled evaluation set. Also use when the user mentions test data design, eval coverage, difficulty stratification, synthetic data generation for eval, or "how to create good evaluation data." Outputs datasets in OpenJudge…

  skills/eval_pipeline/01-eval-design/SKILL.md on GitHub (opens in a new tab)

• metric-design

  Use when the user has evaluation principles or a dataset but needs help choosing the right graders, designing evaluation metrics, creating LLM-as-judge prompts, combining multiple metrics into a composite score, or building an automated evaluation pipeline. Also use when the user mentions grader selection, metric design, judge prompt engineering, rubric design, evaluation pipeline code, or "how t…

  skills/eval_pipeline/02-metric-design/SKILL.md on GitHub (opens in a new tab)

• align-human

  Use when the user has a judge/grader and human-labeled data, and wants to measure how well the judge agrees with humans, detect systematic biases, determine whether automatic evaluation can replace human review, or build a human-reduction roadmap. Also use when the user mentions calibration, TPR/TNR, judge validation, inter-rater agreement, Cohen's kappa, bias detection, or "is my automatic evalu…

  skills/eval_pipeline/03-align-human/SKILL.md on GitHub (opens in a new tab)

• eval-report

  Use when the user has run multiple evaluation skills and wants a comprehensive analysis — maturity assessment, cross-skill signals, trends, prioritized actions, and an executive summary. Also use when the user mentions eval health check, evaluation audit, ship readiness, evaluation maturity, or "how good is my evaluation system itself." This is a read-only analysis skill.

  skills/eval_pipeline/04-eval-report/SKILL.md on GitHub (opens in a new tab)

• rag-eval

  Use when the user has a RAG (Retrieval-Augmented Generation) system and wants to evaluate its quality — separating retrieval issues from generation issues. Also use when the user mentions RAG evaluation, faithfulness checking, hallucination detection in RAG, retrieval quality, chunking optimization, or "is my RAG pipeline working." Outputs a diagnostic matrix that pinpoints whether problems are i…

  skills/eval_pipeline/05-rag-eval/SKILL.md on GitHub (opens in a new tab)

• prompt-regression

  Use when the user has changed a prompt (system prompt, RAG template, agent instruction, etc.) and wants to know whether the candidate is better or worse than the baseline. Also use when the user mentions prompt A/B testing, prompt comparison, prompt optimization validation, "did my prompt change help," or prompt regression testing. Outputs per-dimension win rates with statistical significance usi…

  skills/eval_pipeline/06-prompt-regression/SKILL.md on GitHub (opens in a new tab)

• redteam

  Use when the user wants to test their LLM/agent application for safety and security vulnerabilities — jailbreaks, prompt injection, PII extraction, harmful content generation, or evaluator gaming. Also use when the user mentions security testing, adversarial testing, red teaming, safety evaluation, ASR (Attack Success Rate), or "is my app safe to deploy." Outputs ASR paired with over-refusal rate…

  skills/eval_pipeline/07-redteam/SKILL.md on GitHub (opens in a new tab)

• bootstrap

  Use when the user has nothing — no traces, no labels, no eval set — and needs to build a v0 evaluation from scratch. Also use when the user says "I need to start evaluating my app but don't know where to begin," "I want to set up eval for a new product," or has just identified failure modes and needs to turn them into principles. Outputs a v0 grader in 30 minutes using OpenJudge SimpleRubricsGene…

  skills/eval_pipeline/08-bootstrap/SKILL.md on GitHub (opens in a new tab)

• 01-graders-and-pipeline

  Build custom LLM evaluation pipelines using the OpenJudge framework. Covers selecting and configuring graders (LLM-based, function-based, agentic), running batch evaluations with GradingRunner, combining scores with aggregators, applying evaluation strategies (voting, average), auto-generating graders from data, and analyzing results (pairwise win rates, statistics, validation metrics). Use when…

  skills/openjudge-core/01-graders-and-pipeline/SKILL.md on GitHub (opens in a new tab)

• 02-rl-reward

  Build RL reward signals using the OpenJudge framework. Covers choosing between pointwise and pairwise reward strategies based on RL algorithm, task type, and cost; aggregating multi-dimensional pointwise scores into a scalar reward; pairwise tournament reward for GRPO on subjective tasks (net win rate across group rollouts); generating preference pairs for DPO/RLAIF; and normalizing scores for tr…

  skills/openjudge-core/02-rl-reward/SKILL.md on GitHub (opens in a new tab)

No skill matches that filter.

Similar skills

• career-opsby career-ops-hq Open-source AI job search agent and job finder: scan job boards, score each job 1-5 against your CV before you apply, tailor an ATS-friendl… 75.1k stars · 6 skills
• cherry-studioby CherryHQ AI productivity studio with smart chat, autonomous agents, and 300+ assistants. Unified access to frontier LLMs 52.7k stars · 30 skills
• open-code-reviewby alibaba Secure, fast, efficient, battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, preci… 47.4k stars · 2 skills
• invisible_dotsby feder-cr Open-source, self-hosted alternative to OpenAI Dots, Grok Bot. Built to be undetectable by anti-bot systems. 32.1k stars · 1 skill
• cliby googleworkspace Google Workspace CLI — one command-line tool for Drive, Gmail, Calendar, Sheets, Docs, Chat, Admin, and more. Dynamically built from Google… 31.5k stars · 30 skills
• TencentDB-Agent-Memoryby TencentCloud TencentDB Agent Memory is a team-level memory hub for AI Agents — turning conversations, docs, and code into four reusable memory assets (C… 29.3k stars · 2 skills