judge-rubric

Installation
SKILL.md

Rubric Authoring

Use this skill to build a formal judging rubric before scoring responses, candidates, trajectories, benchmark outputs, or other evaluation artifacts.

Read references/rubric-techniques.md when you need current judging guidance on locked rubrics, task-adaptive rubric design, verifier-backed evidence, robustness checks, calibration, and chain-of-thought skepticism.

When the judging inputs are already available as a structured contract, use scripts/render_rubric.py to render the rubric package deterministically instead of drafting it manually.

When to use this skill

  • The judging task is missing a stable rubric and needs one before scoring starts.
  • The user asks for a grading rubric, scoring rubric, evaluation rubric, or formal scorecard.
  • The domain has specific failure modes, policy constraints, or artifact requirements that must become explicit judging dimensions.
  • The evaluation needs pass, partial, and fail boundaries instead of holistic free-form grading.
  • The comparison is high-risk enough that tie-break rules, robustness checks, and confidence guidance must be defined in advance.

Required inputs

Installs
1
First Seen
Sep 3, 2026