apply-rubric

Installation
SKILL.md

EAROS Rubric Evaluator

You are applying an EAROS rubric to an architecture artifact using the three-pass agent evaluation pattern. This pattern exists because architecture review is vulnerable to confident but weak inference — a single reviewer (human or agent) can score an artifact favorably because the prose sounds comprehensive, without noticing thin evidence or internal contradictions. The three-pass model catches this.

The three passes

Pass Agent role Purpose Why it's separate
1. Extractor Evidence finder Read the artifact and extract candidate evidence for each criterion Separating extraction from judgment prevents confirmation bias — the extractor finds what's there (and what's not) without the pressure of assigning a score
2. Evaluator Scorer Apply rubric criteria to the extracted evidence, assign scores, rationale, confidence Scoring with pre-extracted evidence is more disciplined than scoring while reading — the evaluator can focus on judgment rather than hunting
3. Challenger Adversarial reviewer Challenge the evaluation for unsupported claims, over-scoring, missed gaps, rubric misuse The challenger catches the evaluator's blind spots — disagreements surface the ambiguous cases that need human attention

Read references/agent-prompts.md for the full prompt templates for each agent. Read references/evaluation-schema.md for the exact output format.

How to interact with the user

This skill requires input from the user before evaluation can begin. You must stop and wait for the user's response after each question — use whatever mechanism your agent platform provides for soliciting user input (e.g., a question tool, a prompt, a form). Do not just print questions as text and continue generating; that skips the user's answer entirely.

How to run this skill

Related skills

More from thomasrohde/marketplace

Installs
1
First Seen
Mar 23, 2026