evals-specify

What this skill does

Conducts bottom-up error analysis following EDD Principles III & IX (Error Analysis & Test Data as Code) to discover and document draft evaluation criteria from human observation of system failures.

Output:

1. Draft Eval Records - Individual EVAL-*.md files in .adlc/drafts/evals/ with open coding notes
2. Error Pattern Documentation - Bottom-up failure taxonomy from actual traces
3. Pass/Fail Examples - Real examples that should pass/fail each criterion
4. Auto-handoff to /evals-clarify for axial coding and clustering

Key EDD Principles Applied:

• Principle III: Error Analysis & Pattern Discovery - Open coding → failure taxonomy
• Principle IX: Test Data as Code - Dataset planning and coverage analysis
• Principle II: Binary Pass/Fail - Maintain strict binary pass/fail conditions
• Principle V: Trajectory Observability - Track full multi-turn conversation traces

When to use