skill-eval
Installation
SKILL.md
Skill Evaluation & Improvement
Measure and improve skill quality through empirical testing — because structure doesn't guarantee behavior, and measurement beats assumption. Also covers head-to-head bake-offs of two peer implementations of the same artifact (Mode F).
Reference Loading Table
| Signal | Load These Files | Why |
|---|---|---|
| reading or writing eval artifacts: evals.json, grading.json, metrics.json, history.json | schemas.md |
Loads detailed guidance from schemas.md. |
| improving a skill via variant generation and blind A/B promotion | self-improve-loop.md |
Loads detailed guidance from self-improve-loop.md. |
| "bake-off", "head-to-head", "compare implementations", "grade two versions", "which Feynman skill is better" | bake-off-methodology.md |
Loads the bake-off rubric, anti-rationalization gate, fold-filter, and worked Feynman example. |
Instructions
Phase 1: ASSESS — Determine what to evaluate
Step 1: Identify the skill