Skill Benchmark Design

Core Workflow

1. Name the skill or bundle under test, target user, target artifact, and decision the benchmark must support.
2. Select realistic scenarios that exercise normal, edge, and risky requests without leaking expected answers into the prompt.
3. Define baseline and skill-enabled runs using the same prompt, source material, and acceptance criteria.
4. Choose scoring criteria from docs/evaluation/skill-quality-rubric.md and add task-specific pass/fail checks.
5. Specify evidence capture: prompt, inputs, outputs, reviewer notes, validation output, loaded context, tools/scripts, and overhead when available.
6. Set the decision rule: keep, revise, split, merge, defer, or retire.

Overhead And Composition Checks