skill-evaluator

Installation
SKILL.md

Skill Evaluator

Audit a target skill to see whether its instructions actually land when Claude runs it. This skill does NOT benchmark skill-vs-no-skill (that's skill-creator's job). This skill checks rule adherence under realistic prompts, classifies where failures come from, and proposes targeted fixes.

Scope

Good fit — v1 supports:

  • Workflow skills (sequences of steps, shutdown rituals, review passes)
  • Rule-shaped skills (policies, conventions, constraints, checklists)
  • Guideline skills (style guides, voice guides, design rules)

Out of scope for v1 (say so explicitly if asked):

  • Creative-synthesis skills (brand voice, canvas design, algorithmic art) — rule-adherence framing does not apply cleanly to "is this output beautiful"
  • Skills whose value is measured by end-user outcomes over time (engagement, retention)

If the user asks to evaluate a creative-synthesis skill, say the harness is not validated for that skill type and ask if they want to proceed anyway with a best-effort run. Do not silently pretend it works.

Installs
17
GitHub Stars
1
First Seen
May 6, 2026
skill-evaluator — sorawit-w/agent-skills