skill-eval-designer

Installation
SKILL.md

Skill Eval Designer

Use this skill to prove a skill changes agent behavior on realistic tasks.

Workflow

  1. Identify skill purpose, trigger boundary, expected artifact, failure modes, and target agent behavior.
  2. Read references/skill-eval-systems.md.
  3. Create positive prompts, negative prompts, expected behavior assertions, and artifact checks.
  4. Add edge cases for over-triggering, under-triggering, unsafe advice, missing references, and generic output.
  5. Produce eval fixture, behavior example, and forward-test plan.

When not to use

  • Do not use to author the skill procedure itself, design a whole marketplace, or claim quality from static examples alone.
  • Do not create an eval when the behavior is fully deterministic and a unit, contract, property, or snapshot test is the stronger oracle.

Guardrails

Installs
63
Repository
sylphxai/skills
GitHub Stars
1
First Seen
Jun 30, 2026
skill-eval-designer — sylphxai/skills