running-skills-edd-cycle
Running Skills EDD Cycle
Run evaluation-driven development cycle for agent skills.
Workflow
Step 1: Build Evaluations First
Create evaluations BEFORE writing documentation. This ensures skills solve real problems.
- Run Claude on representative tasks WITHOUT the skill
- Document specific failures or missing context
- Create 3+ evaluation scenarios that test these gaps
Evaluation scenarios are saved to tests/scenarios.md as the final step of /creating-effective-skills workflow.
Step 2: Establish Baseline
Measure Claude's performance WITHOUT the skill:
More from taisukeoe/agentic-ai-skills-creator
creating-effective-skills
Creating high-quality agent skills following Claude's official best practices. Use when designing, implementing, or improving agent skills, including naming conventions, progressive disclosure patterns, description writing, and appropriate freedom levels. Helps ensure skills are concise, well-structured, and optimized for context efficiency.
63improving-skills
Improve existing agent skills based on user feedback and best practices. Use when the user wants to fix, enhance, or refactor an existing skill. Gathers user feedback first, then applies technical analysis and implements improvements.
31reviewing-skills
Review skill files for best practices compliance (naming, description, structure, size). Use when checking SKILL.md quality or getting feedback before publishing. Static analysis only - does NOT execute the skill.
24setting-up-devcontainers
Generate devcontainer configurations for Claude Code development environments. Use when setting up development containers with Claude Code and optional Codex CLI. Automatically detects marketplace.json for plugin marketplace configurations.
16reviewing-plugin-marketplace
Review Claude Code plugin marketplace configurations against official best practices. Use when analyzing marketplace.json and plugin.json files for structural issues, common errors, path validation, and consistency with Anthropic's official format. Detects repository URL mismatches, incorrect source paths, and missing required fields.
14evaluating-skills-with-models
Evaluate skills by executing them across sonnet, opus, and haiku models using sub-agents. Use when testing if a skill works correctly, comparing model performance, or finding the cheapest compatible model. Returns numeric scores (0-100) to differentiate model capabilities.
13