ai-forge-eval
Installation
SKILL.md
AI Forge Eval
Behavioral validation for skills and agents. Rubric scoring (ai-forge-judge) tells you if an artifact is well-written. Eval tells you if it works.
Works for SKILL.md (skills) and .agent.md (agents). Same 5-phase flow; Phase 2 setup differs by artifact type.
Phase 0 — Load or Write the Suite
MANDATORY — READ references/eval-suite.md for the on-disk format, the trigger protocol, and the assertion-discrimination table.
Check for evals/evals.json beside the artifact.
- Present — load it and skip to Phase 2. Add cases if coverage is thin; never silently replace existing ones, or the trend breaks.
- Absent — author it in Phase 1 and write it to
evals/evals.jsonbefore spawning anything.
A suite that lives only in this conversation cannot detect a regression next month. Persisting it is what makes the difference between an opinion and a test.