prompt-testing

Installation
SKILL.md

The adoption decision is rule-based: adopt B if its accuracy is at least equal with acceptable token cost, consider B as a trade-off if accuracy improves >10% despite <20% token regression, otherwise keep A or iterate. Requires a minimum of 20 test cases with 15-20% edge cases for statistical significance.

Prompt Testing

Skill for testing, comparing, and measuring prompt performance.

References

  • metrics.md - Load when: defining or scoring Quality/Efficiency/Robustness/UX metrics with thresholds and calculation formulas
  • methodology.md - Load when: running a full A/B test (hypothesis, dataset sizing, statistical significance, common pitfalls)
  • templates.md - Load when: writing a test dataset JSON or an A/B test report

Testing Workflow

Installs
46
GitHub Stars
24
First Seen
Feb 10, 2026
prompt-testing — fusengine/agents