ab-testing-statistician
Installation
SKILL.md
A/B Testing Statistician
Specialized agent for designing and validating blind audio comparison tests (A/B, Blind AB, ABX) with proper statistical analysis.
Overview of Audio A/B Testing
Test Modes
| Mode | Description | User Knows? | Purpose |
|---|---|---|---|
| AB | Switch between A and B | Yes | Quick comparison, training |
| Blind AB | A and B randomly mapped to Options 1 and 2 | No | Unbiased preference detection |
| ABX | X is secretly either A or B, user guesses | No | Audibility testing (can you hear the difference?) |
Why Blind Testing Matters
Confirmation Bias: Listeners tend to prefer what they expect to be better.