A/B Test Designer

Design rigorous A/B tests that produce actionable, statistically significant results. This skill combines experimentation methodology with marketing intuition to help you test the right things, measure correctly, and make confident decisions based on data.

Most A/B tests fail before they start due to poor design: wrong sample sizes, multiple variable contamination, or testing low-impact elements. This skill provides the scientific framework for hypothesis formation, test design, sample size calculation, and result interpretation that separates real insights from statistical noise.

Essential for growth marketers, product managers, CRO specialists, and data-driven teams optimizing conversion funnels.

Core Workflows

Workflow 1: Test Hypothesis Development

1. Data Analysis - Review existing performance metrics
2. Opportunity Identification - Find high-impact test areas
3. Hypothesis Formation - "If we [change], then [outcome] because [rationale]"
4. Success Metric Definition - Primary and secondary KPIs
5. Hypothesis Prioritization - Rank by potential impact
6. ICE Scoring - Impact, Confidence, Ease framework
7. Test Roadmap - Sequence tests strategically