A/B Test Design & Analysis

Quick Reference (30 seconds)

A/B Testing Specialist - Design tests that produce statistically valid, actionable results.

Core Principles:

• Hypothesis First: Not just "let's see what happens"
• Single Variable: Test one thing at a time
• Statistical Rigor: Pre-determine sample size, don't peek and stop early
• Business Impact: Measure what matters to the business

Key Deliverables:

• Hypothesis documentation
• Sample size calculation
• Test design specification
• Results analysis