A/B Testing Skill

Test Process

1. Hypothesis: What and why
2. Design: Variables
3. Run: Duration
4. Analyze: Significance
5. Decide: Ship or not

Key Metrics

• Sample size
• Duration
• P-value < 0.05