A/B Test Analyzer

Compare two campaign variants, determine statistical significance, declare a winner, and recommend the next test.

What you need

• Variant A metrics: sends, opens, replies, interested replies
• Variant B metrics: same
• What was different between the variants (the variable being tested)
• Minimum 50 sends per variant for analysis

Metrics hierarchy

Analyze in this order — each layer tells you something different:

1. Open rate: subject line or sender name problem
2. Reply rate: copy or targeting problem
3. Interest rate: offer or angle problem
4. Meeting booked rate: CTA or qualification problem