Experiment Design

If you change your list, your copy, and your offer at the same time, you learn nothing. This skill forces you to isolate one variable per experiment so you actually learn what's working.

Why this exists

Most cold email operators run "throw-everything" experiments. Campaign 1 gets a new list, new copy, and a new offer. It works better. They declare victory. But they can't tell you WHY — was it the list? The copy? The offer?

Then campaign 2 changes all three again. Regression. Nobody knows why.

This skill is the antidote: plan each experiment around ONE variable, keep everything else constant, and confidence-weight the results.

The three experiment types

A. List-only experiment

• What varies: the list (targeting criteria)
• What stays fixed: copy, offer, sending infrastructure, sequence timing
• What you learn: whether this segment is a better fit than the baseline
• Confidence on learnings: HIGH on targeting, LOW on copy (because copy wasn't tested)