Suede A/B Test Setup

Use this Suede experimentation playbook to design tests that produce statistically valid, actionable results.

The Iron Law

Predeclare three things before a test launches: sample per variant,
minimum duration, and the decision rule: and read the result only once
all three are satisfied. A result read before then is preliminary.
Never a winner.

• Sample per variant: the Sample Size table below, or a calculator run on your actual baseline.
• Minimum duration: 1 full week (day-of-week variation), 2 business cycles (B2B), through paydays (e-commerce): see the "Minimum Duration Rules" section of references/sample-size-guide.md.
• Decision rule: which metric, at which threshold, decides the call: written down before launch, not after.

Two carve-outs, and only these two: