Experiment Design Review

Use this skill to convert a high-stakes product decision into a concrete, measurable, reviewable operating artifact.

Workflow

1. Identify the decision, user segment, change, expected mechanism, risk, traffic source, and reversible rollout path.
2. Read references/experiment-design-patterns.md.
3. Separate hypothesis, primary metric, guardrails, counter-metrics, sample needs, eligibility, exposure, and analysis window.
4. Choose experiment type: A/B, holdout, staged rollout, switchback, pre/post, qualitative pilot, or no-test decision.
5. Produce experiment spec, instrumentation plan, decision rule, launch checklist, and learning review.

When not to use

• Do not use for generic advice the base model already handles without this skill's specific artifact contract.

Guardrails