Experiment Design Kit Skill

When to Use

• Translating raw ideas into testable hypotheses with clear success metrics.
• Ensuring experiment briefs include guardrails, instrumentation, and rollout details.
• Coaching pods on best practices for multi-variant or multi-surface tests.

Framework

1. Problem Framing – define user problem, business impact, and north-star metric.
2. Hypothesis Structure – "If we do X for Y persona, we expect Z change" with assumptions.
3. Measurement Plan – primary metric, guardrails, min detectable effect, power calc.
4. Variant Strategy – control definition, variant catalog, targeting, and exclusion rules.
5. Operational Plan – owners, timeline, dependencies, QA/rollback steps.