Experiment Designer

Design tests that can survive contact with reality.

This skill is for turning uncertain decisions into credible experiments: defining the causal question, selecting the right unit of assignment, choosing a primary metric, setting guardrails, planning instrumentation, anticipating interference and novelty effects, and making sure the readout can support a real decision.

Use this skill to

• design A/B tests, holdouts, pilots, phased rollouts, or operational experiments
• sharpen hypotheses and causal mechanisms
• choose assignment units and exposure rules
• define primary metrics, secondary metrics, and guardrails
• estimate sample or duration needs with clear caveats
• plan instrumentation and experiment QA before launch
• write interpretation rules and launch/stop criteria

Do not use this skill to