experiment-design

Installation
SKILL.md

experiment-design

Help the user produce an experiment spec that's actually launchable. Walk them through hypothesis, variations, metrics, and sample-size sanity. This skill does not write to GrowthBook — it ends with a ready-to-launch spec that experiment-launch consumes.

All API calls go through the bundled helper: ${CLAUDE_PLUGIN_ROOT}/scripts/gb-call. It needs GB_API_KEY — set in your shell, or written to ~/.config/growthbook/.env by /growthbook:gb-setup. If unset or invalid, gb-call's error message points back at /growthbook:gb-setup.

Workflow

  1. Frame the hypothesis. Falsifiable, if/then/because format:

    If we change X, then Y will improve, because Z.

    Push for specificity if the hypothesis is vague. "We think users will like it" doesn't say which metric — engagement could mean five different things. "If we move the CTA above the fold, then click-through will increase, because users decide whether to engage before they scroll" gives the prediction something concrete to land against.

  2. Define variations. Default to two: control (current state) and treatment (the change). Three or more variations are valid but cost statistical power; ask the user whether they really need a third. Number variations from 0 (control) to N.

  3. Pick goal metrics (ideally one, two max). List available templates and available metrics:

Installs
44
GitHub Stars
21
First Seen
Jun 2, 2026
experiment-design — growthbook/skills