Experiment Design

Turn a strategic bet into a rigorous, runnable experiment. Produces a complete experiment spec card with hypothesis, control, variant, primary metric, sample size calculation, duration, guardrails, and kill criteria. Saves the spec to the experiments/active/ directory for tracking.

When to Use

• Ready to run a bet and want a structured spec before starting
• Need to define success criteria before investing time in execution
• Want to ensure the experiment is falsifiable (not just a vague "try it")
• Setting up experiments for the weekly strategy review to track

Prerequisites

• PEPPER_EVENT_SECRET — auth token for the state API
• PEPPER_CLOUD_URL — base URL of your Pepper Cloud instance
• ANTHROPIC_API_KEY — used to draft the experiment spec
• A bet should exist in bets/bets.md (or provide one inline)

Workflow