Prompt Regression

Compare two prompts head-to-head and determine, with statistical rigor, whether the candidate is better, worse, or tied on each evaluation dimension.

When to Activate

• You changed the system prompt and want to verify it's actually better
• You're iterating on RAG answer templates
• You're optimizing agent step-by-step instructions
• You want data to support a prompt change decision

Checklist