Skill: Prompt Test

Objective

Provide before/after evidence that a change to prompts/default.md (or a custom prompt file) actually improves review quality. The skill runs the reviewer twice against the same PR — once with the OLD prompt, once with the NEW — and produces a comparison the user can paste into a PR description.

Without this evidence, prompt changes are opinion, not engineering.

Non-goals

• Does NOT modify the prompt for the user. The user owns the prompt edit; this skill evaluates it.
• Does NOT post comments on the test PR — runs are configured with AIPRR_TRACKING_COMMENT=false and AIPRR_COLLAPSE_PREVIOUS=false to avoid disturbing the target PR's conversation.

Inputs

• target_prs — list of PR numbers to test against. For substantive changes use 3–5 covering different change types (feature, bugfix, refactor, docs). For targeted changes one PR is enough.
• repo — <owner>/<name> of the target repo. Defaults to the repo the skill is invoked from.

Pre-flight