research-experiment-plan
Installation
SKILL.md
Research Experiment Plan
Quick start
- Freeze the claim, decision rule, and anti-claims before listing runs.
- Classify the intended evidence as exploratory, confirmatory, independently verified, or operational/high-stakes; use
../research-pipeline-planner/references/epistemic-assurance-contract.mdwhen promoting beyond exploratory status. - Decide whether this is a standalone plan or the experiment stage inside an orchestrated suite.
- Initialize the full experiment pack with
scripts/init_experiment_pack.pywhenever the plan needs tracked execution. - Build the minimum decisive experiment blocks, not a benchmark wishlist or a paper-defence script.
- Run a cheap non-vacuity preflight before expensive or confirmatory execution.
- Separate must-run from nice-to-have runs, attach explicit decision gates, and emit bridge-ready outputs for later execution.
- For orchestrated execution, declare inputs, evaluator artifacts, required outputs, allowed lineage relations, and gate-conditioned downstream activation using
../research-pipeline-planner/references/experiment-execution-binding.md.
Constants
MAX_PRIMARY_CLAIMS = 2unless multiple inseparable claims are truly required.MAX_CORE_BLOCKS = 5unless the evaluation setting forces more.MAX_BASELINE_FAMILIES = 3unless the field norm demands additional families.DEFAULT_SEEDS = 3when stochastic variance matters and budget allows.