ai-research-reproduction
Installation
SKILL.md
ai-research-reproduction
Purpose
Guide README-first deep learning reproduction toward the smallest trustworthy run with auditable evidence. Preserve documented meaning; record assumptions, deviations and blockers instead of changing semantics to manufacture success. Load specialized references only for a concrete uncertainty.
Fast Path
For a routine bounded run, keep the control path short:
- Read the target README and only the target test/config/source needed to understand the documented command.
- Run
scripts/orchestrate_repro.py --repo <repo> --plan-only --agent-outputwith any explicit user timeout bound (--timeoutor--train-timeout) already supplied; reviewcommand_candidates, the selectedcmd-XX, side-effect contract, selection fingerprint, and returnedreviewed_run_args. With no--output-dir, later evidence goes to<repo>/repro_outputsregardless of caller cwd. - Run the selected candidate, or another reviewed candidate, with
--run-selected --command-id <cmd-XX> --plan-fingerprint <fingerprint> --agent-outputplus requested timeout/metric/source-adjacent options. Preserve an explicit user command-timeout bound instead of silently making it stricter on a routine trusted run.--timeoutlimits the target command; do not wrap the whole orchestrator in an equal or shorter external timeout, because it still needs time to terminate children and write terminal evidence. A changed command set fails closed; setup/download commands are never target candidates. - Run
--verify-output --agent-output; inspect detailed evidence files only when verification fails or the result is partial/blocked. - Deliver the bounded result and stop.