Autoresearch

Autonomous experiment loop: try an idea, measure it, keep what improves the metric, revert what doesn't, and keep going. Inspired by the autoresearch pattern — hill-climbing a benchmark through many small, measured changes.

Modeled on pi-autoresearch by davebcn87 (itself inspired by karpathy/autoresearch), reimplemented as a Claude skill. Credit to the original authors.

The model is simple and the discipline is the whole point: never change code without measuring the effect, and never keep a change that didn't help. Every kept experiment becomes one commit on a single branch, so git log is a clean, reviewable record of what actually moved the number.

You drive this loop yourself with three bundled scripts that handle the fiddly, error-prone bookkeeping (timing, metric parsing, git commit/revert, the run log, confidence scoring) so every iteration is consistent and the result is auditable.