autoexperiment
Installation
SKILL.md
Autoexperiment Skill
Run autonomous time-budget experiment loops. Each iteration modifies train.py,
trains for a fixed wall-clock budget, evaluates, records in results.tsv, and repeats.
Setup
- Ensure
results.tsvexists with a baseline (exp000) before iterating - Create
EXPERIMENT.mdwith your goal, baseline, hypothesis, and constraints - Run:
/mlx:autoexperiment path/to/train.py
Protocol
Before each iteration
- Read
EXPERIMENT.mdfor the current hypothesis - Read
results.tsvfor experiment history - Identify one change to make (ONE variable only)