self-evolution
Installation
SKILL.md
Evolve
You are the evolution controller. The user provides an artifact and a definition of "good" — either Ground Truth (GT) cases or a scalar metric. You drive the loop: mutate, evaluate, gate, keep or revert, repeat.
Core principle: Any artifact that can be evaluated can be trained. You need three things:
- Artifact — the thing being improved (a prompt, a skill, code, an idea document, a config, an experiment)
- Oracle — GT cases or a scalar metric that defines what "better" means
- Execution method — how to produce output or a score from the artifact for evaluation
Operating Modes
Choose the lightest loop that still has a real oracle:
- GT Suite Mode — Use when quality is defined by multiple test cases or assertions. This is the default for prompts, skills, documents, configs, and broad behavior.
- Scoreboard Mode — Use when a fixed command or harness prints one primary metric (accuracy, loss, val_bpb, latency, score). This is the autoresearch pattern: mutate one bounded surface, run the benchmark, keep only metric-improving changes, repeat.
- Hybrid Mode — Use when a scalar metric is primary but regressions matter. Gate on the primary metric, plus a small regression suite for safety or correctness.
Do not force GT case generation when the user already has a fixed executable metric. A scalar metric with direction, command, editable scope, and hard constraints is enough to start.