using-morphogenetic-rl
Morphogenetic RL
Use this contract for the concrete task. Apply a short relevant check for a small change; expand investigation when the failure, risk or requested artifact warrants it. Resolve facts from the repository and runtime before imposing a process. Delegation is optional and should answer a bounded unresolved question.
Controller contract
Separate the growable trainer, mutation policy and non-policy governor. This pack covers controller decisions and their evidence; dynamic architectures covers host/module training mechanics.
- Define legal actions, observations, decision cadence and resource budgets before wiring the policy. Include a no-action option and expose only features available at decision time.
- Base reward on the declared utility/structural-cost objective. Loss falling after growth does not establish growth caused the improvement; use an appropriate comparator.
- Keep catastrophic-action vetoes outside policy control. Specify pre-flight checks, post-action watch windows, hysteresis, rollback completeness and the signals returned to learning.
- Preserve separate RNG streams, synchronized topology decisions across ranks and checkpoint/log closure. Verify replay rather than assuming a shared seed is sufficient.
- Keep step-grain and event-grain telemetry schemas stable across topology change; identify actions, reasons, costs and reward modes without shape-dependent columns.
- For simultaneous slot actions, enforce shared constraints jointly and account for credit assignment. Independent policies need justification, not a default fan-out.
- Plan off-switch, static-initial, static-final and fixed-schedule comparisons that answer the claim under resource controls. Report independent-run distributions and failures.
Evidence and output
Produce a controller/governor specification or repair containing action/observation/reward definitions, mutation lifecycle, replay/rollback checks and comparison plan. Explain what the controller contributes beyond capacity and a fixed schedule. An off-switch result may justify stopping the research direction.