metforge-model-diagnose
Installation
SKILL.md
MetForge Model Diagnose
Turn model output into a falsifiable diagnosis. Prefer the next decisive check over a long catalog of generic plots.
Diagnostic workflow
- State the test contract:
- property or mechanism being tested
- expected solution, symmetry, invariant, or benchmark
- control and changed factor
- diagnostic time window and success criterion
- observation that would falsify the working explanation
- Inventory the actual run configuration and outputs. Compare namelists, compiler/precision, solver, grid, timestep, domain, boundary conditions, physics, diffusion, filters, and decomposition before interpreting differences.
- Establish the reference. Prefer an analytic solution, converged/high-resolution run, published benchmark, or internally consistent control. Do not call one arbitrary run “truth” without qualification.
- Climb the diagnostic ladder below. Stop when the evidence isolates the failure or when the next step requires new data.
- Classify each result as expected, numerically suspicious, physically inconsistent, configuration-dependent, or inconclusive.
- Produce an evidence table and recommend one next experiment with the largest discrimination value.