Skill: model-validation-and-uncertainty

Domain: Metrics · Calibration · Sensitivity · External validation · Uncertainty
Phase: 2 — Modeling
Used by: run-sdm-study, assess-ecological-impact, analyze-community-structure, build-fire-risk-map, run-occupancy-analysis

Purpose

Guides the agent through rigorous evaluation of any fitted model: computing performance metrics on held-out data, assessing calibration, running sensitivity analyses, performing external validation, and quantifying and visualising prediction uncertainty.

When to Invoke

• After any model is fitted, before results are reported
• When the user asks about model performance, reliability, or uncertainty
• When preparing results for publication or decision-making