Model Evaluation

Overview

Choose metrics that match the business cost and data distribution, prevent leakage, validate with the right CV scheme, calibrate and threshold deliberately, and monitor for drift in production. This skill is the decision layer above sklearn/eval tooling.

Metric selection (the highest-leverage decision)

Wrong metric = confidently shipping a bad model. Pick from the cost structure and class balance, not habit.