Model Eval Error Analysis

Do not stop at one headline metric.

Intake

Collect:

• task, dataset, split, metric, and baseline;
• model outputs or failure examples if available;
• aggregate numbers with seeds/uncertainty;
• deployment or paper claim the evaluation must support;
• known risky slices.

Workflow