Evaluation Reality Check

Mission

Design evaluation strategies that match task type, deployment setting, time, groups, and decision risk.

Current pain point: Offline evaluation often overstates real-world performance because splits, metrics, and benchmarks do not match deployment.

Why this skill exists: Evaluation must simulate the future decision surface, not just produce a leaderboard score.

Operating Rules