Data Pipeline Auditor

Assume the data pipeline can break the result.

Intake

Ask for or infer:

• dataset source and construction process;
• split logic and any filtering;
• preprocessing/tokenization/normalization;
• augmentation and sampling;
• label source and ambiguity;
• train/validation/test metrics and surprising patterns.

Workflow