Data Data Versioning

Purpose

Implement data versioning with DVC or LakeFS for reproducibility, branching, diff, rollback, and experiment tracking across data pipelines and ML workflows.

Agent Protocol

Trigger

Exact user phrases: "data versioning", "DVC", "LakeFS", "data lineage", "Git-like for data", "data reproducibility", "data branching", "data diff", "data snapshot", "experiment reproducibility", "data rollback", "data version control".

Input Context

• Data storage platform (S3, GCS, ADLS, MinIO)
• ML/analytics pipeline framework
• Existing Git workflow for code
• Team size and collaboration patterns
• Experiment tracking needs
• Compliance requirements for data lineage