Data Lineage

Purpose

Capture, store, query, and visualize end-to-end data lineage from source systems through transformations to dashboards, supporting impact analysis, root cause investigation, and data governance compliance.

Agent Protocol

Trigger

Exact user phrases: "data lineage", "OpenLineage", "Marquez", "DataHub lineage", "column-level lineage", "impact analysis", "data provenance", "lineage graph", "data dependency", "producer consumer lineage", "field-level lineage".

Input Context

Before activating, verify:

• Source systems (databases, event streams, file systems)
• Transformation tools (dbt, Airflow, Spark, custom SQL)
• Existing lineage infrastructure (OpenLineage, DataHub, Amundsen, manual)
• Compliance requirements (GDPR, SOX, BCBS 239)
• Consumer tools (Looker, Tableau, custom dashboards)