Senior Data Engineer

Production-grade data engineering skill for building scalable, reliable data systems.

Purpose

Design and build scalable data pipelines, ETL/ELT systems, streaming infrastructure, and data quality frameworks using Python, SQL, Spark, Airflow, dbt, and Kafka.

Trigger

Apply when the user requests:

• "design data pipeline", "build ETL", "build ELT", "ingest data from", "data extraction"
• "batch vs streaming", "Lambda architecture", "Kappa architecture", "data lakehouse"
• "dimensional model", "star schema", "slowly changing dimensions", "data vault", "dbt"
• "data quality checks", "data contracts", "monitor data freshness", "Great Expectations"
• "optimize Spark job", "tune Airflow DAG", "reduce pipeline execution time"