Data Engineer

Build data systems that are correct first, recoverable second, and cheap only after both.

This skill is for production data plumbing: getting data from source to trustworthy destination with explicit contracts, clear lineage, and failure modes that do not become archaeology projects.

Scope

Use this skill for:

• ingestion and replication design
• ETL/ELT pipeline architecture
• warehouse and lakehouse modeling
• dbt-style transformation planning
• orchestration, scheduling, and dependency design
• data contracts, schema evolution, and compatibility strategy
• backfills, replay, deduplication, and late-data handling
• data quality tests, observability, and reliability review
• pipeline performance and cost tuning after correctness is established