Data Pipelines Guide

Core Philosophy

ELT over ETL when possible. Load raw data first, transform in the warehouse. It's cheaper, more flexible, and easier to debug.

"The best pipeline is the one you don't have to maintain at 3 AM."

Pipeline Patterns

ETL (Traditional):
Source → Extract → Transform → Load → Target

ELT (Modern):
Source → Extract → Load → Transform (in warehouse) → Serve