dbt
Installation
SKILL.md
dbt (Data Build Tool)
dbt manages data transformation in the warehouse using SQL. v2.0 introduces the Fusion Engine (Rust) for performance.
When to Use
- Data Modeling: Converting raw tables into "Gold" tables.
- Testing:
not_null,uniquetests defined in YAML. - Documentation: Auto-generating data dictionaries.
Core Concepts
Models (.sql)
Select statements that dbt compiles into CREATE VIEW/TABLE.
Refs ({{ ref('users') }})
Dependency management. dbt builds the DAG automatically.