data-pipeline-quality
Installation
SKILL.md
Testing Pyramid for Data
Run tests in this order. Cheapest and fastest first:
| Layer | What It Catches | Examples |
|---|---|---|
| Schema tests (run first) | Structural failures | Column types, not-null, uniqueness, accepted values |
| Business rule tests | Logic errors | Cross-field validation, referential integrity, range checks |
| Integration tests (run last) | System-level drift | Cross-system reconciliation, end-to-end row counts |
Schema tests are cheap. Run them on every pipeline execution. Business rule tests are mid-tier — run them on staging and production. Integration tests are expensive — run them on a schedule (daily or pre-release).
dbt Test Patterns
Generic tests for reusable checks. Apply across models:
models:
- name: fct_encounters
Related skills