YAML-Driven Gold Layer Table Setup

Overview

Use YAML schema files as the single source of truth for Gold layer table definitions. A single Python script reads YAMLs at runtime and creates tables dynamically - no code generation or embedded DDL required.

Key Principle: Schema definitions live in YAML files. Python code is generic and reusable.

When to Use This Pattern

✅ Use when:

• Managing 10+ Gold layer tables across multiple domains
• Schema evolves frequently and needs easy updates
• Want to avoid embedded SQL DDL strings in Python
• Need consistent table properties across all tables
• Want YAML files to be reviewable/diffable