databricks-spark-declarative-pipelines

Installation
SKILL.md

Lakeflow Spark Declarative Pipelines (SDP)


Critical Rules (always follow)

Syntax: CREATE OR REFRESH (not CREATE OR REPLACE)

  • MUST use CREATE OR REFRESH for SDP objects:
    • CREATE OR REFRESH STREAMING TABLE - for streaming tables
    • CREATE OR REFRESH MATERIALIZED VIEW - for materialized views
  • NEVER use CREATE OR REPLACE - that is standard SQL syntax, not SDP syntax
Installs
28
GitHub Stars
1.8K
First Seen
Feb 24, 2026
databricks-spark-declarative-pipelines — databricks-solutions/ai-dev-kit