databricks-spark-declarative-pipelines
Installation
SKILL.md
Lakeflow Spark Declarative Pipelines (SDP)
Critical Rules (always follow)
Syntax: CREATE OR REFRESH (not CREATE OR REPLACE)
- MUST use
CREATE OR REFRESHfor SDP objects:CREATE OR REFRESH STREAMING TABLE- for streaming tablesCREATE OR REFRESH MATERIALIZED VIEW- for materialized views
- NEVER use
CREATE OR REPLACE- that is standard SQL syntax, not SDP syntax