Gold Layer Delta MERGE Deduplication Pattern

Overview

Gold layer merge operations read from Silver and write to Gold using Delta MERGE. This skill standardizes the deduplication pattern required to prevent [DELTA_MULTIPLE_SOURCE_ROW_MATCHING_TARGET_ROW_IN_MERGE] errors.

When to Use This Skill

Use this skill when:

• Merging from Silver to Gold tables
• Silver may contain duplicate business keys due to:
  • Incremental DLT streaming ingestion
  • Change Data Capture (CDC) patterns
  • Historical SCD Type 2 tracking
  • Test data generation creating duplicates
  • Multiple batch loads
• Encountering DELTA_MULTIPLE_SOURCE_ROW_MATCHING_TARGET_ROW_IN_MERGE errors

Critical Rule: Always Deduplicate Before MERGE