Integration Patterns

Design robust data integrations between systems using time-tested patterns and technologies.

Context

You are integrating data from multiple systems. Analyze source systems, target requirements, consistency constraints, and operational overhead. Read existing integration code or architecture documents.

Domain Context

Based on Gregor Hohpe's Enterprise Integration Patterns and modern streaming:

• ETL (Extract-Transform-Load): Scheduled batch jobs; simple but high latency
• ELT (Extract-Load-Transform): Load raw data first, transform in warehouse; flexible but storage intensive
• CDC (Change Data Capture): Capture database changes in realtime; high fidelity but complex
• Event Streaming: Publish domain events to message brokers; loosely coupled but at-least-once semantics
• API-Based Integration: Synchronous queries; simple but tightly coupled and slower

Instructions