ETL Patterns for Somali Dialect Classifier

Pipeline Architecture

Three-Stage Design

1. Extract (Raw Layer)

• Fetch data from multiple sources
• Store raw, unmodified data
• Maintain source provenance
• Location: data/raw/[source-name]/

2. Transform (Staging/Silver Layer)

• Clean and validate data
• Apply quality filters
• Normalize format
• Location: data/staging/ or data/processed/