Apache Flink

When to Use

Load this skill when the user needs to:

• Build low-latency stateful streaming pipelines (CDC, real-time aggregations, event-driven processing)
• Use event-time processing, watermarks, and out-of-order event handling
• Write PyFlink SQL or Table API pipelines with Kafka sources/sinks
• Implement stateful operations (session detection, deduplication, windowed aggregation)
• Configure checkpointing, state backends, and exactly-once semantics
• Deploy Flink jobs on YARN, Kubernetes, or standalone clusters

Architecture