Streaming And Messaging Systems

Overview

Use this skill for continuous data movement and real-time processing. It helps agents design safe event pipelines around brokers and stream processors such as Kafka, Kinesis, and Flink, with attention to ordering, state, replay, schema evolution, and delivery guarantees.

When to Use

• designing or modifying Kafka topics, consumers, or stream processors
• using Kinesis for event ingestion or streaming delivery
• implementing Flink jobs or stateful stream transformations
• defining near-real-time pipelines, windows, watermarks, and replay behavior
• handling schemas and contracts for event-driven systems

Do not use this when the workload is purely batch and does not require streaming semantics.

Workflow