Apache Kafka

When to Use

Load this skill when the user needs to:

• Design Kafka topics, choose partition count and replication factor
• Configure producers (acks, idempotence, batching, compression)
• Configure consumers (commit strategies, rebalancing, exactly-once)
• Set up Kafka Connect source/sink connectors
• Handle errors with Dead Letter Queues
• Monitor consumer lag and cluster health
• Write Python producers/consumers with confluent-kafka

Core Concepts