An introduction to Apache Kafka - this is Event Streaming, not just Messaging
summary
Explains that Apache Kafka stores append-only events in topics split into partitions, replicates partitions across brokers (recommendation: minimum three brokers), and elects leaders on failure; covers producer acks (0/1/all), idempotent/transactional writes and exactly-once semantics, consumer offset commits and consumer groups tied to partitions, Kafka Streams for in-app per-record transforms, and Kafka Connect for source/sink connectors. Demonstrates local CLI: start ZooKeeper and broker, create a topic, run console producer and consumer, and mentions IBM Event Streams (Kubernetes distribution).
AI-written summary · about
chapters (11)
- 0:00Start
- 4:35Event-Driven in Action
- 5:48Components of an event streaming application
- 6:35Key Use Cases
- 8:06Events vs Messaging
- 9:24Properties of the event central backbone
- 13:41Replication
- 16:46Producers
- 24:40Consumer Groups
- 26:47Katka Streams
- 30:24Katka Connect
related talks
16mAn introduction to Apache Kafka - this is Event Streaming, not just Messaging
50mIntroduction to Apache Kafka
01h 00mIn Depth Kafka Streams
41mKafka as a Platform: the Ecosystem from the Ground Up
36mApache Kafka Simply Explained
54mKafka as a Platform: the Ecosystem from the Ground Up
39mKafka as a Platform: The Ecosystem from the Ground Up
55mDemystifying Stream Processing with Apache Kafka