Brick-by-brick: Exploring Apache Kafka®
summary
Rebuilds Apache Kafka as a Lego set: describes topics as append‑only logs, partitions for parallelism (example three partitions on a three‑node cluster), and replication factor 3 that promotes followers to leaders on broker failure in milliseconds. Covers producer actions (serialize with Avro/JSON/Protobuf, batch, compress), consumer groups mapping one partition per consumer, and schema registry for schema IDs plus Kafka Connect, Kafka Streams and ksqlDB as tools for integration and stateful processing — all shown as working components.
AI-written summary · about
chapters (12)
- 0:00Introduction to Kafka
- 1:04Why use Apache Kafka
- 4:55Understanding events
- 12:22Kafka topics and storage
- 18:20Partitions and scalability
- 24:39Producing data to Kafka
- 33:07Consuming data from Kafka
- 41:51Kafka ecosystem overview
- 47:06Integrating Kafka with systems
- 50:56Stream processing options
- 53:24Real-world Kafka use cases
- 55:12Closing and resources
related talks
39mKafka as a Platform: The Ecosystem from the Ground Up
16mIntroducing Apache Kafka
02h 05mA Deep Dive into Apache Kafka This is Event Streaming
01h 00mKafka as a Platform: the Ecosystem from the Ground Up
41mKafka as a Platform: The Ecosystem from the Ground Up
01h 00mKafka as a Platform: the Ecosystem from the Ground Up
53mDemystifying Kafka
54mKafka: The Must Know Pub/Sub