Brick-by-Brick: Exploring the Elements of Apache Kafka®
summary
Covers concrete Kafka mechanics: events as immutable records, topics split into partitions with offsets, a 3-node cluster example with replication factor 3 and leader/follower replicas, partitioning by key to guarantee ordering, and parallelism capped by partition count. Shows producer behavior (serialization to Avro schema, batching, optional compression), consumer groups and offset commits, Schema Registry for schema IDs, Kafka Connect for sources/sinks, and Kafka Streams/ksqlDB for stateful processing.
AI-written summary · about
chapters (13)
- 0:00Introduction to Kafka
- 2:03Understanding events
- 5:58Kafka topics
- 9:12Kafka partitions and brokers
- 13:27Data replication
- 15:56Producing messages
- 18:57Serialization and schemas
- 21:51Consuming messages
- 27:16Kafka ecosystem overview
- 28:38Schema registry
- 32:21Kafka connect
- 33:49Stream processing
- 37:11Use cases and Q&A
related talks
41mKafka as a Platform: the Ecosystem from the Ground Up
16mIntroducing Apache Kafka
36mApache Kafka Simply Explained
54mKafka as a Platform: the Ecosystem from the Ground Up
41mApache Kafka simply explained
39mKafka as a Platform: The Ecosystem from the Ground Up
41mKafka as a Platform: The Ecosystem from the Ground Up
50mIntroduction to Apache Kafka