Deep Dive into Kafka Architecture: From Simple Scenarios to a Geo-Cluster
summary
A technical deep dive into Apache Kafka’s architecture covering basics through advanced deployment patterns, including single-cluster and geo-cluster setups. It explains Kafka’s high-throughput, low-latency streaming platform characteristics and discusses practical usage scenarios and architectural considerations for building large-scale data streaming systems.
AI-written summary · about
chapters (13)
- 0:00Introduction
- 1:13Kafka history
- 3:24Kafka architecture components
- 5:09Data storage structure
- 8:01Storage and retention policies
- 10:28Zero Copy optimization
- 12:58Producer internals
- 20:32Consumer internals
- 23:04Replication and durability
- 26:59Leader balancing issues
- 28:25Performance testing
- 37:36Geo-replication cluster topologies
- 56:20Q&A
related talks
57mWhen Everything Went Kafka
41mKafka as a Platform: the Ecosystem from the Ground Up
53mDemystifying Kafka
39mKafka as a Platform: The Ecosystem from the Ground Up
41mKafka as a Platform: The Ecosystem from the Ground Up
54mKafka as a Platform: the Ecosystem from the Ground Up
46mBrick-by-Brick: Exploring the Elements of Apache Kafka®
41mApache Kafka simply explained