Kafka 4, fantastic?
summary
Overview of Kafka 4’s key changes and migration steps: removal of ZooKeeper in favor of KRaft to simplify management and improve scalability; a new consumer rebalance protocol to boost group stability and performance; and cooperative queues for point-to-point consumption. Also covers required application and cluster updates (Log4j→Log4j2, ZooKeeper→KRaft migration, Java 11 for clients/Streams and Java 17 for brokers/Connect/tools) and concrete migration guidance for developers, architects, and operators.
AI-written summary · about
chapters (11)
- 0:00Kafka 4 intro
- 2:54Migration needs
- 8:48ZooKeeper to KRaft
- 12:41Observability updates
- 15:49Incremental rebalancing
- 23:10Client & Connect improvements
- 27:46Kafka 4.1 & 4.2 updates
- 36:52Share Groups & queues
- 37:57Framework support
- 40:26Kafka 4.3 roadmap
- 42:32Q&A
related talks
44mKafka 4, Fantastic?
46mKafka 4, Fantastic?
24mKafka & Kubernetes - Migrating to a World Without Zookeeper
26mReleased From the Cage: Apache Kafka Without Its ZooKeeper
38mRe-architecting Apache Kafka for the Cloud
53mDemystifying Kafka
29mKafka on Kubernetes: Does it really have to be the hard way?
31mSimplifying Apache Kafka on Kubernetes With Strimzi