Kafka 4, Fantastic?
summary
An overview of Kafka 4’s key changes: removal of ZooKeeper in favor of KRaft to simplify management and improve scalability, a new consumer group rebalancing protocol for greater stability and performance, and Early Access point‑to‑point cooperative queues. The talk also covers required updates for applications and clusters—Log4j→Log4j2, migrating ZooKeeper→KRaft, and Java version requirements (clients/Streams to Java 11; brokers/Connect/tools to Java 17)—and gives concrete migration steps for developers, architects, and operators.
AI-written summary · about
chapters (11)
- 0:00Introduction
- 3:12Migrating to Kafka 4
- 10:14Zookeeper decommissioning
- 15:31Metric improvements
- 18:42Consumption with auto.offset.reset
- 19:04New rebalance protocol
- 26:52Kafka 4.1 new features
- 31:08JWT authentication and plugins
- 33:13Partition sharing with KIP-952
- 40:39Spring and Quarkus compatibility
- 42:22Release schedule and summary
related talks
50mKafka 4, fantastic?
46mKafka 4, Fantastic?
26mReleased From the Cage: Apache Kafka Without Its ZooKeeper
02h 04mKafka with Raft in Production: A New Era for Distributed Commit Logs
38mRe-architecting Apache Kafka for the Cloud
53mDemystifying Kafka
57mWhen Everything Went Kafka
54mWhen Everything Went Kafka: Apache Kafka and the Consumer