Released From the Cage: Apache Kafka Without Its ZooKeeper

on YouTube ↗26m

" summary

Apache Kafka replaces ZooKeeper with KRaft (Kafka Raft protocol) and Strimzi adds support by introducing Kafka node pools and abandoning StatefulSets to manage pods directly; demo shows adding broker nodes numbered 100–199 and rolling mixed controller+broker pods into dedicated controllers. Migration requires in-version sync to KRaft before upgrading to Kafka 4.0 (planned around Oct 2024); Strimzi 0.40 adds KRaft support and full ZooKeeper removal from Strimzi is targeted for early 2025. Risk: operator now manages pod lifecycle and rebalancing (Cruise Control integration is manual today).

AI-written summary · about

" chapters (9)

1. 0:00Introduction
2. 1:26Removing ZooKeeper
3. 3:52Kafka without ZooKeeper
4. 7:06Migration to KRaft
5. 8:10Implementation challenges
6. 10:17Kafka on Kubernetes
7. 14:54Demo: Kafka cluster
8. 20:57Future plans and Kafka 4.0
9. 25:19Summary

" related talks

• 33mManaging a Kafka cluster in KRaft mode with StrimziGantigmaa Selenge · StrimziCon 2025
• 21mKeynote: Strimzi past, present and futurePaolo Patierno, Katherine Stanley · StrimziCon 2025
• 50mKafka 4, fantastic?Damien Lucas · Devoxx France 2026
• 32mStretching Strimzi: Exploring Multi-Cluster Kafka for High AvailabilityAswin A · StrimziCon 2025
• 44mKafka 4, Fantastic?Damien Lucas · BDX I/O 2025
• 29mMastering Kafka Workload Balancing With Strimzi’s Cruise Control IntegrationPaolo Patierno · Data on Kubernetes Day Europe 2025
• 38mRe-architecting Apache Kafka for the CloudGwen Shapira · Craft Conference 2021
• 24mMake Your Kafka Cluster Production-ReadyJakub Scholz · Data on Kubernetes Day North America 2023