Production Grade Kafka on K8s

on YouTube ↗26m

" summary

Shows a concrete path to run production Kafka on Kubernetes using a Kafka Operator (Strimzi) that deploys brokers and ZooKeeper from a single CRD, runs an Entity Operator with Topic and User operators, and automates version-matched upgrades, rolling updates, and pod affinity across AZs. Demo creates one broker + one ZooKeeper, exposes an internal NLB and broker load balancer, and reports resources as Ready. Features include mTLS and SCRAM auth, JBOD storage, Cruise Control balancing, Kafka Connect/Bridge and topic/user lifecycle management.

AI-written summary · about

" chapters (14)

1. 0:00Introduction
2. 0:26Agenda
3. 0:47Kafka
4. 1:37microservices
5. 2:15use cases
6. 2:48Kafka concepts
7. 4:02Kafka components
8. 5:07Traditional deployment
9. 6:22Streams
10. 8:07Kafka Project
11. 8:58Kafka Design
12. 10:22Kafka Deployment Architecture
13. 13:40Kafka Ecosystem
14. 17:52Demo

" related talks

• 29mKafka on Kubernetes: Does it really have to be the hard way?Victor Gamov · Montréal Cloud Native Day 2019
• 33mKafka Operator: Managing and Operating Kafka Clusters in Kubernetes [A]Nenad Bogojevic · KubeCon + CloudNativeCon North America 2017
• 24mMake Your Kafka Cluster Production-ReadyJakub Scholz · Data on Kubernetes Day North America 2023
• 44mTaming Apache Kafka Using GitOpsNatale Vinto · JCON WORLD ONLINE 2023
• 50mRunning Apache Kafka on Kubernetes and OpenShiftJakub Scholz · DevConf.CZ 2019
• 24mKafka & Kubernetes - Migrating to a World Without ZookeeperRaffael Méndes · KCD Lima, Perú 2024
• 47mRunning Kafka in Kubernetes: a practical guideKatherine Stanley · Devoxx Belgium 2019
• 27mRunning Kafka in Kubernetes a practical guideKatherine Stanley · Voxxed Days Microservices 2018