Running Kafka in Kubernetes a practical guide
summary
Deploys Apache Kafka on Kubernetes using Helm and IBM Event Streams on IBM Cloud Private, running a 3-broker cluster plus ZooKeeper as statefulsets with PVCs so broker IDs and logs stay consistent. Uses node anti-affinity to spread brokers, readiness probes that check in-sync replicas separately from liveness, and an external access server that handles TLS and rewrites advertised.listeners so clients connect to the right broker. Demo shows pods, metrics and routing working end to end.
AI-written summary · about
chapters (22)
- 0:00Introduction
- 0:49Architecture
- 1:23Use cases
- 1:43Eventdriven microservices
- 4:00Agenda
- 5:00Apache Kafka
- 7:01Kafka partitioning
- 8:03Kafka replication
- 8:53Kafka consumer groups
- 10:17Kubernetes overview
- 11:19IBM Event Streams
- 12:44Kubernetes objects
- 14:05Persistent volumes
- 15:44Error message
- 17:10Distributed brokers
- 18:43Event Streams
- 19:21UI Server
- 20:17Health Check
- 21:02Readiness Check
- 22:30Listeners and Advertisers
- 25:05External Access Server
- 25:50Wrap up
related talks
47mRunning Kafka in Kubernetes: a practical guide
29mKafka on Kubernetes: Does it really have to be the hard way?
26mProduction Grade Kafka on K8s
33mKafka Operator: Managing and Operating Kafka Clusters in Kubernetes [A]
02h 05mA Deep Dive into Apache Kafka This is Event Streaming
24mMake Your Kafka Cluster Production-Ready
31mEvent driven communication with Kafka on Kubernetes
30mKafka on Kubernetes: From Evaluation to Production at