Four Different Ways of Working with Kafka on Azure

on YouTube ↗49m

" summary

Compares four concrete deployment choices: HDInsight provisions VM-based Kafka + ZooKeeper (three-node minimum, up to 16 TB broker disks, Kafka 2.1.1, three‑nines SLA) but leaves external access and connectors to you; Event Hubs for Kafka offers a Kafka‑protocol overlay and auto‑inflate throughput but lacks several Kafka protocol features and quotas; Confluent Cloud delivers managed Kafka plus schema registry, Kafka Connect and tiered storage (not yet on Azure Blob) at higher cost; Kafka on AKS uses Strimzi operator to manage topics, users and Connect but requires Kubernetes expertise and your operational responsibility.

AI-written summary · about

" chapters (6)

1. 0:00Introduction to Kafka on Azure
2. 12:09Azure HDInsight for Kafka
3. 22:23Azure Event Hubs for Kafka
4. 30:54Confluent Cloud on Azure
5. 40:23Kafka on Kubernetes with AKS
6. 46:29Summary and Q&A

" related talks

• 11mScaling Kafka in the CloudHeikki Nousiainen · All Things Open 2019
• 26mProduction Grade Kafka on K8sAnand Iyer · Kubernetes Community Days Chennai 2022
• 27mRunning Kafka in Kubernetes a practical guideKatherine Stanley · Voxxed Days Microservices 2018
• 29mKafka on Kubernetes: Does it really have to be the hard way?Victor Gamov · Montréal Cloud Native Day 2019
• 24mMake Your Kafka Cluster Production-ReadyJakub Scholz · Data on Kubernetes Day North America 2023
• 31mSimplifying Apache Kafka on Kubernetes With StrimziPaolo Patierno, Gantigmaa Selenge · KubeCon + CloudNativeCon Europe 2025
• 37mDisaster Recovery Options running Apache Kafka in KubernetesGeetha Anne · Strange Loop 2022
• 30mKafka on Kubernetes: From Evaluation to Production atShrinand Javadekar · LISA18