Kafka on Kubernetes: From Evaluation to Production at
summary
Describes Intuit’s evaluation and production rollout of Apache Kafka on Kubernetes in AWS, including experimental setup, test types (produce/consume, network isolation, cross-region, performance and scale) and tools used. Covers configuration details for kafka and zookeeper StatefulSets, ConfigMaps for server.properties, Service objects for broker access, and integration with Splunk and Wavefront for logging and monitoring.
AI-written summary · about
chapters (8)
- 0:00Start
- 6:24Kafka on Kubernetes: Getting off the ground
- 7:50Performance: Experiments and Results (Baseline)
- 10:49Production Requirements
- 15:54Security
- 17:35Logging and Monitoring
- 23:44Tools and utilities
- 28:09Conclusions
related talks
29mKafka on Kubernetes: Does it really have to be the hard way?
26mProduction Grade Kafka on K8s
27mRunning Kafka in Kubernetes a practical guide
23mWhen Kafka Goes Cloud Native: Observability That Actually Works!
40mKafka, DevOps...And Resilience for All
33mKafka Operator: Managing and Operating Kafka Clusters in Kubernetes [A]
24mKafka & Kubernetes - Migrating to a World Without Zookeeper
47mKafka. "An Account of a Struggle"