Kubernetes & real-time analytics: How to connect these worlds with Apache Flink

on YouTube ↗26m

" summary

Compares running Apache Flink on Kubernetes via Lyft/GCP operators, the official deployment, Ververica Platform GUI, or bespoke scripts, and gives concrete tradeoffs: operators simplify lifecycle but lag on features, Ververica adds a GUI but community edition requires external storage, and custom setups need scripting. Recommends durable state storage (hosted disks or S3), Kafka/Pulsar connectors for ingress, integration and blue/green testing, monitoring job/task manager metrics, and autoscaling rules to reach high throughput and stable stateful performance.

AI-written summary · about

" chapters (9)

1. 0:00Introduction to talk
2. 3:16Apache Flink overview
3. 7:12Real-time analytics use cases
4. 10:23Flink job management
5. 13:13Flink operators and tools
6. 16:06Testing and validation
7. 19:58Production deployment
8. 24:15Getting started guide
9. 25:16Q&A and resources

" related talks

• 43mApache Flink in Production with Ververica PlatformSeth Wiesman · Flink Forward Virtual 2020
• 24mKeynote: The Easiest Way to Get Operational With Apache FlinkKonstantin Knauf · Flink Forward Virtual 2020
• 20mReliable, Real-Time AI with the Ververica Platform + a Kubernetes Operator in a Growing StartupAustin Cawley · Flink Forward Virtual 2020
• 22mBuilding a Kubernetes Operator for Apache Flink in JavaAttila Mészáros, Gyula Fora · Community Over Code EU 2024
• 44mLets Deeploy Flink - Uncovering Hidden Depths of Yarn, Docker, Kubernetes & BeyondNaci Simsek · Big Data Conference Europe 2025
• 58mReal-Time ML Applications at Scale with Flink and Beam on Kubernetes and GCPChethan U · Flink Forward Global Virtual 2020
• 16mZero-downtime upgrades of Flink applicationsLakshmi Rao · Flink Forward Global Virtual 2020
• 17mGetting Started with Flink for Small Teams w/ RabbitMQ and KubernetesAustin Crawley-Edwards · Flink Forward Global Virtual 2020