Flink architecture and automation in Intesa Sanpaolo

on YouTube ↗32m

" summary

Intesa Sanpaolo runs Apache Flink on containerized OpenShift clusters with cross‑region storage replicas and a plan for active‑active cloud migration, processing peaks around Kafka throughput 17k events/sec and near 5 TB ingested over busy weekends while supporting ~1 billion mobile hops/year and 7 million active users. Automation uses ArgoCD GitOps plus config‑map driven templates and a custom operator to push job state and deployments; provisioning, job rollout and DR failover are automated and already shorten delivery and reduce manual ops.

AI-written summary · about

" chapters (6)

1. 0:00Introduction
2. 3:14Stream Architectures in Intesa Sanpaolo
3. 7:56From Apache Storm to Apache Flink
4. 9:23Flink's current use cases
5. 12:20Our Flink architecture
6. 17:21Flink's Automation design

" related talks

• 35mApache Flink 2.0: Unified Enterprise Data Processing System and BeyondBowen Li · Scale By The Bay 2019
• 37mBuilding and operating large-scale streaming applications at KingGyula Fora · Flink Forward Berlin 2017
• 42mApache Flink deep-dive #bbuzzStephan Ewen · Berlin Buzzwords 2015
• 20mAutoscaling Apache Flink ApplicationsRobert Metzger · Berlin Buzzwords 2021
• 42mApache Flink meets Apache Mesos and DC/OSTill Rohrmann · Flink Forward Berlin 2017
• 45mMulti-tenant Flink-as-a-Service on YARNJim Dowling · Flink Forward Berlin 2016
• 38mAutoscaling Flink at NetflixTimothy Farkas · Flink Forward Virtual 2020
• 34mHands-on Stateful Serverless Applications with Kubernetes and Stateful FunctionsSeth Wiesman · Flink Forward Global Virtual 2020