Keynote: Apache Flink - Completing Cloudera’s End to End Streaming Platform

on YouTube ↗32m

" summary

Cloudera integrates Apache Flink into a NiFi + Kafka pipeline and reports delivering most planned enterprise features: rewritten HBase and Kudu connectors with pull requests, schema registry and Atlas lineage integration, GA product in January and a May release adding a Flink SQL catalog and a unified UI. Added usability pieces include a history server that shows running jobs, tutorials, a podcast and a beta program; roadmap targets one‑click Flink SQL deployments on AWS with autoscaling and end‑to‑end lineage.

AI-written summary · about

" chapters (11)

1. 0:00Introduction
2. 1:56Data Flow Management
3. 5:08Connected Data Lifecycle
4. 11:26Flow Management
5. 13:15Data Motion Journey
6. 16:28Enabling Flink
7. 23:02Additional Content
8. 24:45Schema Management
9. 27:28Developer Experience
10. 30:08Example
11. 31:33Summary

" related talks

• 40mUnify Enterprise Data Processing System: Platform-level integration of Flink and HiveBowen Li · Flink Forward Europe 2019
• 23mBetter, Faster, Stronger Streaming: Your First Dive into Flink SQLCaito Scherr · Berlin Buzzwords 2021
• 51mStream Processing Smackdown: Kafka Streams vs. Apache FlinkViktor Gamov · Voxxed Days Ticino 2025
• 15mPowering OLAP at Uber using Apache FlinkGirish Baliga, Chinmay Soman · Flink Forward Global Virtual 2020
• 42mStream Processing with Apache FlinkTugdual Grall · DevFest Toulouse 2017
• 32mThe easy way to build and run Flink SQL jobs using Cloudera SQL Stream BuilderKenny Gorman · Flink Forward Global 2021
• 43mUnified stream and batch processing with Apache Flink’s relational APIsFabian Hueske · Flink Forward Berlin 2017
• 39mMoving Beyond Moving BytesSuneel Marthi, Joey Frazee · Flink Forward Berlin 2017