Leverage the power and simplicity of SQL on Apache Flink

on YouTube ↗43m

" summary

Argues that Apache Flink exposes full SQL and a Table API that deliver unified batch/stream semantics, with production deployments at Alibaba, Huawei, Uber and users like Netflix processing 3 trillion events/day and jobs with 20 TB state. Shows Flink 1.5 features (hopping windows, windowed joins, UDFs), demos queries on NYC taxi events, and describes a proposed query service (FLIP-24) that compiles SQL to streaming jobs, serves live materialized views, and discusses result-serving tradeoffs and a handle+client alternative.

AI-written summary · about

" chapters (11)

1. 0:00Introduction
2. 1:53What is Apache Flink
3. 4:21SQL and Table API overview
4. 8:39Unified batch and stream semantics
5. 13:46Supported SQL operations
6. 15:31Use cases for Flink SQL
7. 22:23Improving API usability
8. 23:08Live SQL demo with NYC taxi data
9. 26:13Future Flink SQL query service
10. 31:55Summary and Flink Forward
11. 33:06Q&A session

" related talks

• 39mBetter, Faster, Stronger Streaming: Your First Dive into Flink SQLCaito Scherr · Data Con LA 2021
• 46mFlink SQL in 2020: Time to show off!Timo Walther, Fabian Hueske · Flink Forward Virtual 2020
• 23mFrom Streams to Tables and Back Again: A Demo of Flink’s Table & SQL APITimo Walther · Flink Forward Berlin 2017
• 41mBeyond the Hype: When Apache Flink Solves Real ProblemsNaci Simsek · Berlin Buzzwords 2026
• 23mBetter, Faster, Stronger Streaming: Your First Dive into Flink SQLCaito Scherr · DataEngBytes 2021
• 38mApache Flink: A Very Quick GuideVladimir Bacvanski · Data By the Bay 2016
• 21mFlink's application at DidiXue Kang · Flink Forward Virtual 2020
• 47mTaking a look under the hood of Apache Flink’s relational APIsFabian Hueske · Flink Forward Berlin 2016