Flink's Table & DataStream API: A Perfect Symbiosis

on YouTube ↗35m

" summary

Shows concrete code and a working demo: Kafka sources with three customer rows and duplicate transactions, a DataStream dedupe using keyed state plus timers, and a Table API version that reduces dozens of lines to three and emits five final rows in batch. Demonstrates from changelog stream to register updates, batch mode flag for DataStream, temporal joins with system time as of, and interoperability via StreamTableEnvironment, all running end to end.

AI-written summary · about

" chapters (6)

1. 0:00Intro
2. 1:00What is Flink?
3. 3:48Flink's APIs
4. 14:17Interoperability
5. 15:57Flink Demo
6. 33:19Summary

" related talks

• 39mChangelog Stream Processing with Apache FlinkTimo Walther · Berlin Buzzwords 2022
• 27mUnderstanding stream table duality using Kafka, Flink SQL and Debezium formatMuhammet Orazov · Community Over Code EU 2024
• 50mStream Processing Smackdown: Kafka Streams vs. Apache FlinkViktor Gamov · Jfokus 2025
• 23mFrom Streams to Tables and Back Again: A Demo of Flink’s Table & SQL APITimo Walther · Flink Forward Berlin 2017
• 23mBetter, Faster, Stronger Streaming: Your First Dive into Flink SQLCaito Scherr · DataEngBytes 2021
• 43mA Data Streaming Architecture with Apache Flink #bbuzzRobert Metzger · Berlin Buzzwords 2016
• 46mFlink SQL in 2020: Time to show off!Timo Walther, Fabian Hueske · Flink Forward Virtual 2020
• 41mBeyond the Hype: When Apache Flink Solves Real ProblemsNaci Simsek · Berlin Buzzwords 2026