Better, Faster, Stronger Streaming: Your First Dive into Flink SQL
summary
Uses Apache Flink SQL to build a real, scalable stream pipeline from local CSV or synthetic data in three steps (four if persisting results): untar Flink, start a cluster, open the Flink SQL client, run CREATE TABLE and SELECT; confirms with a built‑in hello world and the giant squirrel UI. Demo also shows the datagen connector producing unbounded rows for high throughput testing and notes changelog mode limits to 1,000 visible changes.
AI-written summary · about
chapters (19)
- 0:00Introduction
- 2:10Overview
- 3:50The Challenge
- 9:43Flink Overview
- 12:53Why Flink
- 15:55Flink Data Pipeline
- 17:33Why Flink SQL
- 20:46Benefits
- 22:42Regular SQL Engine
- 23:48Recap
- 25:26Prerequisites
- 29:00Troubleshooting
- 30:13Table Reading
- 31:56Data Pipeline
- 32:41Storage
- 34:52Datagen
- 36:39Data Pipeline Demo
- 37:32Flink SQL Cookbook
- 38:04Outro
related talks
23mBetter, Faster, Stronger Streaming: Your First Dive into Flink SQL
43mLeverage the power and simplicity of SQL on Apache Flink
46mFlink SQL in 2020: Time to show off!
38mApache Flink: A Very Quick Guide
32mThe easy way to build and run Flink SQL jobs using Cloudera SQL Stream Builder
25mOnly SQL: Empower data analysts end-to-end with Flink SQL
41mBeyond the Hype: When Apache Flink Solves Real Problems
21mFlink's application at Didi