SQL Ask-Me-Anything

on YouTube ↗37m

" summary

Unified Flink SQL now ships with the Blink planner in Flink 1.9 giving full TPC-H coverage and large batch speedups, with full TPC-DS targeted for 1.10. Hive integration appears as a preview in 1.9 (batch sources) and moves toward streaming Hive sinks in 1.10. The system exposes a catalog API, supports temporal lookups via temporal table join semantics backed by change‑log/CDC ideas, and plans a filesystem connector for Avro/ORC on S3/HDFS; connector growth depends on community contributions.

AI-written summary · about

" chapters (8)

1. 0:00Introduction and panelists
2. 5:12Hive integration overview
3. 10:18Joining live and historical data
4. 17:46Temporal table joins explained
5. 23:54Hive version compatibility
6. 24:41Support for object storage
7. 29:01Roadmap and connectors
8. 35:32Closing remarks

" related talks

• 43mLeverage the power and simplicity of SQL on Apache FlinkFabian Hueske · Berlin Buzzwords 2018
• 35mProduction-Ready Flink and Hive Integration - what story you can tell now?Bowen Li · Flink Forward Virtual 2020
• 36mFlink SQL: Unified Streaming and batch for hive integrationRui Li, Jingsong Lee · Flink Forward Global Virtual 2020
• 37mKeynote | Flink Ahead: What Comes After Unified Batch & Streaming?Stephan Ewen · Flink Forward Global Virtual 2020
• 46mFlink SQL in 2020: Time to show off!Timo Walther, Fabian Hueske · Flink Forward Virtual 2020
• 39mBetter, Faster, Stronger Streaming: Your First Dive into Flink SQLCaito Scherr · Data Con LA 2021
• 35mApache Flink 2.0: Unified Enterprise Data Processing System and BeyondBowen Li · Scale By The Bay 2019
• 47mTaking a look under the hood of Apache Flink’s relational APIsFabian Hueske · Flink Forward Berlin 2016