Batch/Stream Ask-Me-Anything
summary
Speakers describe Apache Flink's effort to unify batch and stream processing by using a single engine and replacing the DataSet API with an extension of the DataStream API that supports bounded streams. Flink committers discuss recent internal changes, the plan to make DataStream handle batch workloads, and answer technical questions about the design and implementation of this unified batch/stream approach.
AI-written summary · about
chapters (6)
- 0:00Batch/Stream AMA intro
- 3:24Problem motivation
- 13:03Real-time events
- 18:49Recovery challenges
- 23:37Scaling future outlook
- 26:21Closing remarks
related talks
45mThe State of Flink and how to adopt Stream Processing
30mBlink: Improvements to Flink & its application in Alibaba Search
38mFrom Flink 1.3 to 1.4
35mBeyond the Watermark: On-Demand Backfilling in Flink
36mMicroStream Labs – New Incredible Feature Preview
42mApache Ignite Extensions - Modularization
40mCombining Stream and Batch Processes in Camunda BPM
01h 29mIntroduction to Spring Integration and Spring Batch