Streaming analytics and CEP ... #bbuzz

on YouTube ↗38m

" summary

Apache Flink claims a single engine can handle both low-latency CEP and high-throughput stream analytics, running millions of events per second at sub-second latency. It ships a pattern API that emits timeout-handled warning or success events, compiles StreamSQL via Apache Calcite into DataStream programs, and plans aggregations and windows by event time. State persists in configurable backends (JVM heap or RocksDB state backend with checkpoints to HDFS). The CEP library is live and CEP-enriched StreamSQL is underway, demonstrated end-to-end in the order/ shipment use case.

AI-written summary · about

" chapters (10)

1. 0:00Introduction to stream processing
2. 6:46Apache Flink capabilities
3. 9:30Order fulfillment use case
4. 11:52Stream analytics and windows
5. 16:46Stream SQL implementation
6. 20:40Complex event processing
7. 24:22Defining patterns in Flink
8. 28:27Integrating CEP and SQL
9. 32:45Conclusion and resources
10. 34:44Q&A session

" related talks

• 39mDeclarative stream processing...Till Rohrmann, Fabian Hueske · Flink Forward Berlin 2016
• 33mComplex Event Processing with Flink: the state of FlinkCEPKostas Kloudas · Flink Forward Berlin 2017
• 38mApache Flink: A Very Quick GuideVladimir Bacvanski · Data By the Bay 2016
• 49mscale.bythebay.io: Stephan Ewen, Apache Flink and the Next Wave of Stream Processing ApplicationsStephan Ewen · Scale By the Bay 2017
• 43mLarge Scale User Behavior Analytics by FlinkHao Wu · Flink Forward Berlin 2017
• 41mBeyond the Hype: When Apache Flink Solves Real ProblemsNaci Simsek · Berlin Buzzwords 2026
• 35mApache Flink 2.0: Unified Enterprise Data Processing System and BeyondBowen Li · Scale By The Bay 2019
• 42mApache Flink deep-dive #bbuzzStephan Ewen · Berlin Buzzwords 2015