Bringing Cypher to Apache Flink

on YouTube ↗17m

" summary

Implements a backend so Cypher queries run on Flink by translating Cypher to relational operators over an abstract table, shipping a working OKAPI backend that plugs into Flink Table + Calcite. Shows an end-to-end implementation, integration issues with planner rules, state, checkpoints and offsets, and benchmarking methodology that compares throughput and latency against Neo4j Morpheus on Spark, reporting concrete performance trade‑offs and practical tuning lessons.

AI-written summary · about

" chapters (10)

1. 0:00Introduction to Flink in production
2. 2:13Service level agreements in Flink
3. 5:04Integrating Kafka with Flink
4. 7:30Handling Kafka offsets and checkpoints
5. 10:23Parallel Flink jobs for offset management
6. 12:07Debugging and profiling Flink jobs
7. 14:35Visualizing Flink job metrics
8. 15:42Flink extensions and scalability
9. 16:24Common Flink problems and solutions
10. 17:04Conclusion and Q&A

" related talks

• 41mCypher-based Graph Pattern Matching in Apache FlinkMax Kießling, Martin Junghanns · Flink Forward Berlin 2017
• 47mTaking a look under the hood of Apache Flink’s relational APIsFabian Hueske · Flink Forward Berlin 2016
• 32mKeynote: Apache Flink - Completing Cloudera’s End to End Streaming PlatformMarton Balassi, Joseph Witt · Flink Forward Virtual 2020
• 43mUnified stream and batch processing with Apache Flink’s relational APIsFabian Hueske · Flink Forward Berlin 2017
• 38mApache Flink: A Very Quick GuideVladimir Bacvanski · Data By the Bay 2016
• 15mPowering OLAP at Uber using Apache FlinkGirish Baliga, Chinmay Soman · Flink Forward Global Virtual 2020
• 43mLeverage the power and simplicity of SQL on Apache FlinkFabian Hueske · Berlin Buzzwords 2018
• 40mIt’s finally here: Python on Flink & Flink on ZeppelinJeff Zhang, Jincheng Sun · Flink Forward Virtual 2020