Flink in genomics...

on YouTube ↗42m

" summary

Shows a parallel pipeline implemented with Apache Flink that converts raw Illumina BCL sequencing data into reconstructed DNA fragments and then sorts those fragments by sample-identifying tag. Describes a Flink-based BCL converter whose performance matches Illumina’s shared-memory bcl2fastq while supporting scalable distributed-memory parallelization, and explains the performance techniques used plus Flink features found useful or lacking.

AI-written summary · about

" related talks

• 19mIntegrating Flink and Kafka in the standard genomics pipelineFrancesco Versaci · Flink Forward Berlin 2017
• 42mApache Flink deep-dive #bbuzzStephan Ewen · Berlin Buzzwords 2015
• 42mFlinkCDC: Streamlining your data analytics pipelinesMuhammet Orazov · Berlin Buzzwords 2025
• 38mApache Flink: A Very Quick GuideVladimir Bacvanski · Data By the Bay 2016
• 39mBetter, Faster, Stronger Streaming: Your First Dive into Flink SQLCaito Scherr · Data Con LA 2021
• 23mBetter, Faster, Stronger Streaming: Your First Dive into Flink SQLCaito Scherr · DataEngBytes 2021
• 43mA Data Streaming Architecture with Apache Flink #bbuzzRobert Metzger · Berlin Buzzwords 2016
• 22mDo Flink on Web with FLOWDongwon Kim, Haemee Park · Flink Forward Europe 2019