Tame Your Data with Akka Streams

on YouTube ↗46m

" summary

Live code shows Akka Streams parsing gzipped CSV files into ByteString lines using framing (delimiter '\n', max 128, allowTruncation true), mapping lines to domain readings via non-blocking futures, handling invalid values with a dummy -1, grouping pairs and computing averages with mapAsyncUnordered for unordered parallelism, and persisting results to Cassandra. A custom graph DSL balancer runs multiple process-single-file flows concurrently; the pipeline materializes on an ActorMaterializer and completes successfully with rows visible in Cassandra.

AI-written summary · about

" chapters (10)

1. 0:00Start
2. 0:43Recap What Stream Processing Is
3. 2:21Back Pressure
4. 3:51Characteristics of Arca Streams
5. 7:17Live Coding
6. 12:53Line Delimiter
7. 16:06Stream Converters
8. 18:59Average Computation
9. 34:48Implement a Simple Load Balancer
10. 36:37Balanced Stage

" related talks

• 01h 07mA Practical Introduction to Akka StreamsJacek Kunicki · JDD 2016
• 35mPractical Reactive Streams with MonixJacek Kunicki · Scale By The Bay 2018
• 48mStreaming all the things with Akka StreamsJohan Andrén · Voxxed Days Zurich 2017
• 32mPRACTICAL REACTIVE STREAMS WITH MONIXJacek Kunicki · Scalar 2018
• 30mLEARN YOU AKKA STREAMS FOR GREAT GOOD!Heiko Seeberger · Scalar Conference 2017
• 31mSTREAM DRIVEN DEVELOPMENT - DESIGN YOUR DATA PIPELINE WITH AKKA STREAMSStefano Bonetti · Scalar 2018
• 01h 20mAkka Streams for Large Scale Data ProcessingZack Loebel-Begelman, Dustin Lyons · Data By the Bay 2016
• 28mStreams on top of ScalaQuentin Adam · Scalar Conference 2015