Patterns for Streaming Telemetry with Akka Streams

on YouTube ↗44m

" summary

Shows a working pattern for ingesting unbounded IoT telemetry with Akka Streams: replace a fragile, stateful actor with a stream that batches with groupedWithin(1000, 1.second), limits concurrent writes with mapAsync(parallelism = 10), preserves per-device order, and applies backpressure so upstream connections stop overwhelming the DB. Demonstrates disaggregation with mapConcat, conditional routing for invalid messages, throttling and idle timeouts, and notes mapAsyncUnordered when order can be sacrificed for throughput.

AI-written summary · about

" chapters (18)

1. 0:00Intro
2. 1:25Aakka
3. 2:07PARTI A MOTIVATING EXAMPLE
4. 9:50ERROR HANDLING
5. 10:56REACTIVE STREAMS
6. 12:44AKKA STREAMS API
7. 13:59PATTERNS FOR STREAMING TELEMETRY
8. 14:25GROUPING
9. 15:56DISAGGREGATION
10. 17:48FILTERING
11. 21:38RATE LIMITING REQUESTS
12. 25:28CONCURRENCY
13. 28:37IDLE TIMEOUTS
14. 30:17PERIODIC EVENTS
15. 30:57WATCHING TERMINATION
16. 32:24PROOF OF CONCEPT
17. 35:41WHAT ABOUT ACTORS?
18. 37:26QUESTIONS?

" related talks

• 46mAkka Streams & Reactive Streams in actionKonrad 'ktoso' Malawski · Scala Days Berlin 2016
• 42mLearn you Akka Streams for great Good!Heiko Seeberger · Scala Days Copenhagen 2017
• 01h 07mA Practical Introduction to Akka StreamsJacek Kunicki · JDD 2016
• 49mA Practical Introduction to Akka StreamsJacek Kunicki · Voxxed Days Vienna 2017
• 49mLearn you advanced Akka Streams for great Good!Heiko Seeberger · Scala.IO 2016
• 46mAkka Streams in Real-World TasksEvgeniy Nenakhov · JPoint 2023
• 30mLive Coding: Building Stateful and Scalable Reactive Streams...Nolan Grace · Scale By the Bay 2021
• 01h 31mReactive Streams / Akka StreamsJohannes Rudolph, Mathias Doenitz · Scala World 2015