Tame Crypto Events with Scala and Akka Streams
summary
Side project collects crypto events and prices with Scala, models domain with DDD and Event-storming, and implements a backpressured pipeline using Akka Streams plus durable messaging via Google pub/sub and Docker on Google Cloud's Kubernetes. Six months of runs produce ~2,000 events across ~500 coins and ~500,000 price measurements; analysis finds a handful of coincidences (notably HOT around community meetups) but no reproducible pattern, so the pipeline works but the hypothesis does not.
AI-written summary · about
chapters (15)
- 0:00Intro
- 2:33Frustrations in software development
- 3:27Side projects
- 5:36The idea
- 7:02Data
- 8:56Events Storming
- 12:23Bounded Contexts
- 13:58Streaming Thinking
- 23:15Deployment
- 24:32Results
- 30:28Hollow Train
- 31:20Community Events
- 32:58Conclusion
- 33:44Motivation
- 34:16Questions
related talks
01h 02mBig Data Analytics in Near-Real-Time with Apache Kafka Streams
01h 47mRadanalytics.io streaming applications workshop
51mStream all the things! - life at the end of the firehose
19mBig Data
21mReal-time Stream Analytics and Scoring Using Apache Flink, Druid & Cassandra
47mReal-time Fraud Detection Challenges and Solutions
49mStream Away with Scala
51mReal-time Fraud Detection: Challenges and Solutions