RBEA- Scalable Real-Time Analytics at King
summary
RBEA (Rule-Based Event Aggregator) is a Groovy DSL platform that compiles user scripts into one heavy Apache Flink job per game, injects scripts into the running operator, and routes generated output events to sinks like Kafka, MySQL or HDFS. It keeps per-user state in a serialized value state on RocksDB state backend with a custom cache, uses a dynamic window assigner to support arbitrary window sizes without proliferating operators, and handles scaling for King’s ~400M users and ~30 billion events/day — it works in production and speeds analyst iteration.
AI-written summary · about
chapters (10)
- 0:00Introduction to RBEA
- 1:52About King and its data
- 6:09RBEA platform goals
- 8:39RBEA architecture overview
- 13:13RBEA Flink backend details
- 15:43RBEA API and scripting
- 24:19Aggregation and output handling
- 26:29User state management
- 29:00RBEA usability benefits
- 31:30Summary and Q&A
related talks
43mLarge Scale User Behavior Analytics by Flink
38mStreaming analytics and CEP ... #bbuzz
35mReal-time analytics at IoT scale
30mBeyond the Build: Unleashing the Hidden Value in Your Data Platforms
37mFrom BaaB to EaaS in the Financial Industry
45mApache Flink — Real-Time Data Processing
19mBuilding Stateful Streaming Pipelines
38mRealtime Data Activation - Analytics, Intelligence & Decision Making