EdgeWise: A Better Stream Processing Engine for the Edge

on YouTube ↗18m

" summary

EdgeWise is an SPE built on Apache Storm and evaluated on Raspberry Pi gateways and an IoT benchmark; it replaces one-worker-per-operator with a fixed-size worker pool and an engine-level congestion-aware scheduler, uses queue-theoretic analysis to choose the next operator to run, and balances per-operator queue lengths to avoid unnecessary backpressure. Compared to Storm it reports up to 3x improvement in throughput on saturated workloads while lowering end-to-end latency, especially by cutting queuing wait for the heaviest operator.

AI-written summary · about

" chapters (8)

1. 0:00Start
2. 2:16Edge Stream Processing Requirements
3. 2:50Dataflow Programming Model
4. 3:39Runtime System
5. 10:48Performance Analysis using Queueing Theory
6. 12:47Throughput-Latency Performance
7. 13:38Fine-Grained Latency Analysis
8. 16:25Performance on Distributed Edge