Nodens: Enabling Resource Efficient and Fast QoS Recovery of Dynamic Microservice...
summary
Nodens is a runtime that builds a traffic-based load monitor, an blocking-aware load updater, and a resource-efficient query drainer to cut QoS recovery from microservice dynamics. It constructs an execution-blocking graph to estimate actual “to-be-processed” load, predicts monitor loads from per-service network bandwidth, and assigns just‑enough excess CPU to drain queues. On an 8-node evaluation across 18 load and call-graph dynamic cases it reduces 99th‑percentile recovery time by 12.1× while using only 6.1% extra resources on average.
AI-written summary · about
chapters (11)
- 0:00Microservice QoS recovery intro
- 2:05Motivation for Nodens research
- 4:12Current QoS recovery limits
- 7:25Nodens runtime design
- 10:13Execution blocking graph
- 12:44Resource allocation strategy
- 13:26Evaluation methodology
- 14:29Performance results
- 15:35Ablation study on load updater
- 16:39Impact of drainer removal
- 17:21Conclusion
related talks
44mHodor: Detecting and Addressing Overload in LinkedIn Microservices
44mDeep Dive talk | Resilience in Microservices with Congestion Control
52mHelidon Nima - Loom based microservices framework
27mProgressive Microservices with NodeJS
42mPredictive Load-Balancing: Unfair but Faster & more Robust
32mBeyond Optimization: Resilient Cloud Microservices at Scale
50mHelidon Nima - Loom based microservices framework
25mOdin: Microsoft’s Scalable Fault-Tolerant CDN Measurement System