E3: Energy-Efficient Microservices on SmartNIC-Accelerated Servers

on YouTube ↗19m

" summary

E3 is a microservice execution platform that offloads small, communication‑intensive services onto Cavium LiquidIO SmartNICs and extends Azure Service Fabric with ECMP-based load balancing, network‑topology aware placement, and a data‑plane orchestrator that detects SmartNIC overload and migrates hot services. Prototype on commodity servers and LiquidIO SmartNICs shows up to 3× energy-efficiency and up to 1.9× cost efficiency over five years for workloads like real‑time analytics, IoT hub and VNFs at under 4% latency increase.

AI-written summary · about

" chapters (10)

1. 0:00E3 system motivation
2. 3:42E3 system design and SmartNIC
3. 6:09SmartNIC integration challenges
4. 7:11E3’s SmartNIC techniques
5. 8:38Load-aware cluster manager
6. 9:20Microservice placement strategy
7. 11:04Energy efficiency evaluation
8. 13:07SmartNIC server cost analysis
9. 14:33Conclusion
10. 15:39Q&A

" related talks

• 27mAzure Accelerated Networking: SmartNICs in the Public CloudAlbert Greenberg, Deepak Bansal, Jitu Padhye, Eric Chung, Matt Humphrey, Adrian Caulfield, Doug Burger, Shachar Raindel, Daniel Firestone, David A. Maltz, Derek Chiou, Andrew Putnam, Sambhrama Mundkur, Alireza Dabagh, Mike Andrewartha, Hari Angepat, Vivek Bhanu, Harish Kumar Chandrappa, Somesh Chaturmohta, Jack Lavier, Norman Lam, Fengfen Liu, Kalin Ovtcharov, Gautham Popuri, Tejas Sapre, Mark Shaw, Gabriel Silva, Madhan Sivakumar, Nisheeth Srivastava, Anshuman Verma, Qasim Zuhair, Kushagra Vaid · NSDI '18
• 23m“Networking” the Logical Micro-Service InfrastructureDave Ward · LinuxCon + ContainerCon + CloudOpen China 2017
• 18mPoby: SmartNIC-accelerated Image Provisioning for Coldstart in CloudsZihao Chang, Jiaqi Zhu, Haifeng Sun, Yunlong Xie, Kan Shi, Ninghui Sun, Yungang Bao, Sa Wang · USENIX ATC '25
• 28mEmpowering the Next Generation of High-Performance, Power-Efficient ServersBrian Millar, Piyush Sukhia, Godwin Maben, Richard Solomon · Arm DevSummit 2021
• 11mUnlock efficiencies from silicon to systems on AzureRani Borkar · Microsoft Build 2024
• 18mBuilding the Future: Microservices, Edge & Cloud InnovationSurya Prabha Busi · Conf42 JavaScript 2025
• 36mThe journey of silicon innovation atAli Saidi · AWS Summit San Francisco 2022
• 48mBuilding applications at hyper scale with the latest Azure innovationsAaron Blasius, Varun Shandilya · Microsoft Build 2024