Poby: SmartNIC-accelerated Image Provisioning for Coldstart in Clouds

on YouTube ↗18m

" summary

Claims SmartNIC-accelerated image provisioning reduces coldstart by offloading decompression to BlueField SmartNICs (decompress 66× faster than host) and repartitioning work with a pipeline-based data-driven workflow plus a disaggregated hardware-aware architecture. Prototype on BlueField with containerd/iSulad baselines and microservice/FaaS suites yields 13.2× and 8.0× speedups respectively, cuts host CPU by 87.5%, and uses block redundancy and best-effort distributed download to avoid centralized registry bottlenecks.

AI-written summary · about

" chapters (10)

1. 0:00Cold start challenges in clouds
2. 2:50Image provisioning bottlenecks
3. 5:00Limitations of avoidance strategies
4. 7:26SmartNIC acceleration approach
5. 9:58Disaggregated architecture
6. 11:48Data-driven workflow design
7. 13:16Distributed image download
8. 15:06Implementation methodology
9. 16:55Performance results
10. 17:17Conclusion

" related talks

• 25mBlazing-Fast Container Deployments: Image Caching With Block StorageManu Bhadoria, Juana Nakfour · Data on Kubernetes Day NA 2025
• 27mSupporting Security Sensitive Tenants in a Bare-Metal CloudMania Abdi, Trammell Hudson, Amin Mosayyebzadeh, Apoorve Mohan, Sahil Tikale, Nabil Schear, Charles Munson, Larry Rudolph, Gene Cooperman, Peter Desnoyers, Orran Krieger · USENIX ATC '19
• 21mDADI: Block-Level Image Service for Agile and Elastic Application DeploymentYifan Yuan, Huiba Li, Lanzheng Liu, Windsor Hsu, Rui Du, Kai Ma · USENIX ATC '20
• 19mE3: Energy-Efficient Microservices on SmartNIC-Accelerated ServersPhitchaya Mangpo Phothilimthana, Ming Liu, Simon Peter, Arvind Krishnamurthy · USENIX ATC '19
• 30mThinner Clouds with PreallocationIdit Keidar, Ittay Eyal, Flavio Paiva Junqueira · HotCloud '13
• 27mAzure Accelerated Networking: SmartNICs in the Public CloudAlbert Greenberg, Deepak Bansal, Jitu Padhye, Eric Chung, Matt Humphrey, Adrian Caulfield, Doug Burger, Shachar Raindel, Daniel Firestone, David A. Maltz, Derek Chiou, Andrew Putnam, Sambhrama Mundkur, Alireza Dabagh, Mike Andrewartha, Hari Angepat, Vivek Bhanu, Harish Kumar Chandrappa, Somesh Chaturmohta, Jack Lavier, Norman Lam, Fengfen Liu, Kalin Ovtcharov, Gautham Popuri, Tejas Sapre, Mark Shaw, Gabriel Silva, Madhan Sivakumar, Nisheeth Srivastava, Anshuman Verma, Qasim Zuhair, Kushagra Vaid · NSDI '18
• 47mCloud Native and Sustainable, Reproducible Scientific ComputingRicardo Rocha · Voxxed Days CERN 2025
• 16mOptimizing Network Provisioning through CooperationRanjita Bhagwan, Yogesh Bansal, Harsha Sharma, Parth Thakkar, Sagar Bharadwaj, Venkata N. Padmanabhan, Vijay Kumar, Kathleen Voelbel · 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI '22)