Transforming Google's Datacenter Network Through Optical Circuit Switching

on YouTube ↗19m

" summary

Google's Jupiter delivers a direct-connect mesh using MEMS-based Optical Circuit Switches as an indirection layer and a centralized Orion SDN control plane to reconfigure topology incrementally with no application-visible downtime. It upgrades blocks independently (200 Gbps native interconnect), reaches 6.4 Pb/s aggregate, and reports 5x higher speed, 30% lower capex, 41% less power, 10% faster flow completion and 30% higher throughput versus prior designs. Traffic control uses variable hedging between VLB and demand-aware routing to balance optimality and robustness.

AI-written summary · about

" chapters (4)

1. 0:00Start
2. 4:352. Optical circuit switch and spine-free topology
3. 6:54Traffic and topology engineering
4. 13:51Hitless network upgrade

" related talks

• 12mOrion: Google's Software-Defined Networking Control PlaneArjun Singh, Amin Vahdat, Shawn Shuoshuo Chen, Andrew D. Ferguson, Richard Alimi, Joon Ong, Amr Sabaa, Shidong Zhang, Leon Poutievski, Steve Gribble, Chi-Yao Hong, Charles Killian, Waqar Mohsin, Henrik Muehe, Lorenzo Vicisano, Mike Conley, Subhasree Mandal, Karthik Nagaraj, Kondapa Naidu Bollineni, Min Zhu · NSDI ’21
• 30mKeynote: Cloud Native NetworkingAmin Vahdat · Open Networking Summit 2017
• 18mArchitecting Multi-tenant Data-center Networks for GPU CustomersChang Kim, Weilong Cui · @Scale: Networking 2025
• 15mCost-effective and Reliable Global Internet Peering with Programmable SwitchesYachen Wang, Wei Guo, Congcong Miao, Marco Canini, Xianneng Zou, Gaogang Xie, Shihan Lin, Yong Jiang, Yunming Xiao, Zhiyi Yao, Xinyi Zhang, Jianchao Lv, Jinglin Wang, Jiwu Bu · NSDI '26
• 18mResiliency at Scale: Managing Google’s TPUv4 Machine Learning SupercomputerSteve Lacy, Chris Lewis, Hoang-Vu Dang, Yazhou Zu, Alireza Ghaffarkhah, Brian Towles, Steven Hand, Safeen Huda, Adekunle Bello, Alexander Kolbasov, Arash Rezaei, Dayou Du, Hang Wang, Aaron Wisner, Henri Bahini · 21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24)
• 21mLarry: Practical Network Reconfigurability in the Data CenterAndromachi Chatzieleftheriou, Antony Rowstron, Sergey Legtchenko, Hugh Williams · NSDI '18
• 17mMeta’s Network Journey to Enable AIHany Morsy, Susana Contrera · Networking @Scale 2023
• 14mRDC: Energy-Efficient Data Center Network Congestion Relief with TopologicalWeitao Wang, T. S. Eugene Ng, Ang Chen, Dingming Wu, Sushovan Das, Afsaneh Rahbar · 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI '22)