AAsclepius: Monitoring, Diagnosing, and Detouring at the Internet Peering Edge

on YouTube ↗21m

" summary

AAsclepius automates detection, localization, direction identification, and detouring of middle faults at the peering edge for Huawei Cloud. It probes representative IPs (representative IP per /24) and reports ASes with sustained loss (>3 minutes), classifies faults with a decision tree, uses PathDebugging by probing alternate POP-to-POP paths over a private backbone to tell outbound vs inbound, and programs BGP to detour outbound traffic. Deployed for ~2–3 years, it diagnoses thousands of faults, circumvents >200 middle faults, and typically restores loss within ~8 minutes, with detours reducing packet loss by up to 7% on average.

AI-written summary · about

" chapters (9)

1. 0:00AAsclepius overview and peering issues
2. 1:08Reducing packet loss rate
3. 2:55Network fault classification
4. 5:03Automated fault detection and detouring
5. 6:27Monitor subsystem: Active probing
6. 9:22Diagnosing subsystem: Fault localization
7. 14:22Detouring strategies
8. 16:35Performance evaluation
9. 19:48Conclusion

" related talks

• 24mHarp: Improving VPC Network Availability via Efficient Failure Detection and Rerouting...Kai Zhang, Jiayu Hu, Feng Jin, Xianping Zhou, Zhen Shen, Yongkang Luo · NSDI '26
• 23mAutomatic Traffic Scheduling for Internet Connectivity FailuresLiuqing Zhang · SREcon18 Asia/Australia
• 16mAres: Comprehensive Path Hijacking Detection via Routing TreeCongcong Miao, Jilong Wang, Yinxiang Tao, Chengwan Zhang, Changqing An, Shuying Zhuang · USENIX Security '25
• 21mDiagnosing Application-network Anomalies for Millions of IPs in Production CloudsTao Ma, Dennis Cai, Guihai Chen, Teng Ma, Zheng Liu, Qiao Xiang, Xianlong Zeng, Zhe Wang, Huanwu Hu, Linghe Kong, Xinlei Kang, Jingxuan Li, Yang Lu, Zhuo Song, Peihao Yang, Jiejian Wu, Yong Yang · USENIX ATC 2024
• 32mActive Fault Finding in NetworksRichard Sheehan · SREcon16 Europe
• 14mSkyline: A Cloud Centric Internet Monitoring EngineYuan Chen, Qi Zhang, Kefei Liu, Gen Li, Rui Han, Anjian Chen, Ziqian Liu, Yiming Qiu, Yibo Huang, Feng Luo, Songlin Liu, Yongbin Dong, Shixian Guo, Yangyang Bai, Yang Lv, Jianwei Hu, Zhenyang Zhong, Sisi Wen, Jiale Feng, Lingpei Meng, Siwan Chen, Hang Li, Shuai Xu, Juntao Zhong, Chaoran Hu · NSDI '26
• 15mCost-effective and Reliable Global Internet Peering with Programmable SwitchesYachen Wang, Wei Guo, Congcong Miao, Marco Canini, Xianneng Zou, Gaogang Xie, Shihan Lin, Yong Jiang, Yunming Xiao, Zhiyi Yao, Xinyi Zhang, Jianchao Lv, Jinglin Wang, Jiwu Bu · NSDI '26
• 29mNetwork Fault Finding System: Packet Loss TriangulationDaniel Rodriguez, Jose Leitao · LISA19