How to Count and Analyze Hundreds of Gigabits of Traffic per Second

on YouTube ↗53m

" summary

Describes collecting and analyzing hundreds of gigabits per second of client traffic using minimal extra servers for static content; addresses challenges when all clients are served from all servers while maintaining per-subdomain statistics, and outlines an approach to compute and aggregate that high-volume traffic data under very high load.

AI-written summary · about

" related talks

• 51mHow to Serve a Billion Users and Deliver Terabits of TrafficIgor Vasilev · HighLoad++ 2017
• 30mSample Your Traffic but Keep the Good Stuff!Ben Hartshorne · LISA17
• 35mHigh Throughput with Low Resource Usage: A Logging JourneyEduardo Silva · KubeCon + CloudNativeCon Europe 2021
• 31mHow to capture 100G Ethernet traffic at wire speed to local diskChristoph H Lameter · linux.conf.au 2020
• 43mHow to Build a 200 Gbps Video PlatformVyacheslav Olkhovchenkov · HighLoad++ 2015
• 17mReasoning about Network Traffic Load Property at Production ScaleHao Wu, Dennis Cai, Ennan Zhai, Chenren Xu, Ruihan Li, Fangdan Ye, Yifei Yuan, Ruizhen Yang, Bingchuan Tian, Tianchen Guo, Xiaobo Zhu, Zhongyu Guan, Qing Ma, Xianlong Zeng · 21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24)
• 19mDDoS Detection at the Scale of One Hundred TbpsYan Chen, Congcong Miao, Mingwei Xu, Yong Jiang, Jilong Wang, Heng Yu, Yunming Xiao, Xijun Luo, Youliang Jiang, Aike Wang, Hu Chen, Zhibin Zhou, Jiahao Cao · NSDI '26
• 51mAdvanced approaches to traffic inspection & network diagnosis w/Ashraf Altalleh, Geoff Sweet · AWS re:Inforce 2023