HeteroSketch: Coordinating Network-wide Monitoring in Heterogeneous and Dynamic Networks

on YouTube ↗16m

" summary

Framework places sketch-based telemetry across switches, SmartNICs, FPGAs and software switches by profiling devices and solving a placement and allocation mixed-integer program constrained by capacity, accuracy and forwarding impact. An automated profiler predicts sketch throughput within ~5% error and the optimizer uses a clustering heuristic to partition large networks, producing solutions 1–3 orders of magnitude faster and cutting monitoring resource overheads by about 20–60% while scaling to >40,000 devices.

AI-written summary · about

" chapters (16)

1. 0:00Intro
2. 0:29Advances: sketches & programmability
3. 1:35Network-wide monitoring
4. 2:09Increasing trend towards heterogeneity
5. 2:27Overlooking heterogeneity is costly
6. 3:40Place sketches & allocate resources?
7. 4:16HeteroSketch in a nutshell
8. 5:31Profiler: Goal & Challenge
9. 6:27Sketch structure simplifies profiling
10. 7:24Micro-benchmarks: Device complexity
11. 8:123 Phases: Micro-benchmark
12. 10:05Challenge: Scalability & Dynamics
13. 10:54Clustering strategy matters
14. 12:25Evaluation: Profiler
15. 14:12Evaluation: Optimizer scalability
16. 14:41Summary & Future work

" related talks

• 14mOctoSketch: Enabling Real-Time, Continuous Network Monitoring over Multiple CoresZaoxing Liu, Yinda Zhang, Peiqing Chen · 21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24)
• 17mSketchovsky: Enabling Ensembles of Sketches on Programmable SwitchesZaoxing Liu, Hun Namkung, Daehyeok Kim, Vyas Sekar, Peter Steenkiste · NSDI 2023
• 15mSketchPipe: Toward Accurate Sketch-based Network Measurement on Multi-Pipeline...Chunming Wu, Xiang Chen, Longlong Zhu, Linying Zheng, Hongyang Du, Dong Zhang, Jianshan Zhang, Xuan Liu, Qun Huang, Dusit Niyato, Haifeng Zhou, Hongyan Liu, Kui Ren · NSDI '26
• 22mSoftware Defined Traffic Measurement with OpenSketchMinlan Yu, Rui Miao, Lavanya Jose · NSDI 2013
• 15mAutoSketch: Automatic Sketch-Oriented Compiler for Query-driven Network TelemetryXin Yao, Wei Wang, Gong Zhang, Haifeng Sun, Yungang Bao, Fuliang Li, Qun Huang, Jinbo Sun, Jiaheng Li · 21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24)
• 16mAutomatic Parallelization of Software Network FunctionsFrancisco Pereira, Fernando M. V. Ramos, Luis Pedrosa · 21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24)
• 46mSelf-Programming Networks: Network Clock Synchronization, Event Playback and Real-time ActionBalaji Prabhakar · Real-Time Decision Making 2018
• 15mForestColl: Throughput-Optimal Collective Communications on Heterogeneous Network FabricsArvind Krishnamurthy, Liangyu Zhao, Zezhou Wang, Saeed Maleki, Ziyue Yang, Hossein Pourreza, Yuanhong Wang · NSDI '26