Justitia: Software Multi-Tenancy in Hardware Kernel-Bypass Networks
Talkat 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI '22) · 2022-04-04..04-06·
summary
Justitia inserts a software layer before hardware kernel-bypass NICs, splitting large sends into chunks and issuing them under a token bucket so the NIC’s message-level shaping prevents head-of-line blocking; tokens represent bytes or message-equivalents so bandwidth and throughput resources share one quota. A passive reference flow implements passive latency monitoring and a sender-driven mediator with receiver-side updates handles incast. Evaluation on RDMA/InfiniBand and RoCE preserves a 10 µs tail target with four bandwidth tenants while keeping overall utilization high.
AI-written summary · about
chapters (7)
- 0:00Introduction to KBN
- 1:09Multi-tenancy challenges
- 3:16Performance isolation analysis
- 6:13Design of Gestitia
- 9:03Implementation details
- 12:21Evaluation results
- 14:41Conclusion
related talks
17mOSMOSIS: Enabling Multi-Tenancy in Datacenter SmartNICs
16mRingLeader: Efficiently Offloading Intra-Server Orchestration to NICs
18mKeepON: Supporting Deterministic Traffic on Standard NICs
13mLive in the Express Lane
16mSöze: One Network Telemetry Is All You Need for Per-flow Weighted Bandwidth Allocation...
17mRearchitecting the TCP Stack for I/O-Offloaded Content Delivery
20mNetKernel: Making Network Stack Part of the Virtualized Infrastructure
22mTransparent MultiNIC Routing for Large AI Models