Flor: An Open High Performance RDMA Framework Over Heterogeneous RNICs
summary
Flor is an RDMA framework that keeps the RoCEv2 data path in RNIC hardware but moves vendor-specific control logic into software running on NPUs/DPUs/host CPUs, implements dynamic chunking, selective UC-first transport, and software reliability/congestion modules. Implemented on Intel E180, Mellanox CX-4/CX-5, Broadcom RNICs, it matches vanilla RDMA performance under stress tests including 1/4096 packet loss, 6000:1 incast, and reduces CX-4/CX-5 bandwidth gap from 24.3% to 1.3% in production.
AI-written summary · about
chapters (14)
- 0:00Flor RDMA framework
- 0:29RDMA with heterogeneous RNICs
- 1:34Performance gaps in RNICs
- 2:16New RDMA production needs
- 3:22Limitations of RDMA frameworks
- 4:03Flor's design key findings
- 5:28Flor architecture and control path
- 6:52Dynamic chunking for RDMA
- 8:39Unreliable Connection transport
- 9:42RTT and congestion control
- 10:29Evaluation setup and throughput
- 11:37Large-scale deployment results
- 12:45Alibaba application performance
- 13:29Conclusion and future work
related talks
18mRoCE BALBOA: Service-Enhanced RDMA Offload Engine for Data Center SmartNICs
20mRDMA at Cloud Scale: The OCI Experience
12mPreview: Networking
25mRDMA @Scale
26mFreeFlow: Software-based Virtual RDMA Networking for Containerized Clouds
17mSRNIC: A Scalable Architecture for RDMA NICs
14mODRP: On-Demand Remote Paging with Programmable RDMA
22mMetaRoCE: Meta’s RDMA Transport
