Network Load Balancing With No Out-of-Order Packet for RoCE
Remote Direct Memory Access (RDMA) is becoming a popular high-speed network technology. It uses kernel bypass and zero copy to allow the host to exchange data directly in memory, providing high throughput and low latency while reducing CPU overhead. However, RDMA is based on single-connection transmission and does not make good use of the end-to-end path diversity of the data center. At the same time, existing load balancing algorithms cannot be well applied to RDMA. In this paper, we focus on the flow characteristics of RDMA and load balancing algorithm for RDMA. We first observe the flow characteristics of RDMA and the transmission mode in the lossless environment through experiments, and analyze the reasons for this phenomenon. Then we propose Ursine, a load balancing algorithm for RDMA. It achieves fine-grained RDMA load balancing while avoiding packet out-of-order, and effectively utilizes the end-to-end path diversity in the data center. We implemented the prototype based on DPDK and verified through small-scale experiments that Ursine provides better performance than existing algorithms. Finally, we analyze and look forward to the future and development trends of RDMA load balancing.
Authors
- Tian Pan (ORCID: https://orcid.org/0000-0001-7718-0669)
- Mingxuan Yu (ORCID: https://orcid.org/0009-0004-5056-0361)
- Yongchen Pan (ORCID: https://orcid.org/0009-0000-4628-7535)
- Tao Huang (ORCID: https://orcid.org/0000-0002-3545-1122)
- Jiao Zhang (ORCID: https://orcid.org/0000-0001-5614-3420)
- Huimin Luo (ORCID: https://orcid.org/0000-0002-7681-7768)
Institutions
- Beijing University of Posts and Telecommunications (CN)
- State Key Laboratory of Networking and Switching Technology
Publication Details
- Journal
- IEEE Network
- Published
- 2024-11-21
- DOI
- https://doi.org/10.1109/mnet.2024.3503714
- Citations
- 4
- Primary Topic
- Interconnection Networks and Systems
- Type
- article
- Field-Weighted Citation Impact
- 1.40