Network Load Balancing With No Out-of-Order Packet for RoCE

Remote Direct Memory Access (RDMA) is becoming a popular high-speed network technology. It uses kernel bypass and zero copy to allow the host to exchange data directly in memory, providing high throughput and low latency while reducing CPU overhead. However, RDMA is based on single-connection transmission and does not make good use of the end-to-end path diversity of the data center. At the same time, existing load balancing algorithms cannot be well applied to RDMA. In this paper, we focus on the flow characteristics of RDMA and load balancing algorithm for RDMA. We first observe the flow characteristics of RDMA and the transmission mode in the lossless environment through experiments, and analyze the reasons for this phenomenon. Then we propose Ursine, a load balancing algorithm for RDMA. It achieves fine-grained RDMA load balancing while avoiding packet out-of-order, and effectively utilizes the end-to-end path diversity in the data center. We implemented the prototype based on DPDK and verified through small-scale experiments that Ursine provides better performance than existing algorithms. Finally, we analyze and look forward to the future and development trends of RDMA load balancing.

Authors

Institutions

Publication Details

Journal
IEEE Network
Published
2024-11-21
DOI
https://doi.org/10.1109/mnet.2024.3503714
Citations
4
Primary Topic
Interconnection Networks and Systems
Type
article
Field-Weighted Citation Impact
1.40
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Network Load Balancing With No Out-of-Order Packet for RoCE

Tian Pan, Mingxuan Yu, Yongchen Pan, Tao Huang et al.
4 citations
IEEE Network
Interconnection Networks and Systems
1.40
article

Network Load Balancing With No Out-of-Order Packet for RoCE

Tian Pan, Mingxuan Yu, Yongchen Pan, Tao Huang, Jiao Zhang, Huimin Luo
article en
4 citations

Abstract

Remote Direct Memory Access (RDMA) is becoming a popular high-speed network technology. It uses kernel bypass and zero copy to allow the host to exchange data directly in memory, providing high throughput and low latency while reducing CPU overhead. However, RDMA is based on single-connection transmission and does not make good use of the end-to-end path diversity of the data center. At the same time, existing load balancing algorithms cannot be well applied to RDMA. In this paper, we focus on the flow characteristics of RDMA and load balancing algorithm for RDMA. We first observe the flow characteristics of RDMA and the transmission mode in the lossless environment through experiments, and analyze the reasons for this phenomenon. Then we propose Ursine, a load balancing algorithm for RDMA. It achieves fine-grained RDMA load balancing while avoiding packet out-of-order, and effectively utilizes the end-to-end path diversity in the data center. We implemented the prototype based on DPDK and verified through small-scale experiments that Ursine provides better performance than existing algorithms. Finally, we analyze and look forward to the future and development trends of RDMA load balancing.

IEEE NetworkVol. 39(2)
Beijing University of Posts and Telecommunications (CN), State Key Laboratory of Networking and Switching Technology
Openalex Percentile: Top 16%
Interconnection Networks and Systems
1.40
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.