UB-Mesh: A Hierarchically Localized nD-FullMesh Data Center Network Architecture
The scaling of Large-scale Language Models (LLMs) demands unprecedented computational power and bandwidth. We present UB-Mesh, an innovative AI datacenter network architecture that enhances scalability, performance, and cost-efficiency through a hierarchical nD-FullMesh topology. Unlike traditional symmetrical designs, UB-Meshoptimizes LLM training by prioritizing localized data movement and minimizing switch usage. The architecture features UB-Mesh-Pod, a physical implementation of 4D-FullMesh using custom hardware including NPUs, CPUs, Low/High-Radix Switches (LRS/HRS), and NICs, interconnected via our Unified Bus (UB) technology for dynamic resource allocation. For network optimization, we introduce All-Path-Routing (APR) to efficiently manage data traffic. Combined with topology-aware performance tuning and robust reliability mechanisms like 64 + 1 backup, UB-Meshachieves 2.04× better cost-efficiency and 7.2% higher availability than Clos networks. These innovations address the critical challenges of building practical, high-performance AI infrastructure at scale.
Authors
- Wenhua Du (ORCID: https://orcid.org/0000-0002-1713-2830)
- Zhe Zhou (ORCID: https://orcid.org/0000-0002-5508-9415)
- Yi Xiong (ORCID: https://orcid.org/0000-0003-2910-6725)
- Xianping Chen (ORCID: https://orcid.org/0000-0002-6332-0955)
- Rui Meng (ORCID: https://orcid.org/0000-0003-0486-1409)
- Yan‐Zhi Gai
- Zhongjun Cheng (ORCID: https://orcid.org/0000-0001-5550-2989)
- Bingyang Liu (ORCID: https://orcid.org/0000-0002-4572-4956)
- Xiangyu Chen (ORCID: https://orcid.org/0000-0001-7870-2270)
- Yu Zhou (ORCID: https://orcid.org/0000-0002-3723-7584)
- Heng Liao
- C. C. Li (ORCID: https://orcid.org/0000-0001-8162-2124)
- Xingyue Li
- Pei-Chen Wu (ORCID: https://orcid.org/0000-0001-7900-3703)
- Chen Lv (ORCID: https://orcid.org/0000-0001-6897-4512)
- Jing Xia (ORCID: https://orcid.org/0000-0003-4962-2604)
- Jintian Gao (ORCID: https://orcid.org/0009-0009-7651-3789)
- Yong Qin (ORCID: https://orcid.org/0000-0002-6519-8316)
- Yongsheng Ma (ORCID: https://orcid.org/0000-0002-6155-0167)
- Bill McColl
- Xi Chen (ORCID: https://orcid.org/0000-0001-5395-4295)
- Lei Chen (ORCID: https://orcid.org/0000-0001-7544-3285)
- Ziyang Zhang (ORCID: https://orcid.org/0000-0001-8627-3437)
- Christopher H.K. Cheng (ORCID: https://orcid.org/0000-0001-8970-9048)
- Wenjie Liu (ORCID: https://orcid.org/0000-0002-9317-2869)
- Jian He
- Buyun Wang (ORCID: https://orcid.org/0000-0001-9901-5728)
- Peng Dong (ORCID: https://orcid.org/0000-0003-2880-1339)
- Shengyuan Yan (ORCID: https://orcid.org/0000-0002-5332-6253)
- Jianbing Wang (ORCID: https://orcid.org/0000-0002-5571-2174)
- Chuan Qian (ORCID: https://orcid.org/0000-0003-0315-8893)
- Zhigang Guo (ORCID: https://orcid.org/0009-0000-7052-879X)
- Li Xiong (ORCID: https://orcid.org/0009-0004-1422-9209)
- Shizhong Xiao
Institutions
- Huawei Technologies (China) (CN)
Publication Details
- Journal
- IEEE Micro
- Published
- 2025-09-01
- DOI
- https://doi.org/10.1109/mm.2025.3592688
- Citations
- 8
- Primary Topic
- Cloud Computing and Resource Management
- Type
- article
- Field-Weighted Citation Impact
- 25.97