Non-Volatile Memory Express (NVMe) Resource Pooling Mechanism Based on PCIe

With the rapid development of big data and cloud computing technologies, the demand for storage system performance is constantly increasing.This paper explores the PCIe-based NVMe resource pooling mechanism, aiming to improve the performance and scalability of modern data center storage systems. By designing a multi-node interconnection mechanism, the cross-node sharing and dynamic allocation of NVMe device resources are realized by using PCIe NTB card. Studies include virtual injection of remote devices, remote access to BARs, and interrupt message remapping to ensure that remote devices can be effectively recognized by the operating system. Tests showed that remote shared NVMe device performance was close to local devices, verifying the feasibility of the design.The designed PCIe-based NVMe resource pooling and sharing mechanism is tested, and the final BW and IOPS performance results are analyzed, and the BW and IOPS performance of random read remote shared NVMe operation is 95% higher than that of local NVMe devices. The BW and IOPS performance of the Random Write remote shared NVMe operation is 90% higher than that of the local NVMe device. In the NVMe resource pooling and sharing mechanism, remote shared NVMe disks can be used instead of local NVMe disks.