Random memristor-based dynamic graph CNN for efficient point cloud learning at the edge
The broad integration of 3D sensors into devices like smartphones and AR/VR headsets has led to a surge in 3D data, with point clouds becoming a mainstream representation method. Efficient real-time learning of point cloud data on edge devices is crucial for applications such as autonomous vehicles and embodied AI. Traditional machine learning models on digital processors face limitations, with software challenges like high training complexity, and hardware challenges such as large time and energy overheads due to von Neumann bottleneck. To address this, we propose a software-hardware co-designed random memristor-based dynamic graph CNN (RDGCNN). Software-wise, we transform point cloud into graph, and propose random EdgeConv for efficient hierarchical and topological features extraction. Hardware-wise, leveraging memristor’s intrinsic stochasticity and in-memory computing capability, we achieve significant reductions in training complexity and energy consumption. RDGCNN demonstrates high accuracy and efficiency across various point cloud tasks, paving the way for future edge 3D vision.
Authors
- Dashan Shang (ORCID: https://orcid.org/0000-0003-3573-8390)
- Meng Xu (ORCID: https://orcid.org/0000-0003-1674-6037)
- Songqi Wang
- Hegan Chen (ORCID: https://orcid.org/0000-0002-9661-2727)
- Shaocong Wang (ORCID: https://orcid.org/0000-0001-6195-1799)
- Xiaoshan Wu (ORCID: https://orcid.org/0000-0003-4200-3587)
- Dingchen Wang (ORCID: https://orcid.org/0000-0003-3747-1626)
- Woyu Zhang
- Zhongrui Wang (ORCID: https://orcid.org/0000-0003-2264-0677)
- Xi Chen (ORCID: https://orcid.org/0000-0003-4221-4288)
- Ning Lin (ORCID: https://orcid.org/0000-0002-6198-7043)
- Jichang Yang
- Xiaojuan Qi (ORCID: https://orcid.org/0000-0002-4285-1626)
- Bo Wang (ORCID: https://orcid.org/0009-0007-0130-1592)
- Yue Zhang (ORCID: https://orcid.org/0000-0002-7786-0231)
- Yifei Yu (ORCID: https://orcid.org/0009-0006-2986-1682)
Institutions
- Chinese Academy of Sciences (CN)
- Hong Kong Science and Technology Parks Corporation (HK)
- Southern University of Science and Technology (CN)
- Institute of Microelectronics (CN)
- University of Chinese Academy of Sciences (CN)
- University of Hong Kong (HK)
Publication Details
- Journal
- npj Unconventional Computing
- Published
- 2024-08-21
- DOI
- https://doi.org/10.1038/s44335-024-00006-0
- Citations
- 1
- Primary Topic
- Advanced Memory and Neural Computing
- Type
- article
- Field-Weighted Citation Impact
- 0.21
Funders
- National Natural Science Foundation of China
- National Key Research and Development Program of China