Revolutionizing Point Cloud Classification with Multiview Self-Supervised Learning
Self-supervised models are shaping the future of point cloud processing by minimizing reliance on labeled data and addressing the challenges associated with point cloud annotation. Traditional self-supervised point cloud models often employ mask reconstruction, which involves globally dividing patches. This approach can lead to increased computational costs and insufficient consideration of global features. In this paper, we introduce MVMAE, a multiview-based self-supervised model designed for point cloud processing. MVMAE firstly converts point clouds into multiview images through rendering. It then integrates views from various angles as inputs to a mask self-encoder, where each view is treated as a distinct patch. This method provides a more comprehensive perspective for feature learning, enhancing point cloud classification performance. Experiments conducted on datasets like ModelNet40 demonstrate that MVMAE achieves a classification accuracy of 90.1% and offers improved processing speed while managing computational complexity and parameter count. The code for MVMAE is available at https://github.com/NWUzhouwei/MVMAE.
Authors
- Weiwei Jin (ORCID: https://orcid.org/0000-0002-0919-2470)
- Yongxiang Yu (ORCID: https://orcid.org/0000-0002-1784-9479)
- Qian Wang (ORCID: https://orcid.org/0000-0003-3175-334X)
- Yunfeng She
- Wei Zhou (ORCID: https://orcid.org/0009-0006-3754-8872)
- Kunlong Liu (ORCID: https://orcid.org/0000-0002-2872-5850)
- Caiwen Ma
Institutions
- East China Jiaotong University (CN)
- Northwest University (CN)
- Xi'an Institute of Optics and Precision Mechanics (CN)
Publication Details
- Published
- 2024-10-28
- DOI
- https://doi.org/10.1109/icsp62129.2024.10846141
- Primary Topic
- Remote Sensing and LiDAR Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Ministry of Education
- China Postdoctoral Science Foundation