Revolutionizing Point Cloud Classification with Multiview Self-Supervised Learning

Self-supervised models are shaping the future of point cloud processing by minimizing reliance on labeled data and addressing the challenges associated with point cloud annotation. Traditional self-supervised point cloud models often employ mask reconstruction, which involves globally dividing patches. This approach can lead to increased computational costs and insufficient consideration of global features. In this paper, we introduce MVMAE, a multiview-based self-supervised model designed for point cloud processing. MVMAE firstly converts point clouds into multiview images through rendering. It then integrates views from various angles as inputs to a mask self-encoder, where each view is treated as a distinct patch. This method provides a more comprehensive perspective for feature learning, enhancing point cloud classification performance. Experiments conducted on datasets like ModelNet40 demonstrate that MVMAE achieves a classification accuracy of 90.1% and offers improved processing speed while managing computational complexity and parameter count. The code for MVMAE is available at https://github.com/NWUzhouwei/MVMAE.

Authors

Institutions

Publication Details

Published
2024-10-28
DOI
https://doi.org/10.1109/icsp62129.2024.10846141
Primary Topic
Remote Sensing and LiDAR Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Revolutionizing Point Cloud Classification with Multiview Self-Supervised Learning

Weiwei Jin, Yongxiang Yu, Qian Wang, Yunfeng She et al.
Remote Sensing and LiDAR Applications
article

Revolutionizing Point Cloud Classification with Multiview Self-Supervised Learning

Weiwei Jin, Yongxiang Yu, Qian Wang, Yunfeng She, Wei Zhou, Kunlong Liu, Caiwen Ma
article en

Abstract

Self-supervised models are shaping the future of point cloud processing by minimizing reliance on labeled data and addressing the challenges associated with point cloud annotation. Traditional self-supervised point cloud models often employ mask reconstruction, which involves globally dividing patches. This approach can lead to increased computational costs and insufficient consideration of global features. In this paper, we introduce MVMAE, a multiview-based self-supervised model designed for point cloud processing. MVMAE firstly converts point clouds into multiview images through rendering. It then integrates views from various angles as inputs to a mask self-encoder, where each view is treated as a distinct patch. This method provides a more comprehensive perspective for feature learning, enhancing point cloud classification performance. Experiments conducted on datasets like ModelNet40 demonstrate that MVMAE achieves a classification accuracy of 90.1% and offers improved processing speed while managing computational complexity and parameter count. The code for MVMAE is available at https://github.com/NWUzhouwei/MVMAE.

East China Jiaotong University (CN), Northwest University (CN), Xi'an Institute of Optics and Precision Mechanics (CN)
Ministry of Education, China Postdoctoral Science Foundation
Climate action
Openalex Percentile: Top 77%
Remote Sensing and LiDAR Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Revolutionizing Point Cloud Classification with Multiview Self-Supervised Learning — Weiwei Jin, Yongxiang Yu, et al. · (2024) | TGRS Research Map | TGRS