Point Patches Contrastive Learning for Enhanced Point Cloud Completion
In partial-to-complete point cloud completion, it is imperative that enabling every patch in the output point cloud faithfully represents the corresponding patch in partial input, ensuring similarity in terms of geometric content. To achieve this objective, we propose a straightforward method dubbed PPCL that aims to maximize the mutual information between two point patches from the encoder and decoder by leveraging a contrastive learning framework. Contrastive learning facilitates the mapping of two similar point patches to corresponding points in a learned feature space. Notably, we explore multi-layer point patches contrastive learning (MPPCL) instead of operating on the whole point cloud. The negatives are exploited within the input point cloud itself rather than the rest of the datasets. To fully leverage the local geometries present in the partial inputs and enhance the quality of point patches in the encoder, we introduce Multi-level Feature Learning (MFL) and Hierarchical Feature Fusion (HFF) modules. These modules are also able to facilitate the learning of various levels of features. Moreover, Spatial-Channel Transformer Point Up-sampling (SCT) is devised to guide the decoder to construct a complete and fine-grained point cloud by leveraging enhanced point patches from our point patches contrastive learning. Extensive experiments demonstrate that our PPCL can achieve better quantitive and qualitative performance over off-the-shelf methods across various datasets.
Authors
- Lipeng Ma (ORCID: https://orcid.org/0000-0001-5974-5988)
- Wen‐Ming Chen (ORCID: https://orcid.org/0000-0003-0409-5118)
- T. Luo (ORCID: https://orcid.org/0000-0002-0969-1173)
- Ben Fei (ORCID: https://orcid.org/0000-0002-3219-9996)
- Liwen Liu (ORCID: https://orcid.org/0000-0003-1867-3046)
- Zhijun Li (ORCID: https://orcid.org/0000-0002-3909-488X)
- Weidong Yang (ORCID: https://orcid.org/0000-0002-6473-9272)
Institutions
- Tongji University (CN)
- Fudan University (CN)
Publication Details
- Journal
- IEEE Transactions on Multimedia
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tmm.2024.3521854
- Citations
- 5
- Primary Topic
- 3D Shape Modeling and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 6.67
Funders
- National Natural Science Foundation of China