Robust incomplete multi-modal clustering with interpolation enhancement and dual-path contrastive optimization
Incomplete multi-modal clustering (IMC) has emerged as a critical challenge in the context of real-world sensing systems, where missing modalities frequently occur due to sensor failure, occlusion, or transmission loss. This paper proposes a novel dual-path clustering framework to address the limitations of existing IMC methods, which either suffer from over-reliance on reconstruction or lack adaptability to varying missing patterns. Specifically, the proposed approach dynamically selects an optimization pathway based on the global missing rate: a contrastive alignment strategy for low missing rates and a gated interpolation-enhanced module for high missing scenarios. To ensure robust representation, the model introduces residual gating to mitigate interpolation noise, and employs dual-level contrastive learning across features and soft cluster assignments to maintain semantic consistency. A self-refining pseudo-label optimization mechanism further guides the training process to convergence. Extensive experiments conducted on three public multi-modal datasets demonstrate that our method achieves competitive or superior clustering performance under various missing rates, while significantly reducing memory consumption and training time compared to state-of-the-art baselines. These findings suggest that the proposed method is well-suited for deployment in edge-intelligent systems and other resource-constrained environments.
Authors
- Qingya Wang (ORCID: https://orcid.org/0000-0001-5636-8785)
- Xixi Zheng (ORCID: https://orcid.org/0009-0005-3898-2534)
- Jiawen Zheng (ORCID: https://orcid.org/0009-0005-8685-6102)
- Bing Han (ORCID: https://orcid.org/0000-0002-6319-6755)
- Jiayi Xu (ORCID: https://orcid.org/0000-0002-9868-2913)
- Baokun Zheng (ORCID: https://orcid.org/0000-0003-3333-9281)
Institutions
- Beijing Institute of Technology (CN)
- China University of Political Science and Law (CN)
- Beijing Electronic Science and Technology Institute (CN)
- China National Institute of Standardization (CN)
- Université de Montréal (CA)
Publication Details
- Journal
- Journal on Wireless Communications and Networking
- Published
- 2025-12-17
- DOI
- https://doi.org/10.1186/s13638-025-02546-w
- Primary Topic
- Advanced Neural Network Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00