Cross-Modal Driven Object Restoration for 3D Point Cloud Backdoor Defense
3D point cloud recognition plays a critical role in autonomous driving, robotics, and medical diagnostics. However, its vulnerability to backdoor attacks remains underexplored, posing significant security risks in real-world applications. Current defense mechanisms against 3D point cloud backdoor attacks are still in their infancy and lacking effective solutions. To address this, we propose a cross-modal driven object restoration framework that leverages 3D reconstruction to mitigate backdoor attacks. Specifically, we introduce a cross-modal semantic encoding module that projects 3D point clouds into multi-view depth maps and utilizes CLIP to extract aligned text-image features, providing semantic guidance for 3D reconstruction. Furthermore, we leverage cross-modal information as conditional guidance to drive dynamic diffusion-based 3D reconstruction and adaptively fuse semantic and geometric features through a gated self-conditioned modulator. This module dynamically selects features for fusion, effectively mitigating noise interference and distribution shifts during latent diffusion, significantly enhancing robustness to noise, and thereby achieving precise restoration of clean point clouds. Extensive experiments on ModelNet40, and ShapeNetPart datasets demonstrate that our method robustly defends against adaptive attacks under varying noise levels and significantly restores classification performance degraded by backdoor triggers.
Authors
- Jiawei Lian
- Le Hui
- Jian Yang (ORCID: https://orcid.org/0000-0003-4800-832X)
- Jianghua Liu (ORCID: https://orcid.org/0000-0002-1199-1132)
Institutions
- Northwestern Polytechnical University (CN)
- Nanjing University of Science and Technology (CN)
- Xiamen University of Technology (CN)
- Ministry of Industry and Information Technology (CN)
- Defense Acquisition University (US)
Publication Details
- Journal
- IEEE Transactions on Information Forensics and Security
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tifs.2025.3615416
- Primary Topic
- Advanced Optical Sensing Technologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00