Divide and Conquer: Frequency-Aware Contrastive Adversarial Training for Robust Point Cloud Classification
Contrastive adversarial training has shown great potential in enhancing model robustness and has been adopted in point cloud classification. There are varying spatial distributions and densities across different regions in point cloud data, which makes adversarial perturbations always exhibit non-uniform patterns of attack intensity and distribution in different regions. However, existing approaches always rely on uniform feature contrast without considering the granularity in the context of point cloud data, limiting their capacities to counter adversarial perturbations effectively. To address this issue, we propose a novel frequency-aware contrastive adversarial training framework, which considers feature contrast via a “divide-and-conquer” method. Specifically, we systematically “<italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">divide</i>” point clouds into distinct frequency components and “<italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">conquer</i>” feature contrast within each frequency band, which fosters fine-grained feature consistency learning and leads to more informative as well as robust representations. Besides, existing methods typically apply group-level contrastive learning, which emphasizes category-wise similarity but often overlooks the nuanced structural variations among instances. To remedy this, we incorporate instance-level contrastive learning to capture per-instance geometric variations. Moreover, a frequency-specific hard-masked sample generation module is designed to construct challenging sample pairs by masking keypoint features in each frequency band, thereby promoting the model to learn more robust feature representations. Extensive experiments on multiple benchmark datasets demonstrate that our proposed method significantly outperforms existing state-of-the-art approaches in adversarial robustness for point cloud classification. The code is available on DiCon-FAT.
Authors
- Yu-Xin Zhang
- James T. Kwok (ORCID: https://orcid.org/0000-0002-4828-8248)
- Yu Cao (ORCID: https://orcid.org/0000-0003-1409-2068)
- Minjing Dong (ORCID: https://orcid.org/0009-0003-1717-818X)
- Yuan Yan Tang (ORCID: https://orcid.org/0000-0002-6887-130X)
- Xin Gong (ORCID: https://orcid.org/0000-0001-6883-5088)
- Xiaofeng Cong (ORCID: https://orcid.org/0000-0001-8850-3507)
- Jie Gui (ORCID: https://orcid.org/0000-0002-9450-1759)
Institutions
- City University of Hong Kong (HK)
- Hong Kong University of Science and Technology (HK)
- University of Macau (MO)
- Southeast University (CN)
Publication Details
- Journal
- IEEE Transactions on Information Forensics and Security
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tifs.2025.3583876
- Citations
- 2
- Primary Topic
- 3D Shape Modeling and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 2.67
Funders
- National Natural Science Foundation of China
- Startup Research Fund of Zhengzhou University