Bridging HSI and LiDAR Data With Frequency-Domain Hierarchical Fusion for Enhanced Classification
Remote sensing data from hyperspectral imaging (HSI) and LiDAR provide complementary perspectives for terrain and object analysis. However, existing methods for multimodal data fusion primarily focus on spatial-domain feature alignment, often overlooking the potential of frequency-domain information to enhance classification accuracy. To bridge this gap, we introduce the Frequency-Domain Hierarchical Perception Fusion Network (FHPF-Net), a novel framework for precise classification of remote sensing images. This network leverages both spatial and frequency-domain information, and provides a new perspective for heterogeneous data integration. To extract and utilize frequency-domain features, we propose the HighLow Spectral Separation and Mining (HLSSM) module, which isolates high-frequency details such as edges and textures from low-frequency structural patterns in HSI and LiDAR data. This separation facilitates targeted feature extraction while preserving crucial contextual information. Additionally, we introduce the Hierarchical Superimposed Multi-domain Information Fusion (HSMIF) module, which employs a multi-level fusion strategy to integrate spatial and frequency-domain features, ensuring consistency and complementarity between the two data sources. Finally, we introduce a Learnable Voting Pre-label Fusion (LVPF) strategy to effectively integrate multi-branch outputs, enhancing classification performance and model robustness. The proposed FHPF-Net effectively captures diverse responses across heterogeneous data types, enabling robust classification in complex environments. Extensive experiments demonstrate that our approach significantly outperforms state-of-the-art methods.
Authors
- Fanda Fan (ORCID: https://orcid.org/0000-0002-5214-0959)
- Luqi Gong (ORCID: https://orcid.org/0009-0000-8744-8630)
- Chao Li (ORCID: https://orcid.org/0000-0002-6304-8824)
- Yuxiang Li (ORCID: https://orcid.org/0009-0002-1170-8189)
- Shuai Zhao (ORCID: https://orcid.org/0000-0002-5217-004X)
- Yue Chen (ORCID: https://orcid.org/0000-0002-1011-2781)
- Rui Bai (ORCID: https://orcid.org/0000-0002-0937-248X)
Institutions
- Beijing University of Posts and Telecommunications (CN)
- Chinese Academy of Sciences (CN)
- Institute of Computing Technology (CN)
- Zhejiang Lab (CN)
- Changsha University of Science and Technology (CN)
- Beihang University (CN)
Publication Details
- Journal
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tgrs.2025.3589080
- Citations
- 3
- Primary Topic
- Remote Sensing and LiDAR Applications
- Type
- article
- Field-Weighted Citation Impact
- 2.40
Funders
- National Natural Science Foundation of China
- National Key Research and Development Program of China