Semantic-Guided Cross-Modal Feature Alignment for Cross-Domain Few-Shot Hyperspectral Image Classification
When facing the challenge of limited samples, existing hyperspectral image (HSI) classification methods typically assume that source domain samples (with prior knowledge) and target task samples share identical data distributions. However, real-world applications frequently encounter cross-domain scenarios where HSIs acquired from distinct environments exhibit significant distribution discrepancies. This domain shift phenomenon severely degrades the performance of models trained on source domains when deployed in target domains. To deal with this problem, this paper presents a semantic-guided cross-domain HSI classification method, namely Semantic-Guided Cross-Modal Feature Alignment (SG-CMFA). Our architecture employs a dualchannel spatial-spectral Mamba module to hierarchically extract discriminative spatial and spectral features from HSIs, enhancing feature representation capacity. Simultaneously, we integrate a BERT-based semantic encoder to distill label-specific textual semantics, which are subsequently fused with visual features to generate semantic-enhanced class prototypes. This cross-modal alignment strategy effectively mitigates domain shift by establishing semantic consistency between source and target domains. Comprehensive evaluations across three benchmark HSI datasets validate that our approach outperforms some state-of-the-art approaches in few-shot HSI classification scenarios.
Authors
- J. Y. Shi (ORCID: https://orcid.org/0009-0003-8317-5622)
- Yuan Liu (ORCID: https://orcid.org/0000-0002-2578-0707)
- Yi Wen (ORCID: https://orcid.org/0000-0002-0829-1995)
- Xiaochen Lu (ORCID: https://orcid.org/0000-0003-1745-4992)
Institutions
- Donghua University (CN)
Publication Details
- Published
- 2025-05-23
- DOI
- https://doi.org/10.1109/cvidl65390.2025.11085853
- Citations
- 2
- Primary Topic
- Remote-Sensing Image Classification
- Type
- article
- Field-Weighted Citation Impact
- 2.27