Semantic-Guided Cross-Modal Feature Alignment for Cross-Domain Few-Shot Hyperspectral Image Classification

When facing the challenge of limited samples, existing hyperspectral image (HSI) classification methods typically assume that source domain samples (with prior knowledge) and target task samples share identical data distributions. However, real-world applications frequently encounter cross-domain scenarios where HSIs acquired from distinct environments exhibit significant distribution discrepancies. This domain shift phenomenon severely degrades the performance of models trained on source domains when deployed in target domains. To deal with this problem, this paper presents a semantic-guided cross-domain HSI classification method, namely Semantic-Guided Cross-Modal Feature Alignment (SG-CMFA). Our architecture employs a dualchannel spatial-spectral Mamba module to hierarchically extract discriminative spatial and spectral features from HSIs, enhancing feature representation capacity. Simultaneously, we integrate a BERT-based semantic encoder to distill label-specific textual semantics, which are subsequently fused with visual features to generate semantic-enhanced class prototypes. This cross-modal alignment strategy effectively mitigates domain shift by establishing semantic consistency between source and target domains. Comprehensive evaluations across three benchmark HSI datasets validate that our approach outperforms some state-of-the-art approaches in few-shot HSI classification scenarios.

Authors

Institutions

Publication Details

Published
2025-05-23
DOI
https://doi.org/10.1109/cvidl65390.2025.11085853
Citations
2
Primary Topic
Remote-Sensing Image Classification
Type
article
Field-Weighted Citation Impact
2.27
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Semantic-Guided Cross-Modal Feature Alignment for Cross-Domain Few-Shot Hyperspectral Image Classification

J. Y. Shi, Yuan Liu, Yi Wen, Xiaochen Lu
2 citations
Remote-Sensing Image Classification
2.27
article

Semantic-Guided Cross-Modal Feature Alignment for Cross-Domain Few-Shot Hyperspectral Image Classification

J. Y. Shi, Yuan Liu, Yi Wen, Xiaochen Lu
article en
2 citations

Abstract

When facing the challenge of limited samples, existing hyperspectral image (HSI) classification methods typically assume that source domain samples (with prior knowledge) and target task samples share identical data distributions. However, real-world applications frequently encounter cross-domain scenarios where HSIs acquired from distinct environments exhibit significant distribution discrepancies. This domain shift phenomenon severely degrades the performance of models trained on source domains when deployed in target domains. To deal with this problem, this paper presents a semantic-guided cross-domain HSI classification method, namely Semantic-Guided Cross-Modal Feature Alignment (SG-CMFA). Our architecture employs a dualchannel spatial-spectral Mamba module to hierarchically extract discriminative spatial and spectral features from HSIs, enhancing feature representation capacity. Simultaneously, we integrate a BERT-based semantic encoder to distill label-specific textual semantics, which are subsequently fused with visual features to generate semantic-enhanced class prototypes. This cross-modal alignment strategy effectively mitigates domain shift by establishing semantic consistency between source and target domains. Comprehensive evaluations across three benchmark HSI datasets validate that our approach outperforms some state-of-the-art approaches in few-shot HSI classification scenarios.

Donghua University (CN)
Openalex Percentile: Top 10%
Remote-Sensing Image Classification
2.27
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.