Transformer-Driven Active Transfer Learning for Cross-Hyperspectral Image Classification
Hyperspectral image (HSI) classification presents inherent challenges due to high spectral dimensionality, significant domain shifts, and limited availability of labeled data. To address these issues, we propose a novel Active Transfer Learning (ATL) framework built upon a Spatial-Spectral Transformer (SST) backbone. The framework integrates multistage transfer learning with an uncertainty-diversity-driven active learning mechanism that strategically selects highly informative and diverse samples for annotation, thereby significantly reducing labeling costs and mitigating sample redundancy. A dynamic layer freezing strategy is introduced to enhance transferability and computational efficiency, enabling selective adaptation of model layers based on domain shift characteristics. Furthermore, we incorporate a self-calibrated attention mechanism that dynamically refines spatial and spectral weights during adaptation, guided by uncertainty-aware feedback. A diversity-promoting sampling strategy ensures broad spectral coverage among selected samples, preventing overfitting to specific classes. Extensive experiments on benchmark cross-domain HSI datasets demonstrate that the proposed SST-ATL framework achieves superior classification performance compared to conventional approaches.
Authors
- Salvatore Distefano (ORCID: https://orcid.org/0000-0002-2752-626X)
- Rana Aamir Raza
- Muhammad Ahmad (ORCID: https://orcid.org/0000-0002-3320-2261)
- Silvia Liberata Ullo (ORCID: https://orcid.org/0000-0001-6294-0581)
- Adil Khan (ORCID: https://orcid.org/0000-0003-2220-8518)
- Manuel Mazzara (ORCID: https://orcid.org/0000-0002-3860-4948)
- F. Mauro (ORCID: https://orcid.org/0000-0003-2968-3792)
Institutions
- University of Messina (IT)
- Bahauddin Zakariya University (PK)
- King Fahd University of Petroleum and Minerals (SA)
- University of Sannio (IT)
- University of Hull (GB)
- Innopolis University (RU)
Publication Details
- Journal
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/jstars.2025.3594108
- Citations
- 4
- Primary Topic
- Neural Networks and Applications
- Type
- article
- Field-Weighted Citation Impact
- 9.92