Robust and Discriminative Visual-Semantic Alignment for Zero-Shot Remote Sensing Image Scene Classification
With the rapid development of remote sensing technology, the range of its applications, such as urban planning and environmental monitoring, has broadened considerably. However, the vast increase in remote sensing data poses challenges for training deep neural networks, primarily due to the extensive labeled datasets required. To address this issue, zero-shot learning (ZSL) emerges as a viable approach, enabling recognition of unseen categories without relying on training samples. In this paper, we introduce a Robust and Discriminative Visual-Semantic Alignment (RDVSA) model, which utilizes attribute-guided contrastive learning for enhanced performance. By incorporating category centroids into the embedding space of visual features and attribute descriptions, our model enhances the discriminative power of learned features and stabilizes the learning process, particularly in the presence of complex data distributions and noise in remote sensing images. Additionally, we employ a Vision Transformer (ViT) and a “mean-teacher" framework to capture both global context and local details, ensuring robustness in occluded or irrelevant attribute regions. Comprehensive experiments on large-scale remote sensing benchmarks reveal that our approach surpasses current state-of-the-art methods in both ZSL and generalized zero-shot learning (GZSL) scenarios. These results underscore the effectiveness of using attribute-based contrastive learning alongside consistency constraints.
Authors
- Jungong Han (ORCID: https://orcid.org/0000-0003-4361-956X)
- Ling Shao (ORCID: https://orcid.org/0000-0002-8264-6117)
- Yang Liu (ORCID: https://orcid.org/0000-0001-5917-8653)
- Xinbo Gao (ORCID: https://orcid.org/0000-0003-1443-0776)
- Weixing Luo
Institutions
- Xidian University (CN)
- University of Chinese Academy of Sciences (CN)
- University of Sheffield (GB)
- Tsinghua University (CN)
Publication Details
- Journal
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tgrs.2025.3591186
- Primary Topic
- Remote-Sensing Image Classification
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China