Robust and Discriminative Visual-Semantic Alignment for Zero-Shot Remote Sensing Image Scene Classification

With the rapid development of remote sensing technology, the range of its applications, such as urban planning and environmental monitoring, has broadened considerably. However, the vast increase in remote sensing data poses challenges for training deep neural networks, primarily due to the extensive labeled datasets required. To address this issue, zero-shot learning (ZSL) emerges as a viable approach, enabling recognition of unseen categories without relying on training samples. In this paper, we introduce a Robust and Discriminative Visual-Semantic Alignment (RDVSA) model, which utilizes attribute-guided contrastive learning for enhanced performance. By incorporating category centroids into the embedding space of visual features and attribute descriptions, our model enhances the discriminative power of learned features and stabilizes the learning process, particularly in the presence of complex data distributions and noise in remote sensing images. Additionally, we employ a Vision Transformer (ViT) and a “mean-teacher" framework to capture both global context and local details, ensuring robustness in occluded or irrelevant attribute regions. Comprehensive experiments on large-scale remote sensing benchmarks reveal that our approach surpasses current state-of-the-art methods in both ZSL and generalized zero-shot learning (GZSL) scenarios. These results underscore the effectiveness of using attribute-based contrastive learning alongside consistency constraints.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Geoscience and Remote Sensing
Published
2025-01-01
DOI
https://doi.org/10.1109/tgrs.2025.3591186
Primary Topic
Remote-Sensing Image Classification
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Robust and Discriminative Visual-Semantic Alignment for Zero-Shot Remote Sensing Image Scene Classification

Jungong Han, Ling Shao, Yang Liu, Xinbo Gao et al.
IEEE Transactions on Geoscience and Remote Sensing
Remote-Sensing Image Classification
article

Robust and Discriminative Visual-Semantic Alignment for Zero-Shot Remote Sensing Image Scene Classification

Jungong Han, Ling Shao, Yang Liu, Xinbo Gao, Weixing Luo
article en

Abstract

With the rapid development of remote sensing technology, the range of its applications, such as urban planning and environmental monitoring, has broadened considerably. However, the vast increase in remote sensing data poses challenges for training deep neural networks, primarily due to the extensive labeled datasets required. To address this issue, zero-shot learning (ZSL) emerges as a viable approach, enabling recognition of unseen categories without relying on training samples. In this paper, we introduce a Robust and Discriminative Visual-Semantic Alignment (RDVSA) model, which utilizes attribute-guided contrastive learning for enhanced performance. By incorporating category centroids into the embedding space of visual features and attribute descriptions, our model enhances the discriminative power of learned features and stabilizes the learning process, particularly in the presence of complex data distributions and noise in remote sensing images. Additionally, we employ a Vision Transformer (ViT) and a “mean-teacher" framework to capture both global context and local details, ensuring robustness in occluded or irrelevant attribute regions. Comprehensive experiments on large-scale remote sensing benchmarks reveal that our approach surpasses current state-of-the-art methods in both ZSL and generalized zero-shot learning (GZSL) scenarios. These results underscore the effectiveness of using attribute-based contrastive learning alongside consistency constraints.

IEEE Transactions on Geoscience and Remote SensingVol. 63
Xidian University (CN), University of Chinese Academy of Sciences (CN), University of Sheffield (GB), Tsinghua University (CN)
National Natural Science Foundation of China
Reduced inequalities
Openalex Percentile: Top 75%
Remote-Sensing Image Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.