FAME: Fusion of Alignment and Multiview Enhancement for Remote Sensing Image–Text Retrieval

Contemporary advancements in Earth observation technologies have generated substantial data resources for remote sensing image retrieval applications. However, existing models exhibit limitations in extracting local features from image-text pairs and establishing effective connections between local and global information. Furthermore, these models lack fine-grained alignment capabilities between different modalities. To address these challenges, we propose FAME, which integrates four key components: a Progressive Masking (ProgMask) module, an OmniView Fusion (OVF) module, a Global Feature Attention with Multi-view Feature Alignment (GFA-MFA) module, and Regional Clustering Alignment Loss (RCA-Loss). The ProgMask module employs a progressive training strategy with alternating masking of image and text modalities to enhance cross-modal learning robustness. The OVF module employs omni-view attention mechanisms with adaptive weighting to dynamically focus on different local semantic regions of remote sensing images and corresponding textual descriptions. The GFA-MFA module enhances global feature capture through selective filtering while ensuring precise multi-view feature alignment. These modules work synergistically to achieve fine-grained alignment between multi-scale local and global features across modalities. Additionally, RCA-Loss optimizes intra-class feature clustering while minimizing inter-class confusion through class center distance optimization and enhanced feature discrimination. Experimental validation on three benchmark datasets (RSITMD, RSICD, UCM-Captions) demonstrates that FAME achieves superior performance compared to existing state-of-the-art methods in remote sensing image-text retrieval tasks.