Frequency and Prompt Learning Cooperation Enhanced Mamba for Remote Sensing Semantic Segmentation
Very high-resolution remote sensing images is a key data source for space–air–ground collaborative monitoring, supplying fine-grained spatial information crucial to urban management, disaster response and ecological assessment. Reliable extraction of roads, buildings and vegetation therefore hinges on accurate semantic segmentation. Recently, the Mamba state-space model has been widely adopted for remotesensing semantic segmentation, markedly improving the globalcontext modelling capacity of existing approaches; nevertheless, the severe inter-class pixel imbalance among categories persists, continuing to hamper segmentation performance. To mitigate this issue, we present FPMamba, a hybrid network that couples frequency-domain cues with prompt learning to emphasize rare classes and suppress background clutter. On the frequency side, a Frequency Channel–Spatial Attention Module (FCSAM) is inserted into each VSS block to fuse spatial features with a frequency branch that captures high-frequency details, markedly sharpening edge and texture representations. A Frequency Fusion Attention Module (FFAM) is further deployed on every skip connection to adaptively reconcile highlevel semantics with low-level details. On the prompt side, we design a lightweight Prompt Text-Guided Strategy (PTGS) that aligns category prompts with image patches via Contrastive Language–Image Pre-training (CLIP), producing CLIP-guided attention mapsthat guide the network towards long-tail targets. PTGS and FCSAM are jointly embedded into a dual-enhanced VSS block, completing the FPMamba architecture. Comprehensive tests on the ISPRS benchmarks demonstrate that FPMamba reaches an overall accuracy of 88.97% and a MIoU of 75.61% on the Vaihingen dataset, while achieving 87.53% overall accuracy and 75.41% MIoU on the Potsdam dataset, outperforming current state-of-the-art methods. These results corroborate the effectiveness and transferability of integrating frequency-domain information with prompt learning for remote-sensing semantic segmentation. Code will be publicly released upon publication.
Authors
- Kang Zheng (ORCID: https://orcid.org/0000-0002-4811-0001)
- Zunyi Xie (ORCID: https://orcid.org/0000-0002-4327-420X)
- Lianqi Zhu
- Shuai Bao
- Yongze Song (ORCID: https://orcid.org/0000-0003-3420-9622)
- Minmin Yu
- Ziwu Pan (ORCID: https://orcid.org/0000-0002-0698-5651)
- Zhifei Liu (ORCID: https://orcid.org/0009-0009-4707-9346)
Institutions
- Curtin University (AU)
- Henan University of Engineering (CN)
- Chinese Academy of Surveying and Mapping (CN)
- Technical University of Munich (DE)
Publication Details
- Journal
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Published
- 2025-09-09
- DOI
- https://doi.org/10.1109/jstars.2025.3607777
- Primary Topic
- Remote-Sensing Image Classification
- Type
- article
- Field-Weighted Citation Impact
- 0.00