LSCF: Long-Term Semantic-Guidance ConvFormer for Referring Remote Sensing Image Segmentation
Referring Remote Sensing Image Segmentation (RRSIS) task aims to generate segmentation masks for target objects based on language descriptions. It requires precise localization while distinguishing between visually similar yet semantically distinct objects. Fusing vision-language features only during extraction causes information loss and semantic forgetting in the decoder, harming similar target distinction. Additionally, high-resolution remote sensing images present challenges, including complex backgrounds, diverse object scales, and intricate boundaries, limiting the effectiveness of previous methods. To address these issues, we propose the Long-term Semantic-guidance ConvFormer (LSCF) Network. First, we fuse multi-receptive-field local features extracted by the Multi-scale CoordConv (MCC) module with language-aware global features from the Cross-modal Attention (CA) module to obtain multi-modal representations. Second, the Sampling Attention (SA) module enables fine-grained vision context alignment under semantic guidance. Finally, the Global Language Fusion (GLF) module is incorporated in the decoder to maintain long-term vision-language alignment and mitigate semantic degradation. Experimental validation on the RefSegRS, RRSIS-D, and RISBench datasets demonstrates that LSCF achieves oIoU scores of 83.27%, 77.42%, and 74.88%, and mIoU scores of 77.44%, 64.25%, and 68.53%, respectively. On RefSegRS, LSCF surpasses the SOTA method FIANet by 5.53% (oIoU) and 9.58% (mIoU), while delivering competitive performance on RRSIS-D and RISBench. Code and experimental configurations will be released.
Authors
- Licheng Jiao (ORCID: https://orcid.org/0000-0003-3354-9617)
- Xiaoqiang Lu (ORCID: https://orcid.org/0000-0003-0338-7645)
- Wenping Ma (ORCID: https://orcid.org/0000-0001-8872-2195)
- Xu Liu (ORCID: https://orcid.org/0000-0002-8780-5455)
- Lingling Li (ORCID: https://orcid.org/0000-0002-6130-2518)
- Fang Liu (ORCID: https://orcid.org/0000-0002-5669-9354)
- Long Sun (ORCID: https://orcid.org/0000-0001-7446-9336)
- Qin Ma
Institutions
- Xidian University (CN)
Publication Details
- Journal
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tgrs.2025.3578515
- Citations
- 2
- Primary Topic
- Advanced Image and Video Retrieval Techniques
- Type
- article
- Field-Weighted Citation Impact
- 2.55
Funders
- National Natural Science Foundation of China
- Higher Education Discipline Innovation Project