Selective Prototype Aggregation for Remote Sensing Few-Shot Semantic Segmentation

Few-shot semantic segmentation (FSS) in remote sensing imagery remains challenging due to complex scenes, large image sizes, frequent multi-class coexistence, and significant intra-class variation. These factors often lead to severe overfitting to base classes and hinder generalization to novel classes. To address these issues, we propose a Mamba-Enhanced Transformer framework with Selective Prototype Aggregation (SPA), which simultaneously suppresses base-class interference and enhances novel-class representation. Specifically, the Dynamic Feature Aggregation (DFA) module integrates features from a base-class learner and a meta-learner, effectively enhancing inter-class distinction and mitigating feature contamination in multi-class coexistence scenarios. We further introduce the Mamba-Enhanced Transformer (MET), which combines Mamba blocks and Transformer self-attention to capture long-range dependencies and multi-scale context while maintaining low computational complexity. Mamba blocks independently extract support and query features, preventing cross-branch interference and improving robustness. By selectively aggregating support prototypes with query self-support prototypes, SPA strengthens feature discriminability and leverages query-specific contextual cues to reduce intra-class variance. Our model demonstrates strong performance across multiple datasets, achieves 50.49% mIoU on the iSAID dataset and 30.82% on the LoveDA dataset, representing improvements of 3.95% and 3.89%, respectively, over the Base model. Ablation experiments further validate the superior performance of SPA.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Geoscience and Remote Sensing
Published
2025-01-01
DOI
https://doi.org/10.1109/tgrs.2025.3612893
Citations
1
Primary Topic
Advanced Image and Video Retrieval Techniques
Type
article
Field-Weighted Citation Impact
1.28
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Selective Prototype Aggregation for Remote Sensing Few-Shot Semantic Segmentation

Sidong Liu, Kun Liu, Menghan Li
1 citations
IEEE Transactions on Geoscience and Remote Sensing
Advanced Image and Video Retrieval Techniques
1.28
article

Selective Prototype Aggregation for Remote Sensing Few-Shot Semantic Segmentation

Sidong Liu, Kun Liu, Menghan Li
article en
1 citations

Abstract

Few-shot semantic segmentation (FSS) in remote sensing imagery remains challenging due to complex scenes, large image sizes, frequent multi-class coexistence, and significant intra-class variation. These factors often lead to severe overfitting to base classes and hinder generalization to novel classes. To address these issues, we propose a Mamba-Enhanced Transformer framework with Selective Prototype Aggregation (SPA), which simultaneously suppresses base-class interference and enhances novel-class representation. Specifically, the Dynamic Feature Aggregation (DFA) module integrates features from a base-class learner and a meta-learner, effectively enhancing inter-class distinction and mitigating feature contamination in multi-class coexistence scenarios. We further introduce the Mamba-Enhanced Transformer (MET), which combines Mamba blocks and Transformer self-attention to capture long-range dependencies and multi-scale context while maintaining low computational complexity. Mamba blocks independently extract support and query features, preventing cross-branch interference and improving robustness. By selectively aggregating support prototypes with query self-support prototypes, SPA strengthens feature discriminability and leverages query-specific contextual cues to reduce intra-class variance. Our model demonstrates strong performance across multiple datasets, achieves 50.49% mIoU on the iSAID dataset and 30.82% on the LoveDA dataset, representing improvements of 3.95% and 3.89%, respectively, over the Base model. Ablation experiments further validate the superior performance of SPA.

IEEE Transactions on Geoscience and Remote SensingVol. 63
Australian Institute of Health and Welfare (AU), Australian Hearing (AU), Shanghai Maritime University (CN)
Openalex Percentile: Top 16%
Advanced Image and Video Retrieval Techniques
1.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Selective Prototype Aggregation for Remote Sensing Few-Shot Semantic Segmentation — Sidong Liu, Kun Liu, et al. · IEEE Transactions on Geoscience and Remote Sensing (2025) | TGRS Research Map | TGRS