HPMF: Hypergraph-Guided Prototype Mining Framework for Few-Shot Object Detection in Remote Sensing Images
Few-shot object detection (FSOD) within remote sensing imagery has achieved great advancements in recent years. However, most existing methods are facing one key challenge while handling remote sensing images: many unlabeled instances in few-shot images are treated as background, which tends to degrade the generalization of the trained model severely. This paper presents HPMF, a Hypergraph-guided Prototype Mining Framework that addresses the challenge through joint optimization from three perspectives. The first is Hierarchical Reference Mining (HRM) which constructs a class-instance dual-driven prototype space that enables mining the unlabeled instances via cross-hierarchical similarity fusion. The second is a Robust Pseudo-box Estimator (RPE) that generates high-quality pseudo bounding boxes for the HRM-mined instances via adaptive density clustering and multi-statistic aggregation. The third is a Hypergraph-Guided Decoder (HGD) that introduces hypergraphs into the transformer decoder for group semantic modeling, enhancing high-order semantic association and similarity of instance features, thereby further improving the mining performance of the HRM module. Extensive experiments under various settings show that the proposed HPMF outperforms state-of-the-art methods consistently across multiple widely adopted remote-sensing FSOD benchmarks such as DIOR, NWPU-VHR10 v2, and HRRSD.
Authors
- Amirkhan Temirbayev (ORCID: https://orcid.org/0000-0001-6759-2774)
- Shijian Lu (ORCID: https://orcid.org/0000-0002-6766-2506)
- Qiang Shen (ORCID: https://orcid.org/0000-0001-9333-4605)
- Jiaman Ma (ORCID: https://orcid.org/0000-0002-5685-6145)
- Changjing Shang (ORCID: https://orcid.org/0000-0001-6375-6276)
- Yan Li (ORCID: https://orcid.org/0000-0001-8137-3084)
- Ying Li (ORCID: https://orcid.org/0000-0001-7370-1754)
- Mingzhe Hao
Institutions
- Aberystwyth University (GB)
- Northwestern Polytechnical University (CN)
- Nanyang Technological University (SG)
- Al-Farabi Kazakh National University (KZ)
Publication Details
- Journal
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tgrs.2025.3613849
- Citations
- 1
- Primary Topic
- Remote-Sensing Image Classification
- Type
- article
- Field-Weighted Citation Impact
- 1.14