MMPW-Net: Detection of Tiny Objects in Aerial Imagery Using Mixed Minimum Point-Wasserstein Distance
The detection of distant tiny objects in aerial imagery plays a pivotal role in early warning, localization, and recognition tasks. However, due to the scarcity of appearance information, minimal pixel representation, susceptibility to blending with the background, and the incompatibility of conventional metrics, the rapid and accurate detection of tiny objects poses significant challenges. To address these issues, a single-stage tiny object detector tailored for aerial imagery is proposed, comprising two primary components. Firstly, we introduce a light backbone-heavy neck architecture, named the Global Context Self-Attention and Dense Nested Connection Feature Extraction Network (GC-DN Network), which efficiently extracts and fuses multi-scale features of the target. Secondly, we propose a novel metric, MMPW, to replace the Intersection over Union (IoU) in label assignment strategies, Non-Maximum Suppression (NMS), and regression loss functions. Specifically, MMPW models bounding boxes as 2D Gaussian distributions and utilizes the Mixed Minimum Point-Wasserstein Distance to quantify the similarity between boxes. Experiments conducted on the latest aerial image tiny object datasets, AI-TOD and VisDrone-19, demonstrate that our method improves AP50 performance by 9.4% and 5%, respectively, and AP performance by 4.3% and 3.6%. This validates the efficacy of our approach for detecting tiny objects in aerial imagery.
Authors
- Wanxuan Lu (ORCID: https://orcid.org/0000-0003-4612-508X)
- Nan Su (ORCID: https://orcid.org/0000-0001-9601-536X)
- Chunhui Zhao (ORCID: https://orcid.org/0000-0002-0254-5763)
- Yiming Yan (ORCID: https://orcid.org/0000-0003-0751-7726)
- Jinpeng Wang (ORCID: https://orcid.org/0000-0002-7636-0374)
- Shou Feng (ORCID: https://orcid.org/0000-0002-7308-9590)
- Zilong Zhao (ORCID: https://orcid.org/0000-0003-4788-3106)
- Hongbo Cui
- Yunfei Qu
Institutions
- Harbin Engineering University (CN)
- Chinese Academy of Sciences (CN)
- Harbin University of Commerce (CN)
- Aerospace Information Research Institute (CN)
Publication Details
- Journal
- Remote Sensing
- Published
- 2024-11-29
- DOI
- https://doi.org/10.3390/rs16234485
- Citations
- 7
- Primary Topic
- Advanced Image and Video Retrieval Techniques
- Type
- article
- Field-Weighted Citation Impact
- 1.74