Detection of Micro-UAVs in Cluttered Multispectral Scenes Through Attention-Driven Cross-Modal Fusion

To address the critical challenge of insufficient detection accuracy for micro-unmanned aerial vehicles (UAVs) which relying solely on visible-light images cannot achieve effective detection under large-scale complex scenarios with diverse backgrounds, this study pioneers a paradigm shift. We present Kilo-UAV, the first multi-spectral micro-UAV detection dataset specifically designed for kilometer-range imaging, comprising 21,940 synchronously acquired multi-spectral remote sensing observations (visible-light, near-infrared, polarized imagery, and atmospheric attenuation-corrected data). The dataset focuses on UAV targets characterized by sub-meter dimensions and minimal pixel occupancy (average pixel area ratio<0.7%), systematically encompassing 10 types, including urban built-up areas, coastal zones, and montane forests. To resolve the critical bottleneck of multi-source remote sensing data fusion, we propose the Weight-Adaptive Decision Fusion Network for Remote Sensing (ADF-RS). This architecture integrates an anomaly-modality sensitivity assessment module to dynamically optimize sensor-specific contribution weights, thereby enabling spatially coordinated representation of multi-spectral features. Experimental validation demonstrates that ADF-RS achieves state-of-the-art performance with an 86.57% detection accuracy (<italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">mAP</i><sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">50</sub>) on the test set, outperforming conventional visible-light-based approaches by a 23-percentage-point margin, while maintaining real-time processing efficiency (57 FPS on NVIDIA RTX3090 hardware). We further propose a lightweight computational framework optimized for edge computing devices, offering an embeddable solution for UAV airspace regulation within existing remote sensing infrastructures. The dataset’s inclusion of multi-scale geographical scenarios supports extensive derivative studies in surveillance technology development. All associated datasets and implementation codes will be open-sourced via GitHub to accelerate advancements in anti-UAV remote sensing technologies.

Authors

Institutions

Publication Details

Journal
IEEE Sensors Journal
Published
2025-06-03
DOI
https://doi.org/10.1109/jsen.2025.3574155
Primary Topic
Infrared Target Detection Methodologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Detection of Micro-UAVs in Cluttered Multispectral Scenes Through Attention-Driven Cross-Modal Fusion

Ti Xiang, Pin Lyu, Jiuwu Hao, Rui Xu et al.
IEEE Sensors Journal
Infrared Target Detection Methodologies
article

Detection of Micro-UAVs in Cluttered Multispectral Scenes Through Attention-Driven Cross-Modal Fusion

Ti Xiang, Pin Lyu, Jiuwu Hao, Rui Xu, S. Cheng, Hamin Song
article en

Abstract

To address the critical challenge of insufficient detection accuracy for micro-unmanned aerial vehicles (UAVs) which relying solely on visible-light images cannot achieve effective detection under large-scale complex scenarios with diverse backgrounds, this study pioneers a paradigm shift. We present Kilo-UAV, the first multi-spectral micro-UAV detection dataset specifically designed for kilometer-range imaging, comprising 21,940 synchronously acquired multi-spectral remote sensing observations (visible-light, near-infrared, polarized imagery, and atmospheric attenuation-corrected data). The dataset focuses on UAV targets characterized by sub-meter dimensions and minimal pixel occupancy (average pixel area ratio<0.7%), systematically encompassing 10 types, including urban built-up areas, coastal zones, and montane forests. To resolve the critical bottleneck of multi-source remote sensing data fusion, we propose the Weight-Adaptive Decision Fusion Network for Remote Sensing (ADF-RS). This architecture integrates an anomaly-modality sensitivity assessment module to dynamically optimize sensor-specific contribution weights, thereby enabling spatially coordinated representation of multi-spectral features. Experimental validation demonstrates that ADF-RS achieves state-of-the-art performance with an 86.57% detection accuracy (<italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">mAP</i><sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">50</sub>) on the test set, outperforming conventional visible-light-based approaches by a 23-percentage-point margin, while maintaining real-time processing efficiency (57 FPS on NVIDIA RTX3090 hardware). We further propose a lightweight computational framework optimized for edge computing devices, offering an embeddable solution for UAV airspace regulation within existing remote sensing infrastructures. The dataset’s inclusion of multi-scale geographical scenarios supports extensive derivative studies in surveillance technology development. All associated datasets and implementation codes will be open-sourced via GitHub to accelerate advancements in anti-UAV remote sensing technologies.

IEEE Sensors JournalVol. 25(21)
Shandong Institute of Automation (CN), Institute of Automation (CN)
Openalex Percentile: Top 84%
Infrared Target Detection Methodologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.