Object detection algorithm based on infrared-visible dual-modality feature fusion

CFM-YOLO, an infrared–visible dual-modality detection algorithm based on YOLOv11, is proposed to improve UAV object detection under adverse illumination and complex aerial backgrounds. The network is redesigned from three aspects: cross-modal feature extraction, lightweight feature fusion, and small-object-oriented detection. First, a Cross-Modality Fusion Mamba (CFM) module is introduced to promote channel-level interaction between visible and infrared features and to model long-range spatial dependencies with selective state-space modeling. Second, a lightweight feature fusion network is used to improve multi-scale information transmission while limiting redundant computation. Third, a P2 detection layer, Ghost convolution, and Focal-WIoU loss are incorporated to enhance small-object localization and alleviate the effect of imbalanced bounding-box samples. Quantitative experiments on the DroneVehicle dataset show that CFM-YOLO achieves 81.6% [email protected] and 60.3% [email protected]:0.95, improving over the YOLOv11n-dual/base baseline by 8.4 and 5.5 percentage points, respectively. Qualitative results on the LLVIP dataset further indicate that the proposed method can reduce several missed detections in low-light pedestrian scenes. These results suggest that CFM-YOLO provides a competitive trade-off between detection accuracy and computational cost for UAV-based infrared–visible object detection.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-07-23
DOI
https://doi.org/10.1038/s41598-026-63114-w
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Object detection algorithm based on infrared-visible dual-modality feature fusion

Zedong Huang, Kangkang Du, Xiaohuang Hu, Jianfeng Li
Scientific Reports
Advanced Neural Network Applications
article

Object detection algorithm based on infrared-visible dual-modality feature fusion

Zedong Huang, Kangkang Du, Xiaohuang Hu, Jianfeng Li
article en

Abstract

CFM-YOLO, an infrared–visible dual-modality detection algorithm based on YOLOv11, is proposed to improve UAV object detection under adverse illumination and complex aerial backgrounds. The network is redesigned from three aspects: cross-modal feature extraction, lightweight feature fusion, and small-object-oriented detection. First, a Cross-Modality Fusion Mamba (CFM) module is introduced to promote channel-level interaction between visible and infrared features and to model long-range spatial dependencies with selective state-space modeling. Second, a lightweight feature fusion network is used to improve multi-scale information transmission while limiting redundant computation. Third, a P2 detection layer, Ghost convolution, and Focal-WIoU loss are incorporated to enhance small-object localization and alleviate the effect of imbalanced bounding-box samples. Quantitative experiments on the DroneVehicle dataset show that CFM-YOLO achieves 81.6% [email protected] and 60.3% [email protected]:0.95, improving over the YOLOv11n-dual/base baseline by 8.4 and 5.5 percentage points, respectively. Qualitative results on the LLVIP dataset further indicate that the proposed method can reduce several missed detections in low-light pedestrian scenes. These results suggest that CFM-YOLO provides a competitive trade-off between detection accuracy and computational cost for UAV-based infrared–visible object detection.

Scientific Reports
Changzhou Vocational Institute of Light Industry (CN)
Openalex Percentile: Top 9%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.