A Lightweight YOLOv8 Object Detection Method Based on Multimodal Fusion of Infrared and Visible Light

To enhance the accuracy and adaptability of target detection in complex environments, this paper proposes a lightweight YOLOv8 detection method based on multimodal fusion of infrared and visible light. This method constructs a dualbranch structure for extracting semantic and structural information, and designs a cross-modal feature fusion module (CMFM), combined with channel attention mechanism to improve feature expression ability. To achieve lightweight deployment, MobileOneNet is adopted to replace the YOLOv8 backbone network, and the GSConv module is introduced in the Neck to reduce computational load and complexity. Furthermore, in the design of the loss function, this paper incorporates the combination strategy of Varifocal Loss and CIoU Loss, respectively optimizing the classification and regression sub-tasks, thereby enhancing the accuracy of the model. Experiments are verified on the LLVIP multimodal dataset, and the results show that while the mAP reaches $90.3 \%$, the model size is compressed to 6.7 MB, and the frame rate is increased to 84.58 FPS, outperforming mainstream detection methods. This method provides an efficient and deployable solution for intelligent perception tasks in night or harsh conditions.

Authors

Institutions

Publication Details

Published
2025-05-29
DOI
https://doi.org/10.1109/icaide65466.2025.11189717
Primary Topic
Infrared Target Detection Methodologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Lightweight YOLOv8 Object Detection Method Based on Multimodal Fusion of Infrared and Visible Light

Youchun Xu, Shengyuan Zhou
Infrared Target Detection Methodologies
article

A Lightweight YOLOv8 Object Detection Method Based on Multimodal Fusion of Infrared and Visible Light

Youchun Xu, Shengyuan Zhou
article en

Abstract

To enhance the accuracy and adaptability of target detection in complex environments, this paper proposes a lightweight YOLOv8 detection method based on multimodal fusion of infrared and visible light. This method constructs a dualbranch structure for extracting semantic and structural information, and designs a cross-modal feature fusion module (CMFM), combined with channel attention mechanism to improve feature expression ability. To achieve lightweight deployment, MobileOneNet is adopted to replace the YOLOv8 backbone network, and the GSConv module is introduced in the Neck to reduce computational load and complexity. Furthermore, in the design of the loss function, this paper incorporates the combination strategy of Varifocal Loss and CIoU Loss, respectively optimizing the classification and regression sub-tasks, thereby enhancing the accuracy of the model. Experiments are verified on the LLVIP multimodal dataset, and the results show that while the mAP reaches $90.3 \%$, the model size is compressed to 6.7 MB, and the frame rate is increased to 84.58 FPS, outperforming mainstream detection methods. This method provides an efficient and deployable solution for intelligent perception tasks in night or harsh conditions.

Guilin University of Electronic Technology (CN)
Openalex Percentile: Top 61%
Infrared Target Detection Methodologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Lightweight YOLOv8 Object Detection Method Based on Multimodal Fusion of Infrared and Visible Light — Youchun Xu, Shengyuan Zhou · (2025) | TGRS Research Map | TGRS