A Multi-Level Fusion-Enhanced YOLOv8 Framework for Multispectral Object Detection

In order to address the issue of insufficient feature complementarity between visible-infrared modalities and low computational efficiency in complex environments, a multi-level fusion-enhanced dual-modal object detection framework is proposed. Based on YOLOv8, we design a heterogeneous dual-stream backbone for modality-specific feature extraction, a Squeeze-and-Excitation Fusion module for dynamic channel enhancement, and a Two-stream Fusion Transformer for long-range dependency modeling. Additionally, a lightweight C2f _Faster module optimises computational efficiency in the infrared branch. Experiments on the LLVIP dataset demonstrate that our method significantly improves detection accuracy and real-time performance by effectively fusing multi-modal complementary information, it achieves an mAP50 of 95.7% (1.0% higher than the baseline dual-stream model) with only 6.42M parameters, providing an efficient solution for robust detection in dynamic open-world scenarios.

Authors

Institutions

Publication Details

Published
2025-07-11
DOI
https://doi.org/10.1109/ieeeconf65522.2025.11137313
Primary Topic
Infrared Target Detection Methodologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Multi-Level Fusion-Enhanced YOLOv8 Framework for Multispectral Object Detection

Mince Li, Jiaqiang Tian, Tao Yu, Yu Wei et al.
Infrared Target Detection Methodologies
article

A Multi-Level Fusion-Enhanced YOLOv8 Framework for Multispectral Object Detection

Mince Li, Jiaqiang Tian, Tao Yu, Yu Wei, Bowen Xiong
article en

Abstract

In order to address the issue of insufficient feature complementarity between visible-infrared modalities and low computational efficiency in complex environments, a multi-level fusion-enhanced dual-modal object detection framework is proposed. Based on YOLOv8, we design a heterogeneous dual-stream backbone for modality-specific feature extraction, a Squeeze-and-Excitation Fusion module for dynamic channel enhancement, and a Two-stream Fusion Transformer for long-range dependency modeling. Additionally, a lightweight C2f _Faster module optimises computational efficiency in the infrared branch. Experiments on the LLVIP dataset demonstrate that our method significantly improves detection accuracy and real-time performance by effectively fusing multi-modal complementary information, it achieves an mAP50 of 95.7% (1.0% higher than the baseline dual-stream model) with only 6.42M parameters, providing an efficient solution for robust detection in dynamic open-world scenarios.

Anhui University (CN), Chery Automobile (China) (CN)
Openalex Percentile: Top 68%
Infrared Target Detection Methodologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.