Mixed local channel attention-based YOLOv8 for pedestrian detection in infrared images

In nighttime pedestrian detection tasks, objects in dark areas can be more easily detected with infrared images. However, the detailed features and contours of object are usually blurry in infrared images. Additionally, due to interference from heat sources, objects in the background with similar infrared radiation as pedestrians may overlap with them, causing confusion of detection models. To address these aforementioned issues, we propose a Mixed Local Channel Attention based YOLOv8 model (YOLOv8-MLCA) in this paper to detect pedestrians in infrared images. Firstly, we propose a Mixed Local Channel Attention (MLCA) module in YOLO's feature extraction backbone network. MLCA combines local and global information from the channel and space dimensions to enhance pedestrian details and contour features. To further address the problem of blurred pedestrian boundaries in infrared images, we propose a Minimum Points Distance based MPDLoss for bounding box regression during model training. We conducted comparative experiments on the LLVIP dataset. Among 5 baseline models in the experiment, the proposed YOLOv8-MLCA achieved the highest accuracy. We also conducted comprehensive ablation analysis to explore the performance of MLCA and MPDLoss. The experimental results validated the effectiveness of the proposed improvements.

Authors

Institutions

Publication Details

Published
2025-01-09
DOI
https://doi.org/10.1117/12.3055766
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Mixed local channel attention-based YOLOv8 for pedestrian detection in infrared images

Hao Feng
Video Surveillance and Tracking Methods
article

Mixed local channel attention-based YOLOv8 for pedestrian detection in infrared images

Hao Feng
article en

Abstract

In nighttime pedestrian detection tasks, objects in dark areas can be more easily detected with infrared images. However, the detailed features and contours of object are usually blurry in infrared images. Additionally, due to interference from heat sources, objects in the background with similar infrared radiation as pedestrians may overlap with them, causing confusion of detection models. To address these aforementioned issues, we propose a Mixed Local Channel Attention based YOLOv8 model (YOLOv8-MLCA) in this paper to detect pedestrians in infrared images. Firstly, we propose a Mixed Local Channel Attention (MLCA) module in YOLO's feature extraction backbone network. MLCA combines local and global information from the channel and space dimensions to enhance pedestrian details and contour features. To further address the problem of blurred pedestrian boundaries in infrared images, we propose a Minimum Points Distance based MPDLoss for bounding box regression during model training. We conducted comparative experiments on the LLVIP dataset. Among 5 baseline models in the experiment, the proposed YOLOv8-MLCA achieved the highest accuracy. We also conducted comprehensive ablation analysis to explore the performance of MLCA and MPDLoss. The experimental results validated the effectiveness of the proposed improvements.

University of Glasgow (GB)
Sustainable cities and communities
Openalex Percentile: Top 100%
Video Surveillance and Tracking Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.