Research on Environmental Perception Based on YOLOv8 and LiDAR Data Fusion

To enhance the sensing capability of driverless cars in complex dynamic scenarios, a fusion method of radar and depth camera is emphasized and a technical framework for integrating multi-source sensors is proposed. A YOLOv8 neural network detection model combined with a self-attention network structure is first used to achieve correct recognition and depth estimation of vehicles and pedestrians, then further distance data of dynamic environment is acquired by M10P LiDAR, and finally information from D435i camera and radar information are fused by matrix projection. In the experiments, the conventional YOLOv8 model was compared to the YOLOv8 model enhanced with self-attention, the camera and LIDAR measurements were evaluated against the fusion results. The experimental results demonstrate that the new model significantly improves the confidence and stability of target detection, while the fused distance measurements are more accurate than those from individual sensors.

Authors

Institutions

Publication Details

Published
2024-12-06
DOI
https://doi.org/10.1109/iciba62489.2024.10868848
Primary Topic
Remote Sensing and LiDAR Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Environmental Perception Based on YOLOv8 and LiDAR Data Fusion

Ting Li, Huiling Li, Zilin Luo, Jie Liu
Remote Sensing and LiDAR Applications
article

Research on Environmental Perception Based on YOLOv8 and LiDAR Data Fusion

Ting Li, Huiling Li, Zilin Luo, Jie Liu
article en

Abstract

To enhance the sensing capability of driverless cars in complex dynamic scenarios, a fusion method of radar and depth camera is emphasized and a technical framework for integrating multi-source sensors is proposed. A YOLOv8 neural network detection model combined with a self-attention network structure is first used to achieve correct recognition and depth estimation of vehicles and pedestrians, then further distance data of dynamic environment is acquired by M10P LiDAR, and finally information from D435i camera and radar information are fused by matrix projection. In the experiments, the conventional YOLOv8 model was compared to the YOLOv8 model enhanced with self-attention, the camera and LIDAR measurements were evaluated against the fusion results. The experimental results demonstrate that the new model significantly improves the confidence and stability of target detection, while the fused distance measurements are more accurate than those from individual sensors.

Nanning Normal University (CN)
Climate action
Openalex Percentile: Top 77%
Remote Sensing and LiDAR Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.