Interpretable Roadside 2D Object Detection Based on Axial Attention

Environmental perception plays a crucial role in the operation of autonomous vehicles. Recent studies have relied on single vehicle cameras for perception due to the lack of roadside view dataset, but this approach provides limited perception information. To address this limitation, there is a growing interest in studying roadside perception to complement vehicle-side perception information. However, existing methods face challenges in accurately recognizing and locating small objects or objects under occluding conditions in the roadside. And autonomous vehicles require millisecond-level decision-making for safe driving, yet many advanced object detection methods struggle to meet the need for high-speed reasoning. Additionally, deep learning models often make black-box decisions without providing explanations or understanding of their decision-making process. To tackle these issues, this study proposes an interpretable 2D object detection method for roadside based on the YOLO V8 with Axial Attention replacing the CNN network within the network architecture. The trained model is then input into HiResCAM to visualize the decision-making process of the roadside detection model. Experimental results on DAIR-V2X-I and Rope3D demonstrate that our proposed method not only improves mean Average Precision (mAP) but also enhances image processing speed by 1.5 to 2 times compared to existing methods. By visualizing the decision-making process of the roadside detection model, it make autonomous vehicle perception more transparent and credible.

Authors

Institutions

Publication Details

Published
2024-09-20
DOI
https://doi.org/10.1109/icis61260.2024.10778301
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Interpretable Roadside 2D Object Detection Based on Axial Attention

Jinyan Hu, Shaojing Song, Fan Wu
Advanced Neural Network Applications
article

Interpretable Roadside 2D Object Detection Based on Axial Attention

Jinyan Hu, Shaojing Song, Fan Wu
article en

Abstract

Environmental perception plays a crucial role in the operation of autonomous vehicles. Recent studies have relied on single vehicle cameras for perception due to the lack of roadside view dataset, but this approach provides limited perception information. To address this limitation, there is a growing interest in studying roadside perception to complement vehicle-side perception information. However, existing methods face challenges in accurately recognizing and locating small objects or objects under occluding conditions in the roadside. And autonomous vehicles require millisecond-level decision-making for safe driving, yet many advanced object detection methods struggle to meet the need for high-speed reasoning. Additionally, deep learning models often make black-box decisions without providing explanations or understanding of their decision-making process. To tackle these issues, this study proposes an interpretable 2D object detection method for roadside based on the YOLO V8 with Axial Attention replacing the CNN network within the network architecture. The trained model is then input into HiResCAM to visualize the decision-making process of the roadside detection model. Experimental results on DAIR-V2X-I and Rope3D demonstrate that our proposed method not only improves mean Average Precision (mAP) but also enhances image processing speed by 1.5 to 2 times compared to existing methods. By visualizing the decision-making process of the roadside detection model, it make autonomous vehicle perception more transparent and credible.

Shanghai Polytechnic University (CN)
Sustainable cities and communities
Openalex Percentile: Top 77%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Interpretable Roadside 2D Object Detection Based on Axial Attention — Jinyan Hu, Shaojing Song, et al. · (2024) | TGRS Research Map | TGRS