A 3D Object Detection Method Based on Cross-Attention Multimodal Feature Fusion

As a key component of the environmental awareness system of autonomous vehicles, efficient and accurate 3D detection of obstacles is directly related to driving safety. However, in complex and ever-changing driving environments, single sensory input like camera or LiDAR often fails to provide accurate and comprehensive environmental information. To improve the effectiveness of 3D object detection, this paper focuses on a multi-perception feature fusion strategy and proposes a supervised learning method called MPF-Net. Firstly, the image features are mapped into a 3-dimensional view cone space, then fused with the LiDAR features in a unified bird's-eye-view (BEV) space, finally an efficient BEV network is designed for 3D object detection. The performance has been validated on KITTI database and compared with several other models, the results demonstrate that the proposed method has more accuracy.

Authors

Institutions

Publication Details

Published
2024-10-25
DOI
https://doi.org/10.1109/cvci63518.2024.10830167
Citations
1
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A 3D Object Detection Method Based on Cross-Attention Multimodal Feature Fusion

Juanxiu Tian, Yanping Zhou, Meng Peng, Xudong Chen
1 citations
Advanced Neural Network Applications
0.25
article

A 3D Object Detection Method Based on Cross-Attention Multimodal Feature Fusion

Juanxiu Tian, Yanping Zhou, Meng Peng, Xudong Chen
article en
1 citations

Abstract

As a key component of the environmental awareness system of autonomous vehicles, efficient and accurate 3D detection of obstacles is directly related to driving safety. However, in complex and ever-changing driving environments, single sensory input like camera or LiDAR often fails to provide accurate and comprehensive environmental information. To improve the effectiveness of 3D object detection, this paper focuses on a multi-perception feature fusion strategy and proposes a supervised learning method called MPF-Net. Firstly, the image features are mapped into a 3-dimensional view cone space, then fused with the LiDAR features in a unified bird's-eye-view (BEV) space, finally an efficient BEV network is designed for 3D object detection. The performance has been validated on KITTI database and compared with several other models, the results demonstrate that the proposed method has more accuracy.

Hunan Institute of Engineering (CN)
Openalex Percentile: Top 42%
Advanced Neural Network Applications
0.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A 3D Object Detection Method Based on Cross-Attention Multimodal Feature Fusion — Juanxiu Tian, Yanping Zhou, et al. · (2024) | TGRS Research Map | TGRS