3D Object Detection Method Based on Image-Point Cloud Interactive Fusion

The rapid development of artificial intelligence and computer vision has propelled autonomous driving to a crucial frontier in the research of intelligent transportation systems. LiDAR and cameras, commonly used as environmental perception sensors in autonomous driving, each have inherent limitations in their single-modality forms. To effectively fuse these modalities, this paper proposes a 3D object detection framework based on the interactive fusion of image and point-cloud features. In the camera branch, the Orthographic Feature Attention Module is used to transform 2D image features into image BEV features. During the fusion stage, a flow-field alignment technique is introduced to address the spatial misalignment issue, ensuring the precise correspondence of cross-modal features. Meanwhile, an interactive attention module is designed to deeply explore and learn the complementary information between different modalities during the fusion process, further enhancing the fusion effect. Numerous experiments on the KITTI and Dual Radar datasets show that our method significantly improves the detection performance for cars, pedestrians, and cyclists. Analyses across different distance ranges highlight the advantages of multimodal fusion in long - range object detection and the complementary role of visual information in enhancing sparse LiDAR point clouds.

Authors

Institutions

Publication Details

Published
2025-06-20
DOI
https://doi.org/10.1109/caibda65784.2025.11183402
Primary Topic
Optical Systems and Laser Technology
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

3D Object Detection Method Based on Image-Point Cloud Interactive Fusion

Tao Zhang, Qixin Lin, R. P. Lin
Optical Systems and Laser Technology
article

3D Object Detection Method Based on Image-Point Cloud Interactive Fusion

Tao Zhang, Qixin Lin, R. P. Lin
article en

Abstract

The rapid development of artificial intelligence and computer vision has propelled autonomous driving to a crucial frontier in the research of intelligent transportation systems. LiDAR and cameras, commonly used as environmental perception sensors in autonomous driving, each have inherent limitations in their single-modality forms. To effectively fuse these modalities, this paper proposes a 3D object detection framework based on the interactive fusion of image and point-cloud features. In the camera branch, the Orthographic Feature Attention Module is used to transform 2D image features into image BEV features. During the fusion stage, a flow-field alignment technique is introduced to address the spatial misalignment issue, ensuring the precise correspondence of cross-modal features. Meanwhile, an interactive attention module is designed to deeply explore and learn the complementary information between different modalities during the fusion process, further enhancing the fusion effect. Numerous experiments on the KITTI and Dual Radar datasets show that our method significantly improves the detection performance for cars, pedestrians, and cyclists. Analyses across different distance ranges highlight the advantages of multimodal fusion in long - range object detection and the complementary role of visual information in enhancing sparse LiDAR point clouds.

Sun Yat-sen University (CN)
Openalex Percentile: Top 72%
Optical Systems and Laser Technology
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.