3D Object Detection Method Based on Image-Point Cloud Interactive Fusion
The rapid development of artificial intelligence and computer vision has propelled autonomous driving to a crucial frontier in the research of intelligent transportation systems. LiDAR and cameras, commonly used as environmental perception sensors in autonomous driving, each have inherent limitations in their single-modality forms. To effectively fuse these modalities, this paper proposes a 3D object detection framework based on the interactive fusion of image and point-cloud features. In the camera branch, the Orthographic Feature Attention Module is used to transform 2D image features into image BEV features. During the fusion stage, a flow-field alignment technique is introduced to address the spatial misalignment issue, ensuring the precise correspondence of cross-modal features. Meanwhile, an interactive attention module is designed to deeply explore and learn the complementary information between different modalities during the fusion process, further enhancing the fusion effect. Numerous experiments on the KITTI and Dual Radar datasets show that our method significantly improves the detection performance for cars, pedestrians, and cyclists. Analyses across different distance ranges highlight the advantages of multimodal fusion in long - range object detection and the complementary role of visual information in enhancing sparse LiDAR point clouds.
Authors
- Tao Zhang (ORCID: https://orcid.org/0000-0003-4489-1127)
- Qixin Lin
- R. P. Lin (ORCID: https://orcid.org/0009-0000-1468-6734)
Institutions
- Sun Yat-sen University (CN)
Publication Details
- Published
- 2025-06-20
- DOI
- https://doi.org/10.1109/caibda65784.2025.11183402
- Primary Topic
- Optical Systems and Laser Technology
- Type
- article
- Field-Weighted Citation Impact
- 0.00