Camera-Radar-Based Adaptive Cross Attention Fusion for Multimodal Object Detection
Advanced driver assistance systems (ADAS) necessitate the integration of data from multiple sensors for accurate environmental perception and object detection. However, fusing information from diverse sensors like cameras and radar presents substantial challenges due to inherent differences in data formats and the need for sophisticated fusion strategies. This paper introduces an Adaptive Cross Attention Fusion Module (ACAFM) tailored for the effective fusion of image and millimeter-wave radar data. By leveraging both channel and spatial attention mechanisms, our approach dynamically adjusts feature weighting during the fusion process, significantly improving detection accuracy and system stability. Evaluations on public datasets demonstrate that our method outperforms existing camera-radar fusion techniques, highlighting its robustness in complex and varied scenarios.
Authors
- Yung-Yao Chen (ORCID: https://orcid.org/0000-0001-6852-8862)
- Shih-Hsuan Lin (ORCID: https://orcid.org/0009-0000-4731-9869)
- Weijie Chang (ORCID: https://orcid.org/0000-0001-7225-3240)
- Sin-Ye Jhong (ORCID: https://orcid.org/0000-0003-4481-1633)
- Kai‐Lung Hua (ORCID: https://orcid.org/0000-0002-7735-243X)
- Hui-Che Hsu
- Shih-Che Chien
Publication Details
- Published
- 2024-10-31
- DOI
- https://doi.org/10.1109/cacs63404.2024.10773133
- Citations
- 1
- Primary Topic
- Infrared Target Detection Methodologies
- Type
- article
- Field-Weighted Citation Impact
- 1.30