RPT-Fusion: A Time-Lag-Aware Quality-Adaptive Radar–Camera Fusion Framework for Water-Surface Object Detection
Water-surface object detection remains challenging under strong reflections, wave disturbances, adverse weather, low illumination, and distant or small targets, which can severely degrade or obscure discriminative visual cues. Although radar–camera fusion provides complementary geometric and motion information, sparse and uncertain radar observations may introduce unreliable cues, while camera–radar temporal asynchrony can further reduce cross-modal spatial consistency. To address these issues, this paper proposes Radar Prior and Time-Lag-Aware Quality-Adaptive Fusion (RPT-Fusion), a radar–camera fusion framework that preserves the camera as the primary semantic modality while treating radar as a reliability-controlled auxiliary source. Sparse 4D radar measurements are transformed into probabilistic occupancy, density, velocity, and reliability priors, with direction-dependent spatial uncertainty represented through anisotropic radar-prior modeling. Local, global, and temporal quality estimates are then jointly used to regulate radar contributions during multi-scale feature fusion. In particular, the measured camera–radar time lag is explicitly incorporated into both radar-prior construction and feature-level reliability control. Experiments on WaterScenes show that RPT-Fusion achieves 92.31% mAP50 at an Intersection-over-Union (IoU) threshold of 0.50 and 68.23% mAP50–95 averaged over IoU thresholds from 0.50 to 0.95, outperforming WS-DETR by 0.82 and 3.69 percentage points, respectively. Ablation experiments verify the contributions of radar-prior modeling, quality-adaptive fusion, and temporal quality, while repeated-training experiments show low performance variability. Time-lag analysis reveals condition-dependent benefits, with the largest observed improvement of 1.15 percentage points occurring when the camera–radar offset reaches or exceeds 20 ms. Radar-frame-dropping experiments further show that mAP50 decreases from 92.31% to 91.54% when radar observations are progressively removed, indicating that the camera-centric pathway retains a substantial detection capability under incomplete radar observations. These results demonstrate the effectiveness of reliability-controlled radar assistance for robust radar–camera object detection in complex water-surface environments.
Authors
- Honghua Chen (ORCID: https://orcid.org/0000-0001-7473-1146)
- Yabin Xu (ORCID: https://orcid.org/0000-0002-1919-8673)
- Weiming Wang (ORCID: https://orcid.org/0000-0002-9068-0227)
- Junnan Yang (ORCID: https://orcid.org/0009-0002-3359-4792)
- Sujie Zhan (ORCID: https://orcid.org/0009-0009-0692-0186)
Institutions
- Zhejiang Sci-Tech University (CN)
Publication Details
- Journal
- Sensors
- Published
- 2026-09-16
- DOI
- https://doi.org/10.3390/s26185860
- Primary Topic
- Advanced SAR Imaging Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00