Geo-RVF: A Multi-Task Lightweight Perception System Based on Radar–Vision Fusion for USVs
Visual perception in Unmanned Surface Vehicles (USVs) suffers from drastic lighting changes and missing texture features. These factors lead to depth scale drift and motion estimation bias. Moreover, existing multi-modal fusion models are computationally complex and unfit for resource-limited edge devices. To address these problems, a lightweight Radar–Vision Fusion (Geo-RVF) algorithm is proposed. To supplement spatial information, point clouds are projected to build sparse depth maps. A probability consistency-based depth correction module is designed to suppress water noise. This helps extract accurate geometric anchors to guide visual depth propagation. Subsequently, a Recurrent Autoregressive Network (RAN) fuses radar and image features in the temporal dimension. This resolves dynamic positional deviations caused by texture degradation and distant small targets. After real-time optimization, Geo-RVF achieves 23 FPS on the Jetson Orin NX. On a collected dataset, the method attains a mean average precision (mAP) 50–90 of 44.2% and a mean intersection over union (mIoU) of 99%, outperforming HybridNets and Achelous.
Authors
- Zhen Huang
- Yilan Yu
- Zhen Tian
- Jianhong Zhou
- Gang Zhang
Institutions
- Ningbo University (CN)
- National Center of Ocean Standards and Metrology (CN)
Publication Details
- Journal
- Journal of Marine Science and Engineering
- Published
- 2026-03-31
- DOI
- https://doi.org/10.3390/jmse14070664
- Primary Topic
- Advanced Neural Network Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Science and Technology Program of Zhejiang Province