DSM-Seg: A CNN-RWKV Hybrid Framework for Forward-Looking Sonar Image Segmentation in Deep-Sea Mining
Accurate and real-time environmental perception is essential for the safe and efficient execution of deep-sea mining operations. Semantic segmentation of forward-looking sonar (FLS) images plays a pivotal role in enabling environmental awareness for deep-sea mining vehicles (DSMVs), but remains challenging due to strong acoustic noise, blurred object boundaries, and long-range semantic dependencies. To address these issues, this study proposes DSM-Seg, a novel hybrid segmentation architecture combining Convolutional Neural Networks (CNNs) and Receptance Weighted Key-Value (RWKV) modeling. The architecture integrates a Physical Prior-Based Semantic Guidance Module (PSGM), which utilizes sonar-specific physical priors to produce high-confidence semantic guidance maps, thereby enhancing the delineation of target boundaries. In addition, a RWKV-Based Global Fusion with Semantic Constraints (RGFSC) module is introduced to suppress cross-regional interference in long-range dependency modeling and achieve the effective fusion of local and global semantic information. Extensive experiments on both a self-collected seabed terrain dataset and a public marine debris dataset demonstrate that DSM-Seg significantly improves segmentation accuracy under complex conditions while satisfying real-time performance requirements. These results highlight the potential of the proposed method to support intelligent environmental perception in DSMV applications.
Authors
- Changyu Lu
- Xinran Liu (ORCID: https://orcid.org/0000-0002-9798-9710)
- Jianmin Yang
- Enhua Zhang
- Wenhao Xu (ORCID: https://orcid.org/0009-0003-5789-1609)
Institutions
- Shanghai Jiao Tong University (CN)
- Institute of Deep-Sea Science and Engineering (CN)
- Shanghai Ocean University (CN)
Publication Details
- Journal
- Remote Sensing
- Published
- 2025-08-28
- DOI
- https://doi.org/10.3390/rs17172997
- Citations
- 2
- Primary Topic
- Underwater Acoustics Research
- Type
- article
- Field-Weighted Citation Impact
- 3.59