Multibeam water column image super-resolution by combining morphological and intensity features
Multibeam water column images (WCI) play a crucial role in the detection and recognition of underwater targets. However, WCI is not a complete image of underwater space due to the gaps between beams inherent in multibeam systems. In this study, we design the WCI super-resolution network (WCISRN) based on Swin-transformer to adapt to the uneven and sparse distribution of water column data. To enable WCISRN to learn morphological features effectively, we produced simulated datasets for pre-training. Subsequently, we conduct self-supervised training on the measured WCI dataset to fine-tune the network parameters, aiming to better adapt WCISRN to the backscattering intensity features of WCI. Finally, by performing network cross-fusion, the pre-trained network and self-supervised training network are combined to form a new network that achieves a balance between image morphology and intensity features. The proposed method is evaluated through visual analysis and quantitative comparison using simulated and real-world datasets. The experimental results demonstrate that our method exhibits stronger detail restoration ability and clearer image morphology. The average peak signal-to-noise ratio (PSNR) on the test set improved from 23.75–26.14, indicating a significant enhancement in the imaging quality of WCI.
Authors
- Jianbing Chen (ORCID: https://orcid.org/0000-0001-8520-0383)
- Mingwei Wang (ORCID: https://orcid.org/0000-0002-0799-3311)
- Ziyin Wu
- Ruifu Wang (ORCID: https://orcid.org/0000-0001-6767-1720)
- Qianyong Liang (ORCID: https://orcid.org/0000-0002-9172-1828)
- Chao Qi (ORCID: https://orcid.org/0000-0002-4771-2617)
- Fanlin Yang (ORCID: https://orcid.org/0000-0002-4100-5612)
Institutions
- Ministry of Natural Resources (CN)
- Guangzhou Marine Geological Survey (CN)
- Second Institute of Oceanography (CN)
- Ocean University of China (CN)
- Shandong University of Science and Technology (CN)
Publication Details
- Journal
- International Journal of Digital Earth
- Published
- 2024-09-02
- DOI
- https://doi.org/10.1080/17538947.2024.2398760
- Citations
- 2
- Primary Topic
- Advanced Image Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.50
Funders
- National Natural Science Foundation of China
- Natural Science Foundation of Shandong Province
- National Key Research and Development Program of China