Multimodal deep learning for intelligent camera parameter control in underwater optical camera communication imaging

Underwater optical camera communication (UOCC) relies on image-based signal reception, where the quality of recorded stripes directly determines the achievable optical signal-to-noise ratio (SNR). However, fixed camera parameters-such as exposure level and International Standards Organization (ISO) sensitivity-are often inadequate under dynamically varying aquatic conditions including turbidity, flow velocity, and ambient illumination. To overcome these limitations, we propose a multimodal deep model that fuses visual cues with environmental context to predict scene-optimal camera parameters at capture time. A ResNet50 backbone extracts semantic representations from raw stripe images, while environmental factors-including turbidity, flow speed, ambient illumination, and LED power-are jointly encoded through a parallel embedding architecture. These modalities are fused within a regression network to infer settings that maximize imaging clarity and stability. The experimental results demonstrate that the proposed model achieves robust accuracy. Crucially, the capture-time parameter selection improves stripe visibility and delivers an average ∼3<i>d</i><i>B</i> gain in optical SNR across diverse conditions. This capture-time optimization sustains a higher and more stable SNR band than both the original fixed settings and a representative learning-based post-processing baseline (DnCNN with horizontal-banding suppression). Beyond accuracy, the approach is computationally light and portable: context-aware parameter prediction at capture time eliminates per-frame processing, providing a practical route to real-time, resource-constrained UOCC with enhanced image quality and robustness.

Authors

Institutions

Publication Details

Journal
Applied Optics
Published
2025-11-10
DOI
https://doi.org/10.1364/ao.577990
Primary Topic
Optical Wireless Communication Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal deep learning for intelligent camera parameter control in underwater optical camera communication imaging

Zefeng Wang, Haifei Shen, Lianxin Hu, Yi-Qian Qian et al.
Applied Optics
Optical Wireless Communication Technologies
article

Multimodal deep learning for intelligent camera parameter control in underwater optical camera communication imaging

Zefeng Wang, Haifei Shen, Lianxin Hu, Yi-Qian Qian, Xun Zhang, Hongda Chen, Zhan Wang, Jiongnan Lou, Chaoya Yan
article en

Abstract

Underwater optical camera communication (UOCC) relies on image-based signal reception, where the quality of recorded stripes directly determines the achievable optical signal-to-noise ratio (SNR). However, fixed camera parameters-such as exposure level and International Standards Organization (ISO) sensitivity-are often inadequate under dynamically varying aquatic conditions including turbidity, flow velocity, and ambient illumination. To overcome these limitations, we propose a multimodal deep model that fuses visual cues with environmental context to predict scene-optimal camera parameters at capture time. A ResNet50 backbone extracts semantic representations from raw stripe images, while environmental factors-including turbidity, flow speed, ambient illumination, and LED power-are jointly encoded through a parallel embedding architecture. These modalities are fused within a regression network to infer settings that maximize imaging clarity and stability. The experimental results demonstrate that the proposed model achieves robust accuracy. Crucially, the capture-time parameter selection improves stripe visibility and delivers an average ∼3<i>d</i><i>B</i> gain in optical SNR across diverse conditions. This capture-time optimization sustains a higher and more stable SNR band than both the original fixed settings and a representative learning-based post-processing baseline (DnCNN with horizontal-banding suppression). Beyond accuracy, the approach is computationally light and portable: context-aware parameter prediction at capture time eliminates per-frame processing, providing a practical route to real-time, resource-constrained UOCC with enhanced image quality and robustness.

Applied OpticsVol. 64(35)
Institut Supérieur d'Électronique de Paris (FR), Huzhou Normal University (CN), Aquatic Systems (United States) (US)
Openalex Percentile: Top 67%
Optical Wireless Communication Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.