An Adaptive Visual–Tactile Fusion Reinforcement Learning Method for Underwater Manipulator Grasping

Underwater manipulator grasping remains challenging because image blur, light attenuation, and flow-induced disturbances degrade perception and control. These factors make target localization, contact judgment, and stable lifting difficult, especially when visual degradation and tactile fluctuation occur together. We propose AVT-TD3, an adaptive visual–tactile fusion reinforcement learning method for underwater manipulator grasping. AVT-TD3 constructs a unified policy state from visual observations, short-horizon tactile variations, and manipulator proprioception. A gated fusion module adjusts the contribution of each sensory branch, while an action modulation mechanism limits abrupt velocity-command changes during contact establishment and lifting. We train the continuous grasping policy with Twin Delayed Deep Deterministic Policy Gradient (TD3) and evaluate it in simulation under different turbidity, flow velocity, and target conditions, followed by controlled water-tank feasibility validation. Simulation results show that AVT-TD3 achieves better performance than Deep Deterministic Policy Gradient (DDPG), Soft Actor-Critic (SAC), and standard TD3 in success rate, completion steps, slip rate, and velocity-command smoothness. In the standard test scenario, AVT-TD3 achieves a success rate of 92.7%, an average of 76 completion steps, a slip rate of 4.1%, and an action variation magnitude of 0.20. Controlled water-tank tests further support the feasibility of deploying AVT-TD3, although open-water validation remains for future work.

Authors

Institutions

Publication Details

Journal
Journal of Marine Science and Engineering
Published
2026-05-31
DOI
https://doi.org/10.3390/jmse14111027
Primary Topic
Robot Manipulation and Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Adaptive Visual–Tactile Fusion Reinforcement Learning Method for Underwater Manipulator Grasping

Lu Han, Wei Chen, Duo Wan, Yongqing Shi
Journal of Marine Science and Engineering
Robot Manipulation and Learning
article

An Adaptive Visual–Tactile Fusion Reinforcement Learning Method for Underwater Manipulator Grasping

Lu Han, Wei Chen, Duo Wan, Yongqing Shi
article en

Abstract

Underwater manipulator grasping remains challenging because image blur, light attenuation, and flow-induced disturbances degrade perception and control. These factors make target localization, contact judgment, and stable lifting difficult, especially when visual degradation and tactile fluctuation occur together. We propose AVT-TD3, an adaptive visual–tactile fusion reinforcement learning method for underwater manipulator grasping. AVT-TD3 constructs a unified policy state from visual observations, short-horizon tactile variations, and manipulator proprioception. A gated fusion module adjusts the contribution of each sensory branch, while an action modulation mechanism limits abrupt velocity-command changes during contact establishment and lifting. We train the continuous grasping policy with Twin Delayed Deep Deterministic Policy Gradient (TD3) and evaluate it in simulation under different turbidity, flow velocity, and target conditions, followed by controlled water-tank feasibility validation. Simulation results show that AVT-TD3 achieves better performance than Deep Deterministic Policy Gradient (DDPG), Soft Actor-Critic (SAC), and standard TD3 in success rate, completion steps, slip rate, and velocity-command smoothness. In the standard test scenario, AVT-TD3 achieves a success rate of 92.7%, an average of 76 completion steps, a slip rate of 4.1%, and an action variation magnitude of 0.20. Controlled water-tank tests further support the feasibility of deploying AVT-TD3, although open-water validation remains for future work.

Journal of Marine Science and EngineeringVol. 14(11)
Jiangsu University of Science and Technology (CN)
Life below water
Openalex Percentile: Top 5%
Robot Manipulation and Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.