Optimizing Source Localization via Reinforcement Learning in Multi-Agent Underwater Networks

In this paper, we propose a novel approach to multi-agent underwater source localization by means of Multi-Agent Reinforcement Learning (MARL). Our framework optimizes the trajectories of two autonomous underwater vehicles, each towing an antenna, to maximize the probability of detection of the source. We implement a shared-parameter MARL strategy with non-synchronous actions to address the challenges posed by non-stationary multi-agent environments. We train a neural network on a simplified simulation environment and evaluate it in a realistic simulation engine, demonstrating robustness to communication losses of up to 60%. Our preliminary results indicate that RL-based trajectory optimization can achieve comparable performance to traditional approaches.

Authors

Institutions

Publication Details

Published
2025-06-16
DOI
https://doi.org/10.1109/oceans58557.2025.11104604
Primary Topic
Underwater Vehicles and Communication Systems
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Optimizing Source Localization via Reinforcement Learning in Multi-Agent Underwater Networks

Gabriele Ferri, Sandjai Bhulai, Alessandro Faggiani, Hilde I. Hummel et al.
Underwater Vehicles and Communication Systems
article

Optimizing Source Localization via Reinforcement Learning in Multi-Agent Underwater Networks

Gabriele Ferri, Sandjai Bhulai, Alessandro Faggiani, Hilde I. Hummel, Alessandra Teseï, Federico Celi, Robert Been, J. Moos Middelkoop
article en

Abstract

In this paper, we propose a novel approach to multi-agent underwater source localization by means of Multi-Agent Reinforcement Learning (MARL). Our framework optimizes the trajectories of two autonomous underwater vehicles, each towing an antenna, to maximize the probability of detection of the source. We implement a shared-parameter MARL strategy with non-synchronous actions to address the challenges posed by non-stationary multi-agent environments. We train a neural network on a simplified simulation environment and evaluate it in a realistic simulation engine, demonstrating robustness to communication losses of up to 60%. Our preliminary results indicate that RL-based trajectory optimization can achieve comparable performance to traditional approaches.

North Atlantic Treaty Organization (IT), Centrum Wiskunde & Informatica (NL), NATO Centre for Maritime Research and Experimentation (IT), Vrije Universiteit Amsterdam (NL)
North Atlantic Treaty Organization
Openalex Percentile: Top 75%
Underwater Vehicles and Communication Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Optimizing Source Localization via Reinforcement Learning in Multi-Agent Underwater Networks — Gabriele Ferri, Sandjai Bhulai, et al. · (2025) | TGRS Research Map | TGRS