Optimizing Source Localization via Reinforcement Learning in Multi-Agent Underwater Networks
In this paper, we propose a novel approach to multi-agent underwater source localization by means of Multi-Agent Reinforcement Learning (MARL). Our framework optimizes the trajectories of two autonomous underwater vehicles, each towing an antenna, to maximize the probability of detection of the source. We implement a shared-parameter MARL strategy with non-synchronous actions to address the challenges posed by non-stationary multi-agent environments. We train a neural network on a simplified simulation environment and evaluate it in a realistic simulation engine, demonstrating robustness to communication losses of up to 60%. Our preliminary results indicate that RL-based trajectory optimization can achieve comparable performance to traditional approaches.
Authors
- Gabriele Ferri (ORCID: https://orcid.org/0000-0001-8830-193X)
- Sandjai Bhulai (ORCID: https://orcid.org/0000-0003-1124-8821)
- Alessandro Faggiani
- Hilde I. Hummel (ORCID: https://orcid.org/0009-0007-2063-5475)
- Alessandra Teseï (ORCID: https://orcid.org/0000-0002-5733-0444)
- Federico Celi (ORCID: https://orcid.org/0000-0001-8015-9887)
- Robert Been
- J. Moos Middelkoop
Institutions
- North Atlantic Treaty Organization (IT)
- Centrum Wiskunde & Informatica (NL)
- NATO Centre for Maritime Research and Experimentation (IT)
- Vrije Universiteit Amsterdam (NL)
Publication Details
- Published
- 2025-06-16
- DOI
- https://doi.org/10.1109/oceans58557.2025.11104604
- Primary Topic
- Underwater Vehicles and Communication Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- North Atlantic Treaty Organization