Multi-Robot Active Mapping based on Inverse Reinforcement Learning in Unknown Environments

Multi-robot active mapping aims to efficiently explore and construct complete maps of unknown environments using multiple robots. The key to solving this problem lies in frontier-based exploration, which enables more efficient robot movements. Recent approaches have employed Reinforcement Learning (RL) to optimize robot policies for efficient exploration. However, designing a suitable reward function for $R L$ in this context is challenging because it requires balancing multiple objectives, such as rapid exploration, efficient coordination, and complete coverage. To address this challenge, we propose an Inverse Reinforcement Learning (IRL) approach that automatically updates the underlying reward function from expert demonstrations of effective multi-robot mapping. We use the performance of NeuralCoMapping on specific maps as expert demonstrations and take NeuralCoMapping as the RL policy. By learning the potential reward function optimized by these expert demonstrations, we aim to discover a more comprehensive and balanced reward function that captures the key features of efficient multi-robot mapping. The proposed IRL-based approach not only offers a promising direction for automatically learning effective reward functions and policies in complex multi-robot systems but also instills optimism for the future of robotics, reducing the need for manual reward engineering.

Authors

Institutions

Publication Details

Published
2024-10-31
DOI
https://doi.org/10.1109/cacs63404.2024.10773177
Primary Topic
Robotics and Sensor-Based Localization
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-Robot Active Mapping based on Inverse Reinforcement Learning in Unknown Environments

Kai-Yi Wong, Ping-Heng Hsieh
Robotics and Sensor-Based Localization
article

Multi-Robot Active Mapping based on Inverse Reinforcement Learning in Unknown Environments

Kai-Yi Wong, Ping-Heng Hsieh
article en

Abstract

Multi-robot active mapping aims to efficiently explore and construct complete maps of unknown environments using multiple robots. The key to solving this problem lies in frontier-based exploration, which enables more efficient robot movements. Recent approaches have employed Reinforcement Learning (RL) to optimize robot policies for efficient exploration. However, designing a suitable reward function for $R L$ in this context is challenging because it requires balancing multiple objectives, such as rapid exploration, efficient coordination, and complete coverage. To address this challenge, we propose an Inverse Reinforcement Learning (IRL) approach that automatically updates the underlying reward function from expert demonstrations of effective multi-robot mapping. We use the performance of NeuralCoMapping on specific maps as expert demonstrations and take NeuralCoMapping as the RL policy. By learning the potential reward function optimized by these expert demonstrations, we aim to discover a more comprehensive and balanced reward function that captures the key features of efficient multi-robot mapping. The proposed IRL-based approach not only offers a promising direction for automatically learning effective reward functions and policies in complex multi-robot systems but also instills optimism for the future of robotics, reducing the need for manual reward engineering.

National Sun Yat-sen University (TW)
National Science and Technology Council
Openalex Percentile: Top 64%
Robotics and Sensor-Based Localization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Multi-Robot Active Mapping based on Inverse Reinforcement Learning in Unknown Environments — Kai-Yi Wong, Ping-Heng Hsieh · (2024) | TGRS Research Map | TGRS