GNN-Based Decentralized Perception in Multi-Robot Systems for Predicting Worker Actions
In industrial environments, predicting human actions is essential for ensuring safe and effective collaboration between humans and robots. This paper introduces a perception framework that enables mobile robots to understand and share information about human actions in a decentralized way. The framework first allows each robot to build a spatial graph representing its surroundings, which it then shares with other robots. This shared spatial data is combined with temporal information to track human behavior over time. A swarm-inspired decision-making process is used to ensure all robots agree on a unified interpretation of the human's actions. Results show that adding more robots and incorporating longer time sequences improve prediction accuracy. Additionally, the consensus mechanism increases system resilience, making the multi-robot setup more reliable in dynamic industrial settings.
Authors
- Giovanni Beltrame (ORCID: https://orcid.org/0000-0001-9755-8630)
- David St-Onge (ORCID: https://orcid.org/0000-0002-0587-8598)
- Muhammad Ali Imran (ORCID: https://orcid.org/0000-0003-4743-9136)
Institutions
- Polytechnique Montréal (CA)
- École de Technologie Supérieure (CA)
Publication Details
- Journal
- IEEE Robotics and Automation Letters
- Published
- 2025-05-02
- DOI
- https://doi.org/10.1109/lra.2025.3566610
- Citations
- 1
- Primary Topic
- Digital Transformation in Industry
- Type
- article
- Field-Weighted Citation Impact
- 1.24