Towards Augmented Reality Support for Swarm Monitoring: Evaluating Visual Cues to Prevent Fragmentation

Swarm fragmentation, the breakdown of communication and coordination among robots, can critically compromise a swarm's mission. Integrating Augmented Reality support into swarm monitoring-especially through co-located visualisations anchored directly on the robots- may enable human operators to detect early signs of fragmentation and intervene effectively. In this work, we propose three localised visual cues-targeting robot connectivity, dominant decision influences, and movement direction-to make explicit the underlying Perception-Decision-Action (PDA) loop of each robot. Through an immersive Virtual Reality user study, 51 participants were tasked with both anticipating potential fragmentation and selecting the appropriate control to prevent it, while observing swarms exhibiting expansion, densification, flocking, and swarming behaviours. Our results reveal that a visualisation emphasising inter-robot connectivity significantly improves anticipation of fragmentation, though none of the cues consistently enhance control selection over a baseline condition. These findings underscore the potential of co-located AR-enhanced visual feedback to support human-swarm interaction and inform the design of future AR-based supervisory systems for robot swarms. A free copy of this paper and all supplemental materials are available at https://osf.io/49gny.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Visualization and Computer Graphics
Published
2025-10-02
DOI
https://doi.org/10.1109/tvcg.2025.3616840
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Towards Augmented Reality Support for Swarm Monitoring: Evaluating Visual Cues to Prevent Fragmentation

Aymeric Hénard, Jérémy Rivière, Étienne Peillard, Gilles Coppin et al.
IEEE Transactions on Visualization and Computer Graphics
Scientific Computing and Data Management
article

Towards Augmented Reality Support for Swarm Monitoring: Evaluating Visual Cues to Prevent Fragmentation

Aymeric Hénard, Jérémy Rivière, Étienne Peillard, Gilles Coppin, Sébastien Kubicki
article en

Abstract

Swarm fragmentation, the breakdown of communication and coordination among robots, can critically compromise a swarm's mission. Integrating Augmented Reality support into swarm monitoring-especially through co-located visualisations anchored directly on the robots- may enable human operators to detect early signs of fragmentation and intervene effectively. In this work, we propose three localised visual cues-targeting robot connectivity, dominant decision influences, and movement direction-to make explicit the underlying Perception-Decision-Action (PDA) loop of each robot. Through an immersive Virtual Reality user study, 51 participants were tasked with both anticipating potential fragmentation and selecting the appropriate control to prevent it, while observing swarms exhibiting expansion, densification, flocking, and swarming behaviours. Our results reveal that a visualisation emphasising inter-robot connectivity significantly improves anticipation of fragmentation, though none of the cues consistently enhance control selection over a baseline condition. These findings underscore the potential of co-located AR-enhanced visual feedback to support human-swarm interaction and inform the design of future AR-based supervisory systems for robot swarms. A free copy of this paper and all supplemental materials are available at https://osf.io/49gny.

IEEE Transactions on Visualization and Computer GraphicsVol. 31(11)
Centre National de la Recherche Scientifique (FR), Université de Bretagne Occidentale (FR), École nationale d'ingénieurs de Brest (FR), Laboratoire des Sciences et Techniques de l’Information de la Communication et de la Connaissance (FR), IMT Atlantique (FR)
Openalex Percentile: Top 74%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.