A Mixed Reality Ground Control Station for MUM-T and Multi-UAV Operations

This paper presents a novel Mixed Reality (MR)-based Ground Control Station (GCS), designed for Manned-Unmanned Teaming (MUM-T) and scalable multi-UAV operations. The system utilizes Microsoft HoloLens 2 as an immersive operator interface, integrating real-time visual feedback and dual control inputs (UI/Speech). To ensure reliable, independent control of multiple drones within a shared ROS Master environment, we propose and implement a Prefix-based Control Logic. Furthermore, we replace the bottleneck-prone ROS Topic video relay with a decentralized WebRTC P2P streaming pipeline to maintain concurrent video stability. The experimental evaluation focused on the system's core capabilities, confirming a 100\% control command success rate across both UI and Speech modes, and demonstrating exceptional video stability (average 29.7 FPS at 1280x720) across dual streams during active maneuvering. These results validate the efficacy of the proposed architectural solutions for reliable, scalable multi-agent control and monitoring in mission-critical MR environments.

Authors

Publication Details

Journal
The Journal of Korean Institute of Communications and Information Sciences
Published
2026-04-23
DOI
https://doi.org/10.7840/kics.2026.51.4.909
Primary Topic
Space Exploration and Technology
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Mixed Reality Ground Control Station for MUM-T and Multi-UAV Operations

Jinsu Park, Daniar Estu Widiyanti, Soo-Young Shin
The Journal of Korean Institute of Communications and Information Sciences
Space Exploration and Technology
article

A Mixed Reality Ground Control Station for MUM-T and Multi-UAV Operations

Jinsu Park, Daniar Estu Widiyanti, Soo-Young Shin
article en

Abstract

This paper presents a novel Mixed Reality (MR)-based Ground Control Station (GCS), designed for Manned-Unmanned Teaming (MUM-T) and scalable multi-UAV operations. The system utilizes Microsoft HoloLens 2 as an immersive operator interface, integrating real-time visual feedback and dual control inputs (UI/Speech). To ensure reliable, independent control of multiple drones within a shared ROS Master environment, we propose and implement a Prefix-based Control Logic. Furthermore, we replace the bottleneck-prone ROS Topic video relay with a decentralized WebRTC P2P streaming pipeline to maintain concurrent video stability. The experimental evaluation focused on the system's core capabilities, confirming a 100\% control command success rate across both UI and Speech modes, and demonstrating exceptional video stability (average 29.7 FPS at 1280x720) across dual streams during active maneuvering. These results validate the efficacy of the proposed architectural solutions for reliable, scalable multi-agent control and monitoring in mission-critical MR environments.

The Journal of Korean Institute of Communications and Information SciencesVol. 51(4)
Openalex Percentile: Top 2%
Space Exploration and Technology
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.