MR-MultiTwin: A Mixed Reality Platform for Multi-User Control of Industrial Digital Twins
As Industry 5.0 accelerates, real-time, multi-user collaboration with digital twins (DTs) becomes increasingly essential. However, current systems struggle with spatial synchro-nization, collaborative execution, and natural interaction at scale. We introduce MR-MultiTwin, a mixed reality (MR) platform that addresses these gaps through three key innovations: (1) a shared-anchor-based spatial mapping method for aligning multi-user locations within a unified coordinate system; (2) a role-based collaboration framework that synchronizes task states, user identities, and control rights in real time; and (3) AI-powered multimodal interaction, integrating gesture, gaze, and voice for seamless DT control. Built on an edge-cloud architecture, MR-MultiTwin has been validated in smart manufacturing and inspection scenarios, showing notable gains in coordination effi-ciency, interaction usability, and deployment feasibility-paving the way for scalable industrial MR systems.
Authors
- Xiaojun Liang (ORCID: https://orcid.org/0000-0003-1712-7983)
- Zhenyu He (ORCID: https://orcid.org/0000-0002-2546-8721)
- Weichao Luo (ORCID: https://orcid.org/0000-0001-8731-3445)
- Cong Liu
- Xiaoning Zhang (ORCID: https://orcid.org/0009-0000-4564-2187)
Institutions
- Peng Cheng Laboratory (CN)
Publication Details
- Published
- 2025-07-11
- DOI
- https://doi.org/10.1109/ieeeconf65522.2025.11137033
- Primary Topic
- Digital Transformation in Industry
- Type
- article
- Field-Weighted Citation Impact
- 0.00