Are We Measuring What Matters? Reframing Evaluation of Extended Reality for Industry 5.0 Work Environments

Current approaches to evaluating extended reality (XR) systems in industrial settings are narrowly focused on usability, device performance, or user experience, while overlooking broader systemic impacts. We argue that this limited scope is misaligned with the challenges and values of future workspaces. As XR technologies become more integrated into manufacturing and training environments, evaluation methods must expand to reflect the principles of Industry 5.0: human-centricity, sustainability, and resilience. In this position paper, we propose a multi-dimensional evaluation framework that incorporates task-technology fit alongside environmental, human, and operational criteria. The proposed framework enables structured, phase-specific assessment of XR systems to guide responsible deployment and adoption. We call on the XR research community to shift from fragmented metrics toward holistic evaluation practices that ensure XR contributes to more efficient, equitable, regenerative, and future-ready work environments.

Authors

Institutions

Publication Details

Published
2025-10-08
DOI
https://doi.org/10.1109/ismar-adjunct68609.2025.00050
Citations
1
Primary Topic
Augmented Reality Applications
Type
article
Field-Weighted Citation Impact
1.28
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Are We Measuring What Matters? Reframing Evaluation of Extended Reality for Industry 5.0 Work Environments

Gopika Premsankar, Xinyi Tu, Miran Ghafoori
1 citations
Augmented Reality Applications
1.28
article

Are We Measuring What Matters? Reframing Evaluation of Extended Reality for Industry 5.0 Work Environments

Gopika Premsankar, Xinyi Tu, Miran Ghafoori
article en
1 citations

Abstract

Current approaches to evaluating extended reality (XR) systems in industrial settings are narrowly focused on usability, device performance, or user experience, while overlooking broader systemic impacts. We argue that this limited scope is misaligned with the challenges and values of future workspaces. As XR technologies become more integrated into manufacturing and training environments, evaluation methods must expand to reflect the principles of Industry 5.0: human-centricity, sustainability, and resilience. In this position paper, we propose a multi-dimensional evaluation framework that incorporates task-technology fit alongside environmental, human, and operational criteria. The proposed framework enables structured, phase-specific assessment of XR systems to guide responsible deployment and adoption. We call on the XR research community to shift from fragmented metrics toward holistic evaluation practices that ensure XR contributes to more efficient, equitable, regenerative, and future-ready work environments.

Aalto University (FI)
Openalex Percentile: Top 14%
Augmented Reality Applications
1.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.