LLMs on XR (LoXR): Performance Evaluation of LLMs Executed Locally on Extended Reality Devices

We evaluate 17 LLMs across four XR devices—Magic Leap 2, Meta Quest 3, Vivo X100s Pro, and Apple Vision Pro—assessing performance on key metrics: consistency, processing speed, and battery consumption. Our experimental setup examines 68 model-device pairs under varying string lengths, batch sizes, and thread counts, providing insights into trade-offs for real-time XR applications. Our findings offer guidance for optimizing LLM deployment on XR devices and establish a foundation for future research in this rapidly evolving field.

Authors

Institutions

Publication Details

Published
2025-03-08
DOI
https://doi.org/10.1109/vrw66409.2025.00252
Primary Topic
Advanced Data Storage Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LLMs on XR (LoXR): Performance Evaluation of LLMs Executed Locally on Extended Reality Devices

Donggang Jia, Xinyu Liu, Ivan Viola, Alexandre Kouyoumdjian et al.
Advanced Data Storage Technologies
article

LLMs on XR (LoXR): Performance Evaluation of LLMs Executed Locally on Extended Reality Devices

Donggang Jia, Xinyu Liu, Ivan Viola, Alexandre Kouyoumdjian, Dawar Khan, Omar Mena
article en

Abstract

We evaluate 17 LLMs across four XR devices—Magic Leap 2, Meta Quest 3, Vivo X100s Pro, and Apple Vision Pro—assessing performance on key metrics: consistency, processing speed, and battery consumption. Our experimental setup examines 68 model-device pairs under varying string lengths, batch sizes, and thread counts, providing insights into trade-offs for real-time XR applications. Our findings offer guidance for optimizing LLM deployment on XR devices and establish a foundation for future research in this rapidly evolving field.

King Abdullah University of Science and Technology (SA)
Openalex Percentile: Top 92%
Advanced Data Storage Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.