"Because we are human, we use hands": Understanding People's Expectations and Mental Models of Virtual Object Interaction in AR Headsets

Augmented reality (AR) headsets are increasingly being used by people in a range of contexts.However, there are still open research questions on how people expect to interact with virtual objects in AR headsets, which limits our ability to design intuitive applications.We conducted an unconstrained elicitation study with 30 adults, in which participants showed how they would interact with a virtual cube in an AR headset.We did not constrain participants to a specific interaction technique (e.g., gestures vs. speech) and asked them open-ended questions to better understand their reasoning.For this paper, we focus on understanding the participants' expectations and mental models.Participants based their interactions on pop-culture, real-world experiences, and expected an immersive physically-engaging environment that follows the laws of physics.Our work contributes a deeper understanding of people's perceptions and expectations of interacting with AR headsets.We provide recommendations for designing future AR headset experiences.

Authors

Institutions

Publication Details

Published
2025-04-25
DOI
https://doi.org/10.1145/3706599.3719691
Primary Topic
Augmented Reality Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

"Because we are human, we use hands": Understanding People's Expectations and Mental Models of Virtual Object Interaction in AR Headsets

Julia Woodward, Armando Luiz N. Delgado, Hinal Shah, Md Mehedi Hasan Jibon et al.
Augmented Reality Applications
article

"Because we are human, we use hands": Understanding People's Expectations and Mental Models of Virtual Object Interaction in AR Headsets

Julia Woodward, Armando Luiz N. Delgado, Hinal Shah, Md Mehedi Hasan Jibon, Anzhelika Kurnikova, Fareeza Rahman
article en

Abstract

Augmented reality (AR) headsets are increasingly being used by people in a range of contexts.However, there are still open research questions on how people expect to interact with virtual objects in AR headsets, which limits our ability to design intuitive applications.We conducted an unconstrained elicitation study with 30 adults, in which participants showed how they would interact with a virtual cube in an AR headset.We did not constrain participants to a specific interaction technique (e.g., gestures vs. speech) and asked them open-ended questions to better understand their reasoning.For this paper, we focus on understanding the participants' expectations and mental models.Participants based their interactions on pop-culture, real-world experiences, and expected an immersive physically-engaging environment that follows the laws of physics.Our work contributes a deeper understanding of people's perceptions and expectations of interacting with AR headsets.We provide recommendations for designing future AR headset experiences.

University of South Florida (US)
Reduced inequalities
Openalex Percentile: Top 93%
Augmented Reality Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.