Understanding Social Engagement in Voice-User Interfaces: An Exploratory Study of Embodiment and Gestures

Human-robot interaction (HRI) researchers have been researching the social robot designs which intrigue engagement among users. Previous work has been mainly focused on the appearance of robots for user engagement. With voice being one of the common methods for interaction, it is important to understand how different embodiment and social cues can intrigue the engagement in voice-based interaction. This paper reports the controlled-lab study with 36 participants who completed an interactive session involving humanoid robot and voice user interface (VUI). Participants were randomly assigned to interact with one of three research conditions. We hypothesized that participants who interacted with social robot embedded with VUI and gestures would highly engage in the communication. However, the actual results indicate that voice-based interaction intrigued engagement among participants regardless of the embodiment. The findings suggest that the robot’s ability to have an interpersonal and natural conversation has stronger impacts on social engagement.

Authors

Institutions

Publication Details

Journal
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Published
2025-09-01
DOI
https://doi.org/10.1177/10711813251369354
Primary Topic
Social Robot Interaction and HRI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Understanding Social Engagement in Voice-User Interfaces: An Exploratory Study of Embodiment and Gestures

Hui Zheng, Eva Wiese, Navab Singh, Pattiya Mahapasuthanon et al.
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Social Robot Interaction and HRI
article

Understanding Social Engagement in Voice-User Interfaces: An Exploratory Study of Embodiment and Gestures

Hui Zheng, Eva Wiese, Navab Singh, Pattiya Mahapasuthanon, Vivian Genaro Motti, Levern Currie
article en

Abstract

Human-robot interaction (HRI) researchers have been researching the social robot designs which intrigue engagement among users. Previous work has been mainly focused on the appearance of robots for user engagement. With voice being one of the common methods for interaction, it is important to understand how different embodiment and social cues can intrigue the engagement in voice-based interaction. This paper reports the controlled-lab study with 36 participants who completed an interactive session involving humanoid robot and voice user interface (VUI). Participants were randomly assigned to interact with one of three research conditions. We hypothesized that participants who interacted with social robot embedded with VUI and gestures would highly engage in the communication. However, the actual results indicate that voice-based interaction intrigued engagement among participants regardless of the embodiment. The findings suggest that the robot’s ability to have an interpersonal and natural conversation has stronger impacts on social engagement.

Proceedings of the Human Factors and Ergonomics Society Annual MeetingVol. 69(1)
Google (United States) (US), George Mason University (US), Rare Book School (US), Technische Universität Berlin (DE), Virginia Tech (US)
Openalex Percentile: Top 73%
Social Robot Interaction and HRI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.