BabbleMind: reducing nonverbal ambiguity via inner voice visualization in interaction with a baby-type robot

Therapeutic robots are widely used in eldercare to alleviate loneliness and support psychological well-being. Among them, baby-shaped robots are well accepted due to their familiar appearance. Their interactions mainly rely on nonverbal cues such as gestures and vocalizations. However, users who struggle to interpret these cues may have difficulty understanding the robot's intentions, reducing interaction quality. To address this issue, we propose BabbleMind, which visualizes a baby robot's intentions (inner voice) on an onboard display. BabbleMind combines Semantic Babbling with explicit inner-voice visualization to support intention understanding without altering nonverbal behavior. Experimental results showed that inner-voice visualization enhanced empathy, immersion, and trust. A case study with older adults further suggested improved intention understanding and interaction ease.

Authors

Institutions

Publication Details

Journal
Advanced Robotics
Published
2026-08-21
DOI
https://doi.org/10.1080/01691864.2026.2716459
Primary Topic
Social Robot Interaction and HRI
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

BabbleMind: reducing nonverbal ambiguity via inner voice visualization in interaction with a baby-type robot

Hidenobu Sumioka, Masahiro Shiomi, Michita Imai, Kohei Okuoka et al.
Advanced Robotics
Social Robot Interaction and HRI
article

BabbleMind: reducing nonverbal ambiguity via inner voice visualization in interaction with a baby-type robot

Hidenobu Sumioka, Masahiro Shiomi, Michita Imai, Kohei Okuoka, Takuto Akiyoshi, Ryuki Matsuoka, Serina Miyake
article en

Abstract

Therapeutic robots are widely used in eldercare to alleviate loneliness and support psychological well-being. Among them, baby-shaped robots are well accepted due to their familiar appearance. Their interactions mainly rely on nonverbal cues such as gestures and vocalizations. However, users who struggle to interpret these cues may have difficulty understanding the robot's intentions, reducing interaction quality. To address this issue, we propose BabbleMind, which visualizes a baby robot's intentions (inner voice) on an onboard display. BabbleMind combines Semantic Babbling with explicit inner-voice visualization to support intention understanding without altering nonverbal behavior. Experimental results showed that inner-voice visualization enhanced empathy, immersion, and trust. A case study with older adults further suggested improved intention understanding and interaction ease.

Advanced Robotics
Keio University (JP), Kyoto University (JP), Advanced Telecommunications Research Institute International (JP)
Tateishi Science and Technology Foundation
Openalex Percentile: Top 6%
Social Robot Interaction and HRI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.