A Study on the Interaction Between Humanoid Robots Equipped with Korean Dataset-Based Gesture Generation AI Models and Korean Users

Humanoid robots can interact effectively with humans through non-verbal expressions such as gestures. To generate non-verbal expressions such as gestures for humanoids, gesture generation AI models and datasets are essential. However, most publicly available gesture generation datasets are based on English and may not reflect the linguistic and cultural characteristics of non-English-speaking regions like Korea. To address this, we built a Korean-specific dataset and trained a gesture generation AI model. We implemented the humanoid robot AIMY in a simulation, applied the generated gestures to the AIMY, and conducted demonstrations with Korean users to evaluate the impact on human-robot interaction. The results demonstrate that gestures trained on Korean datasets better align with Korean non-verbal expressions and are preferred by Korean users compared to gestures based on English datasets, enhancing user experience and interaction quality.

Authors

Institutions

Publication Details

Published
2025-05-20
DOI
https://doi.org/10.1109/ecti-con64996.2025.11100804
Primary Topic
Social Robot Interaction and HRI
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Study on the Interaction Between Humanoid Robots Equipped with Korean Dataset-Based Gesture Generation AI Models and Korean Users

Jeakweon Han, Donghun Noh, Jeremy Yuhyun Kim, Jun‐Hai Yong
Social Robot Interaction and HRI
article

A Study on the Interaction Between Humanoid Robots Equipped with Korean Dataset-Based Gesture Generation AI Models and Korean Users

Jeakweon Han, Donghun Noh, Jeremy Yuhyun Kim, Jun‐Hai Yong
article en

Abstract

Humanoid robots can interact effectively with humans through non-verbal expressions such as gestures. To generate non-verbal expressions such as gestures for humanoids, gesture generation AI models and datasets are essential. However, most publicly available gesture generation datasets are based on English and may not reflect the linguistic and cultural characteristics of non-English-speaking regions like Korea. To address this, we built a Korean-specific dataset and trained a gesture generation AI model. We implemented the humanoid robot AIMY in a simulation, applied the generated gestures to the AIMY, and conducted demonstrations with Korean users to evaluate the impact on human-robot interaction. The results demonstrate that gestures trained on Korean datasets better align with Korean non-verbal expressions and are preferred by Korean users compared to gestures based on English datasets, enhancing user experience and interaction quality.

University of California, Los Angeles (US), Ansan University (KR), Hanyang University (KR)
Korea Institute for Advancement of Technology
Openalex Percentile: Top 76%
Social Robot Interaction and HRI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.