Worldhat: A Humanoid Social Robot Interpreter for Multilingual Dyadic Conversations

Language barriers continue to hinder non-native speakers’ access to essential public services, where effective communication is crucial. While mobile translation apps are common, they often fall short in socially complex settings due to the lack of non-verbal cues, disrupting conversational flow and weakening interpersonal connection. This demonstration introduces Worldhat, a humanoid robot interpreter that supports real-time multilingual communication through speech translation and embodied interaction. Built on the Furhat SDK, Worldhat integrates speech recognition, machine translation, and speech output, simulating the social behaviors of a human interpreter. It highlights how embodied interaction can enhance translation systems. Future work includes automatic language detection and deeper exploration of robot embodiment.

Publication Details

Journal
Gesellschaft für Informatik (GI)
Published
2025-01-01
DOI
https://doi.org/10.18420/muc2025-mci-demo-298
Primary Topic
Geochemistry and Geologic Mapping
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Worldhat: A Humanoid Social Robot Interpreter for Multilingual Dyadic Conversations

Gesellschaft für Informatik (GI)
Geochemistry and Geologic Mapping
article

Worldhat: A Humanoid Social Robot Interpreter for Multilingual Dyadic Conversations

article en

Abstract

Language barriers continue to hinder non-native speakers’ access to essential public services, where effective communication is crucial. While mobile translation apps are common, they often fall short in socially complex settings due to the lack of non-verbal cues, disrupting conversational flow and weakening interpersonal connection. This demonstration introduces Worldhat, a humanoid robot interpreter that supports real-time multilingual communication through speech translation and embodied interaction. Built on the Furhat SDK, Worldhat integrates speech recognition, machine translation, and speech output, simulating the social behaviors of a human interpreter. It highlights how embodied interaction can enhance translation systems. Future work includes automatic language detection and deeper exploration of robot embodiment.

Gesellschaft für Informatik (GI)
Quality Education
Openalex Percentile: Top 69%
Geochemistry and Geologic Mapping
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.