Real-Time Multilingual Museum Guidance with ConvAI and Unreal Engine 5

Immersive reconstructions of archaeological sites often present visitors with richly modelled environments but little opportunity for personalised inquiry. In a collaboration between the University of Genoa and the 3D Lab Factory, we present a pilot that augments the VR installation of the Museo Preistorico dei Balzi Rossi (Ventimiglia, Italy) with an AI-enhanced guide modelled on the Upper-Palaeolithic "Dame du Cavillon." The avatar blends a large-language-model dialogue engine with MetaHuman embodiment in Unreal Engine 5.5, drawing on a curated archaeological knowledge bank to keep every utterance historically grounded. Spoken interaction, gestural cues, and guided movement are orchestrated in real time, allowing the guide to answer questions in Italian, English, and French, escort visitors to points of interest, and gracefully deflect anachronistic prompts. The result is both a narrative anchor and a conversational interface that personalises the learning journey and demonstrates how AI-driven VR can deepen public engagement with archaeological heritage.

Authors

Institutions

Publication Details

Published
2025-09-08
DOI
https://doi.org/10.1109/ieee-ch65308.2025.11279512
Primary Topic
Social Robot Interaction and HRI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Real-Time Multilingual Museum Guidance with ConvAI and Unreal Engine 5

Gianni Vercelli, Daniele Zolezzi, Saverio Iacono, Matteo Scaramuzzino et al.
Social Robot Interaction and HRI
article

Real-Time Multilingual Museum Guidance with ConvAI and Unreal Engine 5

Gianni Vercelli, Daniele Zolezzi, Saverio Iacono, Matteo Scaramuzzino, Luca Martini, Gaia Lorenzoni
article en

Abstract

Immersive reconstructions of archaeological sites often present visitors with richly modelled environments but little opportunity for personalised inquiry. In a collaboration between the University of Genoa and the 3D Lab Factory, we present a pilot that augments the VR installation of the Museo Preistorico dei Balzi Rossi (Ventimiglia, Italy) with an AI-enhanced guide modelled on the Upper-Palaeolithic "Dame du Cavillon." The avatar blends a large-language-model dialogue engine with MetaHuman embodiment in Unreal Engine 5.5, drawing on a curated archaeological knowledge bank to keep every utterance historically grounded. Spoken interaction, gestural cues, and guided movement are orchestrated in real time, allowing the guide to answer questions in Italian, English, and French, escort visitors to points of interest, and gracefully deflect anachronistic prompts. The result is both a narrative anchor and a conversational interface that personalises the learning journey and demonstrates how AI-driven VR can deepen public engagement with archaeological heritage.

University of Genoa (IT)
Sustainable cities and communities
Openalex Percentile: Top 23%
Social Robot Interaction and HRI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Real-Time Multilingual Museum Guidance with ConvAI and Unreal Engine 5 — Gianni Vercelli, Daniele Zolezzi, et al. · (2025) | TGRS Research Map | TGRS