RAGatar: Enhancing LLM-driven Avatars with RAG for Knowledge-Adaptive Conversations in Virtual Reality
We present a virtual reality system that enables users to seamlessly switch between general conversations and domain-specific knowledge retrieval through natural interactions with AI-driven avatars. By combining MetaHuman technology with self-hosted large language models and retrieval-augmented generation, our system demonstrates how immersive AI interactions can enhance learning and training applications where both general communication and expert knowledge are required.
Authors
- Alexander Marquardt (ORCID: https://orcid.org/0000-0002-2844-0804)
- David Golchinfar (ORCID: https://orcid.org/0000-0002-7785-3891)
- Daryoush Daniel Vaziri (ORCID: https://orcid.org/0000-0003-2025-9637)
Institutions
- Hochschule Bonn-Rhein-Sieg (DE)
Publication Details
- Published
- 2025-03-08
- DOI
- https://doi.org/10.1109/vrw66409.2025.00447
- Citations
- 2
- Primary Topic
- Intelligent Tutoring Systems and Adaptive Learning
- Type
- article
- Field-Weighted Citation Impact
- 4.96