Design and Field Validation of a VR-Based RAG Historical NPC: Knowledge Grounding and Persona Grounding Can Fail Independently
Large language model (LLM)-based non-player characters (NPCs) can support unscripted historical dialogue, but their behavior in deployed educational virtual reality (VR) settings remains underexamined. This study reports the design and field validation of a self-hosted VR platform in which a retrieval-augmented generation (RAG) NPC, representing King Sejong the Great, engaged 42 international participants across 126 intercultural-learning sessions. The analytic corpus, reconstructed from retained session logs, comprised 104 sessions from 39 participants (2053 participant turns; 2053 NPC responses). Repetitive NPC response loops occurred in 33 sessions (31.7%), spanning 54 episodes and 190 responses, and co-occurred with learner-side transcript repetition in 31 of these sessions. The NPC maintained its first-person persona throughout the screened corpus, yet produced 30 biographical claims unsupported by the historical record: persona consistency did not ensure factual grounding. Prompt compliance varied by instruction type, and a post hoc implementation audit could not confirm that retrieved content contributed to individual responses. Together, these results identify persona grounding, knowledge grounding, retrieval observability, and session-level instrumentation as validation targets that deployed VR–LLM systems must address separately.
Authors
- Tack Woo (ORCID: https://orcid.org/0000-0003-4114-4556)
- Jiho Kim (ORCID: https://orcid.org/0000-0003-3022-4155)
- Yunjin Kim (ORCID: https://orcid.org/0000-0002-3674-6643)
- Gwuidong Ryu (ORCID: https://orcid.org/0009-0006-8441-5837)
Institutions
- Kyung Hee University (KR)
Publication Details
- Journal
- Applied Sciences
- Published
- 2026-10-29
- DOI
- https://doi.org/10.3390/app162110707
- Primary Topic
- Intelligent Tutoring Systems and Adaptive Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Ministry of Culture, Sports and Tourism
- Korea Creative Content Agency
- Ministry of Science and ICT, South Korea