EMPOWERING HUMAN-LIKE NON-PLAYER CHARACTER INTERACTIONS IN VIRTUAL REALITY THROUGH LARGE LANGUAGE MODELS

This research paper explores the integration of Large Language Models (LLMs) into Virtual Reality (VR) environments to enhance human-like interactions with non-player Characters (NPCs) in professional training simulations. Current VR systems suffer from repetitive, scripted dialogues that lack naturalness and adaptability, reducing user engagement and learning outcomes. To address this, the study developed a proof-of-concept VR system using state-of-the-art LLMs, including GPT-4, Claude 3.5, and Large Language Model Meta AI (LLAMA), evaluated through the Massive Multitask Language Understanding (MMLU) benchmark. The Agile methodology was employed to iteratively refine the system based on user feedback, optimising NPC interactions for contextual relevance and realism. Results demonstrated significant improvements in naturalness, engagement, and context maintenance, with LLaMA-powered NPCs outperforming others in user acceptance testing. These findings underscore the potential of LLMs to revolutionise VR based training by delivering lifelike, context-aware dialogues and provide a robust foundation for future research in AI-driven immersive environments.

Authors

Institutions

Publication Details

Journal
Platform A Journal of Science and Technology
Published
2024-12-31
DOI
https://doi.org/10.61762/pjstvol7iss2art003
Citations
1
Primary Topic
Human Motion and Animation
Type
article
Field-Weighted Citation Impact
0.33
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

EMPOWERING HUMAN-LIKE NON-PLAYER CHARACTER INTERACTIONS IN VIRTUAL REALITY THROUGH LARGE LANGUAGE MODELS

Noreen Izza Arshad, Ahmad Mukhlason, Haarinesh Selvaraju, Faizal Mahananto
1 citations
Platform A Journal of Science and Technology
Human Motion and Animation
0.33
article

EMPOWERING HUMAN-LIKE NON-PLAYER CHARACTER INTERACTIONS IN VIRTUAL REALITY THROUGH LARGE LANGUAGE MODELS

Noreen Izza Arshad, Ahmad Mukhlason, Haarinesh Selvaraju, Faizal Mahananto
article en
1 citations

Abstract

This research paper explores the integration of Large Language Models (LLMs) into Virtual Reality (VR) environments to enhance human-like interactions with non-player Characters (NPCs) in professional training simulations. Current VR systems suffer from repetitive, scripted dialogues that lack naturalness and adaptability, reducing user engagement and learning outcomes. To address this, the study developed a proof-of-concept VR system using state-of-the-art LLMs, including GPT-4, Claude 3.5, and Large Language Model Meta AI (LLAMA), evaluated through the Massive Multitask Language Understanding (MMLU) benchmark. The Agile methodology was employed to iteratively refine the system based on user feedback, optimising NPC interactions for contextual relevance and realism. Results demonstrated significant improvements in naturalness, engagement, and context maintenance, with LLaMA-powered NPCs outperforming others in user acceptance testing. These findings underscore the potential of LLMs to revolutionise VR based training by delivering lifelike, context-aware dialogues and provide a robust foundation for future research in AI-driven immersive environments.

Platform A Journal of Science and Technology
Universiti Teknologi Petronas (MY)
Openalex Percentile: Top 35%
Human Motion and Animation
0.33
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

EMPOWERING HUMAN-LIKE NON-PLAYER CHARACTER INTERACTIONS IN VIRTUAL REALITY THROUGH LARGE LANGUAGE MODELS — Noreen Izza Arshad, Ahmad Mukhlason, et al. · Platform A Journal of Science and Technology (2024) | TGRS Research Map | TGRS