A New Era of Visual Storytelling: Integrating Generative AI and XR in Undergraduate Virtual Production Pedagogy

As XR-based virtual production technologies evolve rapidly, they are redefining film and media production — offering new avenues for integrating technology and the arts in higher education. This paper proposes an innovative pedagogical model grounded in XR virtual production, structured around three pillars: narrative-driven design, generative AI integration, and project-based collaboration with industry. The model addresses limitations in traditional film curricula, including weak real-time interaction and a lack of interdisciplinary integration. A multi-tiered course framework is developed to combine spatial storytelling, real-time rendering, and intelligent content creation, enabling students to master emerging digital workflows. Through a dual-mentorship system involving both academic and industry experts, students gain hands-on experience in virtual cinematography and AI-driven scene generation. Case studies from institutional and external collaborations — such as XR recreations of cultural events and industry-facing student showcases — demonstrate the model’s practical viability. Further, strategies for faculty training, hardware investment, and resource sharing are proposed to support institutional implementation. The study offers a scalable roadmap for integrating XR education into applied arts programs, aiming to cultivate hybrid professionals equipped with narrative insight, technical fluency, and industry readiness.

Authors

Institutions

Publication Details

Journal
International Journal of High Speed Electronics and Systems
Published
2025-08-22
DOI
https://doi.org/10.1142/s0129156425409088
Primary Topic
Augmented Reality Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A New Era of Visual Storytelling: Integrating Generative AI and XR in Undergraduate Virtual Production Pedagogy

Sun Ke
International Journal of High Speed Electronics and Systems
Augmented Reality Applications
article

A New Era of Visual Storytelling: Integrating Generative AI and XR in Undergraduate Virtual Production Pedagogy

Sun Ke
article en

Abstract

As XR-based virtual production technologies evolve rapidly, they are redefining film and media production — offering new avenues for integrating technology and the arts in higher education. This paper proposes an innovative pedagogical model grounded in XR virtual production, structured around three pillars: narrative-driven design, generative AI integration, and project-based collaboration with industry. The model addresses limitations in traditional film curricula, including weak real-time interaction and a lack of interdisciplinary integration. A multi-tiered course framework is developed to combine spatial storytelling, real-time rendering, and intelligent content creation, enabling students to master emerging digital workflows. Through a dual-mentorship system involving both academic and industry experts, students gain hands-on experience in virtual cinematography and AI-driven scene generation. Case studies from institutional and external collaborations — such as XR recreations of cultural events and industry-facing student showcases — demonstrate the model’s practical viability. Further, strategies for faculty training, hardware investment, and resource sharing are proposed to support institutional implementation. The study offers a scalable roadmap for integrating XR education into applied arts programs, aiming to cultivate hybrid professionals equipped with narrative insight, technical fluency, and industry readiness.

International Journal of High Speed Electronics and Systems
School of Visual Arts (US)
Openalex Percentile: Top 79%
Augmented Reality Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A New Era of Visual Storytelling: Integrating Generative AI and XR in Undergraduate Virtual Production Pedagogy — Sun Ke · International Journal of High Speed Electronics and Systems (2025) | TGRS Research Map | TGRS