Decoupling Performance and Effects in Virtual Production via AI-driven Post-Production

To address the structural conflict in Virtual Production (VP) between real-time rendering pipelines and the demands of nonlinear performance and complex visual effects creation, this paper proposes a Lighting-Guided Generative Workflow (LGGW). The core of this approach lies in temporal decoupling: controllable DMX-based physical lighting is used as both an on-set interaction medium and a post-generation anchor, allowing high-risk visual effects to be detached from real-time rendering. Empirical evidence from the sci-fi short film sequence “Meteor Fall” demonstrates that this workflow enables generative AI to asynchronously complete footage embedded with lighting cues, achieving pixel-level integration and compressing production time from days to hours. By preserving lighting coherence and performance authenticity, LGGW introduces a new paradigm for cost-effective hybrid production that integrates physical and virtual elements.

Authors

Publication Details

Journal
Journal of Korea Multimedia Society
Published
2026-02-28
DOI
https://doi.org/10.9717/kmms.2026.29.2.251
Primary Topic
Manufacturing Process and Optimization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Decoupling Performance and Effects in Virtual Production via AI-driven Post-Production

Yun Ji, Sunghoon Cho, Jiani Zhou, Guhee Yoon
Journal of Korea Multimedia Society
Manufacturing Process and Optimization
article

Decoupling Performance and Effects in Virtual Production via AI-driven Post-Production

Yun Ji, Sunghoon Cho, Jiani Zhou, Guhee Yoon
article en

Abstract

To address the structural conflict in Virtual Production (VP) between real-time rendering pipelines and the demands of nonlinear performance and complex visual effects creation, this paper proposes a Lighting-Guided Generative Workflow (LGGW). The core of this approach lies in temporal decoupling: controllable DMX-based physical lighting is used as both an on-set interaction medium and a post-generation anchor, allowing high-risk visual effects to be detached from real-time rendering. Empirical evidence from the sci-fi short film sequence “Meteor Fall” demonstrates that this workflow enables generative AI to asynchronously complete footage embedded with lighting cues, achieving pixel-level integration and compressing production time from days to hours. By preserving lighting coherence and performance authenticity, LGGW introduces a new paradigm for cost-effective hybrid production that integrates physical and virtual elements.

Journal of Korea Multimedia SocietyVol. 29(2)
Openalex Percentile: Top 13%
Manufacturing Process and Optimization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.