Decoupling Performance and Effects in Virtual Production via AI-driven Post-Production
To address the structural conflict in Virtual Production (VP) between real-time rendering pipelines and the demands of nonlinear performance and complex visual effects creation, this paper proposes a Lighting-Guided Generative Workflow (LGGW). The core of this approach lies in temporal decoupling: controllable DMX-based physical lighting is used as both an on-set interaction medium and a post-generation anchor, allowing high-risk visual effects to be detached from real-time rendering. Empirical evidence from the sci-fi short film sequence “Meteor Fall” demonstrates that this workflow enables generative AI to asynchronously complete footage embedded with lighting cues, achieving pixel-level integration and compressing production time from days to hours. By preserving lighting coherence and performance authenticity, LGGW introduces a new paradigm for cost-effective hybrid production that integrates physical and virtual elements.
Authors
- Yun Ji
- Sunghoon Cho
- Jiani Zhou
- Guhee Yoon
Publication Details
- Journal
- Journal of Korea Multimedia Society
- Published
- 2026-02-28
- DOI
- https://doi.org/10.9717/kmms.2026.29.2.251
- Primary Topic
- Manufacturing Process and Optimization
- Type
- article
- Field-Weighted Citation Impact
- 0.00