PerforMagic: Coordinating Bodily Performance and Camera Movement in AI Video Creation
Performance-driven AI video creation allows users to express ideas through bodily action, but it also requires performers to coordinate embodied performance with camera movement. For solo creators, managing this coordination in real time can be cognitively demanding and limits cinematic exploration. We present PerforMagic, an interactive system that explores how coordination between performance and camera movement can be supported through a re-filming interaction. Users first record their performance without explicitly controlling the camera. The system then reconstructs the performance in a virtual environment, enabling users to reason about and explore camera movements in relation to their embodied actions. Through a user study, participants reported clearer relationships between performance and camera movement, less pressure during performance, and broader exploration of camera techniques. Our work contributes an interaction concept for coordinating embodied action and cinematography in performance-driven AI video creation and offers qualitative insights into how staged interaction supports expressive control.
Authors
- Anca-Simona Horvath (ORCID: https://orcid.org/0000-0001-5371-5657)
- Liang Chen (ORCID: https://orcid.org/0000-0003-0579-2716)
- Tianzhao Lin (ORCID: https://orcid.org/0009-0002-3473-5155)
- Shuyue Li
- Yue Hong (ORCID: https://orcid.org/0009-0001-9940-1650)
- Yufeng Zeng (ORCID: https://orcid.org/0009-0003-7609-3477)
Institutions
- University of Hong Kong (HK)
- South China University of Technology (CN)
Publication Details
- Published
- 2026-04-13
- DOI
- https://doi.org/10.1145/3772363.3798782
- Primary Topic
- Social Robot Interaction and HRI
- Type
- article
- Field-Weighted Citation Impact
- 0.00