PerforMagic: Coordinating Bodily Performance and Camera Movement in AI Video Creation

Performance-driven AI video creation allows users to express ideas through bodily action, but it also requires performers to coordinate embodied performance with camera movement. For solo creators, managing this coordination in real time can be cognitively demanding and limits cinematic exploration. We present PerforMagic, an interactive system that explores how coordination between performance and camera movement can be supported through a re-filming interaction. Users first record their performance without explicitly controlling the camera. The system then reconstructs the performance in a virtual environment, enabling users to reason about and explore camera movements in relation to their embodied actions. Through a user study, participants reported clearer relationships between performance and camera movement, less pressure during performance, and broader exploration of camera techniques. Our work contributes an interaction concept for coordinating embodied action and cinematography in performance-driven AI video creation and offers qualitative insights into how staged interaction supports expressive control.

Authors

Institutions

Publication Details

Published
2026-04-13
DOI
https://doi.org/10.1145/3772363.3798782
Primary Topic
Social Robot Interaction and HRI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

PerforMagic: Coordinating Bodily Performance and Camera Movement in AI Video Creation

Anca-Simona Horvath, Liang Chen, Tianzhao Lin, Shuyue Li et al.
Social Robot Interaction and HRI
article

PerforMagic: Coordinating Bodily Performance and Camera Movement in AI Video Creation

Anca-Simona Horvath, Liang Chen, Tianzhao Lin, Shuyue Li, Yue Hong, Yufeng Zeng
article en

Abstract

Performance-driven AI video creation allows users to express ideas through bodily action, but it also requires performers to coordinate embodied performance with camera movement. For solo creators, managing this coordination in real time can be cognitively demanding and limits cinematic exploration. We present PerforMagic, an interactive system that explores how coordination between performance and camera movement can be supported through a re-filming interaction. Users first record their performance without explicitly controlling the camera. The system then reconstructs the performance in a virtual environment, enabling users to reason about and explore camera movements in relation to their embodied actions. Through a user study, participants reported clearer relationships between performance and camera movement, less pressure during performance, and broader exploration of camera techniques. Our work contributes an interaction concept for coordinating embodied action and cinematography in performance-driven AI video creation and offers qualitative insights into how staged interaction supports expressive control.

University of Hong Kong (HK), South China University of Technology (CN)
Openalex Percentile: Top 16%
Social Robot Interaction and HRI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

PerforMagic: Coordinating Bodily Performance and Camera Movement in AI Video Creation — Anca-Simona Horvath, Liang Chen, et al. · (2026) | TGRS Research Map | TGRS