AnimateScene: Camera-Controllable Animation in Any Scene
Recent advances in 3D scene reconstruction and 4D human animation have broadened adoption, but integrating the two remains difficult. Key challenges include placing humans at plausible locations and scales without interpenetration, aligning lighting and style between humans and background, and handling dynamic camera trajectories. We introduce AnimateScene, a unified framework addressing these issues. First, an accurate placement module automatically determines realistic 3D positions and prevents collisions during motion. Second, we propose a training-free style alignment method that adapts the 4D human to match background illumination and appearance, achieving coherent composites. Finally, we design a joint post-reconstruction approach that incorporates camera trajectories for smooth, visually engaging motion videos. Experiments across diverse scenes and actions demonstrate that AnimateScene generates dynamic results with high geometric detail and strong spatiotemporal coherence. The project page is available at this https URL.
Authors
- Zelin Peng (ORCID: https://orcid.org/0009-0002-4066-7929)
- Li Niu (ORCID: https://orcid.org/0000-0003-1970-8634)
- Zhongqian Sun
- Weiheng Huang
- Shuai Yang (ORCID: https://orcid.org/0000-0001-8325-4994)
- Qianli Ma (ORCID: https://orcid.org/0000-0002-9356-2883)
- Haonan Zhao (ORCID: https://orcid.org/0009-0007-4125-2043)
- Jun Zhang (ORCID: https://orcid.org/0000-0001-7835-9871)
- Wei Yang (ORCID: https://orcid.org/0000-0003-2945-2898)
- Q. Liu (ORCID: https://orcid.org/0000-0002-5919-620X)
- Zhaohe Liao
Institutions
- Shanghai Jiao Tong University (CN)
- Tencent (China) (CN)
- East China Normal University (CN)
Publication Details
- Published
- 2026-04-21
- DOI
- https://doi.org/10.1109/icassp55912.2026.11462292
- Primary Topic
- Human Motion and Animation
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China