Spatially-Precise Video Editing with Reference Imitation: A Region-Aware Cross-Modal Framework
Video content is widely applied in the multimedia field. Meanwhile, artificial intelligence generative content (AIGC) is continuously developing. As a result, video editing techniques in the field of computer vision are constantly evolving. However, at present, there are still numerous challenges in achieving fine-grained local editing of videos and maintaining temporal consistency.In this paper, we propose a novel framework for local video editing that integrates image-based local editing techniques with CoDeF (Content Deformation Field). Unlike existing methods, our approach explicitly models temporal deformation, ensuring spatial precision in local edits while maintaining high temporal consistency. Our framework first utilizes CoDeF to generate canonical images that aggregate static video content while preserving semantic integrity. A dual diffusion-based local editing module is then applied to modify these canonical images with user-specified editing regions and reference images. Finally, the learned temporal deformation field propagates the edits back to the entire video, achieving coherent and seamless video editing. Extensive experiments demonstrate that our method outperforms state-of-the-art approaches in both editing quality and user satisfaction, offering a significant improvement in local precision and temporal stability.
Authors
- Yang Lei (ORCID: https://orcid.org/0000-0002-3572-0345)
- Kai Yang (ORCID: https://orcid.org/0000-0002-6540-7480)
- Ying Yang (ORCID: https://orcid.org/0000-0002-8927-3878)
- Qibin Cui
Institutions
- Guangxi University (CN)
- Guangxi Academy of Sciences (CN)
Publication Details
- Journal
- Applied Sciences
- Published
- 2025-04-15
- DOI
- https://doi.org/10.3390/app15084349
- Primary Topic
- Video Analysis and Summarization
- Type
- article
- Field-Weighted Citation Impact
- 0.00