Multi-granularity Music-guided Movie Trailer Generation via Lightweight Foreground-background Decoupling
Music-driven movie trailer generation aims to produce coherent and engaging trailers guided by music. However, existing methods typically rely on either global or fine-grained music features and treat video scenes holistically, overlooking the distinct roles that foreground and background play in music-visual alignment. To address this, we propose a novel framework that enables deep interaction between multi-granularity music features and hierarchical foreground-background visual representations. We introduce a lightweight disentanglement module that separates visual features into semantically distinct foreground and background components with minimal computational cost and performs adaptive fusion. Furthermore, we design a pseudo-supervision strategy to provide weak semantic guidance for foreground-background separation. Experimental results on the CMTD dataset and our curated MovieNet-M dataset demonstrate that the proposed MDT model outperforms existing mainstream methods in both generation quality and music alignment.
Authors
- Xiao Juan Guo (ORCID: https://orcid.org/0000-0002-1744-4340)
- Sun Jing (ORCID: https://orcid.org/0000-0003-0217-0794)
- Yunwen Li
Institutions
- Communication University of China (CN)
Publication Details
- Published
- 2025-08-15
- DOI
- https://doi.org/10.1109/cvaa66438.2025.11193418
- Primary Topic
- Video Surveillance and Tracking Methods
- Type
- article
- Field-Weighted Citation Impact
- 0.00