Multi-granularity Music-guided Movie Trailer Generation via Lightweight Foreground-background Decoupling

Music-driven movie trailer generation aims to produce coherent and engaging trailers guided by music. However, existing methods typically rely on either global or fine-grained music features and treat video scenes holistically, overlooking the distinct roles that foreground and background play in music-visual alignment. To address this, we propose a novel framework that enables deep interaction between multi-granularity music features and hierarchical foreground-background visual representations. We introduce a lightweight disentanglement module that separates visual features into semantically distinct foreground and background components with minimal computational cost and performs adaptive fusion. Furthermore, we design a pseudo-supervision strategy to provide weak semantic guidance for foreground-background separation. Experimental results on the CMTD dataset and our curated MovieNet-M dataset demonstrate that the proposed MDT model outperforms existing mainstream methods in both generation quality and music alignment.

Authors

Institutions

Publication Details

Published
2025-08-15
DOI
https://doi.org/10.1109/cvaa66438.2025.11193418
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-granularity Music-guided Movie Trailer Generation via Lightweight Foreground-background Decoupling

Xiao Juan Guo, Sun Jing, Yunwen Li
Video Surveillance and Tracking Methods
article

Multi-granularity Music-guided Movie Trailer Generation via Lightweight Foreground-background Decoupling

Xiao Juan Guo, Sun Jing, Yunwen Li
article en

Abstract

Music-driven movie trailer generation aims to produce coherent and engaging trailers guided by music. However, existing methods typically rely on either global or fine-grained music features and treat video scenes holistically, overlooking the distinct roles that foreground and background play in music-visual alignment. To address this, we propose a novel framework that enables deep interaction between multi-granularity music features and hierarchical foreground-background visual representations. We introduce a lightweight disentanglement module that separates visual features into semantically distinct foreground and background components with minimal computational cost and performs adaptive fusion. Furthermore, we design a pseudo-supervision strategy to provide weak semantic guidance for foreground-background separation. Experimental results on the CMTD dataset and our curated MovieNet-M dataset demonstrate that the proposed MDT model outperforms existing mainstream methods in both generation quality and music alignment.

Communication University of China (CN)
Openalex Percentile: Top 71%
Video Surveillance and Tracking Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Multi-granularity Music-guided Movie Trailer Generation via Lightweight Foreground-background Decoupling — Xiao Juan Guo, Sun Jing, et al. · (2025) | TGRS Research Map | TGRS