Movie101v2: Improved Movie Narration Benchmark

Automatic movie narration aims to generate video-aligned plot descriptions to assist visually impaired audiences.Unlike standard video captioning, it involves not only describing key visual details but also inferring plots that unfold across multiple movie shots, presenting distinct and complex challenges.To advance this field, we introduce Movie101v2, a largescale, bilingual dataset with enhanced data quality specifically designed for movie narration.Revisiting the task, we propose breaking down the ultimate goal of automatic movie narration into three progressive stages, offering a clear roadmap with corresponding evaluation metrics.Based on our new benchmark, we baseline a range of large vision-language models and conduct an in-depth analysis of the challenges in movie narration generation.Our findings highlight that achieving applicable movie narration generation is a fascinating goal that requires significant research.

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.acl-long.836
Primary Topic
Multimedia Communication and Technology
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Movie101v2: Improved Movie Narration Benchmark

Qin Jin, Zhang Yepeng, Ziheng Wang, Zihao Yue
Multimedia Communication and Technology
article

Movie101v2: Improved Movie Narration Benchmark

Qin Jin, Zhang Yepeng, Ziheng Wang, Zihao Yue
article en

Abstract

Automatic movie narration aims to generate video-aligned plot descriptions to assist visually impaired audiences.Unlike standard video captioning, it involves not only describing key visual details but also inferring plots that unfold across multiple movie shots, presenting distinct and complex challenges.To advance this field, we introduce Movie101v2, a largescale, bilingual dataset with enhanced data quality specifically designed for movie narration.Revisiting the task, we propose breaking down the ultimate goal of automatic movie narration into three progressive stages, offering a clear roadmap with corresponding evaluation metrics.Based on our new benchmark, we baseline a range of large vision-language models and conduct an in-depth analysis of the challenges in movie narration generation.Our findings highlight that achieving applicable movie narration generation is a fascinating goal that requires significant research.

Renmin University of China (CN)
Renmin University of China
Openalex Percentile: Top 74%
Multimedia Communication and Technology
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.