DBCON: Dual Bias Control in Zero-Shot Video Moment Retrieval

Zero-shot Video Moment Retrieval (ZVMR) is a task that localizes temporal moments within a video using only natural language queries, without requiring large-scale datasets or extensive training resources. While previous ZVMR studies have focused on aligning high-quality video and query representations, they have faced performance limitations by overlooking the ‘Dual Bias’ problem, which arises from the excessive specificity of queries and the generality of video captions. To address this challenge, we propose the DBCON (Dual Bias CONtrol) framework, which simultaneously controls caption specificity and query generalization. DBCON employs ‘Query-Aware Caption Refinement’ to induce captions that explicitly reflect the core information of the query, and ‘Query Debiasing’ to rephrase the user query into a more universal expression via an LLM. Our experiments show that DBCON effectively mitigates this dual bias, achieving up to 1.73% higher retrieval accuracy on mAP@avg compared to the state-of-the-art model on the QVHighlights test benchmark. This study is significant as it presents a new direction for developing scalable and efficient video-language retrieval systems.

Authors

Institutions

Publication Details

Journal
IEEE Access
Published
2025-01-01
DOI
https://doi.org/10.1109/access.2025.3613635
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

DBCON: Dual Bias Control in Zero-Shot Video Moment Retrieval

Mingyu Jeon, Junyeong Kim, Minuk Ma
IEEE Access
Multimodal Machine Learning Applications
article

DBCON: Dual Bias Control in Zero-Shot Video Moment Retrieval

Mingyu Jeon, Junyeong Kim, Minuk Ma
article en

Abstract

Zero-shot Video Moment Retrieval (ZVMR) is a task that localizes temporal moments within a video using only natural language queries, without requiring large-scale datasets or extensive training resources. While previous ZVMR studies have focused on aligning high-quality video and query representations, they have faced performance limitations by overlooking the ‘Dual Bias’ problem, which arises from the excessive specificity of queries and the generality of video captions. To address this challenge, we propose the DBCON (Dual Bias CONtrol) framework, which simultaneously controls caption specificity and query generalization. DBCON employs ‘Query-Aware Caption Refinement’ to induce captions that explicitly reflect the core information of the query, and ‘Query Debiasing’ to rephrase the user query into a more universal expression via an LLM. Our experiments show that DBCON effectively mitigates this dual bias, achieving up to 1.73% higher retrieval accuracy on mAP@avg compared to the state-of-the-art model on the QVHighlights test benchmark. This study is significant as it presents a new direction for developing scalable and efficient video-language retrieval systems.

IEEE AccessVol. 13
University of British Columbia (CA), Chung-Ang University (KR)
Openalex Percentile: Top 74%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.