Diffusion-driven key segment generation via progressive boundary optimization for partially relevant video retrieval

Partially Relevant Video Retrieval (PRVR) aims to retrieve related videos from a large collection of untrimmed videos. However, existing methods suffer from redundant candidate generation and fixed-length constraints. This paper presents the first diffusion-driven framework for PRVR, addressing two critical challenges: diffusion target ambiguity and the computation-performance trade-off. First, we redefine the diffusion target as boundary coordinates through a conditional Markov process, enabling the differentiable modeling of continuous boundary variables with geometric constraints to ensure temporal coherence. Second, we propose a progressive boundary refinement strategy that balances exploration (high noise) and exploitation (low noise) through adaptive noise scheduling. This mechanism allows for broad boundary search in early iterations and precise adjustment in later stages. Experiments demonstrate that our approach reduces redundant candidates by 99% compared to sliding-window methods and achieves 44% faster training than MS-SL on Charades-STA. The results validate the effectiveness of diffusion models in PRVR tasks.

Authors

Institutions

Publication Details

Published
2025-08-11
DOI
https://doi.org/10.1117/12.3072530
Primary Topic
Advanced Image and Video Retrieval Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Diffusion-driven key segment generation via progressive boundary optimization for partially relevant video retrieval

Dikai Fang, Huahu Xu, Shijie Wang
Advanced Image and Video Retrieval Techniques
article

Diffusion-driven key segment generation via progressive boundary optimization for partially relevant video retrieval

Dikai Fang, Huahu Xu, Shijie Wang
article en

Abstract

Partially Relevant Video Retrieval (PRVR) aims to retrieve related videos from a large collection of untrimmed videos. However, existing methods suffer from redundant candidate generation and fixed-length constraints. This paper presents the first diffusion-driven framework for PRVR, addressing two critical challenges: diffusion target ambiguity and the computation-performance trade-off. First, we redefine the diffusion target as boundary coordinates through a conditional Markov process, enabling the differentiable modeling of continuous boundary variables with geometric constraints to ensure temporal coherence. Second, we propose a progressive boundary refinement strategy that balances exploration (high noise) and exploitation (low noise) through adaptive noise scheduling. This mechanism allows for broad boundary search in early iterations and precise adjustment in later stages. Experiments demonstrate that our approach reduces redundant candidates by 99% compared to sliding-window methods and achieves 44% faster training than MS-SL on Charades-STA. The results validate the effectiveness of diffusion models in PRVR tasks.

Shanghai University (CN)
Openalex Percentile: Top 80%
Advanced Image and Video Retrieval Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Diffusion-driven key segment generation via progressive boundary optimization for partially relevant video retrieval — Dikai Fang, Huahu Xu, et al. · (2025) | TGRS Research Map | TGRS