Diffusion-driven key segment generation via progressive boundary optimization for partially relevant video retrieval
Partially Relevant Video Retrieval (PRVR) aims to retrieve related videos from a large collection of untrimmed videos. However, existing methods suffer from redundant candidate generation and fixed-length constraints. This paper presents the first diffusion-driven framework for PRVR, addressing two critical challenges: diffusion target ambiguity and the computation-performance trade-off. First, we redefine the diffusion target as boundary coordinates through a conditional Markov process, enabling the differentiable modeling of continuous boundary variables with geometric constraints to ensure temporal coherence. Second, we propose a progressive boundary refinement strategy that balances exploration (high noise) and exploitation (low noise) through adaptive noise scheduling. This mechanism allows for broad boundary search in early iterations and precise adjustment in later stages. Experiments demonstrate that our approach reduces redundant candidates by 99% compared to sliding-window methods and achieves 44% faster training than MS-SL on Charades-STA. The results validate the effectiveness of diffusion models in PRVR tasks.
Authors
- Dikai Fang (ORCID: https://orcid.org/0000-0002-3391-2482)
- Huahu Xu (ORCID: https://orcid.org/0000-0001-8220-1639)
- Shijie Wang (ORCID: https://orcid.org/0000-0002-7990-4883)
Institutions
- Shanghai University (CN)
Publication Details
- Published
- 2025-08-11
- DOI
- https://doi.org/10.1117/12.3072530
- Primary Topic
- Advanced Image and Video Retrieval Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00