UFlow-Net: A Unified Approach for Improved Video Frame Interpolation
Video frame interpolation is a critical method in video processing, enabling the synthesis of intermediate frames to enhance video quality and frame rates. While conventional methods rely on optical flow estimation and kernel-based approaches, they often struggle with complex scenes and rapid motion. Recent advancements in deep learning have demonstrated the potential of hybrid architectures to address these challenges. This paper proposes UFlow-Net, a novel hybrid framework that integrates flow estimation and kernel-based methods within a modified U-Net architecture. The model incorporates a flow-enhanced encoder-decoder structure with advanced feature fusion via skip connections to preserve spatial-temporal information. Evaluated on the Vimeo90K, UCF101, and Middlebury datasets, UFlow-Net achieves state-of-the-art performance with peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) metrics. Results demonstrate its robustness in handling intricate backgrounds and dynamic motion, making it a significant advancement in the field of video frame interpolation.
Authors
- Saadia Binte Alam
- Siam Tahsin Bhuiyan (ORCID: https://orcid.org/0000-0002-1478-8930)
- Syoji Kobashi (ORCID: https://orcid.org/0000-0003-3659-4114)
- Mahmudul Haque
- Subir Sarker (ORCID: https://orcid.org/0000-0002-2685-8377)
- Rashedur Rahman (ORCID: https://orcid.org/0000-0003-0267-2612)
- Halima Khatun
- Fatin Israq
Institutions
- University of Hyogo (JP)
- Independent University, Bangladesh (BD)
Publication Details
- Published
- 2024-12-20
- DOI
- https://doi.org/10.1109/iccit64611.2024.11021809
- Primary Topic
- Advanced Vision and Imaging
- Type
- article
- Field-Weighted Citation Impact
- 0.00