UFlow-Net: A Unified Approach for Improved Video Frame Interpolation

Video frame interpolation is a critical method in video processing, enabling the synthesis of intermediate frames to enhance video quality and frame rates. While conventional methods rely on optical flow estimation and kernel-based approaches, they often struggle with complex scenes and rapid motion. Recent advancements in deep learning have demonstrated the potential of hybrid architectures to address these challenges. This paper proposes UFlow-Net, a novel hybrid framework that integrates flow estimation and kernel-based methods within a modified U-Net architecture. The model incorporates a flow-enhanced encoder-decoder structure with advanced feature fusion via skip connections to preserve spatial-temporal information. Evaluated on the Vimeo90K, UCF101, and Middlebury datasets, UFlow-Net achieves state-of-the-art performance with peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) metrics. Results demonstrate its robustness in handling intricate backgrounds and dynamic motion, making it a significant advancement in the field of video frame interpolation.

Authors

Institutions

Publication Details

Published
2024-12-20
DOI
https://doi.org/10.1109/iccit64611.2024.11021809
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

UFlow-Net: A Unified Approach for Improved Video Frame Interpolation

Saadia Binte Alam, Siam Tahsin Bhuiyan, Syoji Kobashi, Mahmudul Haque et al.
Advanced Vision and Imaging
article

UFlow-Net: A Unified Approach for Improved Video Frame Interpolation

Saadia Binte Alam, Siam Tahsin Bhuiyan, Syoji Kobashi, Mahmudul Haque, Subir Sarker, Rashedur Rahman, Halima Khatun, Fatin Israq
article en

Abstract

Video frame interpolation is a critical method in video processing, enabling the synthesis of intermediate frames to enhance video quality and frame rates. While conventional methods rely on optical flow estimation and kernel-based approaches, they often struggle with complex scenes and rapid motion. Recent advancements in deep learning have demonstrated the potential of hybrid architectures to address these challenges. This paper proposes UFlow-Net, a novel hybrid framework that integrates flow estimation and kernel-based methods within a modified U-Net architecture. The model incorporates a flow-enhanced encoder-decoder structure with advanced feature fusion via skip connections to preserve spatial-temporal information. Evaluated on the Vimeo90K, UCF101, and Middlebury datasets, UFlow-Net achieves state-of-the-art performance with peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) metrics. Results demonstrate its robustness in handling intricate backgrounds and dynamic motion, making it a significant advancement in the field of video frame interpolation.

University of Hyogo (JP), Independent University, Bangladesh (BD)
Openalex Percentile: Top 70%
Advanced Vision and Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.