Self-supervised ultrasound video frame interpolation based on conditional latent diffusion model

High temporal resolution in ultrasound (US) videos is essential for imaging fast-moving structures, capturing dynamic changes, and accurately detecting diseases. Video frame interpolation (VFI) enhances temporal resolution by generating intermediate frames. Despite advancements in natural VFI, motion-estimation-based deep learning methods struggle with US videos due to their complex motion and image quality. In this work, we introduce the conditional latent diffusion model (LDM) for 2D US VFI for the first time, formulating frame prediction as a conditional generative task. We evaluate our method against state-of-the-art motion-estimation-based approaches using one open-source and one customized ultrasound video dataset. Both qualitative and quantitative analyses demonstrate that the conditional LDM approach noticeably enhances the quality of US VFI by generating sharper and more realistic frames.

Authors

Publication Details

Published
2025-02-15
DOI
https://doi.org/10.1117/12.3047431
Primary Topic
Image and Signal Denoising Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Self-supervised ultrasound video frame interpolation based on conditional latent diffusion model

Ahana Gangopadhyay, Xing Yao, Hsi-Ming Chang, Ravi Soni et al.
Image and Signal Denoising Methods
article

Self-supervised ultrasound video frame interpolation based on conditional latent diffusion model

Ahana Gangopadhyay, Xing Yao, Hsi-Ming Chang, Ravi Soni, Ashok Vardhan Addala
article en

Abstract

High temporal resolution in ultrasound (US) videos is essential for imaging fast-moving structures, capturing dynamic changes, and accurately detecting diseases. Video frame interpolation (VFI) enhances temporal resolution by generating intermediate frames. Despite advancements in natural VFI, motion-estimation-based deep learning methods struggle with US videos due to their complex motion and image quality. In this work, we introduce the conditional latent diffusion model (LDM) for 2D US VFI for the first time, formulating frame prediction as a conditional generative task. We evaluate our method against state-of-the-art motion-estimation-based approaches using one open-source and one customized ultrasound video dataset. Both qualitative and quantitative analyses demonstrate that the conditional LDM approach noticeably enhances the quality of US VFI by generating sharper and more realistic frames.

Openalex Percentile: Top 98%
Image and Signal Denoising Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.