SAT: shift alignment transformer for video denoising without flow estimation

Video denoising aims to recover clean video sequences with rich structural details from temporally correlated noisy frames, where the core challenge lies in effectively aggregating long-range temporal information under complex motion conditions. Existing sliding-window and recurrent-based approaches suffer from limited receptive fields or restricted parallelism, while recent Transformer-based methods, although capable of modeling long-range dependencies, are constrained by fixed-window designs that hinder large-scale motion handling. In this paper, we propose a novel and efficient Shift Alignment Transformer (SAT) for video denoising, which enables implicit feature alignment and aggregation over extended spatiotemporal regions without relying on optical flow estimation. The proposed framework introduces two complementary mechanisms: Time Segment Shift, which establishes inter-frame correlations by dynamically shifting temporal windows, and Local Window Shift, which enhances intra-frame contextual modeling through spatial window displacement. Together, these designs enable flexible receptive field expansion while maintaining computational efficiency. Extensive experiments conducted on both synthetic Gaussian noise removal in the RGB domain and real-world video denoising in the RAW domain demonstrate that SAT consistently outperforms or matches state-of-the-art methods in terms of denoising accuracy, while achieving a favorable balance between performance and computational cost. These results indicate that the proposed SAT provides an effective and practical solution for long-range spatiotemporal modeling in video denoising, offering a robust alternative to explicit motion estimation and fixed-window Transformer architectures.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-02-10
DOI
https://doi.org/10.1038/s41598-026-38431-9
Primary Topic
Image and Signal Denoising Methods
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SAT: shift alignment transformer for video denoising without flow estimation

Siyuan Fan, Yueli Hu, Yongji Gao, Xing Zhang et al.
Scientific Reports
Image and Signal Denoising Methods
article

SAT: shift alignment transformer for video denoising without flow estimation

Siyuan Fan, Yueli Hu, Yongji Gao, Xing Zhang, Haikun Zhang
article en

Abstract

Video denoising aims to recover clean video sequences with rich structural details from temporally correlated noisy frames, where the core challenge lies in effectively aggregating long-range temporal information under complex motion conditions. Existing sliding-window and recurrent-based approaches suffer from limited receptive fields or restricted parallelism, while recent Transformer-based methods, although capable of modeling long-range dependencies, are constrained by fixed-window designs that hinder large-scale motion handling. In this paper, we propose a novel and efficient Shift Alignment Transformer (SAT) for video denoising, which enables implicit feature alignment and aggregation over extended spatiotemporal regions without relying on optical flow estimation. The proposed framework introduces two complementary mechanisms: Time Segment Shift, which establishes inter-frame correlations by dynamically shifting temporal windows, and Local Window Shift, which enhances intra-frame contextual modeling through spatial window displacement. Together, these designs enable flexible receptive field expansion while maintaining computational efficiency. Extensive experiments conducted on both synthetic Gaussian noise removal in the RGB domain and real-world video denoising in the RAW domain demonstrate that SAT consistently outperforms or matches state-of-the-art methods in terms of denoising accuracy, while achieving a favorable balance between performance and computational cost. These results indicate that the proposed SAT provides an effective and practical solution for long-range spatiotemporal modeling in video denoising, offering a robust alternative to explicit motion estimation and fixed-window Transformer architectures.

Scientific ReportsVol. 16(1)
Shanghai University (CN), Zhong Ke San Huan (China) (CN), Chery Automobile (China) (CN), Anhui Polytechnic University (CN)
Anhui Polytechnic University
Industry, innovation and infrastructure
Openalex Percentile: Top 62%
Image and Signal Denoising Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.