A hybrid Mamba–Transformer model for image restoration

Image restoration plays a critical role in many engineering systems, including remote sensing, medical imaging, and industrial inspection, where degraded visual data can significantly impair downstream analysis and decision-making. However, existing restoration methods often struggle to balance restoration quality, computational efficiency, and model interpretability, which limits their practical deployment in real-world engineering scenarios. In this paper, we propose Mamba–Transformer for Image Restoration (MatIR), a hybrid image restoration framework that integrates transformer-based (Transformer) attention with state–space modeling (SSM) in a knowledge-guided and modular architecture. MatIR introduces a Channel-Triangle Attention (CTA) module to jointly model global semantic consistency and local structural integrity, and an Image Restoration State Space (IRSS) module that efficiently captures long-range spatial dependencies using multi-directional state–space scanning with linear complexity. A serial stacking strategy is adopted to progressively refine features while avoiding redundant computation. Extensive experiments on multiple image restoration tasks, including denoising, deblurring, and super-resolution, demonstrate that MatIR consistently outperforms state-of-the-art methods, achieving up to 0.3–0.6 decibels (dB) peak signal-to-noise ratio (PSNR) improvements and lower learned perceptual image patch similarity (LPIPS) scores across benchmarks. These results indicate that MatIR delivers both high-fidelity reconstruction and improved perceptual quality. Overall, MatIR provides a scalable, interpretable, and efficient solution for artificial intelligence (AI)-driven image restoration, offering clear potential for deployment in practical engineering applications.

Authors

Institutions

Publication Details

Journal
Engineering Applications of Artificial Intelligence
Published
2026-09-13
DOI
https://doi.org/10.1016/j.engappai.2026.116091
Primary Topic
Advanced Image Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

A hybrid Mamba–Transformer model for image restoration

Luc Van Gool, Radu Timofte, Juan Wen, Weiyan Hou
Engineering Applications of Artificial Intelligence
Advanced Image Processing Techniques
article

A hybrid Mamba–Transformer model for image restoration

Luc Van Gool, Radu Timofte, Juan Wen, Weiyan Hou
article en

Abstract

Image restoration plays a critical role in many engineering systems, including remote sensing, medical imaging, and industrial inspection, where degraded visual data can significantly impair downstream analysis and decision-making. However, existing restoration methods often struggle to balance restoration quality, computational efficiency, and model interpretability, which limits their practical deployment in real-world engineering scenarios. In this paper, we propose Mamba–Transformer for Image Restoration (MatIR), a hybrid image restoration framework that integrates transformer-based (Transformer) attention with state–space modeling (SSM) in a knowledge-guided and modular architecture. MatIR introduces a Channel-Triangle Attention (CTA) module to jointly model global semantic consistency and local structural integrity, and an Image Restoration State Space (IRSS) module that efficiently captures long-range spatial dependencies using multi-directional state–space scanning with linear complexity. A serial stacking strategy is adopted to progressively refine features while avoiding redundant computation. Extensive experiments on multiple image restoration tasks, including denoising, deblurring, and super-resolution, demonstrate that MatIR consistently outperforms state-of-the-art methods, achieving up to 0.3–0.6 decibels (dB) peak signal-to-noise ratio (PSNR) improvements and lower learned perceptual image patch similarity (LPIPS) scores across benchmarks. These results indicate that MatIR delivers both high-fidelity reconstruction and improved perceptual quality. Overall, MatIR provides a scalable, interpretable, and efficient solution for artificial intelligence (AI)-driven image restoration, offering clear potential for deployment in practical engineering applications.

Engineering Applications of Artificial IntelligenceVol. 183
University of Würzburg (DE), ETH Zurich (CH), Zhengzhou University (CN), Sofia University "St. Kliment Ohridski" (BG), KU Leuven (BE)
Alexander von Humboldt-Stiftung, Chinese Government Scholarship
Openalex Percentile: Top 13%
Advanced Image Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.