Multi‐Directional Transformer Image Super‐Resolution Network Based on Information Enhancement

ABSTRACT With the advancement of deep learning, single‐image super‐resolution (SISR) has achieved significant progress. Recently, vision transformer‐based super‐resolution models have demonstrated remarkable performance; however, their high computational cost hinders their practical application. In this paper, we introduce a lightweight transformer‐based super‐resolution model termed information‐enhanced efficient multi‐directional transformer(IEMT). The model employs a dual‐branch architecture that integrates the strengths of both convolutional neural network (CNN) and transformer networks. The proposed high‐frequency extraction block (HEB) effectively captures high‐frequency information from the enhanced image. Furthermore, a multi‐directional attention mechanism is incorporated into the transformer branch to comprehensively learn latent features and details, thereby enhancing reconstruction quality. For attention computation, we propose a dynamic parameter‐sharing mechanism that adaptively adjusts parameter sharing based on local image features, significantly reducing the model's parameter count. Experimental results demonstrate that the proposed IEMT achieves superior performance on five benchmark datasets, with a significantly reduced parameter count, computational complexity, and memory usage.

Authors

Institutions

Publication Details

Journal
IET Image Processing
Published
2025-01-01
DOI
https://doi.org/10.1049/ipr2.70074
Primary Topic
Advanced Image Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi‐Directional Transformer Image Super‐Resolution Network Based on Information Enhancement

Ronggui Wang, Xu Chen, Lixia Xue, Juan Yang
IET Image Processing
Advanced Image Processing Techniques
article

Multi‐Directional Transformer Image Super‐Resolution Network Based on Information Enhancement

Ronggui Wang, Xu Chen, Lixia Xue, Juan Yang
article en

Abstract

ABSTRACT With the advancement of deep learning, single‐image super‐resolution (SISR) has achieved significant progress. Recently, vision transformer‐based super‐resolution models have demonstrated remarkable performance; however, their high computational cost hinders their practical application. In this paper, we introduce a lightweight transformer‐based super‐resolution model termed information‐enhanced efficient multi‐directional transformer(IEMT). The model employs a dual‐branch architecture that integrates the strengths of both convolutional neural network (CNN) and transformer networks. The proposed high‐frequency extraction block (HEB) effectively captures high‐frequency information from the enhanced image. Furthermore, a multi‐directional attention mechanism is incorporated into the transformer branch to comprehensively learn latent features and details, thereby enhancing reconstruction quality. For attention computation, we propose a dynamic parameter‐sharing mechanism that adaptively adjusts parameter sharing based on local image features, significantly reducing the model's parameter count. Experimental results demonstrate that the proposed IEMT achieves superior performance on five benchmark datasets, with a significantly reduced parameter count, computational complexity, and memory usage.

IET Image ProcessingVol. 19(1)
Hefei University of Technology (CN)
National Natural Science Foundation of China, National Key Research and Development Program of China
Openalex Percentile: Top 90%
Advanced Image Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.