Multi-dimensional feature fusion network with transformer for image super-resolution

In the context of deep learning applied to single-image super-resolution, the quality of the reconstructed images is largely contingent upon the intricacy of the convolutional neural networks employed. However, this complexity is limited by the static nature of the receptive fields within these networks. Transformers, distinguished by their self-attention mechanism, are capable of capturing global dependencies, a feature that is beyond the reach of conventional CNNs. However, integrating Transformers into CNN architectures poses a challenge. This paper introduces an innovative solution, a Multi-Dimensional Feature Fusion Image Super-Resolution Network that harnesses Transformer's global representation capability. By utilizing the self-attention mechanism, our network achieves effective cross-feature extraction and establishes global dependencies throughout the feature map. A dedicated Multi-Dimensional Feature Fusion Module is employed to enhance feature fusion, further improving the reconstruction quality. Empirical evidence from experiments on the Set5 benchmark dataset reveals that our network outperforms existing state-of-the-art methods by 0.22dB in 4× super-resolution tasks, highlighting the efficacy of our approach.

Authors

Institutions

Publication Details

Published
2024-09-13
DOI
https://doi.org/10.1117/12.3037830
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-dimensional feature fusion network with transformer for image super-resolution

Qiaochuan Chen, Baoqi Zhong
Advanced Image Fusion Techniques
article

Multi-dimensional feature fusion network with transformer for image super-resolution

Qiaochuan Chen, Baoqi Zhong
article en

Abstract

In the context of deep learning applied to single-image super-resolution, the quality of the reconstructed images is largely contingent upon the intricacy of the convolutional neural networks employed. However, this complexity is limited by the static nature of the receptive fields within these networks. Transformers, distinguished by their self-attention mechanism, are capable of capturing global dependencies, a feature that is beyond the reach of conventional CNNs. However, integrating Transformers into CNN architectures poses a challenge. This paper introduces an innovative solution, a Multi-Dimensional Feature Fusion Image Super-Resolution Network that harnesses Transformer's global representation capability. By utilizing the self-attention mechanism, our network achieves effective cross-feature extraction and establishes global dependencies throughout the feature map. A dedicated Multi-Dimensional Feature Fusion Module is employed to enhance feature fusion, further improving the reconstruction quality. Empirical evidence from experiments on the Set5 benchmark dataset reveals that our network outperforms existing state-of-the-art methods by 0.22dB in 4× super-resolution tasks, highlighting the efficacy of our approach.

Shanghai University (CN)
Affordable and clean energy
Openalex Percentile: Top 75%
Advanced Image Fusion Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Multi-dimensional feature fusion network with transformer for image super-resolution — Qiaochuan Chen, Baoqi Zhong · (2024) | TGRS Research Map | TGRS