ACT-SR: Aggregation Connection Transformer for Remote Sensing Image Super-Resolution

Recently, transformer-based methods have shown impressive performances in remote sensing image super-resolution (RSISR). However, the application of transformer in RSISR frequently results in artifacts and the loss of image detail due to limited information transmission pathways and the constraints of unidimensional self-attention mechanisms. To solve these problems, an aggregation connection transformer (ACT-SR) is proposed for RSISR. ACT-SR employs an advanced attention mechanism designed to enrich information transmission across spatial and channel dimensions, thereby enlarging the receptive fields for more accurate feature extraction. A core component of ACT-SR is the novel aggregation connection attention block, which effectively captures spatial similarities and channel importance, aggregating this information through a combination of series and parallel connections for enhanced feature representation. Furthermore, a new gated feed-forward network is introduced to enhance the nonlinear mapping capabilities of the transformer and control the information flow through the network. In addition, ACT-SR integrates a shifted windows scheme alongside interpolation residual calculation to facilitate efficient detail recovery and artifact elimination. Experimental results confirm the effectiveness of the proposed modules, with ACT-SR outperforming several state-of-the-art RSISR methods in both objective metrics and visual quality.

Authors

Institutions

Publication Details

Journal
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Published
2024-11-27
DOI
https://doi.org/10.1109/jstars.2024.3506717
Citations
7
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
2.24
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ACT-SR: Aggregation Connection Transformer for Remote Sensing Image Super-Resolution

Guang Jin, Shaoju Wang, Xuemin Zhang, Xinyu Wang et al.
7 citations
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Advanced Image Fusion Techniques
2.24
article

ACT-SR: Aggregation Connection Transformer for Remote Sensing Image Super-Resolution

Guang Jin, Shaoju Wang, Xuemin Zhang, Xinyu Wang, Yingdong Kang
article en
7 citations

Abstract

Recently, transformer-based methods have shown impressive performances in remote sensing image super-resolution (RSISR). However, the application of transformer in RSISR frequently results in artifacts and the loss of image detail due to limited information transmission pathways and the constraints of unidimensional self-attention mechanisms. To solve these problems, an aggregation connection transformer (ACT-SR) is proposed for RSISR. ACT-SR employs an advanced attention mechanism designed to enrich information transmission across spatial and channel dimensions, thereby enlarging the receptive fields for more accurate feature extraction. A core component of ACT-SR is the novel aggregation connection attention block, which effectively captures spatial similarities and channel importance, aggregating this information through a combination of series and parallel connections for enhanced feature representation. Furthermore, a new gated feed-forward network is introduced to enhance the nonlinear mapping capabilities of the transformer and control the information flow through the network. In addition, ACT-SR integrates a shifted windows scheme alongside interpolation residual calculation to facilitate efficient detail recovery and artifact elimination. Experimental results confirm the effectiveness of the proposed modules, with ACT-SR outperforming several state-of-the-art RSISR methods in both objective metrics and visual quality.

IEEE Journal of Selected Topics in Applied Earth Observations and Remote SensingVol. 18
Wuhan University (CN)
Openalex Percentile: Top 10%
Advanced Image Fusion Techniques
2.24
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

ACT-SR: Aggregation Connection Transformer for Remote Sensing Image Super-Resolution — Guang Jin, Shaoju Wang, et al. · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (2024) | TGRS Research Map | TGRS