Reparameterized Feature Aggregation Convolutional Neural Network for Remote Sensing Scene Image Classification

With the advancement of deep learning techniques, Transformer has been introduced into remote sensing scene classification (RSSC). Although Transformer performs well in building long-range dependencies, the computational complexity of its self attention mechanism is proportional to the square of the input sequence length, which can lead to high computational costs and resource consumption when processing large-scale or high-resolution remote sensing images. In this study, a re-parameterized feature aggregation convolutional neural network (RepFACNN) is proposed. This is a novel network architecture that combines the advantages of Convolutional Neural Networks (CNN) and Transformers, effectively reducing computational complexity by replacing the self attention module with a RepFormer. Firstly, a reparametrized Transformer (RepFormer) is constructed to extract multi-level features. Then, a multi head hybrid convolution module is designed to extract spatial features across various scales, enhancing the ability of the model to perceive intricate details and broader contexts simultaneously. Finally, a feature fusion module is introduced, adeptly amalgamating the features from the dual branches to facilitate more accurate and robust classification. To illustrate the effectiveness of the RepFACNN method, numerous experiments were conducted on three commonly used RSSC datasets: UC-Merced, AID, and NWPU. The experimental outcomes demonstrate that RepFACNN outperforms than some state-of-the-art scene classification approaches with a large margin.