SCTNet: A Shallow CNN–Transformer Network With Statistics-Driven Modules for Cloud Detection

Existing cloud detection methods often rely on deep neural networks, leading to excessive computational overhead. To address this, we propose a shallow convolutional neural network (CNN)-Transformer hybrid architecture that limits the maximum downsampling rate to 8×. This design preserves local details while effectively capturing global context through a lightweight Transformer branch. To enhance adaptability across diverse cloud scenes, we introduce two novel statistics-driven modules: statistics-adaptive convolution (SAC) and statistical mixing augmentation (SMA). SAC dynamically generates convolutional kernels based on input feature statistics, enabling adaptive feature extraction for varying cloud patterns. SMA improves model generalization by interpolating channel-wise statistics across training samples, increasing feature diversity. Experiments on four datasets show that the proposed method achieves state-of-the-art performance with 732K parameters and 1G multiply-accumulate operations. Code will be available at https://weix-liu.github.io/ for further research.

Authors

Institutions

Publication Details

Journal
IEEE Geoscience and Remote Sensing Letters
Published
2025-01-01
DOI
https://doi.org/10.1109/lgrs.2025.3561004
Citations
2
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
4.96

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SCTNet: A Shallow CNN–Transformer Network With Statistics-Driven Modules for Cloud Detection

Han Nie, Weixing Liu, Jun Liu, Bin Luo et al.
2 citations
IEEE Geoscience and Remote Sensing Letters
Neural Networks and Applications
4.96
article

SCTNet: A Shallow CNN–Transformer Network With Statistics-Driven Modules for Cloud Detection

Han Nie, Weixing Liu, Jun Liu, Bin Luo, Xin Su
article en
2 citations

Abstract

Existing cloud detection methods often rely on deep neural networks, leading to excessive computational overhead. To address this, we propose a shallow convolutional neural network (CNN)-Transformer hybrid architecture that limits the maximum downsampling rate to 8×. This design preserves local details while effectively capturing global context through a lightweight Transformer branch. To enhance adaptability across diverse cloud scenes, we introduce two novel statistics-driven modules: statistics-adaptive convolution (SAC) and statistical mixing augmentation (SMA). SAC dynamically generates convolutional kernels based on input feature statistics, enabling adaptive feature extraction for varying cloud patterns. SMA improves model generalization by interpolating channel-wise statistics across training samples, increasing feature diversity. Experiments on four datasets show that the proposed method achieves state-of-the-art performance with 732K parameters and 1G multiply-accumulate operations. Code will be available at https://weix-liu.github.io/ for further research.

IEEE Geoscience and Remote Sensing LettersVol. 22
Wuhan University (CN), State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing (CN)
National Natural Science Foundation of China
Climate action
Openalex Percentile: Top 6%
Neural Networks and Applications
4.96
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.