Robust small-sample classification via RN50STN architecture with adaptive example reweighting

Convolutional Neural Networks (CNNs) have shown exceptional performance across various domains; however, their deep architectures require extensive datasets for effective training. In practical situations, gathering a large number of training examples can be extremely challenging, and the model is at risk of overfitting due to the limited and potentially biased nature of the available data. To address this challenge, a novel approach using a deep migration hybrid model has been introduced to tackle the issues posed by small-sample datasets. Initially, transfer learning is utilized to convey the knowledge acquired by a pretrained network from the ImageNet database to a limited dataset. Subsequently, the fully connected layers and adaptive average pooling layers of the pretrained network are augmented by incorporating a spatial transformer network (STN) for further training. Simultaneously, an online reweighting algorithm for examples is employed to reduce sample bias and enhance the robustness of the model’s classification capabilities. The proposed algorithm notably improves the classification accuracy of small-sample, imbalanced datasets, as demonstrated by comparing various evaluation metrics before and after its implementation. This confirms that our method is resilient to class imbalance and sample corruption.

Authors

Institutions

Publication Details

Journal
International Journal of Wavelets Multiresolution and Information Processing
Published
2025-03-06
DOI
https://doi.org/10.1142/s0219691325500080
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Robust small-sample classification via RN50STN architecture with adaptive example reweighting

Yu Jin, Guoqing Hu, Zhaowei Shang, Bing Fang et al.
International Journal of Wavelets Multiresolution and Information Processing
Neural Networks and Applications
article

Robust small-sample classification via RN50STN architecture with adaptive example reweighting

Yu Jin, Guoqing Hu, Zhaowei Shang, Bing Fang, Linchang Zhao, Wang Xiu, Yuanyan Tang, Yongchi Xu
article en

Abstract

Convolutional Neural Networks (CNNs) have shown exceptional performance across various domains; however, their deep architectures require extensive datasets for effective training. In practical situations, gathering a large number of training examples can be extremely challenging, and the model is at risk of overfitting due to the limited and potentially biased nature of the available data. To address this challenge, a novel approach using a deep migration hybrid model has been introduced to tackle the issues posed by small-sample datasets. Initially, transfer learning is utilized to convey the knowledge acquired by a pretrained network from the ImageNet database to a limited dataset. Subsequently, the fully connected layers and adaptive average pooling layers of the pretrained network are augmented by incorporating a spatial transformer network (STN) for further training. Simultaneously, an online reweighting algorithm for examples is employed to reduce sample bias and enhance the robustness of the model’s classification capabilities. The proposed algorithm notably improves the classification accuracy of small-sample, imbalanced datasets, as demonstrated by comparing various evaluation metrics before and after its implementation. This confirms that our method is resilient to class imbalance and sample corruption.

International Journal of Wavelets Multiresolution and Information ProcessingVol. 23(04)
Chongqing University (CN), Guizhou University (CN), State Administration of Cultural Heritage (CN), HKUST Shenzhen Research Institute (CN), Guiyang University (CN), Peking University Shenzhen Hospital (CN), Zhuhai Institute of Advanced Technology (CN), University of Hong Kong (HK)
Openalex Percentile: Top 98%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.