Progressive Growth-Based Momentum Contrast for Unsupervised Representative Learning in Classification Tasks

Contrastive unsupervised learning has made significant progress, but there is still potential for improvement by capturing finer details in input data. In this letter, we present PGMoCo, a Progressive Growth-based Momentum Contrast framework for unsupervised representative learning in classification tasks. PGMoCo begins by learning the overall distribution of samples at a coarse scale and progressively refines the representation by incorporating increasingly finer details. PGMoCo consists of data augmentation, progressive growth, an alternative multilayer perceptron (MLP) head, and a loss function. First, PGMoCo applies transformation-based data augmentation to the input samples. Then, it progressively learns features at multiple scales, uses an alternative MLP head to project latent representations into a contrastive loss space, and finally employs a specialized loss function to classify the samples. We evaluate PGMoCo on three datasets: CIFAR-10 and PolyU Palmprint (image classification) and H-MOG (person identification). PGMoCo achieves classification accuracies of 86.76% on CIFAR-10, 95.94% on PolyU Palmprint, and 80.10% on H-MOG, outperforming existing state-of-the-art methods.

Authors

Institutions

Publication Details

Journal
IEEE Networking Letters
Published
2024-10-17
DOI
https://doi.org/10.1109/lnet.2024.3482295
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Progressive Growth-Based Momentum Contrast for Unsupervised Representative Learning in Classification Tasks

Hongyu Huang, Sam Ling, Feno Heriniaina Rabevohitra, Yantao Li
IEEE Networking Letters
Intelligent Tutoring Systems and Adaptive Learning
article

Progressive Growth-Based Momentum Contrast for Unsupervised Representative Learning in Classification Tasks

Hongyu Huang, Sam Ling, Feno Heriniaina Rabevohitra, Yantao Li
article en

Abstract

Contrastive unsupervised learning has made significant progress, but there is still potential for improvement by capturing finer details in input data. In this letter, we present PGMoCo, a Progressive Growth-based Momentum Contrast framework for unsupervised representative learning in classification tasks. PGMoCo begins by learning the overall distribution of samples at a coarse scale and progressively refines the representation by incorporating increasingly finer details. PGMoCo consists of data augmentation, progressive growth, an alternative multilayer perceptron (MLP) head, and a loss function. First, PGMoCo applies transformation-based data augmentation to the input samples. Then, it progressively learns features at multiple scales, uses an alternative MLP head to project latent representations into a contrastive loss space, and finally employs a specialized loss function to classify the samples. We evaluate PGMoCo on three datasets: CIFAR-10 and PolyU Palmprint (image classification) and H-MOG (person identification). PGMoCo achieves classification accuracies of 86.76% on CIFAR-10, 95.94% on PolyU Palmprint, and 80.10% on H-MOG, outperforming existing state-of-the-art methods.

IEEE Networking LettersVol. 7(1)
University of Antananarivo (MG), Chongqing University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 84%
Intelligent Tutoring Systems and Adaptive Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.