A Continual Self-Supervised Learning Framework Using a Decoder and a Clustering-Based Data Selection Method

Continual learning aims to learn a sequence of tasks without forgetting the previously learned tasks. Promising methods for achieving continual learning include applying a replay buffer that stores previously learned samples in existing learning frameworks. Among these methods, lifelong unsupervised mixup (LUMP) interpolates the current task samples and samples from the replay buffer to prevent forgetting. LUMP randomly selects data for the replay buffer. This random selection is likely to have a negative effect on learning performance. In this study, we propose a clustering-based data selection method for the replay buffer. In addition, we introduce a denoising autoencoder to the self-supervised methods to improve the performance of the learning representations. We compare the clustering algorithms used in our framework and demonstrate the effectiveness of the proposed framework through computational experiments. Experimental results on CIFAR-100 and Tiny-ImageNet demonstrate that the proposed framework improves the average accuracy compared with LUMP while reducing forgetting. In particular, the CA+-based selection approach enhances the learning performance. The source code is available at https://github.com/Masuyama-lab/LUMP_SidAE_Clustering

Authors

Institutions

Publication Details

Journal
Journal of Advanced Computational Intelligence and Intelligent Informatics
Published
2026-11-20
DOI
https://doi.org/10.20965/jaciii.2026.p1846
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A Continual Self-Supervised Learning Framework Using a Decoder and a Clustering-Based Data Selection Method

Yusuke Nojima, Wei Shiung Liew, Ryosuke Fujii, Naoki Masuyama et al.
Journal of Advanced Computational Intelligence and Intelligent Informatics
Domain Adaptation and Few-Shot Learning
article

A Continual Self-Supervised Learning Framework Using a Decoder and a Clustering-Based Data Selection Method

Yusuke Nojima, Wei Shiung Liew, Ryosuke Fujii, Naoki Masuyama, Chu Kiong Loo
article en

Abstract

Continual learning aims to learn a sequence of tasks without forgetting the previously learned tasks. Promising methods for achieving continual learning include applying a replay buffer that stores previously learned samples in existing learning frameworks. Among these methods, lifelong unsupervised mixup (LUMP) interpolates the current task samples and samples from the replay buffer to prevent forgetting. LUMP randomly selects data for the replay buffer. This random selection is likely to have a negative effect on learning performance. In this study, we propose a clustering-based data selection method for the replay buffer. In addition, we introduce a denoising autoencoder to the self-supervised methods to improve the performance of the learning representations. We compare the clustering algorithms used in our framework and demonstrate the effectiveness of the proposed framework through computational experiments. Experimental results on CIFAR-100 and Tiny-ImageNet demonstrate that the proposed framework improves the average accuracy compared with LUMP while reducing forgetting. In particular, the CA+-based selection approach enhances the learning performance. The source code is available at https://github.com/Masuyama-lab/LUMP_SidAE_Clustering

Journal of Advanced Computational Intelligence and Intelligent InformaticsVol. 30(6)
University of Malaya (MY), Osaka Metropolitan University (JP)
Domain Adaptation and Few-Shot Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon