A Continual Self-Supervised Learning Framework Using a Decoder and a Clustering-Based Data Selection Method
Continual learning aims to learn a sequence of tasks without forgetting the previously learned tasks. Promising methods for achieving continual learning include applying a replay buffer that stores previously learned samples in existing learning frameworks. Among these methods, lifelong unsupervised mixup (LUMP) interpolates the current task samples and samples from the replay buffer to prevent forgetting. LUMP randomly selects data for the replay buffer. This random selection is likely to have a negative effect on learning performance. In this study, we propose a clustering-based data selection method for the replay buffer. In addition, we introduce a denoising autoencoder to the self-supervised methods to improve the performance of the learning representations. We compare the clustering algorithms used in our framework and demonstrate the effectiveness of the proposed framework through computational experiments. Experimental results on CIFAR-100 and Tiny-ImageNet demonstrate that the proposed framework improves the average accuracy compared with LUMP while reducing forgetting. In particular, the CA+-based selection approach enhances the learning performance. The source code is available at https://github.com/Masuyama-lab/LUMP_SidAE_Clustering
Authors
- Yusuke Nojima (ORCID: https://orcid.org/0000-0003-4853-1305)
- Wei Shiung Liew (ORCID: https://orcid.org/0000-0001-8833-2189)
- Ryosuke Fujii
- Naoki Masuyama (ORCID: https://orcid.org/0000-0002-2886-1588)
- Chu Kiong Loo (ORCID: https://orcid.org/0000-0001-7867-2665)
Institutions
- University of Malaya (MY)
- Osaka Metropolitan University (JP)
Publication Details
- Journal
- Journal of Advanced Computational Intelligence and Intelligent Informatics
- Published
- 2026-11-20
- DOI
- https://doi.org/10.20965/jaciii.2026.p1846
- Primary Topic
- Domain Adaptation and Few-Shot Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.00