Prototype Compensation Method for Small-Scale Incremental Learning Based on Attention-Guided Sample Augmentation and Causal Constraints

In small-shot, replay-free incremental learning scenarios, the scarcity of training samples can lead to weak model feature representation and insufficient causal K-nearest neighbor candidate feature pools, resulting in weight estimation bias and prototype drift, thereby exacerbating catastrophic forgetting. Existing causality-constrained methods have good stability, but they lack plasticity under small-shot conditions; ordinary data augmentation only expands the training samples and lacks causal representation constraints. To address this, this paper proposes a prototype compensation method that combines attention-guided sample augmentation with causal constraints. Attention-guided data augmentation (AGDA) is used to generate semantically invariant synthetic samples, expanding the causal K-nearest neighbor candidate pool to optimize weight estimation; combined with causal regularization to protect old class knowledge, supervised contrastive loss is used to optimize the feature space, and prototype drift is corrected through adversarial shift compensation. Experiments were conducted on 4-task and 8-task small-shot settings of Caltech 101 and Oxford Flowers 102. The results show that, compared to the contrastive baseline, this method improves average accuracy by 1.2%–3.3% and average incremental accuracy by 1.0%–3.0%, effectively reducing the forgetting rate, providing a feasible solution path for replay-free incremental learning with scarce samples.

Authors

Institutions

Publication Details

Journal
Academic Journal of Science and Technology
Published
2026-10-30
DOI
https://doi.org/10.54097/wjejtx49
Primary Topic
Domain Adaptation and Few-Shot Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Prototype Compensation Method for Small-Scale Incremental Learning Based on Attention-Guided Sample Augmentation and Causal Constraints

Jiamin Zhi, Meiqi Zhao, Kexin Zhang
3 links
Academic Journal of Science and Technology
Domain Adaptation and Few-Shot Learning
article

Prototype Compensation Method for Small-Scale Incremental Learning Based on Attention-Guided Sample Augmentation and Causal Constraints

Jiamin Zhi, Meiqi Zhao, Kexin Zhang
article en

Abstract

In small-shot, replay-free incremental learning scenarios, the scarcity of training samples can lead to weak model feature representation and insufficient causal K-nearest neighbor candidate feature pools, resulting in weight estimation bias and prototype drift, thereby exacerbating catastrophic forgetting. Existing causality-constrained methods have good stability, but they lack plasticity under small-shot conditions; ordinary data augmentation only expands the training samples and lacks causal representation constraints. To address this, this paper proposes a prototype compensation method that combines attention-guided sample augmentation with causal constraints. Attention-guided data augmentation (AGDA) is used to generate semantically invariant synthetic samples, expanding the causal K-nearest neighbor candidate pool to optimize weight estimation; combined with causal regularization to protect old class knowledge, supervised contrastive loss is used to optimize the feature space, and prototype drift is corrected through adversarial shift compensation. Experiments were conducted on 4-task and 8-task small-shot settings of Caltech 101 and Oxford Flowers 102. The results show that, compared to the contrastive baseline, this method improves average accuracy by 1.2%–3.3% and average incremental accuracy by 1.0%–3.0%, effectively reducing the forgetting rate, providing a feasible solution path for replay-free incremental learning with scarce samples.

Academic Journal of Science and TechnologyVol. 23(2)
Sias University (CN)
Openalex Percentile: Top 14%
Domain Adaptation and Few-Shot Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon