Inductive Graph Few-shot Class Incremental Learning
Node classification with Graph Neural Networks (GNN) under a fixed set of labels is well studied, while Graph Few-Shot Class Incremental Learning (GFSCIL), which involves learning a GNN classifier as graph nodes and classes growing over time sporadically, has received much less attention despite its importance. We introduce inductive GFSCIL that continually learns novel classes with newly emerging nodes while maintaining performance on old classes without accessing previous data. This addresses the practical concern of transductive GFSCIL, which requires storing the entire graph with historical data. Compared to the transductive GFSCIL, the inductive setting exacerbates catastrophic forgetting due to inaccessible previous data during incremental training, in addition to the overfitting issue caused by label sparsity. Thus, we propose a novel method, called Topology-based class Augmentation and Prototype calibration (TAP). To be specific, it first performs a topology-based class augmentation method, helping replicate the setting of disjoint subgraphs with nodes of novel classes received in incremental sessions, to enhance backbone versatility. In incremental learning, given the limited number of novel class samples, we propose an iterative prototype calibration to improve the separation of class prototypes. Furthermore, as backbone fine-tuning poses the feature distribution drift, prototypes of old classes start failing over time, we propose the prototype shift method for old classes to compensate for the drift. We showcase the proposed method on four datasets.
Authors
- Piotr Koniusz (ORCID: https://orcid.org/0000-0002-6340-5289)
- Peyman Moghadam (ORCID: https://orcid.org/0000-0002-8169-3560)
- Nan Ye (ORCID: https://orcid.org/0000-0001-5971-9202)
- Can Peng (ORCID: https://orcid.org/0000-0003-1673-2460)
- Yayong Li (ORCID: https://orcid.org/0000-0003-2534-1971)
Institutions
- Commonwealth Scientific and Industrial Research Organisation (AU)
- The University of Queensland (AU)
- University of Oxford (GB)
- Health Sciences and Nutrition (AU)
Publication Details
- Published
- 2025-02-26
- DOI
- https://doi.org/10.1145/3701551.3703578
- Citations
- 4
- Primary Topic
- Domain Adaptation and Few-Shot Learning
- Type
- article
- Field-Weighted Citation Impact
- 9.92