MTKD-RL: Multi-Teacher Knowledge Distillation Method for Reinforcement Learning Based on Few-Shot Node Classification

Few-shot node classification aims to effectively predict new class nodes using only a small number of labeled samples, which is an important research direction in graph data mining. Existing self-training-based few-shot node classification methods are constrained by the bias and local optima of a single-teacher model. Meanwhile, multiple-teacher models often suffer from knowledge conflicts and redundant information, which degrade distillation efficiency and model generalization performance. To address these issues, we propose a multi-teacher knowledge distillation method with reinforcement learning for few-shot node classification (MTKD-RL). This framework is composed of a multi-teacher distillation network and a multi-teacher weight optimization module to deliver complementary supervision information from multiple perspectives. The reinforcement learning agent dynamically assigns adaptive weights to different teachers based on their prediction performance and the discrepancy between teacher and student models, which greatly enhances pseudo-label quality and distillation performance. Experiments on nine graph network datasets demonstrate that our method achieves consistent accuracy improvements ranging from 1.4% to 6.2% in few-shot node classification.

Authors

Institutions

Publication Details

Journal
Computers
Published
2026-06-28
DOI
https://doi.org/10.3390/computers15070415
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MTKD-RL: Multi-Teacher Knowledge Distillation Method for Reinforcement Learning Based on Few-Shot Node Classification

Wenai Song, Yiran Li, Biaokai Zhu, Dianjun Xie et al.
Computers
Advanced Graph Neural Networks
article

MTKD-RL: Multi-Teacher Knowledge Distillation Method for Reinforcement Learning Based on Few-Shot Node Classification

Wenai Song, Yiran Li, Biaokai Zhu, Dianjun Xie, Ruize Guo
article en

Abstract

Few-shot node classification aims to effectively predict new class nodes using only a small number of labeled samples, which is an important research direction in graph data mining. Existing self-training-based few-shot node classification methods are constrained by the bias and local optima of a single-teacher model. Meanwhile, multiple-teacher models often suffer from knowledge conflicts and redundant information, which degrade distillation efficiency and model generalization performance. To address these issues, we propose a multi-teacher knowledge distillation method with reinforcement learning for few-shot node classification (MTKD-RL). This framework is composed of a multi-teacher distillation network and a multi-teacher weight optimization module to deliver complementary supervision information from multiple perspectives. The reinforcement learning agent dynamically assigns adaptive weights to different teachers based on their prediction performance and the discrepancy between teacher and student models, which greatly enhances pseudo-label quality and distillation performance. Experiments on nine graph network datasets demonstrate that our method achieves consistent accuracy improvements ranging from 1.4% to 6.2% in few-shot node classification.

ComputersVol. 15(7)
North University of China (CN), Jiangsu Police Officer College (CN)
Quality Education
Openalex Percentile: Top 6%
Advanced Graph Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.