FedMGKD: a multi-granularity trusted knowledge distillation framework for edge personalized federated learning

In edge computing environments, Personalized Federated Learning (PFL) has garnered significant attention due to its strong capabilities in preserving data privacy and enabling local adaptation. However, existing knowledge distillation-based PFL approaches often suffer from limited transfer efficiency and robustness, particularly when confronted with heterogeneous data distributions and erroneous knowledge propagation. To address these challenges, this paper proposes FedMGKD, a novel federated learning framework based on multi-granular trustworthy knowledge distillation, aiming to achieve an optimal balance between global generalization and local customization. Specifically, FedMGKD aligns intermediate representations between student and teacher models across multiple layers of a global feature extractor—including embedding and intermediate convolutional layers—to capture richer shared semantics. Moreover, an exponential moving average correction mechanism is introduced to adaptively regulate the distillation strength based on teacher confidence, thereby mitigating the impact of unreliable knowledge. To further disentangle global and local features, an orthogonal constraint is applied, ensuring the preservation of core shared information while maintaining client-specific representations. Extensive experiments demonstrate that FedMGKD consistently outperforms state-of-the-art methods across various non-IID data distributions and client-scale scenarios. It achieves significant improvements in accuracy and robustness, all while maintaining low communication overhead and strong privacy guarantees. The code is available at https://github.com/lwl-525/FedMGKD .

Authors

Institutions

Publication Details

Journal
Complex & Intelligent Systems
Published
2025-12-09
DOI
https://doi.org/10.1007/s40747-025-02142-x
Primary Topic
Privacy-Preserving Technologies in Data
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

FedMGKD: a multi-granularity trusted knowledge distillation framework for edge personalized federated learning

Ande Bao, Wenlong Lu, Ping Zhang, X. R. Zhou
Complex & Intelligent Systems
Privacy-Preserving Technologies in Data
article

FedMGKD: a multi-granularity trusted knowledge distillation framework for edge personalized federated learning

Ande Bao, Wenlong Lu, Ping Zhang, X. R. Zhou
article en

Abstract

In edge computing environments, Personalized Federated Learning (PFL) has garnered significant attention due to its strong capabilities in preserving data privacy and enabling local adaptation. However, existing knowledge distillation-based PFL approaches often suffer from limited transfer efficiency and robustness, particularly when confronted with heterogeneous data distributions and erroneous knowledge propagation. To address these challenges, this paper proposes FedMGKD, a novel federated learning framework based on multi-granular trustworthy knowledge distillation, aiming to achieve an optimal balance between global generalization and local customization. Specifically, FedMGKD aligns intermediate representations between student and teacher models across multiple layers of a global feature extractor—including embedding and intermediate convolutional layers—to capture richer shared semantics. Moreover, an exponential moving average correction mechanism is introduced to adaptively regulate the distillation strength based on teacher confidence, thereby mitigating the impact of unreliable knowledge. To further disentangle global and local features, an orthogonal constraint is applied, ensuring the preservation of core shared information while maintaining client-specific representations. Extensive experiments demonstrate that FedMGKD consistently outperforms state-of-the-art methods across various non-IID data distributions and client-scale scenarios. It achieves significant improvements in accuracy and robustness, all while maintaining low communication overhead and strong privacy guarantees. The code is available at https://github.com/lwl-525/FedMGKD .

Complex & Intelligent SystemsVol. 12(1)
Henan University of Science and Technology (CN), Luoyang Institute of Science and Technology (CN)
Openalex Percentile: Top 79%
Privacy-Preserving Technologies in Data
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.