FedRazor: Two-Stage Federated Unlearning via Representation Divergence and Gradient Conflict Trimming

Federated unlearning removes a client’s influence from a trained federated model without full retraining, which is required by data deletion regulations but remains difficult due to gradient coupling and recovery instability. Existing methods often rely on historical training records or suffer from severe utility degradation and model reverting after recovery. We propose FedRazor, a two-stage federated unlearning framework that achieves stable client-level unlearning through representation divergence and gradient direction control. In Stage I, FedRazor weakens dependence on forgotten data using two complementary objectives. A Divergence-Smoothing Loss reduces prediction confidence on forgotten labels, while a Feature Mean Divergence loss pushes forgotten representations away from the retained feature center. To protect retained performance, we introduce PCGrad Razor, which trims gradient components that conflict with retained gradients during aggregation. This stage produces an intermediate unlearned model without storing historical updates. In Stage II, FedRazor restores retained utility using directional gradient trimming. Gradients aligned with the unlearning displacement direction are removed, preventing forgotten information from re-entering the model during recovery. Experiments on MNIST, CIFAR-10, and CIFAR-100 under IID and non-IID settings show that FedRazor consistently reduces attack success rate to near zero while preserving retained accuracy. On CIFAR-10 Pat-50, FedRazor achieves ASR = 0.026 with retained accuracy 0.659 after post-training, outperforming strong baselines in stability and unlearning robustness.

Authors

Institutions

Publication Details

Journal
Information
Published
2026-02-02
DOI
https://doi.org/10.3390/info17020146
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

FedRazor: Two-Stage Federated Unlearning via Representation Divergence and Gradient Conflict Trimming

Yan Huang, Junjie Pang, Yanxin Hu, Xi Liu et al.
Information
Adversarial Robustness in Machine Learning
article

FedRazor: Two-Stage Federated Unlearning via Representation Divergence and Gradient Conflict Trimming

Yan Huang, Junjie Pang, Yanxin Hu, Xi Liu, Chao Cheng, Gang Liu
article en

Abstract

Federated unlearning removes a client’s influence from a trained federated model without full retraining, which is required by data deletion regulations but remains difficult due to gradient coupling and recovery instability. Existing methods often rely on historical training records or suffer from severe utility degradation and model reverting after recovery. We propose FedRazor, a two-stage federated unlearning framework that achieves stable client-level unlearning through representation divergence and gradient direction control. In Stage I, FedRazor weakens dependence on forgotten data using two complementary objectives. A Divergence-Smoothing Loss reduces prediction confidence on forgotten labels, while a Feature Mean Divergence loss pushes forgotten representations away from the retained feature center. To protect retained performance, we introduce PCGrad Razor, which trims gradient components that conflict with retained gradients during aggregation. This stage produces an intermediate unlearned model without storing historical updates. In Stage II, FedRazor restores retained utility using directional gradient trimming. Gradients aligned with the unlearning displacement direction are removed, preventing forgotten information from re-entering the model during recovery. Experiments on MNIST, CIFAR-10, and CIFAR-100 under IID and non-IID settings show that FedRazor consistently reduces attack success rate to near zero while preserving retained accuracy. On CIFAR-10 Pat-50, FedRazor achieves ASR = 0.026 with retained accuracy 0.659 after post-training, outperforming strong baselines in stability and unlearning robustness.

InformationVol. 17(2)
Qingdao University (CN), Qingdao University of Science and Technology (CN), Kennesaw State University (US), Changchun University of Technology (CN)
Openalex Percentile: Top 71%
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.