<i>Get Rid of Your Trail</i>: Remotely Erasing Backdoors in Federated Learning

Federated learning (FL) enables collaborative learning across multiple participants without exposing sensitive personal data. However, the distributed nature of FL and unvetted participants’ data makes it vulnerable to <i>backdoor attacks</i>. In these attacks, adversaries selectively inject malicious functionality into the centralized model during training, leading to intentional misclassifications for specific adversary-chosen inputs. While previous research has demonstrated successful injections of persistent backdoors in FL, the persistence also poses a challenge, as their existence in the centralized model can prompt the central aggregation server to take preventive measures for penalizing the adversaries. Therefore, this article proposes a method <i>that enables adversaries to effectively remove backdoors from the centralized model</i> upon achieving their objectives or upon suspicion of possible detection. The proposed approach extends the concept of <i>machine unlearning</i> and presents strategies to preserve the performance of the centralized model and simultaneously prevent over-unlearning of information unrelated to backdoor patterns, making adversaries stealthy while removing backdoors. To the best of our knowledge, this is the first work exploring machine unlearning in FL to remove backdoors to the benefit of adversaries. Exhaustive evaluation considering various image classification scenarios demonstrates the efficacy of the proposed method for efficient backdoor removal from the centralized model, injected by state-of-the-art attacks across multiple configurations.

Authors

Publication Details

Journal
IEEE Transactions on Artificial Intelligence
Published
2024-09-23
DOI
https://doi.org/10.1109/tai.2024.3465441
Citations
12
Primary Topic
Privacy-Preserving Technologies in Data
Type
article
Field-Weighted Citation Impact
4.17
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Get Rid of Your Trail: Remotely Erasing Backdoors in Federated Learning

Michail Maniatakos, Manaar Alam, Hithem Lamri
12 citations
IEEE Transactions on Artificial Intelligence
Privacy-Preserving Technologies in Data
4.17
article

Get Rid of Your Trail: Remotely Erasing Backdoors in Federated Learning

Michail Maniatakos, Manaar Alam, Hithem Lamri
article en
12 citations

Abstract

Federated learning (FL) enables collaborative learning across multiple participants without exposing sensitive personal data. However, the distributed nature of FL and unvetted participants’ data makes it vulnerable to <i>backdoor attacks</i>. In these attacks, adversaries selectively inject malicious functionality into the centralized model during training, leading to intentional misclassifications for specific adversary-chosen inputs. While previous research has demonstrated successful injections of persistent backdoors in FL, the persistence also poses a challenge, as their existence in the centralized model can prompt the central aggregation server to take preventive measures for penalizing the adversaries. Therefore, this article proposes a method <i>that enables adversaries to effectively remove backdoors from the centralized model</i> upon achieving their objectives or upon suspicion of possible detection. The proposed approach extends the concept of <i>machine unlearning</i> and presents strategies to preserve the performance of the centralized model and simultaneously prevent over-unlearning of information unrelated to backdoor patterns, making adversaries stealthy while removing backdoors. To the best of our knowledge, this is the first work exploring machine unlearning in FL to remove backdoors to the benefit of adversaries. Exhaustive evaluation considering various image classification scenarios demonstrates the efficacy of the proposed method for efficient backdoor removal from the centralized model, injected by state-of-the-art attacks across multiple configurations.

IEEE Transactions on Artificial IntelligenceVol. 5(12)
Openalex Percentile: Top 5%
Privacy-Preserving Technologies in Data
4.17
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.