Enhancing Membership Inference Attacks in Federated Learning Based on Overfitting Property

Membership inference attacks have been proposed to infer whether a specific sample is in the training dataset of a victim model. Inferred membership may reveal sensitive information, e.g., personal health condition deduced from a disease prediction model. In federated learning where local datasets of different participants are supposed to be protected, membership inference attacks may still pose a privacy threat. However, existing membership inference attacks in federated learning select the final epoch and random intermediate epochs during training to solicit features for the attack, which may lead to poor attack performance. In this paper, we propose a novel membership inference attack in federated learning, which attempt to find the key epoch during training that is most indicative of the differences between member and non-member samples. Inspired by the overfitting phenomena that often occurs during the training of learning models, we derive the key epoch as the onset of overfitting. We design efficient algorithms to pinpoint the key epoch and leverage attention mechanism to weight the importance of different features. We evaluate our scheme on four datasets and compare experimental results with state-of-the-art attack algorithms. Experimental results demonstrate that our attack outperforms existing works in terms of inference accuracy.

Authors

Institutions

Publication Details

Published
2024-12-20
DOI
https://doi.org/10.1109/msn63567.2024.00135
Primary Topic
Privacy-Preserving Technologies in Data
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Membership Inference Attacks in Federated Learning Based on Overfitting Property

Congrui Bai, Xiaoyan Yin, Yanjiao Chen, Yangyang Li et al.
Privacy-Preserving Technologies in Data
article

Enhancing Membership Inference Attacks in Federated Learning Based on Overfitting Property

Congrui Bai, Xiaoyan Yin, Yanjiao Chen, Yangyang Li, Q. Han
article en

Abstract

Membership inference attacks have been proposed to infer whether a specific sample is in the training dataset of a victim model. Inferred membership may reveal sensitive information, e.g., personal health condition deduced from a disease prediction model. In federated learning where local datasets of different participants are supposed to be protected, membership inference attacks may still pose a privacy threat. However, existing membership inference attacks in federated learning select the final epoch and random intermediate epochs during training to solicit features for the attack, which may lead to poor attack performance. In this paper, we propose a novel membership inference attack in federated learning, which attempt to find the key epoch during training that is most indicative of the differences between member and non-member samples. Inspired by the overfitting phenomena that often occurs during the training of learning models, we derive the key epoch as the onset of overfitting. We design efficient algorithms to pinpoint the key epoch and leverage attention mechanism to weight the importance of different features. We evaluate our scheme on four datasets and compare experimental results with state-of-the-art attack algorithms. Experimental results demonstrate that our attack outperforms existing works in terms of inference accuracy.

Northwest University (CN), China Academy of Information and Communications Technology (CN), Zhejiang University (CN)
Openalex Percentile: Top 72%
Privacy-Preserving Technologies in Data
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Enhancing Membership Inference Attacks in Federated Learning Based on Overfitting Property — Congrui Bai, Xiaoyan Yin, et al. · (2024) | TGRS Research Map | TGRS