Federated learning under differential privacy with effective clipping and analytic Gaussian mechanism

The utilization of convolutional neural networks has become pervasive across numerous sectors, including areas like visual identification and linguistic processing. Yet, there is a growing concern among users regarding the vulnerability of their privacy, stemming from the accessibility of model parameters. Then we take inspiration from differential privacy. By adding Gaussian noise to the training parameters, we finally realize the privacy preservation. This study implements an optimized image recognition technique that utilizes gradient layer clipping to enhance the efficacy of the model while maintaining differential privacy. Additionally, we employ the analytical Gaussian mechanism to bolster our approach. Findings indicate that at a privacy parameter &#1013; of 8.0, the model achieves an accuracy rate of 96.46% on the MNIST dataset and 61.10% on the CIFAR-10 dataset; Meanwhile, with a privacy parameter <i>&#1013;</i> of 2.0, the model's accuracy rate is 94.0% for MNIST and 58.79% for CIFAR-10.

Authors

Institutions

Publication Details

Published
2025-01-16
DOI
https://doi.org/10.1117/12.3052001
Citations
2
Primary Topic
Privacy-Preserving Technologies in Data
Type
article
Field-Weighted Citation Impact
4.96
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Federated learning under differential privacy with effective clipping and analytic Gaussian mechanism

Jianhui Zhang, Entang Li, Youqun Long, Chonghao Xu et al.
2 citations
Privacy-Preserving Technologies in Data
4.96
article

Federated learning under differential privacy with effective clipping and analytic Gaussian mechanism

Jianhui Zhang, Entang Li, Youqun Long, Chonghao Xu, Nianming Xue, Xiangyang Y. Li, Fangfang Chen, Tao Liu
article en
2 citations

Abstract

The utilization of convolutional neural networks has become pervasive across numerous sectors, including areas like visual identification and linguistic processing. Yet, there is a growing concern among users regarding the vulnerability of their privacy, stemming from the accessibility of model parameters. Then we take inspiration from differential privacy. By adding Gaussian noise to the training parameters, we finally realize the privacy preservation. This study implements an optimized image recognition technique that utilizes gradient layer clipping to enhance the efficacy of the model while maintaining differential privacy. Additionally, we employ the analytical Gaussian mechanism to bolster our approach. Findings indicate that at a privacy parameter &#1013; of 8.0, the model achieves an accuracy rate of 96.46% on the MNIST dataset and 61.10% on the CIFAR-10 dataset; Meanwhile, with a privacy parameter <i>&#1013;</i> of 2.0, the model's accuracy rate is 94.0% for MNIST and 58.79% for CIFAR-10.

China Telecom (China) (CN), East China Normal University (CN)
Openalex Percentile: Top 6%
Privacy-Preserving Technologies in Data
4.96
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.