Ultrafast Probabilistic Neuron in an Artificial Spin Ice for Robust Deep Neural Networks

Abstract Deep neural networks (DNNs) have proved to be remarkably successful in various domains, in particular for implementing complex functions and performing sophisticated tasks. However, their vulnerability to adversarial noise undermines their reliability for safety‐critical tasks. Despite attempts to improve the robustness using algorithmic approaches, an effective hardware implementation is still lacking. Here an artificial probabilistic neuron device is proposed based on arrays of coupled nanomagnets, referred to as artificial spin ices, which return a nonlinear function with built‐in stochasticity in response to an ultrafast laser‐induced excitation. By exploiting solid‐state ionic gating, the magnetic coupling is electrically modulated, as a result of the magnetic anisotropy‐mediated competition of the symmetric exchange interaction and Dzyaloshinskii‐Moriya interaction, and hence the stochastic property of the neuron device at runtime can be tuned. Stochastic DNNs are then constructed with an output layer comprising several probabilistic neuron devices. Compared to conventional DNNs, the stochastic DNNs exhibit an order of magnitude greater resistance to adversarial noise, providing a significant improvement in robustness. This approach opens the way to more secure and reliable DNNs, enabling broader uses in real‐world applications.

Authors

Institutions

Publication Details

Journal
Advanced Functional Materials
Published
2024-12-13
DOI
https://doi.org/10.1002/adfm.202417334
Citations
5
Primary Topic
Neural Networks and Reservoir Computing
Type
article
Field-Weighted Citation Impact
1.74

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Ultrafast Probabilistic Neuron in an Artificial Spin Ice for Robust Deep Neural Networks

Laura J. Heyderman, Zhentao Liu, Aleš Hrabec, Jianhao Ding et al.
5 citations
Advanced Functional Materials
Neural Networks and Reservoir Computing
1.74
article

Ultrafast Probabilistic Neuron in an Artificial Spin Ice for Robust Deep Neural Networks

Laura J. Heyderman, Zhentao Liu, Aleš Hrabec, Jianhao Ding, Tong Bu, Yankun Dou, Zhongyu Liang, Zhaofei Yu, Zijian Lyu, Zhaochu Luo, Leran Wang, Jinbo Yang, Yunquan Liu, Peipei Ge, Tiejun Huang, Wenyun Yang
article en
5 citations

Abstract

Abstract Deep neural networks (DNNs) have proved to be remarkably successful in various domains, in particular for implementing complex functions and performing sophisticated tasks. However, their vulnerability to adversarial noise undermines their reliability for safety‐critical tasks. Despite attempts to improve the robustness using algorithmic approaches, an effective hardware implementation is still lacking. Here an artificial probabilistic neuron device is proposed based on arrays of coupled nanomagnets, referred to as artificial spin ices, which return a nonlinear function with built‐in stochasticity in response to an ultrafast laser‐induced excitation. By exploiting solid‐state ionic gating, the magnetic coupling is electrically modulated, as a result of the magnetic anisotropy‐mediated competition of the symmetric exchange interaction and Dzyaloshinskii‐Moriya interaction, and hence the stochastic property of the neuron device at runtime can be tuned. Stochastic DNNs are then constructed with an output layer comprising several probabilistic neuron devices. Compared to conventional DNNs, the stochastic DNNs exhibit an order of magnitude greater resistance to adversarial noise, providing a significant improvement in robustness. This approach opens the way to more secure and reliable DNNs, enabling broader uses in real‐world applications.

Advanced Functional MaterialsVol. 35(11)
Shanxi University (CN), Peking University (CN), Paul Scherrer Institute (CH), ETH Zurich (CH), Beijing Academy of Artificial Intelligence (CN), Fuzhou University (CN)
National Science Foundation, Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung, National Natural Science Foundation of China, Peking University, Beijing Nova Program, National Key Research and Development Program of China, Fundamental Research Funds for the Central Universities
Openalex Percentile: Top 12%
Neural Networks and Reservoir Computing
1.74
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.