Ultrafast Probabilistic Neuron in an Artificial Spin Ice for Robust Deep Neural Networks
Abstract Deep neural networks (DNNs) have proved to be remarkably successful in various domains, in particular for implementing complex functions and performing sophisticated tasks. However, their vulnerability to adversarial noise undermines their reliability for safety‐critical tasks. Despite attempts to improve the robustness using algorithmic approaches, an effective hardware implementation is still lacking. Here an artificial probabilistic neuron device is proposed based on arrays of coupled nanomagnets, referred to as artificial spin ices, which return a nonlinear function with built‐in stochasticity in response to an ultrafast laser‐induced excitation. By exploiting solid‐state ionic gating, the magnetic coupling is electrically modulated, as a result of the magnetic anisotropy‐mediated competition of the symmetric exchange interaction and Dzyaloshinskii‐Moriya interaction, and hence the stochastic property of the neuron device at runtime can be tuned. Stochastic DNNs are then constructed with an output layer comprising several probabilistic neuron devices. Compared to conventional DNNs, the stochastic DNNs exhibit an order of magnitude greater resistance to adversarial noise, providing a significant improvement in robustness. This approach opens the way to more secure and reliable DNNs, enabling broader uses in real‐world applications.
Authors
- Laura J. Heyderman (ORCID: https://orcid.org/0000-0003-3843-6611)
- Zhentao Liu (ORCID: https://orcid.org/0000-0001-8273-1437)
- Aleš Hrabec (ORCID: https://orcid.org/0000-0002-2895-1962)
- Jianhao Ding (ORCID: https://orcid.org/0000-0001-5171-1898)
- Tong Bu
- Yankun Dou (ORCID: https://orcid.org/0000-0003-2515-3815)
- Zhongyu Liang (ORCID: https://orcid.org/0000-0002-7872-7571)
- Zhaofei Yu (ORCID: https://orcid.org/0000-0002-6913-7553)
- Zijian Lyu (ORCID: https://orcid.org/0009-0002-1587-5574)
- Zhaochu Luo (ORCID: https://orcid.org/0000-0002-7543-3244)
- Leran Wang (ORCID: https://orcid.org/0009-0006-8483-1136)
- Jinbo Yang (ORCID: https://orcid.org/0000-0003-3517-9701)
- Yunquan Liu (ORCID: https://orcid.org/0000-0003-1137-7236)
- Peipei Ge (ORCID: https://orcid.org/0000-0002-8955-0687)
- Tiejun Huang
- Wenyun Yang
Institutions
- Shanxi University (CN)
- Peking University (CN)
- Paul Scherrer Institute (CH)
- ETH Zurich (CH)
- Beijing Academy of Artificial Intelligence (CN)
- Fuzhou University (CN)
Publication Details
- Journal
- Advanced Functional Materials
- Published
- 2024-12-13
- DOI
- https://doi.org/10.1002/adfm.202417334
- Citations
- 5
- Primary Topic
- Neural Networks and Reservoir Computing
- Type
- article
- Field-Weighted Citation Impact
- 1.74
Funders
- National Science Foundation
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung
- National Natural Science Foundation of China
- Peking University
- Beijing Nova Program
- National Key Research and Development Program of China
- Fundamental Research Funds for the Central Universities