A self-learning magnetic Hopfield neural network with intrinsic gradient descent adaption

Physical neural networks (PNN) using physical materials and devices to mimic synapses and neurons offer an energy-efficient way to implement artificial neural networks. Yet, training PNN is difficult and heavily relies on external computing resources. An emerging concept to solve this issue is called physical self-learning that uses intrinsic physical parameters as trainable weights. Under external inputs (i.e., training data), training is achieved by the natural evolution of physical parameters that intrinsically adapt modern learning rules via an autonomous physical process, eliminating the requirements on external computation resources. Here, we demonstrate a real spintronic system that mimics Hopfield neural networks (HNN), and unsupervised learning is intrinsically performed via the evolution of the physical process. Using magnetic texture-defined conductance matrix as trainable weights, we illustrate that under external voltage inputs, the conductance matrix naturally evolves and adapts Oja's learning algorithm in a gradient descent manner. The self-learning HNN is scalable and can achieve associative memories on patterns with high similarities. The fast spin dynamics and reconfigurability of magnetic textures offer an advantageous platform toward efficient autonomous training directly in materials.

Authors

Institutions

Publication Details

Journal
Proceedings of the National Academy of Sciences
Published
2024-12-13
DOI
https://doi.org/10.1073/pnas.2416294121
Citations
1
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.35

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A self-learning magnetic Hopfield neural network with intrinsic gradient descent adaption

Lifeng Yin, Yi Zhu, Weichao Yu, Yizheng Wu et al.
1 citations
Proceedings of the National Academy of Sciences
Neural Networks and Applications
0.35
article

A self-learning magnetic Hopfield neural network with intrinsic gradient descent adaption

Lifeng Yin, Yi Zhu, Weichao Yu, Yizheng Wu, Chang Niu, Wenjie Hu, Yinyan Zhu, Yunzhuo Wu, Jian Shen, Tong Wu, Jiang Xiao, Wenbin Wang, Chuanlong Xu, Huanyu Zhang, Yadi Wang, Hangwen Guo, Yu Wu
article en
1 citations

Abstract

Physical neural networks (PNN) using physical materials and devices to mimic synapses and neurons offer an energy-efficient way to implement artificial neural networks. Yet, training PNN is difficult and heavily relies on external computing resources. An emerging concept to solve this issue is called physical self-learning that uses intrinsic physical parameters as trainable weights. Under external inputs (i.e., training data), training is achieved by the natural evolution of physical parameters that intrinsically adapt modern learning rules via an autonomous physical process, eliminating the requirements on external computation resources. Here, we demonstrate a real spintronic system that mimics Hopfield neural networks (HNN), and unsupervised learning is intrinsically performed via the evolution of the physical process. Using magnetic texture-defined conductance matrix as trainable weights, we illustrate that under external voltage inputs, the conductance matrix naturally evolves and adapts Oja's learning algorithm in a gradient descent manner. The self-learning HNN is scalable and can achieve associative memories on patterns with high similarities. The fast spin dynamics and reconfigurability of magnetic textures offer an advantageous platform toward efficient autonomous training directly in materials.

Proceedings of the National Academy of SciencesVol. 121(51)
Fudan University (CN), Hefei University (CN), Collaborative Innovation Center of Advanced Microstructures (CN)
Natural Science Foundation of Shanghai, National Natural Science Foundation of China, Science and Technology Commission of Shanghai Municipality
Affordable and clean energy
Openalex Percentile: Top 31%
Neural Networks and Applications
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.