Synaptic field theory for neural networks
Theoretical understanding of deep learning remains elusive despite its empirical success. In this study, we propose a novel “synaptic field theory” that describes the training dynamics of synaptic weights and biases in the continuum limit. Unlike previous approaches, our framework treats synaptic weights and biases as fields and interprets their indices as spatial coordinates, with the training data acting as external sources. This perspective offers new insights into the fundamental mechanisms of deep learning and suggests a pathway for leveraging well-established field-theoretic techniques to study neural network training.
Authors
- Hye‐Sung Lee (ORCID: https://orcid.org/0000-0002-7333-3741)
- Jaeok Yi (ORCID: https://orcid.org/0000-0001-9400-3939)
- Donghee Lee (ORCID: https://orcid.org/0009-0007-1043-4004)
Institutions
- Korea Advanced Institute of Science and Technology (KR)
Publication Details
- Journal
- Physical review. D/Physical review. D.
- Published
- 2025-07-25
- DOI
- https://doi.org/10.1103/bhwt-j2rq
- Primary Topic
- Neural Networks and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Research Foundation of Korea