Physical neural networks using sharpness-aware training
Recent advances in AI are pushing the limits of traditional hardware, making physical neural networks (PNNs) a promising alternative. However, training PNNs remains challenging: in silico training suffers from model-reality mismatch, while in situ training produces device-specific models that do not transfer across fabrication variations. Both approaches are further compromised by post-deployment perturbations, such as thermal drift or misalignment, which invalidate trained models and require retraining. We address these challenges through sharpness-aware training (SAT), inspired by sharpness-aware minimization, which links loss landscape geometry to generalization. We establish a connection between loss landscape sharpness and robustness in physical systems and leverage it to improve PNN training. SAT is compatible with both in silico and in situ settings: it mitigates model-reality gaps, enables cross-device transfer, and provides strong resilience to post-deployment perturbations without retraining. We demonstrate SAT across three PNN platforms and multiple tasks, including classification, compression, reconstruction, and generation, showing its broad applicability.
Authors
- Tengji Xu (ORCID: https://orcid.org/0009-0008-5958-0149)
- Qiarong Xiao (ORCID: https://orcid.org/0009-0009-8900-9426)
- Dongliang Wang
- Benshan Wang
- Zeyu Luo
- Chaoran Huang
- Shaojie Liu (ORCID: https://orcid.org/0009-0004-4071-3256)
- Li Fan
Institutions
- Chinese University of Hong Kong (HK)
Publication Details
- Journal
- Nature Communications
- Published
- 2026-01-19
- DOI
- https://doi.org/10.1038/s41467-026-68470-9
- Primary Topic
- Neural Networks and Reservoir Computing
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Chinese University of Hong Kong
- National Key Research and Development Program of China