Harnessing Nonidealities in Analog In‐Memory Computing Circuits: A Physical Modeling Approach for Neuromorphic Systems
Large‐scale deep learning models are increasingly constrained by their immense energy consumption, which limits their scalability and applicability for edge intelligence. In‐memory computing (IMC) offers a promising solution by addressing the von Neumann bottleneck inherent in traditional deep learning accelerators, significantly reducing energy consumption. However, the analog nature of IMC introduces hardware nonidealities that degrade model performance and reliability. This article presents a novel approach to directly train physical models of IMC, formulated as ordinary differential equation (ODE)‐based physical neural networks (PNNs). To enable the training of large‐scale networks, a technique called differentiable spike‐time discretization is proposed, which reduces the computational cost of ODE‐based PNNs by up to 20 times in speed and 100 times in memory. Such large‐scale networks enhance learning performance by exploiting hardware nonidealities on the CIFAR‐10 dataset. The proposed bottom‐up methodology is validated through post‐layout SPICE simulations on the IMC circuit with nonideal characteristics using the sky130 process. The proposed PNN approach reduces the discrepancy between model behavior and circuit dynamics by at least an order of magnitude. This work paves the way for leveraging nonideal physical devices, such as nonvolatile resistive memories, for energy‐efficient deep learning applications.
Authors
- Sou Nobukawa (ORCID: https://orcid.org/0000-0001-7003-6912)
- Takeo Hosomi (ORCID: https://orcid.org/0000-0001-5972-3877)
- Kazuyuki Aihara (ORCID: https://orcid.org/0000-0002-4602-9816)
- Yusuke Sakemi (ORCID: https://orcid.org/0000-0002-0274-9491)
- Yuji Okamoto (ORCID: https://orcid.org/0000-0003-0024-549X)
- Takashi Morie (ORCID: https://orcid.org/0000-0003-2708-4307)
Institutions
- NEC (Japan) (JP)
- Kyushu Institute of Technology (JP)
- Kyoto University (JP)
- National Center of Neurology and Psychiatry (JP)
- National Institute of Mental Health (JP)
- Tokyo International University (JP)
- Chiba Institute of Technology (JP)
Publication Details
- Journal
- Advanced Intelligent Systems
- Published
- 2025-08-18
- DOI
- https://doi.org/10.1002/aisy.202500351
- Primary Topic
- Advanced Memory and Neural Computing
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Institute of Advanced Industrial Science and Technology
- Secom Science and Technology Foundation
- University of Tokyo
- Japan Society for the Promotion of Science
- Japan Science and Technology Agency
- International Research Center for Neurointelligence, University of Tokyo
- Precursory Research for Embryonic Science and Technology
- Moonshot Research and Development Program