Mitigating RC-Delay Induced Accuracy Loss in Analog In-Memory Computing: A Non-Compromising Approach
The Internet of Things (IoT) has proliferated ubiquitous information exchange between the physical and cyber worlds through consumer electronics, with a focus on moving computing power to edge terminals. Computing-in-memory (CIM) technology has emerged as a competitive candidate for edge computing because of its low power consumption and high performance. In order to achieve accurate inference for neural network models, it is crucial to comprehend the source of errors in the CIM-based analog computing paradigm. In this work, we analyzed the impact of random noises and output stabling times on the Programmable Linear Random Access Memory (PLRAM)-based CIM chip. Experimental results show that the impact of random noise is negligible. The output stabling time can be treated as RC delay, which is related to the weight distribution. We proposed a weight reordering strategy to achieve better performance without sacrificing computation accuracy. Experiments with a commercial 11-keyword speech recognition model show a 74.4% runtime reduction while maintaining a 95.6% classification accuracy.
Authors
- Saike Zhu (ORCID: https://orcid.org/0009-0008-0300-9496)
- Shifan Gao (ORCID: https://orcid.org/0000-0002-1244-0199)
- Xiang Qiu (ORCID: https://orcid.org/0000-0001-8882-4212)
- Yi Zhao (ORCID: https://orcid.org/0000-0001-5368-3595)
- Xiang Ding (ORCID: https://orcid.org/0000-0002-8835-2961)
- Cimang Lu (ORCID: https://orcid.org/0000-0001-5515-032X)
- Youngseo Kim
Institutions
- Taiwan Semiconductor Manufacturing Company (China) (CN)
- East China Normal University (CN)
- Zhejiang University (CN)
Publication Details
- Journal
- IEEE Transactions on Consumer Electronics
- Published
- 2024-08-19
- DOI
- https://doi.org/10.1109/tce.2024.3445341
- Primary Topic
- Advanced Memory and Neural Computing
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- National Key Research and Development Program of China