High-speed programming with threshold division for RRAM-based neural network accelerators

RRAM-based neural network accelerators offer significant improvements in energy efficiency and throughput for machine learning and artificial intelligence. However, it is challenging to transfer trained neural network weights to RRAM arrays precisely due to non-ideal characteristics such as read noise and write variability. A write-verify strategy is commonly employed to adjust the RRAM cells within acceptable error margins. However, this process is time-consuming and resource-intensive. In this work, a high-speed programming strategy based on threshold division is proposed, inspired by magnitude-based network pruning. The relationship between threshold conductance and programming error is systematically investigated by allowing a larger programming error for cells below the threshold. Results of experiments on MLP and LeNet-5 networks demonstrate that the programming speed is enhanced by 3.41 times and 2.39 times, respectively. This strategy provides a novel method for fast transfer of weights in large-scale RRAM-based neural network accelerators.

Authors

Institutions

Publication Details

Journal
AIP Advances
Published
2024-12-01
DOI
https://doi.org/10.1063/5.0243471
Citations
1
Primary Topic
Advanced Memory and Neural Computing
Type
article
Field-Weighted Citation Impact
0.21

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

High-speed programming with threshold division for RRAM-based neural network accelerators

Peiwen Tong, Taiping Chen, Man Su, Wei Wang et al.
1 citations
AIP Advances
Advanced Memory and Neural Computing
0.21
article

High-speed programming with threshold division for RRAM-based neural network accelerators

Peiwen Tong, Taiping Chen, Man Su, Wei Wang, Xiangyu Du, Zhen Li, Rongrong Cao
article en
1 citations

Abstract

RRAM-based neural network accelerators offer significant improvements in energy efficiency and throughput for machine learning and artificial intelligence. However, it is challenging to transfer trained neural network weights to RRAM arrays precisely due to non-ideal characteristics such as read noise and write variability. A write-verify strategy is commonly employed to adjust the RRAM cells within acceptable error margins. However, this process is time-consuming and resource-intensive. In this work, a high-speed programming strategy based on threshold division is proposed, inspired by magnitude-based network pruning. The relationship between threshold conductance and programming error is systematically investigated by allowing a larger programming error for cells below the threshold. Results of experiments on MLP and LeNet-5 networks demonstrate that the programming speed is enhanced by 3.41 times and 2.39 times, respectively. This strategy provides a novel method for fast transfer of weights in large-scale RRAM-based neural network accelerators.

AIP AdvancesVol. 14(12)
National University of Defense Technology (CN)
National Natural Science Foundation of China
Affordable and clean energy
Openalex Percentile: Top 45%
Advanced Memory and Neural Computing
0.21
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

High-speed programming with threshold division for RRAM-based neural network accelerators — Peiwen Tong, Taiping Chen, et al. · AIP Advances (2024) | TGRS Research Map | TGRS