An Automated Design Platform for ReRAM-based DNN Accelerators with Hardware-Software Co-exploration

Deep neural networks (DNNs) have gained significant attention due to their powerful feature learning capabilities. Traditional von Neumann architecture faces data transfer bottlenecks between computation and memory, hindering processing efficiency. One of the solutions is to use Resistive Random Access Memory (ReRAM) for realizing Computing-In-Memory (CIM) architectures, enabling rapid Matrix-Vector Multiplication (MVM) operations, thus accelerating DNN computations. While designers could optimize the design using hardware simulation tools before fabrication, manual adjustments are time-consuming. Additionally, the mutual influence between the DNN and hardware architecture further exacerbates the complexity of such designs, particularly for those lacking experience and expertise in the field. In this work, we propose an automation platform that aims to co-design the DNN with the underlying ReRAM-based accelerators through parameter search strategies. A training strategy is also proposed to mitigate the impact of ReRAM variation and Stuck-At-1 (SA1) fault. Simulation results show that our proposed training approach maintains an average accuracy of $89.9 \%$ and $77.9 \%$, under the influence of ReRAM-induced variation and Stuck-At-Fault (SAF), respectively, outperforming ${8 4. 5 \%}$ and ${9. 6 \%}$ offered by MNSIM.

Authors

Institutions

Publication Details

Published
2024-11-07
DOI
https://doi.org/10.1109/apccas62602.2024.10808244
Primary Topic
Advanced Memory and Neural Computing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Automated Design Platform for ReRAM-based DNN Accelerators with Hardware-Software Co-exploration

Yung‐Cheng Lai, Chin-Fu Nien
Advanced Memory and Neural Computing
article

An Automated Design Platform for ReRAM-based DNN Accelerators with Hardware-Software Co-exploration

Yung‐Cheng Lai, Chin-Fu Nien
article en

Abstract

Deep neural networks (DNNs) have gained significant attention due to their powerful feature learning capabilities. Traditional von Neumann architecture faces data transfer bottlenecks between computation and memory, hindering processing efficiency. One of the solutions is to use Resistive Random Access Memory (ReRAM) for realizing Computing-In-Memory (CIM) architectures, enabling rapid Matrix-Vector Multiplication (MVM) operations, thus accelerating DNN computations. While designers could optimize the design using hardware simulation tools before fabrication, manual adjustments are time-consuming. Additionally, the mutual influence between the DNN and hardware architecture further exacerbates the complexity of such designs, particularly for those lacking experience and expertise in the field. In this work, we propose an automation platform that aims to co-design the DNN with the underlying ReRAM-based accelerators through parameter search strategies. A training strategy is also proposed to mitigate the impact of ReRAM variation and Stuck-At-1 (SA1) fault. Simulation results show that our proposed training approach maintains an average accuracy of $89.9 \%$ and $77.9 \%$, under the influence of ReRAM-induced variation and Stuck-At-Fault (SAF), respectively, outperforming ${8 4. 5 \%}$ and ${9. 6 \%}$ offered by MNSIM.

National Yang Ming Chiao Tung University (TW), Chang Gung University (TW)
Industry, innovation and infrastructure
Openalex Percentile: Top 78%
Advanced Memory and Neural Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

An Automated Design Platform for ReRAM-based DNN Accelerators with Hardware-Software Co-exploration — Yung‐Cheng Lai, Chin-Fu Nien · (2024) | TGRS Research Map | TGRS