A ReRAM-Based Adaptive Binary Neural Network Accelerator for Efficient Inference

ReRAM-based accelerators have demonstrated significant potential in neural network acceleration. Meanwhile, Binary Neural Networks (BNNs), as an extreme form of model compression, greatly optimize hardware resource utilization and power consumption. Consequently, leveraging the combined advantages of BNNs and ReRAM accelerators offers a promising solution for ultra-low power artificial intelligence (AI) hardware. In this paper, we propose a ReRAM-based Adaptive Threshold BNN accelerator (ReAT) design, which adaptively adjusts weight quantization thresholds using higher order statistical information and employs a gradient-based activation quantization strategy to minimize quantization errors. We evaluate our design using a modified NeuroSim simulator. The results show that, compared to conventional multi-bit quantized models, the ReAT-based BNN accelerators achieve a 7.14× improvement in energy efficiency with minimal accuracy loss. This study provides valuable insights into the application of ReRAM accelerators in low-power edge computing and highlights the great potential of BNNs for high-efficiency inference.

Authors

Institutions

Publication Details

Published
2025-05-09
DOI
https://doi.org/10.1109/iseda65950.2025.11100389
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A ReRAM-Based Adaptive Binary Neural Network Accelerator for Efficient Inference

Huawei Li, Bin Huang, P.P. Dang
Neural Networks and Applications
article

A ReRAM-Based Adaptive Binary Neural Network Accelerator for Efficient Inference

Huawei Li, Bin Huang, P.P. Dang
article en

Abstract

ReRAM-based accelerators have demonstrated significant potential in neural network acceleration. Meanwhile, Binary Neural Networks (BNNs), as an extreme form of model compression, greatly optimize hardware resource utilization and power consumption. Consequently, leveraging the combined advantages of BNNs and ReRAM accelerators offers a promising solution for ultra-low power artificial intelligence (AI) hardware. In this paper, we propose a ReRAM-based Adaptive Threshold BNN accelerator (ReAT) design, which adaptively adjusts weight quantization thresholds using higher order statistical information and employs a gradient-based activation quantization strategy to minimize quantization errors. We evaluate our design using a modified NeuroSim simulator. The results show that, compared to conventional multi-bit quantized models, the ReAT-based BNN accelerators achieve a 7.14× improvement in energy efficiency with minimal accuracy loss. This study provides valuable insights into the application of ReRAM accelerators in low-power edge computing and highlights the great potential of BNNs for high-efficiency inference.

Chinese Academy of Sciences (CN), Institute of Computing Technology (CN), University of Chinese Academy of Sciences (CN)
Peng Cheng Laboratory
Openalex Percentile: Top 90%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.