OSCA: End-to-end Serial Stochastic Computing Neural Acceleration with Fine-grained Scaling and Piecewise Activation
End-to-end stochastic computing (SC) emerges as a promising paradigm for efficient neural acceleration. However, existing serial SC accelerators face serious accuracy challenges due to errors in addition, limited activation compatibility, and limited bitstream multiplication. In this paper, we propose OSCA, an accurate yet efficient end-to-end serial SC accelerator. OSCA features fine-grained scaling control in the SC adder to minimize quantization error and introduces novel segment units for piecewise approximation of complex nonlinear activation functions. We also design an integer-bitstream multiplier that guarantees accuracy regardless of the correlation between input bitstreams. Compared to the serial baseline accelerator of INT8 precision, we can achieve a 30.18% reduction in root mean square error (RMSE) along with an 87.75% area-delay product (ADP) reduction. Moreover, compared to a more accurate parallel accelerator, OSCA achieves a 92.05% ADP reduction with a 12.54× improvement in area efficiency, while also increasing inference accuracy by 0.44% and 0.86%.
Authors
- Yuan Wang (ORCID: https://orcid.org/0000-0002-4951-4286)
- Runsheng Wang (ORCID: https://orcid.org/0000-0002-7514-0767)
- Yixuan Hu (ORCID: https://orcid.org/0000-0002-6310-8209)
- Ru Huang (ORCID: https://orcid.org/0000-0002-8146-4821)
- Meng Li (ORCID: https://orcid.org/0000-0002-7212-2264)
- Yanbin Jia
Institutions
- Peking University (CN)
- Beijing Academy of Artificial Intelligence (CN)
- Beijing Advanced Sciences and Innovation Center (CN)
Publication Details
- Published
- 2024-10-27
- DOI
- https://doi.org/10.1145/3676536.3676652
- Primary Topic
- Advanced Neural Network Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Higher Education Discipline Innovation Project