Advancing Neural Networks: Innovations and Impacts on Energy Consumption
Abstract The energy efficiency of Artificial Intelligence (AI) systems is a crucial and actual issue that may have an important impact on an ecological, economic and technological level. Spiking Neural Networks (SNNs) are strongly suggested as valid candidates able to overcome Artificial Neural Networks (ANNs) in this specific contest. In this study, the proposal involves the review and comparison of energy consumption of the popular Artificial Neural Network architectures implemented on the CPU and GPU hardware compared with Spiking Neural Networks implemented in specialized memristive hardware and biological neural network human brain. As a result, the energy efficiency of Spiking Neural Networks can be indicated from 5 to 8 orders of magnitude. Some Spiking Neural Networks solutions are proposed including continuous feedback‐driven self‐learning approaches inspired by biological Spiking Neural Networks as well as pure memristive solutions for Spiking Neural Networks.
Authors
- Jordi Vallverdú (ORCID: https://orcid.org/0000-0001-9975-7780)
- Milovan Medojević (ORCID: https://orcid.org/0000-0002-4113-0210)
- Max Talanov (ORCID: https://orcid.org/0000-0002-6727-0983)
- Alina Fedorova (ORCID: https://orcid.org/0009-0003-7785-7096)
- Silvia Battistoni (ORCID: https://orcid.org/0000-0002-4646-2425)
- Evgenia I. Alshanskaia
- Alexander Toschev (ORCID: https://orcid.org/0000-0003-4424-6822)
- Victor Erokhin (ORCID: https://orcid.org/0000-0002-6297-5538)
- Miloš Jovičić (ORCID: https://orcid.org/0009-0006-2984-7047)
- Nikola Jovišić (ORCID: https://orcid.org/0009-0003-3000-2920)
Institutions
- National Research University Higher School of Economics (RU)
- Institució Catalana de Recerca i Estudis Avançats (ES)
- Kazan Federal University (RU)
- Institute of Materials for Electronics and Magnetism (IT)
Publication Details
- Journal
- Advanced Electronic Materials
- Published
- 2024-11-27
- DOI
- https://doi.org/10.1002/aelm.202400258
- Citations
- 13
- Primary Topic
- Advanced Memory and Neural Computing
- Type
- article
- Field-Weighted Citation Impact
- 2.71
Funders
- Russian Foundation for Basic Research
- Institució Catalana de Recerca i Estudis Avançats
- Consiglio Nazionale delle Ricerche