Energy-Efficient Activation Control of Laguerre Neural Network

The Laguerre Neural Network (LaNN) employs Laguerre polynomials (LPs) as the activation functions of its hidden neurons (HNs) to approximate the nonlinear functions (NFs). From the perspective of statistics, the more LPs are activated, the more LP-based activation functions (LPAFs) of the HNs will operate, and thus the smaller approximation error (AE) will be suffered by the LaNN, while leading to more energy consumption since activating any LP has to consume energy. Therefore, how to control the activation of LPs to make the optimal tradeoff between approximation accuracy and energy consumption arises as an interesting issue. To address this issue, this paper first establishes an energy-constraint probability-based approximation-accuracy optimization-theoretical (EPAO) framework, considering the probability of obtaining the minimum AE (MAE) as the objective while the energy consumption of the LaNN as the constraint, and then proposes an algorithm for LaNN to maximize the probability of obtaining the MAE at the acceptable level of energy consumption. Experimental comparisons with existing methods verifies its performance.