Multi-input Fourier neural network and its sparrow search optimization

In engineering applications, the back-propagation (BP) neural network often encounters many limitations due to its slow convergence and high noise sensitivity, and meanwhile the reported Fourier neural networks have no ability to extract the features of multi-attribute input data. Hereby, This work proposes a gradient descent-based multi-input Fourier neural network after integrating the multi-layer perceptron with an overlapping Fourier neural network. Thereafter, related to the difficulty of deciding the global optimal parameter settings, an improved sparrow search algorithm is developed to optimize the parameter settings and solve high dimensional function optimization problems, after the Cat chaotic map and the mechanisms of population-size adjustment and parameter adaptiveness are designed to promote the sparrow search algorithm's ability to balance global exploration and local exploitation. The theoretical analysis shows that the improved algorithm's computational complexity is decided by its population size and the optimization problem's dimension. Numerically comparative experiments have validated that not only the acquired Fourier neural network can effectively extract the features of multi-attribute data with strong generalization ability, but also the improved algorithm has significant advantages in coping with high dimensional function optimization problems.