MATHEMATICAL APPROACH OF THE BACKPROPAGATION METHOD FOR CONSTRUCTING ARTIFICIAL NEURAL NETWORKS
Backpropagation isthe core part of a neural network. This method is used to efficiently train a network using a chain rule that allows differentiation of complex functions. In other words, after each pass through the network, the backpropagation method performs a backward pass to adjust the model parameters, such as weights and biases. This article highlights the importance of using the backpropagation method from the point of view of mathematical formulas for neural networks. The importance of using the backpropaga-tion learning algorithm to calculate the gradient (gradient descent) and the need to use the activation function to minimize the loss function is mathematically described and calculated by formulas, and also proven by calculating the matrix products of vectors for each layer of parameters - weights and biases and applying complex differential equations.
Authors
- Young Im Cho (ORCID: https://orcid.org/0000-0003-0184-7599)
- Aknur Yemberdiyeva
- M. Symbat
- Bekbolatov Samat
Institutions
- Gachon University (KR)
- Information Technology University (PK)
- International Information Technologies University (KZ)
Publication Details
- Journal
- INTERNATIONAL JOURNAL OF INFORMATION AND COMMUNICATION TECHNOLOGIES
- Published
- 2024-09-15
- DOI
- https://doi.org/10.54309/ijict.2024.19.3.003
- Citations
- 1
- Primary Topic
- Advanced Research in Systems and Signal Processing
- Type
- article
- Field-Weighted Citation Impact
- 0.33