On the Magnitude of Weights and Thresholds of Multithreshold Neural Units

We treat the problem of the evaluation of the memory capacity sufficient to store all weights and thresholds of a multithreshold neural network without loss of its capability to recognize set of patterns in n-dimensional space. We give the bounds on the magnitude of the integer weight and threshold vectors, respectively, of a multithreshold neuron, which hold for binary-valued neurons as well as multi-valued ones. The refinement of these bounds in the case of binary inputs is also presented. It allows us to evaluate the memory capacity of the multithreshold network. The estimation of average memory capacity for such networks is also considered. We established O(n2 + kn) lower bound on the capacity of the memory that is necessary to store weight coefficients and thresholds of almost all k-threshold neural units proceeding with k-threshold Boolean functions.

Authors

Institutions

Publication Details

Published
2024-10-16
DOI
https://doi.org/10.1109/csit65290.2024.10982585
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

On the Magnitude of Weights and Thresholds of Multithreshold Neural Units

Anatoliy Batyuk, Vladyslav Kotsovsky
Neural Networks and Applications
article

On the Magnitude of Weights and Thresholds of Multithreshold Neural Units

Anatoliy Batyuk, Vladyslav Kotsovsky
article en

Abstract

We treat the problem of the evaluation of the memory capacity sufficient to store all weights and thresholds of a multithreshold neural network without loss of its capability to recognize set of patterns in n-dimensional space. We give the bounds on the magnitude of the integer weight and threshold vectors, respectively, of a multithreshold neuron, which hold for binary-valued neurons as well as multi-valued ones. The refinement of these bounds in the case of binary inputs is also presented. It allows us to evaluate the memory capacity of the multithreshold network. The estimation of average memory capacity for such networks is also considered. We established O(n2 + kn) lower bound on the capacity of the memory that is necessary to store weight coefficients and thresholds of almost all k-threshold neural units proceeding with k-threshold Boolean functions.

Uzhhorod National University (UA), Lviv Polytechnic National University (UA)
Openalex Percentile: Top 73%
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.