Information Entropy of Biometric Data in a Recurrent Neural Network with Low Connectivity
In this paper, we explore the storage capacity and maximal information content of a random recurrent neural network characterized by a very low connectivity. A specific set of patterns is embedded into the network according to the Hebb prescription, a fundamental principle in neural learning. We thoroughly examine how various properties of the network, such as its connectivity and the level of synaptic noise, influence its performance and information retention capabilities, which is evaluated through an entropy measure. Our theoretical analyses are complemented by extensive simulations, and the results are validated through comparisons with the retrieval of real biometric patterns, including retinal vessel maps and fingerprints. This comprehensive approach provides deeper insights into the functionality and limitations of finite-connectivity neural networks and their applicability to the retrieval of complex, structured patterns.
Authors
- Francisco B. Rodrı́guez (ORCID: https://orcid.org/0000-0003-4053-099X)
- R. Erichsen (ORCID: https://orcid.org/0000-0002-7056-4069)
- Ángel Sánchez (ORCID: https://orcid.org/0000-0001-9069-6985)
- David Domínguez (ORCID: https://orcid.org/0000-0003-0911-1834)
- Mario González (ORCID: https://orcid.org/0000-0002-0204-5662)
Institutions
- Universidade Federal do Rio Grande do Sul (BR)
- Universidad Rey Juan Carlos (ES)
- Universidad de Las Américas (EC)
- Universidad Autónoma de Madrid (ES)
Publication Details
- Journal
- Entropy
- Published
- 2025-10-31
- DOI
- https://doi.org/10.3390/e27111125
- Primary Topic
- Ferroelectric and Negative Capacitance Devices
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
- European Regional Development Fund
- Agencia Estatal de Investigación