Algebraically Stabilizing Blocks for Quantized and Finite-Precision Neural Networks

This paper proposes a construction of algebraically stabilizing blocks for quantized and finite-precision neural networks. The approach is based on linear transformations defined by integer-valued matrices satisfying a condition of the form Wk=I+μD, which specifies algebraically controlled k-step behavior and modular periodicity in the integer-valued setting. The proposed property is invariant under conjugation, allowing the stabilizing construction to be transferred across equivalent linear representations. The resulting module can be integrated locally into existing neural architectures without requiring the algebraic structure to be imposed globally. The theoretical results concern algebraic and modular stabilization of the linear block and do not constitute a general guarantee of classical spectral or asymptotic stability in real-valued space. The approach is evaluated experimentally under multi-component harmonic, impulsive, and noisy inputs in both floating-point and INT8-quantized settings. Across several experimental configurations, the proposed block reduces output energy, component-wise variation, selected amplitude-related measures, and finite-precision deviation relative to floating-point reference trajectories. Norm-matched control experiments further suggest that the observed effects are not attributable solely to a reduction in operator magnitude, but may also reflect structural properties of the algebraically constructed operator. The proposed construction is particularly relevant to neural systems operating under limited numerical precision, including FPGA-, ASIC-, and edge-oriented implementations. It provides a structural approach for incorporating formally specified algebraic properties into the design of neural-network architectures.

Authors

Institutions

Publication Details

Journal
Axioms
Published
2026-07-16
DOI
https://doi.org/10.3390/axioms15070533
Primary Topic
Model Reduction and Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Algebraically Stabilizing Blocks for Quantized and Finite-Precision Neural Networks

Kostadin Yotov, Stanka Hadzhikoleva, Emil Hadzhikolev
Axioms
Model Reduction and Neural Networks
article

Algebraically Stabilizing Blocks for Quantized and Finite-Precision Neural Networks

Kostadin Yotov, Stanka Hadzhikoleva, Emil Hadzhikolev
article en

Abstract

This paper proposes a construction of algebraically stabilizing blocks for quantized and finite-precision neural networks. The approach is based on linear transformations defined by integer-valued matrices satisfying a condition of the form Wk=I+μD, which specifies algebraically controlled k-step behavior and modular periodicity in the integer-valued setting. The proposed property is invariant under conjugation, allowing the stabilizing construction to be transferred across equivalent linear representations. The resulting module can be integrated locally into existing neural architectures without requiring the algebraic structure to be imposed globally. The theoretical results concern algebraic and modular stabilization of the linear block and do not constitute a general guarantee of classical spectral or asymptotic stability in real-valued space. The approach is evaluated experimentally under multi-component harmonic, impulsive, and noisy inputs in both floating-point and INT8-quantized settings. Across several experimental configurations, the proposed block reduces output energy, component-wise variation, selected amplitude-related measures, and finite-precision deviation relative to floating-point reference trajectories. Norm-matched control experiments further suggest that the observed effects are not attributable solely to a reduction in operator magnitude, but may also reflect structural properties of the algebraically constructed operator. The proposed construction is particularly relevant to neural systems operating under limited numerical precision, including FPGA-, ASIC-, and edge-oriented implementations. It provides a structural approach for incorporating formally specified algebraic properties into the design of neural-network architectures.

AxiomsVol. 15(7)
Plovdiv University (BG)
Affordable and clean energy
Openalex Percentile: Top 7%
Model Reduction and Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.