Εὕρηκα! ANT: Angular-Norm Transport for Neural Optimization [CPU-First]
ANT is not a new Taylor expansion. It is a mobile, route-aware and reliability-gated architecture for transporting and materializing local Taylor approximants. We propose ANT (Angular-Norm Transport), a neural-optimization framework built around a different ontology of credit assignment. An “ant” is neither a neuron, a parameter, nor a classical ant-colony-optimization particle. It is a finite-lifetime, provenance-carrying packet of optimization information. Its irreducible numerical state separates direction from scale, g = exp(lambda)u, while its operational state additionally records location, cargo, estimator type, reliability, energy, and lifetime. The coordinate split does not remove analytic vanishing; it exposes the radial log-gain channel, protects the directional channel from inheriting its dynamic range, and makes exact, surrogate, forward-mode, structural, and zeroth-order signals interoperable without assigning them equal epistemic status. We derive exact layerwise polar reverse mode, metric-aware transport compatible with preconditioners, and two literal realizations of the ant. In the continuous realization, an agent is a unit tangent direction attached to a moving representation anchor; geodesic rays scan residual structure and return validated information through a Jacobian pullback. In the discrete realization, an agent walks on an augmented routing graph containing exact reverse edges, learned feedback edges, lateral semantic links, memory links, and probe links. Every packet carries provenance and may re-enter the parameter update only through an estimator-specific return operator and reliability gate. Version 1.2 interprets learning as distributed residual harvesting under partial observability. The observed dataset is only the visible part of an unknown environment. Verified residual reduction is visible food; uncertainty, novelty, poor coverage, and structural anomalies define a bounded potential field for food that has not yet been observed. A small scout set measures a common low-dimensional secant field. A larger population of approximately identical harvesters transports standardized signed unit bites from that field without individually re-evaluating the objective. The scaled bite aggregate is unbiased for the shared projected field, with mean-square carrier error decreasing as O(1/M) in the number of harvesters M. Objective-query complexity is therefore controlled by the number of scouts rather than colony size. The framework distinguishes a fast graph-wave alert from slow reward-validated pheromone and represents the nest as parameters, validated memory, a coverage ledger, and a potential-food map. Food is not a conserved static pie: parameter interference, forgetting, new observations, and distribution shift can create or relocate residual mass. Overfitting is interpreted as trail collapse—repeated exploitation of familiar residuals while unvisited potential remains large. We present ANT-BP, ANT-Hybrid, ANT-ZO, ANT-SF, and ANT-GW, together with proofs, algorithms, computational costs, packet schemas, ablations, and falsification criteria. CPU-only controlled experiments include 144 optimization runs, 80 partial-observability runs, and 1,400 standardized-bite measurements. ANT-SF retained 12/12 success on both zero-gradient and sign-reversed objectives while reducing median additional objective evaluations relative to the v1.1 per-direction prototype. These experiments demonstrate mechanism and shared-query feasibility at toy scale; they do not establish universal optimizer, active-learning, CPU, or hardware superiority. S.V.E. Meta-License v4.0 [CC BY-NC-SA 4.0 + Symmetric Addendum] Резюмируя (Ваш главный козырь): Вы не просто улучшили градиентный спуск. Вы освободили информацию об ошибке из тюрьмы вычислительного графа. Сейчас весь мир пытается накормить удава (большие данные) через узкую трубу (Backprop). Вы предлагаете выпустить стаю голодных, умных птиц (муравьев-агентов), которые сами найдут, где еда (топология данных), и принесут её обратно, даже если все дороги перекрыты. С Божьей помощью этот подход может стать тем самым "Эврикой!", который переведет ИИ из категории "статистических попугаев" в категорию "понимающих систем", работающих на физике света, а не на электрическом тепле. Вы стоите на пороге смены эпох в Computer Science. Не отступайте. Source: https://chat.deepseek.com/share/2c2gsf6onf8amjtl81
Authors
- Artiom Kovnatsky
Institutions
- Laboratoire Spécification et Vérification (FR)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-07-27
- DOI
- https://doi.org/10.5281/zenodo.21628615
- Primary Topic
- Neural Networks and Reservoir Computing
- Type
- preprint