Endpoint Selection Through a Moving Fold in a Two-Neuron Group Composition Network

Which endpoint does training reach when the minimum it approaches is degenerate and a small perturbation splits it into competing branches? We study two normalized quadratic neurons trained by continuous exact cross entropy on the complete addition table of C3. With logit scale s³, the first correction to the leading feature objective has a quartic minimum in the relative phase. At unit gain, balancing this quartic against the next-order force gives a displacement of order s; relative relaxation then takes the s⁻⁸ physical clock, followed by common-phase selection on the s⁻⁹ clock. An input-gain imbalance β = 1 + ηs produces a cusp whose forcing comes from the still-moving common phases. For fixed |η| ≠ ηc and any absolutely continuous initialization law, for almost every start in the leading basin there is a start-dependent scale below which the full exact-CE flow reaches the secondary branch if and only if it enters on that side and the forcing stays below the fold threshold along the entire limiting common-phase path. The stationary landscape at the limiting phases alone does not determine the endpoint. For |η| < ηc ≈ 0.486 only the primary minimum is selected; for |η| ≥ η∗ ≈ 0.701 the entrance side alone decides; between these thresholds the path matters. Under rotation-invariant initialization, the limiting secondary probability is half the area fraction of common phases whose path keeps the forcing below the fold threshold. A first integral computes this area. We also classify the second-order unfoldings for other cyclic pairs. These are continuous-training, vanishing-scale results and give no finite-scale branch probabilities.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-26
DOI
https://doi.org/10.5281/zenodo.23652721
Primary Topic
Neural Networks and Applications
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Endpoint Selection Through a Moving Fold in a Two-Neuron Group Composition Network

Vanshdeep Sehrawat
Zenodo (CERN European Organization for Nuclear Research)
Neural Networks and Applications
preprint

Endpoint Selection Through a Moving Fold in a Two-Neuron Group Composition Network

Vanshdeep Sehrawat
preprint en

Abstract

Which endpoint does training reach when the minimum it approaches is degenerate and a small perturbation splits it into competing branches? We study two normalized quadratic neurons trained by continuous exact cross entropy on the complete addition table of C3. With logit scale s³, the first correction to the leading feature objective has a quartic minimum in the relative phase. At unit gain, balancing this quartic against the next-order force gives a displacement of order s; relative relaxation then takes the s⁻⁸ physical clock, followed by common-phase selection on the s⁻⁹ clock. An input-gain imbalance β = 1 + ηs produces a cusp whose forcing comes from the still-moving common phases. For fixed |η| ≠ ηc and any absolutely continuous initialization law, for almost every start in the leading basin there is a start-dependent scale below which the full exact-CE flow reaches the secondary branch if and only if it enters on that side and the forcing stays below the fold threshold along the entire limiting common-phase path. The stationary landscape at the limiting phases alone does not determine the endpoint. For |η| < ηc ≈ 0.486 only the primary minimum is selected; for |η| ≥ η∗ ≈ 0.701 the entrance side alone decides; between these thresholds the path matters. Under rotation-invariant initialization, the limiting secondary probability is half the area fraction of common phases whose path keeps the forcing below the fold threshold. A first integral computes this area. We also classify the second-order unfoldings for other cyclic pairs. These are continuous-training, vanishing-scale results and give no finite-scale branch probabilities.

Zenodo (CERN European Organization for Nuclear Research)
University of Nevada, Las Vegas (US)
Neural Networks and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon