Maximum Hidden Irreversibility Reveals Latent Rotational Dynamics and Predicts Emergent Grokking in Neural Networks
This is Version 2 of the paper. Compared to Version 1, this release includes: Reference-quality and numerically stable implementation of Maximum Hidden Irreversibility (MHI)- Mixture-of-Experts (MoE) extension with routing entropy- Analysis of rotational (antisymmetric) dynamics in neural representations- Improved toy model simulations for demonstration and testing- Updated experiments, figures, and clarifications throughout the paper Note: results presented are proof-of-concept simulations illustrating theoretical predictions. Empirical validation on real training runs is in preparation.
Authors
- Inna Alieksieienko
- Grok (xAI)
- ChatGPT (OpenAI)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-01-07
- DOI
- https://doi.org/10.5281/zenodo.18141309
- Primary Topic
- Neural Networks and Reservoir Computing
- Type
- article
- Field-Weighted Citation Impact
- 0.00