Maximum Hidden Irreversibility Reveals Latent Rotational Dynamics and Predicts Emergent Grokking in Neural Networks

This is Version 2 of the paper. Compared to Version 1, this release includes: Reference-quality and numerically stable implementation of Maximum Hidden Irreversibility (MHI)- Mixture-of-Experts (MoE) extension with routing entropy- Analysis of rotational (antisymmetric) dynamics in neural representations- Improved toy model simulations for demonstration and testing- Updated experiments, figures, and clarifications throughout the paper Note: results presented are proof-of-concept simulations illustrating theoretical predictions. Empirical validation on real training runs is in preparation.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-01-07
DOI
https://doi.org/10.5281/zenodo.18141309
Primary Topic
Neural Networks and Reservoir Computing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Maximum Hidden Irreversibility Reveals Latent Rotational Dynamics and Predicts Emergent Grokking in Neural Networks

Inna Alieksieienko, Grok (xAI), ChatGPT (OpenAI)
Zenodo (CERN European Organization for Nuclear Research)
Neural Networks and Reservoir Computing
article

Maximum Hidden Irreversibility Reveals Latent Rotational Dynamics and Predicts Emergent Grokking in Neural Networks

Inna Alieksieienko, Grok (xAI), ChatGPT (OpenAI)
article en

Abstract

This is Version 2 of the paper. Compared to Version 1, this release includes: Reference-quality and numerically stable implementation of Maximum Hidden Irreversibility (MHI)- Mixture-of-Experts (MoE) extension with routing entropy- Analysis of rotational (antisymmetric) dynamics in neural representations- Improved toy model simulations for demonstration and testing- Updated experiments, figures, and clarifications throughout the paper Note: results presented are proof-of-concept simulations illustrating theoretical predictions. Empirical validation on real training runs is in preparation.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 97%
Neural Networks and Reservoir Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.