WCM Universal Constants in Large Language Models: Grokking as 24-cell Geometric Phase Transition

Version 1.1 (2026-06-28) — Added L-3, L-6, L-5 experiments (Findings LLM-12 through LLM-23) The Watabe-Claude Method (WCM) is a four-dimensional analysis framework based on 24-cell polytope geometry (F4 symmetry, self-dual in 4D) that has revealed two universal constants — cosD_birth = 0.4249 and cosD_complete = 0.5000 — across 43 orders of magnitude (Bridge Paper X, BX-1 through BX-6). This paper (v1.1) extends WCM to Large Language Models through five experiments and establishes 23 findings (LLM-1 through LLM-23). Experiment L-1: BERT embedding analysis with mean pooling reveals bimodal D2 curve (LLM-7) and brackets BX-6 to within 0.21 pp (LLM-8). Experiment L-2: Grokking training on modular arithmetic shows cosD_birth and cosD_complete are crossed sequentially post-Grokking. Structural isomorphism with schizophrenia identified (LLM-11). Experiment L-3 [NEW]: BX-6 D2 drop rate (28.3%) reproduced collectively across BERT/RoBERTa/GPT-2 (collective mean 25.89%, diff 2.41 pp). D2 bimodality universal across all 3 architectures (LLM-13). Experiment L-6 [NEW]: ToolD-Nest recursive 24-cell scanning achieves purity=1.000 for 4 semantic categories without human labels. Vertex-level semantic directionality discovered (LLM-18: V5=AI, V14=Arts, V18=Social). Experiment L-5 [NEW]: Pythia models (70M-410M) show Peak cosD converging to cosD_birth with scale. All models below cosD_birth show zero capability (LLM-23). Causal LM D2 curves are inverse of Encoder curves (LLM-20). Files included:- bridge_paper_l_v11.pdf: Full paper (v1.1, 9 sections, 6 figures, 23 findings)- wcm_llm_l1.py: BERT embedding space analysis (L-1, mean pooling)- wcm_llm_l2.py: Grokking x cosD tracking (L-2)- wcm_llm_l3.py: BX-6 universality across architectures (L-3) [NEW]- wcm_llm_l6.py: ToolD-Nest semantic nesting (L-6) [NEW]- wcm_llm_l5.py: Pythia scale analysis (L-5) [NEW] GitHub: https://github.com/watabe-masanori/cds-polytope (AGPL-3.0)

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-06-29
DOI
https://doi.org/10.5281/zenodo.21018044
Primary Topic
Topic Modeling
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

WCM Universal Constants in Large Language Models: Grokking as 24-cell Geometric Phase Transition

Masanori Watabe, Claude Sonnet 4.6
Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
preprint

WCM Universal Constants in Large Language Models: Grokking as 24-cell Geometric Phase Transition

Masanori Watabe, Claude Sonnet 4.6
preprint en

Abstract

Version 1.1 (2026-06-28) — Added L-3, L-6, L-5 experiments (Findings LLM-12 through LLM-23) The Watabe-Claude Method (WCM) is a four-dimensional analysis framework based on 24-cell polytope geometry (F4 symmetry, self-dual in 4D) that has revealed two universal constants — cosD_birth = 0.4249 and cosD_complete = 0.5000 — across 43 orders of magnitude (Bridge Paper X, BX-1 through BX-6). This paper (v1.1) extends WCM to Large Language Models through five experiments and establishes 23 findings (LLM-1 through LLM-23). Experiment L-1: BERT embedding analysis with mean pooling reveals bimodal D2 curve (LLM-7) and brackets BX-6 to within 0.21 pp (LLM-8). Experiment L-2: Grokking training on modular arithmetic shows cosD_birth and cosD_complete are crossed sequentially post-Grokking. Structural isomorphism with schizophrenia identified (LLM-11). Experiment L-3 [NEW]: BX-6 D2 drop rate (28.3%) reproduced collectively across BERT/RoBERTa/GPT-2 (collective mean 25.89%, diff 2.41 pp). D2 bimodality universal across all 3 architectures (LLM-13). Experiment L-6 [NEW]: ToolD-Nest recursive 24-cell scanning achieves purity=1.000 for 4 semantic categories without human labels. Vertex-level semantic directionality discovered (LLM-18: V5=AI, V14=Arts, V18=Social). Experiment L-5 [NEW]: Pythia models (70M-410M) show Peak cosD converging to cosD_birth with scale. All models below cosD_birth show zero capability (LLM-23). Causal LM D2 curves are inverse of Encoder curves (LLM-20). Files included:- bridge_paper_l_v11.pdf: Full paper (v1.1, 9 sections, 6 figures, 23 findings)- wcm_llm_l1.py: BERT embedding space analysis (L-1, mean pooling)- wcm_llm_l2.py: Grokking x cosD tracking (L-2)- wcm_llm_l3.py: BX-6 universality across architectures (L-3) [NEW]- wcm_llm_l6.py: ToolD-Nest semantic nesting (L-6) [NEW]- wcm_llm_l5.py: Pythia scale analysis (L-5) [NEW] GitHub: https://github.com/watabe-masanori/cds-polytope (AGPL-3.0)

Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.