Relation Order Reproducibly Shifts Entry into Multi-Hop Composition: Within-input relation order, prospectively defined acquisition entry, and independent-seed reproduction in a recurrent-depth reasoner

Preprint. This manuscript has not been peer reviewed.We ask a narrow developmental question: holding a latent relational task and learner fixed, does changing the order in which relations appear within each input change when compositional capability first crosses a fixed held-out competence criterion? We train a recurrent Transformer from scratch on a synthetic relational world under two renderings of the same 587,000 items. The renderings share grammar, sequence length, vocabulary and token multiset - the input token multiset is identical across arms - and differ only in the order of the relation tokens. Acquisition entry is defined prospectively as the first crossing of a strict held-out accuracy criterion. Under this isolation the application-order arm entered two-hop competence at epoch 273, while the canonical-order arm did not enter by its registered horizon of 1872 and is right-censored. We then repeated the comparison in a second, independently initialized realization against outcome branches frozen before that training existed. Both entries were observed: A=287 and C=1349, satisfying the prospectively frozen inequality C >= 4A (4A=1148); only after adjudication, R=4.70 with an absolute separation of 1062 epochs. We make no claim about subsequent depth acquisition: the two available application-order realizations diverge sharply after entry, and we report that as a scope boundary rather than a second result. Epoch-denominated coordinates are not translated into compute, sample efficiency or cost.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-08-26
DOI
https://doi.org/10.5281/zenodo.22103836
Primary Topic
Child and Animal Learning Development
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Relation Order Reproducibly Shifts Entry into Multi-Hop Composition: Within-input relation order, prospectively defined acquisition entry, and independent-seed reproduction in a recurrent-depth reasoner

Simon Lam-Muir
Zenodo (CERN European Organization for Nuclear Research)
Child and Animal Learning Development
preprint

Relation Order Reproducibly Shifts Entry into Multi-Hop Composition: Within-input relation order, prospectively defined acquisition entry, and independent-seed reproduction in a recurrent-depth reasoner

Simon Lam-Muir
preprint en

Abstract

Preprint. This manuscript has not been peer reviewed.We ask a narrow developmental question: holding a latent relational task and learner fixed, does changing the order in which relations appear within each input change when compositional capability first crosses a fixed held-out competence criterion? We train a recurrent Transformer from scratch on a synthetic relational world under two renderings of the same 587,000 items. The renderings share grammar, sequence length, vocabulary and token multiset - the input token multiset is identical across arms - and differ only in the order of the relation tokens. Acquisition entry is defined prospectively as the first crossing of a strict held-out accuracy criterion. Under this isolation the application-order arm entered two-hop competence at epoch 273, while the canonical-order arm did not enter by its registered horizon of 1872 and is right-censored. We then repeated the comparison in a second, independently initialized realization against outcome branches frozen before that training existed. Both entries were observed: A=287 and C=1349, satisfying the prospectively frozen inequality C >= 4A (4A=1148); only after adjudication, R=4.70 with an absolute separation of 1062 epochs. We make no claim about subsequent depth acquisition: the two available application-order realizations diverge sharply after entry, and we report that as a scope boundary rather than a second result. Epoch-denominated coordinates are not translated into compute, sample efficiency or cost.

Zenodo (CERN European Organization for Nuclear Research)
Prime University (BD)
Quality Education
Child and Animal Learning Development
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.