Attention normalization and LayerNorm placement in graph Transformers: protocol and code

Protocol (predictions P1-P7 with three amendments) and code of the study 'Attention normalization and LayerNorm placement limit which targets graph Transformers can extrapolate to larger graphs' (Yuqi Bai, Haoran Ma; manuscript under review). The protocol was written on 2026-09-30 in a local document and was not deposited with a third party at the time. This archive was created on 2026-11-13, after the study; it documents the content of the protocol, not when it was written.

Authors

Publication Details

Journal
Open Science Framework
Published
2026-11-13
DOI
https://doi.org/10.17605/osf.io/9wnzm
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Attention normalization and LayerNorm placement in graph Transformers: protocol and code

Haoran Ma, Yuqi Bai
1 links
Open Science Framework
Advanced Graph Neural Networks
article

Attention normalization and LayerNorm placement in graph Transformers: protocol and code

Haoran Ma, Yuqi Bai
article en

Abstract

Protocol (predictions P1-P7 with three amendments) and code of the study 'Attention normalization and LayerNorm placement limit which targets graph Transformers can extrapolate to larger graphs' (Yuqi Bai, Haoran Ma; manuscript under review). The protocol was written on 2026-09-30 in a local document and was not deposited with a third party at the time. This archive was created on 2026-11-13, after the study; it documents the content of the protocol, not when it was written.

Open Science Framework
Advanced Graph Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon