Layer-Group Coefficient Search for Qwen2.5-0.5B Merging: A Null Test of Layer-Group Search

Interpolating Qwen2.5-0.5B and Qwen2.5-0.5B-Instruct with one global coefficient t leaves open whether per-layer coefficients help. We pre-registered that a coordinate search over four layer groups would beat the global t^* on validation, with a smaller advantage on test (the winner's curse). The search used 21 validation evaluations (1,199 items from four benchmarks) and 3,967 disjoint test items. The validation gain over t^*=0.7 is +0.83 pp, within noise (paired 95% CI [-0.58,+2.17]). On test the gain is +0.39 pp [-0.38, +1.15], p=0.311, not distinguishable from zero (no equivalence test); this is the primary comparison, as worded in hypothesis 5. Against the best original model (base, 0.5025) the layer-wise merge scores 0.5129, a gain of +1.04 pp [+0.20, +1.93] with nominal p=0.017. The pre-registered general rule (paired CI above zero) is met nominally, and fails only the Bonferroni threshold of 0.0083, added later, so we do not claim an improvement. The data are consistent with both a winner's curse and no shrinkage. Scope: one model pair, four benchmarks, one search run.Preprint. The attached archive contains the LaTeX source, the per-item evaluation caches, all analysis scripts and the model revisions needed to regenerate every number, table and figure (git tag preprints-v1; entry point run_everything.sh). Author: Dheiver Francisco Santos, ORCID 0000-0002-8599-9436. License: CC BY 4.0.

Authors

Publication Details

Journal
Figshare
Published
2026-11-15
DOI
https://doi.org/10.6084/m9.figshare.35013997
Primary Topic
Topic Modeling
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Layer-Group Coefficient Search for Qwen2.5-0.5B Merging: A Null Test of Layer-Group Search

Dheiver Francisco Santos
Figshare
Topic Modeling
preprint

Layer-Group Coefficient Search for Qwen2.5-0.5B Merging: A Null Test of Layer-Group Search

Dheiver Francisco Santos
preprint en

Abstract

Interpolating Qwen2.5-0.5B and Qwen2.5-0.5B-Instruct with one global coefficient t leaves open whether per-layer coefficients help. We pre-registered that a coordinate search over four layer groups would beat the global t^* on validation, with a smaller advantage on test (the winner's curse). The search used 21 validation evaluations (1,199 items from four benchmarks) and 3,967 disjoint test items. The validation gain over t^*=0.7 is +0.83 pp, within noise (paired 95% CI [-0.58,+2.17]). On test the gain is +0.39 pp [-0.38, +1.15], p=0.311, not distinguishable from zero (no equivalence test); this is the primary comparison, as worded in hypothesis 5. Against the best original model (base, 0.5025) the layer-wise merge scores 0.5129, a gain of +1.04 pp [+0.20, +1.93] with nominal p=0.017. The pre-registered general rule (paired CI above zero) is met nominally, and fails only the Bonferroni threshold of 0.0083, added later, so we do not claim an improvement. The data are consistent with both a winner's curse and no shrinkage. Scope: one model pair, four benchmarks, one search run.Preprint. The attached archive contains the LaTeX source, the per-item evaluation caches, all analysis scripts and the model revisions needed to regenerate every number, table and figure (git tag preprints-v1; entry point run_everything.sh). Author: Dheiver Francisco Santos, ORCID 0000-0002-8599-9436. License: CC BY 4.0.

Figshare
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Layer-Group Coefficient Search for Qwen2.5-0.5B Merging: A Null Test of Layer-Group Search — Dheiver Francisco Santos · Figshare (2026) | TGRS Research Map | TGRS