Modern Architecture On Advanced LLM: Best-of-N Sampling, Learned Verification and Tree Search as a Substitute for Parameter Scale

The prevailing approach to capability in large language models couples performance to parameter count. We present an alternative architecture in which a frozen 1.5B-parameter reasoning model is paired with a structured inference-time compute layer, and show that the combination recovers a substantial fraction of the capability normally attributed to scale. On AIME 2024, the frozen base improves from 23.3% single-sample accuracy to 83.3% coverage at N=128; a trained outcome verifier converts that coverage into 52.2% realised accuracy at N=32, a 16.6-point gain over majority voting. We formalise the generation-selection decomposition, identify the selection gap as the governing bottleneck of such systems, report transfer to graduate-level science and arithmetic reasoning, and derive Best-of-N MCTS, a tree-search generalisation in which the outcome verifier supplies process-level guidance through truncated rollout. All results are reproducible from a public repository.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-08-14
DOI
https://doi.org/10.5281/zenodo.21936833
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Modern Architecture On Advanced LLM: Best-of-N Sampling, Learned Verification and Tree Search as a Substitute for Parameter Scale

Alejandro Areces Rivera
Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
article

Modern Architecture On Advanced LLM: Best-of-N Sampling, Learned Verification and Tree Search as a Substitute for Parameter Scale

Alejandro Areces Rivera
article en

Abstract

The prevailing approach to capability in large language models couples performance to parameter count. We present an alternative architecture in which a frozen 1.5B-parameter reasoning model is paired with a structured inference-time compute layer, and show that the combination recovers a substantial fraction of the capability normally attributed to scale. On AIME 2024, the frozen base improves from 23.3% single-sample accuracy to 83.3% coverage at N=128; a trained outcome verifier converts that coverage into 52.2% realised accuracy at N=32, a 16.6-point gain over majority voting. We formalise the generation-selection decomposition, identify the selection gap as the governing bottleneck of such systems, report transfer to graduate-level science and arithmetic reasoning, and derive Best-of-N MCTS, a tree-search generalisation in which the outcome verifier supplies process-level guidance through truncated rollout. All results are reproducible from a public repository.

Zenodo (CERN European Organization for Nuclear Research)
Interface (United States) (US), InterScience (United States) (US)
Quality Education
Openalex Percentile: Top 7%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Modern Architecture On Advanced LLM: Best-of-N Sampling, Learned Verification and Tree Search as a Substitute for Parameter Scale — Alejandro Areces Rivera · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS