Is there “Secret Sauce” in large language model development?

Abstract Do leading LLM developers possess a proprietary “secret sauce,” or is LLM performance driven by scaling up compute? Using training and benchmark data for 809 models released between 2022 and 2025, we estimate scaling-law regressions with release date and developer fixed effects. We find clear evidence of developer-specific efficiency advantages, but their importance depends on where models lie in the performance distribution. At the frontier, 80–90% of performance differences are explained by higher training compute, implying that scale—not proprietary technology—drives frontier advances. Away from the frontier, however, proprietary techniques and shared algorithmic progress substantially reduce the compute required to reach fixed capability thresholds. Some companies can systematically produce smaller models more efficiently. Strikingly, we also find substantial variation of model residual efficiency within companies; a firm can train two models with more than 40x compute efficiency difference. We also discuss the implications for AI leadership and capability diffusion.

Authors

Institutions

Publication Details

Journal
npj Artificial Intelligence
Published
2026-10-14
DOI
https://doi.org/10.1038/s44387-026-00159-2
Citations
1
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
3.55
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Is there “Secret Sauce” in large language model development?

Natalia Fischl-Lanzoni, Matthias Mertens, Neil Thompson
1 citations
npj Artificial Intelligence
Topic Modeling
3.55
article

Is there “Secret Sauce” in large language model development?

Natalia Fischl-Lanzoni, Matthias Mertens, Neil Thompson
article en
1 citations

Abstract

Abstract Do leading LLM developers possess a proprietary “secret sauce,” or is LLM performance driven by scaling up compute? Using training and benchmark data for 809 models released between 2022 and 2025, we estimate scaling-law regressions with release date and developer fixed effects. We find clear evidence of developer-specific efficiency advantages, but their importance depends on where models lie in the performance distribution. At the frontier, 80–90% of performance differences are explained by higher training compute, implying that scale—not proprietary technology—drives frontier advances. Away from the frontier, however, proprietary techniques and shared algorithmic progress substantially reduce the compute required to reach fixed capability thresholds. Some companies can systematically produce smaller models more efficiently. Strikingly, we also find substantial variation of model residual efficiency within companies; a firm can train two models with more than 40x compute efficiency difference. We also discuss the implications for AI leadership and capability diffusion.

npj Artificial Intelligence
Massachusetts Institute of Technology (US)
Openalex Percentile: Top 10%
Topic Modeling
3.55
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.