RECURSIVE SYNTHETIC TRAINING CONDITIONS AND LANGUAGE MODEL PERFORMANCE DEGRADATION ACROSS PUBLISHED TEXT GENERATION BENCHMARK EXPERIMENTS

This analysis examines whether assessments of language model resilience depend on decoding configuration and measurement scale, addressing international debates on recursive synthetic training. A descriptive reanalysis uses 24 published WikiText 2 perplexity endpoints from 2025, forming 12 matched configurations across GPT 2, SmolLM2, and six decoding strategies at generations zero and nine. Paired absolute changes, percentage changes, ratios, means, and medians reveal deterioration in every configuration, with percentage increases ranging from 10.24% to 513.83%. SmolLM2 records a smaller mean absolute increase than GPT 2, but a larger mean percentage increase, while its median deterioration remains lower on both scales. Different baseline denominators and concentrated deterioration under greedy decoding and beam search explain this aggregation reversal. Sampling strategy rankings also differ between models, and temperature sampling reverses their comparison across measurement scales. These findings qualify interpretations of resilience as an intrinsic model property by demonstrating configuration and measurement dependence. International benchmarking should report matched baselines, absolute and proportional changes, and distributional summaries to support transparent configuration selection.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-07
DOI
https://doi.org/10.5281/zenodo.24039709
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

RECURSIVE SYNTHETIC TRAINING CONDITIONS AND LANGUAGE MODEL PERFORMANCE DEGRADATION ACROSS PUBLISHED TEXT GENERATION BENCHMARK EXPERIMENTS

Divya Vishwanath & Paul Johnson Asamoah
1 links
Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
article

RECURSIVE SYNTHETIC TRAINING CONDITIONS AND LANGUAGE MODEL PERFORMANCE DEGRADATION ACROSS PUBLISHED TEXT GENERATION BENCHMARK EXPERIMENTS

Divya Vishwanath & Paul Johnson Asamoah
article en

Abstract

This analysis examines whether assessments of language model resilience depend on decoding configuration and measurement scale, addressing international debates on recursive synthetic training. A descriptive reanalysis uses 24 published WikiText 2 perplexity endpoints from 2025, forming 12 matched configurations across GPT 2, SmolLM2, and six decoding strategies at generations zero and nine. Paired absolute changes, percentage changes, ratios, means, and medians reveal deterioration in every configuration, with percentage increases ranging from 10.24% to 513.83%. SmolLM2 records a smaller mean absolute increase than GPT 2, but a larger mean percentage increase, while its median deterioration remains lower on both scales. Different baseline denominators and concentrated deterioration under greedy decoding and beam search explain this aggregation reversal. Sampling strategy rankings also differ between models, and temperature sampling reverses their comparison across measurement scales. These findings qualify interpretations of resilience as an intrinsic model property by demonstrating configuration and measurement dependence. International benchmarking should report matched baselines, absolute and proportional changes, and distributional summaries to support transparent configuration selection.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 19%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
RECURSIVE SYNTHETIC TRAINING CONDITIONS AND LANGUAGE MODEL PERFORMANCE DEGRADATION ACROSS PUBLISHED TEXT GENERATION BENCHMARK EXPERIMENTS — Divya Vishwanath & Paul Johnson Asamoah · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS