What Does "Latency" Mean? A Claim-to-Evidence Audit of Language-Model Performance

Performance numbers can reproduce without establishing the comparison attached to them. We audit published language-model inference assertions through six source-specific reconstructions and a fixed probability sample. The workstation case reproduces 576 saved statistics and 320 displayed entries, yet nine of twelve comparator elapsed-time variability values contradict a stated threshold even after display rounding. Other cases quantify a disclosed timing-window sensitivity, support a memory estimator despite a component increase, reconcile a latency headline with saved outputs, restrict a placement observation to its tested models, and identify inconsistent model attribution. The separate 150-family cohort contains 59 eligible, 67 excluded and 24 unresolved families after documented corrections; 54 assessed assertions comprise 23 supported within scope, one source conflict and 30 unresolved. These are single-author source assessments, not independently validated error rates. We supply calculation inputs, source locators and a correction record. The contribution is a reproducible account of what particular evidence supports, not physical replication, a field-wide error estimate or a new benchmark. Preprint submitted for peer review.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-09
DOI
https://doi.org/10.5281/zenodo.24074169
Primary Topic
Topic Modeling
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

What Does "Latency" Mean? A Claim-to-Evidence Audit of Language-Model Performance

Pranesh S
Zenodo (CERN European Organization for Nuclear Research)
Topic Modeling
preprint

What Does "Latency" Mean? A Claim-to-Evidence Audit of Language-Model Performance

Pranesh S
preprint en

Abstract

Performance numbers can reproduce without establishing the comparison attached to them. We audit published language-model inference assertions through six source-specific reconstructions and a fixed probability sample. The workstation case reproduces 576 saved statistics and 320 displayed entries, yet nine of twelve comparator elapsed-time variability values contradict a stated threshold even after display rounding. Other cases quantify a disclosed timing-window sensitivity, support a memory estimator despite a component increase, reconcile a latency headline with saved outputs, restrict a placement observation to its tested models, and identify inconsistent model attribution. The separate 150-family cohort contains 59 eligible, 67 excluded and 24 unresolved families after documented corrections; 54 assessed assertions comprise 23 supported within scope, one source conflict and 30 unresolved. These are single-author source assessments, not independently validated error rates. We supply calculation inputs, source locators and a correction record. The contribution is a reproducible account of what particular evidence supports, not physical replication, a field-wide error estimate or a new benchmark. Preprint submitted for peer review.

Zenodo (CERN European Organization for Nuclear Research)
SRM Institute of Science and Technology (IN)
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
What Does "Latency" Mean? A Claim-to-Evidence Audit of Language-Model Performance — Pranesh S · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS