Cost per Accepted Answer: A Method for Measuring the True Cost of LLM Inference

Token price is the unit most teams use to reason about LLM cost, but it is not the unit they actually pay for. Teams pay for accepted answers, and every failed or retried attempt adds cost that token pricing hides. This preprint defines cost per accepted answer: a measurement method built on logical tasks, individually recorded attempts, acceptance recorded after review, and pricing snapshots that pin the exact rates used for every figure. It describes the design of an open source implementation, the AI Inference Control Plane, and a worked example with illustrative numbers. The method makes a cheaper model that needs more attempts directly comparable with an expensive model that answers cleanly, on the only number that matters: what one kept answer cost.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-07
DOI
https://doi.org/10.5281/zenodo.24047927
Primary Topic
Artificial Intelligence Applications
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Cost per Accepted Answer: A Method for Measuring the True Cost of LLM Inference

Ahmed Jaffar
Zenodo (CERN European Organization for Nuclear Research)
Artificial Intelligence Applications
preprint

Cost per Accepted Answer: A Method for Measuring the True Cost of LLM Inference

Ahmed Jaffar
preprint en

Abstract

Token price is the unit most teams use to reason about LLM cost, but it is not the unit they actually pay for. Teams pay for accepted answers, and every failed or retried attempt adds cost that token pricing hides. This preprint defines cost per accepted answer: a measurement method built on logical tasks, individually recorded attempts, acceptance recorded after review, and pricing snapshots that pin the exact rates used for every figure. It describes the design of an open source implementation, the AI Inference Control Plane, and a worked example with illustrative numbers. The method makes a cheaper model that needs more attempts directly comparable with an expensive model that answers cleanly, on the only number that matters: what one kept answer cost.

Zenodo (CERN European Organization for Nuclear Research)
Western University (CA)
Artificial Intelligence Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon