Cost per Accepted Answer: A Method for Measuring the True Cost of LLM Inference
Token price is the unit most teams use to reason about LLM cost, but it is not the unit they actually pay for. Teams pay for accepted answers, and every failed or retried attempt adds cost that token pricing hides. This preprint defines cost per accepted answer: a measurement method built on logical tasks, individually recorded attempts, acceptance recorded after review, and pricing snapshots that pin the exact rates used for every figure. It describes the design of an open source implementation, the AI Inference Control Plane, and a worked example with illustrative numbers. The method makes a cheaper model that needs more attempts directly comparable with an expensive model that answers cleanly, on the only number that matters: what one kept answer cost.
Authors
- Ahmed Jaffar (ORCID: https://orcid.org/0009-0003-7510-6221)
Institutions
- Western University (CA)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-11-07
- DOI
- https://doi.org/10.5281/zenodo.24047927
- Primary Topic
- Artificial Intelligence Applications
- Type
- preprint