The Demand Layer: User-side state as the unmeasured variable in LLM verbose-output and the inference energy crisis

This paper names a second source of LLM verbose output that the literature has not yet measured. We call it the demand layer: the implicit relational load a user brings into an exchange with a language model. The model verbose-compensates around this load the same way Zhang et al. (2024) and Hakim (2026) show it compensates around informational uncertainty. The demand layer is upstream of the model. It is not fully addressable by prompt engineering, decoding constraints, or model-side intervention alone. It is addressable at the level of how the user arrives. Inference now dominates AI energy cost at fleet scale, with decoding the largest single contributor and verbose output the most addressable inefficiency within decoding. We argue that fleet-level inference efficiency, output quality, and the AI energy footprint are bounded by this upstream variable as much as by any model-internal property the field is currently optimizing. The paper provides a replication protocol, a falsifiability condition, an observable taxonomy of demand-layer load, and references a partner-evaluable session-governance protocol (AXIS) that implements the framework operationally.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-07-17
DOI
https://doi.org/10.5281/zenodo.21403791
Primary Topic
Ethics and Social Impacts of AI
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

The Demand Layer: User-side state as the unmeasured variable in LLM verbose-output and the inference energy crisis

Joe Trabocco
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
preprint

The Demand Layer: User-side state as the unmeasured variable in LLM verbose-output and the inference energy crisis

Joe Trabocco
preprint en

Abstract

This paper names a second source of LLM verbose output that the literature has not yet measured. We call it the demand layer: the implicit relational load a user brings into an exchange with a language model. The model verbose-compensates around this load the same way Zhang et al. (2024) and Hakim (2026) show it compensates around informational uncertainty. The demand layer is upstream of the model. It is not fully addressable by prompt engineering, decoding constraints, or model-side intervention alone. It is addressable at the level of how the user arrives. Inference now dominates AI energy cost at fleet scale, with decoding the largest single contributor and verbose output the most addressable inefficiency within decoding. We argue that fleet-level inference efficiency, output quality, and the AI energy footprint are bounded by this upstream variable as much as by any model-internal property the field is currently optimizing. The paper provides a replication protocol, a falsifiability condition, an observable taxonomy of demand-layer load, and references a partner-evaluable session-governance protocol (AXIS) that implements the framework operationally.

Zenodo (CERN European Organization for Nuclear Research)
Affordable and clean energy
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.