Measure the divergence, not the agreement: A manifesto for the Real User Cost Framework

Contemporary user experience measurement collapses attitudinal and behavioural evidence into composite scores. This paper argues that the collapse destroys the most diagnostically valuable signal available: the direction and magnitude of divergence between what users do and what users report. Drawing on eight decades of attitude-behaviour research, on evidence-grading practice from clinical medicine, and on distribution reporting from performance engineering, it proposes a framework in which divergence is the primary diagnostic axis, every measurement carries an evidence-quality weight, that weight decays on software release and not on the calendar, and results are reported as distributions instead of means. The framework is falsifiable, and section 9 states the conditions under which it should be rejected. Section 12, added in version 2.2, extends the same rules to design itself: identities, interfaces and reports.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-17
DOI
https://doi.org/10.5281/zenodo.23427983
Primary Topic
Usability and User Interface Design
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Measure the divergence, not the agreement: A manifesto for the Real User Cost Framework

Iordanis Passas
Zenodo (CERN European Organization for Nuclear Research)
Usability and User Interface Design
preprint

Measure the divergence, not the agreement: A manifesto for the Real User Cost Framework

Iordanis Passas
preprint en

Abstract

Contemporary user experience measurement collapses attitudinal and behavioural evidence into composite scores. This paper argues that the collapse destroys the most diagnostically valuable signal available: the direction and magnitude of divergence between what users do and what users report. Drawing on eight decades of attitude-behaviour research, on evidence-grading practice from clinical medicine, and on distribution reporting from performance engineering, it proposes a framework in which divergence is the primary diagnostic axis, every measurement carries an evidence-quality weight, that weight decays on software release and not on the calendar, and results are reported as distributions instead of means. The framework is falsifiable, and section 9 states the conditions under which it should be rejected. Section 12, added in version 2.2, extends the same rules to design itself: identities, interfaces and reports.

Zenodo (CERN European Organization for Nuclear Research)
Usability and User Interface Design
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.