The misuse of Likert data and the illusion of quantification in social and environmental research

Quantitative indicators are used in environmental systems research to assess governance, sustainability, and system performance. However, one common practice remains insufficiently examined: treating Likert-type data as fully quantitative. This paper argues that such treatment produces a form of pseudoquantification . Likert items provide ordinal information. They indicate order but not equal intervals between response categories or a true zero. This makes arithmetic operations such as multiplication, division, and ratio-based interpretation conceptually problematic. Aggregating multiple items into composite scales does not automatically resolve these limitations. Nor does psychometric reliability establish metric legitimacy. Drawing on measurement theory and systems epistemology, the paper shows how this process, termed metric inflation , creates an illusion of precision, amplifies subjective judgments, and obscures uncertainty in indicator-based research. These effects are especially important in environmental governance, where indicators shape policy priorities and institutional evaluation. The paper calls for greater reflexivity in measurement practice and closer alignment between data properties and analytical claims.

Authors

Institutions

Publication Details

Journal
Discover Sustainability
Published
2026-07-18
DOI
https://doi.org/10.1007/s43621-026-04098-5
Primary Topic
Sustainability and Climate Change Governance
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The misuse of Likert data and the illusion of quantification in social and environmental research

Sibongiseni B. Hlabisa
Discover Sustainability
Sustainability and Climate Change Governance
article

The misuse of Likert data and the illusion of quantification in social and environmental research

Sibongiseni B. Hlabisa
article en

Abstract

Quantitative indicators are used in environmental systems research to assess governance, sustainability, and system performance. However, one common practice remains insufficiently examined: treating Likert-type data as fully quantitative. This paper argues that such treatment produces a form of pseudoquantification . Likert items provide ordinal information. They indicate order but not equal intervals between response categories or a true zero. This makes arithmetic operations such as multiplication, division, and ratio-based interpretation conceptually problematic. Aggregating multiple items into composite scales does not automatically resolve these limitations. Nor does psychometric reliability establish metric legitimacy. Drawing on measurement theory and systems epistemology, the paper shows how this process, termed metric inflation , creates an illusion of precision, amplifies subjective judgments, and obscures uncertainty in indicator-based research. These effects are especially important in environmental governance, where indicators shape policy priorities and institutional evaluation. The paper calls for greater reflexivity in measurement practice and closer alignment between data properties and analytical claims.

Discover Sustainability
University of South Africa (ZA)
Life in Land
Openalex Percentile: Top 10%
Sustainability and Climate Change Governance
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.