Investigating Effects of Elemental Design Characteristics on NASA-TLX Ratings

The NASA Task Load Index (NASA‑TLX) is the most widely used subjective measure of mental workload, yet its implementation varies substantially across studies and within NASA’s official materials. Differences in anchor labels, tick patterns, and dimension descriptions may unintentionally influence rating behavior, threatening the tool’s validity and comparability. This study systematically evaluates how these design characteristics affect NASA‑TLX ratings and identifies which versions best align with objective task performance. Thirty‑two participants completed Multi‑Attribute Task Battery II (MATB‑II) scenarios of varying difficulty and provided workload ratings using eight scale designs representing the full factorial combination of official NASA‑TLX design discrepancies. Linear mixed‑effects models assessed the effects of design elements on each TLX dimension. Results show that subtle visual and textual design differences meaningfully alter rating distributions. These findings highlight the need for standardization in NASA‑TLX scale design and provide evidence‑based guidance for selecting formats that improve measurement validity across human factors.

Authors

Institutions

Publication Details

Journal
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Published
2026-11-18
DOI
https://doi.org/10.1177/10711813261505913
Primary Topic
Human-Automation Interaction and Safety
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Investigating Effects of Elemental Design Characteristics on NASA-TLX Ratings

Matthew L. Bolton, Skye Taylor
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Human-Automation Interaction and Safety
article

Investigating Effects of Elemental Design Characteristics on NASA-TLX Ratings

Matthew L. Bolton, Skye Taylor
article en

Abstract

The NASA Task Load Index (NASA‑TLX) is the most widely used subjective measure of mental workload, yet its implementation varies substantially across studies and within NASA’s official materials. Differences in anchor labels, tick patterns, and dimension descriptions may unintentionally influence rating behavior, threatening the tool’s validity and comparability. This study systematically evaluates how these design characteristics affect NASA‑TLX ratings and identifies which versions best align with objective task performance. Thirty‑two participants completed Multi‑Attribute Task Battery II (MATB‑II) scenarios of varying difficulty and provided workload ratings using eight scale designs representing the full factorial combination of official NASA‑TLX design discrepancies. Linear mixed‑effects models assessed the effects of design elements on each TLX dimension. Results show that subtle visual and textual design differences meaningfully alter rating distributions. These findings highlight the need for standardization in NASA‑TLX scale design and provide evidence‑based guidance for selecting formats that improve measurement validity across human factors.

Proceedings of the Human Factors and Ergonomics Society Annual Meeting
University of Virginia (US)
Human-Automation Interaction and Safety
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon