Inattentive respondent detection methods for multiple-choice format items

Web-based surveys are widely used in the social sciences, including psychology. However, such surveys often include inattentive respondents-individuals who answer without carefully reading the questions-which can distort analytical results. Although various detection methods have been proposed, many rely on Likert-scale items. Because some surveys do not include Likert scales-and because such items may introduce directive or unnatural content-there is a need to develop alternative detection methods that do not depend on Likert formats. This study examined inattentive-respondent detection across multiple-choice, free-response, and ranking formats while preserving natural survey content. Study I demonstrated that the proposed detection methods were ineffective for free-response and ranking formats; therefore, subsequent analyses focused exclusively on multiple-choice items. Within multiple-choice items, however, a "choose X from N" format showed promising detection performance but identified an excessively large proportion of respondents as inattentive. In Study II, the items were refined into behavior/fact-based questions, resulting in a method that maintained strong detection performance without over-identification. Thus, the primary contribution of this study is the development and validation of a detection method suitable for multiple-choice surveys that do not rely on Likert scales. The results further indicate that applying the proposed method improves the validity of psychological measures, such as the Big Five scale. Future research should examine its applicability in broader psychological survey contexts.

Institutions

Publication Details

Journal
Acta Psychologica
Published
2026-03-24
DOI
https://doi.org/10.1016/j.actpsy.2026.106689
Primary Topic
Survey Methodology and Nonresponse
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Inattentive respondent detection methods for multiple-choice format items

Acta Psychologica
Survey Methodology and Nonresponse
article

Inattentive respondent detection methods for multiple-choice format items

article en

Abstract

Web-based surveys are widely used in the social sciences, including psychology. However, such surveys often include inattentive respondents-individuals who answer without carefully reading the questions-which can distort analytical results. Although various detection methods have been proposed, many rely on Likert-scale items. Because some surveys do not include Likert scales-and because such items may introduce directive or unnatural content-there is a need to develop alternative detection methods that do not depend on Likert formats. This study examined inattentive-respondent detection across multiple-choice, free-response, and ranking formats while preserving natural survey content. Study I demonstrated that the proposed detection methods were ineffective for free-response and ranking formats; therefore, subsequent analyses focused exclusively on multiple-choice items. Within multiple-choice items, however, a "choose X from N" format showed promising detection performance but identified an excessively large proportion of respondents as inattentive. In Study II, the items were refined into behavior/fact-based questions, resulting in a method that maintained strong detection performance without over-identification. Thus, the primary contribution of this study is the development and validation of a detection method suitable for multiple-choice surveys that do not rely on Likert scales. The results further indicate that applying the proposed method improves the validity of psychological measures, such as the Big Five scale. Future research should examine its applicability in broader psychological survey contexts.

Acta PsychologicaVol. 265
University of Tsukuba (JP), Keio University (JP), Ochanomizu University (JP), The Institute of Statistical Mathematics (JP), National Institute of Population and Social Security Research (JP)
Openalex Percentile: Top 14%
Survey Methodology and Nonresponse
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Inattentive respondent detection methods for multiple-choice format items · Acta Psychologica (2026) | TGRS Research Map | TGRS