Current Practices for Assessing the Usability of Novel Diagnostics in Infectious Diseases: A Multi-stakeholder Qualitative Study (Preprint)

BACKGROUND Decentralized diagnostic tests are expanding access to infectious disease testing in low-resource settings. Usability evaluations help ensure these tools are used safely, accurately, and efficiently, but approaches vary widely. Our previous scoping review found substantial variation in evaluation designs, endpoint selection, and result reporting, yet little is known about the factors driving this variation or how it influences the quality, comparability, and regulatory utility of usability evidence. OBJECTIVE This study aimed to explore how developers, regulators, and researchers conceptualize and conduct usability and human factors evaluations of decentralized diagnostic tests for infectious diseases intended for low-resource settings, and to identify gaps in existing usability guidance and standards. METHODS We conducted semi-structured interviews with 23 stakeholders across three groups: 14 developers, 5 regulators, and 4 researchers, purposively sampled across regions and experience levels. Topic guides were tailored to each stakeholder group and informed by established usability and human factors frameworks. Interviews were conducted in English, audio-recorded, and transcribed verbatim; recruitment continued until thematic saturation was reached. Data were analyzed thematically using an inductive and deductive approach. RESULTS Participants were based in 11 countries across high- and low-resource settings; nearly half (11/23, 48%) were based in the United States or China. Across stakeholder groups, usability was framed primarily around safety and error prevention, closely tied to regulatory expectations. User-centered attributes such as learnability, efficiency, satisfaction, and memorability were acknowledged but rarely defined or systematically assessed. Differences in study design, sample size, and endpoint selection were attributed to a lack of shared definitions, inconsistent regulatory guidance, and limited practical instructions for conducting usability evaluations, particularly in low-resource settings. Environmental conditions, infrastructure, and user diversity further shaped evaluations and often required adaptations to standard approaches. Overall, participants highlighted a need to balance consistency in usability evaluation with flexibility to accommodate different contexts and regulatory requirements. CONCLUSIONS The heterogeneity observed in usability evaluations reflects differences in how usability is defined, operationalized, and assessed across regulatory and contextual settings. Our findings support the development of consensus-based guidance that defines core usability constructs and reporting standards, while allowing flexibility in study design, sample size, and endpoint selection according to the purpose of the evaluation and context. Such guidance could strengthen the rigor, comparability, and practical relevance of usability evidence for regulatory decision-making and implementation, particularly in low-resource settings.

Authors

Publication Details

Published
2026-11-18
DOI
https://doi.org/10.2196/preprints.117175
Primary Topic
Usability and User Interface Design
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Current Practices for Assessing the Usability of Novel Diagnostics in Infectious Diseases: A Multi-stakeholder Qualitative Study (Preprint)

María del Mar Castro, Claudia Maria Denkinger, Lydia Holtgrewe, Elisabeth Mamani-Mategula et al.
Usability and User Interface Design
preprint

Current Practices for Assessing the Usability of Novel Diagnostics in Infectious Diseases: A Multi-stakeholder Qualitative Study (Preprint)

María del Mar Castro, Claudia Maria Denkinger, Lydia Holtgrewe, Elisabeth Mamani-Mategula, Seda Yerlikaya
preprint en

Abstract

BACKGROUND Decentralized diagnostic tests are expanding access to infectious disease testing in low-resource settings. Usability evaluations help ensure these tools are used safely, accurately, and efficiently, but approaches vary widely. Our previous scoping review found substantial variation in evaluation designs, endpoint selection, and result reporting, yet little is known about the factors driving this variation or how it influences the quality, comparability, and regulatory utility of usability evidence. OBJECTIVE This study aimed to explore how developers, regulators, and researchers conceptualize and conduct usability and human factors evaluations of decentralized diagnostic tests for infectious diseases intended for low-resource settings, and to identify gaps in existing usability guidance and standards. METHODS We conducted semi-structured interviews with 23 stakeholders across three groups: 14 developers, 5 regulators, and 4 researchers, purposively sampled across regions and experience levels. Topic guides were tailored to each stakeholder group and informed by established usability and human factors frameworks. Interviews were conducted in English, audio-recorded, and transcribed verbatim; recruitment continued until thematic saturation was reached. Data were analyzed thematically using an inductive and deductive approach. RESULTS Participants were based in 11 countries across high- and low-resource settings; nearly half (11/23, 48%) were based in the United States or China. Across stakeholder groups, usability was framed primarily around safety and error prevention, closely tied to regulatory expectations. User-centered attributes such as learnability, efficiency, satisfaction, and memorability were acknowledged but rarely defined or systematically assessed. Differences in study design, sample size, and endpoint selection were attributed to a lack of shared definitions, inconsistent regulatory guidance, and limited practical instructions for conducting usability evaluations, particularly in low-resource settings. Environmental conditions, infrastructure, and user diversity further shaped evaluations and often required adaptations to standard approaches. Overall, participants highlighted a need to balance consistency in usability evaluation with flexibility to accommodate different contexts and regulatory requirements. CONCLUSIONS The heterogeneity observed in usability evaluations reflects differences in how usability is defined, operationalized, and assessed across regulatory and contextual settings. Our findings support the development of consensus-based guidance that defines core usability constructs and reporting standards, while allowing flexibility in study design, sample size, and endpoint selection according to the purpose of the evaluation and context. Such guidance could strengthen the rigor, comparability, and practical relevance of usability evidence for regulatory decision-making and implementation, particularly in low-resource settings.

Good health and well-being
Usability and User Interface Design
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon