Current Practices for Assessing the Usability of Novel Diagnostics in Infectious Diseases: A Multi-stakeholder Qualitative Study (Preprint)
BACKGROUND Decentralized diagnostic tests are expanding access to infectious disease testing in low-resource settings. Usability evaluations help ensure these tools are used safely, accurately, and efficiently, but approaches vary widely. Our previous scoping review found substantial variation in evaluation designs, endpoint selection, and result reporting, yet little is known about the factors driving this variation or how it influences the quality, comparability, and regulatory utility of usability evidence. OBJECTIVE This study aimed to explore how developers, regulators, and researchers conceptualize and conduct usability and human factors evaluations of decentralized diagnostic tests for infectious diseases intended for low-resource settings, and to identify gaps in existing usability guidance and standards. METHODS We conducted semi-structured interviews with 23 stakeholders across three groups: 14 developers, 5 regulators, and 4 researchers, purposively sampled across regions and experience levels. Topic guides were tailored to each stakeholder group and informed by established usability and human factors frameworks. Interviews were conducted in English, audio-recorded, and transcribed verbatim; recruitment continued until thematic saturation was reached. Data were analyzed thematically using an inductive and deductive approach. RESULTS Participants were based in 11 countries across high- and low-resource settings; nearly half (11/23, 48%) were based in the United States or China. Across stakeholder groups, usability was framed primarily around safety and error prevention, closely tied to regulatory expectations. User-centered attributes such as learnability, efficiency, satisfaction, and memorability were acknowledged but rarely defined or systematically assessed. Differences in study design, sample size, and endpoint selection were attributed to a lack of shared definitions, inconsistent regulatory guidance, and limited practical instructions for conducting usability evaluations, particularly in low-resource settings. Environmental conditions, infrastructure, and user diversity further shaped evaluations and often required adaptations to standard approaches. Overall, participants highlighted a need to balance consistency in usability evaluation with flexibility to accommodate different contexts and regulatory requirements. CONCLUSIONS The heterogeneity observed in usability evaluations reflects differences in how usability is defined, operationalized, and assessed across regulatory and contextual settings. Our findings support the development of consensus-based guidance that defines core usability constructs and reporting standards, while allowing flexibility in study design, sample size, and endpoint selection according to the purpose of the evaluation and context. Such guidance could strengthen the rigor, comparability, and practical relevance of usability evidence for regulatory decision-making and implementation, particularly in low-resource settings.
Authors
- María del Mar Castro (ORCID: https://orcid.org/0000-0002-0485-2919)
- Claudia Maria Denkinger (ORCID: https://orcid.org/0000-0002-7216-7067)
- Lydia Holtgrewe (ORCID: https://orcid.org/0000-0003-3692-0469)
- Elisabeth Mamani-Mategula (ORCID: https://orcid.org/0009-0004-9238-5549)
- Seda Yerlikaya (ORCID: https://orcid.org/0000-0002-6064-548X)
Publication Details
- Published
- 2026-11-18
- DOI
- https://doi.org/10.2196/preprints.117175
- Primary Topic
- Usability and User Interface Design
- Type
- preprint