Usability Evaluation of EzList: A Digital Platform for Surgical Waitlist Management Using Standardized Metrics
OBJECTIVE: This study evaluated the usability of EzList, a Brazilian digital platform developed to optimize elective surgical waitlist management. METHODS: A summative usability assessment was conducted with ten surgeons and surgical residents, both with and without prior EzList experience, following IEC 62366:2015 and ISO 14971 standards. Participants completed seven representative clinical tasks. Usability was measured using the System Usability Scale (SUS) and the Single Usability Metric (SUM), integrating scores for task completion, errors, task time, and satisfaction. Additional metrics included completion rate, error rate, time-based efficiency, assistance rate, learning rate, and workflow adherence. RESULTS: The SUM score was 70.8%, reflecting high task completion (95.7%) and satisfaction, but lower efficiency. The mean SUS score was 84.6 (SD = 7.9), indicating good to excellent perceived usability. The error rate averaged 27.9%, mainly related to comprehension and redundant steps, with task 2 and 6 requiring more time and assistance. Time-based efficiency was 1.47%, slightly below the 1.78% benchmark. Learning curves varied, with a mean improvement of 16.3%. Post-task satisfaction was high; external assistance was needed in 14.3% of tasks. The digital platform provided a highly usable interface, supporting efficient task completion and positive user perception. However, moderate error rates and some inefficiencies highlight areas for interface refinement, particularly regarding workflow clarity. Variability in learning suggests the need for more intuitive design to facilitate broader clinical adoption.
Authors
- Giovanni Scala Marchini (ORCID: https://orcid.org/0000-0003-4334-9803)
- Elisa Antolli
- Fabio Carvalho Vicentini (ORCID: https://orcid.org/0000-0003-3745-341X)
- Guilherme Gentile
- Guilherme Pimenta Roncete
- Eduardo Mazzucchi (ORCID: https://orcid.org/0000-0003-3870-5922)
- Carlos Alfredo Batagello
- Marcelo Morandini
- Rodrigo Perrella
- William Carlos Nahas
- Fabio C. M. Torricelli
- Alexandre Danilovic
- Ana Teresa C. Vicentini
Institutions
- Universidade de São Paulo (BR)
- Hospital Israelita Albert Einstein (BR)
- Centro Universitário Belas Artes de São Paulo (BR)
- Ministério da Saúde (BR)
- Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo (BR)
- Fundação Faculdade de Medicina (BR)
Publication Details
- Journal
- Applied Clinical Informatics
- Published
- 2026-05-22
- DOI
- https://doi.org/10.1055/a-2880-6345
- Primary Topic
- Electronic Health Records Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Fundação de Amparo à Pesquisa do Estado de São Paulo