Usability Evaluation of EzList: A Digital Platform for Surgical Waitlist Management Using Standardized Metrics

OBJECTIVE: This study evaluated the usability of EzList, a Brazilian digital platform developed to optimize elective surgical waitlist management. METHODS: A summative usability assessment was conducted with ten surgeons and surgical residents, both with and without prior EzList experience, following IEC 62366:2015 and ISO 14971 standards. Participants completed seven representative clinical tasks. Usability was measured using the System Usability Scale (SUS) and the Single Usability Metric (SUM), integrating scores for task completion, errors, task time, and satisfaction. Additional metrics included completion rate, error rate, time-based efficiency, assistance rate, learning rate, and workflow adherence. RESULTS: The SUM score was 70.8%, reflecting high task completion (95.7%) and satisfaction, but lower efficiency. The mean SUS score was 84.6 (SD = 7.9), indicating good to excellent perceived usability. The error rate averaged 27.9%, mainly related to comprehension and redundant steps, with task 2 and 6 requiring more time and assistance. Time-based efficiency was 1.47%, slightly below the 1.78% benchmark. Learning curves varied, with a mean improvement of 16.3%. Post-task satisfaction was high; external assistance was needed in 14.3% of tasks. The digital platform provided a highly usable interface, supporting efficient task completion and positive user perception. However, moderate error rates and some inefficiencies highlight areas for interface refinement, particularly regarding workflow clarity. Variability in learning suggests the need for more intuitive design to facilitate broader clinical adoption.

Authors

Institutions

Publication Details

Journal
Applied Clinical Informatics
Published
2026-05-22
DOI
https://doi.org/10.1055/a-2880-6345
Primary Topic
Electronic Health Records Systems
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Usability Evaluation of EzList: A Digital Platform for Surgical Waitlist Management Using Standardized Metrics

Giovanni Scala Marchini, Elisa Antolli, Fabio Carvalho Vicentini, Guilherme Gentile et al.
Applied Clinical Informatics
Electronic Health Records Systems
article

Usability Evaluation of EzList: A Digital Platform for Surgical Waitlist Management Using Standardized Metrics

Giovanni Scala Marchini, Elisa Antolli, Fabio Carvalho Vicentini, Guilherme Gentile, Guilherme Pimenta Roncete, Eduardo Mazzucchi, Carlos Alfredo Batagello, Marcelo Morandini, Rodrigo Perrella, William Carlos Nahas, Fabio C. M. Torricelli, Alexandre Danilovic, Ana Teresa C. Vicentini
article en

Abstract

OBJECTIVE: This study evaluated the usability of EzList, a Brazilian digital platform developed to optimize elective surgical waitlist management. METHODS: A summative usability assessment was conducted with ten surgeons and surgical residents, both with and without prior EzList experience, following IEC 62366:2015 and ISO 14971 standards. Participants completed seven representative clinical tasks. Usability was measured using the System Usability Scale (SUS) and the Single Usability Metric (SUM), integrating scores for task completion, errors, task time, and satisfaction. Additional metrics included completion rate, error rate, time-based efficiency, assistance rate, learning rate, and workflow adherence. RESULTS: The SUM score was 70.8%, reflecting high task completion (95.7%) and satisfaction, but lower efficiency. The mean SUS score was 84.6 (SD = 7.9), indicating good to excellent perceived usability. The error rate averaged 27.9%, mainly related to comprehension and redundant steps, with task 2 and 6 requiring more time and assistance. Time-based efficiency was 1.47%, slightly below the 1.78% benchmark. Learning curves varied, with a mean improvement of 16.3%. Post-task satisfaction was high; external assistance was needed in 14.3% of tasks. The digital platform provided a highly usable interface, supporting efficient task completion and positive user perception. However, moderate error rates and some inefficiencies highlight areas for interface refinement, particularly regarding workflow clarity. Variability in learning suggests the need for more intuitive design to facilitate broader clinical adoption.

Applied Clinical Informatics
Universidade de São Paulo (BR), Hospital Israelita Albert Einstein (BR), Centro Universitário Belas Artes de São Paulo (BR), Ministério da Saúde (BR), Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo (BR), Fundação Faculdade de Medicina (BR)
Fundação de Amparo à Pesquisa do Estado de São Paulo
Openalex Percentile: Top 2%
Electronic Health Records Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.