Randomized Trial Protocol: Head-to-Head Comparison of Two Ambient Artificial Intelligence Documentation Tools on Clinician Usability

Abstract Background: Ambient AI documentation reduces documentation burden and electronic health record (EHR) time for ambulatory clinicians. Newer features also queue orders and offer some level of coding support for clinician review. This study compares two commercial products deployed at UCLA Health. Objective: To compare Nabla and Epic Systems, Inc. ambient AI solution among ambulatory clinicians at UCLA Health on usability, documentation burden, perceived note quality, adoption, EHR time and productivity, clinician-reported experience with order queueing and coding support, coding and billing patterns and integrity, work productivity, and patient-reported communication experience. Methods: Two-arm parallel-group randomized trial, 1:1, among 374 ambulatory clinicians at a single academic health system who hold an active license for a standalone ambient application (Nabla). Randomization is covariate-constrained where cohort size permits, balancing age, sex, half-day clinic sessions, specialty group, and baseline System Usability Scale (SUS) score. Intervention runs 11/9/2026 to 1/17/2027, with the first four weeks as lead-in. The primary outcome is SUS score at follow-up, compared between arms. Analysis is by intention-to-treat using mixed-effects models. Ethics and dissemination: Determined exempt by the UCLA Institutional Review Board (IRB-26-2147). Survey completion indicates consent. No patient-level data are collected. Findings will directly inform operational decision making and will be published regardless of direction.

Authors

Institutions

Publication Details

Journal
medRxiv
Published
2026-11-09
DOI
https://doi.org/10.64898/2026.11.07.26367514
Primary Topic
Electronic Health Records Systems
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Randomized Trial Protocol: Head-to-Head Comparison of Two Ambient Artificial Intelligence Documentation Tools on Clinician Usability

John N. Mafi, Paul J. Lukac, Aaron T. Chin, Sitaram Vangala et al.
medRxiv
Electronic Health Records Systems
preprint

Randomized Trial Protocol: Head-to-Head Comparison of Two Ambient Artificial Intelligence Documentation Tools on Clinician Usability

John N. Mafi, Paul J. Lukac, Aaron T. Chin, Sitaram Vangala, Hawkin E. Woo, Kenny Leung, Eric M. Cheng, Thomas Kingsley, Alexander Sandhu, Laleh Jalalian
preprint en

Abstract

Abstract Background: Ambient AI documentation reduces documentation burden and electronic health record (EHR) time for ambulatory clinicians. Newer features also queue orders and offer some level of coding support for clinician review. This study compares two commercial products deployed at UCLA Health. Objective: To compare Nabla and Epic Systems, Inc. ambient AI solution among ambulatory clinicians at UCLA Health on usability, documentation burden, perceived note quality, adoption, EHR time and productivity, clinician-reported experience with order queueing and coding support, coding and billing patterns and integrity, work productivity, and patient-reported communication experience. Methods: Two-arm parallel-group randomized trial, 1:1, among 374 ambulatory clinicians at a single academic health system who hold an active license for a standalone ambient application (Nabla). Randomization is covariate-constrained where cohort size permits, balancing age, sex, half-day clinic sessions, specialty group, and baseline System Usability Scale (SUS) score. Intervention runs 11/9/2026 to 1/17/2027, with the first four weeks as lead-in. The primary outcome is SUS score at follow-up, compared between arms. Analysis is by intention-to-treat using mixed-effects models. Ethics and dissemination: Determined exempt by the UCLA Institutional Review Board (IRB-26-2147). Survey completion indicates consent. No patient-level data are collected. Findings will directly inform operational decision making and will be published regardless of direction.

medRxiv
University of California, Los Angeles (US), UCLA Health (US)
Electronic Health Records Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon