Hospitalization prediction from the emergency department using computer vision AI with short patient video clips
In this study, we investigate the performance of computer vision AI algorithms in predicting patient disposition from the emergency department (ED) using short video clips. Clinicians often use "eye-balling" or clinical gestalt to aid in triage, based on brief observations. We hypothesize that AI can similarly use patient appearance for disposition prediction. Data were collected from adult patients at an academic ED, with mobile phone videos capturing patients performing simple tasks. Our AI algorithm, using video alone, showed better performance in predicting hospital admissions (AUROC = 0.693 [95% CI 0.689, 0.696]) compared to models using triage clinical data (AUROC = 0.678 [95% CI 0.668, 0.687]). Combining video and triage data achieved the highest predictive performance (AUROC = 0.714 [95% CI 0.709, 0.719]). This study demonstrates the potential of video AI algorithms to support ED triage and alleviate healthcare capacity strains during periods of high demand.
Authors
- Elaine Sui (ORCID: https://orcid.org/0009-0000-9488-6268)
- Abhinav Kumar
- Zhenzhen Weng (ORCID: https://orcid.org/0009-0004-1108-4155)
- Jesutofunmi A. Omiye (ORCID: https://orcid.org/0000-0002-0659-831X)
- Jason Fries (ORCID: https://orcid.org/0000-0001-9316-5768)
- Maria Xenochristou (ORCID: https://orcid.org/0000-0001-5064-0813)
- Nicholas Scoulios
- Ryan Ribeira (ORCID: https://orcid.org/0000-0002-4782-2410)
- Hayden L. Hofmann
- Ali Mottaghi
- Lawrence V. Hofmann (ORCID: https://orcid.org/0009-0004-3823-3894)
- Maja Artandi (ORCID: https://orcid.org/0000-0003-2342-6277)
- Serena Yeung
- Malathi Srinivasan (ORCID: https://orcid.org/0000-0001-9951-0016)
- Ananya Ganesh (ORCID: https://orcid.org/0009-0001-1541-6557)
- Wui Ip (ORCID: https://orcid.org/0000-0002-9459-3702)
- Debadutta Dash
- Elyse Ruan
Institutions
- Palo Alto University (US)
- Stanford Health Care (US)
- Chan Zuckerberg Initiative (United States) (US)
- Stanford Medicine (US)
- Stanford University (US)
Publication Details
- Journal
- npj Digital Medicine
- Published
- 2024-12-19
- DOI
- https://doi.org/10.1038/s41746-024-01375-3
- Citations
- 4
- Primary Topic
- Emergency and Acute Care Studies
- Type
- article
- Field-Weighted Citation Impact
- 2.76