Automatic Detection of Physiological Attributes from Verbal Communication During Time-Critical Medical Events
In this study, we present a proof-of-concept system exploring the feasibility of automatically capturing physiological values during the primary survey phase of trauma resuscitation—a complex, time-sensitive evaluation of severely injured patients. We developed and evaluated a speech-driven activity recognition system designed to detect and extract key physiological parameters (e.g., age, manual blood pressure, Glasgow Coma Scale) from spoken clinical dialogue in real-time. By using audio recordings from actual trauma resuscitation cases, our system performs streaming inference to identify verbalized measurements associated with primary survey activities. Experimental results show that our approach can recognize seven attributes with an average accuracy of 72% in a challenging clinical environment with acceptable latency. We present this work as an initial feasibility demonstration rather than a deployment-ready system, highlighting both the opportunities and the remaining challenges of automating documentation in fast-paced emergency environments.
Authors
- Randall S. Burd (ORCID: https://orcid.org/0000-0003-4465-9117)
- Ivan Marsic (ORCID: https://orcid.org/0000-0002-1033-6865)
- Mary S. Kim (ORCID: https://orcid.org/0009-0006-7025-6636)
- Aleksandra Sarcevic (ORCID: https://orcid.org/0000-0003-2126-8527)
- Chenyang Gao (ORCID: https://orcid.org/0000-0002-0280-7882)
- Aaron H. Mun (ORCID: https://orcid.org/0009-0001-8579-8052)
- Wenjin Zhang (ORCID: https://orcid.org/0009-0008-9825-0978)
Institutions
- Rutgers, The State University of New Jersey (US)
- National Hospital (IN)
- Drexel University (US)
Publication Details
- Journal
- ACM Transactions on Computing for Healthcare
- Published
- 2026-07-17
- DOI
- https://doi.org/10.1145/3829355
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00