WATCH-SS: Developing a Trustworthy and Explainable Modular Framework for Detecting Cognitive Impairment from Spontaneous Speech
Early detection of cognitive impairment (CI) is critical for timely intervention in Alzheimer's disease and AD-related dementias. To address this, we propose the Warning Assessment and Alerting Tool for Cognitive Health from Spontaneous Speech (WATCH-SS), a modular and explainable three-stage framework for detecting CI from a patient's speech sample. The framework uses detectors for five linguistic and acoustic indicators of CI, aggregates their outputs into a set of clinically interpretable summary features, and uses a predictive model for CI classification. We consider multiple approaches to implementing these detectors that range from simple, computationally efficient methods suitable for real-time analysis to strong, resource-intensive methods, better for high accuracy offline analysis. On the DementiaBank ADReSS dataset, WATCH-SS achieved strong predictive performance (AUC = 80% on the test set). This work demonstrates that a modular, feature-based approach can achieve strong performance while providing a transparent diagnostic profile, representing a significant step towards a trustworthy and clinically-usable screening tool for primary care.
Authors
- Sydney Pugh (ORCID: https://orcid.org/0000-0002-1465-983X)
- Rachel Wu
- Sy Hwang (ORCID: https://orcid.org/0000-0003-3851-9521)
- Eric R. Eaton (ORCID: https://orcid.org/0000-0002-5689-2234)
- Karen O’Connor (ORCID: https://orcid.org/0000-0001-7709-3813)
- Kevin B. Johnson (ORCID: https://orcid.org/0000-0003-1016-9363)
- Kuk Jin Jang (ORCID: https://orcid.org/0000-0002-3134-3220)
- Kyra O’Brien (ORCID: https://orcid.org/0000-0002-8461-0492)
- Matthew Hill (ORCID: https://orcid.org/0009-0004-9253-169X)
- Stacy Iannone
Institutions
- University of Pennsylvania (US)
- Hongik University (KR)
Publication Details
- Published
- 2025-12-01
- DOI
- https://doi.org/10.1142/9789819824755_0024
- Primary Topic
- Dementia and Cognitive Impairment Research
- Type
- article
- Field-Weighted Citation Impact
- 0.00