Towards Robust Assessment of Pathological Voices via Combined Low-Level Descriptors and Foundation Model Representations
Perceptual voice quality assessment plays a vital role in diagnosing and monitoring voice disorders. Traditional methods, such as the Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V) and the Grade, Roughness, Breathiness, Asthenia, and Strain (GRBAS) scales, rely on expert raters and are prone to inter-rater variability, emphasizing the need for objective solutions. This study introduces the Voice Quality Assessment Network (VOQANet), a deep learning framework that employs an attention mechanism and Speech Foundation Model (SFM) embeddings to extract high-level features. To further enhance performance, we propose VOQANet+, which integrates self-supervised SFM embeddings with low-level acoustic descriptors-namely jitter, shimmer, and harmonics-to-noise ratio (HNR). Unlike previous approaches that focus solely on vowel-based phonation (PVQD-A), our models are evaluated on both vowel-level and sentence-level speech (PVQD-S) to assess generalizability. Experimental results demonstrate that sentence-based inputs yield higher accuracy, particularly at the patient level. Overall, VOQANet consistently outperforms baseline models in terms of root mean squared error (RMSE) and Pearson correlation coefficient across CAPE-V and GRBAS dimensions, with VOQANet+ achieving even greater performance gains. Additionally, VOQANet+ maintains consistent performance under noisy conditions, suggesting enhanced robustness for real-world and telehealth applications. This work highlights the value of combining SFM embeddings with low-level features for accurate and robust pathological voice assessment.
Authors
- Whenty Ariyanti
- Yu Tsao (ORCID: https://orcid.org/0000-0001-6956-0418)
- Hsin‐Min Wang (ORCID: https://orcid.org/0000-0003-3599-5071)
- Sabato Marco Siniscalchi (ORCID: https://orcid.org/0000-0002-0770-0507)
- Kuan‐Yu Chen (ORCID: https://orcid.org/0000-0002-6036-2199)
Institutions
- National Taiwan University of Science and Technology (TW)
- Research Center for Information Technology Innovation, Academia Sinica (TW)
- Institute of Information Science, Academia Sinica (TW)
- University of Palermo (IT)
Publication Details
- Journal
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/jbhi.2025.3644692
- Primary Topic
- Voice and Speech Disorders
- Type
- article
- Field-Weighted Citation Impact
- 0.00