ML-based detection of depressive profile through voice analysis in WhatsApp™ audio messages of Brazilian Portuguese Speakers
Depression is a prevalent mental health condition that significantly impacts individuals' daily lives, work productivity, relationships, and overall well-being. The lack of reliable biomarkers complicates screening, contributing to underdiagnosis. Depression's impact on voice and acoustic parameters enables differentiation between adaptive and non-adaptive mood profiles, offering potential classifiers for screening. This study evaluates the capability of seven distinct machine learning models to identify depression in speech samples. WhatsApp™ audio messages (WA), clinical, and sociodemographic data were collected from 160 individuals divided into two groups: one for algorithm development and the other for testing. Each group included patients with Major Depressive Disorder and healthy controls. In the test group, participants were interviewed using the Mini-International Neuropsychiatric Interview (MINI), and their WhatsApp™ audio recordings included both structured and semi-structured formats. After pre-processing the audio, 68 acoustic features were used to train the machine learning models. Results shows that: i) The algorithms evaluated WhatsApp™ audio recordings from the test group, achieving peak accuracies of 91.67% for women and 80% for men, with an AUC of 91.9% for women and 78.33% for men. ii) The accuracy of Machine Learning (ML) classification varies depending on the type of audio instruction provided. ML can classify, with reasonable accuracy, whether a WhatsApp™ audio message represents a depressive patient or a healthy individual. Future studies should further explore the relationship between voice characteristics, different mood profiles, and emotional states.
Authors
- Ricardo Riyoiti Uchida (ORCID: https://orcid.org/0000-0002-4209-8830)
- Victor H. O. Otani
- Thiago Justino
- Pedro Makoto Uchida
- Luiza Braconi Grilo
- Lucas M. Marques
- Felipe Oliveira de Aguiar
- Matheus F. Figueiredo
- Daniel A. C. Vasques
- Thaís Z. S. Otani
- João Ricardo N. Vissoci
- Hudson S. Buck
Institutions
- Duke University (US)
- Universidade Estadual de Campinas (UNICAMP) (BR)
- Universidade Federal da Grande Dourados (BR)
- Faculdade de Ciências Médicas da Santa Casa de São Paulo (BR)
- Duke Institute for Health Innovation (US)
- Artificial Intelligence in Medicine (Canada) (CA)
- Pontifícia Universidade Católica de Campinas (BR)
- Pontifícia Universidade Católica de São Paulo (BR)
- Universidade de Mogi das Cruzes (BR)
Publication Details
- Journal
- PLOS mental health.
- Published
- 2026-01-21
- DOI
- https://doi.org/10.1371/journal.pmen.0000357
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00