Fine-Grained Speech Sentiment Analysis in Chinese Psychological Support Hotlines Based on Large-Scale Pre-Trained Model

Suicide and suicidal behaviors remain significant challenges for public policy and healthcare. In response, psy-chological support hotlines have been established worldwide to provide immediate help to individuals in mental crises. The effectiveness of these hotlines largely depends on accurately identifying callers' emotional states, particularly underlying negative emotions indicative of increased suicide risk. However, the high demand for psychological interventions often results in a shortage of professional operators, highlighting the need for an effective speech emotion recognition model. This model would automatically detect and analyze callers' emotions, facil-itating integration into hotline services. Additionally, it would enable large-scale data analysis of psychological support hotline interactions to explore psychological phenomena and behaviors across populations. Our study utilizes data from the Beijing psychological support hotline, the largest suicide hotline in China. We analyzed speech data from 105 callers containing 20,630 segments and categorized them into 11 types of negative emotions. We developed a negative emotion recognition model and a fine-grained multi-label classification model using a large-scale pretrained model. Our experiments indicate that the negative emotion recognition model achieves a maximum F1-score of 76.96%. However, it shows limited efficacy in the fine-grained multi-label classification task, with the best model achieving only a 41.74% weighted F1-score. We conducted an error analysis for this task, discussed potential future improvements, and considered the clinical application possibilities of our study. All the codes are public available at: https://github.com/cz10914/psy_hotline_analysis.

Authors

Institutions

Publication Details

Published
2024-10-06
DOI
https://doi.org/10.1109/smc54092.2024.10831967
Citations
3
Primary Topic
Mental Health via Writing
Type
article
Field-Weighted Citation Impact
1.93
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fine-Grained Speech Sentiment Analysis in Chinese Psychological Support Hotlines Based on Large-Scale Pre-Trained Model

Yi‐Ning Chen, Changwei Song, Qing Zhao, Guanghui Fu et al.
3 citations
Mental Health via Writing
1.93
article

Fine-Grained Speech Sentiment Analysis in Chinese Psychological Support Hotlines Based on Large-Scale Pre-Trained Model

Yi‐Ning Chen, Changwei Song, Qing Zhao, Guanghui Fu, Jianqiang Li, Yongsheng Tong, Zhonglong Chen
article en
3 citations

Abstract

Suicide and suicidal behaviors remain significant challenges for public policy and healthcare. In response, psy-chological support hotlines have been established worldwide to provide immediate help to individuals in mental crises. The effectiveness of these hotlines largely depends on accurately identifying callers' emotional states, particularly underlying negative emotions indicative of increased suicide risk. However, the high demand for psychological interventions often results in a shortage of professional operators, highlighting the need for an effective speech emotion recognition model. This model would automatically detect and analyze callers' emotions, facil-itating integration into hotline services. Additionally, it would enable large-scale data analysis of psychological support hotline interactions to explore psychological phenomena and behaviors across populations. Our study utilizes data from the Beijing psychological support hotline, the largest suicide hotline in China. We analyzed speech data from 105 callers containing 20,630 segments and categorized them into 11 types of negative emotions. We developed a negative emotion recognition model and a fine-grained multi-label classification model using a large-scale pretrained model. Our experiments indicate that the negative emotion recognition model achieves a maximum F1-score of 76.96%. However, it shows limited efficacy in the fine-grained multi-label classification task, with the best model achieving only a 41.74% weighted F1-score. We conducted an error analysis for this task, discussed potential future improvements, and considered the clinical application possibilities of our study. All the codes are public available at: https://github.com/cz10914/psy_hotline_analysis.

Centre National de la Recherche Scientifique (FR), Inserm (FR), Peking University (CN), Beijing University of Technology (CN), Sorbonne Université (FR), Assistance Publique – Hôpitaux de Paris (FR), Beijing HuiLongGuan Hospital (CN), Institut du Cerveau (FR)
Gender equality
Openalex Percentile: Top 13%
Mental Health via Writing
1.93
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.