Pain Level Classification from Speech Using GRU-Mixer Architecture with Log-Mel Spectrogram Features
<b>Background/Objectives</b>: Automatic pain detection from speech signals holds strong promise for non-invasive and real-time assessment in clinical and caregiving settings, particularly for populations with limited capacity for self-report. <b>Methods:</b> In this study, we introduce a lightweight recurrent deep learning approach, namely the Gated Recurrent Unit (GRU)-Mixer model for pain level classification based on speech signals. The proposed model maps raw audio inputs into Log-Mel spectrogram features, which are passed through a stacked bidirectional GRU for modeling the spectral and temporal dynamics of vocal expressions. To extract compact utterance-level embeddings, an adaptive average pooling-based temporal mixing mechanism is applied over the GRU outputs, followed by a fully connected classification head alongside dropout regularization. This architecture is used for several supervised classification tasks, including binary (pain/non-pain), graded intensity (mild, moderate, severe), and thermal-state (cold/warm) classification. End-to-end training is done using speaker-independent splits and class-balanced loss to promote generalization and discourage bias. The provided audio inputs are normalized to a consistent 3-s window and resampled at 8 kHz for consistency and computational efficiency. <b>Results:</b> Experiments on the TAME Pain dataset showcase strong classification performance, achieving 83.86% accuracy for binary pain detection and as high as 75.36% for multiclass pain intensity classification. <b>Conclusions:</b> As the first deep learning based classification work on the TAME Pain dataset, this work introduces the GRU-Mixer as an effective benchmark architecture for future studies on speech-based pain recognition and affective computing.
Authors
- Adi Alhudhaif (ORCID: https://orcid.org/0000-0002-7201-6963)
Institutions
- Prince Sattam Bin Abdulaziz University (SA)
Publication Details
- Journal
- Diagnostics
- Published
- 2025-09-17
- DOI
- https://doi.org/10.3390/diagnostics15182362
- Citations
- 2
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 4.24
Funders
- Prince Sattam bin Abdulaziz University