Breathing and Semantic Pause Detection and Exertion-Level Classification in Post-Exercise Speech
Post-exercise speech contains rich physiological and linguistic cues, often marked by semantic pauses, breathing pauses, and combined breathing-semantic pauses. Detecting these events enables assessment of recovery rate, lung function, and exertion-related abnormalities. However, existing works on identifying and distinguishing different types of pauses in this context are limited. In this work, building on a recently released dataset with synchronized audio and respiration signals, we provide systematic annotations of pause types. Using these annotations, we systematically conduct exploratory breathing and semantic pause detection and exertion-level classification across deep learning models (GRU, 1D CNN-LSTM, AlexNet, VGG16), acoustic features (MFCC, MFB), and layer-stratified Wav2Vec2 representations. We evaluate three setups---single feature, feature fusion, and a two-stage detection-classification cascade---under both classification and regression formulations. Results show per-type detection accuracy up to 89% for semantic, 55% for breathing, 86% for combined pauses, and 73% overall, while exertion-level classification achieves 90.5% accuracy, outperforming prior work.
Authors
- Wentao Xia (ORCID: https://orcid.org/0009-0006-9805-2774)
- Huaxiu Yao (ORCID: https://orcid.org/0000-0002-8691-9629)
- Jingping Nie (ORCID: https://orcid.org/0000-0002-9181-8398)
- Yuyu Wang (ORCID: https://orcid.org/0000-0002-8645-303X)
Institutions
- University of North Carolina at Chapel Hill (US)
Publication Details
- Published
- 2025-09-22
- DOI
- https://doi.org/10.1145/3737901.3768369
- Citations
- 1
- Primary Topic
- Speech Recognition and Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 2.48