Graph-based neural networks with neural ODEs for robust speech processing in environmental and human-centric systems
This paper introduces H-STGNN-ODE-DA, a novel model for voice sentiment analysis that combines multi-scale acoustic feature extraction, hierarchical graph neural networks (GNNs), Neural Ordinary Differential Equations (Neural ODEs), and domain-adversarial adaptation. Designed to enhance accuracy and robustness under real-world conditions, the model was evaluated on IEMOCAP, MELD, and EmoDB datasets, outperforming state-of-the-art approaches such as LSTM, CNN, GCN, GAT, DANN, and SPECTRA. Notably, it achieved a 4.0% improvement over GAT on MELD. Neural ODEs enabled effective modeling of continuous emotional transitions, while domain-adversarial adaptation ensured robustness to domain shifts. Ablation studies confirmed the critical role of each component in achieving high performance. The model demonstrated strong cross-domain transferability, maintaining high accuracy across diverse recording conditions. These results position H- STGNN-ODE-DA as a robust and versatile solution for real-world applications in speech processing, including virtual assistants, social media analysis, and customer service systems.
Authors
- Serik Joldasbayev (ORCID: https://orcid.org/0000-0002-8689-1822)
- Сакен Мамбетов (ORCID: https://orcid.org/0000-0002-7249-5378)
- Bulgyn Mailykhanova (ORCID: https://orcid.org/0009-0000-2409-6041)
- Ainur Ormanbekova
- Laura Duissembayeva
Institutions
- Al-Farabi Kazakh National University (KZ)
- Turan University (KZ)
- Almaty Technological University (KZ)
- International Information Technologies University (KZ)
Publication Details
- Journal
- E3S Web of Conferences
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1051/e3sconf/202562704017
- Citations
- 1
- Primary Topic
- Music and Audio Processing
- Type
- article
- Field-Weighted Citation Impact
- 1.49