Enhancing Schizophrenia Diagnosis with Multi-Spectral Speech Analysis and Attention Mechanisms

Schizophrenia is a complex and chronic psychiatric disorder that significantly affects cognition, perception, and communication. Among its many symptoms, speech impairments serve as a critical biomarker for early diagnosis, making speech-based assessments an effective tool for automated detection. This study introduces WNMSA-Net (Wideband-Narrowband-Mel Spectrogram Axial-Attention Network), an Axial-Attention-Based Deep Learning Model designed for high-accuracy schizophrenia classification and early detection. The model leverages Wideband Spectrograms (WBS), Narrowband Spectrograms (NBS), and Mel Spectrograms (MS) to extract essential speech features while utilizing Axial Attention Mechanisms to enhance time-frequency dependency modeling. Additionally, a Gated Multi-Channel Fusion (GMC-Fusion) module is incorporated to dynamically integrate spectral representations, ensuring optimal feature selection for classification. Experimental results demonstrate that WNMSA-Net effectively captures schizophrenia-related speech impairments, including reduced fluency, monotonic pitch variations, and abnormal intensity shifts. The model achieves an accuracy of 98.85%, significantly improving classification performance while enhancing early detection rates to 92.40%. Computational efficiency is also optimized, reducing training time by 21.6% and inference time by 17.7%, ensuring feasibility for real-time clinical applications. By combining multi-spectral speech analysis, attention-based feature extraction, and adaptive fusion mechanisms, WNMSA-Net establishes a new benchmark for AI-driven schizophrenia detection. This research highlights the potential of speech-driven artificial intelligence in psychiatric diagnostics, paving the way for automated, objective, and scalable mental health assessment tools that can support clinical decision-making and improve early intervention strategies.

Authors

Institutions

Publication Details

Published
2025-07-25
DOI
https://doi.org/10.1109/atigb66719.2025.11142138
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Schizophrenia Diagnosis with Multi-Spectral Speech Analysis and Attention Mechanisms

Gnanajeyaraman Rajaram, L. Reetha, Pirithiga Madhan
Emotion and Mood Recognition
article

Enhancing Schizophrenia Diagnosis with Multi-Spectral Speech Analysis and Attention Mechanisms

Gnanajeyaraman Rajaram, L. Reetha, Pirithiga Madhan
article en

Abstract

Schizophrenia is a complex and chronic psychiatric disorder that significantly affects cognition, perception, and communication. Among its many symptoms, speech impairments serve as a critical biomarker for early diagnosis, making speech-based assessments an effective tool for automated detection. This study introduces WNMSA-Net (Wideband-Narrowband-Mel Spectrogram Axial-Attention Network), an Axial-Attention-Based Deep Learning Model designed for high-accuracy schizophrenia classification and early detection. The model leverages Wideband Spectrograms (WBS), Narrowband Spectrograms (NBS), and Mel Spectrograms (MS) to extract essential speech features while utilizing Axial Attention Mechanisms to enhance time-frequency dependency modeling. Additionally, a Gated Multi-Channel Fusion (GMC-Fusion) module is incorporated to dynamically integrate spectral representations, ensuring optimal feature selection for classification. Experimental results demonstrate that WNMSA-Net effectively captures schizophrenia-related speech impairments, including reduced fluency, monotonic pitch variations, and abnormal intensity shifts. The model achieves an accuracy of 98.85%, significantly improving classification performance while enhancing early detection rates to 92.40%. Computational efficiency is also optimized, reducing training time by 21.6% and inference time by 17.7%, ensuring feasibility for real-time clinical applications. By combining multi-spectral speech analysis, attention-based feature extraction, and adaptive fusion mechanisms, WNMSA-Net establishes a new benchmark for AI-driven schizophrenia detection. This research highlights the potential of speech-driven artificial intelligence in psychiatric diagnostics, paving the way for automated, objective, and scalable mental health assessment tools that can support clinical decision-making and improve early intervention strategies.

Saveetha University (IN)
Openalex Percentile: Top 75%
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Enhancing Schizophrenia Diagnosis with Multi-Spectral Speech Analysis and Attention Mechanisms — Gnanajeyaraman Rajaram, L. Reetha, et al. · (2025) | TGRS Research Map | TGRS