Research on Speech Separation Algorithms Based on Deep Learning

This paper introduces an efficient speech separation algorithm based on optimized Long Short-Term Memory (LSTM) networks. The enhanced LSTM architecture improves accuracy and processing efficiency, enabling real-time applications for multi-speaker separation. The mixed speech signal is first processed via Short-Time Fourier Transform (STFT) for time-frequency representation. A 2D convolutional block extracts features, followed by a deep neural network for advanced processing, with feature fusion through a fully connected layer. The network-processed data undergoes an XOR operation with raw data, and 2D transposed convolutional operations reconstruct isolated speech signals. Experiments demonstrate high scale-invariant signal-to-noise ratio (SISNR) values: 10.27 dB (LSTM), 9.56 dB (BLSTM), and 7.32 dB (Transformer), validating the algorithm's efficacy in multispeaker separation.

Authors

Institutions

Publication Details

Published
2025-04-25
DOI
https://doi.org/10.1109/iccea65460.2025.11102291
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Speech Separation Algorithms Based on Deep Learning

Y. Li, Zhiyong Zhang, Liu B, Jiaxuan Ran
Speech and Audio Processing
article

Research on Speech Separation Algorithms Based on Deep Learning

Y. Li, Zhiyong Zhang, Liu B, Jiaxuan Ran
article en

Abstract

This paper introduces an efficient speech separation algorithm based on optimized Long Short-Term Memory (LSTM) networks. The enhanced LSTM architecture improves accuracy and processing efficiency, enabling real-time applications for multi-speaker separation. The mixed speech signal is first processed via Short-Time Fourier Transform (STFT) for time-frequency representation. A 2D convolutional block extracts features, followed by a deep neural network for advanced processing, with feature fusion through a fully connected layer. The network-processed data undergoes an XOR operation with raw data, and 2D transposed convolutional operations reconstruct isolated speech signals. Experiments demonstrate high scale-invariant signal-to-noise ratio (SISNR) values: 10.27 dB (LSTM), 9.56 dB (BLSTM), and 7.32 dB (Transformer), validating the algorithm's efficacy in multispeaker separation.

Northwest A&F University (CN)
Openalex Percentile: Top 76%
Speech and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.