CCAUNet: Boosting Feature Representation Using Complex Coordinate Attention for Monaural Speech Enhancement

Speech enhancement models based on deep learning, such as the complex U-Net model, have achieved good results. However, traditional methods based on convolutional neural networks often ignore the inherent properties of the speech spectrum, such as long-term temporal dependence, cross-frequency correlation and spatial position information, when processing speech signals. These properties are crucial to helping the model distinguish speech from noise and improve speech quality. In this paper, we propose a new speech enhancement model called CCAUNet. The core of the model is an innovative complex coordinate attention structure that can simultaneously capture and emphasize temporal dependence, frequency dependence and spatial position information in the speech spectrum. In addition, Furthermore, we employ multi-resolution STFT loss and SI -SNR loss for joint optimization of the model, thereby assisting the complex coordinate attention in accurately processing spectral features. The multi-resolution STFT loss can capture detailed information at different frequency scales, while the SI -SNR loss focuses on the quality of the speech signal. Experimental results conducted on the Deep Noise Suppression Challenge dataset show that the proposed CCAUNet outperforms all compared models on WB-PESQ, NB-PESQ, STOI and SI-SNR metrics.

Authors

Institutions

Publication Details

Published
2024-10-06
DOI
https://doi.org/10.1109/smc54092.2024.10830999
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CCAUNet: Boosting Feature Representation Using Complex Coordinate Attention for Monaural Speech Enhancement

Qun Yang, Sixing Liu, Yi Jiang
Speech and Audio Processing
article

CCAUNet: Boosting Feature Representation Using Complex Coordinate Attention for Monaural Speech Enhancement

Qun Yang, Sixing Liu, Yi Jiang
article en

Abstract

Speech enhancement models based on deep learning, such as the complex U-Net model, have achieved good results. However, traditional methods based on convolutional neural networks often ignore the inherent properties of the speech spectrum, such as long-term temporal dependence, cross-frequency correlation and spatial position information, when processing speech signals. These properties are crucial to helping the model distinguish speech from noise and improve speech quality. In this paper, we propose a new speech enhancement model called CCAUNet. The core of the model is an innovative complex coordinate attention structure that can simultaneously capture and emphasize temporal dependence, frequency dependence and spatial position information in the speech spectrum. In addition, Furthermore, we employ multi-resolution STFT loss and SI -SNR loss for joint optimization of the model, thereby assisting the complex coordinate attention in accurately processing spectral features. The multi-resolution STFT loss can capture detailed information at different frequency scales, while the SI -SNR loss focuses on the quality of the speech signal. Experimental results conducted on the Deep Noise Suppression Challenge dataset show that the proposed CCAUNet outperforms all compared models on WB-PESQ, NB-PESQ, STOI and SI-SNR metrics.

Nanjing University of Aeronautics and Astronautics (CN)
Openalex Percentile: Top 71%
Speech and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

CCAUNet: Boosting Feature Representation Using Complex Coordinate Attention for Monaural Speech Enhancement — Qun Yang, Sixing Liu, et al. · (2024) | TGRS Research Map | TGRS