A Novel Sound Source Localization Method Using Transformer

Sound source localization (SSL) has garnered significant attention in the current era of intelligent systems. However, existing localization methods often suffer from limitations such as poor robustness and low accuracy. This paper proposes a novel SSL method that utilizes the self-attention mechanism in Transformers to model audio features. Specifically, after digitizing the audio signal, we first employ a shallow convolutional neural network (CNN) for feature extraction. Subsequently, the flattened audio features undergo deep feature extraction using a straightforward multi-head self-attention mechanism. Finally, we use a fully connected layer to obtain the predicted direction of arrival (DOA) trajectory. Experiments conducted in various scenarios demonstrate that the proposed method offers more stable and precise localization performance.

Authors

Institutions

Publication Details

Published
2024-11-21
DOI
https://doi.org/10.1109/iciibms62405.2024.10792800
Citations
1
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Novel Sound Source Localization Method Using Transformer

Rui Zhang, Xizhong Shen
1 citations
Speech and Audio Processing
0.35
article

A Novel Sound Source Localization Method Using Transformer

Rui Zhang, Xizhong Shen
article en
1 citations

Abstract

Sound source localization (SSL) has garnered significant attention in the current era of intelligent systems. However, existing localization methods often suffer from limitations such as poor robustness and low accuracy. This paper proposes a novel SSL method that utilizes the self-attention mechanism in Transformers to model audio features. Specifically, after digitizing the audio signal, we first employ a shallow convolutional neural network (CNN) for feature extraction. Subsequently, the flattened audio features undergo deep feature extraction using a straightforward multi-head self-attention mechanism. Finally, we use a fully connected layer to obtain the predicted direction of arrival (DOA) trajectory. Experiments conducted in various scenarios demonstrate that the proposed method offers more stable and precise localization performance.

Shanghai Institute of Technology (CN)
Affordable and clean energy
Openalex Percentile: Top 40%
Speech and Audio Processing
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.