Source Separation of Piano Concertos Using Hybrid LSTM-Transformer Model

Music source separation, the process of extracting independent audio streams from a complex mix, has traditionally focused on isolating vocals, drums, bass, and other primary sources. This study tackles the more intricate task of separating the piano component from a piano concerto-a challenge compounded by the diverse range of instruments and the dynamic shifts in volume and timbre. Unlike traditional music separation tasks, the piano’s distinct characteristics and its interaction with the orchestra demand a more nuanced approach.To address the scarcity of multi-track recordings for piano concertos, this research pioneers an artificial data synthesis strategy to create a robust training dataset. We introduce a novel hybrid deep learning model that integrates Long Short-Term Memory (LSTM) networks with Transformer architecture, capitalizing on their complementary strengths to distinguish piano melodies from the rich tapestry of orchestral sounds. Our experiments demonstrate that this hybrid approach significantly outperforms conventional methods, with an improvement of 3.18 dB in signal-to-distortion ratio. These results not only validate the efficacy of proposed method but also pave the way for innovative applications in classical music source separation.

Authors

Institutions

Publication Details

Published
2024-08-25
DOI
https://doi.org/10.1109/cost64302.2024.00011
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Source Separation of Piano Concertos Using Hybrid LSTM-Transformer Model

Jingyu Liu, Wei He, Jingjing Zhou, Wei Jiang
Speech and Audio Processing
article

Source Separation of Piano Concertos Using Hybrid LSTM-Transformer Model

Jingyu Liu, Wei He, Jingjing Zhou, Wei Jiang
article en

Abstract

Music source separation, the process of extracting independent audio streams from a complex mix, has traditionally focused on isolating vocals, drums, bass, and other primary sources. This study tackles the more intricate task of separating the piano component from a piano concerto-a challenge compounded by the diverse range of instruments and the dynamic shifts in volume and timbre. Unlike traditional music separation tasks, the piano’s distinct characteristics and its interaction with the orchestra demand a more nuanced approach.To address the scarcity of multi-track recordings for piano concertos, this research pioneers an artificial data synthesis strategy to create a robust training dataset. We introduce a novel hybrid deep learning model that integrates Long Short-Term Memory (LSTM) networks with Transformer architecture, capitalizing on their complementary strengths to distinguish piano melodies from the rich tapestry of orchestral sounds. Our experiments demonstrate that this hybrid approach significantly outperforms conventional methods, with an improvement of 3.18 dB in signal-to-distortion ratio. These results not only validate the efficacy of proposed method but also pave the way for innovative applications in classical music source separation.

State Key Laboratory of Media Convergence and Communication, Communication University of China (CN)
Affordable and clean energy
Openalex Percentile: Top 83%
Speech and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Source Separation of Piano Concertos Using Hybrid LSTM-Transformer Model — Jingyu Liu, Wei He, et al. · (2024) | TGRS Research Map | TGRS