Disentangling Overlapping Sources: Improving Vocal and Violin Source Separation in Carnatic Music

Separating the individual elements in a music mixture is an important tool in computational musicology, allowing for an improved analysis of music repertoires. In the context of Carnatic music, this task remains a challenge given the suboptimal generalization of existing music source separation systems to this style. Although multi-stem Carnatic recordings exist, these are mostly collected from the mixing console in live performances. Therefore, there is an unintended presence of other sources in the background of the audio signal of an individual instrument. Another challenge for Carnatic music is the strong melodic correlation between the singing voice and the violin, two sources widely found in live performances of this repertoire. Existing strategies to address such problems struggle with source quality and only consider vocals. In this work, we propose to incorporate two components in the regular training scheme of a source separation network, namely a learned loss and a mixer model, to account for the source bleeding. We achieve improved separation while extending the separation targets to the violin, an important source in the repertoire, and therefore cover the separation of the most common melodic components in Carnatic Music. Code and models are available in compiam.

Authors

Institutions

Publication Details

Published
2025-04-06
DOI
https://doi.org/10.1109/icasspw65056.2025.11011027
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Disentangling Overlapping Sources: Improving Vocal and Violin Source Separation in Carnatic Music

Xavier Serra, Martín Rocamora, Genís Plaja-Roglans, Anand Shankar et al.
Music and Audio Processing
article

Disentangling Overlapping Sources: Improving Vocal and Violin Source Separation in Carnatic Music

Xavier Serra, Martín Rocamora, Genís Plaja-Roglans, Anand Shankar, Serafin Schweinitz
article en

Abstract

Separating the individual elements in a music mixture is an important tool in computational musicology, allowing for an improved analysis of music repertoires. In the context of Carnatic music, this task remains a challenge given the suboptimal generalization of existing music source separation systems to this style. Although multi-stem Carnatic recordings exist, these are mostly collected from the mixing console in live performances. Therefore, there is an unintended presence of other sources in the background of the audio signal of an individual instrument. Another challenge for Carnatic music is the strong melodic correlation between the singing voice and the violin, two sources widely found in live performances of this repertoire. Existing strategies to address such problems struggle with source quality and only consider vocals. In this work, we propose to incorporate two components in the regular training scheme of a source separation network, namely a learned loss and a mixer model, to account for the source bleeding. We achieve improved separation while extending the separation targets to the violin, an important source in the repertoire, and therefore cover the separation of the most common melodic components in Carnatic Music. Code and models are available in compiam.

Universitat Pompeu Fabra (ES)
Reduced inequalities
Openalex Percentile: Top 87%
Music and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.