Real-Time Musical Collaboration With a Probabilistic Model

This paper describes the development of a system to play an ancient Basque collaborative percussion instrument (the txalaparta) with a human performer. A deep probabilistic model was trained on two large datasets, and transfer learning used to train the model on high-quality data abstracted from txalaparta performances. The aim is to create a system that effectively responds to the human player in a performance environment, where the model's response must feel instantaneous, organic, and sensible in response to the user's input. The paper outlines the design and implementation of the system, including data collection, model training, and performance visualization. The study contributes to the field of interactive music systems and demonstrates the potential of deep learning in creating intelligent musical systems that can collaborate with human performers.

Authors

Institutions

Publication Details

Published
2024-09-18
DOI
https://doi.org/10.1109/cbmi62980.2024.10858876
Primary Topic
Music Technology and Sound Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Real-Time Musical Collaboration With a Probabilistic Model

Thor Magnusson, Enrique Hurtado, Victor Shepardson, Hannes Högni Vilhjálmsson et al.
Music Technology and Sound Studies
article

Real-Time Musical Collaboration With a Probabilistic Model

Thor Magnusson, Enrique Hurtado, Victor Shepardson, Hannes Högni Vilhjálmsson, Karl Johannsson
article en

Abstract

This paper describes the development of a system to play an ancient Basque collaborative percussion instrument (the txalaparta) with a human performer. A deep probabilistic model was trained on two large datasets, and transfer learning used to train the model on high-quality data abstracted from txalaparta performances. The aim is to create a system that effectively responds to the human player in a performance environment, where the model's response must feel instantaneous, organic, and sensible in response to the user's input. The paper outlines the design and implementation of the system, including data collection, model training, and performance visualization. The study contributes to the field of interactive music systems and demonstrates the potential of deep learning in creating intelligent musical systems that can collaborate with human performers.

Reykjavík University (IS), University of Iceland (IS), University of the Basque Country (ES)
Openalex Percentile: Top 73%
Music Technology and Sound Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Real-Time Musical Collaboration With a Probabilistic Model — Thor Magnusson, Enrique Hurtado, et al. · (2024) | TGRS Research Map | TGRS