Neural audio instruments: epistemological and phenomenological perspectives on musical embodiment of deep learning

Neural Audio is a category of deep learning pipelines which output audio signals directly, in real-time scenarios of action-sound interactions. In this work, we examine how neural audio-based artificial intelligence, when embedded in digital musical instruments (DMIs), shapes embodied musical interaction. While DMIs have long struggled to match the physical immediacy of acoustic instruments, neural audio methods can magnify this challenge, requiring data collection, model training and deep theoretical knowledge that appear to push musicians toward symbolic or conceptual modes of engagement. Paradoxically, these same methods can also foster more embodied practices, by introducing opaque yet expressive behaviors that free performers from rigid technical models and encourage discovery through tactile, real-time experimentation. Drawing on established perspectives in DMI embodiment literature, as well as emerging neural-audio-focused efforts within the community, we highlight two seemingly conflicting aspects of these instruments: on one side, they inherit many “disembodying” traits known from DMIs; on the other, they open pathways reminiscent of acoustic phenomenology and soma, potentially restoring the close physical interplay often missed in digital performance.

Authors

Institutions

Publication Details

Journal
Frontiers in Computer Science
Published
2025-08-20
DOI
https://doi.org/10.3389/fcomp.2025.1575168
Citations
1
Primary Topic
Music Technology and Sound Studies
Type
article
Field-Weighted Citation Impact
1.28

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Neural audio instruments: epistemological and phenomenological perspectives on musical embodiment of deep learning

Victor Zappi, Kıvanç Tatar
1 citations
Frontiers in Computer Science
Music Technology and Sound Studies
1.28
article

Neural audio instruments: epistemological and phenomenological perspectives on musical embodiment of deep learning

Victor Zappi, Kıvanç Tatar
article en
1 citations

Abstract

Neural Audio is a category of deep learning pipelines which output audio signals directly, in real-time scenarios of action-sound interactions. In this work, we examine how neural audio-based artificial intelligence, when embedded in digital musical instruments (DMIs), shapes embodied musical interaction. While DMIs have long struggled to match the physical immediacy of acoustic instruments, neural audio methods can magnify this challenge, requiring data collection, model training and deep theoretical knowledge that appear to push musicians toward symbolic or conceptual modes of engagement. Paradoxically, these same methods can also foster more embodied practices, by introducing opaque yet expressive behaviors that free performers from rigid technical models and encourage discovery through tactile, real-time experimentation. Drawing on established perspectives in DMI embodiment literature, as well as emerging neural-audio-focused efforts within the community, we highlight two seemingly conflicting aspects of these instruments: on one side, they inherit many “disembodying” traits known from DMIs; on the other, they open pathways reminiscent of acoustic phenomenology and soma, potentially restoring the close physical interplay often missed in digital performance.

Frontiers in Computer ScienceVol. 7
Northeastern University (US), Chalmers University of Technology (SE)
Marcus och Amalia Wallenbergs minnesfond
Openalex Percentile: Top 17%
Music Technology and Sound Studies
1.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Neural audio instruments: epistemological and phenomenological perspectives on musical embodiment of deep learning — Victor Zappi, Kıvanç Tatar · Frontiers in Computer Science (2025) | TGRS Research Map | TGRS