Mapping codependency: Intermedial causality in real-time audiovisual performance

Abstract This paper examines how multimodal mapping can function as a collaborative methodology in real-time audiovisual performance. It explores how functional codependency and real-time risk create bonds between artists, becoming fundamental narrative and dramaturgical vectors, and revealing the aesthetic influence of the technological systems shaping contemporary practice. Building on technical research into connectivity and latency, we examine the compositional affordances of those systems and how they shape the experience of performers and audiences. We treat telematic performance as an enabling condition for intermediality and develop our argument through two real-time performances built on a recursive mapping process. The first focused on capturing and transforming gestural data from a violin bow into a robotic system for painting calligraphy within a general constraint of telematic data transfer; the second constructed a longer chain of causality between kinetic sculpture, machine vision, generative music and video mapping. We detail a four-stage multimodal mapping methodology and reflect on how performers and audiences perceive chains of dependency in real-time systems, on the broader apophenic tendency to interpret causation and intention in complex systems, and on what this implies for a reconsideration of post-media aesthetics.

Authors

Institutions

Publication Details

Journal
Organised Sound
Published
2026-09-30
DOI
https://doi.org/10.1017/s1355771826101617
Primary Topic
Music Technology and Sound Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Mapping codependency: Intermedial causality in real-time audiovisual performance

Roberto Alonso Trillo, Kratika Jain, Peter A. C. Nelson
Organised Sound
Music Technology and Sound Studies
article

Mapping codependency: Intermedial causality in real-time audiovisual performance

Roberto Alonso Trillo, Kratika Jain, Peter A. C. Nelson
article en

Abstract

Abstract This paper examines how multimodal mapping can function as a collaborative methodology in real-time audiovisual performance. It explores how functional codependency and real-time risk create bonds between artists, becoming fundamental narrative and dramaturgical vectors, and revealing the aesthetic influence of the technological systems shaping contemporary practice. Building on technical research into connectivity and latency, we examine the compositional affordances of those systems and how they shape the experience of performers and audiences. We treat telematic performance as an enabling condition for intermediality and develop our argument through two real-time performances built on a recursive mapping process. The first focused on capturing and transforming gestural data from a violin bow into a robotic system for painting calligraphy within a general constraint of telematic data transfer; the second constructed a longer chain of causality between kinetic sculpture, machine vision, generative music and video mapping. We detail a four-stage multimodal mapping methodology and reflect on how performers and audiences perceive chains of dependency in real-time systems, on the broader apophenic tendency to interpret causation and intention in complex systems, and on what this implies for a reconsideration of post-media aesthetics.

Organised Sound
Hong Kong Baptist University (HK), Indian Institute of Technology Kanpur (IN)
Sustainable cities and communities
Openalex Percentile: Top 14%
Music Technology and Sound Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Mapping codependency: Intermedial causality in real-time audiovisual performance — Roberto Alonso Trillo, Kratika Jain, et al. · Organised Sound (2026) | TGRS Research Map | TGRS