Harmonising code and composition: computational design strategies for multimedia classical concerts

There are growing intersections between classical music performance, its tradition, acoustic fidelity, and advanced computational technologies, creating immersive multimedia concert experiences. We discuss how classical concert design is advanced by integrating real-time audio processing, machine learning models, generative visual engines, and audience interaction frameworks. A modular architecture was developed and tested through two case studies (Beethoven 360° and Bach Rewired), demonstrating two separate use cases of artificial intelligence, real-time rendering, and biofeedback systems. Sensor-based audience input has been used to learn about the adaptive performance elements, and musical structure was mapped to visual output using deep learning models. Results showed that audience immersion increased from an average of 5.4 to 6.8, while system latency was less than 25 ms. The findings suggest that computational multimedia systems might improve the classical concert experience by bringing new ways for emotional expression, structural clarity, or participatory design while maintaining the integrity of the repertoire.

Authors

Institutions

Publication Details

Journal
International Journal of Information and Communication Technology
Published
2025-01-01
DOI
https://doi.org/10.1504/ijict.2025.147528
Primary Topic
Music Technology and Sound Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Harmonising code and composition: computational design strategies for multimedia classical concerts

Shanshan Li
International Journal of Information and Communication Technology
Music Technology and Sound Studies
article

Harmonising code and composition: computational design strategies for multimedia classical concerts

Shanshan Li
article en

Abstract

There are growing intersections between classical music performance, its tradition, acoustic fidelity, and advanced computational technologies, creating immersive multimedia concert experiences. We discuss how classical concert design is advanced by integrating real-time audio processing, machine learning models, generative visual engines, and audience interaction frameworks. A modular architecture was developed and tested through two case studies (Beethoven 360° and Bach Rewired), demonstrating two separate use cases of artificial intelligence, real-time rendering, and biofeedback systems. Sensor-based audience input has been used to learn about the adaptive performance elements, and musical structure was mapped to visual output using deep learning models. Results showed that audience immersion increased from an average of 5.4 to 6.8, while system latency was less than 25 ms. The findings suggest that computational multimedia systems might improve the classical concert experience by bringing new ways for emotional expression, structural clarity, or participatory design while maintaining the integrity of the repertoire.

International Journal of Information and Communication TechnologyVol. 26(27)
Huainan Normal University (CN)
Openalex Percentile: Top 84%
Music Technology and Sound Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.