Harmonising code and composition: computational design strategies for multimedia classical concerts
There are growing intersections between classical music performance, its tradition, acoustic fidelity, and advanced computational technologies, creating immersive multimedia concert experiences. We discuss how classical concert design is advanced by integrating real-time audio processing, machine learning models, generative visual engines, and audience interaction frameworks. A modular architecture was developed and tested through two case studies (Beethoven 360° and Bach Rewired), demonstrating two separate use cases of artificial intelligence, real-time rendering, and biofeedback systems. Sensor-based audience input has been used to learn about the adaptive performance elements, and musical structure was mapped to visual output using deep learning models. Results showed that audience immersion increased from an average of 5.4 to 6.8, while system latency was less than 25 ms. The findings suggest that computational multimedia systems might improve the classical concert experience by bringing new ways for emotional expression, structural clarity, or participatory design while maintaining the integrity of the repertoire.
Authors
- Shanshan Li (ORCID: https://orcid.org/0000-0003-0798-974X)
Institutions
- Huainan Normal University (CN)
Publication Details
- Journal
- International Journal of Information and Communication Technology
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1504/ijict.2025.147528
- Primary Topic
- Music Technology and Sound Studies
- Type
- article
- Field-Weighted Citation Impact
- 0.00