Supporting Narrative Comprehension in Programmatic Music through Music and Light

Programmatic music, such as Tchaikovsky's Overture Romeo and Juliet, relies on the audience's ability to associate musical motifs with narrative elements. This is a demanding task for less experienced listeners, particularly when cues are subtle, such as those conveyed through timbre. This paper explores how dynamic stage lighting, driven by physiological signals, can enhance narrative comprehension in orchestral performance. Using the LightHearted interactive lighting system, the live heart rates of the conductor and select musicians were mapped to the intensity of colored lights, with specific hues representing key characters. This integration of aimed to communicate subtle narrative cues to the audience in real time. Audience feedback suggests that this approach not only clarifies musical narratives but also enhances the overall experience.