Valence–arousal interactions between images and music: differential effects on memorisation, discrimination, and fixations

Prior research has reported differential roles of valence and arousal in guiding memory and attention. However, few studies have systematically examined how these affective dimensions interact across their full spectrum in audiovisual contexts, particularly when multiple images varying in emotional content are simultaneously present. To address this, we used a recognition memory paradigm in which participants viewed arrays of images representing all combinations of positive/negative valence and low/high arousal. Slightly before and during image presentation, music conveying an emotional tone, also varying in valence and arousal, was played. Memory accuracy was assessed in a later recognition phase. We further employed simple eye-tracking measures to explore how visual attention is influenced by image and music valence and arousal. Results revealed that high image arousal increases fixation duration, whilst high music arousal decreases fixation duration. Memorisation likelihood was not influenced by a four-way interaction of image and music valence and arousal, but mainly by an interaction of image valence and arousal, differently depending on music arousal. In high music arousal, all images except low arousal positive images, were memorised regardless of valence. In low arousal music, we observed that memorisation likelihood was mainly driven by high image arousal, but only paired with negative image valence was memorisation significantly higher compared to other image types. Discrimination accuracy was not observed to be influenced by image valence and arousal, but positive high arousal music significantly improved memory discrimination. By systematically manipulating both valence and arousal of images and music, we highlight how the interaction of these unimodal affective qualities can facilitate or hinder memory.