Cognitive load modulates the effects of emotion and gaze direction on visual-spatial working memory

Background Facial expressions and gaze direction are important factors influencing working memory; however, it remains unclear whether they produce binding effects in Visual-Spatial Working Memory (VSWM). This study aims to investigate the impact of different combinations of facial expression and gaze direction on identity-location binding in VSWM and to examine the modulating role of cognitive load. Methods This study employed two identity-location binding tasks with different cognitive loads: low load (Experiment 1: 2 faces) and high load (Experiment 2: 4 faces). Participants were required to remember the locations of faces sharing the same expression (happy/angry) and gaze direction (direct/averted). Recall was tested via mouse clicks for localization, and eye movements were recorded. Results Under low load (Experiment 1), happy-averted and angry-direct faces were remembered with higher precision (i.e., with lower localization deviation), demonstrating an interaction between expression and gaze direction consistent with the appraisal hypothesis. Under high load (Experiment 2), the processing of expression-gaze combinations was constrained, leaving only a memory advantage for happy faces. Conclusion The binding effect of expression and gaze direction in VSWM is modulated by cognitive load. When cognitive resources are sufficient, individuals engage in elaborate processing based on the behavioral relevance of expression-gaze combinations. When resources are limited, processing shifts from elaborate analysis to a heuristic that prioritizes emotional valence.