Integration of memory and sensory information in skilled sequence production

Sequential movements rely on two information sources: external sensory cues and internal memory representations. Although often both sources jointly drive sequential behavior, previous research has primarily examined them in isolation. To address this, we trained participants (n = 26, 15F) to perform sequences of rapid finger presses in response to numerical cues. Sensory influence was measured by varying the number of visible cues, and memory influence was determined by comparing repeating and random sequences. Early in learning, participants integrated sensory and memory information: repeating sequences were performed more quickly when more cues were visible. After learning, when repeating sequences were predictable with certainty, participants relied solely on memory and ignored sensory cues. However, when this certainty was manipulated by introducing occasional violations within repeating sequences, participants reverted to integrating memory with sensory cues. We propose a computational model that successfully predicted both speed and accuracy of individual presses. Critically, this model relied on the assumption that multiple movements are planned independently of each other. This independence assumption was then validated by examining response patterns to isolated violations in repeating sequences. Finally, we provide evidence into how sequence memories can be flexibly deactivated and reactivated in response to these violations. Together, these results reveal how brain dynamically integrates sensory and memory information to produce sequences of movements.<b>Significance Statement</b> How the brain coordinates sequential movements is fundamental in understanding human motor control. Previous research has studied sensory-driven and memory-driven modes of sequence production in isolation, characterizing learning as a switch from one to the other. In this study, using a sequential finger-pressing task, we show that memory and sensory information jointly drive sequence production. We found that unless sequences were fully predictable, participants integrated sensory information with their memory to achieve faster and more accurate performance. These findings highlight the importance of understanding the mechanisms that underlie sensory and memory integration in sequence production.