Reconstruction of Imagined Melody with Relative Pitch Decoding in Electrocorticography

Music imagery involves internally generated auditory experiences, yet decoding imagined melodic content from neural activity remains challenging. Here, we examined whether imagined melodies can be decoded from human electrocorticography (ECoG) recordings using a relative pitch framework. Ten epilepsy patients performed a music imagery task involving familiar melodies presented in multiple tonalities (3 males and 7 females; mean age, 27.3 ± 4.69 years). Neural features from imagery-responsive cortical sites were used to train intra-subject models to decode relative pitch classes at the single-note level. Although single-note decoding accuracy was modest, it reliably exceeded chance. Sequential integration of decoded pitch classes enabled reconstruction of melodic contours that preserved the relative structure of imagined melodies. These results provide a proof-of-concept that imagined melodic structure can be accessed from intracranial neural recordings when framed in terms of relative pitch, underscoring the importance of sequence-level approaches for decoding internally generated auditory content. Significance Statement Imagining music is a rich internal experience, yet decoding the content of imagined melodies from brain activity remains a major challenge. Most previous studies have focused on detecting music imagery or decoding coarse musical features, rather than reconstructing melodic structure itself. In this study, we demonstrate that imagined melodies can be decoded from human intracranial brain recordings by representing melody in terms of relative pitch, a fundamental principle of musical perception. Although decoding individual imagined notes is difficult, combining note-level predictions over time allows recovery of melodic contours that preserve the structure of imagined songs. These results show that structured internal musical representations can be accessed from neural signals and suggest a principled pathway toward decoding complex imagined auditory content.

Authors

Institutions

Publication Details

Journal
eNeuro
Published
2026-08-03
DOI
https://doi.org/10.1523/eneuro.0289-25.2026
Primary Topic
Neuroscience and Music Perception
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Reconstruction of Imagined Melody with Relative Pitch Decoding in Electrocorticography

June Sic Kim, Jii Kwon, Youmin Shin, Eun Jung Lee et al.
eNeuro
Neuroscience and Music Perception
article

Reconstruction of Imagined Melody with Relative Pitch Decoding in Electrocorticography

June Sic Kim, Jii Kwon, Youmin Shin, Eun Jung Lee, Eunju Jeong, Chun Kee Chung, Sung-Phil Kim
article en

Abstract

Music imagery involves internally generated auditory experiences, yet decoding imagined melodic content from neural activity remains challenging. Here, we examined whether imagined melodies can be decoded from human electrocorticography (ECoG) recordings using a relative pitch framework. Ten epilepsy patients performed a music imagery task involving familiar melodies presented in multiple tonalities (3 males and 7 females; mean age, 27.3 ± 4.69 years). Neural features from imagery-responsive cortical sites were used to train intra-subject models to decode relative pitch classes at the single-note level. Although single-note decoding accuracy was modest, it reliably exceeded chance. Sequential integration of decoded pitch classes enabled reconstruction of melodic contours that preserved the relative structure of imagined melodies. These results provide a proof-of-concept that imagined melodic structure can be accessed from intracranial neural recordings when framed in terms of relative pitch, underscoring the importance of sequence-level approaches for decoding internally generated auditory content. Significance Statement Imagining music is a rich internal experience, yet decoding the content of imagined melodies from brain activity remains a major challenge. Most previous studies have focused on detecting music imagery or decoding coarse musical features, rather than reconstructing melodic structure itself. In this study, we demonstrate that imagined melodies can be decoded from human intracranial brain recordings by representing melody in terms of relative pitch, a fundamental principle of musical perception. Although decoding individual imagined notes is difficult, combining note-level predictions over time allows recovery of melodic contours that preserve the structure of imagined songs. These results show that structured internal musical representations can be accessed from neural signals and suggest a principled pathway toward decoding complex imagined auditory content.

eNeuro
Ewha Womans University (KR), Seoul National University (KR), Seoul National University Hospital (KR), Seoul School of Integrated Sciences and Technologies (KR), National University College (PR), Ulsan National Institute of Science and Technology (KR)
Samsung
Openalex Percentile: Top 8%
Neuroscience and Music Perception
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.