Real-time brain-controlled selective hearing enhances speech perception in multi-talker environments
Understanding speech in noisy environments is difficult for many people, and current hearing aids often fail because they amplify all sounds rather than the talker of interest. Auditory attention decoding (AAD) offers a potential solution by using the listener's brain signals to identify and enhance the attended speaker, but it has been unclear whether this can provide real-time perceptual benefits. Here we used high-resolution intracranial electroencephalography in patients undergoing neurosurgical procedures to implement a closed-loop system that achieves the decoding fidelity necessary to dynamically amplify the attended talker. Across multiple experiments, the system improved speech intelligibility, reduced listening effort and was consistently preferred by subjects. It also tracked both instructed and self-initiated attention shifts. By providing direct evidence that a real-time, brain-controlled hearing system can enhance perception, this work establishes a key performance benchmark for future auditory brain-computer interfaces and advances AAD from a theoretical concept to a validated solution for personalized assistive hearing.
Authors
- Stephan Bickel (ORCID: https://orcid.org/0000-0001-5265-2447)
- Nima Mesgarani (ORCID: https://orcid.org/0000-0002-2987-759X)
- Vishal Choudhari (ORCID: https://orcid.org/0009-0000-5486-5913)
- Maximilian Nentwich (ORCID: https://orcid.org/0000-0002-9306-7591)
- Adeen Flinker (ORCID: https://orcid.org/0000-0003-1247-1283)
- Sarah Johnson (ORCID: https://orcid.org/0000-0001-8848-9135)
- Ashesh D. Mehta (ORCID: https://orcid.org/0000-0001-7293-1101)
- Edward F. Chang (ORCID: https://orcid.org/0000-0003-2480-4700)
- Jose L. Herrero (ORCID: https://orcid.org/0000-0001-5969-9678)
- Daniel Friedman (ORCID: https://orcid.org/0000-0003-1068-1797)
Institutions
- Feinstein Institute for Medical Research (US)
- Hofstra University (US)
- University of California, San Francisco (US)
- MIND Research Institute (US)
- Neurological Surgery (US)
- New York University (US)
- Columbia University (US)
Publication Details
- Journal
- Nature Neuroscience
- Published
- 2026-05-11
- DOI
- https://doi.org/10.1038/s41593-026-02281-5
- Primary Topic
- EEG and Brain-Computer Interfaces
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Institutes of Health
- National Institute on Deafness and Other Communication Disorders