The brain dynamics of the congenitally blind seeing faces with sound

Sensory substitution devices (SSDs) involve translation of image to sound, with the aim to equip blind individuals with functions traditionally considered “visual”, like face detection. Previous work showed that image-to-sound SSDs recruit cortices specialised for visual functions. However, the brain dynamics of these activations, and thus, of SSD-supported perception, remain unknown. Visual cortices specialized for specific categories might be the first locus (or one of the loci) of perception of SSDmediated objects. Alternatively, the activation of those cortices may be a byproduct of perceptual processes unfurling first in auditory cortices. Resolving this uncertainty is critical for understanding to what extent the blind truly “see” via SSDs. Analyzing with electrical neuroimaging the EEG data from congenitally blind adults, we show for the first time that inferotemporal visual cortices are some of the earliest sites of face mediated by SSDs. These activations onset at ˜450ms, i.e., within the first 1/3 of the sweep through the 1,500ms face soundscapes. No earlier effects were detected, including with univariate methods. Interpreted together with subjective reports of blind SSD users, our results suggest to be the evidence that the blind can “see” with SSDs. Control analyses showing the specificity of these effects are presented. By identifying the temporal dynamics of SSD perception, our findings offer new support for the hypothesis that brain cortices are characterised by task-contingent functional organisation

Authors

Publication Details

Journal
ArODES (HES-SO (https://www.hes-so.ch/))
Published
2026-02-25
Primary Topic
Tactile and Sensory Interactions
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The brain dynamics of the congenitally blind seeing faces with sound

Ella Striem-Amit, David A. Tovar, Louise A. Stolz, Elena Aggius-Vella et al.
ArODES (HES-SO (https://www.hes-so.ch/))
Tactile and Sensory Interactions
article

The brain dynamics of the congenitally blind seeing faces with sound

Ella Striem-Amit, David A. Tovar, Louise A. Stolz, Elena Aggius-Vella, Paweł J. Matusz, Lior Reich, Chrysa Retsa, Amir Amedi
article en

Abstract

Sensory substitution devices (SSDs) involve translation of image to sound, with the aim to equip blind individuals with functions traditionally considered “visual”, like face detection. Previous work showed that image-to-sound SSDs recruit cortices specialised for visual functions. However, the brain dynamics of these activations, and thus, of SSD-supported perception, remain unknown. Visual cortices specialized for specific categories might be the first locus (or one of the loci) of perception of SSDmediated objects. Alternatively, the activation of those cortices may be a byproduct of perceptual processes unfurling first in auditory cortices. Resolving this uncertainty is critical for understanding to what extent the blind truly “see” via SSDs. Analyzing with electrical neuroimaging the EEG data from congenitally blind adults, we show for the first time that inferotemporal visual cortices are some of the earliest sites of face mediated by SSDs. These activations onset at ˜450ms, i.e., within the first 1/3 of the sweep through the 1,500ms face soundscapes. No earlier effects were detected, including with univariate methods. Interpreted together with subjective reports of blind SSD users, our results suggest to be the evidence that the blind can “see” with SSDs. Control analyses showing the specificity of these effects are presented. By identifying the temporal dynamics of SSD perception, our findings offer new support for the hypothesis that brain cortices are characterised by task-contingent functional organisation

ArODES (HES-SO (https://www.hes-so.ch/))
Openalex Percentile: Top 42%
Tactile and Sensory Interactions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.