Spectral peak picking improves tactile speech perception

Individual differences in speech perception often arise from disparities in access to acoustic-phonetic cues, particularly among those with hearing loss. Haptic hearing aids, which convey speech information through the sense of touch, offer a complementary pathway to improve speech understanding. However, effectively transmitting critical speech features through vibrotactile stimulation remains challenging.To address this challenge, we introduce a tactile spectral peak picking (tSPP) approach, integrated into a vocoder-based audio-to-tactile conversion algorithm to enhance vibrotactile phoneme discrimination. The tactile vocoder decomposes audio into eight frequency bands, with tSPP selectively transmitting only the most energetic bands to emphasise dominant spectral features.Tactile phoneme discrimination on the wrist was tested in 26 participants using either the tactile vocoder alone or with the tSPP algorithm selecting one, two, or four peaks. Discrimination improved significantly when one, two, or four peaks were selected relative to the vocoder alone, with the greatest benefits observed for one- and two-peak tSPP (average improvement: 7.5%).These findings demonstrate that selective enhancement of spectrally salient features can improve tactile speech perception. The algorithm is suitable for real-time use in wearable sensory substitution devices and could aid the development of effective haptic hearing aids.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2025-11-24
DOI
https://doi.org/10.1038/s41598-025-28930-6
Primary Topic
Tactile and Sensory Interactions
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Spectral peak picking improves tactile speech perception

Carl Verschuur, M. Fletcher, Esma Akış
Scientific Reports
Tactile and Sensory Interactions
article

Spectral peak picking improves tactile speech perception

Carl Verschuur, M. Fletcher, Esma Akış
article en

Abstract

Individual differences in speech perception often arise from disparities in access to acoustic-phonetic cues, particularly among those with hearing loss. Haptic hearing aids, which convey speech information through the sense of touch, offer a complementary pathway to improve speech understanding. However, effectively transmitting critical speech features through vibrotactile stimulation remains challenging.To address this challenge, we introduce a tactile spectral peak picking (tSPP) approach, integrated into a vocoder-based audio-to-tactile conversion algorithm to enhance vibrotactile phoneme discrimination. The tactile vocoder decomposes audio into eight frequency bands, with tSPP selectively transmitting only the most energetic bands to emphasise dominant spectral features.Tactile phoneme discrimination on the wrist was tested in 26 participants using either the tactile vocoder alone or with the tSPP algorithm selecting one, two, or four peaks. Discrimination improved significantly when one, two, or four peaks were selected relative to the vocoder alone, with the greatest benefits observed for one- and two-peak tSPP (average improvement: 7.5%).These findings demonstrate that selective enhancement of spectrally salient features can improve tactile speech perception. The algorithm is suitable for real-time use in wearable sensory substitution devices and could aid the development of effective haptic hearing aids.

Scientific ReportsVol. 15(1)
University of Southampton (GB)
Openalex Percentile: Top 64%
Tactile and Sensory Interactions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.