Using Automatic Speech Recognition for Speech Comprehension Evaluation in the Cochlear Implant

The cochlear implant (CI) is a sophisticated electronic device designed to partially restore hearing for individuals with severe-to-profound hearing loss. To assess speech intelligibility in CI listening, traditional objective evaluation methods obtain scores from psychoacoustic weights across frequency bands but do not account for auditory processing in speech comprehension. In this paper, we propose a novel objective evaluation approach for the CI using Whisper, an automatic speech recognition (ASR) system. Speech comprehension is estimated by assessing the word error rate (WER) and character error rate (CER). The proposed measure is used to evaluate CI simulation speech processed using the common Advanced Combination Encoder (ACE) strategy and the deep-learning based ElectrodeNet-CS strategy. The experimental results demonstrate the feasibility of using ASR technology for evaluating CI speech perception, eliminating the need for original clean speech. This innovative study proposes a unique AI-based alternative for objective evaluation and offers new insights into estimating CI speech comprehension.

Authors

Institutions

Publication Details

Published
2024-10-17
DOI
https://doi.org/10.1109/o-cocosda64382.2024.10800249
Citations
1
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Using Automatic Speech Recognition for Speech Comprehension Evaluation in the Cochlear Implant

Enoch Hsin-Ho Huang, Hsin-Li Chang, Yu Tsao, Yi‐Ching Wang
1 citations
Speech and Audio Processing
0.35
article

Using Automatic Speech Recognition for Speech Comprehension Evaluation in the Cochlear Implant

Enoch Hsin-Ho Huang, Hsin-Li Chang, Yu Tsao, Yi‐Ching Wang
article en
1 citations

Abstract

The cochlear implant (CI) is a sophisticated electronic device designed to partially restore hearing for individuals with severe-to-profound hearing loss. To assess speech intelligibility in CI listening, traditional objective evaluation methods obtain scores from psychoacoustic weights across frequency bands but do not account for auditory processing in speech comprehension. In this paper, we propose a novel objective evaluation approach for the CI using Whisper, an automatic speech recognition (ASR) system. Speech comprehension is estimated by assessing the word error rate (WER) and character error rate (CER). The proposed measure is used to evaluate CI simulation speech processed using the common Advanced Combination Encoder (ACE) strategy and the deep-learning based ElectrodeNet-CS strategy. The experimental results demonstrate the feasibility of using ASR technology for evaluating CI speech perception, eliminating the need for original clean speech. This innovative study proposes a unique AI-based alternative for objective evaluation and offers new insights into estimating CI speech comprehension.

Research Center for Information Technology Innovation, Academia Sinica (TW), Chunghwa Telecom (Taiwan) (TW)
Gender equality
Openalex Percentile: Top 40%
Speech and Audio Processing
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.