Enhancement of a Multilingual Model for Automatic Speech Recognition Analysis of Time and Frequency Domain Data Augmentation

<p>In recent years, significant progress has been made in automatic speech recognition (ASR) systems, especially for languages with abundant transcribed speech data. However, freely accessible models for low-resource languages, particularly those other than English, are still scarce. This study aims to enhance the performance of the prominent multilingual ASR model, Whisper, through fine-tuning and data augmentation techniques. Comprehensive and systematic experiments are conducted on time, frequency and time-frequency domain augmentation strategies across multiple low-resource languages (German, Farsi, Arabic, Russian) to investigate whether these techniques could improve ASR performance in low-resource settings.</p>

Authors

Publication Details

Journal
Journal of Artificial Intelligence Machine Learning and Data Science
Published
2024-10-14
DOI
https://doi.org/10.51219/jaimld/amin-jaber/313
Citations
1
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancement of a Multilingual Model for Automatic Speech Recognition Analysis of Time and Frequency Domain Data Augmentation

Amin Jaber, Sebastian Möller, Razieh Khamsehashari
1 citations
Journal of Artificial Intelligence Machine Learning and Data Science
Speech Recognition and Synthesis
0.35
article

Enhancement of a Multilingual Model for Automatic Speech Recognition Analysis of Time and Frequency Domain Data Augmentation

Amin Jaber, Sebastian Möller, Razieh Khamsehashari
article en
1 citations

Abstract

<p>In recent years, significant progress has been made in automatic speech recognition (ASR) systems, especially for languages with abundant transcribed speech data. However, freely accessible models for low-resource languages, particularly those other than English, are still scarce. This study aims to enhance the performance of the prominent multilingual ASR model, Whisper, through fine-tuning and data augmentation techniques. Comprehensive and systematic experiments are conducted on time, frequency and time-frequency domain augmentation strategies across multiple low-resource languages (German, Farsi, Arabic, Russian) to investigate whether these techniques could improve ASR performance in low-resource settings.</p>

Journal of Artificial Intelligence Machine Learning and Data ScienceVol. 2(4)
Openalex Percentile: Top 32%
Speech Recognition and Synthesis
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.