Research on Mongolian Speech Recognition Based on the Self-supervised Model

As an important branch of artificial intelligence application, speech recognition is becoming more and more widely used in daily life. In the field of speech recognition of Mongolian language, its unique language structure and pronunciation system have brought new challenges to the development of speech recognition technology. As the self-supervised speech representation model is pre-trained using only audio data, without paired text labels, it achieves excellent performance on a variety of downstream tasks. This paper details the structure and working principle of the Mockingjay model and why it is suitable to handle the problem of Mongolian speech recognition. In order to improve the performance and robustness of the model, we propose a speech processing method of Mockingjay model for features extraction of Mongolian speech data and fuse it with MFCC (Mel frequency inversion coefficient). Finally, the effectiveness of the proposed method is verified by entally.

Authors

Publication Details

Published
2024-08-04
DOI
https://doi.org/10.1109/ialp63756.2024.10661157
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Mongolian Speech Recognition Based on the Self-supervised Model

Hong-Yi Su, Yu Xue
Speech Recognition and Synthesis
article

Research on Mongolian Speech Recognition Based on the Self-supervised Model

Hong-Yi Su, Yu Xue
article en

Abstract

As an important branch of artificial intelligence application, speech recognition is becoming more and more widely used in daily life. In the field of speech recognition of Mongolian language, its unique language structure and pronunciation system have brought new challenges to the development of speech recognition technology. As the self-supervised speech representation model is pre-trained using only audio data, without paired text labels, it achieves excellent performance on a variety of downstream tasks. This paper details the structure and working principle of the Mockingjay model and why it is suitable to handle the problem of Mongolian speech recognition. In order to improve the performance and robustness of the model, we propose a speech processing method of Mockingjay model for features extraction of Mongolian speech data and fuse it with MFCC (Mel frequency inversion coefficient). Finally, the effectiveness of the proposed method is verified by entally.

Innovation Fund
Openalex Percentile: Top 87%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.