Mispronunciation Detection and Diagnosis for Young Arabic Learners Using Transfer Learning
Improving primary school students’ reading skills supports their academic growth and communication abilities. Pronunciation accuracy is central to reading, especially in Arabic, where small diacritic changes can alter meaning. This is complicated by Arabic’s low-resource nature. This study developed a Mispronunciation Detection and Diagnosis (MDD) system for Arabic learners, allowing teachers and learners to use Computer-Assisted Pronunciation Training (CAPT) for improved instruction and assessment. A pretrained self-supervised learning (SSL) model was fine-tuned to detect phoneme-level pronunciation errors in Modern Standard Arabic using a unique dataset of primary school learner speech from Saudi Arabia. The data were structured, preprocessed, normalized, and aligned to phoneme sequences. The system showed improved phoneme recognition and performance approaching that of a human expert with an F1 score of 71.4%.
Authors
- Moustafa Elshafei (ORCID: https://orcid.org/0000-0002-8205-666X)
- A. Khuzaim Alzahrani (ORCID: https://orcid.org/0009-0007-2642-9525)
- Wasfi G. Al-Khatib (ORCID: https://orcid.org/0000-0002-6760-3506)
- Mohammad Ismail Amro (ORCID: https://orcid.org/0009-0007-7624-1491)
- Taha Fanoush (ORCID: https://orcid.org/0009-0009-0783-9005)
Institutions
- King Fahd University of Petroleum and Minerals (SA)
- University of Benghazi (LY)
- Zewail City of Science and Technology (EG)
Publication Details
- Journal
- IEEE Access
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/access.2025.3616335
- Primary Topic
- Speech Recognition and Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.00