Design and Development of Afan Oromo Speech Recognition and integrating with Dialogue System Using Whisper and RASA
Abstract Automatic Speech Recognition (ASR) for low-resource languages remains a significant challenge due to limited transcribed data and the lack of systematic guidance on model selection. This paper presents the development of an Afan Oromo ASR system using fine-tuned Whisper-small, integrated with a RASA-based conversational agent. We curated a 76.88-hour corpus, implemented persistent dataset splits, applied data augmentation, and developed a robust checkpointing system. The fine-tuned model achieved a Word Error Rate (WER) of 16.88% on the validation set and 17.42% on the held-out test set. We further detail the integration of this model with RASA, creating a complete speech-to-intent pipeline. Our results demonstrate the viability of state-of-the-art ASR for Afan Oromo and provide a practical template for deploying conversational AI in low-resource settings.
Authors
- Adugna Deksiso
- Teklu Urgessa (ORCID: https://orcid.org/0009-0004-5261-6082)
- Worku Jifara (ORCID: https://orcid.org/0000-0001-6658-5142)
Institutions
- Adama Science and Technology University (ET)
Publication Details
- Journal
- Research Square
- Published
- 2026-11-13
- DOI
- https://doi.org/10.21203/rs.3.rs-10010573/v1
- Primary Topic
- Speech Recognition and Synthesis
- Type
- preprint
Funders
- Adama Science and Technology University