Enhancing Conversational AI for Low-Resource Languages: A Case Study on Somali

Conversational AI has made huge strides in understanding and generating human language. However, these advances have mostly benefited high-resource languages such as English and Spanish. In contrast, languages like Somali— spoken by an estimated 20 million people—lack the abundance of annotated data needed to develop robust language models. This study focuses on practical strategies to boost Somali text and speech processing capabilities. We explore three core approaches: (1) transfer learning, (2) synthetic data augmentation, and (3) fine-tuning multilingual models. Our experiments, featuring XLM-R, mBERT, and OpenAI’s Whisper API, show that well-adapted models significantly outperform their baseline counterparts in Somali text translation and speech-to-text tasks. Beyond the numbers, our findings underscore the societal value of creating accessible AI tools for underrepresented linguistic communities, providing a template for extending these methods to other low-resource languages.

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-02-22
DOI
https://doi.org/10.5281/zenodo.14908879
Primary Topic
ICT in Developing Communities
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Conversational AI for Low-Resource Languages: A Case Study on Somali

Zenodo (CERN European Organization for Nuclear Research)
ICT in Developing Communities
article

Enhancing Conversational AI for Low-Resource Languages: A Case Study on Somali

article en

Abstract

Conversational AI has made huge strides in understanding and generating human language. However, these advances have mostly benefited high-resource languages such as English and Spanish. In contrast, languages like Somali— spoken by an estimated 20 million people—lack the abundance of annotated data needed to develop robust language models. This study focuses on practical strategies to boost Somali text and speech processing capabilities. We explore three core approaches: (1) transfer learning, (2) synthetic data augmentation, and (3) fine-tuning multilingual models. Our experiments, featuring XLM-R, mBERT, and OpenAI’s Whisper API, show that well-adapted models significantly outperform their baseline counterparts in Somali text translation and speech-to-text tasks. Beyond the numbers, our findings underscore the societal value of creating accessible AI tools for underrepresented linguistic communities, providing a template for extending these methods to other low-resource languages.

Zenodo (CERN European Organization for Nuclear Research)
Quality Education
Openalex Percentile: Top 44%
ICT in Developing Communities
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.