Steering a Standard Arab Language Processing Model Towards Accurate Saudi Dialect Sentiment Analysis Using Generative AI
Sentiment analysis (SA) is crucial for many NLP applications across various domains. While Arabic is one of the world’s major languages, high-quality NLP models developed for standard Arabic often underperform on regional dialects like the Saudi Dialect (SD) due to a lack of SD-specific training data. This paper presents a novel approach to adapting a high-resource language model, AraBERT, for low-resource dialect sentiment analysis by combining minimal SD data collection with generative AI. In the absence of openly accessible SD datasets, we augmented a small amount of collected SD data with GPT-generated SD data to fine-tune AraBERT for sentiment analysis in SD. Our contributions include (1) demonstrating the feasibility of low-effort data collection of a low-resource dialect for adapting existing high-resource NLP models and (2) leveraging GPT-generated data to augment collected data to enhance a high-resource language model for sentiment classification in a low-resource dialect, achieving significant improvements over the pre-trained high-resource model. These two contributions imply a potentially replicable approach that can serve as a template for future research in other low-resource NLP tasks. This paper presents a promising solution for enhancing model performance in low-resource dialects and has implications for similar under-resourced languages.
Authors
- Ahmad O. Aseeri (ORCID: https://orcid.org/0000-0001-9863-4551)
- Sulaiman Aftan (ORCID: https://orcid.org/0000-0003-2093-9894)
- Habib Shah (ORCID: https://orcid.org/0000-0003-2078-6285)
- Yu Zhuang (ORCID: https://orcid.org/0000-0001-7013-0722)
Institutions
- Texas Tech University (US)
- Prince Sattam Bin Abdulaziz University (SA)
- King Khalid University (SA)
Publication Details
- Published
- 2024-12-15
- DOI
- https://doi.org/10.1109/bigdata62323.2024.10825944
- Citations
- 1
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.35
Funders
- National Science Foundation