Comparative Study on the Efficiency of Using PaLM and\nCAMeLBERT for Arabic Entity Sentiment Classification

Sentiment classification, which is usually employed to categorize emotions in social media text, has been extensively studied for public opinion monitoring. For example, it can be used to examine feedback from customers on online shopping platforms to assess their satisfaction levels. Sentiment classification achieves high accuracy with the English language. In contrast, sentiment classification in Arabic falls behind, mainly due to the intricate nature of Arabic text, which poses difficulties for contemporary machine learning methods. This study evaluates the effectiveness of the Pathways Language Model (PaLM) and CAMeLBERT to show efficiency of large language models in detecting sentiment in Arabic social media. The results indicate that a pre-trained model using the BERT (CAMeLBERT) architecture outperformed PaLM, achieving an accuracy of 63.87% compared to 61.01% with PaLM. These results underscore the ongoing difficulties that modern language models encounter in accurately interpreting the subtleties of Arabic sentiment classification.

Publication Details

Journal
Journal of the Association for Information Systems
Published
2024-11-19
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparative Study on the Efficiency of Using PaLM and\nCAMeLBERT for Arabic Entity Sentiment Classification

Journal of the Association for Information Systems
Sentiment Analysis and Opinion Mining
article

Comparative Study on the Efficiency of Using PaLM and\nCAMeLBERT for Arabic Entity Sentiment Classification

article en

Abstract

Sentiment classification, which is usually employed to categorize emotions in social media text, has been extensively studied for public opinion monitoring. For example, it can be used to examine feedback from customers on online shopping platforms to assess their satisfaction levels. Sentiment classification achieves high accuracy with the English language. In contrast, sentiment classification in Arabic falls behind, mainly due to the intricate nature of Arabic text, which poses difficulties for contemporary machine learning methods. This study evaluates the effectiveness of the Pathways Language Model (PaLM) and CAMeLBERT to show efficiency of large language models in detecting sentiment in Arabic social media. The results indicate that a pre-trained model using the BERT (CAMeLBERT) architecture outperformed PaLM, achieving an accuracy of 63.87% compared to 61.01% with PaLM. These results underscore the ongoing difficulties that modern language models encounter in accurately interpreting the subtleties of Arabic sentiment classification.

Journal of the Association for Information Systems
Quality Education
Openalex Percentile: Top 56%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.