Comparison of Sentiment Analysis Models Enhanced by Naïve Bayes and Support Vector Machine Algorithms on Mobile Banking BRImo Reviews

This study compares the effectiveness of the Support Vector Machine (SVM) and Naïve Bayes algorithms in classifying user sentiment regarding the BRImo application. User reviews were obtained from the Google Play Store platform and underwent a text preprocessing stage to clean and prepare the data. Subsequently, the SVM and Naïve Bayes algorithms were applied for sentiment analysis, using evaluation metrics such as accuracy, precision, recall, and F1-score. The results show that SVM achieved a training accuracy of 95.67% and a testing accuracy of 83.11%, with its best performance on positive sentiment (precision 92.26%, recall 91.79%, F1-score 92.02%) and moderate performance on negative sentiment (precision 62.81%, recall 62.81%, F1-score 62.81%). Meanwhile, Naïve Bayes recorded a training accuracy of 95.23% and a testing accuracy of 82.77%, with its highest performance on positive sentiment (precision 90.12%, recall 93.38%, F1-score 91.72%) but lower performance on negative sentiment (precision 65.07%, recall 60.06%, F1-score 62.46%). In terms of sentiment distribution, SVM was more effective in handling sentiment variations, particularly in detecting negative and neutral sentiments. These findings indicate that SVM outperforms Naïve Bayes in sentiment analysis of user reviews for the BRImo application.

Authors

Institutions

Publication Details

Journal
Journal of Artificial Intelligence and Engineering Applications (JAIEA)
Published
2025-02-15
DOI
https://doi.org/10.59934/jaiea.v4i2.732
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparison of Sentiment Analysis Models Enhanced by Naïve Bayes and Support Vector Machine Algorithms on Mobile Banking BRImo Reviews

Martanto Martanto, Ahmad Rifa'i, Mohamad Ramadan, Arif Rinaldi Dikananda
Journal of Artificial Intelligence and Engineering Applications (JAIEA)
Sentiment Analysis and Opinion Mining
article

Comparison of Sentiment Analysis Models Enhanced by Naïve Bayes and Support Vector Machine Algorithms on Mobile Banking BRImo Reviews

Martanto Martanto, Ahmad Rifa'i, Mohamad Ramadan, Arif Rinaldi Dikananda
article en

Abstract

This study compares the effectiveness of the Support Vector Machine (SVM) and Naïve Bayes algorithms in classifying user sentiment regarding the BRImo application. User reviews were obtained from the Google Play Store platform and underwent a text preprocessing stage to clean and prepare the data. Subsequently, the SVM and Naïve Bayes algorithms were applied for sentiment analysis, using evaluation metrics such as accuracy, precision, recall, and F1-score. The results show that SVM achieved a training accuracy of 95.67% and a testing accuracy of 83.11%, with its best performance on positive sentiment (precision 92.26%, recall 91.79%, F1-score 92.02%) and moderate performance on negative sentiment (precision 62.81%, recall 62.81%, F1-score 62.81%). Meanwhile, Naïve Bayes recorded a training accuracy of 95.23% and a testing accuracy of 82.77%, with its highest performance on positive sentiment (precision 90.12%, recall 93.38%, F1-score 91.72%) but lower performance on negative sentiment (precision 65.07%, recall 60.06%, F1-score 62.46%). In terms of sentiment distribution, SVM was more effective in handling sentiment variations, particularly in detecting negative and neutral sentiments. These findings indicate that SVM outperforms Naïve Bayes in sentiment analysis of user reviews for the BRImo application.

Journal of Artificial Intelligence and Engineering Applications (JAIEA)Vol. 4(2)
Institute of Biology of Komi Scientific Centre (RU)
Openalex Percentile: Top 99%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.