Sentiment Analysis on WeTV Application Reviews Using Naïve Bayes: A Study of Preprocessing, Balancing, and Model Performance

This study investigates the application of the Naïve Bayes classification algorithm for sentiment analysis of user-generated reviews on the WeTV application available on the Google Play Store. A structured methodology was employed, consisting of data scraping, sentiment labeling based on heuristics, multi-stage preprocessing, class balancing using Synthetic Minority Over-sampling Technique (SMOTE), and performance evaluation through standard metrics. Prior to balancing, the model exhibited strong performance on the dominant class but underperformed on the minority class. The introduction of SMOTE led to improved F1-scores, particularly for positive sentiment, increasing from 61% to 64%, while maintaining overall accuracy around 71%. These findings confirm that Naïve Bayes, when supported by effective preprocessing and data balancing, can deliver robust and interpretable classification results in text mining tasks. This research contributes to the growing literature on machine learning for opinion mining and provides practical implications for developers aiming to extract structured insights from large-scale user reviews.

Authors

Institutions

Publication Details

Journal
JUSIFO (JURNAL SISTEM INFORMASI)
Published
2025-06-30
DOI
https://doi.org/10.19109/jusifo.v11i1.27925
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Sentiment Analysis on WeTV Application Reviews Using Naïve Bayes: A Study of Preprocessing, Balancing, and Model Performance

Siti Nuraini, Maya Rini Handayani, Khothibul Umam, Wilis Brawijaya
JUSIFO (JURNAL SISTEM INFORMASI)
Sentiment Analysis and Opinion Mining
article

Sentiment Analysis on WeTV Application Reviews Using Naïve Bayes: A Study of Preprocessing, Balancing, and Model Performance

Siti Nuraini, Maya Rini Handayani, Khothibul Umam, Wilis Brawijaya
article en

Abstract

This study investigates the application of the Naïve Bayes classification algorithm for sentiment analysis of user-generated reviews on the WeTV application available on the Google Play Store. A structured methodology was employed, consisting of data scraping, sentiment labeling based on heuristics, multi-stage preprocessing, class balancing using Synthetic Minority Over-sampling Technique (SMOTE), and performance evaluation through standard metrics. Prior to balancing, the model exhibited strong performance on the dominant class but underperformed on the minority class. The introduction of SMOTE led to improved F1-scores, particularly for positive sentiment, increasing from 61% to 64%, while maintaining overall accuracy around 71%. These findings confirm that Naïve Bayes, when supported by effective preprocessing and data balancing, can deliver robust and interpretable classification results in text mining tasks. This research contributes to the growing literature on machine learning for opinion mining and provides practical implications for developers aiming to extract structured insights from large-scale user reviews.

JUSIFO (JURNAL SISTEM INFORMASI)Vol. 11(1)
Walisongo State Islamic University (ID)
Openalex Percentile: Top 91%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Sentiment Analysis on WeTV Application Reviews Using Naïve Bayes: A Study of Preprocessing, Balancing, and Model Performance — Siti Nuraini, Maya Rini Handayani, et al. · JUSIFO (JURNAL SISTEM INFORMASI) (2025) | TGRS Research Map | TGRS