Improving Random Forest Performance for Sentiment Analysis on Unbalanced Data Using SMOTE and BoW Integration: PLN Mobile Application Case Study

Purpose: This research aims to improve the accuracy of sentiment analysis on PLN Mobile app reviews by overcoming the challenge of data imbalance. This goal is important to provide a better understanding of user opinions and support PT PLN (Persero) in improving mobile application services. Methods: This research uses the Random Forest algorithm combined with Synthetic Minority Over-sampling Technique (SMOTE) to handle imbalanced data. Data is collected through web scraping reviews from the Google Play Store, followed by preprocessing processes such as data cleaning, stopword removal, tokenization, and stemming. Feature extraction is performed using the Bag of Words (BoW) method, and the data is tested with four sharing schemes. Result: The results showed that the 90%-10% sharing scheme gave the best performance with an accuracy of 81% and an average precision and recall of 0.79. This finding confirms that the larger the proportion of training data, the better the model performs sentiment classification. Novelty: This research's novelty lies in combining SMOTE with BoW and Random Forest to overcome data imbalance. This approach is a significant reference for future sentiment analysis research. It provides practical insights that PT PLN (Persero) can use to improve the quality of its application services.

Authors

Institutions

Publication Details

Journal
Scientific Journal of Informatics
Published
2025-04-08
DOI
https://doi.org/10.15294/sji.v12i1.19295
Primary Topic
Traffic Prediction and Management Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improving Random Forest Performance for Sentiment Analysis on Unbalanced Data Using SMOTE and BoW Integration: PLN Mobile Application Case Study

Moch Arief Soeleman, Affandy, Pulung Nurtantio Andono, Muhammad Rifqi Fadhlan Rahmatullah
Scientific Journal of Informatics
Traffic Prediction and Management Techniques
article

Improving Random Forest Performance for Sentiment Analysis on Unbalanced Data Using SMOTE and BoW Integration: PLN Mobile Application Case Study

Moch Arief Soeleman, Affandy, Pulung Nurtantio Andono, Muhammad Rifqi Fadhlan Rahmatullah
article en

Abstract

Purpose: This research aims to improve the accuracy of sentiment analysis on PLN Mobile app reviews by overcoming the challenge of data imbalance. This goal is important to provide a better understanding of user opinions and support PT PLN (Persero) in improving mobile application services. Methods: This research uses the Random Forest algorithm combined with Synthetic Minority Over-sampling Technique (SMOTE) to handle imbalanced data. Data is collected through web scraping reviews from the Google Play Store, followed by preprocessing processes such as data cleaning, stopword removal, tokenization, and stemming. Feature extraction is performed using the Bag of Words (BoW) method, and the data is tested with four sharing schemes. Result: The results showed that the 90%-10% sharing scheme gave the best performance with an accuracy of 81% and an average precision and recall of 0.79. This finding confirms that the larger the proportion of training data, the better the model performs sentiment classification. Novelty: This research's novelty lies in combining SMOTE with BoW and Random Forest to overcome data imbalance. This approach is a significant reference for future sentiment analysis research. It provides practical insights that PT PLN (Persero) can use to improve the quality of its application services.

Scientific Journal of InformaticsVol. 12(1)
Universitas Dian Nuswantoro (ID)
Openalex Percentile: Top 94%
Traffic Prediction and Management Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Improving Random Forest Performance for Sentiment Analysis on Unbalanced Data Using SMOTE and BoW Integration: PLN Mobile Application Case Study — Moch Arief Soeleman, Affandy, et al. · Scientific Journal of Informatics (2025) | TGRS Research Map | TGRS