Sentiment Classification of Indonesian-Language Roblox Reviews Using IndoBERT with SMOTE Optimization

Roblox is a community-based gaming platform that is extremely popular among users of various age groups. Millions of user reviews available on the platform contain valuable information regarding user satisfaction, expectations, and criticisms of the gameplay experience. To extract insights from these reviews, a reliable natural language processing (NLP) approach tailored to the local language context is essential. This study aims to classify sentiments in Indonesian-language user reviews of Roblox into three categories: positive, negative, and neutral. The model used is IndoBERT, a transformer-based model specifically trained to understand the structure and vocabulary of the Indonesian language. One of the main challenges in this study is the imbalance in the number of data points across sentiment classes. To address this, the SMOTE (Synthetic Minority Over-sampling Technique) method is applied to strengthen the representation of minority classes. The dataset consists of thousands of reviews that have been manually labeled by annotators. Model performance is evaluated using accuracy, precision, recall, and F1-score metrics. The results show that the combination of IndoBERT and SMOTE provides significant improvements compared to the baseline approach without oversampling. This research contributes to the development of automated sentiment analysis systems in the Indonesian language, which can be applied across various digital platforms. The implementation of this model can assist game developers and product analysts in efficiently understanding user opinions, thereby driving improvements in service quality and user satisfaction in the future.

Authors

Institutions

Publication Details

Journal
Journal of Applied Informatics and Computing
Published
2025-08-09
DOI
https://doi.org/10.30871/jaic.v9i4.10155
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Sentiment Classification of Indonesian-Language Roblox Reviews Using IndoBERT with SMOTE Optimization

Ryan Randy Suryono, Ferdi Ansyah
Journal of Applied Informatics and Computing
Sentiment Analysis and Opinion Mining
article

Sentiment Classification of Indonesian-Language Roblox Reviews Using IndoBERT with SMOTE Optimization

Ryan Randy Suryono, Ferdi Ansyah
article en

Abstract

Roblox is a community-based gaming platform that is extremely popular among users of various age groups. Millions of user reviews available on the platform contain valuable information regarding user satisfaction, expectations, and criticisms of the gameplay experience. To extract insights from these reviews, a reliable natural language processing (NLP) approach tailored to the local language context is essential. This study aims to classify sentiments in Indonesian-language user reviews of Roblox into three categories: positive, negative, and neutral. The model used is IndoBERT, a transformer-based model specifically trained to understand the structure and vocabulary of the Indonesian language. One of the main challenges in this study is the imbalance in the number of data points across sentiment classes. To address this, the SMOTE (Synthetic Minority Over-sampling Technique) method is applied to strengthen the representation of minority classes. The dataset consists of thousands of reviews that have been manually labeled by annotators. Model performance is evaluated using accuracy, precision, recall, and F1-score metrics. The results show that the combination of IndoBERT and SMOTE provides significant improvements compared to the baseline approach without oversampling. This research contributes to the development of automated sentiment analysis systems in the Indonesian language, which can be applied across various digital platforms. The implementation of this model can assist game developers and product analysts in efficiently understanding user opinions, thereby driving improvements in service quality and user satisfaction in the future.

Journal of Applied Informatics and ComputingVol. 9(4)
Universitas Teknokrat Indonesia (ID), Universitas Komputer Indonesia (ID)
Openalex Percentile: Top 88%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.