Sentiment Analysis and Classification of User Reviews of the 'Access by KAI' Application Using Machine Learning Methods to Improve Service Quality

This research applies sentiment analysis to understand user perceptions of the Access by KAI application, especially specific aspects such as speed, payment process, and user interface (UI/UX). User reviews are collected and processed through preprocessing stages, balancing using the SMOTE method, and classified using three machine learning algorithms, namely Support Vector Machine (SVM), Decision Tree, and Logistic Regression. The SVM model achieved the highest accuracy of 89.33%, followed by Logistic Regression at 88%, and Decision Tree at 86.67%. Precision, recall, and F1-scores for each model were also evaluated, showing strong performance in detecting negative sentiments but lower performance for neutral and positive sentiments. In addition, keyword-based analysis revealed that negative sentiment was most commonly found in the aspects of the payment process and speed. WordCloud visualization also strengthens the results by showing the dominance of negative words in user reviews. The results of this study provide important suggestions and input for application developers to improve aspects of the service that are considered less satisfactory by users. Thus, this study can be used as a practical guide in making strategic decisions to improve the quality of service and user satisfaction of the Access by KAI application.

Authors

Institutions

Publication Details

Journal
Journal of Information Systems and Informatics
Published
2025-06-30
DOI
https://doi.org/10.51519/journalisi.v7i2.1099
Citations
2
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
4.96
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Sentiment Analysis and Classification of User Reviews of the 'Access by KAI' Application Using Machine Learning Methods to Improve Service Quality

Putri Taqwa Prasetyaningrum, H. Saka
2 citations
Journal of Information Systems and Informatics
Sentiment Analysis and Opinion Mining
4.96
article

Sentiment Analysis and Classification of User Reviews of the 'Access by KAI' Application Using Machine Learning Methods to Improve Service Quality

Putri Taqwa Prasetyaningrum, H. Saka
article en
2 citations

Abstract

This research applies sentiment analysis to understand user perceptions of the Access by KAI application, especially specific aspects such as speed, payment process, and user interface (UI/UX). User reviews are collected and processed through preprocessing stages, balancing using the SMOTE method, and classified using three machine learning algorithms, namely Support Vector Machine (SVM), Decision Tree, and Logistic Regression. The SVM model achieved the highest accuracy of 89.33%, followed by Logistic Regression at 88%, and Decision Tree at 86.67%. Precision, recall, and F1-scores for each model were also evaluated, showing strong performance in detecting negative sentiments but lower performance for neutral and positive sentiments. In addition, keyword-based analysis revealed that negative sentiment was most commonly found in the aspects of the payment process and speed. WordCloud visualization also strengthens the results by showing the dominance of negative words in user reviews. The results of this study provide important suggestions and input for application developers to improve aspects of the service that are considered less satisfactory by users. Thus, this study can be used as a practical guide in making strategic decisions to improve the quality of service and user satisfaction of the Access by KAI application.

Journal of Information Systems and InformaticsVol. 7(2)
Universitas Mercu Buana Yogyakarta (ID)
Openalex Percentile: Top 5%
Sentiment Analysis and Opinion Mining
4.96
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.