Sentiment Analysis of Acceptance TVET Online Courses on the Skill Academy App from Google Play: Leveraging Text Mining with Comparison Machine Learning Model

<ns3:p>Background The rapid growth of online learning platforms has transformed Technical and Vocational Education and Training, enabling broader access to skill based education through mobile applications. Understanding user acceptance is essential to ensure the sustainability and effectiveness of digital TVET platforms. User reviews available on application marketplaces provide valuable insights into learners’ perceptions, satisfaction, and challenges encountered during use. Methods This study analyzed 3,000 user reviews of the Skill Academy application collected from the Google Play Store. Text preprocessing included data cleaning, case folding, tokenization, filtering, stemming, and translation into English to ensure compatibility with the Valence Aware Dictionary and Sentiment Reasoner. Sentiment labels were generated using VADER and categorized into positive, neutral, and negative classes. Text features were extracted using Term Frequency Inverse Document Frequency. Six machine learning classifiers were evaluated, namely Naive Bayes, Support Vector Machine, Logistic Regression, Random Forest, Decision Tree, and K Nearest Neighbors, using a 70:30 train test split. Results The sentiment analysis results showed that 69.4 percent of the reviews expressed positive sentiment, 20.5 percent were neutral, and 10.1 percent were negative. Positive reviews predominantly emphasized course usefulness, ease of use, and skill development benefits. Negative reviews were mainly associated with technical issues such as application errors and performance limitations. Among the evaluated models, the Support Vector Machine achieved the best performance, with an accuracy of 85.77 percent and an area under the curve value of 0.97. Conclusions The findings indicate a high level of user acceptance of online TVET courses offered through the Skill Academy application, primarily driven by content quality and usability. Nevertheless, addressing technical performance issues remains essential to improve user satisfaction and support sustainable long term adoption. The results also demonstrate that the Support Vector Machine model is highly effective for sentiment classification in the context of online TVET platforms.</ns3:p>

Authors

Institutions

Publication Details

Journal
F1000Research
Published
2026-06-09
DOI
https://doi.org/10.12688/f1000research.181728.1
Primary Topic
Online Learning and Analytics
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Sentiment Analysis of Acceptance TVET Online Courses on the Skill Academy App from Google Play: Leveraging Text Mining with Comparison Machine Learning Model

Ramzy Bin Sulaiman, Darmono Darmono, Rizal Justian Setiawan, Muhamad Riyan Maulana et al.
F1000Research
Online Learning and Analytics
article

Sentiment Analysis of Acceptance TVET Online Courses on the Skill Academy App from Google Play: Leveraging Text Mining with Comparison Machine Learning Model

Ramzy Bin Sulaiman, Darmono Darmono, Rizal Justian Setiawan, Muhamad Riyan Maulana, Yanuar Agung Fadlullah, Khakam Ma'ruf, Apry Aditya Saputra, Bagus Banjar Bagaskara, Sahril Sahril
article en

Abstract

<ns3:p>Background The rapid growth of online learning platforms has transformed Technical and Vocational Education and Training, enabling broader access to skill based education through mobile applications. Understanding user acceptance is essential to ensure the sustainability and effectiveness of digital TVET platforms. User reviews available on application marketplaces provide valuable insights into learners’ perceptions, satisfaction, and challenges encountered during use. Methods This study analyzed 3,000 user reviews of the Skill Academy application collected from the Google Play Store. Text preprocessing included data cleaning, case folding, tokenization, filtering, stemming, and translation into English to ensure compatibility with the Valence Aware Dictionary and Sentiment Reasoner. Sentiment labels were generated using VADER and categorized into positive, neutral, and negative classes. Text features were extracted using Term Frequency Inverse Document Frequency. Six machine learning classifiers were evaluated, namely Naive Bayes, Support Vector Machine, Logistic Regression, Random Forest, Decision Tree, and K Nearest Neighbors, using a 70:30 train test split. Results The sentiment analysis results showed that 69.4 percent of the reviews expressed positive sentiment, 20.5 percent were neutral, and 10.1 percent were negative. Positive reviews predominantly emphasized course usefulness, ease of use, and skill development benefits. Negative reviews were mainly associated with technical issues such as application errors and performance limitations. Among the evaluated models, the Support Vector Machine achieved the best performance, with an accuracy of 85.77 percent and an area under the curve value of 0.97. Conclusions The findings indicate a high level of user acceptance of online TVET courses offered through the Skill Academy application, primarily driven by content quality and usability. Nevertheless, addressing technical performance issues remains essential to improve user satisfaction and support sustainable long term adoption. The results also demonstrate that the Support Vector Machine model is highly effective for sentiment classification in the context of online TVET platforms.</ns3:p>

F1000ResearchVol. 15
Yogyakarta State University (ID), National Chung Hsing University (TW), Universitas Gadjah Mada (ID), Yuan Ze University (TW)
Lembaga Pengelola Dana Pendidikan
Quality Education
Openalex Percentile: Top 4%
Online Learning and Analytics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.