Sentiment Analysis of Fizzo Novel Application Using Support Vector Machine and Naïve Bayes Algorithm with SEMMA Framework

The increasing popularity of digital reading platforms in Indonesia, such as Fizzo Novel, has generated many user reviews that can be analyzed to understand their satisfaction. This study analyzes user sentiment toward Fizzo Novel using the SEMMA (Sample, Explore, Modify, Model, Assess) framework, and compares the performance of the Support Vector Machine (SVM) and Naïve Bayes algorithms. A total of 139,759 reviews were collected from the Google Play Store through web scraping. The data was then processed through normalization, tokenization, lexicon-based sentiment labeling, and feature extraction using TF-IDF. To address class imbalance, the SMOTE technique was applied. The results showed that SVM achieved the highest accuracy, exceeding 96%, with a consistent F1-score across all sentiment classes. In contrast, Naïve Bayes recorded lower accuracy (75.82% before SMOTE and 73.63% after SMOTE), along with a decline in performance for the neutral class. SVM proved more reliable in handling large and imbalanced text data. Practically, the results of this study can help application developers such as Fizzo Novel in automatically understanding user opinions. With an accurate sentiment classification model, developers can monitor reviews in real-time, identify issues such as excessive advertising or an unpopular chapter division system, and design feature improvements based on real user needs. This research also provides a foundation for algorithm selection in future large-scale sentiment analysis projects and recommends SVM as the more appropriate choice in this context.

Institutions

Publication Details

Journal
Jurnal Teknik Informatika (Jutif)
Published
2025-08-18
DOI
https://doi.org/10.52436/1.jutif.2025.6.4.4875
Primary Topic
Canadian Policy and Governance
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Sentiment Analysis of Fizzo Novel Application Using Support Vector Machine and Naïve Bayes Algorithm with SEMMA Framework

Jurnal Teknik Informatika (Jutif)
Canadian Policy and Governance
article

Sentiment Analysis of Fizzo Novel Application Using Support Vector Machine and Naïve Bayes Algorithm with SEMMA Framework

article en

Abstract

The increasing popularity of digital reading platforms in Indonesia, such as Fizzo Novel, has generated many user reviews that can be analyzed to understand their satisfaction. This study analyzes user sentiment toward Fizzo Novel using the SEMMA (Sample, Explore, Modify, Model, Assess) framework, and compares the performance of the Support Vector Machine (SVM) and Naïve Bayes algorithms. A total of 139,759 reviews were collected from the Google Play Store through web scraping. The data was then processed through normalization, tokenization, lexicon-based sentiment labeling, and feature extraction using TF-IDF. To address class imbalance, the SMOTE technique was applied. The results showed that SVM achieved the highest accuracy, exceeding 96%, with a consistent F1-score across all sentiment classes. In contrast, Naïve Bayes recorded lower accuracy (75.82% before SMOTE and 73.63% after SMOTE), along with a decline in performance for the neutral class. SVM proved more reliable in handling large and imbalanced text data. Practically, the results of this study can help application developers such as Fizzo Novel in automatically understanding user opinions. With an accurate sentiment classification model, developers can monitor reviews in real-time, identify issues such as excessive advertising or an unpopular chapter division system, and design feature improvements based on real user needs. This research also provides a foundation for algorithm selection in future large-scale sentiment analysis projects and recommends SVM as the more appropriate choice in this context.

Jurnal Teknik Informatika (Jutif)Vol. 6(4)
Muria Kudus University (ID)
Quality Education
Openalex Percentile: Top 39%
Canadian Policy and Governance
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.