Analyzing App Reviews: A Comparative Evaluation of Machine Learning Algorithms on a Spanish Dataset

Currently, the internet plays a main role in collecting and providing information on the needs and preferences of app users. App reviews contain valuable insights, such as bug reports, feature requests, and user feedback. However, manually analyzing these reviews is a time-consuming task. In this paper, we conducted an experiment to automate the process of analyzing app reviews using machine learning algorithms. We utilized and translated the dataset from Gu et al. (2015) to Spanish, which contains approximately 34,000 reviews from several apps. Three algorithms were trained: Multinomial Naive Bayes, Logistic Regression, and Support Vector Machine, with hyperparameter optimization performed via Grid Search. Logistic Regression achieved the highest performance with a maximum F1-score of 0.74.

Authors

Publication Details

Published
2024-11-01
DOI
https://doi.org/10.17979/spudc.9788497498913.10
Primary Topic
Big Data and Business Intelligence
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Analyzing App Reviews: A Comparative Evaluation of Machine Learning Algorithms on a Spanish Dataset

Miguel R. Luaces, Nelly Condorí-Fernández, María Isabel Limaylla-Lunarejo
Big Data and Business Intelligence
article

Analyzing App Reviews: A Comparative Evaluation of Machine Learning Algorithms on a Spanish Dataset

Miguel R. Luaces, Nelly Condorí-Fernández, María Isabel Limaylla-Lunarejo
article en

Abstract

Currently, the internet plays a main role in collecting and providing information on the needs and preferences of app users. App reviews contain valuable insights, such as bug reports, feature requests, and user feedback. However, manually analyzing these reviews is a time-consuming task. In this paper, we conducted an experiment to automate the process of analyzing app reviews using machine learning algorithms. We utilized and translated the dataset from Gu et al. (2015) to Spanish, which contains approximately 34,000 reviews from several apps. Three algorithms were trained: Multinomial Naive Bayes, Logistic Regression, and Support Vector Machine, with hyperparameter optimization performed via Grid Search. Logistic Regression achieved the highest performance with a maximum F1-score of 0.74.

Openalex Percentile: Top 57%
Big Data and Business Intelligence
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.