Large-Scale Multi-Platform Product Review Dataset for Sentiment Analysis: Construction, Quality Control, And Cross-Platform Benchmarking

This study develops and evaluates a large-scale multi-platform product review benchmark for sentiment analysis. Public review data were integrated through provenance auditing, unified schema mapping, quality control, conservative deduplication, sentiment harmonization, source-aware sampling, and stratified experimentation. Four platforms Amazon, Flipkart, Lazada, and Tokopedia were retained after quality control. The sentiment-ready master dataset contains 877,394 reviews, while the multi-platform benchmark contains 509,315 reviews. The benchmark was divided into 407,452 training, 50,931 validation, and 50,932 testing reviews using stratification by platform and sentiment. Two classifiers were evaluated: TF-IDF with Linear Support Vector Machine (SVM) and IndoBERT. TF-IDF+SVM achieved 93.21% accuracy and 83.11% Macro-F1, whereas IndoBERT achieved 93.79% accuracy and 83.46% Macro-F1. Although IndoBERT obtained a higher Macro-F1, the paired bootstrap 95% confidence interval for the difference included zero, so the aggregate improvement was not statistically conclusive. An exact McNemar test showed a significant difference in paired prediction behavior (p = 5.737 × 10⁻¹⁰). Performance was platform-dependent, with IndoBERT providing its clearest gains on Lazada and Tokopedia. Leave-One-Platform-Out evaluation produced substantially lower Macro-F1 values than random stratified evaluation, indicating platform/domain shift. The results demonstrate the importance of dataset quality and cross-platform evaluation for sentiment analysis on heterogeneous product reviews.

Authors

Institutions

Publication Details

Journal
Engineering and Technology Journal
Published
2026-11-21
DOI
https://doi.org/10.47191/etj/v11i11.10
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Large-Scale Multi-Platform Product Review Dataset for Sentiment Analysis: Construction, Quality Control, And Cross-Platform Benchmarking

Jati Sasongko Wibowo, Mardi Siswo Utomo, Eddy Nurraharjo, Herny Februariyanti et al.
Engineering and Technology Journal
Sentiment Analysis and Opinion Mining
article

Large-Scale Multi-Platform Product Review Dataset for Sentiment Analysis: Construction, Quality Control, And Cross-Platform Benchmarking

Jati Sasongko Wibowo, Mardi Siswo Utomo, Eddy Nurraharjo, Herny Februariyanti, Sulastri .
article en

Abstract

This study develops and evaluates a large-scale multi-platform product review benchmark for sentiment analysis. Public review data were integrated through provenance auditing, unified schema mapping, quality control, conservative deduplication, sentiment harmonization, source-aware sampling, and stratified experimentation. Four platforms Amazon, Flipkart, Lazada, and Tokopedia were retained after quality control. The sentiment-ready master dataset contains 877,394 reviews, while the multi-platform benchmark contains 509,315 reviews. The benchmark was divided into 407,452 training, 50,931 validation, and 50,932 testing reviews using stratification by platform and sentiment. Two classifiers were evaluated: TF-IDF with Linear Support Vector Machine (SVM) and IndoBERT. TF-IDF+SVM achieved 93.21% accuracy and 83.11% Macro-F1, whereas IndoBERT achieved 93.79% accuracy and 83.46% Macro-F1. Although IndoBERT obtained a higher Macro-F1, the paired bootstrap 95% confidence interval for the difference included zero, so the aggregate improvement was not statistically conclusive. An exact McNemar test showed a significant difference in paired prediction behavior (p = 5.737 × 10⁻¹⁰). Performance was platform-dependent, with IndoBERT providing its clearest gains on Lazada and Tokopedia. Leave-One-Platform-Out evaluation produced substantially lower Macro-F1 values than random stratified evaluation, indicating platform/domain shift. The results demonstrate the importance of dataset quality and cross-platform evaluation for sentiment analysis on heterogeneous product reviews.

Engineering and Technology JournalVol. 11(11)
Universitas Stikubank (ID)
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Large-Scale Multi-Platform Product Review Dataset for Sentiment Analysis: Construction, Quality Control, And Cross-Platform Benchmarking — Jati Sasongko Wibowo, Mardi Siswo Utomo, et al. · Engineering and Technology Journal (2026) | TGRS Research Map | TGRS