Examining Customer Satisfaction Through Transformer-Based Sentiment Analysis for Improving Bilingual E-Commerce Experiences

As e-commerce continues its rapid expansion, accurately gauging and interpreting customer sentiment has become critical for optimizing user satisfaction and predicting purchasing behavior. This study advances feature-level sentiment analysis by examining Chinese e-commerce product reviews, translated into English, to uncover the contextual impact of sentiment-bearing keywords across diverse product categories. The research intends to discover trends, reasons, and broad conclusions associated with the volume, co-occurrence, and contextual use of keywords across various product types. Using sentiment intensity analysis, N-gram modeling, and machine learning, this research attempted to evaluate the performance of these models: ELECTRA, BERT, BiLSTM, Random Forest with XGBoost, and SVC with SGD. Empirical results demonstrate that ELECTRA yields the highest accuracy (98.09%) and F1 score (0.9711), illustrating superior performance in capturing nuanced sentiment cues, with low loss of 0.062. BiLSTM followed with 96.09% accuracy and F1 score of 0.9583. Although BERT performed strongly with an accuracy of 95.28% and an F1 score of 0.9528, it is extremely resource demanding. Ensemble methods like Random Forest with XGBoost and SVC with SGD had moderate performance, finding 82.43%, and 88.84% accuracy, respectively, but had better runtimes. The results supports the advantage of using transformer based models in attempting more sophisticated contextual analysis by uncovering paramount sentiment patterns, product specific issues, and customer needs. Furthermore, by translating Chinese reviews into English, the study highlights the potential for cross-lingual frameworks to enrich global e-commerce strategies. Future research directions include integrating cultural factors, extending analysis to additional languages, and refining computational approaches for resource-limited environments.

Authors

Institutions

Publication Details

Journal
IEEE Access
Published
2025-01-01
DOI
https://doi.org/10.1109/access.2025.3551666
Citations
7
Primary Topic
Customer churn and segmentation
Type
article
Field-Weighted Citation Impact
14.51
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Examining Customer Satisfaction Through Transformer-Based Sentiment Analysis for Improving Bilingual E-Commerce Experiences

S Shan, Remson Mark C. Macawile, Jin Sun
7 citations
IEEE Access
Customer churn and segmentation
14.51
article

Examining Customer Satisfaction Through Transformer-Based Sentiment Analysis for Improving Bilingual E-Commerce Experiences

S Shan, Remson Mark C. Macawile, Jin Sun
article en
7 citations

Abstract

As e-commerce continues its rapid expansion, accurately gauging and interpreting customer sentiment has become critical for optimizing user satisfaction and predicting purchasing behavior. This study advances feature-level sentiment analysis by examining Chinese e-commerce product reviews, translated into English, to uncover the contextual impact of sentiment-bearing keywords across diverse product categories. The research intends to discover trends, reasons, and broad conclusions associated with the volume, co-occurrence, and contextual use of keywords across various product types. Using sentiment intensity analysis, N-gram modeling, and machine learning, this research attempted to evaluate the performance of these models: ELECTRA, BERT, BiLSTM, Random Forest with XGBoost, and SVC with SGD. Empirical results demonstrate that ELECTRA yields the highest accuracy (98.09%) and F1 score (0.9711), illustrating superior performance in capturing nuanced sentiment cues, with low loss of 0.062. BiLSTM followed with 96.09% accuracy and F1 score of 0.9583. Although BERT performed strongly with an accuracy of 95.28% and an F1 score of 0.9528, it is extremely resource demanding. Ensemble methods like Random Forest with XGBoost and SVC with SGD had moderate performance, finding 82.43%, and 88.84% accuracy, respectively, but had better runtimes. The results supports the advantage of using transformer based models in attempting more sophisticated contextual analysis by uncovering paramount sentiment patterns, product specific issues, and customer needs. Furthermore, by translating Chinese reviews into English, the study highlights the potential for cross-lingual frameworks to enrich global e-commerce strategies. Future research directions include integrating cultural factors, extending analysis to additional languages, and refining computational approaches for resource-limited environments.

IEEE AccessVol. 13
National University (PH), Yango University (CN), China National Democratic Construction Association (CN), Far Eastern University (PH)
Quality Education
Openalex Percentile: Top 2%
Customer churn and segmentation
14.51
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.