Enhancing Aspect-Based Sentiment Analysis in Imbalanced Multilabel Datasets using Resampling and Classifiers for Digital Signature Applications

Amid the growing demand for digital identity solutions, applications like Privy, VIDA, and Xignature offer integrated digital signature and e-stamp services, generating extensive user feedback on platforms like Google Play Store and App Store. Extracting meaningful insights from thousands of reviews is challenging, necessitating effective sentiment analysis. Aspect-Based Sentiment Analysis (ABSA) enables detailed sentiment evaluation by linking user feedback to specific aspects and sentiments. However, ABSA faces challenges with imbalanced datasets where label distributions are uneven. This study explores the application of three resampling techniques, including MLROS, MLSMOTE, and REMEDIAL, to address this issue in multilabel classification. Using multilabel classifiers, including Binary Relevance, Label Powerset, and Classifier Chains, the study systematically evaluates their performance. Results reveal that resampling significantly enhances outcomes, with MLROS and Classifier Chains under a 70:30 split achieving the best performance, reducing Hamming Loss to 0.0401 or 95% accuracy. This marks a 34.2% improvement over baseline models without resampling or classifiers. The model generalizes well to unseen data with minimal overfitting, as indicated by validation results. These results underscore the importance of imbalanced data resampling and multilabel classification techniques in advancing ABSA, offering valuable insights for improving sentiment analysis in real-world applications.

Authors

Publication Details

Journal
Aviation Electronics Information Technology Telecommunications Electricals Controls (AVITEC)
Published
2025-06-23
DOI
https://doi.org/10.28989/avitec.v7i2.3023
Primary Topic
Text and Document Classification Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Aspect-Based Sentiment Analysis in Imbalanced Multilabel Datasets using Resampling and Classifiers for Digital Signature Applications

Tri Luhur Indayanti Sugata, Amalia Anjani Arifiyanti, Efriza Cahya Narendra
Aviation Electronics Information Technology Telecommunications Electricals Controls (AVITEC)
Text and Document Classification Technologies
article

Enhancing Aspect-Based Sentiment Analysis in Imbalanced Multilabel Datasets using Resampling and Classifiers for Digital Signature Applications

Tri Luhur Indayanti Sugata, Amalia Anjani Arifiyanti, Efriza Cahya Narendra
article en

Abstract

Amid the growing demand for digital identity solutions, applications like Privy, VIDA, and Xignature offer integrated digital signature and e-stamp services, generating extensive user feedback on platforms like Google Play Store and App Store. Extracting meaningful insights from thousands of reviews is challenging, necessitating effective sentiment analysis. Aspect-Based Sentiment Analysis (ABSA) enables detailed sentiment evaluation by linking user feedback to specific aspects and sentiments. However, ABSA faces challenges with imbalanced datasets where label distributions are uneven. This study explores the application of three resampling techniques, including MLROS, MLSMOTE, and REMEDIAL, to address this issue in multilabel classification. Using multilabel classifiers, including Binary Relevance, Label Powerset, and Classifier Chains, the study systematically evaluates their performance. Results reveal that resampling significantly enhances outcomes, with MLROS and Classifier Chains under a 70:30 split achieving the best performance, reducing Hamming Loss to 0.0401 or 95% accuracy. This marks a 34.2% improvement over baseline models without resampling or classifiers. The model generalizes well to unseen data with minimal overfitting, as indicated by validation results. These results underscore the importance of imbalanced data resampling and multilabel classification techniques in advancing ABSA, offering valuable insights for improving sentiment analysis in real-world applications.

Aviation Electronics Information Technology Telecommunications Electricals Controls (AVITEC)Vol. 7(2)
Openalex Percentile: Top 91%
Text and Document Classification Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.