TEXT SENTIMENT CLASSIFICATION BASED ON NEURAL NETWORK MODELING

In this work, we propose a method for automatically determining the sentiment of text reviews posted by online store customers using recurrent neural networks equipped with two LSTM blocks with 1024 and 128 neurons, each employing ReLU activation. For text encoding into vectors, we use the FastText model, which captures the morphological nuances of the Russian language by extracting information from word sub-units. The two successive LSTM layers enable modeling of long-term contextual dependencies, crucial for analyzing textual data. This study aims to overcome the limitations of existing methods that only partially account for semantic and morphological language features. At the core of our approach is the automatic extraction of contextual dependencies, which is especially relevant when processing unstructured data. The experimental part of the research consists of developing a model trained on a dataset of 60000 annotated reviews, split into training and test sets in an 80:20 ratio, and conducting a comparative analysis of its classification results against those obtained with logistic regression and single-layer LSTM models. The results demonstrate an increase in classification accuracy - up to 90 % on the test set - through the use of two LSTM layers. Comparative evaluation shows that our two-layer LSTM architecture outperforms the classical logistic regression algorithm and single-layer LSTM models across key metrics (Accuracy ≈ 0.89; F1-Score ≈ 0.90; AUC ≈ 0.95). The proposed methodology enables effective sentiment analysis of large volumes of text data. Moreover, it exhibits high practical relevance for scalable monitoring of user feedback and can be extended by integrating attention mechanisms (self-attention) and hybrid architectures that combine the strengths of RNNs and Transformers.

Authors

Publication Details

Journal
Herald of Technological University
Published
2025-01-01
DOI
https://doi.org/10.55421/3034-4689_2025_28_6_91
Primary Topic
Advanced Computational Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

TEXT SENTIMENT CLASSIFICATION BASED ON NEURAL NETWORK MODELING

L. Yu. Emaletdinova, M.S. PISHCHULIN
Herald of Technological University
Advanced Computational Techniques and Applications
article

TEXT SENTIMENT CLASSIFICATION BASED ON NEURAL NETWORK MODELING

L. Yu. Emaletdinova, M.S. PISHCHULIN
article en

Abstract

In this work, we propose a method for automatically determining the sentiment of text reviews posted by online store customers using recurrent neural networks equipped with two LSTM blocks with 1024 and 128 neurons, each employing ReLU activation. For text encoding into vectors, we use the FastText model, which captures the morphological nuances of the Russian language by extracting information from word sub-units. The two successive LSTM layers enable modeling of long-term contextual dependencies, crucial for analyzing textual data. This study aims to overcome the limitations of existing methods that only partially account for semantic and morphological language features. At the core of our approach is the automatic extraction of contextual dependencies, which is especially relevant when processing unstructured data. The experimental part of the research consists of developing a model trained on a dataset of 60000 annotated reviews, split into training and test sets in an 80:20 ratio, and conducting a comparative analysis of its classification results against those obtained with logistic regression and single-layer LSTM models. The results demonstrate an increase in classification accuracy - up to 90 % on the test set - through the use of two LSTM layers. Comparative evaluation shows that our two-layer LSTM architecture outperforms the classical logistic regression algorithm and single-layer LSTM models across key metrics (Accuracy ≈ 0.89; F1-Score ≈ 0.90; AUC ≈ 0.95). The proposed methodology enables effective sentiment analysis of large volumes of text data. Moreover, it exhibits high practical relevance for scalable monitoring of user feedback and can be extended by integrating attention mechanisms (self-attention) and hybrid architectures that combine the strengths of RNNs and Transformers.

Herald of Technological UniversityVol. 28(6)
Openalex Percentile: Top 91%
Advanced Computational Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

TEXT SENTIMENT CLASSIFICATION BASED ON NEURAL NETWORK MODELING — L. Yu. Emaletdinova, M.S. PISHCHULIN · Herald of Technological University (2025) | TGRS Research Map | TGRS