A COMPARATIVE STUDY OF LSTM AND BERT MODELS FOR MULTI-CLASSIFICATION TASKS USING NER DATASET

The article presents a comparative analysis of LSTM and BERT models applied to multi- classification tasks in the Kazakh language using a named entity recognition dataset. The study primarily focuses on addressing the issue of limited resources for processing Kazakh text by adapting existing machine learning methods for the analysis of multidimensional classification tasks. Both approaches have demonstrated their effectiveness in various aspects of text data processing, including modeling contextual dependencies and accurately classifying multiple categories. The LSTM model exhibited a high capability for capturing temporal dependencies in text, making it suitable for classification tasks in low-resource language settings. Meanwhile, the BERT model, based on the Transformer architecture, showed superior results in contextual analysis and processing of complex text structures, ensuring higher performance in multi-classification of Kazakh text. The experimental results indicate that both models can be effectively employed for text classification tasks in the Kazakh language. However, the BERT model demonstrated more stable and reliable outcomes, attributed to its ability for deeper contextual understanding. The findings underscore the importance of applying modern natural language processing (NLP) methods to low-resource languages and open new avenues for further research and practical application

Authors

Publication Details

Journal
Bulletin of D Serikbayev EKTU
Published
2025-06-30
DOI
https://doi.org/10.51885/1561-4212_2025_2_182
Primary Topic
Machine Learning and Data Classification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A COMPARATIVE STUDY OF LSTM AND BERT MODELS FOR MULTI-CLASSIFICATION TASKS USING NER DATASET

Дина Оралбекова, Ayagoz Imansakipova, Aliya Zhiger, Kuralai Mukhsina et al.
Bulletin of D Serikbayev EKTU
Machine Learning and Data Classification
article

A COMPARATIVE STUDY OF LSTM AND BERT MODELS FOR MULTI-CLASSIFICATION TASKS USING NER DATASET

Дина Оралбекова, Ayagoz Imansakipova, Aliya Zhiger, Kuralai Mukhsina, Оrken Mamyrbayev
article en

Abstract

The article presents a comparative analysis of LSTM and BERT models applied to multi- classification tasks in the Kazakh language using a named entity recognition dataset. The study primarily focuses on addressing the issue of limited resources for processing Kazakh text by adapting existing machine learning methods for the analysis of multidimensional classification tasks. Both approaches have demonstrated their effectiveness in various aspects of text data processing, including modeling contextual dependencies and accurately classifying multiple categories. The LSTM model exhibited a high capability for capturing temporal dependencies in text, making it suitable for classification tasks in low-resource language settings. Meanwhile, the BERT model, based on the Transformer architecture, showed superior results in contextual analysis and processing of complex text structures, ensuring higher performance in multi-classification of Kazakh text. The experimental results indicate that both models can be effectively employed for text classification tasks in the Kazakh language. However, the BERT model demonstrated more stable and reliable outcomes, attributed to its ability for deeper contextual understanding. The findings underscore the importance of applying modern natural language processing (NLP) methods to low-resource languages and open new avenues for further research and practical application

Bulletin of D Serikbayev EKTUVol. 108(2)
Openalex Percentile: Top 86%
Machine Learning and Data Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.