ДОСЛІДЖЕННЯ ГІБРИДНОЇ МОДЕЛІ LSTM-CNN-ATTENTION ДЛЯ КЛАСИФІКАЦІЇ ВЕБ-КОНТЕНТУ НА ОСНОВІ ТЕКСТУ

Context. Text-based web content classification plays a pivotal role in various natural language processing (NLP) tasks, including fake news detection, spam filtering, content categorization, and automated moderation. As the scale and complexity of textual data on the web continue to grow, traditional classification approaches – especially those relying on manual feature engineering or shallow learning techniques – struggle to capture the nuanced semantic relationships and structural variability of modern web content. These limitations result in reduced adaptability and poor generalization performance on real-world data. Therefore, there is a clear need for advanced models that can simultaneously learn local linguistic patterns and understand the broader contextual meaning of web text.Method. This study presents a hybrid deep learning architecture that integrates Long Short-Term Memory (LSTM) networks, Convolutional Neural Networks (CNN), and an Attention mechanism to enhance the classification of web content based on text. Pretrained GloVe embeddings are used to represent words as dense vectors that preserve semantic similarity. The CNN layer extracts local n-gram patterns and lexical features, while the LSTM layer models long-range dependencies and sequential structure. The integrated Attention mechanism enables the model to focus selectively on the most informative parts of the input sequence. The model was evaluated using the dataset, which consists of over 10,000 HTML-based web pages annotated as legitimate or fake. A 5-fold cross-validation setup was used to assess the robustness and generalizability of the proposed solution.Results. Experimental results show that the hybrid LSTM-CNN-Attention model achieved outstanding performance, with an accuracy of 0.98, precision of 0.94, recall of 0.92, and F1-score of 0.93. These results surpass the performance of baseline models based solely on CNNs, LSTMs, or transformer-based classifiers such as BERT. The combination of neural network components enabled the model to effectively capture both fine-grained text structures and broader semantic context. Furthermore, the use of GloVe embeddings provided an efficient and effective representation of textual data, making the model suitable for integration into systems with real-time or near-real-time requirements.Conclusions. The proposed hybrid architecture demonstrates high effectiveness in text-based web content classification, particularly in tasks requiring both syntactic feature extraction and semantic interpretation. By combining convolutional, recurrent, and attention-based mechanisms, the model addresses the limitations of individual architectures and achieves improved generalization. These findings support the broader use of hybrid deep learning approaches in NLP applications, especially where complex, unstructured textual data must be processed and classified with high reliability.

Authors

Institutions

Publication Details

Journal
The Scientific Issues of Ternopil Volodymyr Hnatiuk National Pedagogical University Series pedagogy
Published
2025-12-24
Primary Topic
Spam and Phishing Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ДОСЛІДЖЕННЯ ГІБРИДНОЇ МОДЕЛІ LSTM-CNN-ATTENTION ДЛЯ КЛАСИФІКАЦІЇ ВЕБ-КОНТЕНТУ НА ОСНОВІ ТЕКСТУ

М. В. Пікуляк, І. М. Лазарович, А. Д. Кваснюк, М. І. Козленко et al.
The Scientific Issues of Ternopil Volodymyr Hnatiuk National Pedagogical University Series pedagogy
Spam and Phishing Detection
article

ДОСЛІДЖЕННЯ ГІБРИДНОЇ МОДЕЛІ LSTM-CNN-ATTENTION ДЛЯ КЛАСИФІКАЦІЇ ВЕБ-КОНТЕНТУ НА ОСНОВІ ТЕКСТУ

М. В. Пікуляк, І. М. Лазарович, А. Д. Кваснюк, М. І. Козленко, М. В. Кузь
article en

Abstract

Context. Text-based web content classification plays a pivotal role in various natural language processing (NLP) tasks, including fake news detection, spam filtering, content categorization, and automated moderation. As the scale and complexity of textual data on the web continue to grow, traditional classification approaches – especially those relying on manual feature engineering or shallow learning techniques – struggle to capture the nuanced semantic relationships and structural variability of modern web content. These limitations result in reduced adaptability and poor generalization performance on real-world data. Therefore, there is a clear need for advanced models that can simultaneously learn local linguistic patterns and understand the broader contextual meaning of web text.Method. This study presents a hybrid deep learning architecture that integrates Long Short-Term Memory (LSTM) networks, Convolutional Neural Networks (CNN), and an Attention mechanism to enhance the classification of web content based on text. Pretrained GloVe embeddings are used to represent words as dense vectors that preserve semantic similarity. The CNN layer extracts local n-gram patterns and lexical features, while the LSTM layer models long-range dependencies and sequential structure. The integrated Attention mechanism enables the model to focus selectively on the most informative parts of the input sequence. The model was evaluated using the dataset, which consists of over 10,000 HTML-based web pages annotated as legitimate or fake. A 5-fold cross-validation setup was used to assess the robustness and generalizability of the proposed solution.Results. Experimental results show that the hybrid LSTM-CNN-Attention model achieved outstanding performance, with an accuracy of 0.98, precision of 0.94, recall of 0.92, and F1-score of 0.93. These results surpass the performance of baseline models based solely on CNNs, LSTMs, or transformer-based classifiers such as BERT. The combination of neural network components enabled the model to effectively capture both fine-grained text structures and broader semantic context. Furthermore, the use of GloVe embeddings provided an efficient and effective representation of textual data, making the model suitable for integration into systems with real-time or near-real-time requirements.Conclusions. The proposed hybrid architecture demonstrates high effectiveness in text-based web content classification, particularly in tasks requiring both syntactic feature extraction and semantic interpretation. By combining convolutional, recurrent, and attention-based mechanisms, the model addresses the limitations of individual architectures and achieves improved generalization. These findings support the broader use of hybrid deep learning approaches in NLP applications, especially where complex, unstructured textual data must be processed and classified with high reliability.

The Scientific Issues of Ternopil Volodymyr Hnatiuk National Pedagogical University Series pedagogy
Vasyl Stefanyk Carpathian National University (UA)
Openalex Percentile: Top 23%
Spam and Phishing Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.