Enhancing Cyber Security: Comparing the Accuracy of the Bert Model with Other Common Deep Learning Models in Identifying Email Spam

Spam emails constitute a significant percentage of email traffic and are considered a cybersecurity threat, often leading to phishing attacks, malware infections, and financial fraud. These emails, sent in bulk for commercial and malicious purposes, can bypass traditional spam filters, necessitating the development of high-accuracy models for effective detection. A major challenge in spam filtering is reducing false positives, which can lead to legitimate emails being incorrectly classified as spam, impacting users' email communication. In this study, deep learning (DL) and natural language processing (NLP) methods were employed to develop a spam detection model. Five DL-based models—Dense, CNN, LSTM, CNN-LSTM, and BERT—were evaluated. Data preprocessing included stemming, lemmatization, and text vectorization using Word2Vec to enhance feature extraction. The models were trained on a real dataset, and their accuracy was assessed using multiple evaluation indices. The findings demonstrated that, among the tested models, BERT achieved the highest accuracy (99.33%), outperforming all other approaches in spam detection. Its ability to understand contextual relationships and mitigate false positives makes it highly suitable for real-world applications. Given its computational demands, future research should focus on optimizing BERT for real-time deployment through model compression and parallel execution. Additionally, further testing on larger and more diverse datasets and implementing multilingual spam filtering capabilities will enhance its practical utility.

Institutions

Publication Details

Journal
SHILAP Revista de lepidopterología
Published
2025-03-01
DOI
https://doi.org/10.22034/aeis.2025.492892.1257
Citations
1
Primary Topic
Spam and Phishing Detection
Type
article
Field-Weighted Citation Impact
3.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Cyber Security: Comparing the Accuracy of the Bert Model with Other Common Deep Learning Models in Identifying Email Spam

1 citations
SHILAP Revista de lepidopterología
Spam and Phishing Detection
3.25
article

Enhancing Cyber Security: Comparing the Accuracy of the Bert Model with Other Common Deep Learning Models in Identifying Email Spam

article en
1 citations

Abstract

Spam emails constitute a significant percentage of email traffic and are considered a cybersecurity threat, often leading to phishing attacks, malware infections, and financial fraud. These emails, sent in bulk for commercial and malicious purposes, can bypass traditional spam filters, necessitating the development of high-accuracy models for effective detection. A major challenge in spam filtering is reducing false positives, which can lead to legitimate emails being incorrectly classified as spam, impacting users' email communication. In this study, deep learning (DL) and natural language processing (NLP) methods were employed to develop a spam detection model. Five DL-based models—Dense, CNN, LSTM, CNN-LSTM, and BERT—were evaluated. Data preprocessing included stemming, lemmatization, and text vectorization using Word2Vec to enhance feature extraction. The models were trained on a real dataset, and their accuracy was assessed using multiple evaluation indices. The findings demonstrated that, among the tested models, BERT achieved the highest accuracy (99.33%), outperforming all other approaches in spam detection. Its ability to understand contextual relationships and mitigate false positives makes it highly suitable for real-world applications. Given its computational demands, future research should focus on optimizing BERT for real-time deployment through model compression and parallel execution. Additionally, further testing on larger and more diverse datasets and implementing multilingual spam filtering capabilities will enhance its practical utility.

SHILAP Revista de lepidopterología
Wuyi University (CN), Wuyi University (CN)
Peace, Justice and strong institutions
Openalex Percentile: Top 5%
Spam and Phishing Detection
3.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.