Spam No More: A Cross-Model Analysis of Machine Learning Techniques and Large Language Model Efficacies

With the increasing sophistication of phishing scams, financial fraud, and malicious cyber-attacks, the need for effective spam detection mechanisms to safeguard users is more critical than ever. In this paper, we present a comprehensive evaluation of traditional machine learning models and Large Language Models (LLMs) in the context of spam detection. By assessing a variety of traditional ML models such as Support Vector Machines (SVM), Logistic Regression, Random Forest, Naive Bayes, K-Nearest Neighbors (KNN), and XGBoost on several performance metrics, we establish a baseline of effectiveness for spam identification tasks. We extend our analysis to include LLMs, specifically ChatGPT 3.5, Perplexity AI, and our own customized fine-tuned GPT model, referred to as TextGPT. Our findings show that while traditional ML models are effective, LLMs demonstrate exceptional potential in enhancing spam detection. Through a rigorous comparative analysis, this study highlights the strengths of both traditional and advanced approaches, showcasing the promising application of LLMs in improving spam detection processes.

Authors

Institutions

Publication Details

Published
2024-12-04
DOI
https://doi.org/10.1109/csnet64211.2024.10851763
Citations
5
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
1.74
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Spam No More: A Cross-Model Analysis of Machine Learning Techniques and Large Language Model Efficacies

Prashnna Gyawali, Robin Chataut, Mary Nankya, Yusuf Usman et al.
5 citations
Topic Modeling
1.74
article

Spam No More: A Cross-Model Analysis of Machine Learning Techniques and Large Language Model Efficacies

Prashnna Gyawali, Robin Chataut, Mary Nankya, Yusuf Usman, Aadesh Upadhyay
article en
5 citations

Abstract

With the increasing sophistication of phishing scams, financial fraud, and malicious cyber-attacks, the need for effective spam detection mechanisms to safeguard users is more critical than ever. In this paper, we present a comprehensive evaluation of traditional machine learning models and Large Language Models (LLMs) in the context of spam detection. By assessing a variety of traditional ML models such as Support Vector Machines (SVM), Logistic Regression, Random Forest, Naive Bayes, K-Nearest Neighbors (KNN), and XGBoost on several performance metrics, we establish a baseline of effectiveness for spam identification tasks. We extend our analysis to include LLMs, specifically ChatGPT 3.5, Perplexity AI, and our own customized fine-tuned GPT model, referred to as TextGPT. Our findings show that while traditional ML models are effective, LLMs demonstrate exceptional potential in enhancing spam detection. Through a rigorous comparative analysis, this study highlights the strengths of both traditional and advanced approaches, showcasing the promising application of LLMs in improving spam detection processes.

West Virginia University (US), University of North Texas (US), Texas Christian University (US), Quinnipiac University (US), Fitchburg State University (US)
Openalex Percentile: Top 12%
Topic Modeling
1.74
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.