A hybrid approach for adversarial attack detection based on sentiment analysis model using Machine learning

One of the main subfields of Machine Learning (ML) that deals with human language for intelligent applications is Natural Language Processing (NLP). One of the biggest problems NLP models encounter is adversarial assaults, which lead to inaccurate predictions. To increase an NLP model’s resilience, adversarial text must be used to examine assaults and defenses. several strategies for detecting adversarial attacks have been put forth; nonetheless, they face several obstacles, such as low attack success rates on particular datasets. Some other attack methods can already be effectively defended against by existing defensive strategies. As a result, such attackers are unable to delve further into the limitations of NLP models to guide future advancements in defense. Consequently, it is required to develop an adversarial attack strategy with a larger attack duration and better performance. Firstly, we train the Convolutional Neural Network (CNN) using the IMDB dataset, which consists of labeled movie reviews that represent positive and negative sentiments on movie reviews. The CNN model performs the sentiment classification of data. Subsequently, adversarial examples are generated from the IMDB dataset utilizing the Fast Gradient Sign Method (FGSM), a well-liked and effective method in the adversarial machine learning domain. After that, a Long Short-Term Memory (LSTM) model is developed utilizing the FGSM-generated hostile cases to identify adversarial attempts on sentiment analysis systems. The LSTM model was trained using a combination of original IMDB data and adversarial cases generated using the FGSM technique. The models are tested on various standard metrics including Accuracy, precision, F1-score, etc., and it achieve about 95.6% accuracy in detecting adversarial attacks.

Authors

Institutions

Publication Details

Journal
Engineering Science and Technology an International Journal
Published
2024-09-21
DOI
https://doi.org/10.1016/j.jestch.2024.101829
Citations
11
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
3.82

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A hybrid approach for adversarial attack detection based on sentiment analysis model using Machine learning

Naeem Ahmed, Faisal S. Alsubaei, Jaroslav Frnda, Rahma Gantassi et al.
11 citations
Engineering Science and Technology an International Journal
Adversarial Robustness in Machine Learning
3.82
article

A hybrid approach for adversarial attack detection based on sentiment analysis model using Machine learning

Naeem Ahmed, Faisal S. Alsubaei, Jaroslav Frnda, Rahma Gantassi, Asma Hassan Alshehri, Rashid Amin
article en
11 citations

Abstract

One of the main subfields of Machine Learning (ML) that deals with human language for intelligent applications is Natural Language Processing (NLP). One of the biggest problems NLP models encounter is adversarial assaults, which lead to inaccurate predictions. To increase an NLP model’s resilience, adversarial text must be used to examine assaults and defenses. several strategies for detecting adversarial attacks have been put forth; nonetheless, they face several obstacles, such as low attack success rates on particular datasets. Some other attack methods can already be effectively defended against by existing defensive strategies. As a result, such attackers are unable to delve further into the limitations of NLP models to guide future advancements in defense. Consequently, it is required to develop an adversarial attack strategy with a larger attack duration and better performance. Firstly, we train the Convolutional Neural Network (CNN) using the IMDB dataset, which consists of labeled movie reviews that represent positive and negative sentiments on movie reviews. The CNN model performs the sentiment classification of data. Subsequently, adversarial examples are generated from the IMDB dataset utilizing the Fast Gradient Sign Method (FGSM), a well-liked and effective method in the adversarial machine learning domain. After that, a Long Short-Term Memory (LSTM) model is developed utilizing the FGSM-generated hostile cases to identify adversarial attempts on sentiment analysis systems. The LSTM model was trained using a combination of original IMDB data and adversarial cases generated using the FGSM technique. The models are tested on various standard metrics including Accuracy, precision, F1-score, etc., and it achieve about 95.6% accuracy in detecting adversarial attacks.

Engineering Science and Technology an International JournalVol. 58
Karnatak University (IN), Chonnam National University (KR), VSB - Technical University of Ostrava (CZ), Prince Sattam Bin Abdulaziz University (SA), University of Engineering and Technology Taxila (PK), Nanjing University of Information Science and Technology (CN), University of Žilina (SK), University of Jeddah (SA)
Ministerstvo Školství, Mládeže a Tělovýchovy
Reduced inequalities
Openalex Percentile: Top 6%
Adversarial Robustness in Machine Learning
3.82
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.