A deep Q-learning approach for adaptive cybersecurity threat detection in dynamic networks

Cybersecurity faces persistent challenges due to the rapid growth and complexity of network-based threats. Conventional rule-based systems and classical machine learning approaches often lack the adaptability required to detect advanced and dynamic attacks in real time. This study introduces a deep Q-learning framework for autonomous threat detection and mitigation within a simulated network environment that reflects realistic traffic, malicious behaviors, and system conditions. The framework incorporates experience replay and target network stabilization to strengthen learning and policy optimization. Evaluation was performed on a synthesized dataset containing benign traffic and multiple attack categories, including distributed denial of service (DDoS), phishing, advanced persistent threats, and malware. The proposed system achieved 96.7% detection accuracy, an F1-score of 0.94, and reduced detection latency to 50 ms. These results surpassed the performance of rule-based methods and traditional classifiers such as support vector machines, random forests, convolutional neural networks, and recurrent neural networks. A central contribution lies in combining dynamic feature selection with reinforcement learning (RL), allowing the agent to adapt to evolving threats and diverse network conditions. The findings demonstrate the potential of deep reinforcement learning (DRL) as a scalable and efficient solution for real-time cybersecurity defense.

Authors

Institutions

Publication Details

Journal
Bulletin of Electrical Engineering and Informatics
Published
2025-10-01
DOI
https://doi.org/10.11591/eei.v14i5.9494
Primary Topic
Network Security and Intrusion Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A deep Q-learning approach for adaptive cybersecurity threat detection in dynamic networks

V. Thiruchelvam, Sathish Kumar Selvaperumal, N. Ramasenderan, P. Shyamala Bharathi et al.
Bulletin of Electrical Engineering and Informatics
Network Security and Intrusion Detection
article

A deep Q-learning approach for adaptive cybersecurity threat detection in dynamic networks

V. Thiruchelvam, Sathish Kumar Selvaperumal, N. Ramasenderan, P. Shyamala Bharathi, Maheswara Reddy, Deepak Arun Annamalai
article en

Abstract

Cybersecurity faces persistent challenges due to the rapid growth and complexity of network-based threats. Conventional rule-based systems and classical machine learning approaches often lack the adaptability required to detect advanced and dynamic attacks in real time. This study introduces a deep Q-learning framework for autonomous threat detection and mitigation within a simulated network environment that reflects realistic traffic, malicious behaviors, and system conditions. The framework incorporates experience replay and target network stabilization to strengthen learning and policy optimization. Evaluation was performed on a synthesized dataset containing benign traffic and multiple attack categories, including distributed denial of service (DDoS), phishing, advanced persistent threats, and malware. The proposed system achieved 96.7% detection accuracy, an F1-score of 0.94, and reduced detection latency to 50 ms. These results surpassed the performance of rule-based methods and traditional classifiers such as support vector machines, random forests, convolutional neural networks, and recurrent neural networks. A central contribution lies in combining dynamic feature selection with reinforcement learning (RL), allowing the agent to adapt to evolving threats and diverse network conditions. The findings demonstrate the potential of deep reinforcement learning (DRL) as a scalable and efficient solution for real-time cybersecurity defense.

Bulletin of Electrical Engineering and InformaticsVol. 14(5)
Asia Pacific University of Technology & Innovation (MY), Saveetha University (IN)
Openalex Percentile: Top 67%
Network Security and Intrusion Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A deep Q-learning approach for adaptive cybersecurity threat detection in dynamic networks — V. Thiruchelvam, Sathish Kumar Selvaperumal, et al. · Bulletin of Electrical Engineering and Informatics (2025) | TGRS Research Map | TGRS