Generative Red Teaming for Robust Network Intrusion Detection: A Constrained Adversarial Approach
The increasing reliance on digital infrastructure has made the protection of critical networks essential for ensuring operational resilience and security. Cybersecurity operations centers (CSOCs), supported by advanced technologies and skilled professionals, are central to this effort, with network intrusion detection systems (NIDS) serving as a primary defense mechanism. The adoption of machine learning (ML) and deep learning (DL) within NIDS has greatly improved their ability to detect cyber threats. However, these models are inherently vulnerable to adversarial attacks, where carefully crafted inputs manipulate model weaknesses to evade detection. The rapid evolution of generative artificial intelligence (AI) technologies has amplified this risk by enabling adversaries to automate the creation of sophisticated evasion attacks. Hence, it is critical to evaluate the robustness of ML/DL-based NIDS against evolving adversaries. Current adversarial evaluation techniques for NIDS fail to capture real-world constraints, leading to unrealistic assumptions such as unrestricted packet modifications and control over encrypted communications, resulting in a false sense of security. To bridge this gap, we introduce a generative red teaming framework designed to conduct realistic and scalable vulnerability assessment of ML/DL-based NIDS. Our adversarial framework, PerturbLite , leverages a novel autoencoder-based generative model that produces minimally perturbed, functionality-preserving adversarial network packets capable of bypassing detection. Extensive experiments on real-world benchmarking network intrusion data sets reveal that our approach achieves superior evasion performance while maintaining packet validity, often altering less than 1% of the original content. In addition to outperforming existing adversarial methods, our framework uncovers systemic vulnerabilities within NIDS, offering insights that can guide the design of more resilient detection models at a CSOC to better protect organizations. Our work advances adversarial testing methodologies in cybersecurity and aligns with best practices recommended by Cybersecurity and AI governance frameworks.
Authors
- Nathaniel D. Bastian (ORCID: https://orcid.org/0000-0001-9957-2778)
- Ankit Shah (ORCID: https://orcid.org/0000-0002-8314-6392)
- Jalal Ghadermazi (ORCID: https://orcid.org/0009-0000-7554-5740)
- Mohammad Noroozi (ORCID: https://orcid.org/0000-0002-3180-9959)
- Soumyadeep Hore (ORCID: https://orcid.org/0000-0002-9326-291X)
Institutions
- United States Military Academy (US)
- University of South Florida (US)
- Indiana University Bloomington (US)
Publication Details
- Journal
- ACM Transactions on Internet Technology
- Published
- 2026-11-21
- DOI
- https://doi.org/10.1145/3871042
- Primary Topic
- Adversarial Robustness in Machine Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.00