Adversarial robustness evaluation of hybrid CNN-LSTM-transformer NIDS on evolving threats
[EN]Current Network Intrusion Detection Systems (NIDS) often fail to detect adversarial evasion attacks, creating critical security blind spots. To address this, we propose a standardized adversarial evaluation protocol that quantifies performance degradation against Fast Gradient Sign Method (FGSM), Projected Gradient Descent (PGD), and AutoAttack ensemble attacks, establishing empirically observed performance bounds. We implemented a high-throughput hybrid architecture combining 1D-CNN, Bidirectional LSTM, and Transformer mechanisms, designed specifically to balance varying traffic dynamics and robustness. Unlike prior studies that report only clean-data accuracy, our evaluation of UNSW-NB15, CICIDS2017, and CICIoT2023 demonstrates competitive performance (e.g., strong multi-class F1 scores) while revealing robustness profiles up to an operational limit of e=0.05. Crucially, we validated our results under a temporal split using the official UNSW-NB15 train/test partition, confirming that binary detection (94.20% accuracy, 95.69% F1) generalizes under distribution shift. We further compared the proposed method with PGD-based adversarial training (PGD-AT) to quantify the robustness–accuracy trade-off. Our results advocate the use of security curves as a standard metric for NIDS validation in hostile environments.
Authors
- Javier Prieto (ORCID: https://orcid.org/0000-0001-8175-2201)
- Evaristo J. Abril (ORCID: https://orcid.org/0000-0003-4164-2467)
- Juan Antonio González-Ramos (ORCID: https://orcid.org/0000-0003-0964-899X)
- Pablo Chamoso (ORCID: https://orcid.org/0000-0001-5109-3583)
- Patricia Fernández
Publication Details
- Journal
- Journal of Information Security and Applications
- Published
- 2026-04-15
- DOI
- https://doi.org/10.1016/j.jisa.2026.104467
- Primary Topic
- Adversarial Robustness in Machine Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- European Commission
- Instituto Nacional de Ciberseguridad
- Universidad de Salamanca