Discrete Unintentional Adversarial Perturbation Detection for DQN Traffic Signal Control
Anomalous traffic-state observations can affect deep Q-network (DQN) traffic signal control during training and inference. This study uses training-time backdoor poisoning to construct compromised DQN controllers and inference-time trigger activation to evaluate the resulting threat. We propose a Discrete Unintentional Adversarial Perturbation Detector (DUIAPD) for detecting trigger-bearing inputs to an already trained DQN. For each input, the detector generates discretized random perturbations, evaluates all perturbed input copies with the same fixed DQN, and measures action-wise Q-value variability. A normalized sensitivity score is compared with a threshold calibrated on clean reference inputs. No surrogate neural network is trained and no DQN parameters are updated during detection. At a single SUMO intersection with four actions, the reported results across 18 trigger configurations give true positive rates of 92.14–96.38% and false positive rates of 1.51–6.40%. These results support detection of the constructed trigger-bearing inputs under the evaluated conditions. General sensor-fault detection, transfer across intersections, real-time feasibility, and downstream closed-loop benefits remain to be validated.
Authors
- Dongwei Xu (ORCID: https://orcid.org/0000-0003-2693-922X)
- Akhylbek Kazhigulovich Kurishbayev (ORCID: https://orcid.org/0000-0002-0568-5964)
- Duman Imanmadi (ORCID: https://orcid.org/0009-0004-5416-0832)
- Chengju Sun (ORCID: https://orcid.org/0009-0009-8472-3225)
- Haifeng Guo
- Tieming Chen
- Guanyu Zhu
Institutions
- National Academy of Sciences of the Republic of Kazakhstan (KZ)
- Kazakh National Agrarian Research University (KZ)
- Zhejiang University of Technology (CN)
Publication Details
- Journal
- Electronics
- Published
- 2026-10-29
- DOI
- https://doi.org/10.3390/electronics15215014
- Primary Topic
- Adversarial Robustness in Machine Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Zhejiang University of Technology