A cue-locality audit framework for attributing spurious temporal shortcuts in deep sequence models
Abstract High accuracy on independent and identically distributed (IID) test data does not reveal which temporal cue a sequence model uses. A directional process can leave a cue in individual frames, so out-of-distribution (OOD) failure alone does not establish temporal-order use. We propose a six-gate audit that attributes failure to a nuisance and distinguishes frame-local, order-invariant multi-frame, and order-encoded cues. A companion controlled benchmark provides the factor-level probes and interventions the audit requires. Applied to this benchmark, the audit revealed that a variant designed to encode temporal order was instead solvable from individual frames. In the strict order-encoded variant (OE-Strict), direction is readable only from interior frame order. With nuisance direction aligned with the label with probability 0.97 during training, a gated recurrent unit (GRU) trained by empirical risk minimization (ERM) selects the shortcut in thirty of thirty seeds (0.970 IID and 0.030 OOD accuracy). Channel-selective interventions attribute the collapse to nuisance frame ordering. The audit distinguishes which process supports a prediction and whether using that process requires temporal order.
Authors
- Dae-Yeol Kim
- Do-Yup Kim (ORCID: https://orcid.org/0000-0002-4165-1323)
- Youngjun Kim
- YoungJae Cho
Institutions
- Changwon National University (KR)
- University of Ulsan (KR)
Publication Details
- Journal
- Scientific Reports
- Published
- 2026-11-15
- DOI
- https://doi.org/10.1038/s41598-026-75482-4
- Primary Topic
- Explainable Artificial Intelligence (XAI)
- Type
- article
- Field-Weighted Citation Impact
- 0.00