Scalp EEG seizure warning in children under a pre-specified, locked evaluation: confound audit, structured chance levels and a negative result
Reported performance of scalp electroencephalographic (EEG) seizure prediction is often inflated by lenient evaluation and by the vigilance-state, clock-time and admission-trend structure of monitoring data. We asked how much short-horizon warning survives a pre-specified, locked evaluation. Continuous video-EEG from 21 monitored children (1315 h) formed the development cohort. A statistical-process-control warning method, evaluated under a written protocol, detected 44% of evaluable seizures at 0.48 false alarms per hour, no better than a random predictor (51%, p = 0.86); its statistic moved three times more with vigilance state than with seizure approach. We re-designed it as a state-conditioned, directional scheme on seven global EEG features, froze it with a hash-recorded configuration and time-stamped pre-specification, and estimated its performance by nested leave-one-patient-out cross-validation: 15 of 45 seizures (33%) at 0.47 false alarms per hour, above analytic (21%, p = 0.034) and permutation chance, but a predictor using only clock time, vigilance state and days since admission reproduced most of this, and the signal was confined to the last 30 min. Applied once to two validation cohorts (a second batch from the same unit and the public CHB-MIT database; 101 evaluable seizures), the frozen scheme detected 19 seizures (19%) at 0.60 false alarms per hour against 26% chance (p = 0.96); no secondary endpoint was met, and with the child as the unit of analysis no cohort was above chance. Scalp-EEG warning should be evaluated under pre-specified rules against structured chance levels; the frozen scheme and framework are offered as a reference.
Authors
- Guojing Yu (ORCID: https://orcid.org/0000-0002-1858-5217)
- Taoyun Ji (ORCID: https://orcid.org/0000-0003-0098-3257)
- Quansheng Ren (ORCID: https://orcid.org/0000-0001-8698-9603)
- Xiwen Lai
- Pan Gong (ORCID: https://orcid.org/0000-0003-2459-124X)
- Zeyu Wu (ORCID: https://orcid.org/0009-0008-8527-7450)
- Shuai Xu (ORCID: https://orcid.org/0000-0002-6878-7378)
- Jingtong Li
- Yiming Zhang (ORCID: https://orcid.org/0009-0004-1494-3437)
- Xiaoyan Liu
- Mufeng Chen (ORCID: https://orcid.org/0009-0003-7980-0253)
- Bomiao Sun
- Jiayi Yao
- Hui Zhang
- Shuang Wang
- Hongrui Zhang
- Qi Wu
Institutions
- Beijing University of Posts and Telecommunications (CN)
- Minzu University of China (CN)
- Shanghai Jiao Tong University (CN)
- Peking University (CN)
- Beijing Normal University (CN)
- University of Oxford (GB)
- Nanjing University of Posts and Telecommunications (CN)
- Peking University First Hospital (CN)
- Aerospace Information Research Institute (CN)
- Communication University of China (CN)
Publication Details
- Journal
- medRxiv
- Published
- 2026-11-10
- DOI
- https://doi.org/10.64898/2026.11.10.26367449
- Primary Topic
- EEG and Brain-Computer Interfaces
- Type
- preprint