YOLO world guides open world video anomaly detection
Abstract Video anomaly detection is important for safety-critical monitoring, yet deployed systems must recognize anomaly categories absent from training. Existing weakly supervised and vision-language methods emphasize video- or segment-level scores or text–video similarity, limiting object-centric temporal reasoning and direct known-versus-unknown separation. To address these limitations, this paper proposes OW-YW-VAD, an object-centric open-world video anomaly detection framework. YOLO-World provides open-vocabulary object evidence, ByteTrack forms trajectories, and a temporal convolutional encoder and interaction module model motion and context. Known-class confidence, normal-memory distance, regional dynamics, and semantic uncertainty are fused to produce localized normal, known-anomaly, and unknown-anomaly decisions. Experimental results show that OW-YW-VAD obtains 76.10%, 98.60%, and 90.12% on UBnormal, ShanghaiTech, and UCF-Crime, respectively, in independent benchmark-specific Protocol-A real-video experiments. Experimental results show that the five-seed held-out-category real-video experiment yields a known-versus-unknown AUROC of 96.36±0.25%, OSCR of 88.67±0.19%, and unknown-class F1 of 90.50±0.16%. The prompt-role ablation further shows that object prompts dominate the fused decision, while the auxiliary prompt groups do not yet contribute positively under the held-out-category protocol. Experimental results show that the evaluation quantifies both benchmark anomaly detection and direct known-versus-unknown separation under the declared protocols.
Authors
- Liming Wang (ORCID: https://orcid.org/0000-0002-4178-3537)
- Xiangjun Chen (ORCID: https://orcid.org/0000-0003-0766-3416)
- Xiaocheng Huang (ORCID: https://orcid.org/0009-0004-1615-1257)
- Youxi Li
- Qiang Liu
Institutions
- Zhejiang Institute of Special Equipment Inspection (CN)
- Hangzhou DAC Biotech (China) (CN)
Publication Details
- Journal
- Scientific Reports
- Published
- 2026-09-18
- DOI
- https://doi.org/10.1038/s41598-026-69765-z
- Primary Topic
- Anomaly Detection Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00