CAMELOT-IDS: a multi-scale transformer with empirical uncertainty diagnostics for IoT intrusion detection

Internet of Things (IoT) intrusion detection must address severe class imbalance, heterogeneous traffic, and potential distribution shift while providing interpretable information about predictive uncertainty. CAMELOT-IDS integrates semantic local-global Transformer encoding, hierarchical supervision, Label-Distribution-Aware Margin loss with deferred reweighting (LDAM-DRW), deterministic Mondrian Regularized Adaptive Prediction Sets (RAPS), and stream-oriented monitoring. On the reported CICIoT2023 analysis subset, the reference model achieved 99.20% fine-class accuracy, 76.76% fine-class macro-F1, and 99.79% malicious-class F1. At α = 0.10, the deterministic RAPS implementation produced 99.95% empirical coverage with a mean prediction-set size of 1.60. Because probability scaling and RAPS-threshold estimation reused the same labeled calibration pool, these set-valued results are interpreted as empirical diagnostics rather than as a formal split-conformal validity result. Batch throughput was 18,141.6 samples/s on an NVIDIA RTX 3060 and 1062.3 samples/s on the tested dual-Xeon platform. Fine-class performance remained highly uneven, with the Uploading Attack class yielding an F1 score of 4.96%. The stream-monitoring pathway produced no trigger during the held-out stream replay. These findings support further provenance-aware external validation, dependence-aware calibration, and controlled distribution-shift evaluation.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-10-31
DOI
https://doi.org/10.1038/s41598-026-79015-x
Primary Topic
Network Security and Intrusion Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CAMELOT-IDS: a multi-scale transformer with empirical uncertainty diagnostics for IoT intrusion detection

Nadeem Sarwar, Imran Sarwar Bajwa, Monia Hamdi, Ali Samad et al.
Scientific Reports
Network Security and Intrusion Detection
article

CAMELOT-IDS: a multi-scale transformer with empirical uncertainty diagnostics for IoT intrusion detection

Nadeem Sarwar, Imran Sarwar Bajwa, Monia Hamdi, Ali Samad, Ayesha Qureshi
article en

Abstract

Internet of Things (IoT) intrusion detection must address severe class imbalance, heterogeneous traffic, and potential distribution shift while providing interpretable information about predictive uncertainty. CAMELOT-IDS integrates semantic local-global Transformer encoding, hierarchical supervision, Label-Distribution-Aware Margin loss with deferred reweighting (LDAM-DRW), deterministic Mondrian Regularized Adaptive Prediction Sets (RAPS), and stream-oriented monitoring. On the reported CICIoT2023 analysis subset, the reference model achieved 99.20% fine-class accuracy, 76.76% fine-class macro-F1, and 99.79% malicious-class F1. At α = 0.10, the deterministic RAPS implementation produced 99.95% empirical coverage with a mean prediction-set size of 1.60. Because probability scaling and RAPS-threshold estimation reused the same labeled calibration pool, these set-valued results are interpreted as empirical diagnostics rather than as a formal split-conformal validity result. Batch throughput was 18,141.6 samples/s on an NVIDIA RTX 3060 and 1062.3 samples/s on the tested dual-Xeon platform. Fine-class performance remained highly uneven, with the Uploading Attack class yielding an F1 score of 4.96%. The stream-monitoring pathway produced no trigger during the held-out stream replay. These findings support further provenance-aware external validation, dependence-aware calibration, and controlled distribution-shift evaluation.

Scientific Reports
Princess Nourah bint Abdulrahman University (SA), Islamia University of Bahawalpur (PK), Bahria University (PK)
Openalex Percentile: Top 12%
Network Security and Intrusion Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon