Identifiering av anomalier i Automatic Dependent Surveillance Broadcast med Explainable AI : Förbättrar tillit med SHapley Additive exPlanations

Automatic Dependent Surveillance–Broadcast (ADS-B) is a core component of modern air traffic management, enabling aircraft to broadcast real-time information such as position and velocity. However, the protocol lacks cryptographic protection, making it susceptible to spoofing, message injection, and data manipulation. In response to these threats, this thesis explores a reconstruction-based anomaly detection approach using Long Short-Term Memory (LSTM) autoencoders. The model is trained on a hybrid dataset consisting of real ADS-B data from the OpenSky Network and synthetic attack scenarios generated via AttackScope. A second model was also trained on a smaller dataset, which only used real data to verify the robustness. To address the "black box" nature of deep learning models, explainable AI (XAI) techniques are applied, with a primary focus on SHapley Additive exPlanations (SHAP) and a comparative evaluation using Local Interpretable Model-Agnostic Explanations (LIME). The LSTM autoencoder trained on the simulated data achieves strong performance, with a precision of 0.9951, a recall of 0.7588, and an AUC-ROC of 0.9591, confirming its ability to distinguish between benign and anomalous flight sequences. The model trained on the real data achieved a perfect score, getting a score of 1.0 inaccuracy, precision, recall, F1-Score and AUC-ROC. This further confirms its ability to differentiate between normal and anomalous flight behavior. SHAP visualizations provide global and local insight into model behavior. Features such as geo_altitude and long are consistently identified as key contributors to anomaly detection. The results also show distinct attribution patterns between the normal and manipulated sequences. Altough LIME offers supporting explanations, its higher variability suggests that SHAP is better suited for applications requiring interpretive stability. This study shows that using SHAP to explain LSTM-bases anomaly detection yields interpretable results without compromising classification performance, which may helpinform future deployment of machine learning tools in surveillance applications.

Publication Details

Journal
KTH Publication Database DiVA (KTH Royal Institute of Technology)
Published
2025-01-01
Primary Topic
Geochemistry and Geologic Mapping
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Identifiering av anomalier i Automatic Dependent Surveillance Broadcast med Explainable AI : Förbättrar tillit med SHapley Additive exPlanations

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Geochemistry and Geologic Mapping
article

Identifiering av anomalier i Automatic Dependent Surveillance Broadcast med Explainable AI : Förbättrar tillit med SHapley Additive exPlanations

article en

Abstract

Automatic Dependent Surveillance–Broadcast (ADS-B) is a core component of modern air traffic management, enabling aircraft to broadcast real-time information such as position and velocity. However, the protocol lacks cryptographic protection, making it susceptible to spoofing, message injection, and data manipulation. In response to these threats, this thesis explores a reconstruction-based anomaly detection approach using Long Short-Term Memory (LSTM) autoencoders. The model is trained on a hybrid dataset consisting of real ADS-B data from the OpenSky Network and synthetic attack scenarios generated via AttackScope. A second model was also trained on a smaller dataset, which only used real data to verify the robustness. To address the "black box" nature of deep learning models, explainable AI (XAI) techniques are applied, with a primary focus on SHapley Additive exPlanations (SHAP) and a comparative evaluation using Local Interpretable Model-Agnostic Explanations (LIME). The LSTM autoencoder trained on the simulated data achieves strong performance, with a precision of 0.9951, a recall of 0.7588, and an AUC-ROC of 0.9591, confirming its ability to distinguish between benign and anomalous flight sequences. The model trained on the real data achieved a perfect score, getting a score of 1.0 inaccuracy, precision, recall, F1-Score and AUC-ROC. This further confirms its ability to differentiate between normal and anomalous flight behavior. SHAP visualizations provide global and local insight into model behavior. Features such as geo_altitude and long are consistently identified as key contributors to anomaly detection. The results also show distinct attribution patterns between the normal and manipulated sequences. Altough LIME offers supporting explanations, its higher variability suggests that SHAP is better suited for applications requiring interpretive stability. This study shows that using SHAP to explain LSTM-bases anomaly detection yields interpretable results without compromising classification performance, which may helpinform future deployment of machine learning tools in surveillance applications.

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Openalex Percentile: Top 68%
Geochemistry and Geologic Mapping
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.