Unraveling Multi-Stage AI Threat Scenarios with MITRE ATLAS: A Probabilistic Risk Analysis Using Absorbing Markov Chains

Since the public release of ChatGPT in 2022, Large Language Models (LLMs) have rapidly expanded across practical applications, accompanied by increasing concern regarding LLM-targeted cyberattacks. Among these threats, Prompt Injection has remained ranked as LLM01 in both the 2023 and 2025 editions of the OWASP Top 10 for LLM Applications and has been discussed by organizations such as NCSC and IEEE Spectrum as a difficult class of attacks to fully mitigate. While prior studies mainly evaluate Hijacking and Extraction as independent single-stage attacks, probabilistic evaluation of chained multi-stage attack processes remains limited. To address this gap, we formulate a four-step attack scenario derived from MITRE ATLAS as a non-homogeneous absorbing Markov chain and empirically evaluate Meta Llama3:8B using Tensor Trust attack scripts (776 Hijacking and 230 Extraction cases). Our results show that the defense configuration achieving the highest robustness in single-stage Hijacking evaluation ranked lowest under multi-stage attack evaluation, revealing a reversal effect associated with Refusal-Induced Leakage (RIL), We additionally introduce the terms Compliance-Induced Leakage (CIL) and Refusal-Induced Leakage (RIL) to distinguish two empirically observed leakage patterns in LLM refusal responses. In which few-shot-trained models inadvertently disclose sensitive information within refusal responses. Furthermore, combining the Silent Refusal (SR) principle with a three-layer external guardrail achieved 98.3–99.6% attack blocking performance against the evaluated attack scripts.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-05-23
DOI
https://doi.org/10.5281/zenodo.20350013
Primary Topic
Adversarial Robustness in Machine Learning
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Unraveling Multi-Stage AI Threat Scenarios with MITRE ATLAS: A Probabilistic Risk Analysis Using Absorbing Markov Chains

Taiichi Saito, Ryoichi Sasaki, Yoshinari Ito
Zenodo (CERN European Organization for Nuclear Research)
Adversarial Robustness in Machine Learning
preprint

Unraveling Multi-Stage AI Threat Scenarios with MITRE ATLAS: A Probabilistic Risk Analysis Using Absorbing Markov Chains

Taiichi Saito, Ryoichi Sasaki, Yoshinari Ito
preprint en

Abstract

Since the public release of ChatGPT in 2022, Large Language Models (LLMs) have rapidly expanded across practical applications, accompanied by increasing concern regarding LLM-targeted cyberattacks. Among these threats, Prompt Injection has remained ranked as LLM01 in both the 2023 and 2025 editions of the OWASP Top 10 for LLM Applications and has been discussed by organizations such as NCSC and IEEE Spectrum as a difficult class of attacks to fully mitigate. While prior studies mainly evaluate Hijacking and Extraction as independent single-stage attacks, probabilistic evaluation of chained multi-stage attack processes remains limited. To address this gap, we formulate a four-step attack scenario derived from MITRE ATLAS as a non-homogeneous absorbing Markov chain and empirically evaluate Meta Llama3:8B using Tensor Trust attack scripts (776 Hijacking and 230 Extraction cases). Our results show that the defense configuration achieving the highest robustness in single-stage Hijacking evaluation ranked lowest under multi-stage attack evaluation, revealing a reversal effect associated with Refusal-Induced Leakage (RIL), We additionally introduce the terms Compliance-Induced Leakage (CIL) and Refusal-Induced Leakage (RIL) to distinguish two empirically observed leakage patterns in LLM refusal responses. In which few-shot-trained models inadvertently disclose sensitive information within refusal responses. Furthermore, combining the Silent Refusal (SR) principle with a three-layer external guardrail achieved 98.3–99.6% attack blocking performance against the evaluated attack scripts.

Zenodo (CERN European Organization for Nuclear Research)
Tokyo Denki University (JP)
Peace, Justice and strong institutions
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.