LLM-guided contrastive evidence mining for explainable cyber threat intelligence classification

Translating unstructured cyber threat intelligence (CTI) reports into the MITRE ATT&CK catalog is a cognitively demanding security operations task, and existing automated approaches face a trade-off between accuracy, faithful explanations, and coverage of rarely seen attack techniques. We present CSEM-CTI, a contextual self-adversarial evidence-mining framework built upon the self-adversarial tactic generation paradigm. The framework combines a domain-adapted SecureBERT encoder, LLM-guided prototype initialization using GPT-4o, a contrastive InfoNCE-based necessity loss, and a hierarchical tactic-conditioned focal classifier. Across three CTI corpora, CSEM-CTI reaches a tactic macro-F1 of 0.939 and a technique macro-F1 of 0.481, with rare-class macro-F1 rising from 0.083 to 0.363, ERASER comprehensiveness of 0.847 and sufficiency of 0.923, and a TextFooler attack success rate of 5.5%. The results indicate that representation quality, prototype geometry, and necessity loss formulation are coupled architectural choices that jointly determine accuracy, explanation faithfulness, and robustness, supporting deployment of auditable TTP classification in security workflows.

Authors

Institutions

Publication Details

Journal
iScience
Published
2026-06-25
DOI
https://doi.org/10.1016/j.isci.2026.116466
Primary Topic
Cybercrime and Law Enforcement Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LLM-guided contrastive evidence mining for explainable cyber threat intelligence classification

Azhar Imran, Natalia Kryvinska, Ahmad Alshammari, Shanshan Tu et al.
iScience
Cybercrime and Law Enforcement Studies
article

LLM-guided contrastive evidence mining for explainable cyber threat intelligence classification

Azhar Imran, Natalia Kryvinska, Ahmad Alshammari, Shanshan Tu, Jin Peng
article en

Abstract

Translating unstructured cyber threat intelligence (CTI) reports into the MITRE ATT&CK catalog is a cognitively demanding security operations task, and existing automated approaches face a trade-off between accuracy, faithful explanations, and coverage of rarely seen attack techniques. We present CSEM-CTI, a contextual self-adversarial evidence-mining framework built upon the self-adversarial tactic generation paradigm. The framework combines a domain-adapted SecureBERT encoder, LLM-guided prototype initialization using GPT-4o, a contrastive InfoNCE-based necessity loss, and a hierarchical tactic-conditioned focal classifier. Across three CTI corpora, CSEM-CTI reaches a tactic macro-F1 of 0.939 and a technique macro-F1 of 0.481, with rare-class macro-F1 rising from 0.083 to 0.363, ERASER comprehensiveness of 0.847 and sufficiency of 0.923, and a TextFooler attack success rate of 5.5%. The results indicate that representation quality, prototype geometry, and necessity loss formulation are coupled architectural choices that jointly determine accuracy, explanation faithfulness, and robustness, supporting deployment of auditable TTP classification in security workflows.

iScienceVol. 29(7)
Northern Border University (SA), Beijing University of Technology (CN), Comenius University Bratislava (SK)
Openalex Percentile: Top 3%
Cybercrime and Law Enforcement Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.