1347-UR Evaluating LLMs for Cybersecurity Risks

Large Language Models (LLMS) may help identify various cybersecurity issues, but their predictions can be incorrect or inconsistent. This project developed a Python evaluation pipeline in Google Colab to test LLM performance across five test cases: Phishing Emails, Source-code Vulnerabilities, Malicious Network Events, Prompt Injections, and malware-related threat classifications. Using public or curated data we can send samples to the LLMs, parse the predictions, and compare with expected outcomes to judge strengths and limitations. This research focuses on measuring LLM assistance, and not replacing security judgement.

Authors

Institutions

Publication Details

Journal
DigitalCommons - Kennesaw State University (Kennesaw State University)
Published
2026-11-20
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

1347-UR Evaluating LLMs for Cybersecurity Risks

Tyler Day, KC Achukwu
DigitalCommons - Kennesaw State University (Kennesaw State University)
Adversarial Robustness in Machine Learning
article

1347-UR Evaluating LLMs for Cybersecurity Risks

Tyler Day, KC Achukwu
article en

Abstract

Large Language Models (LLMS) may help identify various cybersecurity issues, but their predictions can be incorrect or inconsistent. This project developed a Python evaluation pipeline in Google Colab to test LLM performance across five test cases: Phishing Emails, Source-code Vulnerabilities, Malicious Network Events, Prompt Injections, and malware-related threat classifications. Using public or curated data we can send samples to the LLMs, parse the predictions, and compare with expected outcomes to judge strengths and limitations. This research focuses on measuring LLM assistance, and not replacing security judgement.

DigitalCommons - Kennesaw State University (Kennesaw State University)
Kennesaw State University (US)
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
1347-UR Evaluating LLMs for Cybersecurity Risks — Tyler Day, KC Achukwu · DigitalCommons - Kennesaw State University (Kennesaw State University) (2026) | TGRS Research Map | TGRS