SkyQuery: Evaluating LLMs for Decision Making in the CAGE Challenge

─This paper presents a novel framework for developing autonomous cyber defense agents that incorporate defender goals into their decision-making processes. Evaluated within the CAGE Challenge 2 simulation environment, the framework enables agents to adapt their strategies to align with specific objectives, such as maximizing rewards or deploying deception. Leveraging previously validated strategies, the proposed approach enhances the adaptability and effectiveness of cyber defense systems, providing a foundation for addressing evolving threats in dynamic cyber environments.

Authors

Institutions

Publication Details

Published
2025-05-05
DOI
https://doi.org/10.1109/cai64502.2025.00196
Primary Topic
Semantic Web and Ontologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SkyQuery: Evaluating LLMs for Decision Making in the CAGE Challenge

Ryan Gabrys, Daniel Silva, Mark Bilinski
Semantic Web and Ontologies
article

SkyQuery: Evaluating LLMs for Decision Making in the CAGE Challenge

Ryan Gabrys, Daniel Silva, Mark Bilinski
article en

Abstract

─This paper presents a novel framework for developing autonomous cyber defense agents that incorporate defender goals into their decision-making processes. Evaluated within the CAGE Challenge 2 simulation environment, the framework enables agents to adapt their strategies to align with specific objectives, such as maximizing rewards or deploying deception. Leveraging previously validated strategies, the proposed approach enhances the adaptability and effectiveness of cyber defense systems, providing a foundation for addressing evolving threats in dynamic cyber environments.

Naval Information Warfare Center Pacific (US)
Peace, Justice and strong institutions
Openalex Percentile: Top 92%
Semantic Web and Ontologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.