Certiguard: a fine-tuned LLM for mastering security certification exams

Cybersecurity certification exams have become an important pathway for developing professional competence, yet preparation for exams such as CISA, CRISC, CEH, and CCNA often relies on fragmented materials, costly training programs, and limited individualized feedback. This study introduces CertiGuard, a resource-efficient cybersecurity training framework built on LLaMA-2-7B. The model is adapted through a two-stage process: continued pre-training on a curated cybersecurity corpus, followed by supervised fine-tuning with certification-aligned instructions. To reduce the computational cost of domain adaptation, the framework applies QLoRA-based fine-tuning and organizes model use through beginner, intermediate, and advanced proficiency tiers. Experiments were conducted on four certification-oriented question-answering datasets covering auditing, risk and control, ethical hacking, and networking domains. The base Certibase model achieved an average accuracy of 54.1%, while the best structured prompt improved the average accuracy to 72.0%. Further evaluation of reasoning strategies showed that self-consistency Chain-of-Thought achieved the strongest overall performance, reaching an average accuracy of 86.5% across the four exam domains. The results suggest that domain adaptation, structured prompting, and reasoning-oriented inference can substantially improve LLM performance on cybersecurity certification questions. At the same time, the study highlights practical limitations related to small evaluation sets, dataset provenance, copyright restrictions, and the need for broader human-centered evaluation. Overall, CertiGuard provides a lightweight and scalable approach for certification-oriented cybersecurity training, while offering a basis for future adaptive learning systems and reproducible evaluation benchmarks.

Authors

Institutions

Publication Details

Journal
International Journal of Information Security
Published
2026-09-04
DOI
https://doi.org/10.1007/s10207-026-01317-y
Primary Topic
Information and Cyber Security
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Certiguard: a fine-tuned LLM for mastering security certification exams

Chun-Ming Lai, Li-Di Chang, Yi-Chao Wu, Chun-Chieh Chang
International Journal of Information Security
Information and Cyber Security
article

Certiguard: a fine-tuned LLM for mastering security certification exams

Chun-Ming Lai, Li-Di Chang, Yi-Chao Wu, Chun-Chieh Chang
article en

Abstract

Cybersecurity certification exams have become an important pathway for developing professional competence, yet preparation for exams such as CISA, CRISC, CEH, and CCNA often relies on fragmented materials, costly training programs, and limited individualized feedback. This study introduces CertiGuard, a resource-efficient cybersecurity training framework built on LLaMA-2-7B. The model is adapted through a two-stage process: continued pre-training on a curated cybersecurity corpus, followed by supervised fine-tuning with certification-aligned instructions. To reduce the computational cost of domain adaptation, the framework applies QLoRA-based fine-tuning and organizes model use through beginner, intermediate, and advanced proficiency tiers. Experiments were conducted on four certification-oriented question-answering datasets covering auditing, risk and control, ethical hacking, and networking domains. The base Certibase model achieved an average accuracy of 54.1%, while the best structured prompt improved the average accuracy to 72.0%. Further evaluation of reasoning strategies showed that self-consistency Chain-of-Thought achieved the strongest overall performance, reaching an average accuracy of 86.5% across the four exam domains. The results suggest that domain adaptation, structured prompting, and reasoning-oriented inference can substantially improve LLM performance on cybersecurity certification questions. At the same time, the study highlights practical limitations related to small evaluation sets, dataset provenance, copyright restrictions, and the need for broader human-centered evaluation. Overall, CertiGuard provides a lightweight and scalable approach for certification-oriented cybersecurity training, while offering a basis for future adaptive learning systems and reproducible evaluation benchmarks.

International Journal of Information SecurityVol. 25(5)
National Taipei University of Technology (TW), Tunghai University (TW)
National Science and Technology Council, National Science and Technology Council
Industry, innovation and infrastructure
Openalex Percentile: Top 4%
Information and Cyber Security
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.