From alerts to action: developing a communication quality index for public institutional cybersecurity warnings

Purpose This study aims to develop and apply the Cybersecurity Communication Quality Index (CCQI) to assess the observable quality of public institutional cybersecurity warnings. It examines whether warnings provide the communication qualities needed for threat recognition, feasible action, temporal interpretation, credibility, preventive learning and post-exposure user support. Design/methodology/approach A deductive qualitative content analysis was conducted on 55 public cybersecurity risk messages issued between 2023 and 2025 by Croatian institutional and public-service sources. Each message was independently coded by two coders across six CCQI dimensions using a predefined three-point ordinal instrument. Intercoder reliability was assessed using exact agreement and weighted Cohen’s kappa before adjudication. The final data set was analysed descriptively by overall score, dimension, source family and year. Findings The corpus achieved a high mean CCQI score of 90.5 on a 0–100 scale. Threat recognition clarity and credibility were the strongest dimensions, showing that most messages made the threat recognisable and institutionally verifiable. User support orientation was the weakest relative dimension, indicating less consistent guidance on reporting, verification, assistance or recovery after possible exposure. The high scores require cautious interpretation because of possible ceiling effects, corpus selection and differences in the applicability of the scoring criteria across message types. Practical implications The CCQI offers institutions a transparent review tool for strengthening public cybersecurity warnings before or after publication. It can help communication and cybersecurity teams identify whether warnings provide concrete action steps, verification routes, preventive learning and post-exposure support, rather than merely naming a threat or issuing general caution. Social implications Clearer cybersecurity warnings can help citizens recognise online threats, take protective action and seek assistance after possible exposure. By identifying whether public warnings provide concrete action steps, verification routes and recovery guidance, the CCQI can support more user-oriented institutional communication. This is socially relevant because phishing, impersonation scams and digital fraud increasingly affect everyday users who must make quick decisions under uncertainty. Originality/value The study treats institutional cybersecurity warnings as evaluable communication artefacts and introduces a replicable message-level diagnostic index that distinguishes aggregate quality from dimension-specific strengths and weaknesses.

Authors

Institutions

Publication Details

Journal
Information and Computer Security
Published
2026-11-16
DOI
https://doi.org/10.1108/ics-05-2026-0332
Primary Topic
Information and Cyber Security
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

From alerts to action: developing a communication quality index for public institutional cybersecurity warnings

Marija Boban, Marija Gombar
1 links
Information and Computer Security
Information and Cyber Security
article

From alerts to action: developing a communication quality index for public institutional cybersecurity warnings

Marija Boban, Marija Gombar
article en

Abstract

Purpose This study aims to develop and apply the Cybersecurity Communication Quality Index (CCQI) to assess the observable quality of public institutional cybersecurity warnings. It examines whether warnings provide the communication qualities needed for threat recognition, feasible action, temporal interpretation, credibility, preventive learning and post-exposure user support. Design/methodology/approach A deductive qualitative content analysis was conducted on 55 public cybersecurity risk messages issued between 2023 and 2025 by Croatian institutional and public-service sources. Each message was independently coded by two coders across six CCQI dimensions using a predefined three-point ordinal instrument. Intercoder reliability was assessed using exact agreement and weighted Cohen’s kappa before adjudication. The final data set was analysed descriptively by overall score, dimension, source family and year. Findings The corpus achieved a high mean CCQI score of 90.5 on a 0–100 scale. Threat recognition clarity and credibility were the strongest dimensions, showing that most messages made the threat recognisable and institutionally verifiable. User support orientation was the weakest relative dimension, indicating less consistent guidance on reporting, verification, assistance or recovery after possible exposure. The high scores require cautious interpretation because of possible ceiling effects, corpus selection and differences in the applicability of the scoring criteria across message types. Practical implications The CCQI offers institutions a transparent review tool for strengthening public cybersecurity warnings before or after publication. It can help communication and cybersecurity teams identify whether warnings provide concrete action steps, verification routes, preventive learning and post-exposure support, rather than merely naming a threat or issuing general caution. Social implications Clearer cybersecurity warnings can help citizens recognise online threats, take protective action and seek assistance after possible exposure. By identifying whether public warnings provide concrete action steps, verification routes and recovery guidance, the CCQI can support more user-oriented institutional communication. This is socially relevant because phishing, impersonation scams and digital fraud increasingly affect everyday users who must make quick decisions under uncertainty. Originality/value The study treats institutional cybersecurity warnings as evaluable communication artefacts and introduces a replicable message-level diagnostic index that distinguishes aggregate quality from dimension-specific strengths and weaknesses.

Information and Computer Security
University of Split (HR)
Information and Cyber Security
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon