Cybersecurity Quizzes: A Call for Better Tests

Combatting cyber-attacks relies on the users of the system being properly educated on how to recognize and respond to the attack. Evaluating a user’s cyber awareness knowledge through testing allows for the ability to certify that users are prepared for possible threats they may face online. This study examines the validity of currently available tests of cyber awareness on three criteria: readability, taxonomy type, and relevancy. By using the chosen criteria, the sampled tests can be assessed on whether they are accessible for the average reader, whether the questions require a response that demonstrates the ability to apply the knowledge, and if the questions cover relevant cyber threats. The sampled tests were shown to be mostly above average U.S. reading level. The taxonomy of the test questions was shown to rely mostly on the remembering and understanding dimensions. The content of the tests was shown to overall cover questions pertaining to relevant cyber-attack threats. Readability of the tests was shown to be the most prevalent issue with the currently used tests making accessibility for the average reader a concern.