Beyond Structural Equation Modeling: A Complementary ML-XAI Approach to Predicting and Interpreting Phishing Security Behavior

Phishing remains one of the most prevalent cybersecurity threats, yet behavioral research has relied predominantly on Structural Equation Modeling, a method optimized for population-level explanation but limited for individual-level prediction. This study applies a complementary Machine Learning and Explainable AI framework to predict phishing-related email security behavior among 535 university students. Seven supervised classification algorithms were evaluated within a cross-validation pipeline; Random Forest achieved the strongest performance (accuracy = 0.8505; ROC-AUC = 0.920). Explainability techniques including SHAP, LIME, DiCE counterfactual analysis, and SHAP-value clustering revealed that insecure behavior primarily reflects a failure of behavioral activation rather than awareness deficit. Perceived importance emerged as the dominant behavioral driver, while cluster analysis identified four statistically validated behavioral profiles with distinct intervention requirements. These findings challenge information-deficit assumptions underlying conventional awareness programs and demonstrate how predictive modeling can enable personalized, activation-oriented phishing mitigation strategies.

Authors

Institutions

Publication Details

Journal
International Journal of Human-Computer Interaction
Published
2026-06-24
DOI
https://doi.org/10.1080/10447318.2026.2688498
Primary Topic
Spam and Phishing Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Beyond Structural Equation Modeling: A Complementary ML-XAI Approach to Predicting and Interpreting Phishing Security Behavior

Mohan Bhandari, Anderson Kevin Gwenhure
International Journal of Human-Computer Interaction
Spam and Phishing Detection
article

Beyond Structural Equation Modeling: A Complementary ML-XAI Approach to Predicting and Interpreting Phishing Security Behavior

Mohan Bhandari, Anderson Kevin Gwenhure
article en

Abstract

Phishing remains one of the most prevalent cybersecurity threats, yet behavioral research has relied predominantly on Structural Equation Modeling, a method optimized for population-level explanation but limited for individual-level prediction. This study applies a complementary Machine Learning and Explainable AI framework to predict phishing-related email security behavior among 535 university students. Seven supervised classification algorithms were evaluated within a cross-validation pipeline; Random Forest achieved the strongest performance (accuracy = 0.8505; ROC-AUC = 0.920). Explainability techniques including SHAP, LIME, DiCE counterfactual analysis, and SHAP-value clustering revealed that insecure behavior primarily reflects a failure of behavioral activation rather than awareness deficit. Perceived importance emerged as the dominant behavioral driver, while cluster analysis identified four statistically validated behavioral profiles with distinct intervention requirements. These findings challenge information-deficit assumptions underlying conventional awareness programs and demonstrate how predictive modeling can enable personalized, activation-oriented phishing mitigation strategies.

International Journal of Human-Computer Interaction
Hodges University (US), Atma Jaya University Yogyakarta (ID), Samaritan Hospital (US)
Openalex Percentile: Top 3%
Spam and Phishing Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.