Human Detection of AI-Generated Phishing: Study Protocol and Dataset Design for the Threat Terminal Experiment

v1.1: Appended protocol addendum documenting the removal of the email authentication header inspection panel from the platform interface. See Addendum section for rationale and impact on data collection. Original protocol text is unmodifiedThis paper presents the study protocol, dataset design, and methodological framework for an experiment examining which phishing techniques produce the lowest human detection rates when all stimuli are AI-generated at consistent linguistic quality. Data is collected through Threat Terminal, a purpose-built game-based research platform where participants classify AI-generated emails as phishing or legitimate, express confidence in each decision, and receive forensic signal breakdowns after each session. The dataset comprises 1,000 cards across six phishing technique categories and three legitimate email categories. Hypotheses are stated prior to full analysis. Initial pilot data from 70 participants and 996 classified cards confirms platform viability. Empirical findings will be reported in a separate publication upon reaching the target sample of 100 participants.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-03-22
DOI
https://doi.org/10.5281/zenodo.19156047
Primary Topic
Spam and Phishing Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Human Detection of AI-Generated Phishing: Study Protocol and Dataset Design for the Threat Terminal Experiment

Scott Altiparmak
Zenodo (CERN European Organization for Nuclear Research)
Spam and Phishing Detection
article

Human Detection of AI-Generated Phishing: Study Protocol and Dataset Design for the Threat Terminal Experiment

Scott Altiparmak
article en

Abstract

v1.1: Appended protocol addendum documenting the removal of the email authentication header inspection panel from the platform interface. See Addendum section for rationale and impact on data collection. Original protocol text is unmodifiedThis paper presents the study protocol, dataset design, and methodological framework for an experiment examining which phishing techniques produce the lowest human detection rates when all stimuli are AI-generated at consistent linguistic quality. Data is collected through Threat Terminal, a purpose-built game-based research platform where participants classify AI-generated emails as phishing or legitimate, express confidence in each decision, and receive forensic signal breakdowns after each session. The dataset comprises 1,000 cards across six phishing technique categories and three legitimate email categories. Hypotheses are stated prior to full analysis. Initial pilot data from 70 participants and 996 classified cards confirms platform viability. Empirical findings will be reported in a separate publication upon reaching the target sample of 100 participants.

Zenodo (CERN European Organization for Nuclear Research)
Peace, Justice and strong institutions
Openalex Percentile: Top 12%
Spam and Phishing Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.