Multimodal Detection and Analysis of Impersonation-Based Cyber Scams

Impersonation-based cyber scams exploit the trust associated with legitimate individuals, organizations, brands, and public institutions. Such attacks are distributed through multiple digital channels and may combine deceptive messages, suspicious URLs, copied visual identities, QR codes, documents, and video-based content. Detection systems that examine only one evidence type can overlook cross-modal indicators or fail to explain why an input appears risky. This paper presents a proposed multimodal framework for detecting and analyzing impersonation-based cyber scams through modality-specific processing and evidence-aware risk assessment. Text and email content will be analyzed using contextual language models such as BERT; URL characteristics will be evaluated using structured features and an XGBoost-based classifier; image and screenshot evidence will be examined through OCR and visual similarity analysis; and QR codes and documents will be decoded or parsed to extract actionable text and links. Optional video processing will use bounded frame sampling and, where feasible, speech transcription. The resulting modality-level outputs will be combined through a calibrated evidence-fusion stage that considers supporting indicators, contradictions, unavailable modalities, and uncertainty. The system is intended to produce a risk band, supporting evidence, and safe recommendations rather than a definitive legal or factual judgment. Since the project is proposed and implementation/evaluation are ongoing, this paper defines the research problem, framework, methodology, and evaluation protocol; it does not report fabricated experimental results.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-12
DOI
https://doi.org/10.5281/zenodo.24161148
Primary Topic
Spam and Phishing Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Multimodal Detection and Analysis of Impersonation-Based Cyber Scams

Vaishnavi Wankhade, Shakshi Sharma, Swarali Jadhav, Mayur Dongare et al.
Zenodo (CERN European Organization for Nuclear Research)
Spam and Phishing Detection
article

Multimodal Detection and Analysis of Impersonation-Based Cyber Scams

Vaishnavi Wankhade, Shakshi Sharma, Swarali Jadhav, Mayur Dongare, Om Charthal, Prof. Dr. P. S. Deshmukh
article en

Abstract

Impersonation-based cyber scams exploit the trust associated with legitimate individuals, organizations, brands, and public institutions. Such attacks are distributed through multiple digital channels and may combine deceptive messages, suspicious URLs, copied visual identities, QR codes, documents, and video-based content. Detection systems that examine only one evidence type can overlook cross-modal indicators or fail to explain why an input appears risky. This paper presents a proposed multimodal framework for detecting and analyzing impersonation-based cyber scams through modality-specific processing and evidence-aware risk assessment. Text and email content will be analyzed using contextual language models such as BERT; URL characteristics will be evaluated using structured features and an XGBoost-based classifier; image and screenshot evidence will be examined through OCR and visual similarity analysis; and QR codes and documents will be decoded or parsed to extract actionable text and links. Optional video processing will use bounded frame sampling and, where feasible, speech transcription. The resulting modality-level outputs will be combined through a calibrated evidence-fusion stage that considers supporting indicators, contradictions, unavailable modalities, and uncertainty. The system is intended to produce a risk band, supporting evidence, and safe recommendations rather than a definitive legal or factual judgment. Since the project is proposed and implementation/evaluation are ongoing, this paper defines the research problem, framework, methodology, and evaluation protocol; it does not report fabricated experimental results.

Zenodo (CERN European Organization for Nuclear Research)
Spam and Phishing Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon