Real-Time Fraud Detection Using Large Language Models: A Context-Aware System for Mitigating Social Engineering Threats

The massive digitalization of the communication environment has created fertile ground for increasingly sophisticated social engineering attacks, which exploit human psychology rather than technical flaws. Online criminal activity: Today, fraudsters hijack real-time conversations across voice calls, chat platforms, and emails to trick individuals and organizations into divulging private information or approving fraudulent transactions. Traditional fraud detection strategies, which rely mostly on static keyword-based heuristics or predefined rule-based detection, have proven to be less effective against these dynamic and adaptive threats. Therefore, in this paper, we propose a real-time fraud detection model based on fine-tuned large language models (LLMs) to bridge this gap. Unlike conventional systems, the proposed architecture leverages deep contextual understanding, semantic reasoning, and intent classification to identify suspicious interactions in live communication environments. The system integrates several key components: a speech-to-text transcription pipeline for converting voice calls into structured text; a retrieval-augmented generation (RAG) mechanism that incorporates organizational policies and domain-specific knowledge into decision-making; and a feedback loop enabling continuous adaptation to novel fraud strategies. In addition, the framework utilizes a scenario generator to augment the datasets, generating contrastive benign versus malicious dialogue as a means to enhance model robustness. Trained with LoRA and quantization techniques for efficiency reasons, the model performs well on controlled evaluations, reaching over 97% accuracy in predicting the intent of fraudulent messages within three conversational turns. Real-world deployment results demonstrate tangible improvements in incidents related to fraud, enhanced decision support for analysts utilizing outputs from explainable AI, and increased flexibility in responding to new threats. In addition to advancing the technical state of fraud detection research, this work also contributes to the broader research efforts on cybersecurity resiliency by demonstrating the feasibility of operationalizing LLMs for high-stakes real-time applications.

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-06-30
DOI
https://doi.org/10.5281/zenodo.17481230
Primary Topic
Spam and Phishing Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Real-Time Fraud Detection Using Large Language Models: A Context-Aware System for Mitigating Social Engineering Threats

Zenodo (CERN European Organization for Nuclear Research)
Spam and Phishing Detection
article

Real-Time Fraud Detection Using Large Language Models: A Context-Aware System for Mitigating Social Engineering Threats

article en

Abstract

The massive digitalization of the communication environment has created fertile ground for increasingly sophisticated social engineering attacks, which exploit human psychology rather than technical flaws. Online criminal activity: Today, fraudsters hijack real-time conversations across voice calls, chat platforms, and emails to trick individuals and organizations into divulging private information or approving fraudulent transactions. Traditional fraud detection strategies, which rely mostly on static keyword-based heuristics or predefined rule-based detection, have proven to be less effective against these dynamic and adaptive threats. Therefore, in this paper, we propose a real-time fraud detection model based on fine-tuned large language models (LLMs) to bridge this gap. Unlike conventional systems, the proposed architecture leverages deep contextual understanding, semantic reasoning, and intent classification to identify suspicious interactions in live communication environments. The system integrates several key components: a speech-to-text transcription pipeline for converting voice calls into structured text; a retrieval-augmented generation (RAG) mechanism that incorporates organizational policies and domain-specific knowledge into decision-making; and a feedback loop enabling continuous adaptation to novel fraud strategies. In addition, the framework utilizes a scenario generator to augment the datasets, generating contrastive benign versus malicious dialogue as a means to enhance model robustness. Trained with LoRA and quantization techniques for efficiency reasons, the model performs well on controlled evaluations, reaching over 97% accuracy in predicting the intent of fraudulent messages within three conversational turns. Real-world deployment results demonstrate tangible improvements in incidents related to fraud, enhanced decision support for analysts utilizing outputs from explainable AI, and increased flexibility in responding to new threats. In addition to advancing the technical state of fraud detection research, this work also contributes to the broader research efforts on cybersecurity resiliency by demonstrating the feasibility of operationalizing LLMs for high-stakes real-time applications.

Zenodo (CERN European Organization for Nuclear Research)
Oldham Council (GB)
Peace, Justice and strong institutions
Openalex Percentile: Top 32%
Spam and Phishing Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.