An Explainable Machine Learning Framework with Large Language Model Features for Predicting Monetary Redress in Bank Fraud and Scam Complaints
Abstract Liability for scam losses is shifting towards banks, yet few interpretable tools can anticipate which fraud and scam complaints will end in redress. This study develops SCAM-XD, an explainable framework that predicts whether a complaint to the US Consumer Financial Protection Bureau (CFPB) flagged as possible fraud or a scam closes with monetary relief reported by the company. From the CFPB narratives archive, the study builds a benchmark of these complaints, about half of which human coders confirm as fraud or scams. A large language model (LLM) codes each narrative for scam type, payment rail, authorisation, manipulation cues and signals of the bank's response, agreeing closely with human coding on scam type. These features are combined with structured fields, company identity and text representations in a stacking ensemble, explained with SHapley Additive exPlanations (SHAP) and linked to a cost-sensitive triage layer. Tested on a later period, SCAM-XD improves significantly on strong baselines across seeds, including a reimplemented topic model approach. LLM features yield a compact, interpretable model that nearly matches a high-dimensional text baseline but do not significantly improve the full model. Company identity is the strongest driver of predicted redress, yet firm identity alone predicts far less well, and payment rail and bank response cues act in directions consistent with liability rules. Under assumed costs, thresholds selected on validation data substantially reduce modelled expected cost relative to standard thresholds, whereas model choice matters much less. Redress depends on both the firm and the facts that determine liability.
Authors
- Urvashi Rahul Saxena (ORCID: https://orcid.org/0000-0002-0419-4530)
- Raza Nowrozy (ORCID: https://orcid.org/0000-0002-9886-0978)
- Tahsien Al‐Quraishi (ORCID: https://orcid.org/0000-0003-3814-0431)
- Jemal Abawajy (13075551)
- Naseer Ali Hussien
- O. S. Albahri
- Islam Mohammad Tahidul
Institutions
- Federation University (AU)
- Deakin University (AU)
- Al-Ayen Iraqi University (IQ)
- Melbourne Institute of Technology (AU)
- Victoria University (AU)
Publication Details
- Journal
- Research Square
- Published
- 2026-11-16
- DOI
- https://doi.org/10.21203/rs.3.rs-11721933/v1
- Primary Topic
- Explainable Artificial Intelligence (XAI)
- Type
- preprint