FraudDebate-Agent: A Multi-Agent LLM Framework with an Evidence-Based Debate Mechanism for Financial Statement Fraud Detection

Financial statement fraud inflicts large and recurring losses on capital markets, yet the dominant detection paradigm still relies on single, black-box classifiers (e.g., RUSBoost) trained on structured accounting ratios alone. Two limitations follow: (i) the rich, unstructured Management Discussion and Analysis (MD&A) narrative of the 10-K filing is discarded, and (ii) the resulting scores are difficult for auditors to trust because they carry no transparent, standards-aligned rationale. Recent large language model (LLM) systems have shown that multi-agent collaboration is more robust than a single LLM for anomaly detection, but no study has systematically transferred this paradigm to listed-company statement fraud. We propose FraudDebate-Agent, a four-role multi-agent system in which a Quantitative Analyst agent scores 28 raw accounting items and 14 ratios with gradient-boosted and tabular attention models, a Narrative Auditor agent quantifies tone, linguistic uncertainty, and year-over-year textual novelty of the MD&A with FinBERT, and an Industry Peer agent uses retrieval-augmented generation to measure industry-relative anomaly. A Critic–Debate agent then orchestrates a pair-wise Evidence-based Multi-Agent Debate (EMAD) that reconciles disagreement across modalities and arbitrates a reconciled fraud-risk assessment, which is aggregated over a tri-modal evidence graph. Our contributions are as follows: (1) the first use of an evidence-grounded debate mechanism for accounting fraud, which materially reduces LLM hallucination; (2) a numerical–textual–peer evidence graph that fuses heterogeneous signals; and (3) an explainable report aligned with the PCAOB AS 2401 fraud-risk taxonomy. On AAER-labelled firm-years linked across a SEC financial dataset and EDGAR-CORPUS, FraudDebate-Agent improves the area under the ROC curve and the rare-event ranking metric NDCG@k over the strongest single-modality and single-LLM baselines while producing substantially more faithful explanations. We frame the system as a fraud-risk screening and risk-ranking tool for AAER-labelled misstatement risk rather than a determination of fraudulent intent. We report results over multiple seeds to reflect real-world stochasticity and discuss limitations and cross-domain applications.

Authors

Institutions

Publication Details

Journal
Mathematics
Published
2026-07-27
DOI
https://doi.org/10.3390/math14152695
Primary Topic
Auditing, Earnings Management, Governance
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

FraudDebate-Agent: A Multi-Agent LLM Framework with an Evidence-Based Debate Mechanism for Financial Statement Fraud Detection

Wenhe Liu, Jie Yang, Xinran Yue
Mathematics
Auditing, Earnings Management, Governance
article

FraudDebate-Agent: A Multi-Agent LLM Framework with an Evidence-Based Debate Mechanism for Financial Statement Fraud Detection

Wenhe Liu, Jie Yang, Xinran Yue
article en

Abstract

Financial statement fraud inflicts large and recurring losses on capital markets, yet the dominant detection paradigm still relies on single, black-box classifiers (e.g., RUSBoost) trained on structured accounting ratios alone. Two limitations follow: (i) the rich, unstructured Management Discussion and Analysis (MD&A) narrative of the 10-K filing is discarded, and (ii) the resulting scores are difficult for auditors to trust because they carry no transparent, standards-aligned rationale. Recent large language model (LLM) systems have shown that multi-agent collaboration is more robust than a single LLM for anomaly detection, but no study has systematically transferred this paradigm to listed-company statement fraud. We propose FraudDebate-Agent, a four-role multi-agent system in which a Quantitative Analyst agent scores 28 raw accounting items and 14 ratios with gradient-boosted and tabular attention models, a Narrative Auditor agent quantifies tone, linguistic uncertainty, and year-over-year textual novelty of the MD&A with FinBERT, and an Industry Peer agent uses retrieval-augmented generation to measure industry-relative anomaly. A Critic–Debate agent then orchestrates a pair-wise Evidence-based Multi-Agent Debate (EMAD) that reconciles disagreement across modalities and arbitrates a reconciled fraud-risk assessment, which is aggregated over a tri-modal evidence graph. Our contributions are as follows: (1) the first use of an evidence-grounded debate mechanism for accounting fraud, which materially reduces LLM hallucination; (2) a numerical–textual–peer evidence graph that fuses heterogeneous signals; and (3) an explainable report aligned with the PCAOB AS 2401 fraud-risk taxonomy. On AAER-labelled firm-years linked across a SEC financial dataset and EDGAR-CORPUS, FraudDebate-Agent improves the area under the ROC curve and the rare-event ranking metric NDCG@k over the strongest single-modality and single-LLM baselines while producing substantially more faithful explanations. We frame the system as a fraud-risk screening and risk-ranking tool for AAER-labelled misstatement risk rather than a determination of fraudulent intent. We report results over multiple seeds to reflect real-world stochasticity and discuss limitations and cross-domain applications.

MathematicsVol. 14(15)
University of Denver (US), Carnegie Mellon University (US)
Peace, Justice and strong institutions
Openalex Percentile: Top 4%
Auditing, Earnings Management, Governance
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.