Bias-Aware and Hallucination-Resistant Financial AI for Credit Scoring
Financial institutions are increasingly exploring Large Language Models (LLMs) for financial document analysis and credit assessment. However, hallucinated financial information and demographic bias can undermine the reliability and fairness of AI-assisted lending decisions. This study proposes an integrated framework for trustworthy financial AI that combines hallucination detection, bias mitigation, and fair credit-risk assessment. The framework uses an LLM to extract structured financial information from source documents, followed by an evidence-verification module that identifies unsupported claims through source matching, semantic verification, numerical consistency checks, and confidence assessment. Verified features are then processed by a separate credit-risk model, while a fairness module evaluates demographic and intersectional disparities in extracted information and credit predictions. The framework will be evaluated using public financial question-answering and credit-risk datasets, supplemented by controlled synthetic financial documents containing known factual and numerical errors. Experiments will examine hallucination detection performance, counterfactual demographic bias, credit-risk prediction quality, and the propagation of incorrect financial information into downstream credit decisions. Evaluation will use claim-level precision and recall, false acceptance rate, AUROC, Brier score, calibration, demographic parity, equal opportunity, equalized odds, and credit-decision flip rate. The study aims to determine whether integrating evidence-based verification and fairness controls can reduce the influence of unsupported financial information while maintaining predictive performance and improving the consistency of AI-assisted credit assessment. Keywords - Trustworthy Financial AI; Large Language Models; Hallucination Detection; Bias Mitigation; Fair Credit Scoring; Credit Risk Assessment; Evidence Verification; Algorithmic Fairness.
Authors
- Neelotpal Dey
- Ms. Apoorva Singh
- Ms. Akarshika Pandey
- Mr. Shani Kumar Jaiswal
Publication Details
- Journal
- International Journal of Creative and Open Research in Engineering and Management
- Published
- 2026-11-14
- DOI
- https://doi.org/10.55041/ijcope.v2i11.056
- Primary Topic
- Ethics and Social Impacts of AI
- Type
- article
- Field-Weighted Citation Impact
- 0.00