Economic insights into credit risk: a deep learning model for predicting loan repayment capacity

Accurately predicting loan repayment capacity is critical to effective credit risk assessment in banking, finance, and economic policymaking. This study proposes a novel deep learning architecture, the Gated Transformer, designed specifically for structured credit data. The model integrates categorical and numerical features into a unified latent space and employs multi-head self-attention combined with a token-wise gating mechanism to dynamically capture complex feature interactions while enhancing interpretability. Experiments conducted on the LendingClub dataset demonstrate that the proposed model achieves strong predictive performance, with an accuracy of 92.38%, an area under the receiver operating characteristic curve (AUROC) of 0.8517, and an area under the precision-recall curve (AUPRC) of 0.9213. Further robustness tests across multiple random seeds confirm the model’s stability. These findings underscore the model’s effectiveness in handling heterogeneous financial data and its potential to support responsible, data-driven credit risk evaluation.

Authors

Institutions

Publication Details

Journal
PeerJ Computer Science
Published
2025-12-19
DOI
https://doi.org/10.7717/peerj-cs.3339
Primary Topic
Financial Distress and Bankruptcy Prediction
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Economic insights into credit risk: a deep learning model for predicting loan repayment capacity

Sheng Li, Cheng Qiu, X. Y. Zhou
PeerJ Computer Science
Financial Distress and Bankruptcy Prediction
article

Economic insights into credit risk: a deep learning model for predicting loan repayment capacity

Sheng Li, Cheng Qiu, X. Y. Zhou
article en

Abstract

Accurately predicting loan repayment capacity is critical to effective credit risk assessment in banking, finance, and economic policymaking. This study proposes a novel deep learning architecture, the Gated Transformer, designed specifically for structured credit data. The model integrates categorical and numerical features into a unified latent space and employs multi-head self-attention combined with a token-wise gating mechanism to dynamically capture complex feature interactions while enhancing interpretability. Experiments conducted on the LendingClub dataset demonstrate that the proposed model achieves strong predictive performance, with an accuracy of 92.38%, an area under the receiver operating characteristic curve (AUROC) of 0.8517, and an area under the precision-recall curve (AUPRC) of 0.9213. Further robustness tests across multiple random seeds confirm the model’s stability. These findings underscore the model’s effectiveness in handling heterogeneous financial data and its potential to support responsible, data-driven credit risk evaluation.

PeerJ Computer ScienceVol. 11
Guangxi Normal University (CN), Kunshan Industrial Technology Research Institute (CN)
Openalex Percentile: Top 44%
Financial Distress and Bankruptcy Prediction
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Economic insights into credit risk: a deep learning model for predicting loan repayment capacity — Sheng Li, Cheng Qiu, et al. · PeerJ Computer Science (2025) | TGRS Research Map | TGRS