Predicting mortgage loan defaults using transformer models

We use the mortgage data provided by Freddie Mac in the U.S. The predictive power of transformer models was empirically verified while simultaneously exploring the potential for enhancing explanatory power through the following three research questions. First, is there a statistically significant difference in predictive power between the transformer and the panel logistic regression? Second, is there a difference in predictive performance between the variables at the time of loan origination and the current ones? Finally, does altering the input order of the independent variables affect the predictive performance? Our findings are as follows. First, compared with the traditional panel logistic regression model, the transformer demonstrated overwhelmingly superior predictive performance. Second, the absolute importance of updated current month variables in default prediction was statistically demonstrated. Last, the transformer model exhibited a dual nature: practical applicability in overall predictive performance with respect to the F1 score to changes in the order of input variables and the variability of marginal effects for individual variables. These findings contribute to strengthening risk management capabilities in the housing finance sector and increasing the reliability of machine learning model utilisation.

Authors

Institutions

Publication Details

Journal
International Journal of Strategic Property Management
Published
2026-11-19
DOI
https://doi.org/10.3846/ijspm.2026.28909
Primary Topic
Financial Distress and Bankruptcy Prediction
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Predicting mortgage loan defaults using transformer models

Yeonjae Lee, Seung-woo Shin, Sangmin Lee
International Journal of Strategic Property Management
Financial Distress and Bankruptcy Prediction
article

Predicting mortgage loan defaults using transformer models

Yeonjae Lee, Seung-woo Shin, Sangmin Lee
article en

Abstract

We use the mortgage data provided by Freddie Mac in the U.S. The predictive power of transformer models was empirically verified while simultaneously exploring the potential for enhancing explanatory power through the following three research questions. First, is there a statistically significant difference in predictive power between the transformer and the panel logistic regression? Second, is there a difference in predictive performance between the variables at the time of loan origination and the current ones? Finally, does altering the input order of the independent variables affect the predictive performance? Our findings are as follows. First, compared with the traditional panel logistic regression model, the transformer demonstrated overwhelmingly superior predictive performance. Second, the absolute importance of updated current month variables in default prediction was statistically demonstrated. Last, the transformer model exhibited a dual nature: practical applicability in overall predictive performance with respect to the F1 score to changes in the order of input variables and the variability of marginal effects for individual variables. These findings contribute to strengthening risk management capabilities in the housing finance sector and increasing the reliability of machine learning model utilisation.

International Journal of Strategic Property ManagementVol. 30(5)
Konkuk University (KR)
Financial Distress and Bankruptcy Prediction
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon