Predicting mortgage loan defaults using transformer models
We use the mortgage data provided by Freddie Mac in the U.S. The predictive power of transformer models was empirically verified while simultaneously exploring the potential for enhancing explanatory power through the following three research questions. First, is there a statistically significant difference in predictive power between the transformer and the panel logistic regression? Second, is there a difference in predictive performance between the variables at the time of loan origination and the current ones? Finally, does altering the input order of the independent variables affect the predictive performance? Our findings are as follows. First, compared with the traditional panel logistic regression model, the transformer demonstrated overwhelmingly superior predictive performance. Second, the absolute importance of updated current month variables in default prediction was statistically demonstrated. Last, the transformer model exhibited a dual nature: practical applicability in overall predictive performance with respect to the F1 score to changes in the order of input variables and the variability of marginal effects for individual variables. These findings contribute to strengthening risk management capabilities in the housing finance sector and increasing the reliability of machine learning model utilisation.
Authors
- Yeonjae Lee (ORCID: https://orcid.org/0009-0002-5783-0622)
- Seung-woo Shin (ORCID: https://orcid.org/0000-0002-4637-9584)
- Sangmin Lee (ORCID: https://orcid.org/0009-0001-8571-9561)
Institutions
- Konkuk University (KR)
Publication Details
- Journal
- International Journal of Strategic Property Management
- Published
- 2026-11-19
- DOI
- https://doi.org/10.3846/ijspm.2026.28909
- Primary Topic
- Financial Distress and Bankruptcy Prediction
- Type
- article
- Field-Weighted Citation Impact
- 0.00