PREDICTING EMPLOYEE ATTRITION USING TEMPORAL FUSION TRANSFORMERS: A HYPERPARAMETER-OPTIMIZED DEEP LEARNING APPROACH

Employee attrition is of critical concern to organizations, impacting productivity, workforce planning, and bottom lines. Existing machine learning models falter in capturing the complex temporal dynamics in employee behavior, resulting in poor predictive performance. To overcome this, we suggest a Temporal Fusion Transformer based deep learning approach for employee attrition prediction, which is optimized using Bayesian Optimization. IBM HR Analytics Employee Attrition dataset is utilized, employing extensive data preprocessing such as dealing with missing values, encoding categorical features, and scaling numerical features. The TFT model utilizes multi-head attention, Gated Residual Networks, and variable selection mechanisms to acquire short-term and long-term dependencies. Bayesian Optimization optimizes hyperparameters effectively with reduced computational expense and improved performance. The model offers a 97.5% predictive accuracy, 96.8% precision, 97.2% recall, and an AUC-ROC of 98.1%, significantly better than state-of-the-art machine learning methods available today. Organizations can use it to accurately forecast attrition patterns and adopt retention policies ahead of time, thus minimizing turnover and improving job satisfaction. The research contributes to the field of HR analytics with the development of a new deep learning model dedicated to attrition forecasting. As future research, work will continue with the application of explanation methods, such as SHAP, LIME, and attention visualization, in an effort to support explainability, fairness, and interpretability in AI-based HR decision-making and workforce management.

Authors

Institutions

Publication Details

Journal
International Journal of Research In Commerce and Management Studies
Published
2025-01-01
DOI
https://doi.org/10.38193/ijrcms.2025.7215
Citations
1
Primary Topic
AI and HR Technologies
Type
article
Field-Weighted Citation Impact
2.76
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

PREDICTING EMPLOYEE ATTRITION USING TEMPORAL FUSION TRANSFORMERS: A HYPERPARAMETER-OPTIMIZED DEEP LEARNING APPROACH

R. Hemnath
1 citations
International Journal of Research In Commerce and Management Studies
AI and HR Technologies
2.76
article

PREDICTING EMPLOYEE ATTRITION USING TEMPORAL FUSION TRANSFORMERS: A HYPERPARAMETER-OPTIMIZED DEEP LEARNING APPROACH

R. Hemnath
article en
1 citations

Abstract

Employee attrition is of critical concern to organizations, impacting productivity, workforce planning, and bottom lines. Existing machine learning models falter in capturing the complex temporal dynamics in employee behavior, resulting in poor predictive performance. To overcome this, we suggest a Temporal Fusion Transformer based deep learning approach for employee attrition prediction, which is optimized using Bayesian Optimization. IBM HR Analytics Employee Attrition dataset is utilized, employing extensive data preprocessing such as dealing with missing values, encoding categorical features, and scaling numerical features. The TFT model utilizes multi-head attention, Gated Residual Networks, and variable selection mechanisms to acquire short-term and long-term dependencies. Bayesian Optimization optimizes hyperparameters effectively with reduced computational expense and improved performance. The model offers a 97.5% predictive accuracy, 96.8% precision, 97.2% recall, and an AUC-ROC of 98.1%, significantly better than state-of-the-art machine learning methods available today. Organizations can use it to accurately forecast attrition patterns and adopt retention policies ahead of time, thus minimizing turnover and improving job satisfaction. The research contributes to the field of HR analytics with the development of a new deep learning model dedicated to attrition forecasting. As future research, work will continue with the application of explanation methods, such as SHAP, LIME, and attention visualization, in an effort to support explainability, fairness, and interpretability in AI-based HR decision-making and workforce management.

International Journal of Research In Commerce and Management StudiesVol. 07(02)
Ramakrishna Mission Vidyalaya (IN)
Openalex Percentile: Top 11%
AI and HR Technologies
2.76
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.