Exploring the role of machine learning models in risk assessment models for developed organizations’ management decision policies

The goal of this work was to create and assess machine-learning models for estimating the risk of budget overruns in developed projects. Finding the best model for risk forecasting required evaluating the performance of several models. Using a dataset of 177 projects took into account variables like environmental risks employee skill level safety incidents and project complexity. In our experiments, we analyzed the application of different machine learning models to analyze the risk for the management decision policies of developed organizations. The performance of the chosen model Neural Network (MLP) was improved after applying the tuning process which increased the Test R2 from −0.37686 before tuning to 0.195637 after tuning. The Support Vector Machine (SVM), Ridge Regression, Lasso Regression, and Random Forest (Tuned) models did not improve, as seen when Test R2 is compared to the experiments. No changes in Test R2’s were observed on GBM and XGBoost, which retained same Test R2 across different tuning attempts. Stacking Regressor was used only during the hyperparameter tuning phase and brought a Test R2 of 0. 022219.Decision Tree was again the worst model among all throughout the experiments, with no signs of improvement in its Test R2; it was −1.4669 for Decision Tree in all experiments arranged on the basis of Gender. These results indicate that although, models such as the Neural Network (MLP) sees improvements due to hyperparameter tuning, there are minimal improvements for most models. This works does highlight some of the weaknesses in specific types of models, as well as identifies areas where additional work can be expected to deliver incremental benefits to the structured applied process of risk assessment in organizational policies.

Authors

Institutions

Publication Details

Journal
Journal of Infrastructure Policy and Development
Published
2024-11-15
DOI
https://doi.org/10.24294/jipd9364
Citations
4
Primary Topic
Risk Management in Financial Firms
Type
article
Field-Weighted Citation Impact
3.78
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploring the role of machine learning models in risk assessment models for developed organizations’ management decision policies

Basel Bani‐Ismail, Boumedyen Shannaq, Devarajanayaka Kalenahalli Muniyanayaka, Said Al Maqbali
4 citations
Journal of Infrastructure Policy and Development
Risk Management in Financial Firms
3.78
article

Exploring the role of machine learning models in risk assessment models for developed organizations’ management decision policies

Basel Bani‐Ismail, Boumedyen Shannaq, Devarajanayaka Kalenahalli Muniyanayaka, Said Al Maqbali
article en
4 citations

Abstract

The goal of this work was to create and assess machine-learning models for estimating the risk of budget overruns in developed projects. Finding the best model for risk forecasting required evaluating the performance of several models. Using a dataset of 177 projects took into account variables like environmental risks employee skill level safety incidents and project complexity. In our experiments, we analyzed the application of different machine learning models to analyze the risk for the management decision policies of developed organizations. The performance of the chosen model Neural Network (MLP) was improved after applying the tuning process which increased the Test R2 from −0.37686 before tuning to 0.195637 after tuning. The Support Vector Machine (SVM), Ridge Regression, Lasso Regression, and Random Forest (Tuned) models did not improve, as seen when Test R2 is compared to the experiments. No changes in Test R2’s were observed on GBM and XGBoost, which retained same Test R2 across different tuning attempts. Stacking Regressor was used only during the hyperparameter tuning phase and brought a Test R2 of 0. 022219.Decision Tree was again the worst model among all throughout the experiments, with no signs of improvement in its Test R2; it was −1.4669 for Decision Tree in all experiments arranged on the basis of Gender. These results indicate that although, models such as the Neural Network (MLP) sees improvements due to hyperparameter tuning, there are minimal improvements for most models. This works does highlight some of the weaknesses in specific types of models, as well as identifies areas where additional work can be expected to deliver incremental benefits to the structured applied process of risk assessment in organizational policies.

Journal of Infrastructure Policy and DevelopmentVol. 8(13)
University of Buraimi (OM), Majan College (OM), Applied Science University (BH)
Openalex Percentile: Top 6%
Risk Management in Financial Firms
3.78
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.