Ensemble learning predicts glass-forming ability under imbalanced datasets

The flowchart of this paper is depicted in the figure. In the data preprocessing stage, two data enhancement strategies, WERCS and SMOGN , were employed and the strategies were evaluated by PCD. For model construction, 12 commonly used ML models were collected and screened by the R 2 and CI. Further, the composition of MLS models was optimized using BOA . The results show that the R 2 and RMSE of the MLS models on the test set are 0.79 and 4.29, respectively. In addition, the generalization ability of the MLS models was verified in the Cu-Mg-Ca alloy system . • Multi-layer stacking ensemble learning with multi-model fusion for predicting GFA. • WERCS and SMOGN data enhancement strategies to address data imbalance. • Utilized Bayesian optimization algorithm to select the composition of models. • Achieved a prediction accuracy of 0.79, surpassing other mentioned models. With the development of artificial intelligence, machine learning (ML) is widely used to predict glass-forming ability (GFA). However, GFA experimental data usually exhibits a long-tailed distribution, and the similarity between the enhanced dataset and the original dataset is unclear. In terms of modeling, although model fusion provides better prediction results than individual learners, it also faces the risk of overfitting. Therefore, two preprocessing methods designed for regression problems WEighted Relevance-based Combination Strategy (WERCS) and Synthetic Minority Over-sampling technique with Gaussian Noise (SMOGN) are employed. The best strategy is selected by Pairwise correlation difference (PCD). Based on the screening results, this paper further proposes a multi-layer stacking ensemble learning model (MLS) for predicting GFA. Considering model accuracy and diversity together, the base model and meta -model combinations are optimized by Bayesian optimization algorithm (BOA). The results show that MLS achieves R 2 = 0.79 in prediction accuracy, which is better than other models and criteria discussed in this paper. In addition, the generalization ability of the MLS model is verified in the Cu-Mg-Ca alloy system. To explain the MLS model, SHapley Additive exPlanation (SHAP) is introduced. With the help of MLS and SHAP methods, the formation law of bulk metallic glasses (BMGs) is revealed, and the BMGs of Zr-Cu-Al-Ag series alloys are successfully designed.

Authors

Institutions

Publication Details

Journal
Computational Materials Science
Published
2024-12-12
DOI
https://doi.org/10.1016/j.commatsci.2024.113601
Citations
5
Primary Topic
Cultural Heritage Materials Analysis
Type
article
Field-Weighted Citation Impact
14.62
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Ensemble learning predicts glass-forming ability under imbalanced datasets

Yuanwei Pu, Qian Chen, Yongchao Liang, Dehua Cheng
5 citations
Computational Materials Science
Cultural Heritage Materials Analysis
14.62
article

Ensemble learning predicts glass-forming ability under imbalanced datasets

Yuanwei Pu, Qian Chen, Yongchao Liang, Dehua Cheng
article en
5 citations

Abstract

The flowchart of this paper is depicted in the figure. In the data preprocessing stage, two data enhancement strategies, WERCS and SMOGN , were employed and the strategies were evaluated by PCD. For model construction, 12 commonly used ML models were collected and screened by the R 2 and CI. Further, the composition of MLS models was optimized using BOA . The results show that the R 2 and RMSE of the MLS models on the test set are 0.79 and 4.29, respectively. In addition, the generalization ability of the MLS models was verified in the Cu-Mg-Ca alloy system . • Multi-layer stacking ensemble learning with multi-model fusion for predicting GFA. • WERCS and SMOGN data enhancement strategies to address data imbalance. • Utilized Bayesian optimization algorithm to select the composition of models. • Achieved a prediction accuracy of 0.79, surpassing other mentioned models. With the development of artificial intelligence, machine learning (ML) is widely used to predict glass-forming ability (GFA). However, GFA experimental data usually exhibits a long-tailed distribution, and the similarity between the enhanced dataset and the original dataset is unclear. In terms of modeling, although model fusion provides better prediction results than individual learners, it also faces the risk of overfitting. Therefore, two preprocessing methods designed for regression problems WEighted Relevance-based Combination Strategy (WERCS) and Synthetic Minority Over-sampling technique with Gaussian Noise (SMOGN) are employed. The best strategy is selected by Pairwise correlation difference (PCD). Based on the screening results, this paper further proposes a multi-layer stacking ensemble learning model (MLS) for predicting GFA. Considering model accuracy and diversity together, the base model and meta -model combinations are optimized by Bayesian optimization algorithm (BOA). The results show that MLS achieves R 2 = 0.79 in prediction accuracy, which is better than other models and criteria discussed in this paper. In addition, the generalization ability of the MLS model is verified in the Cu-Mg-Ca alloy system. To explain the MLS model, SHapley Additive exPlanation (SHAP) is introduced. With the help of MLS and SHAP methods, the formation law of bulk metallic glasses (BMGs) is revealed, and the BMGs of Zr-Cu-Al-Ag series alloys are successfully designed.

Computational Materials ScienceVol. 248
Guizhou University (CN)
Openalex Percentile: Top 1%
Cultural Heritage Materials Analysis
14.62
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.