From classical machine learning algorithms to modern transformer-inspired neural networks for multi-target prediction of fracture properties in concrete structures

• Multi-target prediction of Gc and KIC of concretes using 25 ML algorithms • TabPFN outperforms 24 algorithms with R² = 87.89% on unseen test data • SHAP analysis provides unbiased interpretability of fracture predictions Concrete fracture properties, including fracture energy ( G c ) and Mode I fracture toughness ( K IC ), are critical parameters of structural performance. Accurate prediction of these parameters remains challenging due to their nonlinear dependence on geometric and mechanical factors. This study develops a comprehensive explainable artificial intelligence framework for the simultaneous prediction of G c and K IC of concretes. A dataset comprising 330 data points with six input features, including beam depth, span length, beam width, notch length, tensile strength, and elastic modulus, was analyzed. 25 machine learning algorithms, including 22 classical models and three modern transformer-inspired models (i.e., TabPFN, TabNet, FTTr), were systematically trained and evaluated. Hyperparameter tuning was performed through grid search and 5-fold cross-validation, while early stopping was applied for neural network–based models to prevent overfitting. Results show that the TabPFN algorithm, as the most modern and state-of-the-art transformer-based algorithm, achieved the highest accuracy with an R² of 87.89% on the test set, outperforming all other algorithms. To enhance interpretability, Shapley Additive Explanations (SHAP) analysis was conducted on the test predictions of TabPFN. The results revealed that G c is predominantly governed by tensile strength and ligament-related geometry, whereas K IC is strongly influenced by beam depth and notch length. Importantly, the SHAP results also highlighted nonlinear and interaction-driven effects that were not captured by simple correlation analysis. Overall, the findings demonstrate that advanced transformer-based algorithms combined with explainable AI provide a powerful framework for the multi-target prediction of concrete fracture properties, offering valuable insights for structural design and material optimization.

Authors

Institutions

Publication Details

Journal
Machine Learning with Applications
Published
2026-02-27
DOI
https://doi.org/10.1016/j.mlwa.2026.100877
Primary Topic
Rock Mechanics and Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

From classical machine learning algorithms to modern transformer-inspired neural networks for multi-target prediction of fracture properties in concrete structures

Mohammad Heidari‐Rarani, Pooya Sareh, Mohammad Hossein Nikzad
Machine Learning with Applications
Rock Mechanics and Modeling
article

From classical machine learning algorithms to modern transformer-inspired neural networks for multi-target prediction of fracture properties in concrete structures

Mohammad Heidari‐Rarani, Pooya Sareh, Mohammad Hossein Nikzad
article en

Abstract

• Multi-target prediction of Gc and KIC of concretes using 25 ML algorithms • TabPFN outperforms 24 algorithms with R² = 87.89% on unseen test data • SHAP analysis provides unbiased interpretability of fracture predictions Concrete fracture properties, including fracture energy ( G c ) and Mode I fracture toughness ( K IC ), are critical parameters of structural performance. Accurate prediction of these parameters remains challenging due to their nonlinear dependence on geometric and mechanical factors. This study develops a comprehensive explainable artificial intelligence framework for the simultaneous prediction of G c and K IC of concretes. A dataset comprising 330 data points with six input features, including beam depth, span length, beam width, notch length, tensile strength, and elastic modulus, was analyzed. 25 machine learning algorithms, including 22 classical models and three modern transformer-inspired models (i.e., TabPFN, TabNet, FTTr), were systematically trained and evaluated. Hyperparameter tuning was performed through grid search and 5-fold cross-validation, while early stopping was applied for neural network–based models to prevent overfitting. Results show that the TabPFN algorithm, as the most modern and state-of-the-art transformer-based algorithm, achieved the highest accuracy with an R² of 87.89% on the test set, outperforming all other algorithms. To enhance interpretability, Shapley Additive Explanations (SHAP) analysis was conducted on the test predictions of TabPFN. The results revealed that G c is predominantly governed by tensile strength and ligament-related geometry, whereas K IC is strongly influenced by beam depth and notch length. Importantly, the SHAP results also highlighted nonlinear and interaction-driven effects that were not captured by simple correlation analysis. Overall, the findings demonstrate that advanced transformer-based algorithms combined with explainable AI provide a powerful framework for the multi-target prediction of concrete fracture properties, offering valuable insights for structural design and material optimization.

Machine Learning with ApplicationsVol. 24
University of Isfahan (IR), Newcastle University (GB)
Sustainable cities and communities
Openalex Percentile: Top 42%
Rock Mechanics and Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.