From Simulation to Validation in Ensuring Quality and Reliability in Model-Based Predictive Analysis

The increasing complexity of artificial intelligence and machine learning models has raised concerns about balancing model accuracy and interpretability. While advanced software tools facilitate model design, they also introduce challenges in selecting models that offer both high quality and manageable complexity. Validation techniques such as Root Mean Squared Error (RMSE), Mean Absolute Error (MAE), and the Akaike Information Criterion (AIC) enable quantitative assessment, but empirical studies indicate that higher complexity does not always improve predictive performance. This study proposes an approach to evaluate model complexity versus accuracy in predicting the absorption properties of composite materials with varying textile fibre content (10%, 20%, 30%, 40%). Using MATLAB’s Curve Fitting Toolbox, we assessed polynomial, Fourier, and Gaussian regression models. The Gaussian regression model with six parameters (Gauss6) achieved the best balance between complexity and accuracy (R2 = 0.9429; RMSE = 0.013537; MAE = 0.004885). Increasing parameters beyond six showed diminishing returns, as confirmed by AIC (−2806.93 for Gauss6 vs. −2847.17 for Gauss7). These findings emphasise that higher model complexity does not necessarily enhance quality, highlighting the importance of structured model validation. This study provides insights for optimising predictive modelling in material science and other domains.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2025-03-13
DOI
https://doi.org/10.3390/app15063107
Citations
5
Primary Topic
Fault Detection and Control Systems
Type
article
Field-Weighted Citation Impact
6.07

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

From Simulation to Validation in Ensuring Quality and Reliability in Model-Based Predictive Analysis

Jozef Husár, Stella Hrehová, Katarzyna Antosz, Alena Vagaská
5 citations
Applied Sciences
Fault Detection and Control Systems
6.07
article

From Simulation to Validation in Ensuring Quality and Reliability in Model-Based Predictive Analysis

Jozef Husár, Stella Hrehová, Katarzyna Antosz, Alena Vagaská
article en
5 citations

Abstract

The increasing complexity of artificial intelligence and machine learning models has raised concerns about balancing model accuracy and interpretability. While advanced software tools facilitate model design, they also introduce challenges in selecting models that offer both high quality and manageable complexity. Validation techniques such as Root Mean Squared Error (RMSE), Mean Absolute Error (MAE), and the Akaike Information Criterion (AIC) enable quantitative assessment, but empirical studies indicate that higher complexity does not always improve predictive performance. This study proposes an approach to evaluate model complexity versus accuracy in predicting the absorption properties of composite materials with varying textile fibre content (10%, 20%, 30%, 40%). Using MATLAB’s Curve Fitting Toolbox, we assessed polynomial, Fourier, and Gaussian regression models. The Gaussian regression model with six parameters (Gauss6) achieved the best balance between complexity and accuracy (R2 = 0.9429; RMSE = 0.013537; MAE = 0.004885). Increasing parameters beyond six showed diminishing returns, as confirmed by AIC (−2806.93 for Gauss6 vs. −2847.17 for Gauss7). These findings emphasise that higher model complexity does not necessarily enhance quality, highlighting the importance of structured model validation. This study provides insights for optimising predictive modelling in material science and other domains.

Applied SciencesVol. 15(6)
Rzeszów University of Technology (PL), Technical University of Košice (SK)
Ministerstvo školstva, vedy, výskumu a športu Slovenskej republiky, Agentúra na Podporu Výskumu a Vývoja
Openalex Percentile: Top 4%
Fault Detection and Control Systems
6.07
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.