Separating predictive accuracy from functional behaviour in machine-learning surrogate models for geoengineering applications

Machine-learning regression models are increasingly used as surrogate parameterisations in geoengineering workflows, where they function as continuous mappings across predictor domains rather than as pointwise predictors. However, model evaluation remains dominated by predictive accuracy metrics, which provide limited insight into surrogate behaviour between observations. This study demonstrates that predictive accuracy and functional behaviour represent distinct and complementary dimensions of surrogate adequacy. Using a controlled laboratory dataset describing thermal conductivity as a function of water content and bulk density, regression models with contrasting inductive biases are analysed as continuous response surfaces over the empirically supported predictor domain. A post hoc diagnostic framework is formalised to evaluate surrogate behaviour in terms of response-surface geometry, monotonicity, smoothness, local predictor effects, and residual structure across the predictor domain. Results demonstrate that models with comparable predictive accuracy can produce substantially different response-surface structures, revealing, within the analysed setting, a broad trade-off between numerical accuracy and functional regularity that is consistent with a strong influence of model inductive bias. To support comparative evaluation, a Functional Inconsistency Index (FII) is defined as a composite post hoc indicator of undesirable surrogate behaviour. The index does not measure physical validity or enforce governing equations but provides a reproducible heuristic measure based on monotonicity violations, normalised surface roughness, and output-range violations. Combined with conventional accuracy metrics, FII enables models to be positioned within an explicit accuracy–inconsistency decision space. The results highlight that predictive accuracy alone may be insufficient for evaluating machine-learning surrogates when they are reused as continuous parameterisations in modelling workflows. The proposed framework provides a reproducible and potentially transferable approach for integrating behavioural diagnostics into surrogate-model selection, although its criteria require domain-specific definition and further validation in more complex geoengineering and environmental applications.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-08-03
DOI
https://doi.org/10.1038/s41598-026-65202-3
Primary Topic
Advanced Multi-Objective Optimization Algorithms
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Separating predictive accuracy from functional behaviour in machine-learning surrogate models for geoengineering applications

Mateusz Żeruń
Scientific Reports
Advanced Multi-Objective Optimization Algorithms
article

Separating predictive accuracy from functional behaviour in machine-learning surrogate models for geoengineering applications

Mateusz Żeruń
article en

Abstract

Machine-learning regression models are increasingly used as surrogate parameterisations in geoengineering workflows, where they function as continuous mappings across predictor domains rather than as pointwise predictors. However, model evaluation remains dominated by predictive accuracy metrics, which provide limited insight into surrogate behaviour between observations. This study demonstrates that predictive accuracy and functional behaviour represent distinct and complementary dimensions of surrogate adequacy. Using a controlled laboratory dataset describing thermal conductivity as a function of water content and bulk density, regression models with contrasting inductive biases are analysed as continuous response surfaces over the empirically supported predictor domain. A post hoc diagnostic framework is formalised to evaluate surrogate behaviour in terms of response-surface geometry, monotonicity, smoothness, local predictor effects, and residual structure across the predictor domain. Results demonstrate that models with comparable predictive accuracy can produce substantially different response-surface structures, revealing, within the analysed setting, a broad trade-off between numerical accuracy and functional regularity that is consistent with a strong influence of model inductive bias. To support comparative evaluation, a Functional Inconsistency Index (FII) is defined as a composite post hoc indicator of undesirable surrogate behaviour. The index does not measure physical validity or enforce governing equations but provides a reproducible heuristic measure based on monotonicity violations, normalised surface roughness, and output-range violations. Combined with conventional accuracy metrics, FII enables models to be positioned within an explicit accuracy–inconsistency decision space. The results highlight that predictive accuracy alone may be insufficient for evaluating machine-learning surrogates when they are reused as continuous parameterisations in modelling workflows. The proposed framework provides a reproducible and potentially transferable approach for integrating behavioural diagnostics into surrogate-model selection, although its criteria require domain-specific definition and further validation in more complex geoengineering and environmental applications.

Scientific Reports
Polish Geological Institute (PL)
Narodowy Fundusz Ochrony Środowiska i Gospodarki Wodnej
Openalex Percentile: Top 7%
Advanced Multi-Objective Optimization Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.