FA-ATF: Leakage-Safe Factorial-Aware Multi-Output Learning for Small Hierarchical Experimental Data

Machine learning on small designed experiments is prone to optimistic evaluation when several observations share one physical unit and are split row-wise between training and test sets. We study this problem on a small hierarchical factorial dataset—81 section-level observations from 27 specimens of hard-turned 51CrV4 steel—with two physically different targets: surface roughness (Ra) and post-process hardness (HV30). We propose (i) a leakage-safe evaluation protocol based on specimen-grouped nested cross-validation (nine outer, four inner folds) with fold-local preprocessing, and (ii) Factorial-Aware Asymmetric Target Fusion (FA-ATF), a multi-output learner that encodes the specimen–section hierarchy through a factorial line-profile backbone, uses target-specific backbones, and admits additional experts and residual correction only when inner-fold gains are stable. Under the same protocol, FA-ATF was compared with 17 models spanning regularized regression, mixed-effects, kernel, ensemble, boosting, Gaussian process, and neural approaches. FA-ATF yielded the best observed performance (mean target-wise normalized root-mean-square error (NRMSE) 0.3773; macro-R2 0.8542) and ranked first in 83% of specimen-cluster bootstrap resamples, and ablation attributed almost all of the gain to the factorial line-profile backbone, which is the core contribution, rather than to the additional components. Multiplicity-corrected paired tests did not establish statistically significant superiority over the strongest comparators, and several differences were too small to matter in practice, illustrating how grouped validation tempers performance claims on small data. Code, fold specifications, and out-of-fold predictions are openly available.

Authors

Institutions

Publication Details

Journal
Computers
Published
2026-11-13
DOI
https://doi.org/10.3390/computers15110828
Primary Topic
Optimal Experimental Design Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

FA-ATF: Leakage-Safe Factorial-Aware Multi-Output Learning for Small Hierarchical Experimental Data

Dariga Yesmukhanova, Ainur Orazayeva, Nurgul Smakova, Bulat Serimbetov et al.
2 links
Computers
Optimal Experimental Design Methods
article

FA-ATF: Leakage-Safe Factorial-Aware Multi-Output Learning for Small Hierarchical Experimental Data

Dariga Yesmukhanova, Ainur Orazayeva, Nurgul Smakova, Bulat Serimbetov, Alfiya BIGALIYEVA, Aigul Abildina, Aliya Abdukarimova, Assel Kanapina, Nurgul Tursynbay, Kamilya Tyutebayeva
article en

Abstract

Machine learning on small designed experiments is prone to optimistic evaluation when several observations share one physical unit and are split row-wise between training and test sets. We study this problem on a small hierarchical factorial dataset—81 section-level observations from 27 specimens of hard-turned 51CrV4 steel—with two physically different targets: surface roughness (Ra) and post-process hardness (HV30). We propose (i) a leakage-safe evaluation protocol based on specimen-grouped nested cross-validation (nine outer, four inner folds) with fold-local preprocessing, and (ii) Factorial-Aware Asymmetric Target Fusion (FA-ATF), a multi-output learner that encodes the specimen–section hierarchy through a factorial line-profile backbone, uses target-specific backbones, and admits additional experts and residual correction only when inner-fold gains are stable. Under the same protocol, FA-ATF was compared with 17 models spanning regularized regression, mixed-effects, kernel, ensemble, boosting, Gaussian process, and neural approaches. FA-ATF yielded the best observed performance (mean target-wise normalized root-mean-square error (NRMSE) 0.3773; macro-R2 0.8542) and ranked first in 83% of specimen-cluster bootstrap resamples, and ablation attributed almost all of the gain to the factorial line-profile backbone, which is the core contribution, rather than to the additional components. Multiplicity-corrected paired tests did not establish statistically significant superiority over the strongest comparators, and several differences were too small to matter in practice, illustrating how grouped validation tempers performance claims on small data. Code, fold specifications, and out-of-fold predictions are openly available.

ComputersVol. 15(11)
L. N. Gumilyov Eurasian National University (KZ), West Kazakhstan Marat Ospanov State Medical University (KZ), Abylkas Saginov Karaganda Technical University (KZ), Kazakh Technology and Business University named after K.Kulazhanov (KZ), Astana International University (KZ)
Optimal Experimental Design Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon