Simulation-Driven Deep Transfer Learning Framework for Data-Efficient Prediction of Physical Experiments

Transfer learning, which utilizes extensive simulation data to overcome the limitations of scarce and expensive experimental data, has emerged as a powerful approach for predictive modeling in various physical domains. This study presents a comprehensive framework to improve the predictive performance of transfer learning, focusing on quasi-zero stiffness (QZS) systems with limited experimental datasets. The proposed framework systematically examines the interplay among three critical factors in the target domain: data augmentation, layer-freezing configurations, and neural network architecture. Simulation-driven synthetic data are generated to capture dynamic features not represented in the sparse experimental data. The optimal transfer depth is explored by evaluating different scenarios of selective layer freezing and fine-tuning. Results show that partial transfer strategies outperform both full-transfer and non-transfer approaches, leading to more stable and accurate predictions. To investigate hierarchical transfer, both symmetric and asymmetric network architectures are designed, embedding physically meaningful representations from simulations into the deeper layers of the target model. Furthermore, an attention mechanism is integrated to emphasize material-specific characteristics. Building on these components, the proposed simulation-driven framework predicts the full force–displacement responses of QZS systems using only 12 experimental samples. Through a systematic comparison of three datasets (direct transfer, linear correction, FEM-based correction), three network architectures, and seven layer-freezing scenarios, the framework achieves a best test performance of R2 = 0.978 and MAE = 0.34 Newtons.

Authors

Institutions

Publication Details

Journal
Mathematics
Published
2025-12-04
DOI
https://doi.org/10.3390/math13233884
Primary Topic
Model Reduction and Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Simulation-Driven Deep Transfer Learning Framework for Data-Efficient Prediction of Physical Experiments

Soo Kun Lim, Han-Bok Seo, Seung-Yop Lee
Mathematics
Model Reduction and Neural Networks
article

Simulation-Driven Deep Transfer Learning Framework for Data-Efficient Prediction of Physical Experiments

Soo Kun Lim, Han-Bok Seo, Seung-Yop Lee
article en

Abstract

Transfer learning, which utilizes extensive simulation data to overcome the limitations of scarce and expensive experimental data, has emerged as a powerful approach for predictive modeling in various physical domains. This study presents a comprehensive framework to improve the predictive performance of transfer learning, focusing on quasi-zero stiffness (QZS) systems with limited experimental datasets. The proposed framework systematically examines the interplay among three critical factors in the target domain: data augmentation, layer-freezing configurations, and neural network architecture. Simulation-driven synthetic data are generated to capture dynamic features not represented in the sparse experimental data. The optimal transfer depth is explored by evaluating different scenarios of selective layer freezing and fine-tuning. Results show that partial transfer strategies outperform both full-transfer and non-transfer approaches, leading to more stable and accurate predictions. To investigate hierarchical transfer, both symmetric and asymmetric network architectures are designed, embedding physically meaningful representations from simulations into the deeper layers of the target model. Furthermore, an attention mechanism is integrated to emphasize material-specific characteristics. Building on these components, the proposed simulation-driven framework predicts the full force–displacement responses of QZS systems using only 12 experimental samples. Through a systematic comparison of three datasets (direct transfer, linear correction, FEM-based correction), three network architectures, and seven layer-freezing scenarios, the framework achieves a best test performance of R2 = 0.978 and MAE = 0.34 Newtons.

MathematicsVol. 13(23)
Sogang University (KR)
Openalex Percentile: Top 69%
Model Reduction and Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.