A multimodal approach for fostering knowledge transfer in engineering design activity: an eye-tracking and fNIRS study

Knowledge transfer in engineering design activity involves effectively applying prior practical experience in novel contexts. While related works fostering knowledge transfer focus on educational practices and experience generalisation, recent advancements enable us to analyze its complex cognitive processes using neuroimaging technology. This paper proposes a multimodal approach for facilitating knowledge transfer in engineering design, utilising functional near-infrared spectroscopy (fNIRS) and eye-tracking technologies based on neurocognitive profiling. We conducted knowledge transfer experiments using mixed and extended design tasks. Meanwhile, The analysis focused on gaze duration, gaze counts, brain region activation levels, functional connectivity, and effective connectivity of the participants. Finally, we employed stepwise linear regression to identify significant and potential associated factors of knowledge transfer. By combining eye-tracking predictors and brain network predictors, a multivariate linear discriminant analysis (LDA) significantly differentiated between participants in near-transferred and far-transferred states, achieving an accuracy of 91.16% using leave-one-out cross-validation. The 'basic-supplementary-target task' method effectively improved the knowledge transfer performance by 27.6%. Our findings demonstrate the efficacy of the proposed multimodal approach in facilitating knowledge transfer in engineering design activities.

Authors

Institutions

Publication Details

Journal
Journal of Engineering Design
Published
2024-08-19
DOI
https://doi.org/10.1080/09544828.2024.2380621
Citations
4
Primary Topic
Human-Automation Interaction and Safety
Type
article
Field-Weighted Citation Impact
2.57

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A multimodal approach for fostering knowledge transfer in engineering design activity: an eye-tracking and fNIRS study

Zuhua Jiang, Fuhua Wang, Kexin Cheng, Guoliang Fan et al.
4 citations
Journal of Engineering Design
Human-Automation Interaction and Safety
2.57
article

A multimodal approach for fostering knowledge transfer in engineering design activity: an eye-tracking and fNIRS study

Zuhua Jiang, Fuhua Wang, Kexin Cheng, Guoliang Fan, Hongming Zhou
article en
4 citations

Abstract

Knowledge transfer in engineering design activity involves effectively applying prior practical experience in novel contexts. While related works fostering knowledge transfer focus on educational practices and experience generalisation, recent advancements enable us to analyze its complex cognitive processes using neuroimaging technology. This paper proposes a multimodal approach for facilitating knowledge transfer in engineering design, utilising functional near-infrared spectroscopy (fNIRS) and eye-tracking technologies based on neurocognitive profiling. We conducted knowledge transfer experiments using mixed and extended design tasks. Meanwhile, The analysis focused on gaze duration, gaze counts, brain region activation levels, functional connectivity, and effective connectivity of the participants. Finally, we employed stepwise linear regression to identify significant and potential associated factors of knowledge transfer. By combining eye-tracking predictors and brain network predictors, a multivariate linear discriminant analysis (LDA) significantly differentiated between participants in near-transferred and far-transferred states, achieving an accuracy of 91.16% using leave-one-out cross-validation. The 'basic-supplementary-target task' method effectively improved the knowledge transfer performance by 27.6%. Our findings demonstrate the efficacy of the proposed multimodal approach in facilitating knowledge transfer in engineering design activities.

Journal of Engineering DesignVol. 35(12)
Wenzhou University (CN), Shanghai Jiao Tong University (CN)
National Natural Science Foundation of China
Industry, innovation and infrastructure
Openalex Percentile: Top 11%
Human-Automation Interaction and Safety
2.57
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.