Metricized Scaffolds: AI-Enabled Simulation Training and Transfer in Human Resource Development

AI-enabled simulation platforms are increasingly used for talent development, offering scalable, low-risk practice and algorithmic feedback for interpersonal HR capabilities such as difficult conversations, negotiation, and consultation. Yet HRD evaluation cautions that within-platform improvement may not transfer to authentic interactions once dashboards and metrics disappear. We conceptualize AI-enabled simulation training as metricized scaffolding and integrate scaffolding theory with exploration–exploitation learning dynamics to explain when algorithmic supports fade into self-regulation rather than produce metric adaptation (score chasing). We introduce Algorithmic Feedback Literacy (AFL)—learners’ capability to interpret algorithmic feedback, calibrate its authority, and translate cues into portable self-scaffolds—as a mechanism linking metricized practice to transfer. We test this model in an AI-enabled virtual internship and career development program that combines repeated simulation attempts with an authentic consultation assessment. Using platform traces (592 attempts nested within 90 learners), instructor-rated consultation performance as a transfer outcome, and 102 learner reflections, we examine how distributed practice span and practice dose related to simulation gains and transfer, and how consultation complexity changes, which interactional behaviors predicted success. Distributed practice span predicted transfer beyond within-platform gains, while practice dose operated primarily through measurable simulation improvement. Complexity shifted performance relevance toward governance and boundary-setting behaviors. Qualitative evidence identified two developmental pathways: productive internalization, where learners converted metric cues into routines and mode-switching strategies, and metric adaptation, where learners optimized scores without internalizing broader professional judgment. We discuss design implications for AI-enabled HRD and retention-oriented capability building: cultivate AFL through transparency and calibration supports, design for deliberate fading, and pair metricized refinement with authentic assessments to strengthen transfer.

Authors

Institutions

Publication Details

Journal
Administrative Sciences
Published
2026-08-03
DOI
https://doi.org/10.3390/admsci16080372
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Metricized Scaffolds: AI-Enabled Simulation Training and Transfer in Human Resource Development

Yiduo Wang, Nina Xie, Yuanyuan Wang, Yujun Liu
Administrative Sciences
Ethics and Social Impacts of AI
article

Metricized Scaffolds: AI-Enabled Simulation Training and Transfer in Human Resource Development

Yiduo Wang, Nina Xie, Yuanyuan Wang, Yujun Liu
article en

Abstract

AI-enabled simulation platforms are increasingly used for talent development, offering scalable, low-risk practice and algorithmic feedback for interpersonal HR capabilities such as difficult conversations, negotiation, and consultation. Yet HRD evaluation cautions that within-platform improvement may not transfer to authentic interactions once dashboards and metrics disappear. We conceptualize AI-enabled simulation training as metricized scaffolding and integrate scaffolding theory with exploration–exploitation learning dynamics to explain when algorithmic supports fade into self-regulation rather than produce metric adaptation (score chasing). We introduce Algorithmic Feedback Literacy (AFL)—learners’ capability to interpret algorithmic feedback, calibrate its authority, and translate cues into portable self-scaffolds—as a mechanism linking metricized practice to transfer. We test this model in an AI-enabled virtual internship and career development program that combines repeated simulation attempts with an authentic consultation assessment. Using platform traces (592 attempts nested within 90 learners), instructor-rated consultation performance as a transfer outcome, and 102 learner reflections, we examine how distributed practice span and practice dose related to simulation gains and transfer, and how consultation complexity changes, which interactional behaviors predicted success. Distributed practice span predicted transfer beyond within-platform gains, while practice dose operated primarily through measurable simulation improvement. Complexity shifted performance relevance toward governance and boundary-setting behaviors. Qualitative evidence identified two developmental pathways: productive internalization, where learners converted metric cues into routines and mode-switching strategies, and metric adaptation, where learners optimized scores without internalizing broader professional judgment. We discuss design implications for AI-enabled HRD and retention-oriented capability building: cultivate AFL through transparency and calibration supports, design for deliberate fading, and pair metricized refinement with authentic assessments to strengthen transfer.

Administrative SciencesVol. 16(8)
Lingnan University (HK), Hong Kong Metropolitan University (HK)
Quality Education
Openalex Percentile: Top 6%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.