Teaching higher vocational students to evaluate AI career advice: TRACE scaffolding and appropriate reliance in a cluster-randomised trial
Career guidance requires students to judge whether AI recommendations are credible and suitable to their circumstances. We tested TRACE, a decision routine practised with progressively reduced prompts, in a teacher-blocked 2 × 2 cluster-randomised trial involving 480 second-year students in 24 classes at three Chinese higher vocational institutions. The focal comparison was AI + TRACE versus AI only. On a 10-item assessment, appropriate reliance was 81.3% versus 72.1%. The class-adjusted difference was 9.06 percentage points (pointwise randomisation interval [2.54, 24.12]; exact p = .031; Holm-adjusted p = .063), with all six teacher-block differences positive. The mixed-model odds ratio was 1.68 (CR2 95% CI [1.30, 2.16]). Early unaided transfer was 1.14 points (Holm-adjusted exact p = .094), while delayed performance showed little separation. TRACE improved evaluation of sampled AI career advice, but delayed unaided transfer was not established.
Authors
- Yushuang Wu (ORCID: https://orcid.org/0009-0002-9725-0606)
- Haohong Nie
- SENHAO XIONG (ORCID: https://orcid.org/0000-0001-7275-749X)
- Kuihua Li
Institutions
- Khon Kaen University (TH)
- Chongqing Three Gorges University (CN)
Publication Details
- Journal
- British Journal of Guidance and Counselling
- Published
- 2026-11-13
- DOI
- https://doi.org/10.1080/03069885.2026.2744378
- Primary Topic
- Artificial Intelligence in Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00