Supporting Pre‐Service Teachers' Diagnostic Skills: Analysing Judgement Accuracy and Chatbot Impact in a Biology Classroom Simulation

ABSTRACT Background Novice teachers often struggle to apply their content and pedagogical content knowledge in real teaching situations, a phenomenon known as the theory–practice gap. Classroom simulations offer an opportunity to bridge this gap by integrating practical, risk‐free experiences into early university teacher education. Enriching these simulations with chatbots could enhance this process by providing tailored, adaptive learning support, potentially improving pre‐service teachers' diagnostic skills. Objectives This study investigates pre‐service biology teachers' ability to diagnose virtual students' evolutionary explanations in the classroom simulation SCR Bio and the effect of a retrieval‐based chatbot system. Methods A sample of 107 pre‐service biology teachers diagnosed 3153 virtual students' evolutionary explanations using three SCR Bio settings: without a chatbot (SCR‐only), with a knowledge bot (SCR‐Kbot), and with both a knowledge bot and a process‐based feedback bot (SCR‐Kbot+Pbot). Results and Conclusions Pre‐service biology teachers were able to broadly categorize student explanations in a classroom simulation; however, they struggled to accurately diagnose specific misconceptions, especially in mixed‐scientific responses. Regression analysis revealed that pedagogical content knowledge and cognitive load had a significant influence on judgement accuracy. Although chatbot‐based support was accessed more frequently when combined with process prompts (SCR‐Kbot+Pbot group), it did not result in significant improvements in accuracy. These findings highlight the need for targeted training for diagnostic skills and suggest that the integration of adaptive digital tools alone may not be sufficient to enhance diagnostic competence without deeper pedagogical embedding.

Authors

Institutions

Publication Details

Journal
Journal of Computer Assisted Learning
Published
2025-12-02
DOI
https://doi.org/10.1002/jcal.70161
Primary Topic
AI in Service Interactions
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Supporting Pre‐Service Teachers' Diagnostic Skills: Analysing Judgement Accuracy and Chatbot Impact in a Biology Classroom Simulation

Daniela Fiedler, Daniel Schönle, Ute Harms, Christoph Reich
Journal of Computer Assisted Learning
AI in Service Interactions
article

Supporting Pre‐Service Teachers' Diagnostic Skills: Analysing Judgement Accuracy and Chatbot Impact in a Biology Classroom Simulation

Daniela Fiedler, Daniel Schönle, Ute Harms, Christoph Reich
article en

Abstract

ABSTRACT Background Novice teachers often struggle to apply their content and pedagogical content knowledge in real teaching situations, a phenomenon known as the theory–practice gap. Classroom simulations offer an opportunity to bridge this gap by integrating practical, risk‐free experiences into early university teacher education. Enriching these simulations with chatbots could enhance this process by providing tailored, adaptive learning support, potentially improving pre‐service teachers' diagnostic skills. Objectives This study investigates pre‐service biology teachers' ability to diagnose virtual students' evolutionary explanations in the classroom simulation SCR Bio and the effect of a retrieval‐based chatbot system. Methods A sample of 107 pre‐service biology teachers diagnosed 3153 virtual students' evolutionary explanations using three SCR Bio settings: without a chatbot (SCR‐only), with a knowledge bot (SCR‐Kbot), and with both a knowledge bot and a process‐based feedback bot (SCR‐Kbot+Pbot). Results and Conclusions Pre‐service biology teachers were able to broadly categorize student explanations in a classroom simulation; however, they struggled to accurately diagnose specific misconceptions, especially in mixed‐scientific responses. Regression analysis revealed that pedagogical content knowledge and cognitive load had a significant influence on judgement accuracy. Although chatbot‐based support was accessed more frequently when combined with process prompts (SCR‐Kbot+Pbot group), it did not result in significant improvements in accuracy. These findings highlight the need for targeted training for diagnostic skills and suggest that the integration of adaptive digital tools alone may not be sufficient to enhance diagnostic competence without deeper pedagogical embedding.

Journal of Computer Assisted LearningVol. 42(1)
University of Copenhagen (DK), Leibniz Institute for Science and Mathematics Education (DE), University College Copenhagen (DK), Furtwangen University (DE)
Bundesministerium für Bildung und Forschung
Openalex Percentile: Top 80%
AI in Service Interactions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.