Clinical Reasoning Skills in Psychiatric Education: Scenario and Question Generation with Chat-GPT

Introduction Case-based learning holds a crucial place in psychiatric education. Through methods such as written scenarios, video presentations, patient simulations, or observing real patients, students are expected to gain clinical reasoning skills by observing psychiatric cases. Objectives This study aims to generate case scenarios using ChatGPT-4 and create multiple-choice questions based on these cases. Methods A prompt was developed based on the literature to generate case scenarios for 12 psychiatric diagnoses, along with five related questions for each case (Figure) (Kıyak. Rev esp educ méd 2023; 4(3)). The scenarios and questions were organized into six forms, each containing two cases and ten questions. Results A total of 12 psychiatrists, (5.33 ± 1.31 years of practice) evaluated each form in pairs. The results of the case evaluations are presented in Table 1, and the question evaluations in Table 2. Table 1 Form 1 Form 2 Form 3 Form 4 Form 5 Form 6 Total Schizophrenia/ MDD Schizophreniform/ AN Brief PD/ SSD Panic/ Bipolar I Dysthymia/ BPD Conversion/ GAD The clinical scenario represents a typical case for the queried disorder. 2/2 2/2 1/2 2/2 2/2 2/2 23/24 The mental status examination findings in the case are appropriate for diagnosis. 2/2 2/2 2/2 2/2 2/2 1/2 23/24 The case scenario is well-written. 2/2 2/1 2/2 2/2 2/2 2/2 23/24 The case is of appropriate difficulty for medical students. 2/2 1/1 2/1 2/2 2/2 1/2 20/24 The case is aimed at measuring clinical reasoning skills. 2/2 2/2 2/1 2/2 1/1 2/2 21/24 Table 2 The question text is clear. The question is clinically appropriate. The question has only one correct answer. The information provided is sufficient to find the correct answer. The distractors are plausible. The question was of appropriate difficulty for medical students. Factual Recall/ Clinical reasoning Total by question type Diagnosis 23 23 22 23 23 19 16 149/168 Treatment 24 23 12 20 17 15 17 128/168 Differential diagnosis <jats:td colspan="1" row