Assessing procedural knowledge in clinical psychology: development and evaluation of a brief video-based measure

Abstract Objective: Research on the acquisition of psychotherapeutic competencies attributes an important role to procedural knowledge. We developed and evaluated a brief video-based measure of procedural knowledge in clinical psychology (the Pro CliPs Task). Method: The Pro CliPs Task consists of seven distinct case vignettes, each presented in four brief videos, and eight open-ended questions pertaining to each case vignette. The instrument was developed and validated in a multi-stage process, which included conceptual development, a feasibility study and an evaluation study. In the feasibility study ( n =66 psychology students), the item characteristics and reliability of the coding method for the open-ended answers, authenticity of the case vignettes and general applicability of the measure were assessed. The following evaluation study ( n =68 psychology students, n =65 postgraduate psychotherapy trainees) was conducted to investigate the validity of the instrument. Results: The item characteristics of the Pro CliPs Task were largely found to be within the expected range and inter-rater reliability was excellent. The case vignettes used were perceived as highly authentic, and the Pro CliPs Task was generally evaluated positively by participants. In the evaluation study, the Pro CliPs Task was strongly associated with declarative knowledge and therapeutic self-efficacy. Postgraduate psychotherapy trainees outperformed psychology students in the Pro CliPs Task. Conclusion: The Pro CliPs Task holds promise as a valid and brief measure of procedural knowledge in clinical psychology with potential for use in research, training and teaching contexts. Key learning aims (1) To gain insight into the role of procedural knowledge in clinical psychology and the limitations regarding its assessment. (2) To learn about the theoretical basis and conceptual development of the Pro CliPs Task, a recently developed measure to assess procedural knowledge in clinical psychology. (3) To evaluate the Pro CliPs Task regarding its item characteristics, inter-rater reliability, applicability, authenticity and validity.