The assessment of professional judgement and decision-making competency in complex environments – a study of expert adventure sport coaches

Effective decision-making (DM) is critical for operation within complex environments, such as those found in adventure sports (AS). Previously, much attention has been given to the nature and development of DM in adventure sports’ coaches (ASCs). Despite this, little focus has been given to assessing DM competence. This unique study utilises Applied Cognitive Task Analysis via single interview to expert ASCs (n = 6), unpacking their assessment of DM for the highest-level awards. Using semi-structured interviews and thematic analysis we identify four overarching themes: Assessment format, authenticity of performance, validity of assessor decisions and evidence. Assessors utilise a constructively aligned philosophy, requiring sufficient time for candidates to demonstrate authenticity and consistency in performance, and thus enhance validity in the inference of DM competence. Tensions exist when syllabi constrain assessors in these regard. Evidence of performance is required to meet legal requirements. Furthermore, the implications for wider practice and further research are discussed.