Preliminary Development and Evaluation of a Severity Classification Tool Informed by Objective Indicators of Challenging Behavior

ABSTRACT In behavior analysis, the term severe is commonly used to describe challenging behavior, but the criteria used to distinguish severe from non‐severe challenging behavior are not always clearly defined or consistently applied. The current manuscript demonstrates preliminary steps in the development and evaluation of a severity classification tool informed by objective indicators of challenging behavior. Study 1 evaluated the content validity of proposed tool items. Seven experienced Board‐Certified Behavior Analysts rated each item's relevance, clarity, representativeness, perceived bias/inclusivity, and retention. Study 2 examined whether access to the tool was associated with improved agreement among Board Certified Behavior Analysts classifying case scenarios as severe or not severe. Study 3 replicated and extended this evaluation using two no‐tool‐access conditions before tool access. Study 1 outcomes suggested that raters generally viewed tool items as relevant, clear, representative, unbiased, and appropriate for retention. Across Studies 2 and 3, access to the tool was associated with higher rater agreement within and across rater groups. Most raters reported that the tool could have value in research and practice settings. We discuss these findings as preliminary evidence supporting continued tool refinement and validation.