Psychometric Properties of the Diagnosis and Screening Instrument for DSM-5

Abstract: This study aims to evaluate the psychometric properties of the computer-assisted Dutch version of the MINI-SCAN (called DSI) compared to the Dutch SCID-5-CV. Administered to 260 patients between September 2020 and July 2022, the DSI exhibits valid diagnostic agreement on DSM-5 category level (AUC = 0.71-0.82, κ = 0.40–0.64), with high specificity (0.79–0.99) and variable sensitivity (0.40–0.71). On disorder level, the diagnostic agreement of the DSI demonstrates acceptability for seven out of fifteen measured disorders (AUC = 0.73–0.89, κ = 0.44–0.74), with high specificity (0.79–0.98) and moderate to substantial sensitivity (0.47–0.86). However, for four disorders, diagnostic agreement is unacceptable (AUC = 0.58–0.68, κ = 0.11–0.45). For four others, the sample size is insufficient for a conclusive statement. Inter-rater reliability of the DSI on both category level as disorder level is moderate to high (κ = 0.42–0.94). Administration time in minutes for the DSI ( M = 42.32, SD = 14.91) is significantly shorter than for the SCID-5-CV ( M = 78.17, SD = 21.48), representing a 46% reduction. In conclusion, psychometric properties of the DSI in general are promising and assessment with the DSI is less time-consuming. Despite some limitations, such as low inclusion rates for certain disorders and limited variation in the severity of complaints, the DSI appears promising for classification purposes and may serve as a viable option for routine clinical practice.