Psychometric Evaluation of the Chinese Version of the Mental Health System Responsiveness Questionnaire for Psychiatric Outpatients: Classical Test Theory and Item Response Theory Approaches

Zhenzhu Qian,1– 3 Yanyan Yang,3 Jianfeng Tan,4 You Li,4 Jin Zhou,4 Jiewen Huang,1 Sawitri Assanangkornchai,2 Jialong Chen1 1The First Dongguan Affiliated Hospital, Guangdong Medical University, Dongguan, Guangdong Province, People’s Republic of China; 2Department of Epidemiology, Faculty of Medicine, Prince of Songkla University, Hat Yai, Songkhla, Thailand; 3Department of Hospital Management, Guangdong Medical University, Dongguan, Guangdong Province, People’s Republic of China; 4School of Humanities and Management, Guangdong Medical University, Dongguan, Guangdong Province, People’s Republic of ChinaCorrespondence: Sawitri Assanangkornchai, Department of Epidemiology, Faculty of Medicine, Prince of Songkla University, Hat Yai, Songkhla, 90110, Thailand, Email [email protected] Jialong Chen, The First Dongguan Affiliated Hospital, Guangdong Medical University, Dongguan, Guangdong, 523710, People’s Republic of China, Email [email protected]: The Health System Responsiveness Questionnaire has been an important tool for evaluating the quality of health services from non-clinical perspectives. However, there is a lack of reliable and valid tools to assess the responsiveness of the mental health system in China, despite the increasing attention to the quality of mental health services.Purpose: This study aimed to adapt a Chinese version of the Mental Health System Responsiveness Questionnaire based on the WHO Health System Responsiveness Questionnaire and assess its psychometric properties among psychiatric outpatients.Patients and Methods: We adapted the Health System Responsiveness Questionnaire into Chinese and used it on psychiatric outpatients through face-to-face interviews, resulting in 1067 valid responses. We conducted a reliability and validity analysis based on classical test theory (CTT) and applied the graded response model based on item response theory (IRT) to examine the performance of each item.Results: From the CTT analysis, values of Cronbach’s alpha, test-retest reliability, and split-half reliability of the questionnaire were all greater than 0.8. Confirmatory factor analysis exhibited a good fit; convergent and discriminant validity were achieved with average variance extracted > 0.5 and heterotrait-monotrait ratio < 0.9. Results from the IRT analysis showed that all items demonstrated acceptable discrimination (discrimination parameters ≥ 0.65) and appropriate difficulty parameters (ranging from − 4 to 4). Additionally, all items provided sufficient information, except for two items in the prompt attention domain.Conclusion: Our adapted Mental Health System Responsiveness Questionnaire possessed strong psychometric properties and could serve as an effective tool for assessing the responsiveness of mental health systems in China. However, improving two items in the domain of prompt attention may contribute to more optimal psychometric properties of the questionnaire.Keywords: health system responsiveness, questionnaire, psychiatric patients, psychometric properties