Development of the Integrated-Cultural Well-Being Index (ICWI): A Content Validity & Inter-Rater Reliability Study With Experts in Clinical Mental-Health Counseling

Abstract This dissertation study developed and validated the Integrated-Cultural Well-Being Index (ICWI), a psychological measurement that assessed well-being across both Individualist-Cultural (IC) and Collectivist-Cultural (CC) dimensions. Grounded in Bronfenbrenner’s Process-Person-Context-Time (PPCT) model, the ICWI was conceptualized to reflect the multidimensional nature of well-being in modern integrated societies, where cultural boundaries are increasingly fluid. The ICWI consists of ten latent dimensions of well-being: self-determination, social relationships, self-enhancement, self-contentment, cultural identity, cultural coping skills, communalism, cultural spirituality, life satisfaction, and mental health. A three-phase expert validation process was conducted, employing both content validity and inter-rater reliability methodologies. Content validity was assessed using the Expert Level Content Validity Index indices of Item-Level Content Validity Index (I-LCVI), Total Content Validity (T-CVI), and Scale-Level Content Validity Index Average (S-CVI/Ave). Inter-rater reliability was evaluated using Intra-Class Correlation Coefficients indices of Single Measure (SM), Average Measure (AM), Cronbach’s Alpha, and F-statistics. In Phase One, 16 experts rated 55 items on relevance. Content validity scores were I-LCVI ≥ .78 for 31 out of 55 items, T-CVI = .82, S-CVI/Ave = .867. Inter-rater reliability yielded, SM-ICC = .129, AM-ICC = .961, Cronbach’s Alpha = .968, F (15, 840) = 37.226, p < .001. In Phase Two, 16 experts evaluated 54 revised items across sufficiency, clarity, coherence, and relevance. Scores were I-LCVI ≥ .78 for 48 out of 54, T-CVI = .87, S-CVI/Ave = .931. Reliability scores were SM-ICC = .156, AM-ICC = .976, Cronbach’s Alpha = .977F (15, 840) = 41.051, p < .001. In Phase Three, 22 experts rated 36 final items. Scores were I-LCVI ≥ .78 35 out of 36, T-CVI = .88, S-CVI/Ave = .912. Reliability scores were Cronbach’s Alpha = .958, AM-ICC = .956, SM-ICC = .131, F (21, 3003) = 23.631, p < .001. The findings from this study suggest preliminary support for the Integrated Cultural Well-Being Index. Expert evaluations indicated that the ICWI items possess high levels of sufficiency, clarity, coherence, and relevance as indicators of culturally integrated well-being. Content validity scores exceeded established thresholds, and inter-rater reliability was consistently strong at the group level. These results provide a solid foundation for future studies and suggest the ICWI holds potential for application in research, clinical assessment, and policy development in diverse and integrated populations. Keywords: Integrated Well-Being, Content Validity, Inter-Rater Reliability, Individualist, Collectivist, Cultural Identity, Psychometric Evaluation, PPCT Model