Measuring Professional Competency in School Counselors: Development and Rasch Validation of a Multidimensional Instrument

<ns3:p>Background The measurement of professional competency in school counseling remains methodologically constrained by fragmented domain assessment and heavy reliance on classical test theory approaches. There is a critical need for an empirically calibrated instrument that integrates regulatory competency standards with expanded theoretical domains while ensuring measurement precision and structural coherence. This study developed and validated a multidimensional instrument of professional competency for school counselors using Rasch analysis. Methods A cross-sectional instrumental design was implemented. The instrument was constructed across seven domains: assessment, development of guidance and counseling program, implementation of guidance and counseling services, evaluation of guidance and counseling program, supervision of pre-service counselor training, continuous professional development, and collaborative engagement in co-curricular programs. Seventy-one items were rated on a five-point Likert scale. Data from 93 practicing school counselors were analyzed using the Rasch Rating Scale Model. Analyses included the evaluation of category functioning, item and person fit statistics, reliability and separation indices, and principal component analysis of residuals (PCAR) to assess construct dimensionality. Results The Rasch model demonstrated acceptable item fit and ordered rating scale thresholds. The raw variance explained by measures was 53.4%, with 6.7% unexplained variance in the first contrast, indicating a dominant latent construct despite the multidomain theoretical structure. Item difficulty estimates ranged from −1.68 to +1.71 logits, forming a hierarchical continuum from foundational service practices to advanced supervisory and professional roles. Reliability and separation indices indicated stable item calibration and adequate differentiation among levels of professional competency. Conclusions The findings support the structural validity, hierarchical calibration, and measurement precision of the instrument within a unified Rasch framework. The instrument provides a methodologically robust basis for professional assessment, supervision, and competency-based development in school counseling contexts, with significant potential for further validation across diverse educational systems.</ns3:p>

Authors

Institutions

Publication Details

Journal
F1000Research
Published
2026-04-22
DOI
https://doi.org/10.12688/f1000research.178940.1
Primary Topic
Counseling Practices and Supervision
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Measuring Professional Competency in School Counselors: Development and Rasch Validation of a Multidimensional Instrument

Mutmainnah, Deasy Yunika Khairun, Maya Nurlita, Kamaliyah Kadir et al.
F1000Research
Counseling Practices and Supervision
article

Measuring Professional Competency in School Counselors: Development and Rasch Validation of a Multidimensional Instrument

Mutmainnah, Deasy Yunika Khairun, Maya Nurlita, Kamaliyah Kadir, Ibrahim Al Hakim, Fuja Siti Fujiawati, Sohibun ., Agus Taufiq, Yusi Riksa Yustiana
article en

Abstract

<ns3:p>Background The measurement of professional competency in school counseling remains methodologically constrained by fragmented domain assessment and heavy reliance on classical test theory approaches. There is a critical need for an empirically calibrated instrument that integrates regulatory competency standards with expanded theoretical domains while ensuring measurement precision and structural coherence. This study developed and validated a multidimensional instrument of professional competency for school counselors using Rasch analysis. Methods A cross-sectional instrumental design was implemented. The instrument was constructed across seven domains: assessment, development of guidance and counseling program, implementation of guidance and counseling services, evaluation of guidance and counseling program, supervision of pre-service counselor training, continuous professional development, and collaborative engagement in co-curricular programs. Seventy-one items were rated on a five-point Likert scale. Data from 93 practicing school counselors were analyzed using the Rasch Rating Scale Model. Analyses included the evaluation of category functioning, item and person fit statistics, reliability and separation indices, and principal component analysis of residuals (PCAR) to assess construct dimensionality. Results The Rasch model demonstrated acceptable item fit and ordered rating scale thresholds. The raw variance explained by measures was 53.4%, with 6.7% unexplained variance in the first contrast, indicating a dominant latent construct despite the multidomain theoretical structure. Item difficulty estimates ranged from −1.68 to +1.71 logits, forming a hierarchical continuum from foundational service practices to advanced supervisory and professional roles. Reliability and separation indices indicated stable item calibration and adequate differentiation among levels of professional competency. Conclusions The findings support the structural validity, hierarchical calibration, and measurement precision of the instrument within a unified Rasch framework. The instrument provides a methodologically robust basis for professional assessment, supervision, and competency-based development in school counseling contexts, with significant potential for further validation across diverse educational systems.</ns3:p>

F1000ResearchVol. 15
Indonesia University of Education (ID), Sultan Ageng Tirtayasa University (ID), Universitas Muhammadiyah Semarang (ID), Universitas Dayanu Ikhsanuddin (ID)
Quality Education
Openalex Percentile: Top 5%
Counseling Practices and Supervision
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.