Development of score prediction model based on the K-CESA with self-report test tool

This study investigates the possibility that the characteristics of assessment tools may influence the results of individual competency evaluations. A self-report survey consisting of 28 items was developed to assess core competencies and was compared with the results obtained from K-CESA’s performance-based and self-report assessments. The study involved 117 undergraduate students from S University who participated in the K-CESA assessment. Correlation analysis, Support Vector Machine (SVM), and linear regression models were applied to examine the relationships and predictive accuracy between the self-report survey results and the K-CESA outcomes. The correlation analysis revealed that, even when assessing the same competencies, the relationship between the performance-based evaluation results from K-CESA and the self-report survey results developed in this study was very weak. In contrast, there was a significant correlation between the self-report evaluation results from K-CESA and the self-report survey results from this study, with strong predictive accuracy. This indicates that even with fewer items, the self-report evaluation results from K-CESA can be effectively predicted. These findings highlight the importance of assessment methods in determining competency evaluation results. Furthermore, the study provides practical implications by proposing directions to reduce discrepancies between self-report measures widely used in education and actual performance, thereby improving the validity of competency assessment tools.

Authors

Publication Details

Journal
The Korea Association for Care Competency Education
Published
2024-12-31
DOI
https://doi.org/10.52616/jccer.2024.9.2.145
Primary Topic
Diverse Approaches in Healthcare and Education Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Development of score prediction model based on the K-CESA with self-report test tool

Yewon Kim, Sohyeon Park, Heewon Lee
The Korea Association for Care Competency Education
Diverse Approaches in Healthcare and Education Studies
article

Development of score prediction model based on the K-CESA with self-report test tool

Yewon Kim, Sohyeon Park, Heewon Lee
article en

Abstract

This study investigates the possibility that the characteristics of assessment tools may influence the results of individual competency evaluations. A self-report survey consisting of 28 items was developed to assess core competencies and was compared with the results obtained from K-CESA’s performance-based and self-report assessments. The study involved 117 undergraduate students from S University who participated in the K-CESA assessment. Correlation analysis, Support Vector Machine (SVM), and linear regression models were applied to examine the relationships and predictive accuracy between the self-report survey results and the K-CESA outcomes. The correlation analysis revealed that, even when assessing the same competencies, the relationship between the performance-based evaluation results from K-CESA and the self-report survey results developed in this study was very weak. In contrast, there was a significant correlation between the self-report evaluation results from K-CESA and the self-report survey results from this study, with strong predictive accuracy. This indicates that even with fewer items, the self-report evaluation results from K-CESA can be effectively predicted. These findings highlight the importance of assessment methods in determining competency evaluation results. Furthermore, the study provides practical implications by proposing directions to reduce discrepancies between self-report measures widely used in education and actual performance, thereby improving the validity of competency assessment tools.

The Korea Association for Care Competency EducationVol. 9(2)
Quality Education
Openalex Percentile: Top 62%
Diverse Approaches in Healthcare and Education Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.