Intra- and Inter-Rater Reliability of the UFS In-Hand Manipulation Assessment Instrument in 3- to 4-Year-Old Children Based on Video Recordings

This study aimed to determine the intra- and inter-rater reliability of the University of the Free State In-Hand Manipulation Assessment Instrument in children aged 3 to 4 years. A quantitative design was employed in which 21 video-recorded assessments were scored to determine reliability. Inter-rater reliability was established through independent scoring by two raters, while intra-rater reliability involved one rater rescoring the same recordings 2 weeks apart. Intra-rater reliability showed agreement for the 195 rating units, with substantial to perfect agreement for 155 units (κ = 0.61-1.00), moderate for 26 units (κ = 0.40-0.60) and poor for 14 units (κ <0.40). Inter-rater reliability demonstrated substantial to perfect agreement for 118 units (κ = 0.61-1.00), moderate for 52 units (κ = 0.40-0.60) and poor for 25 units (κ < 0.40). Overall, acceptable reliability was found, with refinements to administration and rater training recommended.