Influence of workstation design on intra-rater reliability in sculpting kneading task assessments

Intra-rater reliability is a crucial metric for evaluating the consistency of ratings made by the same individual across repeated trials. This study examines intra-rater reliability for posture assessment during a kneading sculpting task on worktables titled at 0° and 25°, and analyzes how table tilt and other factors affect the evaluation consistency. Thirty-nine experienced sculptors performed the tasks under both conditions in a randomized sequence. One rater assessed upper arm, lower arm and wrist postures across three trials. Postures were assessed using the Rapid Upper Limb Assessment method. Reliability and performance differences using the two table tilts were analyzed using Weighted Cohen’s Kappa coefficient (WCK), Wilcoxon signed-rank test, and Bland-Altman plots. Results showed high intra-rater reliability, with WCK averages of 0.78 (0° tilt) and 0.85 (25° tilt). Bland-Altman plots indicated strong agreement, with mean differences near zero and slightly narrower limits of agreement for the 25° tilt, suggesting greater consistency. Minor systematic bias appeared under the 0° tilt, likely due to higher ergonomic demand. The Wilcoxon test revealed significant differences in posture scores between trials for both tilts (p<0.05). These findings underscore the impact of workstation design on intra-rater reliability, highlighting the value of ergonomic integration in manual tasks. Reliability remained high across tilts, with slight variations linked to ergonomic factors. Future studies should include diverse participants, inter-rater comparisons, and varied task types to strengthen generalizability across manual work scenarios.

Authors

Publication Details

Journal
AHFE international
Published
2025-01-01
DOI
https://doi.org/10.54941/ahfe1006465
Primary Topic
Ergonomics and Musculoskeletal Disorders
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Influence of workstation design on intra-rater reliability in sculpting kneading task assessments

Enrique Javier de la Vega Bustillos, Juan Luis Hernández Arellano, David Sáenz-Zamarrón, Aidé Aracely Maldonado-Macías et al.
1 links
AHFE international
Ergonomics and Musculoskeletal Disorders
article

Influence of workstation design on intra-rater reliability in sculpting kneading task assessments

Enrique Javier de la Vega Bustillos, Juan Luis Hernández Arellano, David Sáenz-Zamarrón, Aidé Aracely Maldonado-Macías, Patricia Eugenia Sortillon González
article en

Abstract

Intra-rater reliability is a crucial metric for evaluating the consistency of ratings made by the same individual across repeated trials. This study examines intra-rater reliability for posture assessment during a kneading sculpting task on worktables titled at 0° and 25°, and analyzes how table tilt and other factors affect the evaluation consistency. Thirty-nine experienced sculptors performed the tasks under both conditions in a randomized sequence. One rater assessed upper arm, lower arm and wrist postures across three trials. Postures were assessed using the Rapid Upper Limb Assessment method. Reliability and performance differences using the two table tilts were analyzed using Weighted Cohen’s Kappa coefficient (WCK), Wilcoxon signed-rank test, and Bland-Altman plots. Results showed high intra-rater reliability, with WCK averages of 0.78 (0° tilt) and 0.85 (25° tilt). Bland-Altman plots indicated strong agreement, with mean differences near zero and slightly narrower limits of agreement for the 25° tilt, suggesting greater consistency. Minor systematic bias appeared under the 0° tilt, likely due to higher ergonomic demand. The Wilcoxon test revealed significant differences in posture scores between trials for both tilts (p<0.05). These findings underscore the impact of workstation design on intra-rater reliability, highlighting the value of ergonomic integration in manual tasks. Reliability remained high across tilts, with slight variations linked to ergonomic factors. Future studies should include diverse participants, inter-rater comparisons, and varied task types to strengthen generalizability across manual work scenarios.

AHFE internationalVol. 185
Openalex Percentile: Top 83%
Ergonomics and Musculoskeletal Disorders
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.