Assessing Inter-rater Reliability and Intra-rater Reliability During the 2-Minute Hand-Release Push-Up Event in the Army Fitness Test

{"ABSTRACT:":[0],"Van":[1],"Dam,":[2],"D,":[3,11],"Gidaro,":[4],"R,":[5],"Ferreira,":[6],"S,":[7],"Morogiello,":[8],"J,":[9],"Jaffe,":[10],"and":[12,18,61,97,109,167,213,226,228,236],"Semmel,":[13],"A.":[14],"Assessing":[15],"inter-rater":[16,96,212,235],"reliability":[17,20,81,99,225],"intra-rater":[19,98,214,237],"during":[21],"the":[22,28,80,83,95,101,146,182,197,200,218,275],"2-minute":[23],"hand-release":[24,57,103,123],"push-up":[25,104,124],"event":[26,65,277],"in":[27,43,179,199,255,268],"army":[29],"fitness":[30],"test.":[31,149],"J":[32],"Strength":[33],"Cond":[34],"Res":[35],"XX(X):":[36],"000-000,":[37],"2026-The":[38],"Army":[39],"Fitness":[40],"Test,":[41],"implemented":[42],"2025,":[44],"assesses":[45],"soldier":[46],"readiness":[47],"via":[48],"5":[49],"physically":[50],"challenging":[51],"events":[52],"(3":[53],"repetition":[54,159,166],"maximum":[55],"deadlift,":[56],"push-up,":[58],"sprint-drag-carry,":[59],"plank,":[60],"2-mile":[62],"run).":[63],"Each":[64,137],"is":[66,262],"graded":[67,121],"by":[68,160],"individuals":[69],"with":[70,193,250],"varying":[71],"levels":[72],"of":[73,82,89,100,111,142,181,191],"experience,":[74],"thus":[75],"posing":[76],"a":[77,140,143,155,164,204,248,279],"threat":[78],"to":[79,93,106,153,210,222,232],"physical":[84,113],"performance":[85],"scores.":[86],"The":[87],"purpose":[88],"this":[90],"study":[91],"was":[92],"examine":[94],"two-minute":[102,147],"test":[105],"facilitate":[107],"learning":[108],"improvement":[110],"assessing":[112],"performance.":[114],"Seventeen":[115],"raters":[116,178,243],"(5":[117],"female,":[118],"12":[119],"male)":[120],"10":[122],"(HRPU)":[125],"videos":[126,198],"over":[127],"3":[128,183],"separate":[129],"weeks":[130],"(30":[131],"total":[132,135,281],"videos,":[133],"60":[134],"minutes).":[136],"video":[138],"contained":[139],"recording":[141],"Cadet":[144],"performing":[145],"HRPU":[148,276],"Raters":[150],"were":[151,186,208,244],"required":[152],"provide":[154],"response":[156],"after":[157],"each":[158,180,189],"stating":[161],"\\"yes\\"":[162],"for":[163,169,188],"proper":[165],"\\"no\\"":[168],"an":[170],"improper":[171],"repetition.":[172],"Researchers":[173,216],"recorded":[174],"all":[175],"responses":[176,257],"from":[177],"settings.":[184],"Videos":[185],"randomized":[187],"week":[190],"viewing":[192,196],"no":[194],"rater":[195],"same":[201],"order.":[202],"Using":[203],"logistic":[205],"model,":[206],"we":[207,240],"able":[209],"measure":[211],"reliability.":[215,238],"calculated":[217],"intraclass":[219],"correlation":[220],"coefficient":[221],"evaluate":[223],"overall":[224],"agreement":[227],"Prevalence-Adjusted,":[229],"Bias-Adjusted":[230],"Kappa":[231],"further":[233],"understand":[234],"Ultimately,":[239],"found":[241],"that":[242],"not":[245],"consistent":[246],"as":[247],"group,":[249],"some":[251],"showing":[252],"significant":[253],"fluctuations":[254],"their":[256],"between":[258],"tests.":[259],"This":[260],"finding":[261],"crucial":[263],"because":[264],"even":[265],"small":[266],"differences":[267],"scoring":[269],"can":[270],"negatively":[271],"impact":[272],"assessment":[273],"on":[274],"influencing":[278],"subjects's":[280],"score.":[282]}

Authors

Institutions

Publication Details

Journal
The Journal of Strength and Conditioning Research
Published
2026-09-18
DOI
https://doi.org/10.1519/jsc.0000000000005673
Primary Topic
Occupational Health and Performance
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Assessing Inter-rater Reliability and Intra-rater Reliability During the 2-Minute Hand-Release Push-Up Event in the Army Fitness Test

Sarah Ferreira, Drew J. Van Dam, Austin Semmel, Rachel Gidaro et al.
The Journal of Strength and Conditioning Research
Occupational Health and Performance
article

Assessing Inter-rater Reliability and Intra-rater Reliability During the 2-Minute Hand-Release Push-Up Event in the Army Fitness Test

Sarah Ferreira, Drew J. Van Dam, Austin Semmel, Rachel Gidaro, Jenna Morogiello, Dan Jaffe
article en

Abstract

ABSTRACT: Van Dam, D, Gidaro, R, Ferreira, S, Morogiello, J, Jaffe, D, and Semmel, A. Assessing inter-rater reliability and intra-rater reliability during the 2-minute hand-release push-up event in the army fitness test. J Strength Cond Res XX(X): 000-000, 2026-The Army Fitness Test, implemented in 2025, assesses soldier readiness via 5 physically challenging events (3 repetition maximum deadlift, hand-release push-up, sprint-drag-carry, plank, and 2-mile run). Each event is graded by individuals with varying levels of experience, thus posing a threat to the reliability of the physical performance scores. The purpose of this study was to examine the inter-rater and intra-rater reliability of the two-minute hand-release push-up test to facilitate learning and improvement of assessing physical performance. Seventeen raters (5 female, 12 male) graded 10 hand-release push-up (HRPU) videos over 3 separate weeks (30 total videos, 60 total minutes). Each video contained a recording of a Cadet performing the two-minute HRPU test. Raters were required to provide a response after each repetition by stating "yes" for a proper repetition and "no" for an improper repetition. Researchers recorded all responses from raters in each of the 3 settings. Videos were randomized for each week of viewing with no rater viewing the videos in the same order. Using a logistic model, we were able to measure inter-rater and intra-rater reliability. Researchers calculated the intraclass correlation coefficient to evaluate overall reliability and agreement and Prevalence-Adjusted, Bias-Adjusted Kappa to further understand inter-rater and intra-rater reliability. Ultimately, we found that raters were not consistent as a group, with some showing significant fluctuations in their responses between tests. This finding is crucial because even small differences in scoring can negatively impact assessment on the HRPU event influencing a subjects's total score.

The Journal of Strength and Conditioning Research
United States Military Academy (US)
Openalex Percentile: Top 4%
Occupational Health and Performance
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.