Redefining Research Productivity: Rethinking Applicant Evaluation With the Arms Race Control Score

OBJECTIVES: The residency application "arms race" for research productivity has intensified following the Step 1 pass/fail transition, with applicants increasingly evaluated by total publication counts. The Total Number of Residency Applicant Publications (TNRAP) has become the dominant metric but doesn't consider authorship position or study quality, leading to inflated and misleading measures of productivity. This study evaluates the Arms Race Control Score (ARCS), a novel effort-adjusted metric, compared to TNRAP in assessing otolaryngology residency applicants. STUDY DESIGN: Retrospective cohort. SETTING: National sample of otolaryngology residency applicants across 5 application cycles (2020-2024). METHODS: A total of 542 matched applicants from 30 programs (10 per US News ranking tier) with PubMed-indexed publications were analyzed. ARCS was calculated by weighting publications by study type, authorship position, and journal impact factor. Trends in TNRAP, cumulative Publication Value Units (cPVU), match characteristics, and ARCS were compared using t-tests, Pearson correlation, and ROC analysis. RESULTS: TNRAP rose significantly from 2020 to 2024 (mean 5.0-8.0; P = .002), while ARCS remained stable (mean ≈ 10; P = .055). ARCS re-ranked 64% to 98% of applicants annually and provided greater discrimination among applicants with identical TNRAP values. ROC analysis demonstrated that ARCS outperformed TNRAP in predicting top 10 match status. CONCLUSIONS: ARCS better reflects research effort and quality than raw counts, offering fairer applicant stratification and stronger predictive consistency for competitive matches. ARCS may mitigate superficial publication, promote meaningful scholarly engagement, and restore balance to the current "arms race" while offering an equitable framework.

Authors

Institutions

Publication Details

Journal
Otolaryngology
Published
2026-04-06
DOI
https://doi.org/10.1002/ohn.70232
Primary Topic
Defense, Military, and Policy Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Redefining Research Productivity: Rethinking Applicant Evaluation With the Arms Race Control Score

Jean Anderson Eloy, Akshay Warrier, Hilary C. McCrary, Christian A. Bowers et al.
Otolaryngology
Defense, Military, and Policy Studies
article

Redefining Research Productivity: Rethinking Applicant Evaluation With the Arms Race Control Score

Jean Anderson Eloy, Akshay Warrier, Hilary C. McCrary, Christian A. Bowers, Aman M. Patel, Richard Klaus Gurgel, Rishi Raman, Andrew G. Lee, Brad Amoateng, Darian Napoleon, Angelica Castillo
article en

Abstract

OBJECTIVES: The residency application "arms race" for research productivity has intensified following the Step 1 pass/fail transition, with applicants increasingly evaluated by total publication counts. The Total Number of Residency Applicant Publications (TNRAP) has become the dominant metric but doesn't consider authorship position or study quality, leading to inflated and misleading measures of productivity. This study evaluates the Arms Race Control Score (ARCS), a novel effort-adjusted metric, compared to TNRAP in assessing otolaryngology residency applicants. STUDY DESIGN: Retrospective cohort. SETTING: National sample of otolaryngology residency applicants across 5 application cycles (2020-2024). METHODS: A total of 542 matched applicants from 30 programs (10 per US News ranking tier) with PubMed-indexed publications were analyzed. ARCS was calculated by weighting publications by study type, authorship position, and journal impact factor. Trends in TNRAP, cumulative Publication Value Units (cPVU), match characteristics, and ARCS were compared using t-tests, Pearson correlation, and ROC analysis. RESULTS: TNRAP rose significantly from 2020 to 2024 (mean 5.0-8.0; P = .002), while ARCS remained stable (mean ≈ 10; P = .055). ARCS re-ranked 64% to 98% of applicants annually and provided greater discrimination among applicants with identical TNRAP values. ROC analysis demonstrated that ARCS outperformed TNRAP in predicting top 10 match status. CONCLUSIONS: ARCS better reflects research effort and quality than raw counts, offering fairer applicant stratification and stronger predictive consistency for competitive matches. ARCS may mitigate superficial publication, promote meaningful scholarly engagement, and restore balance to the current "arms race" while offering an equitable framework.

Otolaryngology
Rutgers, The State University of New Jersey (US), Saint Barnabas Medical Center (US), University of Utah (US), Health Outcomes Solutions (United States) (US), Neurological Surgery (US), Rutgers New Jersey Medical School (US)
Decent work and economic growth
Openalex Percentile: Top 25%
Defense, Military, and Policy Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.