Redefining Research Productivity: Rethinking Applicant Evaluation With the Arms Race Control Score.
| Title: | Redefining Research Productivity: Rethinking Applicant Evaluation With the Arms Race Control Score. |
|---|---|
| Authors: | Warrier A; Department of Otolaryngology, Rutgers New Jersey Medical School, Newark, New Jersey, USA.; Department of Otolaryngology, Bowers Neurosurgical Frailty and Outcomes Data Science Lab, Flint, Michigan, USA.; Castillo A; Department of Otolaryngology, Rutgers New Jersey Medical School, Newark, New Jersey, USA.; Amoateng B; Department of Otolaryngology, Rutgers New Jersey Medical School, Newark, New Jersey, USA.; Raman R; Department of Otolaryngology, Rutgers New Jersey Medical School, Newark, New Jersey, USA.; Lee A; Department of Otolaryngology, Rutgers New Jersey Medical School, Newark, New Jersey, USA.; Napoleon D; Department of Otolaryngology, Rutgers New Jersey Medical School, Newark, New Jersey, USA.; Patel AM; Department of Otolaryngology, Rutgers New Jersey Medical School, Newark, New Jersey, USA.; McCrary HC; Department of Otolaryngology, University of Utah, Salt Lake City, Utah, USA.; Gurgel R; Department of Otolaryngology, University of Utah, Salt Lake City, Utah, USA.; Bowers C; Department of Otolaryngology, Bowers Neurosurgical Frailty and Outcomes Data Science Lab, Flint, Michigan, USA.; Eloy JA; Department of Otolaryngology, Rutgers New Jersey Medical School, Newark, New Jersey, USA.; Department of Neurological Surgery, Rutgers New Jersey Medical School, Newark, New Jersey, USA.; Department of Ophthalmology and Visual Science, Rutgers New Jersey Medical School, Newark, New Jersey, USA.; Department of Otolaryngology and Facial Plastic Surgery, Cooperman Barnabas Medical Center-RWJBarnabas Health, Livingston, New Jersey, USA. |
| Source: | Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery [Otolaryngol Head Neck Surg] 2026 Apr 06. Date of Electronic Publication: 2026 Apr 06. |
| Publication Model: | Ahead of Print |
| Publication Type: | Journal Article |
| Language: | English |
| Journal Info: | Publisher: Wiley Country of Publication: England NLM ID: 8508176 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1097-6817 (Electronic) Linking ISSN: 01945998 NLM ISO Abbreviation: Otolaryngol Head Neck Surg Subsets: MEDLINE |
| Imprint Name(s): | Publication: 2023- : [Oxford] : Wiley; Original Publication: [Rochester, Minn.] : The Academy, [c1981- |
| Abstract: | Objectives: The residency application "arms race" for research productivity has intensified following the Step 1 pass/fail transition, with applicants increasingly evaluated by total publication counts. The Total Number of Residency Applicant Publications (TNRAP) has become the dominant metric but doesn't consider authorship position or study quality, leading to inflated and misleading measures of productivity. This study evaluates the Arms Race Control Score (ARCS), a novel effort-adjusted metric, compared to TNRAP in assessing otolaryngology residency applicants.; Study Design: Retrospective cohort.; Setting: National sample of otolaryngology residency applicants across 5 application cycles (2020-2024).; Methods: A total of 542 matched applicants from 30 programs (10 per US News ranking tier) with PubMed-indexed publications were analyzed. ARCS was calculated by weighting publications by study type, authorship position, and journal impact factor. Trends in TNRAP, cumulative Publication Value Units (cPVU), match characteristics, and ARCS were compared using t-tests, Pearson correlation, and ROC analysis.; Results: TNRAP rose significantly from 2020 to 2024 (mean 5.0-8.0; P = .002), while ARCS remained stable (mean ≈ 10; P = .055). ARCS re-ranked 64% to 98% of applicants annually and provided greater discrimination among applicants with identical TNRAP values. ROC analysis demonstrated that ARCS outperformed TNRAP in predicting top 10 match status.; Conclusions: ARCS better reflects research effort and quality than raw counts, offering fairer applicant stratification and stronger predictive consistency for competitive matches. ARCS may mitigate superficial publication, promote meaningful scholarly engagement, and restore balance to the current "arms race" while offering an equitable framework.; (© 2026 The Author(s). Otolaryngology–Head and Neck Surgery published by Wiley Periodicals LLC on behalf of American Academy of Otolaryngology–Head and Neck Surgery Foundation.) |
| References: | Makhoul AT, Pontell ME, Ganesh Kumar N, et al. Objective measures needed—program directors' perspectives on a pass/fail USMLE Step 1. N Engl J Med. 2020;382(25):2389‐2392.; Karimov Z, Kazim SF, Schmidt M, et al. Rapid exponential increase in neurosurgery departmental scholarly output following an intensive research initiative. Postgrad Med J. 2022;98(1158):239‐245.; Wickramasinghe DP, Perera CS, Senarathna S, et al. Patterns and trends of medical student research. BMC Med Educ. 2013;13(1):175.; Bowe SN, Schmalbach CE, Laury AM. The state of the otolaryngology match: a review of applicant trends, “impossible” qualifications, and implications. Otolaryngol Head Neck Surg. 2017;156(6):985‐990.; Benjamin WJ, Lenze NR, Farlow JL, et al. Cost of the otolaryngology residency application process: comparison with other specialties and equity implications. OTO Open. 2022;6:2473974X221119150.; Ahmed AK, Adashi EY. Research fever—an ever more prominent trend in the residency match. JAMA Surg. 2023;158(1):6.; Bowe SN, Bly RA, Whipple ME, Gray ST. Residency selection in otolaryngology: past, present, and future. Laryngoscope. 2023;133(11):S1‐S13.; Wadhwa H, Shah SS, Shan J, et al. The neurosurgery applicant's “arms race”: analysis of medical student publication in the neurosurgery residency match. J Neurosurg. 2019;133(6):1913‐1921.; Vaysburg DM, Cortez AR, Hanseman DJ, et al. An analysis of applicant competitiveness to general surgery, surgical subspecialties, and integrated programs. Surgery. 2021;170(4):1087‐1092.; Dorismond C, Shah RN, Ebert Jr., CS, Buckmire RA. Impact of medical student research fellowships on otolaryngology match outcomes. Laryngoscope. 2021;131(9):E2506‐E2512.; Narang J, Eversman A, Kalra M, et al. Trends of research output of allopathic medical students matching into dermatology, 2007–2018. JAMA Dermatol. 2021;157(8):1‐5.; Adeyeri B, Lee T, Beal T, et al. Analysis of research productivity of orthopedic surgery residency applicants. Cureus. 2023;15(10):e46384.; Bowers CA, Covell MM, Levy EI, et al. Arms Race Control Score standardizes residency applicant publication assessment. Neurosurgery. 2025;97(1):250‐258.; Nasser JS, Artino Jr. AR, Kind T, et al. Matching into competitive surgical residencies: predictors of success. Med Educ Online. 2023;28(1):2189558.; Nathan AS, Richards PQ, Ryll LS, et al. The home program advantage in the otolaryngology residency match. J Surg Educ. 2023;80(12):1877‐1884.; Wang JC, Pillutla P, Tello N, et al. Competitiveness of otolaryngology residency applicants without a home program. Ann Otol, Rhinol, Laryngol. 2020;129:462‐468.; Roth SG, Ortiz AV, Feldman MJ, et al. “Home field advantage”: the presence of a home neurosurgical residency training program is associated with improved match outcomes. Neurosurgery. 2024;95(3):702‐708.; Jenkins TM. Meet the Residents. Columbia University Press; 2020.; Hoy JF, Shuman SL, Smith SR, et al. Analysis of variability and trends in medical school clerkship grades. Surg Open Sci. 2024;19:80‐86.; Maxfield CM, Cao JY, Martin JG, et al. An elite privilege: top‐ranked medical schools provide fewer comparative performance data on their students. J Am Coll Radiol. 2023;20:446‐451.; Shahriar AA, Puram VV, Miller JM, et al. Socioeconomic diversity of the matriculating US medical student body by race, ethnicity, and sex, 2017–2019. JAMA Netw Open. 2022;5(3):e222621.; Carter A, Findlay MC, Earl ER, et al. Systematic review of research, mentorship, and career resources for medical students pursuing neurosurgical training. World Neurosurg. 2023;179:28‐36.; Rodriguez R, Siller A, Pandya AG, et al. Implications of increasing publication trends in dermatology on individuals from disadvantaged backgrounds and those without a home dermatology program. J Am Acad Dermatol. 2021;84(2):e109‐e110.; Nguyen M, Chaudhry SI, Asabor E, et al. Variation in research experiences and publications during medical school by sex and race and ethnicity. JAMA Netw Open. 2022;5(10):e2238520.; Hayden Gephart M, Holly LT, Amin‐Hanjani S, et al. Roadmap for development of a strong, diverse research workforce in neurosurgery. Neurosurgery. 2023;93(3):e53‐e58.; Youmans QR, Essien UR, Capers Q. A test of diversity—what USMLE pass/fail scoring means for medicine. N Engl J Med. 2020;382:2393‐2395.; Patel H, Wright D‐D, Hernandez N, et al. Evaluating the factors influencing residency match for surgical specialty applicants and programs: challenges and future directions. Am Surg. 2025;91:386‐392.; Smith DH, Zeitouni J, Kim Thiesse N, et al. Trends of rising research production among otolaryngology residency applicants. OTO Open. 2024;8(3):e170.; Maverakis E, Li CS, Alikhan A, et al. The effect of academic misrepresentation on residency match outcomes. Dermatol Online J. 2012;18(1):1.; Burkhart RJ, Hecht CJ, Karimi AH, et al. What are the trends in research publication misrepresentation among orthopaedic residency and fellowship applicants from 1996 to 2019? A systematic review. Clin Orthop Relat Res. 2023;481(7):1292‐1303.; Gupta R, Chen J, Roth S, et al. Preresidency research output among US neurological surgery residents. J Neurosurg. 2024;141(1):63‐71.; Letchuman V, Barrow DL, Adamson DC. Trends in academic misrepresentation in neurological surgery residency applicants: a 2‐year analysis. World Neurosurg. 2021;151:e988‐e994.; Carlson KJ, Dowdall JR, Geelan‐Hansen KR, et al. Quality versus quantity: using scholarly activity to assess otolaryngology residency candidates. OTO Open. 2023;7(1):e45.; Elliott B, Carmody JB. Publish or perish: the research arms race in residency selection. J Grad Med Educ. 2023;15(5):524‐527.; Glehan A, Ramsey T, Kumaresan T, et al. Medical student otolaryngology research: involvement, perceptions, motivations. Am J Otolaryngol. 2023;44(6):103977.; Ishman SL, Smith DF, Skinner ML, et al. Unverifiable publications in otolaryngology residency applications. Otolaryngol Head Neck Surg. 2012;147(2):249‐255.; Tomlinson OW. Predatory publishing in medical education: a rapid scoping review. BMC Med Educ. 2024;24(1):33.; Emma DR, Fa S, Gn R, et al. Changes in otolaryngology application requirements and match outcomes: are we doing any better? World J Otorhinolaryngol Head Neck Surg. 2023;9:144‐152. |
| Contributed Indexing: | Keywords: ARCS; Otolaryngology; PVU; Publications; Research Productivity; The Match |
| Entry Date(s): | Date Created: 20260406 Latest Revision: 20260406 |
| Update Code: | 20260406 |
| DOI: | 10.1002/ohn.70232 |
| PMID: | 41940703 |
| Database: | MEDLINE |
Journal Article