1
|
Raborn LN, Janis JE. Current Views on the New United States Medical Licensing Examination Step 1 Pass/Fail Format: A Review of the Literature. J Surg Res 2022; 274:31-45. [PMID: 35121548 DOI: 10.1016/j.jss.2022.01.002] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2021] [Revised: 11/20/2021] [Accepted: 01/02/2022] [Indexed: 10/19/2022]
Abstract
INTRODUCTION Residency programs have historically used numerical Step 1 scores to screen applicants, making it a career-defining, high-stakes examination. Step 1 scores will be reported as pass/fail starting in January 2022, fundamentally reshaping the residency application review process. This review aimed to identify opinions of physicians and medical students about the new format, identify arguments in support of or against the change, and determine the implications of this change on the residency selection process. METHODS A comprehensive PubMed review was performed in May 2021 to identify articles that discussed the new Step 1 format. Non-English and duplicate articles were excluded. Data collected from each article included publication year, specialty, subjects, and key findings. RESULTS A total of 81 articles were included, 26 of which discussed the impact of the new format within surgical fields (32.1%). Remaining articles discussed the implications within the medical community as a whole (n = 33, 40.7%) and nonsurgical fields (n = 22, 27.2%). Studies suggest Program Directors will rely on Step 2 Clinical Knowledge (CK) scores, medical school reputation, applicant familiarity, Dean's letters, recommendation letters, and research in lieu of numerical Step 1 scores. In addition, concerns have been raised that the new format will disadvantage international, osteopathic, and minority applicants while increasing stress surrounding Step 2 CK. CONCLUSIONS Within the medical community, there are concerns that Step 2 CK will be used to substitute Step 1 and that resident diversity will diminish due to the new Step 1 format. Holistic candidate consideration will be increasingly important.
Collapse
Affiliation(s)
- Layne N Raborn
- Department of Surgery, Louisiana State University Health Sciences Center, New Orleans, Louisiana
| | - Jeffrey E Janis
- Department of Plastic and Reconstructive Surgery, Wexner Medical Center, Ohio State University, Columbus, Ohio.
| |
Collapse
|
2
|
Hafferty FW, O'Brien BC, Tilburt JC. Beyond High-Stakes Testing: Learner Trust, Educational Commodification, and the Loss of Medical School Professionalism. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2020; 95:833-837. [PMID: 32079955 DOI: 10.1097/acm.0000000000003193] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
With ever-growing emphasis on high-stakes testing in medical education, such as the Medical College Admission Test and the United States Medical Licensing Examination Step 1, there has been a recent surge of concerns on the rise of a "Step 1 climate" within U.S. medical schools. The authors propose an alternative source of the "climate problem" in current institutions of medical education. Drawing on the intertwined concepts of trust and professionalism as organizational constructs, the authors propose that the core problem is not hijacking-by-exam but rather a hijackable learning environment weakened by a pernicious and under-recognized tide of commodification within the U.S. medical education system. The authors discuss several factors contributing to this weakening of medicine's control over its learning environments, including erosion of trust in medical school curricula as adequate preparation for entry into the profession, increasing reliance on external profit-driven sources of medical education, and the emergence of an internal medical education marketplace. They call attention to breaches in the core tenets of a profession-namely a logic that differentiates its work from market and managerial forces, along with related slippages in discretionary decision making. The authors suggest reducing reliance on external performance metrics (high-stakes exams and corporate rankings), identifying and investing in alternative metrics that matter, abandoning the marketization of medical education "products," and attending to the language of educational praxis and its potential corruption by market and managerial lexicons. These steps might salvage some self-governing independence implied in the term "profession" and make possible (if not probable) a recovery of a public trust becoming of the term and its training institutions.
Collapse
Affiliation(s)
- Frederic W Hafferty
- F.W. Hafferty is professor of medical education, Division of General Internal Medicine and Program in Professionalism and Values, Mayo Clinic, Rochester, Minnesota; ORCID: https://orcid.org/0000-0002-5604-7268. B.C. O'Brien is professor of medicine, Department of Medicine, and education scientist, Center for Faculty Educators, University of California, San Francisco, School of Medicine, San Francisco, California. J.C. Tilburt is professor of medicine, Division of General Internal Medicine, Mayo Clinic, Rochester, Minnesota
| | | | | |
Collapse
|
3
|
Patel MD, Tomblinson CM, Benefield T, Ali K, DeBenedectis CM, England E, Gaviola GC, Ho CP, Jay AK, Milburn JM, Ong S, Robbins JB, Sarkany DS, Heitkamp DE, Jordan SG. The Relationship Between US Medical Licensing Examination Step Scores and ABR Core Examination Outcome and Performance: A Multi-institutional Study. J Am Coll Radiol 2020; 17:1037-1045. [PMID: 32220580 DOI: 10.1016/j.jacr.2020.02.017] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2020] [Revised: 02/25/2020] [Accepted: 02/27/2020] [Indexed: 11/17/2022]
Abstract
PURPOSE We analyzed multi-institutional data to understand the relationship of US Medical Licensing Examination (USMLE) Step scores to ABR Core examination performance to identify Step score tiers that stratify radiology residents into different Core performance groups. METHODS We collected USMLE Step scores and ABR Core examination outcomes and scores for anonymized residents from 13 different diagnostic radiology residency programs taking the ABR Core examination between 2013 and 2019. USMLE scores were grouped into noniles using z scores and then aggregated into three tiers based on similar Core examination pass-or-fail outcomes. Core performance was grouped using standard deviation from the mean and then measured by the percent of residents with scores below the mean. Differences between Step tiers for Core outcome and Core performance were statistically evaluated (P < .05 considered significant). RESULTS Differences in Step 1 terciles Core failure rates (45.9%, 11.9%, and 3.0%, from lowest to highest Step tiers; n = 416) and below-mean Core performance (83.8%, 54.1%, and 21.1%, respectively; n = 402) were significant. Differences in Step 2 groups Core failure rates (30.0%, 10.6%, and 2.0%, from lowest to highest Step tiers; n = 387) and below-mean Core performance (80.0%, 43.7%, and 14.0%, respectively; n = 380) were significant. Step 2 results modified Core outcome and performance predictions for residents in Step 1 terciles of varying statistical significance. CONCLUSIONS Tiered scoring of USMLE Step results has value in predicting radiology resident performance on the ABR Core examination; effective stratification of radiology resident applicants can be done without reporting numerical Step scores.
Collapse
Affiliation(s)
- Maitray D Patel
- Executive Board, Society of Radiologists in Ultrasound, Department of Radiology, Mayo Clinic Arizona, Phoenix, Arizona.
| | - Courtney M Tomblinson
- Associate Program Director Diagnostic Radiology Residency; Associate Director, Women in Radiology, Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, Tennessee
| | - Thad Benefield
- Department of Radiology, University of North Carolina School of Medicine, Chapel Hill, North Carolina
| | - Kamran Ali
- Program Director Diagnostic Radiology Residency; President, Radiology Group, Department of Radiology, University of Kansas School of Medicine, Wichita, Kansas
| | - Carolynn M DeBenedectis
- Vice Chair for Education; Program Director, Radiology Residency program, Department of Radiology, University of Massachusetts Medical School, Worcester, Massachusetts
| | - Eric England
- Vice Chair of Education, Department of Radiology; Program Director, Diagnostic Radiology Residency; Jerome F. Wiot Endowed Chair of Radiology Residency Education, Department of Radiology, University of Cincinnati Medical Center, Cincinnati, Ohio
| | - Glenn C Gaviola
- Program Director Diagnostic Radiology Residency, Department of Radiology, Brigham and Women's Hospital, Boston, Massachusetts
| | - Christopher P Ho
- Program Director Diagnostic Radiology Residency, Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Georgia
| | - Ann K Jay
- Vice Chair of Education and Program Director Diagnostic Radiology Residency, Department of Radiology, MedStar Georgetown University Hospital, Washington, DC
| | - James M Milburn
- Vice Chair of Radiology, Section Head Neuroradiology, Program Director of Diagnostic Radiology Residency. ACR: Louisiana State Councilor; Department of Radiology, Ochsner Clinic Foundation, New Orleans, Louisiana
| | - Seng Ong
- Program Director Diagnostic Radiology Residency, Department of Radiology, University of Chicago Medical Center, Chicago, Illinois
| | - Jessica B Robbins
- Vice Chair of Faculty Development and Enrichment; Associate Program Director Diagnostic Radiology and Integrated Diagnostic/Interventional Radiology Residencies, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin
| | - David S Sarkany
- Diagnostic Radiology Program Director, Department of Radiology, Staten Island University Hospital Northwell Health, Staten Island, New York
| | | | - Sheryl G Jordan
- Education Director Department of Radiology, University of North Carolina School of Medicine, Chapel Hill, North Carolina
| |
Collapse
|