|
1
|
Lipman JM, Colbert CY, Ashton R, French J, Warren C, Yepes-Rios M, King RS, Bierer SB, Kline T, Stoller JK. A Systematic Review of Metrics Utilized in the Selection and Prediction of Future Performance of Residents in the United States. J Grad Med Educ 2023; 15:652-668. [PMID: 38045930 PMCID: PMC10686656 DOI: 10.4300/jgme-d-22-00955.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Revised: 04/26/2023] [Accepted: 09/05/2023] [Indexed: 12/05/2023] Open
Abstract
Background Aligning resident and training program attributes is critical. Many programs screen and select residents using assessment tools not grounded in available evidence. This can introduce bias and inappropriate trainee recruitment. Prior reviews of this literature did not include the important lens of diversity, equity, and inclusion (DEI). Objective This study's objective is to summarize the evidence linking elements in the Electronic Residency Application Service (ERAS) application with selection and training outcomes, including DEI factors. Methods A systematic review was conducted on March 30, 2022, concordant with PRISMA guidelines, to identify the data supporting the use of elements contained in ERAS and interviews for residency training programs in the United States. Studies were coded into the topics of research, awards, United States Medical Licensing Examination (USMLE) scores, personal statement, letters of recommendation, medical school transcripts, work and volunteer experiences, medical school demographics, DEI, and presence of additional degrees, as well as the interview. Results The 2599 identified unique studies were reviewed by 2 authors with conflicts adjudicated by a third. Ultimately, 231 meeting inclusion criteria were included (kappa=0.53). Conclusions Based on the studies reviewed, low-quality research supports use of the interview, Medical Student Performance Evaluation, personal statement, research productivity, prior experience, and letters of recommendation in resident selection, while USMLE scores, grades, national ranking, attainment of additional degrees, and receipt of awards should have a limited role in this process.
Collapse
Affiliation(s)
- Jeremy M. Lipman
- Jeremy M. Lipman, MD, MHPE, is Professor of Surgery, Director of Graduate Medical Education, and Designated Institutional Official (DIO), Cleveland Clinic and Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, Ohio, USA
| | - Colleen Y. Colbert
- Colleen Y. Colbert, PhD, is Professor of Medicine, and Director, Office of Educator and Scholar Development, Cleveland Clinic and Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, Ohio, USA
| | - Rendell Ashton
- Rendell Ashton, MD, is Associate Professor of Medicine, Director, Pulmonary, Critical Care Fellowship, and Associate DIO, Cleveland Clinic and Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, Ohio, USA
| | - Judith French
- Judith French, PhD, is Associate Professor of Surgery, and Vice Chair for Education, Department of General Surgery, Cleveland Clinic and Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, Ohio, USA
| | - Christine Warren
- Christine Warren, MD, MS, is Associate Professor of Dermatology and Associate Dean, Admissions and Student Affairs, Cleveland Clinic and Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, Ohio, USA
| | - Monica Yepes-Rios
- Monica Yepes-Rios, MD, is Associate Professor of Medicine and Assistant Dean, Diversity Equity and Inclusion for Students, Cleveland Clinic and Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, Ohio, USA
| | - Rachel S. King
- Rachel S. King, JD, is Director of Educational Equity and Title IX Coordinator, Cleveland Clinic and Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, Ohio, USA
| | - S. Beth Bierer
- S. Beth Bierer, PhD, MEd, is Professor of Medicine and Director, Assessment and Evaluation, Cleveland Clinic and Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, Ohio, USA
| | - Theresa Kline
- Theresa Kline, MLIS, AHIP, is Medical Librarian, Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, Ohio, USA; and
| | - James K. Stoller
- Jeremy M. Lipman, MD, MHPE, is Professor of Surgery, Director of Graduate Medical Education, and Designated Institutional Official (DIO), Cleveland Clinic and Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, Ohio, USA
- James K. Stoller, MS, MD, is Professor of Medicine, Senior Associate Dean, and Chairman, Education Institute, Cleveland Clinic and Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, Ohio, USA
| |
Collapse
|