Holistic Review in Medical School Admissions and Selection: A Strategic, Mission-Driven Response to Shifting Societal Needs

Non-native English-speaking applicants and the likelihood of physician assistant program matriculation

PURPOSE

Effective communication is critical in patient care. Multilingual medical providers, including Physician Assistants (PAs) can contribute to improved health care among patients with limited English proficiency; however, this is contingent upon matriculating multilingual providers. In this study, the association between prospective applicants' self-reported English as second language (ESL) status and their likelihood of matriculation into a PA program was investigated.

METHODS

Participants included applicants to five admission cycles of the Centralized Application Service for Physician Assistant from 2012 to 2020. Logistic regression was utilized to investigate association between applicant ESL status and odds of program matriculation in both bivariate and multivariable regression models. Models were adjusted for citizenship status, undergraduate grade point average, gender, age, race/ethnicity, number of programs applied to, and patient care hours.

RESULTS

In unadjusted and adjusted models, ESL status was associated with a significantly lower odds of matriculation to a PA program across all study years. In adjusted multivariable models, associations were strongest for 2014-2015 where ESL status was associated with a 35% lower odds of matriculation (odds ratio 0.65, 95% confidence interval 0.56, 0.76) when controlling for demographics, citizenship status, patient care experience, and academic achievement. In sensitivity analyses restricting to (a) those with TOEFL scores ≥ 100, and (b) restricting to those ESL applicants without TOEFL scores, we did not observe important changes in our results.

CONCLUSIONS

Results indicated that non-native English-speaking applicants have lower odds of PA program matriculation. Decrements in matriculation odds were large magnitude, minimally impacted by adjustment for confounders and persistent across the years. These findings suggest that PA program admission processes may disadvantage non-native English-speaking applicants. While there are potential explanations for the observed findings, they are cause for concern. Matriculating and training PAs who have language concordance with underserved populations are important means of improving patient outcomes.

A Systematic Review of Variables Used in Physical Therapist Education Program Admissions Part 2: Noncognitive Variables

BACKGROUND AND PURPOSE

Physical therapist (PT) education professionals agree on promoting holistic admissions practices to increase student body diversity but lack consensus about what factors in an application should be part of this process. This systematic literature review aimed to understand the value of noncognitive variables in PT education admissions.

METHODS

The initial literature search identified 1,592 articles in databases and relevant journals. Of the 39 studies meeting the inclusion criteria, 29 reported on noncognitive variables.

RESULTS

Commonly used noncognitive variables (interviews, written essays, letters of recommendation, and clinical experiences) were insignificant or inconsistently associated with performance in the PT program or on the National Physical Therapy Examination. Sociodemographic variables appeared to negatively affect the academic qualifications of applicants who were older, identified with underrepresented racial/ethnic groups, and reported English as a second language. Finally, 5 studies identified personal attributes, such as emotional intelligence and grit, as having a significant relationship with successful student outcomes.

DISCUSSION AND CONCLUSION

Cognitive variables should serve as only one of several factors considered in admissions to achieve a more diverse class of students. Physical therapist education programs may use this evidence to reevaluate their admissions practices to include a balanced consideration of cognitive and noncognitive variables.

Medical school selection is a sociohistorical embedded activity: A comparison of five countries

INTRODUCTION

The medical school selection literature comes mostly from a few countries in the Global North and offers little opportunity to consider different ways of thinking and doing. Our aim, therefore, was to critically consider selection practices and their sociohistorical influences in our respective countries (Brazil, China, Singapore, South Africa and the UK), including how any perceived inequalities are addressed.

METHODS

This paper summarises many constructive dialogues grounded in the idea of he er butong () (harmony with diversity), learning about and from each other.

RESULTS

Some practices were similar across the five countries, but there were differences in precise practices, attitudes and sociohistorical influences thereon. For example, in Brazil, South Africa and the UK, there is public and political acknowledgement that attainment is linked to systemic and social factors such as socio-economic status and/or race. Selecting for medical school solely on prior attainment is recognised as unfair to less privileged societal groups. Conversely, selection via examination performance is seen as fair and promoting equality in China and Singapore, although the historical context underpinning this value differs across the two countries. The five countries differ in respect of their actions towards addressing inequality. Quotas are used to ensure the representation of certain groups in Brazil and regional representation in China. Quotas are illegal in the UK, and South Africa does not impose them, leading to the use of various, compensatory 'workarounds' to address inequality. Singapore does not take action to address inequality because all people are considered equal constitutionally.

DISCUSSION

In conclusion, medical school selection practices are firmly embedded in history, values, societal expectations and stakeholder beliefs, which vary by context. More comparisons, working from the position of acknowledging and respecting differences, would extend knowledge further and enable consideration of what permits and hinders change in different contexts.

The predictive validity of MCAT scores and undergraduate GPA for COMLEX-USA licensure exam performance of students enrolled in osteopathic medical schools

CONTEXT

Osteopathic (Doctor of Osteopathic Medicine [DO]) medical students account for more than 25 % of all medical students in the United States.

OBJECTIVES

This study examined the predictive validity of Medical College Admission Test (MCAT) total scores and cumulative undergraduate grade point averages (UGPAs) for performance on the Comprehensive Osteopathic Medical Licensing Examination of the United States (COMLEX-USA) Level 1 and Level 2-CE (Cognitive Evaluation) licensure examinations administered by the National Board of Osteopathic Medical Examiners (NBOME). Additionally, the study examined the degree to which MCAT total scores and UGPAs provide comparable prediction of student performance by key sociodemographic variables.

METHODS

This study involved a collaborative effort between the Association of American Medical Colleges (AAMC), the American Association of Colleges of Osteopathic Medicine (AACOM) and the NBOME. Data were examined for 39 accredited DO-granting medical schools in the United States during the 2017 application cycle. Researchers utilized three regression models that included MCAT total scores, cumulative UGPA, and combined MCAT total scores and cumulative UGPA to determine predictive validity. Researchers also examined the comparability of prediction for sociodemographic variables by examining the differences between observed and predicted error for both scores and pass/fail success rates.

RESULTS

Medium to large correlations were discernible between MCAT total scores, UGPA, and COMLEX-USA examination outcomes. For both COMLEX-USA Level 1 and Level 2-CE scores and pass/fail outcomes, MCAT scores alone provided superior predictive value to UGPA alone. However, MCAT scores and UGPA utilized in conjunction provided the best predictive value. When predicting both licensure examination scores and pass/fail outcomes by sociodemographic variables, all three models provided comparable predictive accuracy.

CONCLUSIONS

Findings from this comprehensive study of DO-granting medical schools provide evidence for the value-added benefit of taking MCAT scores and UGPA into consideration, particularly when these measures are utilized in conjunction. Further, findings provide evidence indicating that individuals from different sociodemographic backgrounds who enter medical school with similar MCAT scores and UGPA perform similarly on licensure examination outcome measures.

Storylines of family medicine XI: professional identity formation-nurturing one's own story

Storylines of Family Medicine is a 12-part series of thematically linked mini-essays with accompanying illustrations that explore the many dimensions of family medicine, as interpreted by individual family physicians and medical educators in the USA and elsewhere around the world. In 'XI: professional identity formation-nurturing one's own story', authors address the following themes: 'The social construction of professional identity', 'On becoming a family physician', 'What's on the test?-professionalism for family physicians', 'The ugly doc-ling', 'Teachers-the essence of who we are', 'Family medicine research-it starts in the clinic', 'Socially accountability in medical education', 'Personal philosophy and how to find it' and 'Teaching and learning with Storylines of Family Medicine'. May these essays encourage readers to find their own creative spark in medicine.

Association of applicant demographic factors with medical school acceptance

BACKGROUND

Medical school acceptance rates in the United States (US) have been lower for applicants who identify as Underrepresented-in-Medicine (UiM) compared to non-UiM applicants. The gap between UiM and no-UiM groups is narrowing in recent years. Less well-studied are associations of acceptance decisions with family income and parental education. This study's purpose is to evaluate the relationships between medical school acceptance and family income, parental education status, racial/ethnic background, Grade Point Average (GPA), Medical College Admission Test (MCAT) score, and participation in extracurricular activities.

METHODS

This is a cross-sectional study of first-time US medical school applicants between 2017 and 2020. Acceptance rates for first-time applicants were calculated for first-generation (FG), low-income (LI), and UiM applicants. Associations of these attributes with MCAT scores, science GPAs, and seven categories of extracurricular activities were evaluated. Regression analyses estimated associations between acceptance to medical school with all variables with and without interaction terms (FG*URM, LI*URM, FG*LI).

RESULTS

The overall acceptance rate for first-time applicants from 2017-2020 was 45.3%. The acceptance rates among FG, LI and UiM applicants were 37.9%, 39.6% and 44.2%, respectively. In univariable logistic regression analyses, acceptance was negatively associated with being FG (OR: 0.68, CI: 0.67-0.70), LI (OR: 0.70, CI: 0.69-0.72), and UiM (OR: 0.95, CI: 0.93-0.97). In multivariable regression, acceptance was most strongly associated with science GPA (OR: 7.15, CI: 6.78-7.54 for the highest quintile) and UiM (OR: 5.56, CI: 5.48-5.93) status and MCAT score (OR: 1.19, CI: 1.18-1.19), FG (OR: 1.14, CI: 1.10-1.18), and most extracurricular activities. Including interaction terms revealed a negative association between acceptance and LI (OR:0.90, CI: 0.87-0.94) and FG was no longer significant (OR:1.10, CI:0.96-1.08).

CONCLUSIONS

Collectively these results suggest medical school admissions committees may be relying on holistic admission practices. While MCAT and GPA scores continue to predict acceptance, individuals from racially and ethnically UiM backgrounds have favorable odds of acceptance when controlling for MCAT and GPA. However, these positive associations were not seen for low-income and first-generation applicants. Additional preparation for college and the MCAT for these latter groups may help further diversify the medical profession.

Challenges Facing First-Generation College Graduates in Medical School: A Qualitative Analysis

Importance

First-generation (FG) medical students remain underrepresented in medicine despite ongoing national efforts to increase diversity; understanding the challenges faced by this student population is essential to building holistic policies, practices, and learning environments that promote professional actualization. Although FG students have been extensively studied in the undergraduate literature, there is little research investigating how FG students experience medical education or opportunities for educators to intervene.

Objective

To explore challenges that FG students experience in undergraduate medical education and identify opportunities to improve foundational FG support.

Design, Setting, and Participants

This qualitative study was conducted using an online platform with 37 FG students enrolled in 27 US medical schools. An interprofessional team of medical educators and trainees conducted semistructured interviews from November 2021 through April 2022. Participants were recruited using a medical student listserv. Data were analyzed from April to November 2022.

Main Outcomes and Measures

After conducting a preliminary analysis using open coding, a codebook was created and used in a thematic analysis; the codebook used a combination of deductive and inductive coding.

Results

Among the 37 students recruited for this study, 21 (56.8%) were female; 23 (62.2%) were in the clinical phase of training; 1 (2.7%) was American Indian or Alaska Native, 7 (18.9%) were Hispanic, Latino, or of Spanish origin, 8 (21.6%) were non-Hispanic Asian or Asian American, 9 (24.3%) were non-Hispanic Black or African American, and 23 (32.4%) were non-Hispanic White; mean (SD) age was 27.3 (2.8) years. Participants described 4 major themes: (1) isolation and exclusion related to being a newcomer to medicine; (2) difficulty with access to basic resources (eg, food, rent, transportation) as well as educational (eg, books); (3) overall lack of faculty or institutional support to address these challenges; and (4) a sense of needing to rely on grit and resilience to survive.

Conclusions and Relevance

Although grit and resilience are desirable traits, results of this study suggest that FG medical students face increased adversity with inadequate institutional support, which forces them to excessively rely on grit and resilience as survival (rather than educational) strategies. By applying the holistic model often used in admissions to the postmatriculation educational process, targeted and flexible initiatives can be created for FG students so that all students, regardless of background, can achieve robust professional actualization.

Association Between a Medical School Applicant's Community College Attendance and the Likelihood of Application Acceptance: An Investigation of Select Medical School Characteristics

PURPOSE

One-third of medical school applicants attend a community college (CC), and they represent a diverse group of applicants. However, they have a lower likelihood of being accepted to medical school. Using application-level data, this study examines how an applicant's CC attendance impacts the likelihood of application acceptance and how 3 medical school characteristics moderate this association.

METHOD

Data examined were from 2,179,483 applications submitted to at least one of 146 U.S. Liaison Committee on Medical Education-accredited medical schools by 124,862 applicants between 2018 and 2020. The outcome was application acceptance. The main measures were applicants' CC attendance (no, lower [> 0%-19% of college course hours], or higher [≥ 20%]) and 3 medical school characteristics: geographic region, private versus public control, and admissions policy regarding CC coursework. Multilevel logistic regression models estimated the association between CC attendance and the likelihood of application acceptance and how this association was moderated by school characteristics.

RESULTS

Among applicants, 23.8% (29,704/124,862) had lower CC attendance and 10.3% (12,819/124,862) had higher CC attendance. Regression results showed that, relative to no CC attendance, applications with lower (adjusted odds ratio [AOR] = .96; 95% confidence internal [CI], .94-.97) and higher (AOR = .78; 95% CI, .76-.81) CC attendance had significantly decreased odds of acceptance when the 3 school characteristics were included. Each of the 3 medical school characteristics significantly moderated the association between an applicant's CC attendance and the likelihood of application acceptance.

CONCLUSIONS

The negative association between CC attendance and medical school application acceptance varies by medical school characteristics. Professional development for admissions officers focused on understanding the CC pathway and potential biases related to CC attendance would likely be beneficial in terms of trying to attract and select a diverse cohort of medical students in a holistic and equitable manner.

Perceived Barriers Among Underrepresented and Historically Marginalized Medical Students Pursuing a Career in Urology

OBJECTIVE

To assess perceived barriers to pursuing urology among medical students and to determine if marginalized groups identified greater challenges to entry.

METHODS

The Deans of all New York medical schools were asked to disseminate a survey to their students. The survey collected demographic information to identify underrepresented minorities, students of low socioeconomic background, and lesbian, gay, bisexual, transgender, queer, intersex, and asexual individuals. Students were asked to rate various survey items on a five-point Likert scale to determine which factors were perceived as barriers to applying to urology residency. Student t tests and ANOVA were used to compare mean Likert ratings between groups.

RESULTS

A total of 256 students responded to the survey from 47% of medical institutions. Underrepresented minorities students cited lack of evident diversity within the field as a more significant barrier than counterparts (3.2 vs 2.7, P= .025). Lesbian, gay, bisexual, transgender, queer, intersex, and asexual students perceived the lack of evident diversity within urology (3.1 vs 2.65, P = .01), exclusivity of the field (3.73 vs 3.29, P = .04), and fear that residency programs would have negative perceptions of them as students (3.0 vs 2.1, P < .0001) as substantial obstacles compared to peers. Students with childhood household incomes less than $40,000 cited socioeconomic concerns as a higher barrier compared to students with household incomes greater than $40,000 (3.2 vs 2.3, P = .001).

CONCLUSION

Underrepresented and historically marginalized students perceive more significant barriers to pursuing urology than their peers. Urology training programs must continue to foster an inclusive environment to recruit prospective students from already marginalized groups.

The Use of Artificial Intelligence Tools to Prepare Medical School Applications

Advances in artificial intelligence (AI) have been changing the landscape in daily life and the practice of medicine. As these tools have evolved to become consumer-friendly, AI has become more accessible to many individuals, including applicants to medical school. With the rise of AI models capable of generating complex passages of text, questions have arisen regarding the appropriateness of using such tools to assist in the preparation of medical school applications. In this commentary, the authors offer a brief history of AI tools in medicine and describe large language models, a form of AI capable of generating natural language text passages. They question whether AI assistance should be considered inappropriate in preparing applications and compare it with the assistance some applicants receive from family, physician friends, or consultants. They call for clearer guidelines on what forms of assistance-human and technological-are permitted in the preparation of medical school applications. They recommend that medical schools steer away from blanket bans on AI tools in medical education and instead consider mechanisms for knowledge sharing about AI between students and faculty members, incorporation of AI tools into assignments, and the development of curricula to teach the use of AI tools as a competency.

Diversity in the pediatric research workforce: a scoping review of the literature

The purpose of this scoping review is to determine trends in racial and ethnic representation, identify barriers and facilitators to greater diversity, and assess strategies and interventions to advance diversity among those in the pediatric research workforce in the U.S. We conducted a scoping review of PubMed supplemented with the authors' personal library of papers published from January 1, 2010, to December 31, 2021. To be eligible, papers had to provide original data, be published in English, report information from a U.S. healthcare institution, and report on outcomes of interest relevant to the child health field. The diversity of faculty has modestly increased over the past decade but reflects a worsening representation compared to overall population trends. This slow increase reflects a loss of diverse faculty and has been referred to as a "leaky pipeline." Strategies to plug the "leaky pipeline" include greater investments in pipeline programs, implementation of holistic review and implicit bias training, development of mentoring and faculty programs targeted to diverse faculty and trainees, alleviation of burdensome administrative tasks, and creation of more inclusive institutional environments. Modest improvements in the racial and ethnic diversity of the pediatric research workforce were identified. However, this reflects worsening overall representation given changing U.S. population demographics. IMPACT: Racial and ethnic diversity in the pediatric research workforce has shown modest increases but worsening overall representation. This review identified barriers and facilitators at the intrapersonal, interpersonal, and institutional levels that impact BIPOC trainees and faculty career advancement. Strategies to improve the pathway for BIPOC individuals include greater investments in pipeline and educational programs, implementation of holistic review admissions and bias training, institution of mentoring and sponsorship, alleviation of burdensome administrative responsibilities, and creation of inclusive institutional climates. Future studies should rigorously test the effects of interventions and strategies designed to improve diversity in the pediatric research workforce.

Impact of holistic review on diversity of interviewed and matriculating residents in graduate medical education: a systematic review protocol

INTRODUCTION

Diversity in the physician workforce improves patient-centred outcomes. Patients are more likely to trust in and comply with care when seeing gender/racially concordant providers. A current emphasis on standardised metrics in academic achievement often serves as a barrier to the recruitment and retention of gender and racial minorities in medicine. Holistic review of residency applicants has been supported as a means of encouraging diversification but is not yet standardised. The current body of evidence examining the effects of holistic review on the recruitment of racial and gender minorities in surgical residencies is small. We therefore propose a systematic review to summarise the state of holistic review in graduate medical education in the USA and its impact on diversification.

METHODS AND ANALYSIS

Our systematic review protocol has been designed with plans to report our review findings in accordance with the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols guidelines. PubMed and Embase will be searched with the assistance of a health sciences librarian with expertise in systematic review. We will include studies of graduate medical education programmes that describe the implementation of holistic review, outline the components of their holistic review process and compare proportions of under-represented minorities (URM) and women interviewed and matriculating before and after holistic review implementation. We will first report a summary of the findings regarding the operationalisation of holistic review as described by studies included. We will then pool the percentages of URM and women for interviewee and matriculant populations from each study and report the collective odds ratios of each for holistic review compared with traditional review as our primary outcome.

ETHICS AND DISSEMINATION

This study is a protocol for systematic review, and therefore does not involve any human subjects. Findings will be published in the form of a manuscript submitted to a peer-reviewed journal.

PROSPERO REGISTRATION NUMBER

CRD42023401389.

The association between how medical students were selected and their perceived stress levels in Year-1 of medical school

BACKGROUND

The prevalence of medical students' mental distress is high. While schools apply various methods to select a well-performing and diverse student population, little is known about the association between different selection methods and the well-being of these students during medical school. The present retrospective multi-cohort study assessed whether students selected by high grades, assessment, or weighted lottery showed different stress perception levels in Year-1 of medical school.

METHODS

Of 1144 Dutch Year-1 medical students, 650 (57%) of the cohorts 2013, 2014, and 2018 who were selected by high grades, assessment, or weighted lottery completed a stress perception questionnaire (PSS-14). A multilevel regression analysis assessed the association between selection method (independent variable) and stress perception levels (dependent variable) while controlling for gender and cohort. In a post-hoc analysis, academic performance (optimal vs. non-optimal) was included in the multilevel model.

RESULTS

Students selected by assessment (B = 2.25, p < .01, effect size (ES) = small) or weighted lottery (B = 3.95, p < .01, ES = medium) had higher stress perception levels than students selected by high grades. Extending the regression model with optimal academic performance (B=-4.38, p < .001, ES = medium), eliminated the statistically significant difference in stress perception between assessment and high grades and reduced the difference between weighted lottery and high grades from 3.95 to 2.45 (B = 2.45, p < .05, ES = small).

CONCLUSIONS

Selection methods intended to create a diverse student population - assessment and lottery - are associated with higher stress perception levels in Year-1 of medical school. These findings offer medical schools insights into fulfilling their responsibility to take care of their students' well-being.

Increasing Underrepresented Minority Students in Medical School: a Single-Institution Experience

PURPOSE

Underrepresented minority student recruitment initiatives from medical school admissions and diversity offices can bring equity for those learners underrepresented in medicine. Measuring growth of the applicant pool helps determine the impact of such initiatives in helping diversify the healthcare workforce.

AIM

The authors evaluated underrepresented minority applicant pool growth at the Brody School of Medicine to determine whether predominantly White institutions or historically Black colleges and universities have accounted for the most growth in minority applicants in recent years.

METHODS

Outreach outcomes across the state were obtained by comparing applicant and matriculant demographics. Data on all applicants and matriculants were retrieved from the school's institutional records and classified according to student self-identification as underrepresented minority. Using Chi-square tests, authors aimed to determine whether the proportion of minority students increased among applicants and matriculants since 2016, the year of restructuring outreach. In further analysis, the number of graduates from historically Black colleges and universities as compared to minority graduates from predominantly White schools was evaluated.

RESULTS

The authors identified 7,848 applicants and 654 matriculants over the evaluation period. The proportion of learners identifying as underrepresented minority increased from 17% before 2016 (622/3,672) to 20% after 2016 (835/4,176; p = 0.001). The proportion of applicants who did not graduate from a historically Black college or university increased slightly after 2016 (89% of underrepresented minority applicants before 2016 vs. 92% of underrepresented minority applicants after 2016), but this increase was not statistically significant (p = 0.097).

CONCLUSION

Applicant growth has been more significant for underrepresented minority applicants from predominantly White institutions. Graduates of targeted historically Black colleges and universities who applied to Brody School of Medicine were better prepared, resulting in increased chances of admission.

Applicant perceptions of selection methods for health professions education: Rationales and subgroup differences

CONTEXT

Applicant perceptions of selection methods can affect motivation, performance and withdrawal and may therefore be of relevance in the context of widening access. However, it is unknown how applicant subgroups perceive different selection methods.

OBJECTIVES

Using organisational justice theory, the present multi-site study examined applicant perceptions of various selection methods, rationales behind perceptions and subgroup differences.

METHODS

Applicants to five Dutch undergraduate health professions programmes (N = 704) completed an online survey including demographics and a questionnaire on applicant perceptions applied to 11 commonly used selection methods. Applicants rated general favourability and justice dimensions (7-point Likert scale) and could add comments for each method.

RESULTS

Descriptive statistics revealed a preference for selection methods on which applicants feel more 'in control': General favourability ratings were highest for curriculum-sampling tests (mean [M] = 5.32) and skills tests (M = 5.13), while weighted lottery (M = 3.05) and unweighted lottery (M = 2.97) were perceived least favourable. Additionally, applicants preferred to distinguish themselves on methods that assess attributes beyond cognitive abilities. Qualitative content analysis of comments revealed several conflicting preferences, including a desire for multiple selection methods versus concerns of experiencing too much stress. Results from a linear mixed model of general favourability indicated some small subgroup differences in perceptions (based on gender, migration background, prior education and parental education), but practical meaning of these differences was negligible. Nevertheless, concerns were expressed that certain selection methods can hinder equitable admission due to inequal access to resources.

CONCLUSIONS

Our findings illustrate that applicants desire to demonstrate a variety of attributes on a combination of selection tools, but also observe that this can result in multiple drawbacks. The present study can help programmes in deciding which selection methods to include, which more negatively perceived methods should be better justified to applicants, and how to adapt methods to meet applicants' needs.

Medical student selection process enhanced by improving selection algorithms and changing the focus of interviews in Australia: a descriptive study

PURPOSE

The study investigates the efficacy of new features introduced to the selection process for medical school at the University of New South Wales, Australia: (1) considering the relative ranks rather than scores of the Undergraduate Medicine and Health Sciences Admission Test and Australian Tertiary Admission Rank; (2) structured interview focusing on interpersonal interaction and concerns should the applicants become students; and (3) embracing interviewers’ diverse perspectives.

METHODS

Data from 5 cohorts of students were analyzed, comparing outcomes of the second year in the medicine program of 4 cohorts of the old selection process and 1 of the new process. The main analysis comprised multiple linear regression models for predicting academic, clinical, and professional outcomes, by section tools and demographic variables.

RESULTS

Selection interview marks from the new interview (512 applicants, 2 interviewers each) were analyzed for inter-rater reliability, which identified a high level of agreement (kappa=0.639). No such analysis was possible for the old interview since it required interviewers to reach a consensus. Multivariate linear regression models utilizing outcomes for 5 cohorts (N=905) revealed that the new selection process was much more effective in predicting academic and clinical achievement in the program (R2=9.4%–17.8% vs. R2=1.5%–8.4%).

CONCLUSION

The results suggest that the medical student selection process can be significantly enhanced by employing a non-compensatory selection algorithm; and using a structured interview focusing on interpersonal interaction and concerns should the applicants become students; as well as embracing interviewers’ diverse perspectives.

College competitiveness and medical school exam performance

BACKGROUND

In medical school, students are tested through periodic USMLE Step 1 and 2 examinations before obtaining a medical license. Traditional predictors of medical school performance include MCAT scores, undergraduate grades, and undergraduate institutional selectivity. Prior studies indicate that admissions committees might unfairly discriminate against applicants who graduated from less competitive universities. However, there is limited literature to determine whether those who attended competitive colleges perform better on USMLE Step 1 and 2 examinations.

OBJECTIVE

The purpose of our study is to determine if students who attended competitive undergraduate colleges outperform those who did not on medical school benchmarks.

METHODS

We defined a Competitive College as having greater than 10% of its student body scoring 1400 or higher (on a 1600 scale) on the SAT. If this criteria was not met, colleges would be categorized as Non-Competitive. Descriptive statistics and unpaired t-tests were calculated to analyze average test scores on the MCAT, Phase 1 NBME, USMLE Step 1, Phase 2 NBME, and USMLE Step 2.

RESULTS

Our findings suggest there are no statistically significant differences between students who do or do not attend competitive undergraduate colleges on these medical school benchmark examinations following the MCAT.

CONCLUSION

Admissions committees should use this data to aid in their student selection as our research indicates that institutional selectivity accurately predicts MCAT scores, but not performance on standardized medical school examinations once admitted.

Impact of considering United States Medical Licensing Examination Step 1 pass/fail on diversity in dermatology residency recruitment

The University of Chicago dermatology residency program considered the United States Medical Licensing Examination (USMLE) Step 1 pass/fail during the 2020-2021 application cycle with the goal of recruiting diverse dermatology residency candidates. We conducted a retrospective multiyear cross-sectional study among applicants to the dermatology residency program during the 2018-2019 and 2020-2021 application cycles, the latter excluding use of USMLE Step 1 cutoff scores as a screening tool. Of the applicants, 69.8% (n = 419) and 94.5% (n = 605) had their residency applications reviewed by our program during the 2018-2019 and 2020-2021 application cycles, respectively. There was a statistically significant upward trend in the number of underrepresented in medicine (URiM) applicants offered an interview from 10.4% (n = 5) to 37.7% (n = 20) across the application cycles. Multiple linear regression demonstrated there was a statistically significant decrease in the mean USMLE Step 1 score among applicants reviewed across application cycle and URiM status independently, and as a factor of their interaction (P = .016 and P = .001). By de-emphasizing the USMLE Step 1 score and using the test as originally intended, a marker for licensure, our program significantly increased the number of URiM applicants who were offered an interview and implemented a holistic review process focused on individual attributes and cultural competence.

The Validity of MCAT Scores in Predicting Students' Performance and Progress in Medical School: Results From a Multisite Study

PURPOSE

This is the first multisite investigation of the validity of scores from the current version of the Medical College Admission Test (MCAT) in clerkship and licensure contexts. It examined the predictive validity of MCAT scores and undergraduate grade point averages (UGPAs) for performance in preclerkship and clerkship courses and on the United States Medical Licensing Examination Step 1 and Step 2 Clinical Knowledge examinations. It also studied students' progress in medical school.

METHOD

Researchers examined data from 17 U.S. and Canadian MD-granting medical schools for 2016 and 2017 entrants who volunteered for the research and applied with scores from the current MCAT exam. They also examined data for all U.S. medical schools for 2016 and 2017 entrants to regular-MD programs who applied with scores from the current exam. Researchers conducted linear and logistic regression analyses to determine whether MCAT total scores added value beyond UGPAs in predicting medical students' performance and progress. Importantly, they examined the comparability of prediction by sex, race and ethnicity, and socioeconomic status.

RESULTS

Researchers reported medium to large correlations between MCAT total scores and medical student outcomes. Correlations between total UGPAs and medical student outcomes were similar but slightly lower. When MCAT scores and UGPAs were used together, they predicted student performance and progress better than either alone. Despite differences in average MCAT scores and UGPAs between students who self-identified as White or Asian and those from underrepresented racial and ethnic groups, predictive validity results were comparable. The same was true for students from different socioeconomic backgrounds, and for males and females.

CONCLUSIONS

These data demonstrate that MCAT scores add value to the prediction of medical student performance and progress and that applicants from different backgrounds who enter medical school with similar ranges of MCAT scores and UGPAs perform similarly in the curriculum.

Evaluating a Global Assessment Measure Created by Standardized Patients for the Multiple Mini Interview in Medical School Admissions: Mixed Methods Study

BACKGROUND

Standardized patients (SPs) are essential stakeholders in the multiple mini interviews (MMIs) that are increasingly used to assess medical school applicants' interpersonal skills. However, there is little evidence for their inclusion in the development of instruments.

OBJECTIVE

This study aimed to describe the process and evaluate the impact of having SPs co-design and cocreate a global measurement question that assesses medical school applicants' readiness for medical school and acceptance status.

METHODS

This study used an exploratory, sequential, and mixed methods study design. First, we evaluated the initial MMI program and determined the next quality improvement steps. Second, we held a collaborative workshop with SPs to codevelop the assessment question and response options. Third, we evaluated the created question and the additional MMI rubric items through statistical tests based on 1084 applicants' data from 3 cohorts of applicants starting in the 2018-2019 academic year. The internal reliability of the MMI was measured using a Cronbach α test, and its prediction of admission status was tested using a forward stepwise binary logistic regression.

RESULTS

Program evaluation indicated the need for an additional quantitative question to assess applicant readiness for medical school. In total, 3 simulation specialists, 2 researchers, and 21 SPs participated in a workshop leading to a final global assessment question and responses. The Cronbach α's were >0.8 overall and in each cohort year. The final stepwise logistic model for all cohorts combined was statistically significant (P<.001), explained 9.2% (R2) of the variance in acceptance status, and correctly classified 65.5% (637/972) of cases. The final model consisted of 3 variables: empathy, rank of readiness, and opening the encounter.

CONCLUSIONS

The collaborative nature of this project between stakeholders, including nonacademics and researchers, was vital for the success of this project. The SP-created question had a significant impact on the final model predicting acceptance to medical school. This finding indicates that SPs bring a critical perspective that can improve the process of evaluating medical school applicants.

The Intersection of Race, Racism, and Child and Adolescent Health

There has been an increasing focus on the impact of racism both within pediatrics and throughout society as a whole. This focus has emerged as a result of the current sociopolitical climate in the United States coupled with the recent deaths of Black Americans by law enforcement and the maltreatment of Latina/o immigrants. In 2019, the American Academy of Pediatrics released the landmark policy statement "The Impact of Racism on Child and Adolescent Health," which describes the profound effects of racism on health, its function in perpetuating health disparities, and the potential role of child health professionals in addressing racism as a public health issue. (1) Foundational knowledge regarding race, racism, and their relation to health are not consistently included in standard medical education curricula. This leaves providers, including pediatricians, with varying levels of understanding regarding these concepts. This article seeks to provide an overview of the intersection of race, racism, and child/adolescent health in an effort to reduce knowledge gaps among pediatric providers with the ultimate goal of attenuating racial health disparities among children and adolescents. Please reference the Table for additional resources to reinforce concepts described throughout this article.

Looking Back on Graduate BME Admissions Data: Lessons Learned and Implications for Holistic Review and Diversity

Graduate school applications in Biomedical Engineering (BME) are steadily rising, making competition stiffer, applications more complex, and reviews more resource intensive. Holistic reviews are being increasingly adopted to support increased diversity, equity, and inclusion in graduate student BME admissions, but which application metrics are the strongest predictors of admission and enrollment into BME programs remains unclear. In this perspectives article, we aim to shed light on some of the key predictors of student acceptance in graduate school. We share data from a three-year retrospective review of our own institution’s graduate BME applications and admission rates and review the influence of grade point averages (GPA), standardized test scores (e.g., GRE), and prior research experience on graduate school admission rates. We also examine how the waiver of GRE requirements has changed the landscape of BME graduate applications in recent years. Finally, we discuss efforts taken by our institution and others to develop and implement holistic reviews of graduate applications that encourage students from underrepresented backgrounds to apply and successfully gain admission to graduate school. We share five key lessons we learned by performing the retrospective review and encourage other institutions to “self-reflect” and examine their historical graduate admissions data and past practices. Efforts aimed at engaging faculty to overcome their own implicit biases, engaging with underrepresented students in hands-on, research-intensive programs, and networking with diverse student populations have strong potential to enhance the diversity of BME graduate programs and our STEM workforce.

Restitution Through Equity-Focused Mentoring: A Solution to Diversify the Physician Workforce

Minoritized and marginalized physicians who identify as Black, Latino/a/x and Native American (BLNA) remain unacceptably underrepresented in medicine. Multiple studies provide a compelling argument for prioritizing racial/ethnic diversification of the physician workforce to improve racial/ethnic physician-patient concordance and assist in achieving more equitable health outcomes. Despite a growing awareness for the tangible benefits of a diversified physician workforce, the number of physicians from minoritized and marginalized groups remains relatively stagnant or worsening in certain demographics. The 5:1 ratio of Black students and trainees to Black faculty exemplifies and exacerbates the increased risk for harmful isolation particularly experienced by many BLNA mentees. They too need and deserve the benefits produced by concordant racial/ethnic faculty mentoring and support. However, these demands on time, resources and bandwidth can lead to negative consequences for BLNA faculty engaged in these efforts by contributing to their emotional, mental and physical exhaustion. Given the perpetual paucity of BLNA physicians in academic medicine, immediate interventions to prevent attrition of BLNA faculty, trainees and students journeying along the physician career pathway are urgently needed. Requiring the implementation of mentoring programs explicitly focused on increasing the number of physicians from groups underrepresented in medicine must happen at every point of the education and training process.

Advancing Equity in Academic Medicine Through Holistic Review for Faculty Recruitment and Retention

The Association of American Medical Colleges (AAMC) in 2007 developed the Holistic Review Framework for medical school admissions to increase mission-aligned student diversity. This approach balances an applicant's experiences, attributes, and metrics during the screening, interview, and selection processes. Faculty recruitment provides its own set of challenges, and there is persistent underrepresentation of certain racial and ethnic minority groups and women in faculty and leadership positions in U.S. academic health centers (AHCs). In 2019, the AAMC initiated a pilot program to adapt and implement the framework for use in faculty recruitment at AHCs. In this Invited Commentary, the authors describe the pilot implementation of the Holistic Review Framework for Faculty Recruitment and Retention and share lessons learned to date. Although the pilot proceeded during 2020, institutional implementation was impacted by the COVID-19 pandemic and racial justice movement. Pilot institutions encountered hiring freezes, reductions in funding, and restrictions on in-person meetings due to COVID-19 that resulted in both barriers and opportunities in implementing the framework. Renewed commitment to racial justice was associated with increased momentum and urgency for the implementation of faculty holistic review at the majority of pilot institutions. Common themes from the pilot leads' experiences included the importance of achieving "buy in," having a dedicated implementation team, and being explicit about core values. Other themes included the importance of adaptability and flexibility to meet the needs of different institutions and mission areas. The faculty holistic review framework has shown promise as an approach to advancing faculty diversity goals. The pilot institutions will continue to share best practices, track outcomes, implement quality improvement, and disseminate findings to assist other institutions and health care communities with their endeavors to recruit and retain diverse faculty.

New Heuristics to Stratify Applicants: Predictors of General Surgery Residency Applicant Step 1 Scores

OBJECTIVE

In 2022, United States Medical Licensing Examination (USMLE) Step 1 scores will become pass/fail. This may be problematic, as residency programs heavily rely on USMLE Step 1 scores as a metric when determining interview invitations. This study aimed to assess candidate application metrics associated with USMLE Step 1 scores to offer programs new cues for stratifying applicants.

DESIGN

Retrospective cohort study analyzing interviewed applicants to one general surgery residency program in 2019 and 2020. Applicant data analyzed included USMLE Step 1 scores, number of publications, clerkship scores, letter of recommendation scores (out of 2, scored by 0.25 interval), interview overall score (out of 5, scored by integer level), and standardized question score (out of 10). Each year, applicant's answers to one standardized behavioral question during their interview were scored by interviewers.

SETTING

Tertiary medical center, academic general surgery residency program.

PARTICIPANTS

Interviewed applicants at one general surgery residency program whose applications contained complete demographic information (203 out of 247).

RESULTS

Multiple Linear Regression revealed that higher surgical clerkship (β = 0.19, p = 0.006) and higher standardized interview question (β = 0.32, p < 0.001) scores were positively associated with applicant USMLE Step 1 score (F[7, 195] = 6.61, p < 0.001, R2 = 0.19). Letter of recommendation score, number of peer reviewed publications, gender, race, and applicant type (preliminary/categorical) were not associated with USMLE Step 1 scores.

CONCLUSIONS

With USMLE Step 1 scores transitioning to pass/fail, surgical residency programs need new selection heuristics. Surgery clerkship scores and standardized behavioral questions answered by applicants prior to the interview could provide a holistic view of applicants and help programs better stratify candidates without USMLE Step 1 scores.

Examining the U.S. premed path as an example of discriminatory design & exploring the role(s) of capital

The college-level pathway to medical school (i.e., the "premed path") includes all coursework, extra-curriculars, shadowing, volunteering, high-stakes examination (e.g., MCAT®), and application-related processes. Although medical school admission committees routinely insist their interest in diverse and "well-rounded" applicants, the premed path (PMP), through formal and informal mechanisms, is constructed to favor those from high in socioeconomic status (SES) privileged backgrounds, and those majoring in typical premed majors such as in the Biological Sciences. In these respects, the PMP is an example of Discriminatory Design-an entity constructed and sustained in a manner that (un)intentionally discriminates against certain groups of individuals. We begin this paper by providing a brief description of the PMP (within the U.S. specifically) and conceptual and theoretical overview of the discriminatory design framework. We then explore how the PMP is an example of discriminatory design through the distinct but related role(s) of financial, social, cultural, and (what we term) (extra)curricular capital. Using data gleaned from interviews with premedical students, content analyses of the curricular structure of particular majors and publicly available data on the various "costs" associated with the PMP, we detail how the PMP is reflective of discriminatory design, spotlighting specific barriers and hurdles for certain groups of students. Given the persistent lack of representation of students from minoritized groups as well as those from diverse academic backgrounds within medical schools, our goal is to spotlight key features and processes within the PMP that actively favor the pursuit of certain majors and students from more privileged backgrounds. In turn, we conclude by offering medical schools and undergraduate institutions specific recommendations for remediating these barriers and hurdles.

All We Can Be: Innovations to Improve the Pipeline of Military Veterans in Medical Schools

ISSUE

Medical schools are increasingly identifying military veteran applicants as a source of diversity, resiliency, and commitment-often derived from their personal experiences in the military. Yet, veterans remain significantly under-represented in entering classes; moreover, those veterans who do matriculate are not yet fully reflective of the diversity that the Armed Forces have to offer. Fortunately, specific measures have been shown to be effective at increasing both the number and diversity of student veterans in medical school.

EVIDENCE

In 2019, there were less than 60 military veterans who entered the 144 civilian medical schools in the United States, according to the Association of American Medical Colleges. We identify common barriers faced by military veterans and propose best practices for medical schools to recruit and sustain them. We draw on the existing medical education literature about veteran support systems, and we underscore the unique challenges of veterans in medicine. Finally, we highlight innovative programs currently in place at several US medical schools that seek to address the needs of student veterans. This article provides a guide for how to recruit, assess, and nurture student veterans, suggesting a new way of thinking about this population of nontraditional medical students.

IMPLICATIONS

This dearth of servicemembers significantly below what would be expected based on national demographic data is indicative of how medical schools offer few pathways to entry for military servicemembers-and far fewer for enlisted personnel and other populations traditionally under-represented in medicine. Should schools aim to recruit a veteran population that is truly representative of the military, additional measures need to be taken into consideration during the admissions review process.

Applicant Familiarity Becomes Most Important Evaluation Factor in USMLE Step I Conversion to Pass/Fail: A Survey of Plastic Surgery Program Directors

BACKGROUND

In 2020, Step 1 of the United States Medical Licensing Examination (USMLE) changed to a pass/fail reporting. Step 1 has been one of the main factors for both inviting applicants for interviews and for ranking in Plastic Surgery. Due to this change, we hypothesize that Step 2 CK - currently the only remaining, universal quantitative metric - will become the main factor in the residency selection process.

METHODS

A survey-based cross-sectional study of United States (US) integrated plastic surgery program directors (PSPDs) investigated the factors that would assume importance following the change in the reporting pattern.

RESULTS

Respondents reported that personal prior knowledge of the applicant, Letters of recommendation (LORs), Step 2 CK scores, and away rotation at the institution of interest would become the most important factors (median ratings of 5, 4.5, 4.5, 4.5, respectively on a 5-point Likert scale). Eighty-three percent of respondents were strongly dissatisfied with the conversion to pass/fail reporting. LOR's received the highest ranking (median,1; IQR,1-2) as the component used for offering away rotations after the implementation of the pass/fail reporting, followed by the applicant's medical school (median, 3; IQR, 3-4), and grades obtained during medical school (median,3; IQR,1.75-4). Standardized assessment during rotations are recommended by 67% of PSPDs.

CONCLUSIONS

Future emphasis will be placed primarily on subjective metrics, including applicant familiarity. Step 2 CK, LORs, and away rotation at the institution of interest are other factors of importance. PSPDs welcome the adoption of objective assessments of patient care and medical knowledge to improve the current selection process.

Difference in demographics and motivation to study medicine with respect to medical students' channel of admission: A national study

INTRODUCTION

Medical schools employ various tools to select suitable medical students (MS). This study investigated whether MS who were admitted through multiple mini-interviews (MMI) and MS who were admitted through Taiwan's Joint College Entrance Written Test (JCEWT) differed in their characteristics.

METHODS AND SUBJECTS

First-year MS from seven medical schools completed a semi-structured questionnaire that inquired into their channel of admission (MMI or JCEWT), gender, location (metropolitan or rural), high school type (public or private), parents' socioeconomic status (SES), and motivations to study medicine.

RESULTS

In total, 513 MS participated, 493 (96%) returned valid questionnaires, and 397 were enrolled in the study, (MMI group: 205 MS; JCEWT group: 192 MS). Irrespective of channel of admission, most MS came from metropolitan areas (80%-86%), belonged to high-SES families (73%-76%), and had mixed motivations (51%-96%). Female applicants, private school leavers, and those who were less motivated by the physician's SES were more likely to be selected through the MMI channel than the JCEWT channel.

CONCLUSION

Irrespective of the channels of entry, MS had similar demographics and motivations for studying medicine. MS selected through MMI had different characteristics than those selected through a JCEWT.

Coming face to face with implicit bias, microagressions, and macroaggressions: Understanding the influence of structural racism and misogyny on physician wellness

Implicit bias, microaggressions, and macroaggressions have a negative impact on physician and trainee wellness. In this article, we describe how structural racism, misogyny, and other social constructs have shaped the medical landscape. Increasing awareness in medical education, patient care, and research can help to dismantle the effects.

Looking Beyond the Numbers: Increasing Diversity and Inclusion Through Holistic Review in General Surgery Recruitment

OBJECTIVE

The purpose of this study is the examine the effect of a holistic review process on the recruitment of women and students underrepresented in medicine (UIM) in a general surgery residency program.

DESIGN

A retrospective study comparing the proportion of women and UIM students ranked and matched into categorical positions from 2013 to 2020 before and after the implementation of the holistic application review process. United States Medical Licensing Exam (USMLE) scores and American Board of Surgery In-training Exam (ABSITE) scores were also compared between groups.

SETTING

General Surgery residency program at a tertiary, academic center.

PARTICIPANTS

Medical students applying for and matriculated to categorical positions.

RESULTS

After the implementation of holistic review in 2017, there was a statistically significant increase in the proportion of women (42% vs. 61%, p < 0.01) and UIM students (14% vs. 20%, p = 0.046) ranked in our program compared with the prior "traditional" approach. The proportion of matched female (33% vs. 54%, p = 0.11) and UIM applicants (14% vs. 21%, p = 0.48) also increased after holistic review, although the changes were not statistically significant. The median USMLE Step 1 scores were equivalent for both ranked (250 vs. 250, p = 0.81) and matched (250 vs. 249, p = 0.32) applicants before and after the intervention. The median ABSITE scores for the matched intern classes was lower after initiation of holistic review (519 vs. 483, p = 0.01). However, these scores were consistently above the national medians and subgroup analysis showed no difference between the median aggregate ABSITE scores for UIM and female categorical interns and non-UIM males (475 vs. 520, p = 0.09).

CONCLUSIONS

Increasing emphasis is being placed on the diversification of residency training to reflect an expanding, diverse patient population. The incorporation of a holistic review process, providing broader assessment of applicants, can play a pivotal role in increasing the proportion of women and UIM students represented in the general surgery recruitment process.

An equity-oriented admissions model for Indigenous student recruitment in an undergraduate medical education program

BACKGROUND

With the 2015 publication of the Truth and Reconciliation Commission of Canada's calls to action, health professional schools are left grappling with how to increase the recruitment and success of Indigenous learners. Efforts to diversify trainee pools have long looked to quota-based approaches to recruit students from underserved communities, though such approaches pose dilemmas around meaningfully dismantling structural barriers to health professional education. Lessons shared here from developing one multi-layered admissions strategy highlight the importance of equity-rather than equality-in any recruitment for learners from medically underserved communities.

SUMMARY

The promotion of fairness in the recruitment of future practitioners is not just a question of equalizing access to, in this case, medical school; it involves recognizing the wider social and structural mechanisms that enable privileged access to the medical profession by members of dominant society. This recognition compels a shift in focus beyond merely giving the disadvantaged increased access to an unfair system, towards building tools to address deeper questions about what is meant by the kind of excellence expected of applicants, how it is to be measured, and to what extent these recruits may contribute to improved care for the communities from which they come.

CONCLUSION

Equity-based approaches to student recruitment move health professional schools beyond the dilemma of recruiting students from marginalized backgrounds who happen to be most similar to the dominant student population. Achieving this requires a complex view of the target population, recognizing that disadvantage is experienced in many diverse ways, that barriers are encountered along a spectrum of access, and that equity may only emerge when a critically, socially conscious approach is embedded throughout institutional practices.

Curated collection for clinician educators: Six key papers on residency recruitment

INTRODUCTION

All emergency medicine (EM) residency programs must recruit new medical school graduates each year. The process is often overwhelming, with each program receiving far more applicants than available positions. We searched for evidence-based best practices to guide residency programs in screening, interviewing, and ranking applicants to ensure a high-performing and diverse residency class.

METHODS

A literature search was conducted on the topic of residency recruitment, utilizing a call on social media as well as multiple databases. After identifying relevant articles, we performed a modified Delphi process in three rounds, utilizing junior educators as well as more senior faculty.

RESULTS

We identified 51 relevant articles on the topic of residency recruitment. The Delphi process yielded six articles that were deemed most highly relevant over the three rounds. Transparency with selection criteria, holistic application review, standardized letters of evaluation, and blinding applicant files for interviewers were among noted best practices.

CONCLUSIONS

Well-supported evidence-based practices exist for residency recruitment, and programs may benefit from understanding which common recruitment practices offer the most value. The articles discussed here provide a foundation for faculty looking to improve their program's recruiting practices.

Is There Color or Sex Behind the Mask and Sterile Blue? Examining Sex and Racial Demographics Within Academic Surgery

BACKGROUND

The lack of underrepresented minorities has been a persistent issue within the surgical workforce. Equal sex representation has also been a problem in surgery. Underrepresented minorities females face the unique challenge of being a minority in both race and sex.

OBJECTIVE

The objective of this retrospective cross-sectional study is to determine the racial and sex demographics of medical trainees and faculty and determine the degree to which minority women are underrepresented at higher ranks and leadership.

METHODS

Race and sex demographic data for all medical students, surgical residents and faculty was extracted from the AAMC data files. This data was compared to the US population using chi squared tests. Race and sex breakdowns of the different surgical subspecialties was also analyzed using chi squared tests. Demographics of surgical faculty at various ranks are also reported.

RESULTS

White men made up 37% of all surgical residents. Black men made up only 1.9% of all surgical residents whereas Black women made up 2.6%. The subspecialty with the smallest percentage of Black women was Orthopedic Surgery with 0.6%. The specialty with the highest representation of Black women was Ob/Gyn with 6.2%. There was a decrease in representation of Black women with each increase in professional rank, with 2.8%, 1.6%, and 0.7% for assistant, associate, and full professor, respectively, as compared to Black men, who as a percentage, remained stable at the various ranks with 2.1%, 2.4%, and 2.1% for assistant, associate, and full professor, respectively.

CONCLUSIONS

There is a striking lack of minority women in surgery. This trend is amplified as surgeons progress from student, to resident, to attending, and then to leadership positions.

Perspectives on Transitioning Step 1 of the United States Medical Licensing Examination to a Pass/Fail Scoring Model: Defining New Frameworks for Medical Students Applying for Residency

For years, the USMLE Step 1 has acted as an unofficial "concours" for medical students applying to residency positions in the United States. The three-digit numeric score has been used to rank thousands of applicants without any evidence of validity. The USMLE will soon change score reporting to a pass/fail outcome. The main reason given was to address the concerns about its effects on the well-being of the students and medical education. It is argued that time for change has come. The authors discuss the various viewpoints of the stakeholders and the effects of this change on applicants and potential changes on the undergraduate medical curriculum. Furthermore, this article discusses several metrics that can be utilized in the application process in lieu of the USMLE Step 1. Additionally, some novel key metrics in the application process are identified, and their unique dynamic and adaptive characteristics are deliberated. Finally, the benefits of a transparent and holistic process are strongly advocated.

Standardization in the MSPE: Key Tensions for Learners, Schools, and Residency Programs

The Medical Student Performance Evaluation (MSPE), which summarizes a medical student's academic and professional undergraduate medical education performance and provides salient information during the residency selection process, faces persistent criticisms regarding heterogeneity and obscurity. Specifically, MSPEs do not always provide the same type or amount of information about students, especially from diverse schools, and important information is not always easy to find or interpret. To address these concerns, a key guiding principle from the Recommendations for Revising the MSPE Task Force of the Association of American Medical Colleges (AAMC) was to achieve "a level of standardization and transparency that facilitates the residency selection process." Benefits of standardizing the MSPE format include clarification of performance benchmarks or metrics, consistency across schools to enhance readability, and improved quality. In medical education, standardization may be an important mechanism to ensure accountability of the system for all learners, including those with varied backgrounds and socioeconomic resources. In this article, members of the aforementioned AAMC MSPE task force explore 5 tensions inherent in the pursuit of standardizing the MSPE: (1) presenting each student's individual characteristics and strengths in a way that is relevant, while also working with a standard format and providing standard content; (2) showcasing school-specific curricular strengths while also demonstrating standard evidence of readiness for internship; (3) defining and achieving the right amount of standardization so that the MSPE provides useful information, adds value to the residency selection process, and is efficient to read and understand; (4) balancing reporting with advocacy; and (5) maintaining standardization over time, especially given the tendency for the MSPE format and content to drift. Ongoing efforts to promote collaboration and trust across the undergraduate to graduate medical education continuum offer promise to reconcile these tensions and promote successful educational outcomes.

Medical Education's Wicked Problem: Achieving Equity in Assessment for Medical Learners

Despite a lack of intent to discriminate, physicians educated in U.S. medical schools and residency programs often take actions that systematically disadvantage minority patients. The approach to assessment of learner performance in medical education can similarly disadvantage minority learners. The adoption of holistic admissions strategies to increase the diversity of medical training programs has not been accompanied by increases in diversity in honor societies, selective residency programs, medical specialties, and medical school faculty. These observations prompt justified concerns about structural and interpersonal bias in assessment. This manuscript characterizes equity in assessment as a "wicked problem" with inherent conflicts, uncertainty, dynamic tensions, and susceptibility to contextual influences. The authors review the underlying individual and structural causes of inequity in assessment. Using an organizational model, they propose strategies to achieve equity in assessment and drive institutional and systemic improvement based on clearly articulated principles. This model addresses the culture, systems, and assessment tools necessary to achieve equitable results that reflect stated principles. Three components of equity in assessment that can be measured and evaluated to confirm success include intrinsic equity (selection and design of assessment tools), contextual equity (the learning environment in which assessment occurs), and instrumental equity (uses of assessment data for learner advancement and selection and program evaluation). A research agenda to address these challenges and controversies and demonstrate reduction in bias and discrimination in medical education is presented.

Blackface in White Space: Using Admissions to Address Racism in Medical Education

Given the long history and pervasive nature of racism in medical culture, this essay argues that diversifying efforts alone cannot address systemic racism in medical education. Positive affirmation of anti-racist values and racial consciousness in the admissions process is necessary to create a truly inclusive culture in medical education and begin to undo centuries of racial prejudice in medicine. Drawing from historic examples, scholarship on the sociology of racialized space, recent research on race and medical education, and personal experience, we propose that medical educational institutions make a more concerted effort to consider racial attitudes and awareness as part of the admissions process as well as curricular reform efforts. We also provide examples of potential ways to practically implement this proposal in the admissions process.

Outcomes-Based Selection Into Medical School: Predicting Excellence in Multiple Competencies During the Clinical Years

PURPOSE

Medical school selection committees aim to identify the best possible students and, ultimately, the best future doctors from a large, well-qualified, generally homogeneous pool of applicants. Constructive alignment of medical school selection, curricula, and assessment with the ultimate outcomes (e.g., CanMEDS roles) has been proposed as means to attain this goal. Whether this approach is effective has not yet been established. The authors addressed this gap by assessing the relationship between performance in an outcomes-based selection procedure and performance during the clinical years of medical school.

METHOD

Two groups of students were compared: (1) those admitted into Maastricht University Medical School via an outcomes-based selection procedure and (2) those rejected through this procedure who were admitted into the program through a national, grade-point-average-based lottery. The authors compared performance scores of students from the 2 groups on all 7 CanMEDS roles, using assessment data gathered during clinical rotations. The authors examined data from 3 cohorts (2011-2013).

RESULTS

Students admitted through the local, outcomes-based selection procedure significantly outperformed the initially rejected but lottery-admitted students in all years, and the differences between groups increased over time. The selected students performed significantly better in the CanMEDS roles of Communicator, Collaborator, and Professional in the first year of clinical rotations; in these 3 roles-plus Organizer-in the second year; and in 2 additional roles (Advocate and Scholar-all except Medical Expert) at the end of their clinical training.

CONCLUSIONS

A constructively aligned selection procedure has increasing predictive value across the clinical years of medical school compared with a GPA-based lottery procedure. The data reported here suggest that constructive alignment of selection, curricula, and assessment to ultimate outcomes is effective in creating a selection procedure predictive of clinical performance.

Promoting Inclusion, Diversity, Access, and Equity Through Enhanced Institutional Culture and Climate

Advancing the health of all members of the global community remains core to the mission of the infectious diseases profession. Training, research, healthcare-delivery, and other infectious diseases-related institutions play a central role in meeting this goal. The promotion of inclusion, diversity, access, and equity (IDA&E) is critical to harnessing the full range of human creativity, innovation, and talent necessary to realizing the education, research, patient care, and service missions that constitute the principal objectives of such institutions. Strong and positive institutional cultures and climates are essential to achieving these IDA&E goals. We discuss opportunity gaps that exist in leveraging institutional culture and climate to optimize IDA&E. We further identify effective strategies to address these gaps and achieve excellence in education, research, patient care, and service in infectious diseases and the broader healthcare and biomedical space. We discuss the importance of both local and global context in conceptualizing IDA&E to best achieve these aims.