Selection and lottery in medical school admissions: who gains and who loses?

Improving selection procedures in health professions education from the applicant perspective: an interview study

INTRODUCTION

Applicant perceptions of selection impact motivation and performance during selection, and student diversity. However, in-depth insight into which values underly these perceptions is lacking, creating challenges for aligning selection procedures with applicant perceptions. This qualitative interview study aimed to identify values applicants believe should underlie selection, and how, according to applicants, these values should be used to make specific improvements to selection procedures in undergraduate health professions education (HPE).

METHODS

Thirty-one applicants to five undergraduate HPE programs in the Netherlands participated in semi-structured interviews using Appreciative Inquiry, an approach that focuses on what goes well to create vision for improvement, to guide the interviews. Transcriptions were analyzed using thematic analysis, adopting a constructivist approach.

RESULTS

Applicants' values related to the aims of selection, the content of selection, and the treatment of applicants. Applicants believed that selection procedures should aim to identify students who best fit the training and profession, and generate diverse student populations to fulfill societal needs. According to applicants, the content of selection should be relevant for the curriculum and profession, assess a comprehensive set of attributes, be of high quality, allow applicants to show who they are, and be adapted to applicants' current developmental state. Regarding treatment, applicants believed that selection should be a two-way process that fosters reflection on study choice, be transparent about what applicants can expect, safeguard applicants' well-being, treat all applicants equally, and employ an equitable approach by taking personal circumstances into account. Applicants mentioned specific improvements regarding each value.

DISCUSSION

Applicants' values offer novel insights into what they consider important preconditions for the design of selection procedures. Their suggested improvements can support selection committees in better meeting applicants' needs.

A survey of medical school aspirant perceptions of an unexpected lottery-facilitated admissions adaptation

INTRODUCTION

Due to the COVID-19 pandemic, the Undergraduate Medical Doctor (MD) Programme at McMaster University (Hamilton, Canada) was unable to run in-person medical school interviews in March 2020, prompting an alternate solution that maximised admission opportunities for Indigenous applicants, prioritised admission for those rated most highly in the interview determination process, and allocated subsequent offers via lottery.

METHODS

A short survey was administered to applicants who had been offered an admissions interview and were subsequently impacted by the admissions adaptations. The survey elicited perceptions of the adaptation through Likert scale ratings and free-text responses. Survey data were analysed via a sequential (quantitative to qualitative) mixed-methods design.

RESULTS

196 of 552 potential participants completed the survey. Across quantitative and qualitative analyses, respondents reported that the adaptation had a negative impact on their professional development and personal life. Ratings of negative perception were greater for those who did not receive an offer than for those who accepted or declined an offer. Free text responses emphasised considerable criticism for the lottery portion of the adaptation and displeasure that efforts made in constructing applications were less relevant than anticipated.

DISCUSSION

The negative responses to this unexpected change highlight the profound upstream impact admission policies have on the preapplication behaviours of aspiring medical students. The outcomes support a refined understanding of the value candidates place on the interview in appraising their own suitability for a career as a physician.

The association between how medical students were selected and their perceived stress levels in Year-1 of medical school

BACKGROUND

The prevalence of medical students' mental distress is high. While schools apply various methods to select a well-performing and diverse student population, little is known about the association between different selection methods and the well-being of these students during medical school. The present retrospective multi-cohort study assessed whether students selected by high grades, assessment, or weighted lottery showed different stress perception levels in Year-1 of medical school.

METHODS

Of 1144 Dutch Year-1 medical students, 650 (57%) of the cohorts 2013, 2014, and 2018 who were selected by high grades, assessment, or weighted lottery completed a stress perception questionnaire (PSS-14). A multilevel regression analysis assessed the association between selection method (independent variable) and stress perception levels (dependent variable) while controlling for gender and cohort. In a post-hoc analysis, academic performance (optimal vs. non-optimal) was included in the multilevel model.

RESULTS

Students selected by assessment (B = 2.25, p < .01, effect size (ES) = small) or weighted lottery (B = 3.95, p < .01, ES = medium) had higher stress perception levels than students selected by high grades. Extending the regression model with optimal academic performance (B=-4.38, p < .001, ES = medium), eliminated the statistically significant difference in stress perception between assessment and high grades and reduced the difference between weighted lottery and high grades from 3.95 to 2.45 (B = 2.45, p < .05, ES = small).

CONCLUSIONS

Selection methods intended to create a diverse student population - assessment and lottery - are associated with higher stress perception levels in Year-1 of medical school. These findings offer medical schools insights into fulfilling their responsibility to take care of their students' well-being.

The added value of free preparatory activities for widening access to medical education: a multi-cohort study

BACKGROUND

Medical schools are reported to be less accessible to students with non-traditional backgrounds. These students face barriers when applying for and transitioning to medical school, which may be reduced by offering free preparatory activities. By equalizing access to resources, these activities are expected to reduce disparities in selection outcomes and early academic performance. In the present study, four free institutionally-provided preparatory activities were evaluated by comparing the demographic composition of participating and non-participating applicants. Additionally, the association between participation and selection outcomes and early academic performance was investigated for subgroups (based on sex, migration background and parental education).

METHODS

Participants were applicants to a Dutch medical school in 2016-2019 (N = 3592). Free preparatory activities included Summer School (N = 595), Coaching Day (N = 1794), Pre-Academic Program (N = 217), and Junior Med School (N = 81), supplemented with data on participation in commercial coaching (N = 65). Demographic compositions of participants and non-participants were compared using chi-squared tests. Regression analyses were performed to compare selection outcomes (curriculum vitae [CV], selection test score, probability of enrolment) and early academic performance (first-course grade) between participants and non-participants of demographic subgroups, controlling for pre-university grades and participation in other activities.

RESULTS

Generally, no differences in sociodemographic compositions of participants and non-participants were found, but males participated less often in Summer School and Coaching Day. Applicants with a non-Western background participated less often in commercial coaching, but the overall participation rate was low and participation had negligible effects on selection outcomes. Participation in Summer School and Coaching Day were stronger related with selection outcomes. In some cases, this association was even stronger for males and candidates with a migration background. After controlling for pre-university grades, none of the preparatory activities were positively associated with early academic performance.

CONCLUSIONS

Free institutionally-provided preparatory activities may contribute to student diversity in medical education, because usage was similar across sociodemographic subgroups, and participation was positively associated with selection outcomes of underrepresented and non-traditional students. However, since participation was not associated with early academic performance, adjustments to activities and/or curricula are needed to ensure inclusion and retention after selection.

Influence of social networks in healthcare on preparation for selection procedures of health professions education: a Dutch interview study

OBJECTIVES

Health professions education (HPE) students are often not representative of the populations they will serve. The underrepresentation of non-traditional students is problematic because diversity is essential for promoting excellence in health education and care. This study aimed to understand the perceptions of traditional and non-traditional students regarding facilitators and barriers in preparing for HPE selection procedures, and to determine the role of social networks in their decision-making and preparations to apply.

METHODS

A qualitative study was conducted with 26 Dutch youth who were interested in university-level HPE programmes. Semistructured interviews and sociograms were analysed using thematic analysis, adopting a constructivist approach.

RESULTS

Twenty-six high school students participated, with traditional and non-traditional backgrounds, with and without social networks in healthcare and higher education. Two themes were constructed. First, four high-impact facilitators helped to overcome barriers to apply and in preparation for selection: access to a social network connection working or studying in healthcare, to correct information, to healthcare experience and to a social network connection in higher education. Lack of information was the main barrier while access to social network connections in healthcare was the main facilitator to overcome this barrier. However, this access was unevenly distributed. Second, access alone is not enough: the need for agency to make use of available facilitators is also essential.

CONCLUSIONS

The themes are discussed using intersectionality. Traditional students with access to facilitators develop their self-efficacy and agency within social structures that privilege them, whereas non-traditional students must develop those skills without such structures. Our findings provide recommendations for the ways in which universities can remove barriers that cause unequal opportunities to prepare for the selection of HPE programmes. Along with equitable admissions, these recommendations can help to achieve a more representative student population and subsequently a better quality of health education and care.

Selection for health professions education leads to increased inequality of opportunity and decreased student diversity in The Netherlands, but lottery is no solution: A retrospective multi-cohort study

BACKGROUND

Concerns exist about the role of selection in the lack of diversity in health professions education (HPE). In The Netherlands, the gradual transition from weighted lottery to selection allowed for investigating the variables associated with HPE admission, and whether the representativeness of HPE students has changed.

METHOD

We designed a retrospective multi-cohort study using Statistics Netherlands microdata of all 16-year-olds on 1 October 2008, 2012, and 2015 (age cohorts, N > 600,000) and investigated whether they were eligible students for HPE programs (n > 62,000), had applied (n > 14,000), and were HPE students at age 19 (n > 7500). We used multivariable logistic regression to investigate which background variables were associated with becoming an HPE student.

RESULTS

HPE students with ≥1 healthcare professional (HP) parent, ≥1 top-10% income/wealth parent, and women are overrepresented compared to all age cohorts. During hybrid lottery/selection (cohort-2008), applicants with ≥1 top-10% wealth parent and women had higher odds of admission. During 100% selection (cohort-2015) this remained the case. Additionally, applicants with ≥1 HP parent had higher odds, those with a migration background had lower odds.

CONCLUSIONS

Odds of admission are increasingly influenced by applicants' backgrounds. Targeted recruitment and equitable admissions procedures are required to increase matriculation of underrepresented students.

Systematic review of specialist selection methods with implications for diversity in the medical workforce

PURPOSE

There is growing concern that inequities in methods of selection into medical specialties reduce specialist cohort diversity, particularly where measures designed for another purpose are adapted for specialist selection, prioritising reliability over validity. This review examined how empirical measures affect the diversity of specialist selection. The goals were to summarise the groups for which evidence is available, evaluate evidence that measures prioritising reliability over validity contribute to under-representation, and identify novel measures or processes that address under-representation, in order to make recommendations on selection into medical specialties and research required to support diversity.

METHOD

In 2020-1, the authors implemented a comprehensive search strategy across 4 electronic databases (Medline, PsychINFO, Scopus, ERIC) covering years 2000-2020, supplemented with hand-search of key journals and reference lists from identified studies. Articles were screened using explicit inclusion and exclusion criteria designed to focus on empirical measures used in medical specialty selection decisions.

RESULTS

Thirty-five articles were included from 1344 retrieved from databases and hand-searches. In order of prevalence these papers addressed the under-representation of women (21/35), international medical graduates (10/35), and race/ethnicity (9/35). Apart from well-powered studies of selection into general practice training in the UK, the literature was exploratory, retrospective, and relied upon convenience samples with limited follow-up. There was preliminary evidence that bias in the measures used for selection into training might contribute to under-representation of some groups.

CONCLUSIONS

The review did not find convincing evidence that measures prioritising reliability drive under-representation of some groups in medical specialties, although this may be due to limited power analyses. In addition, the review did not identify novel specialist selection methods likely to improve diversity. Nevertheless, significant and divergent efforts are being made to promote the evolution of selection processes that draw on all the diverse qualities required for specialist practice serving diverse populations. More rigorous prospective research across different national frameworks will be needed to clarify whether eliminating or reducing the weighting of reliable pre-selection academic results in selection decisions will increase or decrease diversity, and whether drawing on a broader range of assessments can achieve both reliable and socially desirable outcomes.

Getting to know our non-traditional and rejected medical school applicants

None

Closing Editorial: New insights and reflections on the science of selection and recruitment

This article was migrated. The article was marked as recommended. In this closing editorial we reflect on key topics presented in this special issue on selection and recruitment, with a view to identifying gaps in the literature, and exploring where next. Four key themes have emerged including; (1) the impact of using new technologies in selection and recruitment; (2) addressing social accountability, diversity and fairness issues in selection; (3) increased emphasis on non-academic personal attributes in selection, and (4) attraction and recruitment in postgraduate recruitment. The implications of findings from this collection of studies and opinion pieces are discussed in relation to future research, policy and practice.