Widening the Gates: Redefining Excellence in Selection for Health Professions Education for a Diverse Future Workforce

To ensure diversity in the healthcare workforce selection committees must select a cohort of students who collectively possess the wide variety of qualities necessary to serve societal needs. In practice, selection procedures primarily focus on predicting academic outcomes, which are currently based on a limited set of qualities, restricting the definition of excellence in healthcare. The authors propose a shift in the design of selection procedures by including additional considerations - student diversity and applicant perception - to select talented students who can fulfil societal needs. The authors explain the importance of incorporating these considerations into the design of selection procedures and challenges that may arise. To overcome the challenges of incorporating student diversity and applicant perception in the design of selection procedures, a new view on alignment between the profession, training and selection is needed. This starts with redefining excellence in the profession with more explicit attention to equity, diversity and inclusion (EDI). The authors argue that by employing an EDI-adjusted model of alignment, selection procedures can enhance academic outcomes, properly recognize the talents of and acknowledge the needs for a diverse future workforce and be perceived as fair by applicants.

Demographic disparities in dental school selection: An analysis of current UK practices

INTRODUCTION

Specific social groups remain under-represented within dentistry. While the University Clinical Aptitude Test (UCAT) aims to widen participation in under-represented social groups, there is no evidence in dental education that this aim is being met.

MATERIALS AND METHODS

Data over two admission cycles (2012 and 2013), including 3246 applicants to 10 UK dental schools, were analysed. Applicant and selected pools were compared to the UK population. Multiple logistic regression was used to investigate the association between demographic variables and UCAT and receiving an offer of a place at dental school.

RESULTS

Over-representation of Female, Asian, least deprived and grammar school groups were found in applicant and selected pools compared with the UK population. White ethnic applicants were significantly more selected than Black (OR 0.25), Asian (OR 0.57) and Mixed (OR 0.80) ethnicities, while least deprived applicants were significantly more selected than most deprived (OR 0.59). Grammar school education increased odds of selection by 1.8 when compared to state school. The addition of UCAT to the model for applicants reduced ethnic disparities but led to disparities between other groups.

CONCLUSION

Current widening participation practices focus on attracting applicants from lower socio-economic groups. However, this study showed that ethnicity, sex and educational background biases also affect demographic diversity in dentistry. The UCAT shows promise in levelling the playing field; however, widening access measures will only succeed if selection committees radically change selection processes to address the systemic biases, enabling the dentists of tomorrow to represent the society they serve.

The added value of free preparatory activities for widening access to medical education: a multi-cohort study

BACKGROUND

Medical schools are reported to be less accessible to students with non-traditional backgrounds. These students face barriers when applying for and transitioning to medical school, which may be reduced by offering free preparatory activities. By equalizing access to resources, these activities are expected to reduce disparities in selection outcomes and early academic performance. In the present study, four free institutionally-provided preparatory activities were evaluated by comparing the demographic composition of participating and non-participating applicants. Additionally, the association between participation and selection outcomes and early academic performance was investigated for subgroups (based on sex, migration background and parental education).

METHODS

Participants were applicants to a Dutch medical school in 2016-2019 (N = 3592). Free preparatory activities included Summer School (N = 595), Coaching Day (N = 1794), Pre-Academic Program (N = 217), and Junior Med School (N = 81), supplemented with data on participation in commercial coaching (N = 65). Demographic compositions of participants and non-participants were compared using chi-squared tests. Regression analyses were performed to compare selection outcomes (curriculum vitae [CV], selection test score, probability of enrolment) and early academic performance (first-course grade) between participants and non-participants of demographic subgroups, controlling for pre-university grades and participation in other activities.

RESULTS

Generally, no differences in sociodemographic compositions of participants and non-participants were found, but males participated less often in Summer School and Coaching Day. Applicants with a non-Western background participated less often in commercial coaching, but the overall participation rate was low and participation had negligible effects on selection outcomes. Participation in Summer School and Coaching Day were stronger related with selection outcomes. In some cases, this association was even stronger for males and candidates with a migration background. After controlling for pre-university grades, none of the preparatory activities were positively associated with early academic performance.

CONCLUSIONS

Free institutionally-provided preparatory activities may contribute to student diversity in medical education, because usage was similar across sociodemographic subgroups, and participation was positively associated with selection outcomes of underrepresented and non-traditional students. However, since participation was not associated with early academic performance, adjustments to activities and/or curricula are needed to ensure inclusion and retention after selection.

Preparing for selection success: Socio-demographic differences in opportunities and obstacles

INTRODUCTION

There is a growing drive to improve the heterogeneity of medical school cohorts. However, those from lower socio-economic groups remain under-represented. Understanding the methods used by applicants to prepare for medical school selection, and the challenges they face with respect to opportunities and access, may provide important insights to this lack of diversity. This research considered the influence of socio-demographic background on preparation for medical school selection and on the successful offer of a place.

METHODS

All eligible applicants to a large UK medical school were invited to complete an anonymous online survey (international and mature applicants excluded), detailing demographic data and experiences of preparing for selection and challenges faced (n = 1885). Selection outcomes across all UK medical schools were examined for consenting students (n = 955). Univariate and multivariate analyses explored the associations of preparatory activities and demographic data with subsequent offer of a place at a UK medical school.

RESULTS

The survey response rate was 66.4%. Clinical work experience (hospital or general practice), fee-based courses for admissions tests and school preparation courses for interview were activities significantly associated with the offer of a place (P < .05). Those attending independent (private) schools most frequently reported school support and fee-based courses to support preparation (P < .01). Applicants from state non-selective (SNS) schools and lower socio-economic groups more frequently reported challenges in accessing fee-based support, school interview courses and clinical work experience (P ≤ .02).

DISCUSSION

Clinical work experience, commercial courses for admissions tests and school-based support for interview represent areas of preparation that are associated with success. However, they also represent areas that are more challenging to access for demographic groups traditionally under-represented in medicine. Addressing complex issues of fairness in highly selective higher education settings can appear an insurmountable task. These preparatory activities represent key areas for applicants, schools and institutions to explore and address.

How effective are selection methods in medical education? A systematic review

CONTEXT

Selection methods used by medical schools should reliably identify whether candidates are likely to be successful in medical training and ultimately become competent clinicians. However, there is little consensus regarding methods that reliably evaluate non-academic attributes, and longitudinal studies examining predictors of success after qualification are insufficient. This systematic review synthesises the extant research evidence on the relative strengths of various selection methods. We offer a research agenda and identify key considerations to inform policy and practice in the next 50 years.

METHODS

A formalised literature search was conducted for studies published between 1997 and 2015. A total of 194 articles met the inclusion criteria and were appraised in relation to: (i) selection method used; (ii) research question(s) addressed, and (iii) type of study design.

RESULTS

Eight selection methods were identified: (i) aptitude tests; (ii) academic records; (iii) personal statements; (iv) references; (v) situational judgement tests (SJTs); (vi) personality and emotional intelligence assessments; (vii) interviews and multiple mini-interviews (MMIs), and (viii) selection centres (SCs). The evidence relating to each method was reviewed against four evaluation criteria: effectiveness (reliability and validity); procedural issues; acceptability, and cost-effectiveness.

CONCLUSIONS

Evidence shows clearly that academic records, MMIs, aptitude tests, SJTs and SCs are more effective selection methods and are generally fairer than traditional interviews, references and personal statements. However, achievement in different selection methods may differentially predict performance at the various stages of medical education and clinical practice. Research into selection has been over-reliant on cross-sectional study designs and has tended to focus on reliability estimates rather than validity as an indicator of quality. A comprehensive framework of outcome criteria should be developed to allow researchers to interpret empirical evidence and compare selection methods fairly. This review highlights gaps in evidence for the combination of selection tools that is most effective and the weighting to be given to each tool.