Why is it so hard to consider personal qualities when selecting medical students?

Applying to medical school with undiagnosed dyslexia: a collaborative autoethnography

Recent statistics found the prevalence of dyslexia in UK medical schools to be 7%, sitting below the national prevalence of 10%. The factors contributing to this discrepancy are currently unknown, but may result from an interplay of individual and systemic barriers to entering medicine. This collaborative, analytic autoethnography aimed to use the experiences of 'Meg', a fourth-year medical student who was diagnosed as dyslexic whilst at medical school, to explore how the lack of a diagnosis during the admissions process may have impacted her journey into medicine. The data were collected using reflective writing and an interview before conducting a thematic analysis. Our analysis resulted in the construction of two meta-themes, relating to the negative emotional impact of not having a diagnosis and feelings of inferiority. Seven themes were also constructed. Some explored how Meg's personal experience of undiagnosed dyslexia acted as a barrier to entering medicine. Others explored the impact of external factors, such as socio-economic background and the provision of support, on an individual's chance of successfully applying to medical school. Finally, we explored the inadvertent impact undiagnosed (and unrecognised) dyslexia had on Meg's life course, including how medicine-specific aptitude tests, such as the BMAT and UKCAT, may have contributed to this. These results provide a unique window into the culture of applying to medical school as an undiagnosed dyslexic person, whilst discussing the need for medical schools to consider how their admissions processes may inadvertently disadvantage undiagnosed dyslexic applicants.

Incorporating a situational judgement test in residency selections: clinical, educational and organizational outcomes

BACKGROUND

Computer-based assessment for sampling personal characteristics (Casper), an online situational judgement test, is a broad measure of personal and professional qualities. We examined the impact of Casper in the residency selection process on professionalism concerns, learning interventions and resource utilization at an institution.

METHODS

In 2022, admissions data and information in the files of residents in difficulty (over three years pre- and post- Casper implementation) was used to determine the number of residents in difficulty, CanMEDS roles requiring a learning intervention, types of learning interventions (informal learning plans vs. formal remediation or probation), and impact on the utilization of institutional resource (costs and time). Professionalism concerns were mapped to the 4I domains of a professionalism framework, and their severity was considered in mild, moderate, and major categories. Descriptive statistics and between group comparisons were used for quantitative data.

RESULTS

In the pre- and post- Casper cohorts the number of residents in difficulty (16 vs. 15) and the number of learning interventions (18 vs. 16) were similar. Professionalism concerns as an outcome measure decreased by 35% from 12/16 to 6/15 (p < 0.05), were reduced in all 4I domains (involvement, integrity, interaction, introspection) and in their severity. Formal learning interventions (15 vs. 5) and informal learning plans (3 vs. 11) were significantly different in the pre- and post-Casper cohorts respectively (p < 0.05). This reduction in formal learning interventions was associated with a 96% reduction in costs f(rom hundreds to tens of thousands of dollars and a reduction in time for learning interventions (from years to months).

CONCLUSIONS

Justifiable from multiple stakeholder perspectives, use of an SJT (Casper) improves a clinical performance measure (professionalism concerns) and permits the institution to redirect its limited resources (cost savings and time) to enhance institutional endeavors and improve learner well-being and quality of programs.

How professional and academic pre-qualifications relate to success in medical education: Results of a multicentre study in Germany

OBJECTIVE

Every year, many applicants want to study medicine. Appropriate selection procedures are needed to identify suitable candidates for the demanding curriculum. Although research on medical school admissions has shown good predictive validity for cognitive selection methods (undergraduate GPA, aptitude tests), the literature on applicants with professional and/or academic experience prior to entering medical school remains slim. In our study, we therefore aimed to examine the association between academic success in medical school and having previously completed vocational training in the medical field, voluntary service (≥11 months) or an academic degree.

METHODS

Data were collected in a multicentre, cross-sectional study at five medical schools in Germany (Baden-Wuerttemberg) from students during medical school (i.e. 3rd-, 6th-, and 10th-semester and final-year students). Academic success was assessed according to scores on the first and second state examinations, the total number of examinations repeated and the number of semesters beyond the standard period of study. For the analysis we calculated ordinal logistic regression models for each outcome variable of academic success.

RESULTS

A total of N = 2,370 participants (response rate: RR = 47%) participated in the study. Having completed vocational training was associated with a higher amount of repeated examinations (small effect), while having an academic degree was associated with worse scores on the second state examination (medium effect). No significant association emerged between voluntary service and academic success.

CONCLUSION

The results indicate that professional and academic pre-qualifications pose no advantage for academic success. Possible associations with the financing of study and living conditions of students with pre-qualifications were analysed and discussed in an exploratory manner. However, the operationalisation of academic success from objective and cognitive data should be critically discussed, as the benefits of prior experience may be captured by personal qualities rather than examination results.

Recruiting students to rural longitudinal integrated clerkships: a qualitative study of medical educationists' experiences across continents

INTRODUCTION

Many health systems struggle in the provision of a sustainable and an efficient rural health workforce. There is evidence to suggest that Longitudinal Integrated Clerkships (LIC) placing student learners in rural community settings have positively impacted the provision of rural health care services The recruitment and engagement of students in rural LIC have significant challenges. This study explored best practice methods of recruiting and supporting the transition of medical students into rural LIC.

METHODS

The study took place during the 2021 Consortium of Longitudinal Integrated Clerkships Conference, a virtual event hosted by Stellenbosch University, South Africa. Participants consisted of delegates attending the Personally Arranged Learning Session (PeArLS) themed 'Secrets to success'. The session was recorded with the participants' consent and the recordings were transcribed verbatim. Data was uploaded to NVivo software and coded and analyzed using constant comparative analysis. Salient themes and patterns were identified.

RESULTS

Thirteen attendees participated in the PeArLS representing a range of countries and institutions. Strategically marketing the LIC brand, improving the LIC program profile within institutions by bridging logistics, and the need to scaffold the transition to the rural LIC learning environment emerged as key themes for success. The attendees highlighted their experiences of using peer groups, early exposure to rural LIC sites, and student allocation strategies for promotion. Unique learning styles adopted in LIC models, student anxiety and the importance of fostering supportive relationships with stakeholders to support students in their transition to the LIC environment were discussed.

DISCUSSION

This PeArLS highlighted successful systems and processes implemented in rural settings across different countries to recruit and manage the transition of medical students to rural LIC. The process proved to be a quick and efficient way to elicit rich information and may be of benefit to educationists seeking to establish similar programs or improve existing rural LIC.

Between agency and systemic barriers: Pathways to medicine and health sciences among Black students with immigrant parents from the Caribbean or Sub-Saharan Africa in Quebec, Canada

This qualitative study, based on life stories, documents the pathways to medicine and health sciences of Black students with immigrant parents from the Caribbean or Sub-Saharan Africa in Quebec, Canada. The aim of this study is to investigate the factors that shape their educational pathways using Doray's framework. Even among students from families with substantial levels of education, the educational pathways to medicine or health sciences may be described as non-linear. Several obstacles can arise along these pathways, depending on various social markers. Many of the interviewees first enroll in a program other than their desired program, either to ensure their financial security or to improve their grades for a limited-enrollment program. Medicine and pharmacy studies remain a dream for most participants and their parents. However, in some cases, this dream is not coming true, and interviewees' aspirations are sometimes stifled. These results shed light on the possible changes to be made within certain programs' admissions policies. Nevertheless, the students (n = 12) demonstrate agency in facing a seemingly unfair admissions system for highly selective programs. We conclude with recommendations on how to better accommodate the so-called non-traditional pathways of Black students with immigrant parents from the Caribbean or Sub-Saharan Africa.[Box: see text].

What is the evidence for biology as the 'heart of eligibility' to study medicine? A retrospective analysis

The first, sometimes the only, selection tool for entry into undergraduate medicine is prior educational attainment (PEA). This is often further specified to include certain subjects, for example, biology is a prerequisite for entry into medicine in many Asian countries. However, there seems no clear evidence base for this prerequisite. Our aim, therefore, was to carry out a retrospective quantitative study comparing the performances of five cohorts of students (2015-2019 entry; n = 588) with and without biology PEA in Years 1 and 2 Bachelor of Medicine and Bachelor of Surgery (MBBS) integrated written assessments (n = 3) and anatomy practical examinations (APE) (n = 5). The study was conducted at one of Singapore's three medical schools. Data were analyzed using independent t-tests and Mann-Whitney U with p values of less than 0.05 were considered significant. There were no significant differences in performance on any Years 1 or 2 integrated written assessments. Similarly, in one of the APE, a significant difference was found for one cohort (academic year [AY] 2015-2016) out of five assessments. These results suggest that having a prior biology qualification does not make a difference in assessment performance in the early years of medical school. This information may help stakeholders and admissions committees decide whether biology is required for medical school entrance.

Admission Grades as Predictors of Medical Students’ Academic Performance: A Cross-Sectional Study from Saudi Arabia

Background: Admission to medical school is competitive, and different countries use various tests in addition to high school grades to minimize selection bias. A few studies have been conducted to evaluate the usefulness of these tests as predictors for students’ academic performance. In this article, we aimed to assess factors that influenced students’ grades in medical school. Methods: A cross-sectional study included all students who graduated from the Faculty of Medicine at Jazan University between 2018 and 2020. Scores of the included participants were extracted from the registry of Jazan University, and additional questions about study habits were completed by the included students. Descriptive, univariate, and multivariate analyses were performed for the factors that impacted academic performance. Results: There were 331 included candidates, and the majority of them were female (53%). About 60% of the participants were medical residents at the time of the study, and 40% were interns. Univariate and multivariate analyses indicated that grades in high school and the pre-requisite tests were positively associated with students’ academic performance. Further, studying more than two hours per day was positively correlated with better grades in medical school. Conclusion: Scores of the admission tests can serve as predictors for student performance in medical school. National studies are deemed essential to evaluate additional admission tests for medical school, an action that would minimize selection bias.

The roles of personal interview and cognitive abilities at admission to medical school in predicting performance of medical students in their internal medicine sub-internship

BACKGROUND

The medical school admission process is complicated, perhaps reflecting unresolved debates concerning the most important skills necessary to become an ideal physician. The Goldman Medical School at Ben-Gurion University in Israel is known for placing great emphasis on the personal attributes of candidates in addition to their academic excellence. To this end, 1-h consecutive interviews are embedded in the admission process. This study aims to determine whether there is an association between candidates' personal interview ratings and the ratings assigned to these students at the conclusion of their 6^th year internal medicine sub-internship.

METHODS

Our study sample included 136 students who were admitted to the medical school in 2015, and who completed their 6^th year internal medicine sub-internship in 2019-2020. Our data were derived from the admissions information for each candidate and from structured interviews concerning medical competence and personal traits, which were completed by medical personnel who were in contact with these students during their clinical rounds.

RESULTS

Higher interview ratings of candidates during the admission process were associated with a higher probability that students would be evaluated as top-rated internists 6 years later (Odds Ratio (OR) = 9.4, p-value = 0.049), independent of gender (OR for male vs female = 0.2, p-value = 0.025) and age (OR = 1.3 per each year, p-value = 0.115). Although significant, the numeric difference in interview rating was relatively small (median 9.5 and 9.4 for top-rated and not top-rated internists, respectively).

CONCLUSIONS

Our study shows that high personal interview ratings assigned to candidates as part of the medical school admission process are predictive of high performance ratings of students after they complete their 6^th year internal medicine sub-internships. These findings demonstrate the value and importance of using semi-structured personal interviews in the medical school admission process.

The role of the interview in residency selection: A mixed-methods study

CONTEXT

Residency programmes invest considerable time and resources in candidate interviews as a result of their perceived ability to reveal important social traits. However, studies examining the ability of interviews to predict resident performance have shown mixed findings, and the role of the interview in candidate evaluation remains unclear. This mixed-methods study, conducted in an anaesthesiology residency programme at a large academic medical centre, examined how interviews contributed to candidate assessment and whether the addition of behavioural questions to interviews altered their role in the evaluation process.

METHODS

During the 2018-2019 residency selection season in the Department of Anesthesiology and Critical Care at the University of Pennsylvania, independent ratings for each interviewee were collected from faculty interviewers. Consensus ratings subsequently established by committee were also collected. Committee meetings were audiorecorded and transcribed for qualitative analysis. Behavioural questions were integrated into half of interview days. Ratings of candidates interviewed on behavioural question days were compared statistically with those of candidates interviewed on non-behavioural question days.

RESULTS

Qualitative analysis showed that interviewers heavily emphasised candidates' application files in evaluating the interviews. Interviewers focused on candidates' academic records and favoured candidates whose interview behaviours were consistent with their applications and whose applications demonstrated similarities to interviewers' traits. The addition of behavioural questions demonstrated little ability to alter these dynamics. Quantitatively, there were no significant differences in candidate rating outcomes between behavioural and non-behavioural interviewing days, whereas a higher medical school rating and higher score on the United States Medical Licensing Examination Step 1 were associated with a more favourable consensus rating.

CONCLUSIONS

Residency candidates' application files predisposed interviewers' experience and evaluation of interviews, preventing the interviews from providing discrete assessments of interpersonal qualities, even when behavioural questions were included. In the continued effort to perform well-rounded assessments of residency candidates, further research and reflection on the role of interviewing in evaluation are necessary.