How Different Medical School Selection Processes Call upon Different Personality Characteristics

A preliminary study of the probitive value of personality assessment in medical school admissions within the United States

BACKGROUND

Allopathic medicine faces a daunting challenge of selecting the best applicants because of the very high applicant / matriculant ratio. The quality of graduates ultimately reflects the quality of medical practice. Alarming recent trends in physician burnout, misconduct and suicide raise questions of whether we are selecting the right candidates. The United States (US) lags far behind the United Kingdom (UK) and Europe in the study of non-cognitive tests in medical school admissions. Although more recently, medical schools in both the UK, Europe and the US have begun to use situational judgement tests such as the Computer-Based Assessment for Sampling Personal Characteristics (CASPer) and the situational judgement test (SJT), recently developed by the Association of American Medical Colleges (AAMC) and that these tests are, in a sense non-cognitive in nature, direct personality tests per se have not been utilized. We have historically used, in the admissions process within the US, knowledge, reasoning and exam performance, all of which are largely influenced by intelligence and also improved with practice. Personality, though also undoubtedly influenced by intelligence, is fundamentally different and subject to different kinds of measurements.

METHODS

A popular personality measurement used over the past two decades within the US in business and industry, but not medical school has been the Neo Personality Inventory - Revised (NEO-PI-R) Test. This test has not been utilized regularly in allopathic medicine probably because of the paucity of exploratory retrospective and validating prospective studies. The hypothesis which we tested was whether NEO-PI-R traits exhibited consistency between two institutions and whether their measurements showed probative value in predicting academic performance.

RESULTS

Our retrospective findings indicated both interinstitutional consistencies and both positive and negative predictive values for certain traits whose correlative strengths exceeded traditional premed metrics: medical college admission test (MCAT) scores, grade point average (GPA), etc. for early academic performance.

CONCLUSIONS

Our exploratory studies should catalyze larger and more detailed confirmatory studies designed to validate the importance of personality traits not only in predicting early medical school performance but also later performance in one's overall medical career.

The big five: Studying the surgical personality

BACKGROUND

The challenging nature of performing surgery on a personal and professional level demands specific characteristics. Personality traits play an important role in the nature and behavior of humans, which are studied using the five-factor model. Therefore, we investigated the personality of 3 surgical generations.

METHODS

Three distinct surgical populations were approached. The Dutch Big Five Inventory-2 was sent out online to 126 surgical residents (response: n = 69) and 104 surgeons (response: n = 60) in a teaching region in the Netherlands. Moreover, medical students interested in surgery were approached via the students' surgical society (response: n = 54). To obtain a normative Dutch population sample, the Longitudinal Internet studies for the Social Sciences panel was used, creating groups of the following age categories: 18 to 25 (n = 84), 26 to 35 (n = 101), 36 to 67 (n = 432). One-way analysis of variance with Bonferroni correction was used to assess differences in personality scores.

RESULTS

Individuals interested in surgery (ie, surgically-oriented medical students, surgical residents, and surgeons) generally scored significantly higher on extraversion, conscientiousness, agreeableness, open-mindedness, and lower on negative emotionality compared with the normative population sample. Across the surgical generations, surgical residents scored significantly lower on open-mindedness (3.60) compared with surgeons (3.92) and surgically-oriented medical students (3.82). Surgically-oriented medical students scored significantly higher in negative emotionality (2.44) compared with surgical residents (2.12) and surgeons (2.07).

CONCLUSION

Being a surgeon demands particular levels of determination and emotional stability. The surgical population shows a distinct personality pattern compared with the normative population, and more modest differences exist between persons in different stages of their surgical career.

Associations between admissions factors and the need for remediation

This study examines the way in which student characteristics and pre-admissions measures are statistically associated with the likelihood a student will require remediation for academic and professionalism offenses. We anchor our inquiry within Irby and Hamstra's (2016) conceptual framework of constructs of professionalism. Data from five graduating cohorts (2014-2018) from McMaster University (Hamilton, Canada) (N = 1,021) were retroactively collected and analyzed using traditional and multinominal logistic regression analyses. The relationship among student characteristics, pre-admissions variables, and referral for potential remediation both by occurrence (yes/no) as well as type (academic/professional/no referral) were examined separately. Findings indicate that gender (OR = 0.519, 95% CI 0.326-0.827, p < 0.01) and undergraduate grade point average (GPA) (OR = 0.245, 95% CI 0.070-0.855, p < 0.05) were significantly associated with instances of referral for potential professionalism and academic remediation, respectively. Women were less likely than men to require remediation for professionalism (OR = 0.332, 95% CI 0.174-0.602, p < 0.001). Undergraduate GPAs (OR = 0.826, 95% CI 0.021-0.539, p < 0.01) were significantly associated with remediation for academic reasons. Lower undergraduate GPAs were associated with a higher likelihood of remediation. These findings point to the admissions variables that are associated with instances that prompt referral for potential remediation. Where associations are not significant, we consider the application of different conceptualizations of professionalism across periods of admissions and training. We encourage those involved in applicant selection and student remediation to emphasize the importance of the interactions that occur between personal and contextual factors to influence learner behaviour and professional identity formation.

The Long-Term Effectiveness of Empathic Interventions in Medical Education: A Systematic Review

The Association of American Medical Colleges recognizes that empathy is an important part of providing excellent patient care and lists empathy as a Core Entrustable Professional Attribute for physicians. This study is a review of the literature focusing on studies with an educational intervention to promote empathy and at least one year follow-up data. After reviewing the 4910 abstracts retrieved from PubMed, PsycInfo, Cochrane, Web of Science, CINAHL, and Embase; the coauthors selected 61 articles for full-text review and completed a medical education research study quality instrument (MERSQI) to ensure all selected studies scored at least 7 or above. Five studies from the US and seven international studies met our inclusion criteria and formed the basis for the study. Few longitudinal studies with a post-intervention follow-up exist to confirm or disprove the effectiveness and durability of empathy training. Of the published studies that do conduct long-term follow-up, study design and measures used to test empathy are inconsistent. Despite the high degree of heterogeneity, the overwhelming majority demonstrated declining empathy over time. Little evidence was identified to support the ability to augment the empathy of physician trainees in sustained fashion. A model is presented which explains the observed changes. Alternative solutions are proposed, including the selection of more prosocial candidates.

Outcomes-Based Selection Into Medical School: Predicting Excellence in Multiple Competencies During the Clinical Years

PURPOSE

Medical school selection committees aim to identify the best possible students and, ultimately, the best future doctors from a large, well-qualified, generally homogeneous pool of applicants. Constructive alignment of medical school selection, curricula, and assessment with the ultimate outcomes (e.g., CanMEDS roles) has been proposed as means to attain this goal. Whether this approach is effective has not yet been established. The authors addressed this gap by assessing the relationship between performance in an outcomes-based selection procedure and performance during the clinical years of medical school.

METHOD

Two groups of students were compared: (1) those admitted into Maastricht University Medical School via an outcomes-based selection procedure and (2) those rejected through this procedure who were admitted into the program through a national, grade-point-average-based lottery. The authors compared performance scores of students from the 2 groups on all 7 CanMEDS roles, using assessment data gathered during clinical rotations. The authors examined data from 3 cohorts (2011-2013).

RESULTS

Students admitted through the local, outcomes-based selection procedure significantly outperformed the initially rejected but lottery-admitted students in all years, and the differences between groups increased over time. The selected students performed significantly better in the CanMEDS roles of Communicator, Collaborator, and Professional in the first year of clinical rotations; in these 3 roles-plus Organizer-in the second year; and in 2 additional roles (Advocate and Scholar-all except Medical Expert) at the end of their clinical training.

CONCLUSIONS

A constructively aligned selection procedure has increasing predictive value across the clinical years of medical school compared with a GPA-based lottery procedure. The data reported here suggest that constructive alignment of selection, curricula, and assessment to ultimate outcomes is effective in creating a selection procedure predictive of clinical performance.

The Evolution of Social Beliefs 1960-2016 in the United States and Its Influence on Empathy and Prosocial Expression in Medicine

This perspective surveys healthcare's response to the increased prominence of racial, ethnic, religious and sexual minorities as well as females in American culture. It argues for understanding physicians both as products of the broader society and its changes. Starting in the 1960s, empiric evidence for the rise of reactionary viewpoints in response to major social movements is outlined. Structural reasons for the prevalence of such ideologies within medicine are highlighted. Its negative consequences for minority health are addressed. Finally, the author turns to compensatory strategies to improve the social environment within healthcare. Alternative selection strategies for medical school are proposed, with a stronger focus on empathetic candidates.

Exam performance of different admission quotas in the first part of the state examination in medicine: a cross-sectional study

BACKGROUND

Most medical students in Germany are admitted via selection procedures, which are adjusted to the demands of the universities. At Lübeck medical school, scores from interviews that measure non-academic skills and pre-university GPAs are summed to arrive at an admission decision. This article seeks to illuminate the effectiveness of this selection procedure in comparison to other non-selected student groups.

METHODS

Quota information and exam results from the first federal exam were linked for students admitted to Lübeck medical school between 2012 and 2015 (N = 655). Five different student groups (university-specific selection quota, pre-university GPA quota, waiting time quota, ex-ante quota and foreign students) were compared regarding exam attempts, written and oral grades, temporal continuity and examination success in the standard study period.

RESULTS

While the pre-university GPA quota outperformed all other quotas regarding written and oral grades, it did not differ from the selection quota regarding exam attempts, temporal continuity and examination success in the standard study period. Students in the waiting time and ex-ante quotas performed inferior by comparison. The results of foreign students were the most problematic.

CONCLUSION

Students selected by the university show high temporal continuity and examination success. These results, and possible advantages in physician eligibility, argue for the utilisation of non-academic skills for admission.

Need for cognitive closure, tolerance for ambiguity, and perfectionism in medical school applicants

BACKGROUND

Physicians have to deal with uncertainty on a daily basis, which requires high tolerance for ambiguity. When medical decisions have to be made in ambiguous situations, low levels of need for cognitive closure and high levels of adaptive perfectionism are beneficial. It might be useful to measure such personality traits during medical school selection processes. In our study, we explored the expression of need for cognitive closure, tolerance for ambiguity, and perfectionism in medical school applicants who participated in a multiple mini-interview selection process with respect to the final decision of admission or rejection.

METHODS

After participating in the multiple mini-interview procedure (HAM-Int) at Hamburg Medical School in August 2019, 189 medical school applicants filled out a questionnaire including the Multidimensional Perfectionism Scale by Hewitt and Flett (MPS-H), the Multidimensional Perfectionism Scale by Frost (MPS-F), the Tolerance for Ambiguity Scale (TAS), the 16-Need for Cognitive Closure Scale (16-NCCS), and sociodemographic data. After the final admission decision, the scores of need for cognitive closure, tolerance for ambiguity, and perfectionism of admitted and rejected applicants were compared. We also assessed the predictive power of need for cognitive closure and age for the admission decision in a binary logistic regression model.

RESULTS

Compared to the admitted applicants, the rejected applicants showed a significantly higher need for cognitive closure (p = .009). A high need for cognitive closure correlated significantly positively with maladaptive perfectionism (p < .001) and significantly negatively with tolerance for ambiguity (p < .001). Low need for cognitive closure and older age were associated with a positive admission decision.

CONCLUSIONS

Regarding the personality traits need for cognitive closure, tolerance for ambiguity, and perfectionism we identified interesting differences and correlations of relevance for physicians' daily work in medical school applicants who were admitted or rejected after participating in a multiple mini-interview selection procedure. Further studies are needed to investigate these characteristics and their development longitudinally in medical students and to correlate them with students' medical performance.

An Exploration of the Relationships Between Multiple Mini-Interview Scores and Personality Traits

Objective. To explore the relationship between pharmacy students' social and behavioral competencies assessed using multiple mini-interviews (MMIs) and their personality traits. Methods. A retrospective study was conducted using data from two Doctor of Pharmacy (PharmD) cohorts. Students' self-reported scores from an externally validated tool completed during their first professional year that assessed five personality traits (openness to experiences, conscientiousness, extraversion, agreeableness, and emotionality) were collected. Students' scores on empathy, integrity, adaptability, critical thinking, and collaboration were collected during MMIs conducted during the admissions process. Analysis of variance was used to test the homogeneity of the sample, and correlation analyses were used to determine the strength of relationships between variables. Results. When examining for associations between students' personality traits and their social and behavioral competencies measured during the MMIs, we found a few significant but very weak correlations with extraversion. Conclusion. Our results revealed weak to negligible correlations between scores on competencies measured during the MMIs and personality traits, potentially because the assessments measured different constructs.

Factors Associated with Academic Performance in Physician Assistant Graduate Programs and National Certification Examination Scores. A Literature Review

Purpose:

A physician assistant (PA) is a state-licensed, nationally certified healthcare professional who practices medicine on healthcare teams with physicians and other providers. PAs practice medicine across the US (all 50 states, the District of Columbia, and the US territories). In recent years, the demand for clinicians has increased dramatically which has led to an increase in the number of practicing PAs. To meet this growing demand for healthcare providers, identifying applicants capable of overcoming the challenges associated with the PA educational track in addition to the corresponding clinical training is crucial.

Method:

In this paper, we reviewed the literature and discuss preadmission factors and their relationship toward completion of PA graduate programs and successfully passing the national certification examination (PANCE).

Results:

Previous studies indicated a weak positive association between verbal GRE scores and success on the PANCE. Moreover, undergraduate GPA, and taking a variety of undergraduate science prerequisites correlates with passing the PANCE.

Discussion:

Investigations of success correlates of other professional programs indicated that psychological factors may have potential for use in predicting whether an applicant would be successful in PA school. These include tests for emotional intelligence and particular personality characteristics.

Reliability of personality and values tests: The effects of "high stakes" selection conditions, and of four years in medical school

This study investigated if scores on tests of personal qualities are affected by whether they will determine selection decisions ("high stakes") or not; and whether they are stable for individuals and groups across a four-year medical course. Two tests, one assessing values and one assessing components of personality, were administered either at the same time as a medical university entrance exam (first cohort; N = 216), or after entry was confirmed (second cohort; N = 142). Both cohorts took the tests again after four years of medical school. Analysis of variance was used to compare group mean scores and interactions, and correlation coefficients to measure temporal reliability. The high stakes cohort initially presented themselves in a significantly more positive light on the personality test. After four years of medical school scores on both tests changed significantly, towards more communitarian values and less empathic attitudes. Thus, personality scores were affected by both the conditions under which the initial tests were conducted and by the passage of time, but values only by the passage of time. Before and after scores were significantly correlated.

Do different curriculum aligned selection procedures admit students with different personality profiles to medical school?

BACKGROUND

Medical schools aim to contribute to a pool of doctors who are ready for a future practice that will be ever-changing requiring collaboration skills and lifelong learning. They adapt their curricula and selection procedures to fulfil this responsibility. This study aims to determine whether two different selection procedures in one medical school, both matching the key characteristics of the subsequent curricula (one traditional, knowledge-based, and one recently designed for self directed learning and focusing on practice), select students with different personality traits as a side-effect. This perspective was chosen as personality has been related to the CanMeds competencies, innovation capacities, medical school performance and medical professional success.

METHODS

A total of 621 students admitted through the new or the traditional selection procedure were invited to complete a Big Five Inventory questionnaire at the start of their Bachelor's programme. Using ANCOVA, we compared Big Five traits of students admitted through the new selection procedure (n = 196) and the traditional selection procedure (n = 425).

RESULTS

The group of students admitted through the procedure matching the newly designed curriculum had a lower mean score on neuroticism (p < .01) and higher mean scores on conscientiousness, extraversion, agreeableness and openness (p < .001) than the other group.

CONCLUSIONS

The findings of the current study indicate that the medical school population is influenced in terms of personality traits as a side-effect of a changing selection procedure. We recommend studying this mechanism and its implications further and using it more consciously in selection procedure design.

The role of personal resilience and personality traits of healthcare students on their attitudes towards interprofessional collaboration

BACKGROUND

Interprofessional collaboration (IPC) improves communication between healthcare workers and healthcare delivery. Interprofessional education (IPE) is essential in preparing healthcare students for cooperating with other healthcare disciplines in a real work setting. Although higher education settings have a responsibility to provide collaborative healthcare practice to students, IPE has not yet been prompted worldwide as a formal division in health professional education and in Israel IPE among health professions students is scarce.

OBJECTIVE

To examine the attitudes of health professions students towards IPC in correlation with their personal resilience and personality traits.

DESIGN

A descriptive cross-sectional design was used.

SETTING AND PARTICIPANTS

Participants were fourth year nursing, occupational therapy (OT), and physical therapy students studying in an academic undergraduate program at a School of Health Professions in a central university in Israel.

METHODS

Attitudes were assessed with a questionnaire consisting of the Interdisciplinary Education Perception Scale, the Connor-Davidson Resilience Scale, the Big Five Inventory of personality dimensions, and a question evaluating students' experience with the PBL (Problem-Based Learning) method.

RESULTS

Questionnaires were completed by 184 health professions students. Nursing students' perception of actual cooperation with other professions and their perceived competency and autonomy in their profession were slightly lower than those of other students. Among nursing students, positive correlations were found between competency & autonomy and resilience (p<0.01) and between competency & autonomy and agreeableness (p<0.05). Positive correlations were also found between their perception of actual cooperation with other professions and: resilience (p<0.01), agreeableness (p<0.05), conscientiousness (p<0.05), and openness (p<0.05). Only OT students were familiar with and experienced in the PBL method. This experience with PBL was found correlated with more positive attitudes towards competency and autonomy in the profession and higher positive perception of actual cooperation with other professions.

CONCLUSIONS

IPE, including PBL, should be integrated in health professions students' training.

Lessons learned from 15 years of non-grades-based selection for medical school

CONTEXT

Thirty years ago, it was suggested in the Edinburgh Declaration that medical school applicants should be selected not only on academic, but also on non-academic, attributes. The main rationale behind extending medical school selection procedures with the evaluation of (non-academic) personal qualities is that this will lead to the selection of students who will perform better as a doctor than those who are selected on the basis of academic measures only. A second rationale is the expectation that this will lead to a representative health workforce as a result of reduced adverse impact. The aims of this paper are (i) to describe what can be learned about the use of selection criteria other than grades from over 15 years of Dutch experience and (ii) to summarise current knowledge on the issue of adverse impact in relation to non-grades-based selection.

METHODS

A narrative review was undertaken of the (published) evidence that has resulted from non-grades-based school-specific selection procedures in the Netherlands and from recent explorations of the effect of the use of non-grades-based selection criteria on student diversity.

RESULTS

The Dutch evidence is grouped into five key themes: the effect of participation in voluntary selection procedures, the assessment of pre-university extracurricular activities, the use of work samples, Dutch experiences with situational judgement tests and the effects of changing circumstances. This is followed by several lessons learned for medical schools that aim to increase their student diversity.

CONCLUSION

Over the last 30 years, important steps towards reliable and valid methods for measuring non-academic abilities have been taken. The current paper describes several lessons that can be learned from the steps taken in the Dutch context. The importance of sharing evidence gathered around the globe and building on this evidence to reach our goal of predicting who will be a good doctor is acknowledged.

Is perfect good? - Dimensions of perfectionism in newly admitted medical students

BACKGROUND

Society expects physicians to perform perfectly but high levels of perfectionism are associated with symptoms of distress in medical students. This study investigated whether medical students admitted to medical school by different selection criteria differ in the occurrence of perfectionism.

METHODS

Newly enrolled undergraduate medical students (n = 358) filled out the following instruments: Multidimensional Perfectionism Scale (MPS-H), Multidimensional Perfectionism Scale (MPS-F), Big Five Inventory (BFI-10), General Self-Efficacy Scale (GSE), Patient Health Questionnaire 9 (PHQ-9), and Generalized Anxiety Disorder 7 (GAD-7). Sociodemographic data such as age, gender, high school degrees, and the way of admission to medical school were also included in the questionnaire.

RESULTS

The 298 participating students had significantly lower scores in Socially-Prescribed Perfectionism than the general population independently of their way of admission to medical school. Students who were selected for medical school by their high school degree showed the highest score for Adaptive Perfectionism. Maladaptive Perfectionism was the strongest predictor for the occurrence symptoms of depression and anxiety regardless of the way of admission.

CONCLUSIONS

Students from all admission groups should be observed longitudinally for performance and to assess whether perfectionism questionnaires might be an additional useful instrument for medical school admission processes.

Personality and achievement along medical training: Evidence from a cross-lagged analysis

INTRODUCTION

Evidence on personality traits change implies it should be studied as an outcome and not only as an explanatory effect. Therefore, we aimed to assess how personality and academic achievement sway each other. Three cohorts of medical students (n = 181) comprised of school leavers and graduates, completed NEO-FFI when admitted (baseline) and later on medical training (follow-up). Previous achievement was measured as mean scores on national school examinations, and academic achievement as medical course average. Causal relations were studied by cross-lagged analysis.

RESULTS

Cross-sectional analysis at baseline showed differences between graduates and school leavers on personality, with graduates scoring lower on neuroticism (β = -12.344, p<0.001), and higher on openness to experience (β = 5.257, p<0.001), conscientiousness (β = 2.345, p = 0.004,) and agreeableness (β = 6.993, p<0.001). Longitudinal analyses indicated that personality traits and achievement tracked over time. Cross-lagged analysis found a positive significant association between academic achievement and neuroticism at baseline (β = 0.031, p = 0.014) and with being a graduate student (β = 0.766, p = 0.006). After adjusting, no association was found between previous achievement and personality at follow-up.

CONCLUSIONS

Some neuroticism may enhance medical academic achievement. The blurring of the initial differences between graduates and school leavers suggests a reasonable possibility of personality traits change along the medical course. Future research on medical selection processes cannot afford to ignore the influence of the medical school environment on personality traits change.

A multi-site study on medical school selection, performance, motivation and engagement

Medical schools seek ways to improve their admissions strategies, since the available methods prove to be suboptimal for selecting the best and most motivated students. In this multi-site cross-sectional questionnaire study, we examined the value of (different) selection procedures compared to a weighted lottery procedure, which includes direct admission based on top pre-university grade point averages (≥8 out of 10; top-pu-GPA). We also considered whether students had participated in selection, prior to being admitted through weighted lottery. Year-1 (pre-clinical) and Year-4 (clinical) students completed standard validated questionnaires measuring quality of motivation (Academic Self-regulation Questionnaire), strength of motivation (Strength of Motivation for Medical School-Revised) and engagement (Utrecht Work Engagement Scale-Student). Performance data comprised GPA and course credits in Year-1 and clerkship performance in Year-4. Regression analyses were performed. The response rate was 35% (387 Year-1 and 273 Year-4 students). Top-pu-GPA students outperformed selected students. Selected Year-1 students reported higher strength of motivation than top-pu-GPA students. Selected students did not outperform or show better quality of motivation and engagement than lottery-admitted students. Participation in selection was associated with higher engagement and better clerkship performance in Year-4. GPA, course credits and strength of motivation in Year-1 differed between students admitted through different selection procedures. Top-pu-GPA students perform best in the medical study. The few and small differences found raise questions about the added value of an extensive selection procedure compared to a weighted lottery procedure. Findings have to be interpreted with caution because of a low response rate and small group sizes.

Participation and selection effects of a voluntary selection process

Many different medical school selection processes are used worldwide. In this paper, we examine the effect of (1) participation, and (2) selection in a voluntary selection process on study performance. We included data from two cohorts of medical students admitted to Erasmus MC, Rotterdam and VUmc, Amsterdam, The Netherlands and compared them to previously published data from Groningen medical school, The Netherlands. All included students were admitted based on either (1) a top pre-university grade point average, or (2) a voluntary selection process, or (3) weighted lottery. We distinguished between lottery-admitted students who had participated in the voluntary selection process and had been rejected, and lottery-admitted students who had not participated. Knowledge test scores, study progress, and professionalism scores were examined using ANCOVA modelling, logistic regression, and Bonferroni post hoc multiple-comparison tests, controlling for gender and cohort. For written test grades, results showed a participation effect at Groningen medical school and Erasmus MC (p < 0.001), and a selection effect at VUmc (p < 0.05). For obtained course credits, results showed a participation effect at all universities (p < 0.01) and a selection effect at Groningen medical school (p < 0.005). At Groningen medical school, a participation effect seemed apparent in on time first-year completion (p < 0.05). Earlier reported selection and participation effects in professionalism scores at Groningen medical school were not apparent at VUmc. Top pre-university students performed well on all outcome measures. For both the participation effect and the selection effect, results differed between universities. Institutional differences in curricula and in the design of the selection process seem to mediate relations between the different admissions processes and performance. Further research is needed for a deeper understanding of the influence of institutional differences on selection outcomes.