Selection and academic success of medical students in Hamburg, Germany

[Integration of natural sciences and basic medical subjects in the integrated dentistry program (iMED DENT) at the University of Hamburg]

In October 2019, an integrated dentistry program (iMED DENT) was implemented at the University of Hamburg and was the first of its kind in Germany. This model curriculum builds on didactic concepts that have been applied successfully for many years in curricula for human medicine, including interdisciplinary teaching, early clinical experience, and scientific education. The first year focuses on the healthy situation ("normal function") and aims to integrate the natural sciences (biology, chemistry, physics) and the basic medical subjects (anatomy, biochemistry, physiology, medical terminology) in the context of dental health. Further, basic practical and clinical tasks are assigned to the students during the first year.From the experience of the first four cohorts, initial conclusions can be drawn about this stage of study. Generally, its modular structure results in a condensation of learning content, which students judge as demanding. However, its interdisciplinary approach is well accepted. For instance, presenting the basics of the natural sciences in the context of their dental relevance is much better evaluated in the new compared to the previous curriculum, in which this content was taught without specific references to dental health. Teaching the basics of medicine within clinical context and the inclusion of early clinical practice are similarly appreciated. Presently, the interdisciplinary approach is limited by the focus on practical competencies of the dentistry curriculum, as some practical courses offer only few opportunities for other disciplines to interconnect their teaching. The continuous evaluation of the curriculum and exchange of experiences between the disciplines will further improve the integrative concept of the curriculum.

German Physicians and Medical Students Do Not Represent the Population They Serve

Medical professionals who represent the communities they serve are in a better position to understand patients' social circumstances and communicate in a more patient-centered way. International studies show limited diversity and underrepresentation of certain social groups in the population of physicians and medical students. We designed an observational study to investigate the cultural and socio-economic diversity of physicians and medical applicants in comparison to the general population in Germany. We invited 15,195 physicians in Hamburg and 11,287 medical applicants in Germany to participate in an online survey between June and August 2022. The lower three quintiles of objective socio-economic background (SEB) were vastly underrepresented in all subsamples of the study and in particular amongst applicants and students admitted in Hamburg: 57.9% of physicians and 73.8% of medical students in Hamburg originate from the top quintile of SEB. The Turkish and Polish communities were particularly underrepresented in the group of physicians from Hamburg and medical applicants and students in Germany (p = 0.02; p < 0.001). In line with existing evidence, the vast majority of physicians and medical students come from the most affluent households when entering medical school. Widening participation strategies are needed to facilitate fairer access to the study of medicine in Germany.

Exploring the relationships between first impressions and MMI ratings: a pilot study

The phenomenon of first impression is well researched in social psychology, but less so in the study of OSCEs and the multiple mini interview (MMI). To explore its bearing on the MMI method we included a rating of first impression in the MMI for student selection executed 2012 at the University Medical Center Hamburg-Eppendorf, Germany (196 applicants, 26 pairs of raters) and analyzed how it was related to MMI performance ratings made by (a) the same rater, and (b) a different rater. First impression was assessed immediately after an applicant entered the test room. Each MMI-task took 5 min and was rated subsequently. Internal consistency was α = .71 for first impression and α = .69 for MMI performance. First impression and MMI performance correlated by r = .49. Both measures weakly predicted performance in two OSCEs for communication skills, assessed 18 months later. MMI performance did not increment prediction above the contribution of first impression and vice versa. Prediction was independent of whether or not the rater who rated first impression also rated MMI performance. The correlation between first impression and MMI-performance is in line with the results of corresponding social psychological studies, showing that judgements based on minimal information moderately predict behavioral measures. It is also in accordance with the notion that raters often blend their specific assessment task outlined in MMI-instructions with the self-imposed question of whether a candidate would fit the role of a medical doctor.

Admission criteria and academic performance in medical school

BACKGROUND

Different variables have been used to predict the academic performance of students in medical schools. The aim of this study was to assess the effect of demographics, admission system, and high-school background on the academic performance of medical students.

METHODS

We conducted this longitudinal cohort study on 808 students admitted to the Faculty of. Medicine at the University of Jordan (Amman, Jordan), in the years 2012 and 2013. Admission pathway, and academic performance data were collected and analyzed.

RESULTS

A total of 808 students [i.e., 426 (52.7%) females, and 382(47.3%) males] were identified. Admitted students were holding 17 different types of high school degrees, and were accepted through 6 different quota pathways (open competition [National unified admission], underprivileged ["Makrumah"], parallel, children of university staff, international students, and others). Students admitted through the open competition and the underprivileged quota(Makrumah) were more likely to graduate on time and had higher graduation grades while students admitted through the parallel, international and others quota were more likely to fail and had lower graduation grades. Regarding highs school degrees, the students that were more likely to graduate were those with IB and the Jordanian high school degrees. The highest graduation GPA was for IB students followed by SAT, IGCSE as well as Jordanian and Syrian high school degrees respectively. IB, Jordanian, Kuwaiti and IGSC high school grades were significantly correlated with the graduation GPA.

CONCLUSIONS

Admission criteria such as type of high school degree and grades as well as admission pathways can predict the likelihood to graduate and the graduation GPA of medical students. Open competition and underprivileged admission pathways as well as IB, IGCSE and Jordanian high school degrees seem to be better predictors of student performance in the medical school.

Clinical experience can compensate for inferior academic achievements in an undergraduate objective structured clinical examination

BACKGROUND

Practical and non-cognitive skills are essential to medical professions; yet, success in medical studies is primarily assessed with cognitive criteria. We show that practical exams can benefit students who have only average high school final grades, but working experience in medical professions.

METHODS

With a cross-sectional study, we compare the performance of undergraduate medical students with working experience in adjacent health-care professions (and below-average school leaving-grades) with students who entered medical school directly based on their excellent school records in an Objective Structured Clinical Examination (OSCE). For a sample of more than 1,200 students, we use information on OSCE scores in medical and practical skills, doctor-patient communication/interaction, performance in MC-exams, and core sociodemographic variables.

RESULTS

Waiting list students outperformed their classmates in the demonstration of practical skills. Students admitted via their excellent school grades scored best overall. This difference vanishes once we control for school-leaving grade and age, the two main factors separating the analysed groups. Students from the waiting list have a significantly smaller overall chance to reach excellent grades in the first two years of study.

CONCLUSIONS

Students who gathered experiences in health-care professions before enrolling at medical school can benefit from an expanded role of practical elements in medical studies. Student selection instruments should take these different starting positions and qualities of applicants into account, for example with a quota for the professionally experienced.

Admission Grades as Predictors of Medical Students’ Academic Performance: A Cross-Sectional Study from Saudi Arabia

Background: Admission to medical school is competitive, and different countries use various tests in addition to high school grades to minimize selection bias. A few studies have been conducted to evaluate the usefulness of these tests as predictors for students’ academic performance. In this article, we aimed to assess factors that influenced students’ grades in medical school. Methods: A cross-sectional study included all students who graduated from the Faculty of Medicine at Jazan University between 2018 and 2020. Scores of the included participants were extracted from the registry of Jazan University, and additional questions about study habits were completed by the included students. Descriptive, univariate, and multivariate analyses were performed for the factors that impacted academic performance. Results: There were 331 included candidates, and the majority of them were female (53%). About 60% of the participants were medical residents at the time of the study, and 40% were interns. Univariate and multivariate analyses indicated that grades in high school and the pre-requisite tests were positively associated with students’ academic performance. Further, studying more than two hours per day was positively correlated with better grades in medical school. Conclusion: Scores of the admission tests can serve as predictors for student performance in medical school. National studies are deemed essential to evaluate additional admission tests for medical school, an action that would minimize selection bias.

Considering vocational training as selection criterion for medical students: evidence for predictive validity

Prior work experience in a relevant medical profession is an important admission criterion currently used at many German medical schools in addition to cognitive criteria. In other countries, work experience is often considered in later admission stages (e.g., interviews with pre-selected subgroups of applicants). However, evidence for its predictive validity for study success in addition to cognitive admission criteria is currently lacking. We therefore assessed whether completed vocational training in a relevant medical profession can predict study performance in the first two years of study in addition to cognitive admission criteria. Admission and study performance data of all currently enrolled medical students at two German medical schools (Göttingen and Heidelberg) beginning with the 2013/14 cohort were retrospectively analyzed. Cognitive admission criteria in our sample were GPA grades and a cognitive test ("Test für Medizinische Studiengänge", TMS). We defined the study outcome parameter as the mean percentile rank over all performance data points over the first two years of study for each location, respectively. A multi-level model with varying intercepts by location, GPA, TMS, vocational training, and sex as predictors accounted for 14.5% of the variance in study outcome. A positive predictive association with study outcome was found for vocational training (ß = 0.33, p = .008) beyond GPA (ß = 0.38, p < .001) and TMS (ß = 0.26, p < .001). Our results support the use of prior vocational training as a selection criterion for medical studies potentially adding predictive validity to cognitive criteria.

Can selection interviews predict OSCE performance? Evidence from Hannover Medical School

OBJECTIVES

We analyze whether the student selection process at Hannover Medical School (MHH), which combined a semi-structured interview with school leaving grades, can predict performances in an Objective Structured Clinical Examination (OSCE). We also check whether there are differences between assessments of clinical knowledge, practical skills, and communication abilities.

METHODS

We use data from 525 medical students who were admitted after a successful selection process and who completed the OSCE in the years 2015-2019. We employ multivariate regressions and a mediation analysis approach to learn whether study success after admission and prior to the OSCE mediates the outcome of the latter.

RESULTS

A better performance in the MHH's selection interview is unrelated to success in the OSCE. However, there is a small but significant influence of school grades on OSCE results in each part except for the assessment of communication skills. The impact of the school grade is partially mediated by performances in written and oral exams preceding the OSCE.

DISCUSSION

School grades matter for the OSCE outcome, albeit to different degrees for more learning-based vs. practical parts of the examination. The interview at MHH was purely informative and unrelated to study success, also in the assessment of communication skills. Better structured interview tools may yield better results.

CONCLUSION

Students' cognitive abilities predict study success in an undergraduate OSCE. Performances in a semi-structured selection interview have no impact, not even the assessment of communication skills.

International medical students' perspectives on factors affecting their academic success in China: a qualitative study

BACKGROUND

The number of international students who choose China as their destination for quality medical education is rising, particularly those from developing countries, but little is known about their adaptation and educational experiences at Chinese universities. This study explored the factors that these students perceived to have influenced their academic success.

METHODS

Semi-structured interviews were conducted with international students (N = 40) from developing countries from September 2020 to January 2021. Participants were graduates or in their second, third, fourth, fifth, or sixth academic year in two university medical schools. Interviews were audio-recorded, transcribed, and analyzed using a thematic analysis approach.

RESULTS

The participants chose China to study medicine based on cost, teaching resources, quality of medical education, recommendation, and safety factors. They considered an increase in medical knowledge, clinical skills and communication skills as an indicator of academic success. Positive factors affecting academic success were the support system (family, friends, seniors) and campus resources (library, laboratories, extra-curricular activities, scholarship). Negative factors were (i) issues affecting learning (English language barrier), adjusting to the medical education system in China, learning difficulties, failing exams, internship difficulties, problems with online learning during the pandemic, (ii) sociocultural issues (lacking knowledge of the Chinese language, challenges in daily life, perceived discrimination, interpersonal relationships), (iii) wellbeing issues (physical and mental health issues), and (iv) other challenges (climate, food, finance, scholarship). The influence of teachers, administrators and classmates was perceived as both positive and negative.

CONCLUSIONS

Factors affecting the academic success of international medical students at Chinese universities are multi-faceted. It is the collective responsibility of the host society, universities, teachers, administrators, classmates, families, and students themselves to address these factors in order to support and help students achieve academic success. Findings in our study support recommendations to improve teachers' English language skills and pedagogy and to invest in administrators' professional development. They also suggest that greater awareness of students' sociocultural and mental challenges and optimizing the positive influence of classmates could strengthen student support and better address student academic difficulties. The English proficiency and prior academic performance of international students should be considered during recruitment. Given the rapid growth in international MBBS programs in China, further research on the experiences of international students in China's medical programs is needed.

You Can Play the Game Without Knowing the Rules – But You’re Better Off Knowing Them

Abstract. Due to their high item difficulties and excellent psychometric properties, construction-based figural matrices tasks are of particular interest when it comes to high-stakes testing. An important prerequisite is that test preparation – which is likely to occur in this context – does not impair test fairness or item properties. The goal of this study was to provide initial evidence concerning the influence of test preparation. We administered test items to a sample of N = 882 participants divided into two groups, but only one group was given information about the rules employed in the test items. The probability of solving the items was significantly higher in the test preparation group than in the control group ( M = 0.61, SD = 0.19 vs. M = 0.41, SD = 0.25; t(54) = 3.42, p = .001; d = .92). Nevertheless, a multigroup confirmatory factor analysis, as well as a differential item functioning analysis, indicated no differences between the item properties in the two groups. The results suggest that construction-based figural matrices are suitable in the context of high-stakes testing when all participants are provided with test preparation material so that test fairness is ensured.

Reliability and validity of new online selection tests for midwifery students

BACKGROUND AND OBJECTIVE

Newly created midwifery bachelor programmes attract an increasing number of applicants. Hence, educators have moved away from traditional non-standardised selection methods and started developing new tools for the admission of students. Researchers have expressed concerns around the validity of such selection measures and their ability to identify the appropriate candidates. The objective of this study was to develop and implement selection procedures for a new midwifery Bachelor of Science degree in Hamburg, Germany, and assess their psychometric properties.

DESIGN

This is a mixed-methods longitudinal study on the reliability, validity and acceptability of newly developed selection criteria.

SETTING

The newly established midwifery bachelor of science in Hamburg, Germany.

PARTICIPANTS

Upon completion of their online application, all midwifery applicants were invited by email to participate in our research project and thereby informed of its purpose and voluntary nature of their participation. The total number of candidates who took the test was 366, of which 309 agreed to take part in this study. Sixty-five applicants were eventually admitted to the midwifery Bachelor programme, of which 59 were included in the study.

MEASUREMENTS AND FINDINGS

We developed two tests for cognitive ability (HAM-Mid I and II) and adapted one test for personal and professional characteristics (Casper - Computer-based Assessment for Sampling Personal Characteristics). Due to the Covid pandemic, we implemented the tests online instead of on site as initially planned. HAM-Mid I had the lowest (Cronbach's Alpha = 0.38) whereas Casper had the highest internal consistency (Cronbach's Alpha = 0.77) of all three tests. Age, previous academic achievement and native tongue were significantly associated with applicants' performance on HAM-Mid II and Casper admission tests. HAM-Mid II was associated with students' performance in the first year midwifery exam (r = 0.31, p < 0.05). Overall evaluation of HAM-Mid II and Casper was good while HAM-Mid I received a more negative feedback.

KEY CONCLUSIONS

Evidence on the reliability and predictive validity of the newly developed tests suggests that the applied admission criteria are appropriate for an objective selection of bachelor midwifery students.

IMPLICATIONS FOR PRACTICE

The interests of university and clinical stakeholders of a midwifery bachelor degree can be represented through the development of tests for the assessment of cognitive ability and personal and professional characteristics.

What do Final Year Medical Students in Germany know and think about Climate Change? - The ClimAttitude Study

Climate change (CC) is adversely affecting human health and will become far more dangerous in the future, if no substantial measures are taken. Young people in particular are taking an energetic stand for CC awareness. Some CC experts argue that medical doctors are especially well positioned to inform about the impact of CC on public health, as it is well established that they are among the most trusted members of society. However, medical doctors seem to be unsure of their role in addressing CC. This study aimed to investigate future doctors´, i.e., final year medical students´ (FYMS), attitudes towards CC and their personal role in CC education and health care. A questionnaire was developed to examine (1) the expected consequences of CC for FYMS, (2) their perceived individual responsibility, and their attitudes towards an additional (3) professional responsibility. To examine the climate-questionnaire's component correlations, we ran a factor analysis using oblique (promax) rotation and conducted a one-way ANOVA with repeated measures to compare the mean scores of the factors. Data are presented as mean ± SD or percentage, as appropriate. n = 65 FYMS (response rate: 87%) were participating and all of them completed the questionnaire. Items of the factor professional responsibility showed the lowest level of agreement (47.2 ± 21.2), while the 2 other factors showed higher levels of agreement (expected consequences (75.6 ± 18.4), individual responsibility (75.1 ± 20.6). Future doctors at Heidelberg University Hospital are well-informed about the expected health consequences of CC. They recognize human contributions to CC and make personal decisions to mitigate the impact. However, the opinion that they have a professional responsibility as physicians to patients or society in regard to CC is weaker. Specific teaching could help to change the way future doctors see their role and responsibility in tackling CC.

[Selection interviews at Hanover Medical School (MHH): determinants of student selection in medical studies]

INTRODUCTION

In order to incorporate social and communicative skills in its student admissions process, Hanover Medical School (MHH) has conducted selection interviews (in combination with the high-school GPA) to choose 60 % of its freshmen in medical studies. The present article analyses if applicants' performances in the interviews were the determining criterion of student selection, despite a higher weighting of school grades in the admission process. Furthermore, this article checks whether the grading of the interviews was independent of the applicants' gender, age, origin and educational background.

METHODS

For a sample of more than 3,000 successful and unsuccessful participants in the MHH student admission process in the years 2010-2017, we employ variance analysis and logistic regression analysis to determine those factors that have contributed to the chances of being offered a place at the MHH after a successful interview.

RESULTS

The scores received in the selection interview were the sole determinant of being offered a place at the MHH; neither the applicants'age nor their gender or origin biased the decisions of the selection committees. The grading of the interview was also not affected by school GPAs.

DISCUSSION

The selection interviews at the MHH have been costly in terms of both financial and human resources. However, this selection method has been popular among students and lecturers alike, not least because its elements fit the MHH's focus on early bedside teaching and social skills of prospective physicians. However, there is no evidence that selection interviews are effective in predicting academic success.

CONCLUSIONS

The present article has shown that the selection interviews acted up to the principles defined by the MHH: very homogenous high school GPAs were complemented by differentiated interview assessments that did not discriminate by sociodemographic characteristics. It is, however, unclear if the MHH will resume the interviews after the end of a federally mandated halt to stand-alone selection methods at medical schools in Germany.

Are different medical school admission tests associated with the outcomes of a simulation-based OSCE?

BACKGROUND

Medical school admission procedures have the common goal to select applicants with the greatest potential of becoming successful physicians. Hamburg Medical Faculty selects medical students by grade point average (GPA) and employs a two-step selection process of a natural sciences test (HAM-Nat), in some cases followed by multiple mini-interviews (HAM-Int). Multiple mini-interviews can predict non-cognitive outcomes, while GPA has predictive validity for cognitive outcomes. The aim of our study was to explore communication skills and clinical knowledge of advanced medical students according to their respective admission procedure.

METHODS

In July 2019, 146 students grouped according to their admission procedure into GPA-only (19.2 %), HAM-Nat (33.6 %), HAM-Int (30.8 %), and Waiting List (16.4 %) participated in four OSCE stations which equally assessed students' communication skills (OSCE part 1) and clinical knowledge (OSCE part 2) in simulated patient encounters, rated by physicians with checklists. Additionally, psychosocial assessors ranked communication skills with a global rating scale (GR). The students also participated in a multiple choice (MC) exam testing clinical knowledge. Kruskal-Wallis analyses of variance of test performance and Spearman correlation of instruments were calculated.

RESULTS

Students from the Waiting List group performed significantly worse on the MC exam compared to GPA-only and HAM-Int (adjusted p = .029 and 0.018, respectively). No significant differences were found between the admission groups with respect to communication skills. Global Rating and OSCE part 1 (communication) correlated significantly (ρ = 0.228, p = .006) as did OSCE part 2 (clinical knowledge) and MC exam (ρ = 0.242, p = .003), indicating criterion validity. Constructs did not overlap, indicating divergent validity.

CONCLUSIONS

Advanced medical students selected for undergraduate studies by multiple mini-interviews assessing psychosocial skills showed similar communication skills compared to students admitted to medical school by other entryways. It is unclear whether these similarities are due to an effective undergraduate longitudinal communication curriculum. Assessing baseline communication skills of all medical students at entry-level may aid with this question.

University Admission Test Associates with Academic Performance at the End of Medical Course in a PBL Medical Hybrid Curriculum

PURPOSE

Most studies assessing the value of the university admissions test (UAT) to predict academic performance at the end of a medical course were carried out on lecture-based medical courses. However, the association between performance in the UAT with academic achievement at the end of medical course in a problem-based learning (PBL) medical hybrid curriculum remains controversial. The aim of this study was to correlate marks in the UAT with those obtained in the Organized Structured Clinical Examination (OSCE), in the progress testing (PT), and in the final marks of the clerkship (FMC).

METHODS

We used data from 48 medical students. A single and a multiple dependency studies were performed to assess bivariate and multiple correlation between the UAT or the essay scores (dependent variables) and the OSCE, PT, and FMC (independent variables). Pearson test, multiple linear regression, and ANOVA tests were used and a p-value < 0.05 was considered significant.

RESULTS

In the bivariate analysis, only the UAT and FMC marks were correlated (r=0.34; p=0.02). However, the multiple dependency study showed a moderate correlation among UAT, OSCE, PT, and FMC marks (r=0.46; p=0.01). No correlation was found between the essay scores and PT, FMC, and OSCE scores.

CONCLUSION

Our study shows that UAT marks, but not essay scores, can predict academic achievement, particularly in terms of clinical competence (FMC) at the end of a medical course in a PBL hybrid curriculum.

Exam performance of different admission quotas in the first part of the state examination in medicine: a cross-sectional study

BACKGROUND

Most medical students in Germany are admitted via selection procedures, which are adjusted to the demands of the universities. At Lübeck medical school, scores from interviews that measure non-academic skills and pre-university GPAs are summed to arrive at an admission decision. This article seeks to illuminate the effectiveness of this selection procedure in comparison to other non-selected student groups.

METHODS

Quota information and exam results from the first federal exam were linked for students admitted to Lübeck medical school between 2012 and 2015 (N = 655). Five different student groups (university-specific selection quota, pre-university GPA quota, waiting time quota, ex-ante quota and foreign students) were compared regarding exam attempts, written and oral grades, temporal continuity and examination success in the standard study period.

RESULTS

While the pre-university GPA quota outperformed all other quotas regarding written and oral grades, it did not differ from the selection quota regarding exam attempts, temporal continuity and examination success in the standard study period. Students in the waiting time and ex-ante quotas performed inferior by comparison. The results of foreign students were the most problematic.

CONCLUSION

Students selected by the university show high temporal continuity and examination success. These results, and possible advantages in physician eligibility, argue for the utilisation of non-academic skills for admission.

Exploring sociodemographic subgroup differences in multiple mini-interview (MMI) performance based on MMI station type and the implications for the predictive fairness of the Hamburg MMI

BACKGROUND

Sociodemographic subgroup differences in multiple mini-interview (MMI) performance have been extensively studied within the MMI research literature, but heterogeneous findings demand a closer look at how specific aspects of MMI design (such as station type) affect these differences. So far, it has not been investigated whether sociodemographic subgroup differences imply that an MMI is biased, particularly in terms of its predictive validity.

METHODS

Between 2010 and 2017, the University Medical Centre Hamburg-Eppendorf (UKE) tested 1438 candidates in an MMI who also provided sociodemographic data and agreed to participate in this study. Out of these, 400 candidates were admitted and underwent a first objective structured clinical examination (OSCE) after one and a half years, including one station assessing communication skills. First, we analyzed the relationship between gender, age, native language and medical family background and MMI station performance including interaction terms with MMI station type (simulation, interview, and group) in a hierarchical linear model. Second, we tested whether the prediction of OSCE overall and communication station performance in particular differed depending on sociodemographic background by adding interaction terms between MMI performance and gender, age and medical family background in a linear regression model.

RESULTS

Young female candidates performed better than young male candidates both at interview and simulation stations. The gender difference was smaller (simulation) or non-significant (interview) in older candidates. There were no gender or age effects in MMI group station performance. All effects were very small, with the overall model explaining only 0.6% of the variance. MMI performance was not related to OSCE overall performance but significantly predicted OSCE communication station performance with no differences in the prediction for sociodemographic subgroups.

CONCLUSIONS

The Hamburg MMI is fair in its prediction of OSCE communication scores. Differences in MMI station performance for gender and age and their interaction with MMI station type can be related to the dimensions assessed at different station types and thus support the validity of the MMI. Rather than being threats to fairness, these differences could be useful for decisions relating to the design and use of an MMI.