1
|
Tsikas SA, Dauer K. Examining interviewer bias in medical school admissions: The interplay between applicant and interviewer gender and its effects on interview outcomes. PLoS One 2024; 19:e0309293. [PMID: 39186521 PMCID: PMC11346660 DOI: 10.1371/journal.pone.0309293] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Accepted: 08/09/2024] [Indexed: 08/28/2024] Open
Abstract
Selection interviews have long been integral to medical school admissions, yet their limited predictive validity and susceptibility to bias raise concerns. This study delves into potential interviewer bias within the dynamics of interviewee and interviewer gender. We analyze a dataset of 5,200 applicants and over 370 selection committees engaged in semi-structured interviews from 2006 to 2019 at a large German medical school with multiple linear and non-linear regression analyses. Our findings reveal that all-female committees tended to award male candidates, on average, one point more than their female counterparts, significantly enhancing the chances of submission for male applicants despite lower academic grades, which constituted 51% of the selection process points. All-male and mixed-gender committees exhibited similar ratings for both genders. The role of valuing voluntary services emerged prominently: all-male and mixed committees acknowledged women's volunteer work but not men's, while all-female committees demonstrated the opposite pattern. Our results attribute variations in interview outcomes to the absence of standardization, such as insufficient interviewer training, divergent rating strategies, variations in interviewer experience, and imbalances in candidate allocation to selection committees, rather than to a "gender bias", for example by favoritism of males because of their gender.
Collapse
Affiliation(s)
- Stefanos A. Tsikas
- Dean of Studies Office, Academic Controlling, Hannover Medical School, Hannover, Lower Saxony, Germany
| | - Karina Dauer
- Dean of Studies Office, Academic Controlling, Hannover Medical School, Hannover, Lower Saxony, Germany
| |
Collapse
|
2
|
Fleck L, Amelung D, Fuchs A, Mayer B, Escher M, Listunova L, Schultz JH, Möltner A, Schütte C, Wittenberg T, Schneider I, Herpertz SC. Interactional competencies in medical student admission- what makes a "good medical doctor"? ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2024:10.1007/s10459-024-10348-w. [PMID: 39008161 DOI: 10.1007/s10459-024-10348-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Accepted: 06/02/2024] [Indexed: 07/16/2024]
Abstract
Doctors' interactional competencies play a crucial role in patient satisfaction, well-being, and compliance. Accordingly, it is in medical schools' interest to select candidates with strong interactional abilities. While Multiple Mini Interviews (MMIs) provide a useful context to assess such abilities, the evaluation of candidate performance during MMIs is not always based on a solid theoretical framework. The newly developed selection procedure "Interactional Competencies - Medical Doctors (IC-MD)" uses an MMI circuit with five simulation patient scenarios and is rated based on the theoretically and empirically grounded construct of emotional availability. A first validation study with N = 70 first-semester medical students took place in 2021. In terms of convergent validity, IC-MD ratings showed strong correlations with simulation patients' satisfaction with the encounter (r =.57) but no association with emotional intelligence measures. IC-MD ratings were not related to high school performance or a cognitive student aptitude test, indicating divergent validity. Inter-rater reliability (ICC = 0.63) and generalizability (Eρ2 = 0.64) were satisfactory. The IC-MD proved to be fair regarding participants' age and gender. Participants with prior work experience in healthcare outperformed those without such experience. Participant acceptance of the procedure were good. The IC-MD is a promising selection procedure capable of assessing interactional competencies relevant to the medical setting. Measures of interactional competencies can complement the use of cognitive selection criteria in medical student admission. The predictive validity of the IC-MD needs to be addressed in future studies.
Collapse
Affiliation(s)
- Leonie Fleck
- Medical Faculty, Heidelberg University, Heidelberg, Germany
- Central Institute of Mental Health, Mannheim, Germany
| | | | - Anna Fuchs
- Department of Child & Adolescent Psychiatry, University of Heidelberg, Heidelberg, Germany
| | - Benjamin Mayer
- Medical Faculty, Heidelberg University, Heidelberg, Germany
| | - Malvin Escher
- Medical Faculty, Heidelberg University, Heidelberg, Germany
| | - Lena Listunova
- Medical Faculty, Heidelberg University, Heidelberg, Germany
| | - Jobst-Hendrik Schultz
- Department of General Internal Medicine and Psychosomatics, University of Heidelberg, Heidelberg, Germany
| | | | - Clara Schütte
- Medical Faculty, Heidelberg University, Heidelberg, Germany
| | - Tim Wittenberg
- Medical Faculty, Heidelberg University, Heidelberg, Germany
| | - Isabella Schneider
- Department of General Psychiatry, Heidelberg University Hospital, Voßstraße 4, 69115, Heidelberg, Germany.
| | - Sabine C Herpertz
- Medical Faculty, Heidelberg University, Heidelberg, Germany
- Department of General Psychiatry, Heidelberg University Hospital, Voßstraße 4, 69115, Heidelberg, Germany
| |
Collapse
|
3
|
Knorr M, Mielke I, Amelung D, Safari M, Gröne OR, Breil SM, MacIntosh A. Measuring personal characteristics in applicants to German medical schools: Piloting an online Situational Judgement Test with an open-ended response format. GMS JOURNAL FOR MEDICAL EDUCATION 2024; 41:Doc30. [PMID: 39131892 PMCID: PMC11310783 DOI: 10.3205/zma001685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Figures] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Revised: 03/19/2024] [Accepted: 04/17/2024] [Indexed: 08/13/2024]
Abstract
Objectives Situational Judgement Tests (SJT) are a cost-efficient method for the assessment of personal characteristics (e.g., empathy, professionalism, ethical thinking) in medical school admission. Recently, complex open-ended response format SJTs have become more feasible to conduct. However, research on their applicability to a German context is missing. This pilot study tests the acceptability, reliability, subgroup differences, and validity of an online SJT with open-ended response format developed in Canada ("Casper"). Methods German medical school applicants and students from Hamburg were invited to take Casper in 2020 and 2021. The test consisted of 12 video- and text-based scenarios, each followed by three open-ended questions. Participants subsequently evaluated their test experience in an online survey. Data on sociodemographic characteristics, other admission criteria (Abitur, TMS, HAM-Nat, HAM-SJT) and study success (OSCE) was available in a central research database (stav). Results The full sample consisted of 582 participants. Test-takers' global perception of Casper was positive. Internal consistency was satisfactory in both years (α=0.73; 0.82) while interrater agreement was moderate (ICC(1,2)=0.54). Participants who were female (d=0.37) or did not have a migration background (d=0.40) received higher scores. Casper scores correlated with HAM-SJT (r=.18) but not with OSCE communication stations performance. The test was also related to Abitur grades (r=-.15), the TMS (r=.18), and HAM-Nat logical reasoning scores (r=.23). Conclusion This study provides positive evidence for the acceptability, internal consistency, and convergent validity of Casper. The selection and training of raters as well as the scenario content require further observation and adjustments to a German context to improve interrater reliability and predictive validity.
Collapse
Affiliation(s)
- Mirjana Knorr
- University Medical Center Hamburg-Eppendorf, Arbeitsgruppe Auswahlverfahren, Hamburg, Germany
| | - Ina Mielke
- University Medical Center Hamburg-Eppendorf, Arbeitsgruppe Auswahlverfahren, Hamburg, Germany
| | | | | | - Oana R. Gröne
- University Medical Center Hamburg-Eppendorf, Arbeitsgruppe Auswahlverfahren, Hamburg, Germany
| | | | | |
Collapse
|
4
|
Can Different Admissions to Medical School Predict Performance of Non-Technical Skill Performance in Simulated Clinical Settings? Healthcare (Basel) 2022; 11:healthcare11010046. [PMID: 36611506 PMCID: PMC9818855 DOI: 10.3390/healthcare11010046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Revised: 12/13/2022] [Accepted: 12/22/2022] [Indexed: 12/28/2022] Open
Abstract
Non-technical skills (NTS) in medical care are essential to ensure patient safety. Focussing on applicants' NTS during medical school admission could be a promising approach to ensure that future physicians master NTS at a high level. Next to pre-university educational attainment, many selection tests have been developed worldwide to facilitate and standardise the selection process of medical students. The predictive validity of these tests regarding NTS performance in clinical settings has not been investigated (yet). Therefore, we explored the predictive validities and prognosis of the Hamburg MMI (HAM-Int), HAM-Nat, PEA, and waiting as well as other quota (as example) designated by the Federal Armed Forces) for NTS performance in clinical emergency medicine training of medical students. During 2017 and 2020, N = 729 second, third, and fourth year students were enrolled within the study. The mean age of participants was 26.68 years (SD 3.96) and 49% were female students. NTS of these students were assessed during simulation scenarios of emergency training with a validated rating tool. Students admitted via waiting quota and designated by the Armed Forces performed significantly better than students admitted by excellent PEA (p = 0.026). Non-EU students performed significantly inferior (p = 0.003). Our findings provide further insight to explain how and if admission to medical school could predict NTS performance of further physicians.
Collapse
|
5
|
Tsikas SA. Can selection interviews predict OSCE performance? Evidence from Hannover Medical School. ZEITSCHRIFT FUR EVIDENZ, FORTBILDUNG UND QUALITAT IM GESUNDHEITSWESEN 2022; 173:85-91. [PMID: 35773085 DOI: 10.1016/j.zefq.2022.05.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Revised: 05/16/2022] [Accepted: 05/19/2022] [Indexed: 06/15/2023]
Abstract
OBJECTIVES We analyze whether the student selection process at Hannover Medical School (MHH), which combined a semi-structured interview with school leaving grades, can predict performances in an Objective Structured Clinical Examination (OSCE). We also check whether there are differences between assessments of clinical knowledge, practical skills, and communication abilities. METHODS We use data from 525 medical students who were admitted after a successful selection process and who completed the OSCE in the years 2015-2019. We employ multivariate regressions and a mediation analysis approach to learn whether study success after admission and prior to the OSCE mediates the outcome of the latter. RESULTS A better performance in the MHH's selection interview is unrelated to success in the OSCE. However, there is a small but significant influence of school grades on OSCE results in each part except for the assessment of communication skills. The impact of the school grade is partially mediated by performances in written and oral exams preceding the OSCE. DISCUSSION School grades matter for the OSCE outcome, albeit to different degrees for more learning-based vs. practical parts of the examination. The interview at MHH was purely informative and unrelated to study success, also in the assessment of communication skills. Better structured interview tools may yield better results. CONCLUSION Students' cognitive abilities predict study success in an undergraduate OSCE. Performances in a semi-structured selection interview have no impact, not even the assessment of communication skills.
Collapse
|
6
|
Leduc JM, Béland S, Renaud JS, Bégin P, Gagnon R, Ouellet A, Bourdy C, Loye N. Are different station formats assessing different dimensions in multiple mini-interviews? Findings from the Canadian integrated French multiple mini-interviews. BMC MEDICAL EDUCATION 2022; 22:616. [PMID: 35962381 PMCID: PMC9375358 DOI: 10.1186/s12909-022-03681-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/19/2021] [Accepted: 08/05/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND Multiple mini-interviews (MMI) are used to assess non-academic attributes for selection in medicine and other healthcare professions. It remains unclear if different MMI station formats (discussions, role-plays, collaboration) assess different dimensions. METHODS Based on station formats of the 2018 and 2019 Integrated French MMI (IFMMI), which comprised five discussions, three role-plays and two collaboration stations, the authors performed confirmatory factor analysis (CFA) using the lavaan 0.6-5 R package and compared a one-factor solution to a three-factor solution for scores of the 2018 (n = 1438) and 2019 (n = 1440) cohorts of the IFMMI across three medical schools in Quebec, Canada. RESULTS The three-factor solution was retained, with discussions, role-plays and collaboration stations all loading adequately with their scores. Furthermore, all three factors had moderate-to-high covariance (range 0.44 to 0.64). The model fit was also excellent with a Comparative fit index (CFI) of 0.983 (good if > 0.9), a Tucker Lewis index of 0.976 (good if > 0.95), a Standardized Root Mean Square Residual of 0.021 (good if < .08) and a Root Mean Square Error of 0.023 (good if < 0.08) for 2018 and similar results for 2019. In comparison, the single factor solution presented a lower fit (CFI = 0.819, TLI = 0.767, SRMR = 0.049 and RMSEA = 0.070). CONCLUSIONS The IFMMI assessed three dimensions that were related to stations formats, a finding that was consistent across two cohorts. This suggests that different station formats may be assessing different skills, and has implications for the choice of appropriate reliability metrics and the interpretation of scores. Further studies should try to characterize the underlying constructs associated with each station format and look for differential predictive validity according to these formats.
Collapse
Affiliation(s)
- Jean-Michel Leduc
- Centre de recherche du Centre intégré universitaire de santé et de services sociaux du Nord-de-l’Île-de-Montréal, Hôpital du Sacré-Cœur de Montréal, 5400 boul. Gouin ouest, Montréal, QC H4J 1C5 Canada
- Department of Microbiology, Infectious Diseases and Immunology, Faculty of Medicine, Université de Montréal, 2900 boul. Edouard-Montpetit, Montréal, QC H3T 1J4 Canada
| | - Sébastien Béland
- Department of Education Administration and Foundations, Faculty of Education Sciences, Université de Montréal, 90, avenue Vincent-D’Indy, Montréal, QC H2V 2S9 Canada
| | - Jean-Sébastien Renaud
- Department of Family Medicine and Emergency Medicine, Office of Education and Professional Development, Faculty of Medicine, Université Laval, 1050 Avenue de la Médecine, Quebec, QC G1V 0A6 Canada
| | - Philippe Bégin
- Department of Medicine, Faculty of Medicine, Université de Montréal, 2900 boul. Edouard-Montpetit, Montréal, QC H3T 1J4 Canada
| | - Robert Gagnon
- Office of Assessment and Evaluation, Faculty of Medicine, Université de Montréal, 2900 boul. Edouard-Montpetit, Montréal, QC H3T 1J4 Canada
| | - Annie Ouellet
- Department of Obstetrics and Gynecology, Faculty of Medicine and Health Sciences, Université de Sherbrooke, 3001 12 Ave N Immeuble X1, Sherbrooke, QC J1H 5N4 Canada
| | - Christian Bourdy
- Department of Family Medicine and Emergency Medicine, Faculty of Medicine, Université de Montréal, 2900 boul. Edouard-Montpetit, Montréal, QC H3T 1J4 Canada
| | - Nathalie Loye
- Department of Education Administration and Foundations, Faculty of Education Sciences, Université de Montréal, 90, avenue Vincent-D’Indy, Montréal, QC H2V 2S9 Canada
| |
Collapse
|
7
|
Gröne O, Mielke I, Knorr M, Ehrhardt M, Bergelt C. Associations between communication OSCE performance and admission interviews in medical education. PATIENT EDUCATION AND COUNSELING 2022; 105:2270-2275. [PMID: 34801337 DOI: 10.1016/j.pec.2021.11.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Revised: 10/21/2021] [Accepted: 11/08/2021] [Indexed: 06/13/2023]
Abstract
OBJECTIVE To investigate associations between medical students' communication and other clinical skills assessed in OSCEs and MMIs performance upon admission by developing an assessment strategy based on an internationally acknowledged curriculum framework. METHODS Between July 2019 and March 2020, 365 medical students in the 4th and 5th semester took two OSCEs containing 10 5-minute stations examining communication and other clinical skills. We used a European conceptual framework to determine the content validity of the communication score and calculated scores of communication and other clinical skills. We assessed students' OSCE performance and estimated multiple regressions to predict its association with MMIs. RESULTS The multiple linear regressions showed that students' MMI performance upon admission is significantly associated with the communication score (b = 0.32, p = 0.006) but not the clinical score (b = 0.19, p = 0.121), when controlling for gender and cognitive criteria. CONCLUSIONS Our assessment strategy designed to distinguish between different areas of competence provides a more thorough description of the positive relationship between OSCE performance and MMIs. PRACTICE IMPLICATIONS We developed a communication skills assessment strategy that can be easily applied by medical schools that use OSCEs as a training or assessment method.
Collapse
Affiliation(s)
- Oana Gröne
- Institute of Biochemistry and Molecular Cell Biology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
| | - Ina Mielke
- Institute of Biochemistry and Molecular Cell Biology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Mirjana Knorr
- Institute of Biochemistry and Molecular Cell Biology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Maren Ehrhardt
- Institute of General Practice, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Corinna Bergelt
- Institute of Medical Psychology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
8
|
Breil SM, Forthmann B, Back MD. Measuring Distinct Social Skills via Multiple Speed Assessments. EUROPEAN JOURNAL OF PSYCHOLOGICAL ASSESSMENT 2022. [DOI: 10.1027/1015-5759/a000657] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
Abstract. Social skills (e.g., persuading others, showing compassion, staying calm) are of key importance in work and education settings. Accordingly, the goal of many selection processes is to identify candidates who excel in desired skills. For this, high-fidelity simulations such as assessment centers (ACs) are regarded as ideal procedures because they can be used to evoke, observe, and evaluate candidates’ actual behavior. However, research has repeatedly shown that observed performance differences in ACs are not sufficiently driven by the specific skill dimensions that are defined for assessment. Building on multiple speed assessments and incorporating insights from behavioral personality science, we offer an alternative approach for the reliable and valid assessment of distinct social skills. We hereby (a) selected skills on the basis of a bottom-up analysis of observable and distinguishable interpersonal behaviors and (b) specifically designed exercises around these skills (i.e., one skill per exercise, multiple exercises per skill). Here, we present the initial results of this newly developed procedure across three samples in a high-stakes selection context ( N = 589). Generalizability theory analyses showed that a substantial amount of variance in assessor ratings could be attributed to the selected skills. This underlines the importance of more behaviorally focused selection procedures.
Collapse
Affiliation(s)
- Simon M. Breil
- Department of Psychology, University of Münster, Germany
| | | | - Mitja D. Back
- Department of Psychology, University of Münster, Germany
| |
Collapse
|
9
|
Kötter T, Rose SI, Goetz K, Steinhäuser J. The predictive validity of admission criteria for the results of clinical competency assessment with an emphasis on family medicine in the fifth year of medical education: an observational study. BMC MEDICAL EDUCATION 2022; 22:269. [PMID: 35413869 PMCID: PMC9003966 DOI: 10.1186/s12909-022-03293-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/28/2021] [Accepted: 03/14/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND In many countries, the number of applicants to medical schools exceeds the number of available places. This offers the need, as well as the opportunity to medical schools to select those applicants most suitable for later work as a doctor. However, there is no generally accepted definition of a 'good doctor'. Clinical competencies may serve as surrogates. The aim of this study was to compare medical students in Germany selected based either on their pre-university grade point average alone or based on the result of a university-specific selection procedure regarding their clinical competencies with an emphasis on family medicine in the later years of training. METHODS We used the 'Allgemeinarztbarometer Ausbildung' (Undergraduate Family Medicine Barometer), an instrument developed to assess clinical competencies with an emphasis on family medicine, to compare students in the pre-university grade point average admission-quota and the university-specific selection procedure admission-quota in the fifth year of training. Students were judged by their supervising general practitioners after a two-week practical course. Competencies were rated on a five-point Likert-scale (1 = 'totally agree' i.e. the student is very competent to 5 = 'totally disagree' i.e. the student is not competent at all). RESULTS We included 94 students (66% female). Students in the university-specific selection procedure quota (n = 80) showed better mean scores in every item of the Undergraduate Family Medicine Barometer. We found a statistically significant difference between the two groups for the item assessing communication skills (M [university-specific selection procedure quota] = 1.81, SD = 0.84 vs. M [pu-GPA quota] = 2.38, SD = 0.96; t[91] = -2.23, p = .03; medium effect size). Logistic regression revealed no statistically significant age or gender contribution. CONCLUSIONS Despite the small sample-size, our results indicate, that students selected via an university-specific selection procedure show better communicative competencies in the later years of training.
Collapse
Affiliation(s)
- Thomas Kötter
- Institute of Family Medicine, University Medical Centre Schleswig-Holstein, Campus Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Institute of Social Medicine and Epidemiology, University Medical Centre Schleswig-Holstein, Campus Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Silvia Isabelle Rose
- Institute of Family Medicine, University Medical Centre Schleswig-Holstein, Campus Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Institute of Social Medicine and Epidemiology, University Medical Centre Schleswig-Holstein, Campus Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Katja Goetz
- Institute of Family Medicine, University Medical Centre Schleswig-Holstein, Campus Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Jost Steinhäuser
- Institute of Family Medicine, University Medical Centre Schleswig-Holstein, Campus Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| |
Collapse
|
10
|
Breil SM, Lievens F, Forthmann B, Back MD. Interpersonal behavior in assessment center role‐play exercises: investigating structure, consistency, and effectiveness. PERSONNEL PSYCHOLOGY 2022. [DOI: 10.1111/peps.12507] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
11
|
Abstract
BACKGROUND This article aims to describe the content and the psychometric properties of emotional intelligence instruments used in health care education and to examine the relationship between emotional intelligence and study success. METHOD Six electronic databases were searched in spring 2020. Two researchers participated in the selection and quality assessment of the articles. Ultimately, 26 articles were included in the review. RESULTS From the included articles, 18 emotional intelligence instruments were identified. The content of the instruments focused on perception of emotions, understanding of emotions, emotional expression, managing emotions, using emotions, and social awareness and relations. In most of the studies, emotional intelligence was related to study success. CONCLUSION The assessment of several important components of emotional intelligence was identified. Comprehensive assessment using the emotional intelligence total score seemed to be the best predictor of study success. [J Nurs Educ. 2022;61(1):6-11.].
Collapse
|
12
|
Bußenius L, Harendza S. Are different medical school admission tests associated with the outcomes of a simulation-based OSCE? BMC MEDICAL EDUCATION 2021; 21:263. [PMID: 33962606 PMCID: PMC8103591 DOI: 10.1186/s12909-021-02703-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Accepted: 04/29/2021] [Indexed: 06/12/2023]
Abstract
BACKGROUND Medical school admission procedures have the common goal to select applicants with the greatest potential of becoming successful physicians. Hamburg Medical Faculty selects medical students by grade point average (GPA) and employs a two-step selection process of a natural sciences test (HAM-Nat), in some cases followed by multiple mini-interviews (HAM-Int). Multiple mini-interviews can predict non-cognitive outcomes, while GPA has predictive validity for cognitive outcomes. The aim of our study was to explore communication skills and clinical knowledge of advanced medical students according to their respective admission procedure. METHODS In July 2019, 146 students grouped according to their admission procedure into GPA-only (19.2 %), HAM-Nat (33.6 %), HAM-Int (30.8 %), and Waiting List (16.4 %) participated in four OSCE stations which equally assessed students' communication skills (OSCE part 1) and clinical knowledge (OSCE part 2) in simulated patient encounters, rated by physicians with checklists. Additionally, psychosocial assessors ranked communication skills with a global rating scale (GR). The students also participated in a multiple choice (MC) exam testing clinical knowledge. Kruskal-Wallis analyses of variance of test performance and Spearman correlation of instruments were calculated. RESULTS Students from the Waiting List group performed significantly worse on the MC exam compared to GPA-only and HAM-Int (adjusted p = .029 and 0.018, respectively). No significant differences were found between the admission groups with respect to communication skills. Global Rating and OSCE part 1 (communication) correlated significantly (ρ = 0.228, p = .006) as did OSCE part 2 (clinical knowledge) and MC exam (ρ = 0.242, p = .003), indicating criterion validity. Constructs did not overlap, indicating divergent validity. CONCLUSIONS Advanced medical students selected for undergraduate studies by multiple mini-interviews assessing psychosocial skills showed similar communication skills compared to students admitted to medical school by other entryways. It is unclear whether these similarities are due to an effective undergraduate longitudinal communication curriculum. Assessing baseline communication skills of all medical students at entry-level may aid with this question.
Collapse
Affiliation(s)
- Lisa Bußenius
- Department of Biochemistry and Molecular Cell Biology, Center for Experimental Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Sigrid Harendza
- III. Department of Internal Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
13
|
Gärtner J, Bußenius L, Prediger S, Vogel D, Harendza S. Need for cognitive closure, tolerance for ambiguity, and perfectionism in medical school applicants. BMC MEDICAL EDUCATION 2020; 20:132. [PMID: 32345278 PMCID: PMC7189591 DOI: 10.1186/s12909-020-02043-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/27/2019] [Accepted: 04/13/2020] [Indexed: 06/11/2023]
Abstract
BACKGROUND Physicians have to deal with uncertainty on a daily basis, which requires high tolerance for ambiguity. When medical decisions have to be made in ambiguous situations, low levels of need for cognitive closure and high levels of adaptive perfectionism are beneficial. It might be useful to measure such personality traits during medical school selection processes. In our study, we explored the expression of need for cognitive closure, tolerance for ambiguity, and perfectionism in medical school applicants who participated in a multiple mini-interview selection process with respect to the final decision of admission or rejection. METHODS After participating in the multiple mini-interview procedure (HAM-Int) at Hamburg Medical School in August 2019, 189 medical school applicants filled out a questionnaire including the Multidimensional Perfectionism Scale by Hewitt and Flett (MPS-H), the Multidimensional Perfectionism Scale by Frost (MPS-F), the Tolerance for Ambiguity Scale (TAS), the 16-Need for Cognitive Closure Scale (16-NCCS), and sociodemographic data. After the final admission decision, the scores of need for cognitive closure, tolerance for ambiguity, and perfectionism of admitted and rejected applicants were compared. We also assessed the predictive power of need for cognitive closure and age for the admission decision in a binary logistic regression model. RESULTS Compared to the admitted applicants, the rejected applicants showed a significantly higher need for cognitive closure (p = .009). A high need for cognitive closure correlated significantly positively with maladaptive perfectionism (p < .001) and significantly negatively with tolerance for ambiguity (p < .001). Low need for cognitive closure and older age were associated with a positive admission decision. CONCLUSIONS Regarding the personality traits need for cognitive closure, tolerance for ambiguity, and perfectionism we identified interesting differences and correlations of relevance for physicians' daily work in medical school applicants who were admitted or rejected after participating in a multiple mini-interview selection procedure. Further studies are needed to investigate these characteristics and their development longitudinally in medical students and to correlate them with students' medical performance.
Collapse
Affiliation(s)
- Julia Gärtner
- III. Department of Internal Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Lisa Bußenius
- Department of Biochemistry and Molecular Cell Biology, Center for Experimental Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Sarah Prediger
- III. Department of Internal Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Daniela Vogel
- III. Department of Internal Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Sigrid Harendza
- III. Department of Internal Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
14
|
Breil SM, Forthmann B, Hertel-Waszak A, Ahrens H, Brouwer B, Schönefeld E, Marschall B, Back MD. Construct validity of multiple mini interviews - Investigating the role of stations, skills, and raters using Bayesian G-theory. MEDICAL TEACHER 2020; 42:164-171. [PMID: 31591917 DOI: 10.1080/0142159x.2019.1670337] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Background: One popular procedure in the medical student selection process are multiple mini-interviews (MMIs), which are designed to assess social skills (e.g., empathy) by means of brief interview and role-play stations. However, it remains unclear whether MMIs reliably measure desired social skills or rather general performance differences that do not depend on specific social skills. Here, we provide a detailed investigation into the construct validity of MMIs, including the identification and quantification of performance facets (social skill-specific performance, station-specific performance, general performance) and their relations with other selection measures.Methods: We used data from three MMI samples (N = 376 applicants, 144 raters) that included six interview and role-play stations and multiple assessed social skills.Results: Bayesian generalizability analyses show that, the largest amount of reliable MMI variance was accounted for by station-specific and general performance differences between applicants. Furthermore, there were low or no correlations with other selection measures.Discussion: Our findings suggest that MMI ratings are less social skill-specific than originally conceptualized and are due more to general performance differences (across and within-stations). Future research should focus on the development of skill-specific MMI stations and on behavioral analyses on the extents to which performance differences are based on desirable skills versus undesired aspects.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | - Mitja D Back
- Psychology, University of Münster, Münster, Germany
| |
Collapse
|
15
|
Kötter T, Rose SI, Waldmann A, Steinhäuser J. Do Medical Students in Their Fifth Year of Undergraduate Training Differ in Their Suitability to Become a "Good Doctor" Depending on Their Admission Criteria? A Pilot Study. ADVANCES IN MEDICAL EDUCATION AND PRACTICE 2020; 11:109-112. [PMID: 32104132 PMCID: PMC7013149 DOI: 10.2147/amep.s235529] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/21/2019] [Accepted: 01/24/2020] [Indexed: 05/23/2023]
Abstract
BACKGROUND In Germany, the pre-university grade point average (pu-GPA) has to be the main criterion for medical school applicant selection. This is also mandatory in the university-specific selection procedures (Auswahlverfahren der Hochschulen [AdH]). The admission framework has now been reworked following a judgement by the German Federal Constitutional Court. From 2020, more students will be admitted based solely on the pu-GPA and at least two selection criteria independent of the pu-GPA have to be considered in the AdH. However, the question whether an AdH (the core of the AdH at Lübeck Medical School [LMS], Germany, is a 30-mins panel interview led by two faculty members and one student) leads to better doctors as compared to pu-GPA-based selection, remains unanswered. OBJECTIVE To compare students selected based either on their pu-GPA alone ("pu-GPA-students") or based on the result of the AdH at LMS ("AdH-students") regarding their suitability to become a good doctor. DESIGN We conducted a cross-sectional observational pilot study at LMS. Students were judged regarding their overall suitability to become a good doctor by their supervising general practitioners after a two-week internship in their last year of theoretical medical education. The scores were matched to the selection procedure and compared between the pu-GPA-students and AdH-students. RESULTS In all, 79% of the AdH-students were rated as "absolutely suitable" for the medical profession, as compared to 42% of the pu-GPA-students (p = 0.01, odds ratio 5.17, 95% confidence interval = 1.41, 18.99). We did not find any association between gender or age and the suitability rating. CONCLUSION Despite the small sample size, our results indicate that it could be favourable to select medical students not only based on their pu-GPA but also using additional selection criteria.
Collapse
Affiliation(s)
- Thomas Kötter
- Institute of Family Medicine, University Medical Centre Schleswig-Holstein, Campus Lübeck, Lübeck, Germany
- Institute of Social Medicine and Epidemiology, University of Lübeck, Lübeck, Germany
- Correspondence: Thomas Kötter Institute of Family Medicine, University Medical Centre Schleswig-Holstein, Campus Lübeck, Ratzeburger Allee 160, Lübeck23562, GermanyTel +49 451 3101 8006Fax +49 451 3101 8004 Email
| | - Silvia Isabelle Rose
- Institute of Family Medicine, University Medical Centre Schleswig-Holstein, Campus Lübeck, Lübeck, Germany
- Institute of Social Medicine and Epidemiology, University of Lübeck, Lübeck, Germany
| | - Annika Waldmann
- Institute of Social Medicine and Epidemiology, University of Lübeck, Lübeck, Germany
| | - Jost Steinhäuser
- Institute of Family Medicine, University Medical Centre Schleswig-Holstein, Campus Lübeck, Lübeck, Germany
| |
Collapse
|
16
|
Clark JR, Miller CA, Garwood EL. Rethinking the Admissions Interview: Piloting Multiple Mini-Interviews in a Graduate Psychology Program. Psychol Rep 2019; 123:1869-1886. [PMID: 31865837 DOI: 10.1177/0033294119896062] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Health profession programs routinely utilize traditional interviews in admissions as a means of assessing important non-academic characteristics (e.g., critical thinking, interpersonal skills, judgment) of candidates. However, the reliability and validity of traditional interviews is highly questionable. Given this, multiple health profession programs (e.g., medicine, nursing, pharmacy, physical therapy) have implemented multiple mini-interviews as an alternative for assessing non-academic characteristics. This paper describes the development and implementation of multiple mini-interviews in the admissions process for a doctoral clinical psychology program, one of the health professions yet to use multiple mini-interviews. This paper also examines the feasibility and acceptability of the multiple mini-interviews in this program. Results of a mixed-method survey of all 120 candidates who participated in admissions days are presented along with discussion of factors associated with satisfaction and dissatisfaction. Recommendations for program refinement and application to other graduate psychology programs for improved admissions processes are discussed.
Collapse
|
17
|
Ali S, Sadiq Hashmi MS, Umair M, Beg MA, Huda N. Multiple Mini-Interviews: Current Perspectives on Utility and Limitations. ADVANCES IN MEDICAL EDUCATION AND PRACTICE 2019; 10:1031-1038. [PMID: 31849557 PMCID: PMC6913247 DOI: 10.2147/amep.s181332] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 04/13/2019] [Accepted: 11/16/2019] [Indexed: 06/10/2023]
Abstract
The growing role of healthcare professionals urged admissions committees to restructure their selection process and assess key personal attributes rather than academic achievements only. Multiple mini interviews (MMIs) were designed in 2002 to assess such domains in prospective healthcare professions. Being a high-stake assessment, the utility and limitations of MMI need to be explored. The purpose of this article is to review the available evidence to establish its utility. The claim of the reliability is verified by the studies assessing the effect of number of stations, duration of stations, format and scoring systems of stations and number of raters assessing the applicants. Similarly, by gathering evidence concerning its content validity, convergent/divergent correlation and predictive ability, validity is ensured. Finally, its acceptability and feasibility along with limitations is discussed. This article concludes by providing recommendations for further work required to deal with the limitations and enhance its utility.
Collapse
Affiliation(s)
- Sobia Ali
- Department of Health Professions Education, Liaquat National Hospital & Medical College, Karachi74800, Pakistan
| | | | - Mehnaz Umair
- Department of Health Professions Education, Liaquat National Hospital & Medical College, Karachi74800, Pakistan
| | - Mirza Aroosa Beg
- Department of Medical Education, Sindh Institute of Urology and Transplantation (SIUT), Karachi74200, Pakistan
| | - Nighat Huda
- Department of Health Professions Education, Liaquat National Hospital & Medical College, Karachi74800, Pakistan
| |
Collapse
|
18
|
Bußenius L, Harendza S. The relationship between perfectionism and symptoms of depression in medical school applicants. BMC MEDICAL EDUCATION 2019; 19:370. [PMID: 31615496 PMCID: PMC6794862 DOI: 10.1186/s12909-019-1823-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/18/2019] [Accepted: 09/26/2019] [Indexed: 05/16/2023]
Abstract
BACKGROUND The association between perfectionism and depression in the medical profession can ultimately influence physicians' performance negatively. In medical students, especially maladaptive perfectionism is connected with distress and lower academic performance. The expression of perfectionism and symptoms of depression at the time of medical school application is not known. Therefore, we explored perfectionism and symptoms of depression in participants of multiple mini-interviews for medical school admission and investigated possible differences between applicants who were eventually admitted or rejected. METHODS After the multiple mini-interviews admission procedure at Hamburg Medical School in August 2018, 146 applicants filled out a questionnaire including sociodemographic data and the following validated instruments: Multidimensional Perfectionism Scale by Hewitt and Flett (MPS-H), Multidimensional Perfectionism Scale by Frost (MPS-F), Patient Health Questionnaire (PHQ-9), Generalized Anxiety Disorder Scale (GAD-7), and a 10-item version of the Big Five Inventory (BFI-10). The two groups of admitted and rejected applicants were compared and the correlation between symptoms of depression and perfectionism further explored. RESULTS The admitted applicants were significantly more extrovert and had lower depression scores compared to the rejected applicants. In both groups, the composite scales of Adaptive Perfectionism (r = .21, p = .011) and Maladaptive Perfectionism (r = .43, p < .001) as well as their components correlated significantly with the PHQ-9 results. Maladaptive Perfectionism accounted for about 18% of variance in the PHQ-9 score. CONCLUSIONS Rejected medical school applicants who participated in a multiple mini-interviews admission procedure showed higher levels of depression symptoms than admitted applicants. The degree of depressive symptoms can be partly explained by Maladaptive Perfectionism scores. Since coping in medical school and in postgraduate medical education require robust mental health, perfectionism questionnaires could be an additional tool in medical school selection processes.
Collapse
Affiliation(s)
- Lisa Bußenius
- Department of Biochemistry and Molecular Cell Biology, Center for Experimental Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Sigrid Harendza
- III. Department of Internal Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
19
|
Knorr M, Meyer H, Sehner S, Hampe W, Zimmermann S. Exploring sociodemographic subgroup differences in multiple mini-interview (MMI) performance based on MMI station type and the implications for the predictive fairness of the Hamburg MMI. BMC MEDICAL EDUCATION 2019; 19:243. [PMID: 31269937 PMCID: PMC6610801 DOI: 10.1186/s12909-019-1674-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/21/2019] [Accepted: 06/17/2019] [Indexed: 05/30/2023]
Abstract
BACKGROUND Sociodemographic subgroup differences in multiple mini-interview (MMI) performance have been extensively studied within the MMI research literature, but heterogeneous findings demand a closer look at how specific aspects of MMI design (such as station type) affect these differences. So far, it has not been investigated whether sociodemographic subgroup differences imply that an MMI is biased, particularly in terms of its predictive validity. METHODS Between 2010 and 2017, the University Medical Centre Hamburg-Eppendorf (UKE) tested 1438 candidates in an MMI who also provided sociodemographic data and agreed to participate in this study. Out of these, 400 candidates were admitted and underwent a first objective structured clinical examination (OSCE) after one and a half years, including one station assessing communication skills. First, we analyzed the relationship between gender, age, native language and medical family background and MMI station performance including interaction terms with MMI station type (simulation, interview, and group) in a hierarchical linear model. Second, we tested whether the prediction of OSCE overall and communication station performance in particular differed depending on sociodemographic background by adding interaction terms between MMI performance and gender, age and medical family background in a linear regression model. RESULTS Young female candidates performed better than young male candidates both at interview and simulation stations. The gender difference was smaller (simulation) or non-significant (interview) in older candidates. There were no gender or age effects in MMI group station performance. All effects were very small, with the overall model explaining only 0.6% of the variance. MMI performance was not related to OSCE overall performance but significantly predicted OSCE communication station performance with no differences in the prediction for sociodemographic subgroups. CONCLUSIONS The Hamburg MMI is fair in its prediction of OSCE communication scores. Differences in MMI station performance for gender and age and their interaction with MMI station type can be related to the dimensions assessed at different station types and thus support the validity of the MMI. Rather than being threats to fairness, these differences could be useful for decisions relating to the design and use of an MMI.
Collapse
Affiliation(s)
- Mirjana Knorr
- Institute of Biochemistry and Molecular Cell Biology, University Medical Center Hamburg-Eppendorf (UKE), N30, Martinistraße 52, 20246 Hamburg, Germany
| | - Hubertus Meyer
- Institute of Biochemistry and Molecular Cell Biology, University Medical Center Hamburg-Eppendorf (UKE), N30, Martinistraße 52, 20246 Hamburg, Germany
| | - Susanne Sehner
- Institute of Medical Biometry and Epidemiology, University Medical Center Hamburg-Eppendorf (UKE), W34, Martinistraße 52, 20246 Hamburg, Germany
| | - Wolfgang Hampe
- Institute of Biochemistry and Molecular Cell Biology, University Medical Center Hamburg-Eppendorf (UKE), N30, Martinistraße 52, 20246 Hamburg, Germany
| | - Stefan Zimmermann
- Institute of Biochemistry and Molecular Cell Biology, University Medical Center Hamburg-Eppendorf (UKE), N30, Martinistraße 52, 20246 Hamburg, Germany
| |
Collapse
|
20
|
Groothuizen JE, Callwood A, Allan HT. The 'values journey' of nursing and midwifery students selected using multiple mini interviews: Evaluations from a longitudinal study. Nurs Inq 2019; 26:e12307. [PMID: 31240793 DOI: 10.1111/nin.12307] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2019] [Revised: 05/17/2019] [Accepted: 05/18/2019] [Indexed: 11/29/2022]
Abstract
Values-based practice is deemed essential for healthcare provision worldwide. In England, values-based recruitment methods, such as multiple mini interviews (MMIs), are employed to ensure that healthcare students' personal values align with the values of the National Health Service (NHS), which focus on compassion and patient-centeredness. However, values cannot be seen as static constructs. They can be positively and negatively influenced by learning and socialisation. We have conceptualised students' perceptions of their values over the duration of their education programme as a 'values journey'. The aim of this hermeneutic longitudinal focus group study was to explore the 'values journey' of student nurses and midwives, recruited through MMIs, across the 3 years of their education programme. The study commenced in 2016, with 42 nursing and midwifery students, originally recruited onto their programmes through multiple mini interviews. At the third and final point of data collection, 25 participants remained. Findings indicate that students' confidence, courage and sense of accountability increased over the 3 years. However, their values were also shaped by time constraints, emotional experiences and racial discrimination. We argue that adequate psychological support is necessary as healthcare students embark on and progress through their values journey, and propose a framework for this.
Collapse
Affiliation(s)
| | - Alison Callwood
- School of Health Sciences, University of Surrey, Guildford, UK
| | - Helen Therese Allan
- Centre for Critical Research in Nursing and Midwifery, School of Health and Education, Middlesex University, London, UK
| |
Collapse
|
21
|
Shaikh FA, Gilmour J. Emotional intelligence in medical students: should we be assessing this more vigorously during the admissions process? KOREAN JOURNAL OF MEDICAL EDUCATION 2019; 31:177-178. [PMID: 31230440 PMCID: PMC6589612 DOI: 10.3946/kjme.2019.129] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 05/07/2019] [Revised: 05/14/2019] [Accepted: 05/15/2019] [Indexed: 06/09/2023]
Affiliation(s)
| | - Jenna Gilmour
- GKT School of Medicine, King's College London, London, UK
| |
Collapse
|
22
|
Rodríguez-De Ávila U, Reyes-Rojas M, Campo-Arias A, Caballero-Domínguez C, Ceballos-Ospino G. Entrevistas en los procesos de selección de estudiantes de medicina. DUAZARY 2019. [DOI: 10.21676/2389783x.2758] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
Desde hace varias décadas, las entrevistas en los procesos de selección de estudiantes para las escuelas de medicina han sido repetidamente objeto de discusión. No obstante, se ha investigado muy poco sobre la utilidad de la entrevista clásica en la admisión de los futuros médicos1,2.
Collapse
|
23
|
Hampe W, Kadmon M. Who is allowed to study medicine? - regulations and evidence. GMS JOURNAL FOR MEDICAL EDUCATION 2019; 36:Doc10. [PMID: 30828610 PMCID: PMC6390087 DOI: 10.3205/zma001218] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Subscribe] [Scholar Register] [Received: 02/03/2019] [Revised: 02/03/2019] [Accepted: 02/03/2019] [Indexed: 06/09/2023]
Affiliation(s)
- Wolfgang Hampe
- University Hospital Hamburg-Eppendorf, Inst. of Biochemistry and Molecular Cell Biology, Hamburg, Germany
| | - Martina Kadmon
- University of Augsburg, Medical Faculty Augsburg, Deanery, Augsburg, Germany
| |
Collapse
|