The validity of student tutors' judgments in early detection of struggling in medical school. A prospective cohort study

Twelve tips for designing and implementing peer-led assessment writing schemes in health professions education

Peer-led assessment (PLA) has gained increasing prominence within health professions education as an effective means of engaging learners in the process of assessment writing and practice. Involving students in various stages of the assessment lifecycle, including item writing, quality assurance, and feedback, not only facilitates the creation of high-quality item banks with minimal faculty input but also promotes the development of students' assessment literacy and fosters their growth as teachers. The advantages of involving students in the generation of assessments are evident from a pedagogical standpoint, benefiting both students and faculty. However, faculty members may face uncertainty when it comes to implementing such approaches effectively. To address this concern, this paper presents twelve tips that offer guidance on important considerations for the successful implementation of peer-led assessment schemes in the context of health professions education.

Pre- and post-examination reflections of first-year medical students in an integrated medical anatomy course

Due to the rigor and pace of undergraduate medical anatomy courses, it is not uncommon for students to struggle and fail initially. However, repetition of coursework places an additional burden on the student, instructor, and institution. The purpose of this study was to compare the exam preparation strategies of repeating and non-repeating students to identify areas where struggling students can be supported prior to course failure. As part of their integrated anatomy course, first-year medical students at Indiana University completed a metacognitive Practice-Based Learning and Improvement (PBLI) assignment prior to and after their first exam. In the PBLIs, students were asked to reflect on their exam preparation strategies, confidence, and satisfaction, as well as their predicted and actual exam performance. PBLI responses from non-repeating and repeating students were then analyzed quantitatively and qualitatively. A total of 1802 medical students were included in this study, including 1751 non-repeating and 51 repeating students. Based on their PBLI responses, non-repeating students were appropriately confident, somewhat satisfied, and more accurate when predicting their exam performance. Repeating students were overconfident, dissatisfied, and inaccurate when predicting their first exam performance on their initial, unsuccessful attempt but were more successful on their second, repeat attempt. Qualitative analysis revealed that repeating students aimed to improve their studying by modifying their existing study strategies and managing their time more effectively. In conjunction with other known risk factors, these insights into repeater and non-repeater exam preparation practices can help anatomy educators better identify and support potential struggling students.

Investigating the risk factors for academic difficulties in the medical programme at a South African university

BACKGROUND

The National Benchmark Test (NBT) that determines academic readiness is widely used by Faculties as an additional measure to select students for the study of medicine. Despite this, many students continue to experience academic challenges that culminate in delayed graduation and sometimes academic exclusion or discontinuation of studies.

AIM

This study aimed to understand academic and non-academic variables linked with academic difficulties in the first three years of medical education.

METHODS

The study sample consisted of six cohorts of medical students for the period 2011 to 2016 (n = 1392). Only the first three of the six-year medical programme were selected for analysis. Survival analysis and Cox Proportional Hazard (CPH) was used to identify academic and non-academic variables associated with academic difficulties.

RESULTS

A total of 475 students (34%) experienced academic difficulty; 221 (16%) in the first year of study, 192 (14%) in the second year and 62 (5%) in the third year of study. The results show that Intermediate Upper, Lower and Basic levels for all NBT domains, living in university residence, rurality and male gender were risk factors for academic difficulty.

CONCLUSION

In mitigating these factors, the NBT must inform the type of support programmes to augment the students' skills and promote academic success. Additionally, existing support programmes should be evaluated to ascertain if they reach students at risk and whether participating in these programmes yield positive academic outcomes.

Why do students struggle in their first year of medical school? A qualitative study of student voices

BACKGROUND

Struggling at medical school incorporates academic failure, course disruption and early course exit. Struggling is usually multi-factorial involving academic, personal, financial and health factors. Struggling students may fail to engage with available support. First year students are particularly susceptible as they transition to university and a professional career.

METHODS

The study aim was to explore medical students' own voices on struggling and assess how they match up to existing literature. During one academic year, all first year medical students at the University of Birmingham (UK) who opted to leave or were required to withdraw (n = 52) were asked to participate in an individual exit interview. Fifteen students responded and fourteen (27%) agreed to be interviewed. Interviews were face to face (n = 10), telephone (n = 3) and via email (n = 1). Interviews were unstructured and led by a general open question. Framework analysis identified key data themes.

RESULTS

Students described year one of medical school as a critical transition. They simultaneously needed to adapt to being a university student, a medical student and a doctor. A six-group typology of students emerged, each of which struggled with one or more of these adaptations. The groups were: wrong degree choice, mental health problems, acute crisis, at capacity, slow starter and family rock. Some students experienced an isolated problem from within this typology. Most had a multi-factorial story of struggling. Mental health problems and acute crises were the most common issues. Early professional identity formation was a key hurdle. Help-seeking behaviours were varied.

CONCLUSIONS

This study explores the narratives of medical students who struggled from an early stage and presents a data-driven typology of their issues. It advances existing qualitative understanding of this topic, which to date is predominantly derived from educator perceptions and not specific to early course issues. Although our results broadly cohere with existing knowledge, we also present novel findings which may reflect our focus on first year students. Issues around early professional identity formation may reflect the increasing emphasis on professionalism in medical school curricula. Listening to these narratives could help university staff to identify students at risk of struggling for targeted support.

Predicting failure before it happens: A 5-year, 1042 participant prospective study

PURPOSE OF THE ARTICLE

Students who fail assessments are at risk of negative consequences, including emotional distress and cessation of studies. Identifying students at risk of failure before they experience difficulties may considerably improve their outcomes.

METHODS

Using a prospective design, we collected simple measures of engagement (formative assessment scores, compliance with routine administrative tasks, and attendance) over the first 6 weeks of Year 1. These measures were combined to form an engagement score which was used to predict a summative examination sat 14 weeks after the start of medical school. The project was repeated for five cohorts, giving a total sample size of 1042.

RESULTS

Simple linear regression showed engagement predicted performance (R²_adj = 0.03, F(1,1040) = 90.09, p < 0.001) with a small effect size. More than half of failing students had an engagement score in the lowest two deciles.

CONCLUSIONS

At-risk medical students can be identified with some accuracy immediately after starting medical school using routinely collected, easily analysed data, allowing for tailored interventions to support students. The toolkit provided here can reproduce the predictive model in any equivalent educational context. Medical educationalists must evaluate how the advantages of early detection are balanced against the potential invasiveness of using student data.

Struggling with strugglers: using data from selection tools for early identification of medical students at risk of failure

BACKGROUND

Struggling medical students is an under-researched in medical education. It is known, however, that early identification is important for effective remediation. The aim of the study was to determine the predictive effect of medical school admission tools regarding whether a student will struggle academically.

METHODS

Data comprise 700 students from the University of New South Wales undergraduate medical program. The main outcome of interest was whether these students struggled during this 6-year program; they were classified to be struggling they failed any end-of-phase examination but still graduated from the program. Discriminate Function Analysis (DFA) assessed whether their pre-admission academic achievement, Undergraduate Medicine Admission Test (UMAT) and interview scores had predictive effect regarding likelihood to struggle.

RESULTS

A lower pre-admission academic achievement in the form of Australian Tertiary Admission Rank (ATAR) or Grade Point Average (GPA) were found to be the best positive predictors of whether a student was likely to struggle. Lower UMAT and poorer interview scores were found to have a comparatively much smaller predictive effect.

CONCLUSION

Although medical admission tests are widely used, medical school rarely use these data for educational purposes. The results of this study suggest admission test data can predict who among the admitted students is likely to struggle in the program. Educationally, this information is invaluable. These results indicate that pre-admission academic achievement can be used to predict which students are likely to struggle in an Australian undergraduate medicine program. Further research into predicting other types of struggling students as well as remediation methods are necessary.

Early identification of first-year students at risk of dropping out of high-school entry medical school: the usefulness of teachers' ratings of class participation

Dropping out from undergraduate medical education is costly for students, medical schools, and society in general. Therefore, the early identification of potential dropout students is important. The contribution of personal features to dropout rates has merited exploration. However, there is a paucity of research on aspects of student experience that may lead to dropping out. In this study, underpinned by theoretical models of student commitment, involvement, and engagement, we explored the hypothesis of using inferior participation as an indicator of a higher probability of dropping out in year 1. Class participation was calculated as an aggregate score based on teachers' daily observations in class. The study used a longitudinal dataset of six cohorts of high-school entry students (N = 709, 67% females) in one medical school with an annual intake of 120 students. The findings confirmed the initial hypothesis and showed that lower scores of class participation in year 1 added predictive ability to pre-entry characteristics (Pseudo-R² raised from 0.22 to 0.28). Even though the inclusion of course failure in year 1 resulted in higher explanatory power than participation in class (Pseudo-R² raised from 0.28 to 0.63), ratings of class participation may be advantageous to anticipate dropout identification, as those can be collected prior to course failure. The implications for practice are that teachers' ratings of class participation can play a role in indicating medical students who may eventually drop out. We conclude that the scores of class participation can contribute to flagging systems for the early detection of student dropouts.

Dissecting the role of sessional anatomy teachers: A systematic literature review

Worldwide there is a growing reliance on sessional teachers in universities. This has impacted all disciplines in higher education including medical anatomy programs. The objective of this review was to define the role and support needs of sessional anatomy teachers by reporting on the (1) qualifications, (2) teaching role, (3) training, and (4) performance management of this group of educators. A systematic literature search was conducted on the 27 July 2017 in Scopus, Web of Science, and several databases on the Ovid, ProQuest and EBSCOhost platforms. The search retrieved 5,658 articles, with 39 deemed eligible for inclusion. The qualifications and educational distance between sessional anatomy teachers and their students varied widely. Reports of cross-level, near-peer and reciprocal-peer teaching were identified, with most institutes utilizing recent medical graduates or medical students as sessional teachers. Sessional anatomy teachers were engaged in the full spectrum of teaching-related duties from assisting students with cadaveric dissection, to marking student assessments and developing course materials. Fourteen institutes reported that training was provided to sessional anatomy teachers, but the specific content, objectives, methods and effectiveness of the training programs were rarely defined. Evaluations of sessional anatomy teacher performance primarily relied on subjective feedback measures such as student surveys (n = 18) or teacher self-assessment (n = 3). The results of this systematic review highlight the need for rigorous explorations of the use of sessional anatomy teachers in medical education, and the development of evidence-based policies and training programs that regulate and support the use of sessional teachers in higher education. Anat Sci Educ 11: 410-426. © 2017 American Association of Anatomists.

Situating Remediation: Accommodating Success and Failure in Medical Education Systems

There has been a widespread shift to competency-based medical education (CBME) in the United States and Canada. Much of the CBME discourse has focused on the successful learner, with relatively little attention paid to what happens in CBME systems when learners stumble or fail. Emerging issues, such as the well-documented problem of "failure to fail" and concerns about litigious learners, have highlighted a need for well-defined and integrated frameworks to support and guide strategic approaches to the remediation of struggling medical learners.This Perspective sets out a conceptual review of current practices and an argument for a holistic approach to remediation in the context of their parent medical education systems. The authors propose parameters for integrating remediation into CBME and describe a model based on five zones of practice along with the rules of engagement associated with each zone. The zones are "normal" curriculum, corrective action, remediation, probation, and exclusion.The authors argue that, by linking and integrating theory and practice in remediation with CBME, a more integrated systems-level response to differing degrees of learner difficulty and failure can be developed. The proposed model demonstrates how educational practice in different zones is based on different rules, roles, responsibilities, and thresholds for moving between zones. A model such as this can help medical educators and medical education leaders take a more integrated approach to learners' failures as well as their successes by being more explicit about the rules of engagement that apply in different circumstances across the competency continuum.