The remediation challenge: theoretical and methodological insights from a systematic review

Unravelling epistemic injustice in medical education: The case of the underperforming learner

CONTEXT

Epistemic injustice refers to a wrong done to someone in their capacity as a knower. While philosophers have detailed the pervasiveness of this issue within healthcare, it is only beginning to be discussed by medical educators. The purpose of this article is to expand the field's understanding of this concept and to demonstrate how it can be used to reframe complex problems in medical education.

METHODS

After outlining the basic features of epistemic injustice, we clarify its intended (and unintended) meaning and detail what is required for a perceived harm to be named an epistemic injustice. Using an example from our own work on introversion in undergraduate medical education, we illustrate what epistemic injustice might look like from the perspectives of both educators and students and show how the concept can reorient our perspective on academic underperformance.

RESULTS

Epistemic injustice results from two things: (1) social power dynamics that give some individuals control over others, and (2) identity prejudice that is associated with discriminatory stereotypes. This can lead to one, or both, forms of epistemic injustice: testimonial and hermeneutical. Our worked example demonstrates how medical educators can be unaware of when and how epistemic injustice is happening, yet the effects on students' well-being and sense of selves can be profound. Thinking about academic underperformance with epistemic injustice in mind can reveal an emphasis within current educational practices on diagnosing learning deficiencies, to the detriment of holistically representing its socially constructed and structural nature.

CONCLUSIONS

This article builds upon recent calls to recognise epistemic injustice in medical education by clarifying its terminology and intended use and providing in-depth application and analysis to a particular case: underperformance and the introverted medical student. Equipped with a more sophisticated understanding of the term, medical educators may be able to re-conceptualise long-standing issues including, but also beyond, underperformance.

'We're like Spider-Man; with great power comes great responsibility': Coaches' experiences supporting struggling medical students

BACKGROUND

Medical students can experience a range of academic and non-academic struggles. Coaching is a valuable strategy to support learners, but coaches describe working with struggling learners as taxing. Transformative learning theory (TLT) provides insights into how educators grow from challenging experiences to build resilience. This study explores how coaches evolve as educators through supporting struggling students.

METHODS

This qualitative study grounded in an interpretivist paradigm used interviews of longitudinal medical student coaches at two academic institutions. Interviews, using TLT as a sensitizing concept, explored coaches' experience coaching struggling learners. We performed thematic analysis.

RESULTS

We interviewed 15 coaches. Coaches described supporting students through multi-faceted struggles which often surprised the coach. Three themes characterized coaches' experiences: personal responsibility, emotional response, and personal learning. Coaches shouldered high personal responsibility for learners' success. For some, this burden felt emotional, raised parental instincts and questions about maintaining boundaries with learners. Coaches evolved their coaching approach, challenged biases, and built skills. Coaches learned to better appreciate the learner point of view and employ resources to support students.

DISCUSSION

Through navigating learner struggles, educators can gain self-efficacy, learn to understand learners' perspectives, and evolve their coaching approach to lessen their personal emotional burden through time.

Interventions for undergraduate and postgraduate medical learners with academic difficulties: A BEME systematic review update: BEME Guide No. 85

BACKGROUND

Clinical teachers often struggle to record trainee underperformance due to lacking evidence-based remediation options.

OBJECTIVES

To provide updated evidence-based recommendations for addressing academic difficulties among undergraduate and postgraduate medical learners.

METHODS

A systematic review searched databases including MEDLINE, CINAHL, EMBASE, ERIC, Education Source, and PsycINFO (2016-2021), replicating the original Best Evidence Medical Education 56 review strategy. Original research/innovation reports describing intervention(s) for medical learners with academic difficulties were included. Data extraction used Michie's Behaviour Change Techniques (BCT) Taxonomy and program evaluation models from Stufflebeam and Kirkpatrick. Quality appraised used the Mixed Methods Appraisal Tool (MMAT). Authors synthesized extracted evidence by adapting GRADE approach to formulate recommendations.

RESULTS

Eighteen articles met the inclusion criteria, primarily addressing knowledge (66.7%), skills (66.7%), attitudinal problems (50%) and learner's personal challenges (27.8%). Feedback and monitoring was the most frequently employed BCT. Study quality varied (MMAT 0-100%). We identified nineteen interventions (UG: n = 9, PG: n = 12), introducing twelve new thematic content. Newly thematic content addressed contemporary learning challenges such as academic procrastination, and use of technology-enhanced learning resources. Combined with previous interventions, the review offers a total dataset of 121 interventions.

CONCLUSION

This review offers additional evidence-based interventions for learners with academic difficulties, supporting teaching, learning, faculty development, and research efforts.

Coping Strategies of Failing International Medical Students in Two Chinese Universities: A Qualitative Study

Phenomenon: China hosts a large number of international medical students from low-income countries, and some fail examinations in the early stage of the Bachelor of Medicine and Bachelor of Surgery (MBBS) program. Little is known about how failing international medical students cope to recover their academic performance. It would be beneficial to investigate the coping strategies they use to help them recover their academic performance and progress. Approach: Semi-structured interviews were conducted with 21 international medical students at two universities in China from September 2020 to January 2021. These students had passed make-up exams or re-sits and progressed academically. A thematic analysis approach was used to identify major themes in the interview data. Findings: After failing initial exams or re-sits, students were found to adopt seven coping strategies to help them pass future examinations and recover their academic performance: (i) increased help-seeking behaviors, (ii) improved learning motivation and attitudes, (iii) improved learning strategies, (iv) improved exam preparation, (v) utilization of library resources, (vi) enhanced time management, and (vii) enhanced English language skills. Of the seven strategies, seeking help from friends, peers, seniors, and teachers was the strategy reported most frequently. Insights: The results of this study provide insights into the coping strategies that international undergraduate medical students adopt to recover from poor academic performance in Chinese universities. Host institutions should recognize the resilience and agency of such students to make positive changes. Furthermore, institutional efforts should be made to develop contextualized intervention plans that stimulate students' learning motivation and encourage them to adopt self-help strategies by incorporating useful resources (e.g., help from peers, seniors, and teachers). Enrollment should integrate specific English language proficiency criteria, and interviews and entrance exams should be conducted. For some failing students, it may be necessary to provide academic remediation.

Genetic counseling program remediation practices for students underperforming in clinical skills: An exploratory study

Program-level clinical remediation in genetic counseling training programs aims to help students who are underperforming gain clinical skills to successfully manage clinical counseling sessions with patients. Student remediation often requires intervention, including discussions with program leadership and/or a formal remediation plan through the program. This study surveyed genetic counseling program leaders to explore the remediation landscape by identifying skills in which students underperformed, program remediation activities to improve skills, and remediation outcomes. Thirteen participants indicated their program required at least one student to complete program-level clinical remediation during the last 10 years. Eight of the 13 programs (61.5%) required at least one student to participate in clinical remediation for underperformance in professionalism, seven (53.8%) for underperformance in educating patients, six (46.2%) for underperformance in critical thinking, and two (15.4%) for underperformance in demonstrating empathy. Nineteen students were remediated for underperformance in critical thinking. Of those 19 students, one student (5.2%) was dismissed from the training program, and five students (26.3%) chose to withdraw from their program. One of 13 (7.7%) students remediated for underperformance in educating patients and one of 11 (9.1%) students remediated for underperformance in professionalism chose to withdraw from their programs. All students remediated for underperformance in demonstrating empathy successfully completed program-level clinical remediation and graduated. The most frequently endorsed factor positively associated with remediation success was completion of additional in-person patient encounters. The most frequent barrier was a student's poor mental health. Participants most frequently endorsed identification of resources for specific areas of remediation to improve their programs' efficacy in clinical remediation practices. This exploratory study provides valuable information describing clinical skills that require remediation in genetic counseling graduate training, the remediation practices utilized by training programs, and resources that may increase remediation success.

Pre- and post-examination reflections of first-year medical students in an integrated medical anatomy course

Due to the rigor and pace of undergraduate medical anatomy courses, it is not uncommon for students to struggle and fail initially. However, repetition of coursework places an additional burden on the student, instructor, and institution. The purpose of this study was to compare the exam preparation strategies of repeating and non-repeating students to identify areas where struggling students can be supported prior to course failure. As part of their integrated anatomy course, first-year medical students at Indiana University completed a metacognitive Practice-Based Learning and Improvement (PBLI) assignment prior to and after their first exam. In the PBLIs, students were asked to reflect on their exam preparation strategies, confidence, and satisfaction, as well as their predicted and actual exam performance. PBLI responses from non-repeating and repeating students were then analyzed quantitatively and qualitatively. A total of 1802 medical students were included in this study, including 1751 non-repeating and 51 repeating students. Based on their PBLI responses, non-repeating students were appropriately confident, somewhat satisfied, and more accurate when predicting their exam performance. Repeating students were overconfident, dissatisfied, and inaccurate when predicting their first exam performance on their initial, unsuccessful attempt but were more successful on their second, repeat attempt. Qualitative analysis revealed that repeating students aimed to improve their studying by modifying their existing study strategies and managing their time more effectively. In conjunction with other known risk factors, these insights into repeater and non-repeater exam preparation practices can help anatomy educators better identify and support potential struggling students.

Stress, Grit, Satisfaction With Life, and Remediation of Prelicensure Nursing Students

BACKGROUND

Stress and poor academic performance often lead to high levels of nursing school attrition.

PURPOSE

To explore nursing students' perceived stress, grit, and satisfaction with life, and assess the effectiveness of a remediation program for students at risk for poor academic performance.

METHODS

Perceived stress, grit, and satisfaction with life were measured, and the effect of remediation given to at-risk students was studied. Examination and psychometric scores were compared between remediation and nonremediation groups.

RESULTS

The remediation group had higher levels of perceived stress and a lower satisfaction with life compared with the rest of the cohort. Remediation significantly improved examination scores of at-risk students although scores remained lower than those among nonremediation students.

CONCLUSIONS

Perceived stress and grit scores were high in nursing students, and satisfaction varied among age groups. Remediation based on metacognitive theory significantly improved at-risk students' examination scores.

A phenomenological exploration of the feedback experience of medical students after summative exam failure

BACKGROUND

Preventing medical students entering cycles of underperformance following assessment is a priority due to the consequences for the student, faculty, and wider society. The benefits from feedback may be inadequately accessed by students in difficulty due to the emotional response evoked by examination failure. This study aims to explore medical students' experiences of receiving feedback after summative assessment failure and investigate the role of emotions on motivation for learning after underperformance, to better support remediation and preparation for future assessments.

METHODS

This study used interpretative phenomenological analysis (IPA) to explore the experiences of four medical students who failed summative assessments. Additionally, a content analysis was conducted using Linguistic Inquiry and Word Count (LIWC) to investigate the characteristics and use of language to describe their emotional response.

RESULTS

Anger, fear, anxiety, and sadness were emotions frequently experienced after examination failure. These emotions led to feelings of mistrust of the medical school and subsequent distrust in the university's assessment processes, impacting on the desire to engage with feedback. There was dissonance between the students' perceptions of what feedback should provide and what benefit feedback provided after summative assessments. The linguistic inquiry further confirmed an initial (and sometimes long lived) negative affective state after experiencing failure, and a barrier to engagement with remediation when not effectively managed.

CONCLUSIONS

A range of emotions, directed at themselves and the medical school are experienced by students following exam failure. These emotions lead to a range of negative feelings and responses that affect how students make sense of and move on from the failure experience. There is a need for educators to better understand and support students to manage, reflect and contextualise their emotional responses, minimise external attribution and to enable focus on remediation and learning.

Self-regulated learning processes across different physiotherapy clinical procedural skills and time intervals: A SRL microanalysis study

PURPOSE OF THE STUDY

The performance of a clinical procedural skill by an individual student is associated with their use of Self-Regulated Learning (SRL) processes. However, previous research has not identified if an individual student has a similarity in their use of SRL processes across different clinical procedural skill tasks and at a time interval. The aim of this pilot study was to explore the similarity in the use of SRL processes by individual students across different clinical procedural skill tasks and at a time interval.

METHODS

SRL-microanalysis was used to collect within-subject data on undergraduate physiotherapy students' use of the two key SRL processes (planning and monitoring) during their performance of different goniometry clinical procedural skills tasks and also at a fourth month interval.

RESULTS

An individual student's use of key SRL processes across different clinical procedural skill tasks and at a time interval was similar. Also, this similarity was identified for students with initial successful and unsuccessful performances.

CONCLUSION

Our findings have implications for the future wider practical implementation of SRL microanalysis to inform personalised SRL feedback for developing the clinical procedural skills of individual students. Further research with a greater number of students and across a wider range of clinical procedural skills will be required to confirm our findings, and also its effectiveness on feedback and future performance.

Design of a Learning Development Program to Support First-Year Undergraduate Medical Students in the Transition to a PBL Curriculum

While the evaluation of learning development interventions needs to be considered carefully and included at the curriculum design stage, there is limited literature on the actual design of interventions, especially on how these designs evolve and improve over time. This paper describes the evolution of a learning development program intended to support first-year medical students adjusting to a problem-based learning curriculum. We used a design-based research approach, articulating our theoretical grounding and incorporating students' voices to develop an "optimal" intervention for the specific challenges in our context. We describe lessons learned around four aspects: students' growth and development, teachers' professional growth and development, program design principles, and the emergent components of a learning development program. Overall, our students describe the Learning Success Program as adding value by enabling the adoption of a repertoire of skills and strategies for learning management. Additionally, the incremental nature of design-based research allowed for the development of a context-specific program that considers students' voices through needs assessment and feedback on the program offerings. It has also provided an opportunity for the professional development of teachers through feedback from classroom practice, reflection, and the literature.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40670-023-01790-3.

Using document phenomenology to investigate academic failure among year 1 undergraduate Malaysian medical students

BACKGROUND

Academic failure is common among medical schools worldwide. However, the process behind this failure itself is underexplored. A deeper understanding of this phenomenon may avert the vicious cycle of academic failure. Hence, this study investigated the process of academic failure among medical students in Year 1.

METHODS

This study employed a document phenomenological approach, which is a systematic process to examine documents, interpret them to attain understanding, and develop empirical knowledge of the phenomenon studied. Using document analysis, interview transcripts and reflective essays of 16 Year 1 medical students who experienced academic failure were analysed. Based on this analysis, codes were developed and further reduced into categories and themes. Thirty categories in eight themes were linked to make sense of the series of events leading to academic failure.

RESULTS

One or more critical incidents commenced during the academic year, which led to possible resulting events. The students had poor attitudes, ineffective learning methods, health problems or stress. Students progressed to mid-year assessments and reacted differently to their results in the assessments. Afterwards, the students tried different types of attempts, and they still failed the end-of-year assessments. The general process of academic failure is illustrated in a diagram describing chronological events.

CONCLUSION

Academic failure may be explained by a series of events (and consequences) of what students experience and do and how they respond to their experiences. Preventing a preceding event may prevent students from suffering these consequences.

CARDA: Guiding document analyses in health professions education research

INTRODUCTION

Documents, from policies and procedures to curriculum maps and examination papers, structure the everyday experiences of health professions education (HPE), and as such can provide a wealth of empirical information. Document analysis (DA) is an umbrella term for a range of systematic research procedures that use documents as data.

METHODS

A meta-study review was conducted with the aims of describing the current state of DA in HPE, guiding researchers engaging in DA and improving methodological, analytical and reporting rigour. Structured searches were conducted, returns were filtered for inclusion and the 115 remaining articles were critically analysed for their use of DA methods and methodologies.

RESULTS

There was a significant increase in the number of articles reporting the use of DA over time. Sixty-three articles were single method (DA only), while the others were mixed methods research (MMR). Overall, there were major lacunae in terms of why documents were used, how documents were identified, what the authors did and what they found from the documents. This was particularly apparent in MMR where DA reporting was typically poorer than the reporting of other methods in the same paper.

DISCUSSION

Given these many lacunae, a framework for reporting on DA research was developed to facilitate rigorous DA research and transparent, complete and accurate reporting of the same, to help readers assess the trustworthiness of the findings from document use and analysis in HPE and, potentially, other domains. It was also noted that there are gaps in HPE knowledge that could be addressed through DA, particularly where documents are conceptualised as more than passive holders of information. Scholars are encouraged to reflect more deeply on the applications and practices of DA, with the ultimate aim of ensuring more substantive and more rigorous use of documents for understanding and constructing meaning in our field.

Developing low-achieving medical students' self-regulated learning using a combined learning diary and explicit training intervention

INTRODUCTION

The development of self-regulated learning (SRL) is an essential educational component of remediation for low-achieving students. The aim of this study was to design, implement, and evaluate a longitudinal SRL intervention combining both a structured learning diary and explicit SRL training in a cohort of low-achieving undergraduate medical students.

MATERIALS AND METHODS

A mixed methods quasi-experimental study was conducted, with a pretest-posttest study in the intervention group and comparison of the GPA and course grade of the intervention group with a historical comparison group. A questionnaire and focus group explored the participants' perceptions about the intervention.

RESULTS

The SRL scores (total and rehearsal, organization, critical thinking, metacognitive regulation, time management and environment management) and course grade of participants were significantly improved in the intervention group. The course grade of participants was significantly higher than the comparison group but the GPA was not significantly different. Overall, the participants were positive about the intervention.

CONCLUSIONS

This study was the first in medical education to evaluate the effectiveness and user acceptability of an SRL intervention that combined a structured learning diary and explicit SRL training in low-achieving medical students. Further research is recommended in different contexts and with larger number of students.

Predictors of clinical performance in comprehensive care cases in undergraduate dentists

INTRODUCTION

Achieving a high grade in the final-year comprehensive clinical care (CCC) course is not only important for the individual candidate but also to ensure competency of students as they transition from dental school into independent practice. Here, we aimed to identify predictors of success in the CCC that might prove useful to identify which, if any, students need focused intervention to improve their performance in the CCC.

MATERIALS AND METHODS

This was a cross-sectional study of two consecutive cohorts (2017-2018 and 2018-2019) of final-year (Year six) dental students (n = 180 females and n = 150 males) attending [King Abdulaziz University], Saudi Arabia. Age, gender, cumulative GPA to the start of Year six and assessment results were tabulated and analysed as independent variables in binary logistic regression to identify predictors of the final case grade (≤69% or >70%).

RESULTS

Year five GPA (OR 1.07, 95% CI 1.02-1.12; p = .004) and female gender (OR 2.21, 95% CI 1.12-4.36; p = .02) were significantly associated with an increased odds of achieving a final case grade >70%. In particular, female students were over twice as likely as male students to achieve a higher score in their final case assessment.

DISCUSSION

This study suggests that gender may influence final performance in the CCC. The better performance of females in the final CCC course than their male counterparts suggests that there may be a narrowing or even reversal of the historical gender gap in dental school performance.

CONCLUSIONS

Both cognitive (GPA) and other (i.e. gender) factors influence clinical dental performance. Further work is required to establish what instructional modifications are required to accommodate these gender differences in CCC courses to pave the way for personalised teaching approaches to optimise educational outcomes.

Postgraduate Year 6 Versus Postgraduate Year 7 Neurosurgical Chief Year: A Survey of Residents and Program Directors

OBJECTIVE

Recently, more neurosurgical residency programs have transitioned from a postgraduate year (PGY)-7 to a PGY-6 chief year. There has not been a national analysis of resident and program director perceptions regarding the timing of chief year conductance and its influence on overall program satisfaction.

METHODS

An online survey was distributed to all North American PGY 4-7 residents and program directors. Data regarding program size, protected research timing, chief year timing (PGY-6 vs. PGY-7), and resident and program director perceptions of the influence of neurosurgical chief year timing on program satisfaction and ability of residents to practice were recorded. Survey results were summarized descriptively.

RESULTS

A total of 134 respondents completed the survey. Thirty-five percent of respondents reported a recent program transition from a PGY-7 to PGY-6 chief year while 44% of respondents at programs conducting a PGY-7 chief year reported they were interested in transitioning to a PGY-6 chief year. The large majority (76%) of respondents at PGY-6 chief year programs stated they were overall satisfied with this. A large percentage of all respondents reported that a PGY-6 chief year provided increased opportunity for subspecialty focus, enfolded fellowships and career planning.

CONCLUSIONS

Program directors and residents at PGY-6 chief year programs report a high level of satisfaction with close to half of those at PGY-7 programs desiring to make this transition. Most PGY-6 chief year respondents report that this model allows for greater subspecialty focus and career planning during the PGY-7 year.

Differences between high- and low-achieving pre-clinical medical students: a qualitative instrumental case study from a theory of action perspective

BACKGROUND

Poor academic performance and failure can cause undesired effects for students, schools, and society. Understanding why some students fail while their peers succeed is important to enhance student performance. Therefore, this study explores the differences in the learning process between high- and low-achieving pre-clinical medical students from a theory of action perspective.

METHODS

This study employed a qualitative instrumental case study design intended to compare two groups of students-high-achieving students (n = 14) and low-achieving students (n = 5), enrolled in pre-clinical medical studies at the Universiti Malaya, Malaysia. Data were collected through reflective journals and semi-structured interviews. Regarding journaling, participants were required to recall their learning experiences of the previous academic year. Two analysts coded the data and then compared the codes of high- and low-achieving students. The third analyst reviewed the codes. Themes were identified iteratively, working towards comparing the learning processes of high- and low-achieving students.

RESULTS

Data analysis revealed four themes-motivation and expectation, study methods, self-management, and flexibility of mindset. First, high-achieving students were more motivated and had higher academic expectations than low-achieving students. Second, high-achieving students adopted study planning and deep learning approaches, whereas low-achieving students adopted superficial learning approaches. Third, in contrast to low-achieving students, high-achieving students exhibited better time management and studied consistently. Finally, high-achieving students proactively sought external support and made changes to overcome challenges. In contrast, low-achieving students were less resilient and tended to avoid challenges.

CONCLUSION

Based on the theory of action, high-achieving students utilize positive governing variables, whereas low-achieving students are driven by negative governing variables. Hence, governing variable-based remediation is needed to help low-achieving students interrogate the motives behind their actions and realign positive governing variables, actions, and intended outcomes.Key MessagesThis study found four themes describing the differences between high- and low-achieving pre-clinical medical students: motivation and expectation, study methods, self-management, and flexibility of mindset.Based on the theory of action approach, high-achieving pre-clinical medical students are fundamentally different from their low-achieving peers in terms of their governing variables, with the positive governing variables likely to have guided them to act in a manner beneficial to and facilitating desirable academic performance.Governing variable-based remediation may help students interrogate the motives of their actions.

Incorporation of Comprehensive Examinations for a Time-Efficient Remediation Method

BACKGROUND

Remediation in medical school should be a time-limited, and highly structured process that addresses student deficiencies and allows them to prove content competency before progressing in the curriculum. In this study, we analyze the use of a comprehensive end-of semester final examination in the remediation process for pre-clinical students at Kirk Kerkorian School of Medicine (KSOM). Faculty time utilized is analyzed and compared with the previously employed remediation process.

METHODS

Administered to all students at the end of each semester is a comprehensive examination consisting of a sufficient number of faculty-selected questions relating to each organ system covered with a 75% passing threshold. A student must also demonstrate competency of any failed system examination content to remediate successfully. The performance of those who did not exhibit competency was analyzed to identify areas of deficiency then an individualized exam would then be administered. The total remediation time spent by faculties and students was then analyzed.

RESULTS

KSOM Class of 2024 results showed that faculty were able to yield significant savings in time spent on remediation. Faculty spent 45 total remediation hours for the Class of 2024, compared to 400 hours remediating using the paper-based assignment method for the Class of 2021. With the transition to comprehensive end-of-semester final examinations, a total of 355 hours were saved. Furthermore, faculty used an average 1.07 hours/student with end-of-semester comprehensive examinations. The saved time allows faculty to work on improving the overall curriculum for all students rather than focusing on a limited number of students.

CONCLUSION

Utilizing comprehensive end-of-semester final examinations notably decreased the amount of faculty time spent per semester on remediation. Further evaluation is required to evaluate long-term effectiveness on content competency and would further be strengthened by a multi-institutional comparison.

Integrated Holistic Student Affairs: A Personalized, Equitable, Student-Centered Approach to Student Affairs

Medical education has reached a critical juncture-the structural racism that has permeated the fabric of its systems and institutions for centuries can no longer be ignored. The destructive, disproportionate impact of the COVID-19 pandemic and unabated violence targeting individuals who are Black, Indigenous, and People of Color (BIPOC) exact an incalculable toll on BIPOC students and students from other groups that are historically underrepresented in medicine (UIM). Failing to recognize and act on the well-documented differential experience of BIPOC medical students impedes medical educators' ability to cultivate learning environments where all learners have an equitable opportunity to thrive. Holistic review admission processes, now widely accepted, have challenged admissions committees to consider the "whole applicant" to diversify matriculating classes. While gaining admission is critical, it is merely the first step for BIPOC students, who may face marginalization within what the authors have termed a "sink-or-swim" culture in medical education. For the tremendous potential afforded by holistic review to be realized, the medical education community must extend the holistic approach throughout the medical education continuum, beginning with student affairs practices and support. The authors propose the use of Integrated Holistic Student Affairs (IHSA), a systems-based model that fosters the reexamining and reengineering of existing student affairs structures, policies, and processes to promote a personalized, equitable student-centered approach. The IHSA Model consists of 4 strategic actions-establish vertical and horizontal collaboration, conduct systems thinking analysis, target leverage points for change, and operationalize the change process-and 4 areas of priority for collaboration with student diversity affairs staff and faculty. The IHSA Model provides student affairs staff and faculty with a framework for shifting from reactive, deficit-oriented practices to proactive, empowering, equitable practices, with the goal of allowing BIPOC and all other UIM students to thrive during their journey from matriculation to graduation.

"Clinical Teachers: Teaching Tips for the Busy Veterinary Team": Reflections on the Development of a Multimodal Resource for Veterinarians and Veterinary Nurses/ Technologists New to Clinical Teaching

Clinical practice-based training/work-integrated learning is an applied, social, and high-impact element of the veterinary curriculum. Within this context, students are learning on the job with clinician-educators who are carrying out their professional duties at the same time as supporting learning. To equip clinician-educators with role awareness and general teaching skills, it is recommended that all have access to basic teacher training. However, delivering this training can be challenging to organize and potentially costly when busy, time-poor clinician-educators are distributed across many geographical locations. This Teaching Tip shares our insights about developing and delivering a set of novel clinical teacher resources for veterinarians and veterinary nurses/technologists new to clinical teaching. The resources, underpinned by the principles of participatory design, integrate contemporary clinical educational theories with practical strategies and are interwoven with video clips capturing staff and student perspectives on key topics. While initially focused on creating just an online resource, we ultimately produced an A6 ring-bound booklet version and face-to-face workshops. In this article, we unpack considerations involved in committing to such a project and designing and creating the resources. We hope that this information may be of use to others when developing similar resources.

Ambivalent professional identity of early remedial medical students from Generation Z: a qualitative study

BACKGROUND

Supporting professional identity development in medical students undergoing remediation in the first few years of their studies is an important topic. However, there is a lack of research on developing an effective and individualised process for successful remediation that targets learner identities. This study examined the identities of Generation Z remedial medical students through the lens of professional identity formation, focusing on the difficulties they faced and the support they sought.

METHODS

An exploratory qualitative case study was conducted within a constructivist paradigm. Twenty-two medical students (14 males and 8 females) who had experienced remediation in their first few years of medical university participated in this study. All participants were members of Generation Z. Qualitative data were collected through face-to-face, semi-structured interviews and analysed using thematic analysis.

RESULTS

Medical students undergoing remediation in the first few years experienced resistance to the medical profession and conflict due to the gap between the ideal and the reality they experienced after entering medical university. Students' professional identities were closely intertwined with their pre-university identities; this affected the process of professional identity formation after entering medical university. They preferred assurances of confidentiality as a prerequisite and immediately sought advice through social networks to support their professional identity development.

CONCLUSIONS

When planning professional identity development support for Generation Z medical students undergoing remediation in the first few years, it is necessary to carefully select integrative interaction methods, focus on the context of individual learners, and collaboratively discuss specific responses between students and faculty. The results of this study could be useful to faculty in developing support systems for future remedial medical students that focuses on professional identity development and mentoring of remedial medical students.

Associations between admissions factors and the need for remediation

This study examines the way in which student characteristics and pre-admissions measures are statistically associated with the likelihood a student will require remediation for academic and professionalism offenses. We anchor our inquiry within Irby and Hamstra's (2016) conceptual framework of constructs of professionalism. Data from five graduating cohorts (2014-2018) from McMaster University (Hamilton, Canada) (N = 1,021) were retroactively collected and analyzed using traditional and multinominal logistic regression analyses. The relationship among student characteristics, pre-admissions variables, and referral for potential remediation both by occurrence (yes/no) as well as type (academic/professional/no referral) were examined separately. Findings indicate that gender (OR = 0.519, 95% CI 0.326-0.827, p < 0.01) and undergraduate grade point average (GPA) (OR = 0.245, 95% CI 0.070-0.855, p < 0.05) were significantly associated with instances of referral for potential professionalism and academic remediation, respectively. Women were less likely than men to require remediation for professionalism (OR = 0.332, 95% CI 0.174-0.602, p < 0.001). Undergraduate GPAs (OR = 0.826, 95% CI 0.021-0.539, p < 0.01) were significantly associated with remediation for academic reasons. Lower undergraduate GPAs were associated with a higher likelihood of remediation. These findings point to the admissions variables that are associated with instances that prompt referral for potential remediation. Where associations are not significant, we consider the application of different conceptualizations of professionalism across periods of admissions and training. We encourage those involved in applicant selection and student remediation to emphasize the importance of the interactions that occur between personal and contextual factors to influence learner behaviour and professional identity formation.

Remediation in Practice: A Polarity to be Managed

Originally developed in the business literature, a polarity is a concept where 2 distinctive and opposing characteristics (poles), each presenting advantages and disadvantages or opportunities and pitfalls, must both be taken into account to ensure effective management of a challenging problem. Managing a polarity is a thorny endeavor because it entails striving to maximize the benefits of both poles while simultaneously minimizing or controlling the downsides of each. Previous investigations into stakeholder conceptualizations of remediation led us to suggest that remediation is framed in stakeholders' minds simultaneously as an educational endeavor (ie, the remediatee needs educational support to regain full competence) and a regulatory act (ie, the revocation of the individual's professional right to self-regulate their practice and learning). In this article, we argue that viewing remediation for practicing physicians as a polarity to be managed offers a framework that can further the conversation about how to address some of remediation's challenges.

Understanding the impact of academic difficulties among medical students: A scoping review

BACKGROUND

Many medical students may encounter a range of academic and personal challenges during their course of study, but very little is known about their experiences. Our aim was to review the literature to inform future scholarship and to inform policy change.

METHODS

A scoping review was conducted searching PubMed, MEDLINE, EMBASE, PsycInfo, British Education Index, Web of Science and ERIC for English language primary research with no date limits. This retrieved 822 papers of which eight met the requirements for inclusion in the review. Data were independently reviewed by two researchers and underwent thematic analysis by the research team.

RESULTS

Three major themes emerged. Theme 1: 'Identity preservation' addressed students' aim to preserve their sense of self in the face of academic difficulty and their tendency to seek support. This connected the apprehension many students expressed about their educational institutions to Theme 2: 'The dual role of the medical school'-medical schools are required to support struggling students but are predominantly seen as a punitive structure acting as the gatekeeper to a successful career in medicine. Students' apprehension and attempts to protect their identities within this complex landscape often resulted in 'maladaptive coping strategies' (Theme 3).

CONCLUSION

Understanding and exploring the academic challenges faced by medical students through their own experiences highlight the need for the development of more individualised remediation strategies. Educators may need to do more to bridge the gap between students and institutions. There is a need to build trust and to work with students to enhance their sense of self and remediate approaches to engagement with learning, rather than focusing efforts on success in assessments and progression.

Remediation Programs for Regulated Health Care Professionals: A Scoping Review

PURPOSE

Clinical competence is essential for providing safe, competent care and is regularly assessed to ensure health care practitioners maintain competence. When deficiencies in competence are identified, practitioners may undergo remediation. However, there is limited evidence regarding the effectiveness of remediation programs. The purpose of this review is to examine the purpose, format, and outcomes of remediation programs for regulated health care practitioners.

METHODS

All six stages of the scoping review process as recommended by Levac et al were undertaken. A search was conducted within MEDLINE, Embase, CINAHL, ERIC, gray literature databases, and websites of Canadian provincial regulatory bodies. Emails were sent to Registrars of Canadian regulatory bodies to supplement data gathered from their websites.

RESULTS

A total of 14 programs were identified, primarily for physicians (n = 8). Reasons for remediation varied widely, with some programs identifying multiple reasons for referral such as deficiencies in recordkeeping (n = 7) and clinical skills (n = 6). Most programs (n = 9) were individualized to address specific deficiencies in competence. The process of remediation followed three stages: (1) assessment, (2) active remediation, and (3) reassessment. Most programs (n = 12) reported that remediation was effective in improving competence.

CONCLUSIONS

Regulatory bodies should consider implementing individualized remediation programs to ensure that clinicians' deficiencies in competence are addressed effectively. Further research is indicated, using reliable and valid outcome measures to assess competence immediately after remediation programs and beyond.

The do's, don'ts and don't knows of redressing differential attainment related to race/ethnicity in medical schools

INTRODUCTION

Systematic and structural inequities in power and privilege create differential attainment whereby differences in average levels of performance are observed between students from different socio-demographic groups. This paper reviews the international evidence on differential attainment related to ethnicity/race in medical school, drawing together the key messages from research to date to provide guidance for educators to operationalize and enact change and identify areas for further research.

METHODS

Authors first identified areas of conceptual importance within differential attainment (learning, assessment, and systems/institutional factors) which were then the focus of a targeted review of the literature on differential attainment related to ethnicity/race in medical education and, where available and relevant, literature from higher education more generally. Each author then conducted a review of the literature and proposed guidelines based on their experience and research literature. The guidelines were iteratively reviewed and refined between all authors until we reached consensus on the Do's, Don'ts and Don't Knows.

RESULTS

We present 13 guidelines with a summary of the research evidence for each. Guidelines address assessment practices (assessment design, assessment formats, use of assessments and post-hoc analysis) and educational systems and cultures (student experience, learning environment, faculty diversity and diversity practices).

CONCLUSIONS

Differential attainment related to ethnicity/race is a complex, systemic problem reflective of unequal norms and practices within broader society and evident throughout assessment practices, the learning environment and student experiences at medical school. Currently, the strongest empirical evidence is around assessment processes themselves. There is emerging evidence of minoritized students facing discrimination and having different learning experiences in medical school, but more studies are needed. There is a pressing need for research on how to effectively redress systemic issues within our medical schools, particularly related to inequity in teaching and learning.

Emotion in remediation: A scoping review of the medical education literature

OBJECTIVES

Remediation can be crucial and high stakes for medical learners, and experts agree it is often not optimally conducted. Research from other fields indicates that explicit incorporation of emotion improves education because of emotion's documented impacts on learning. Because this could present an important opportunity for improving remediation, we aimed to investigate how the literature on remediation interventions in medical education discusses emotion.

METHODS

The authors used Arksey and O'Malley's framework to conduct a scoping literature review of records describing remediation interventions in medical education, using PubMed, CINAHL Complete, ERIC, Web of Science and APA PsycInfo databases, including all English-language publications through 1 May 2020 meeting search criteria. They included publications discussing remediation interventions either empirically or theoretically, pertaining to physicians or physician trainees of any level. Two independent reviewers used a standardised data extraction form to report descriptive information; they reviewed included records for the presence of mentions of emotion, described the mentions and analysed results thematically.

RESULTS

Of 1644 records, 199 met inclusion criteria and were reviewed in full. Of those, 112 (56%) mentioned emotion in some way; others focused solely on cognitive aspects of remediation. The mentions of emotion fell into three themes based on when the emotion was cited as present: during regular coursework or practice, upon referral for remediation and during remediation. One-quarter of records (50) indicated potential intentional incorporation of emotion into remediation programme design, but they were non-specific as to how emotions related to the learning process itself.

CONCLUSION

Even though emotion is omnipresent in remediation, medical educators frequently do not factor emotion into the design of remediation approaches and rarely explicitly utilise emotion to improve the learning process. Applications from other fields may help medical educators leverage emotion to improve learning in remediation, including strategies to frame and design remediation.

Predicting failure before it happens: A 5-year, 1042 participant prospective study

PURPOSE OF THE ARTICLE

Students who fail assessments are at risk of negative consequences, including emotional distress and cessation of studies. Identifying students at risk of failure before they experience difficulties may considerably improve their outcomes.

METHODS

Using a prospective design, we collected simple measures of engagement (formative assessment scores, compliance with routine administrative tasks, and attendance) over the first 6 weeks of Year 1. These measures were combined to form an engagement score which was used to predict a summative examination sat 14 weeks after the start of medical school. The project was repeated for five cohorts, giving a total sample size of 1042.

RESULTS

Simple linear regression showed engagement predicted performance (R²_adj = 0.03, F(1,1040) = 90.09, p < 0.001) with a small effect size. More than half of failing students had an engagement score in the lowest two deciles.

CONCLUSIONS

At-risk medical students can be identified with some accuracy immediately after starting medical school using routinely collected, easily analysed data, allowing for tailored interventions to support students. The toolkit provided here can reproduce the predictive model in any equivalent educational context. Medical educationalists must evaluate how the advantages of early detection are balanced against the potential invasiveness of using student data.

Optimising the delivery of remediation programmes for doctors: A realist review

CONTEXT

Medical underperformance puts patient safety at risk. Remediation, the process that seeks to 'remedy' underperformance and return a doctor to safe practice, is therefore a crucially important area of medical education. However, although remediation is used in health care systems globally, there is limited evidence for the particular models or strategies employed. The purpose of this study was to conduct a realist review to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety.

METHOD

We conducted a realist literature review consistent with RAMESES standards. We developed a programme theory of remediation by carrying out a systematic search of the literature and through regular engagement with a stakeholder group. We searched bibliographic databases (MEDLINE, EMBASE, PsycINFO, HMIC, CINAHL, ERIC, ASSIA and DARE) and conducted purposive supplementary searches. Relevant sections of text relating to the programme theory were extracted and synthesised using a realist logic of analysis to identify context-mechanism-outcome configurations (CMOcs).

RESULTS

A 141 records were included. The majority of the studies were from North America (64%). 29 CMOcs were identified. Remediation programmes are effective when a doctor's insight and motivation are developed and behaviour change reinforced. Insight can be developed by providing safe spaces, using advocacy to promote trust and framing feedback sensitively. Motivation can be enhanced by involving the doctor in remediation planning, correcting causal attribution, goal setting and destigmatising remediation. Sustained change can be achieved by practising new behaviours and skills, and through guided reflection.

CONCLUSION

Remediation can work when it creates environments that trigger behaviour change mechanisms. Our evidence synthesis provides detailed recommendations on tailoring implementation and design strategies to improve remediation interventions for doctors.

Management of residents in difficulty in a Swiss general internal medicine outpatient clinic: Change is necessary!

AIMS OF THE STUDY

Residents in difficulty are a major cause for concern in medical education, with a prevalence of 7-15%. They are often detected late in their training and cannot make use of remediation plans. Nowadays, most training hospitals in Switzerland do not have a specific program to identify and manage residents in difficulty. The aim of the study was to explore the challenges perceived by physicians regarding the process of identifying, diagnosing, and supporting residents in difficulty in a structured and programmatic way. We explored perceptions of physicians at different hierarchical levels (residents (R), Chief residents (CR), attending physicians (A), Chief Physician (CP)) in order to better understand these challenges.

METHODS

We conducted an exploratory qualitative study between December 2015 and July 2016. We asked volunteers from the Primary Care Division of the Geneva University Hospitals to partake to three focus groups (with CR, A, R) and one interview with the division's CP. We transcribed, coded, and qualitatively analyzed the three focus groups and the interview, using a content thematic approach and Fishbein's conceptual framework.

RESULTS

We identified similarities and differences in the challenges of the management of residents in difficulty on a programmatic way amongst physicians of different hierarchical levels. Our main findings: Supervisors (CR, A, CP) have good identification skills of residents in difficulty, but they did not put in place systematic remediation strategies.Supervisors (CR, A) were concerned about managing residents in difficulty. They were aware of the possible adverse effects on patient care, but "feared to harm" resident's career by documenting a poor institutional assessment.Residents "feared to share" their own difficulties with their supervisors. They thought that it would impact their career negatively.The four physician's hierarchical level reported environmental constraints (lack of funding, time constraint, lack of time and resources…).

CONCLUSION

Our results add two perspectives to specialized recommendations regarding the implementation of remediation programs for residents in difficulty. The first revolves around the need to identify and fully understand not only the beliefs but also the implicit norms and the feeling of self-efficacy that are shared by teachers and that are likely to motivate them to engage in the management of residents in difficulty. The second emphasizes the importance of analyzing these elements that constitute the context for a change and of identifying, in close contact with the heads of the institutions, which factors may favor or hinder it. This research action process has fostered awareness and discussions at different levels. Since then, various actions and processes have been put in place at the Faculty of Medicine in Geneva.

Early Detection and Remediation of Problem Learners

There are myriad types of problem learners in surgical residency and most have difficulty in more than 1 competency. Programs that use a standard curriculum of study and assessment are most successful in identifying struggling learners early. Many problem learners lack appropriate systems for study; a multidisciplinary educational team that is separate from the team that evaluates the success of remediation is critical. Struggling residents who require formal remediation benefit from performance improvement plans that clearly outline the issues of concern, describe the steps required for remediation, define success of remediation, and outline consequences for failure to remediate appropriately.

Remediation of Underperformance in Surgical Trainees - A Scoping Review

OBJECTIVE

Surgical trainees with significant underperformance require formal support to return to an expected standard, termed remediation. The aim of this scoping review was to define remediation interventions, approaches, and contexts.

DESIGN

Following scoping review protocols, we set out to identify the evidence-base for remediation of surgical trainees, outline key concepts and uncover areas to stimulate further research.

RESULTS

From a screen of 80 articles, 24 reported on remediation of surgical trainees. Most were from medical journals (n = 21, 88%) and published in the United States (n = 20, 83%). Ten articles (41%) reported outcomes of remediation of a trainee cohort and 7 (19%) were survey reports from surgical directors. The remainder were a mix of commentaries, editorials or reviews. Thirteen articles (54%) described trainees with deficiencies in multiple competencies, 8 articles (33%) had a singular focus on academic performance, and 1 article (3%) on technical skills. All articles used targeted individualized remediation strategies, a range of intervention methods (some multimodal) and recommended a 6- to 12-month period of remediation (n = 7, 29%). The program director was often the only supervisor (n = 12, 50%). One article reported trainees' perspective of the process and one used educational theory to inform remediation.

CONCLUSIONS

Data with clearly reported outcomes were limited, but we found that targeted, individualized, multimodal and long-term remediation covering a range of competencies have been reported in the literature for surgical trainees. There is a need for development of explicit frameworks, strengthen the support for supervisors and trainees and further apply educational theory to develop better interventions that remediate deficiencies for all competencies.

Redefining scholarship for health professions education: AMEE Guide No. 142

Scholarship is an integral aspect of academia. It shapes the practice of individuals and the field and is often used to inform career progression decisions and policies. This makes it high stakes. Yet it is complex, and ambiguous. Definitions vary and the term does not necessarily translate well across contexts. In this AMEE guide, our aim is to establish a contemporary definition of scholarship which is appropriate to health professions education (HPE). Our specific objectives are to provide guidance to support colleagues in their career development as professional educators and to challenge biases and assumptions about scholarship which may still exist in educational systems and structures. Ultimately, we hope that this work will advance the stature/standing of scholarship in the field. We provide a general definition of scholarship and how this relates to the scholarship of teaching (and learning) (SoT[L]) and scholarly teaching. Drawing on Boyer's seminal work, we describe different types of scholarship and reflect on how these apply to HPE, before moving on to describe different types of engagement with scholarship in HPE, including scope of contribution and influence. Using cases and examples, we illustrate differences in scholarly engagement across stages of a career, contexts, and ways of engaging. We provide guidance on how to assess 'quality' of scholarship. We offer practical advice for health professions' educators seeking academic advancement. We advocate that institutional leaders consider their systems and structures, so that these align with faculty work patterns, and judge teaching and professional practice appropriately. We conclude by offering a new definition of scholarship in HPE.

Remediation programmes for practising doctors to restore patient safety: the RESTORE realist review

Background

An underperforming doctor puts patient safety at risk. Remediation is an intervention intended to address underperformance and return a doctor to safe practice. Used in health-care systems all over the world, it has clear implications for both patient safety and doctor retention in the workforce. However, there is limited evidence underpinning remediation programmes, particularly a lack of knowledge as to why and how a remedial intervention may work to change a doctor’s practice.

Objectives

To (1) conduct a realist review of the literature to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety; and (2) provide recommendations on tailoring, implementation and design strategies to improve remediation interventions for doctors.

Design

A realist review of the literature underpinned by the Realist And MEta-narrative Evidence Syntheses: Evolving Standards quality and reporting standards.

Data sources

Searches of bibliographic databases were conducted in June 2018 using the following databases: EMBASE, MEDLINE, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, Education Resources Information Center, Database of Abstracts of Reviews of Effects, Applied Social Sciences Index and Abstracts, and Health Management Information Consortium. Grey literature searches were conducted in June 2019 using the following: Google Scholar (Google Inc., Mountain View, CA, USA), OpenGrey, NHS England, North Grey Literature Collection, National Institute for Health and Care Excellence Evidence, Electronic Theses Online Service, Health Systems Evidence and Turning Research into Practice. Further relevant studies were identified via backward citation searching, searching the libraries of the core research team and through a stakeholder group.

Review methods

Realist review is a theory-orientated and explanatory approach to the synthesis of evidence that seeks to develop programme theories about how an intervention produces its effects. We developed a programme theory of remediation by convening a stakeholder group and undertaking a systematic search of the literature. We included all studies in the English language on the remediation of practising doctors, all study designs, all health-care settings and all outcome measures. We extracted relevant sections of text relating to the programme theory. Extracted data were then synthesised using a realist logic of analysis to identify context–mechanism–outcome configurations.

Results

A total of 141 records were included. Of the 141 studies included in the review, 64% related to North America and 14% were from the UK. The majority of studies (72%) were published between 2008 and 2018. A total of 33% of articles were commentaries, 30% were research papers, 25% were case studies and 12% were other types of articles. Among the research papers, 64% were quantitative, 19% were literature reviews, 14% were qualitative and 3% were mixed methods. A total of 40% of the articles were about junior doctors/residents, 31% were about practicing physicians, 17% were about a mixture of both (with some including medical students) and 12% were not applicable. A total of 40% of studies focused on remediating all areas of clinical practice, including medical knowledge, clinical skills and professionalism. A total of 27% of studies focused on professionalism only, 19% focused on knowledge and/or clinical skills and 14% did not specify. A total of 32% of studies described a remediation intervention, 16% outlined strategies for designing remediation programmes, 11% outlined remediation models and 41% were not applicable. Twenty-nine context–mechanism–outcome configurations were identified. Remediation programmes work when they develop doctors’ insight and motivation, and reinforce behaviour change. Strategies such as providing safe spaces, using advocacy to develop trust in the remediation process and carefully framing feedback create contexts in which psychological safety and professional dissonance lead to the development of insight. Involving the remediating doctor in remediation planning can provide a perceived sense of control in the process and this, alongside correcting causal attribution, goal-setting, destigmatising remediation and clarity of consequences, helps motivate doctors to change. Sustained change may be facilitated by practising new behaviours and skills and through guided reflection.

Limitations

Limitations were the low quality of included literature and limited number of UK-based studies.

Future work

Future work should use the recommendations to optimise the delivery of existing remediation programmes for doctors in the NHS.

Study registration

This study is registered as PROSPERO CRD42018088779.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 11. See the NIHR Journals Library website for further project information.

Supporting students with academic difficulties

INTRODUCTION

Up 15% of health professions students experience academic difficulties. We describe an early tracking system that effectively identifies and supports students with performance deficiencies. The objectives of this study were to discuss changes made in an academic success system at our new college of pharmacy, describe effectiveness of the updated program after one-year of use, and present changes that are being discussed based on the faculty and student feedback.

METHODS

We conducted in-person faculty interviews using open-ended questions to evaluate the effectiveness of our original program for supporting students with academic difficulties called the Early Tracking System (ETS). We then developed a new program titled the Individualized Plan for Academic Success System (IPASS). We conducted more faculty interviews and a student survey after the implementation of IPASS to evaluate its effectiveness.

RESULTS

In the 2018-2019 academic year at our institution, IPASS was activated 291 times, of which there were 27 course failures. The results of our study indicated a pass rate of 90.72% post-IPASS for all pharmacy students.

CONCLUSIONS

The goal of this study was to revise and implement an early tracking system that all faculty members, students, and administrators can utilize efficiently and effectively. This study demonstrated that students with academic difficulties have the potential for progression if their deficiencies are detected early. We described a unique system by which we addressed the needs of the at-risk students. The interview of faculty and survey of students indicated satisfaction with IPASS.

Remediation for surgical trainees: recommendations from a narrative review

BACKGROUND

Remediation involves formalized support for surgical trainees with significant underperformance to return to expected standards. There is a need to understand current evidence of remediation for surgical trainees to inform practice and justify investment of resources.

METHODS

Following the principles of a systematic review, we conducted a narrative analysis to make recommendations for remediation of underperforming surgical trainees.

RESULTS

From a review of 55 articles on remediation of trainees in medical and surgical sub-specialities, we have identified system and process level recommendations. Remediation is reported as long-term, complex and resource-intensive. Establishing a defined and standardized remediation framework enables co-ordination of multi-modal interventions. System level recommendations aim to consolidate protocols via developing better assessment, intervention and re-evaluation modalities whilst also strengthening support to supervisors conducting the remediation. Process level recommendations should be tailored for the specific needs of each trainee, aiming to be proactive with interventions within a programmatic framework. Regular reassessment is required, and long-term follow-up shows that remediation efforts are often successful.

CONCLUSION

While remediation within a programmatic framework is complex, it is often a successful approach to return surgical trainees to their expected standard. Future directions involve applying learning theories, encouraging research methods and to develop integrated collaborate protocols and support to synergize efforts.

Medical students with performance difficulties need wide support: Initial results of an academic tutoring program

BACKGROUND

Even students with previous academic success may face challenges that affect their academic performance. Many medical schools offer programs to students at the risk of academic failure, to ensure that they succeed in the course.

OBJECTIVE AND METHODS

In this report we describe a pioneering academic tutoring program developed at a Brazilian medical school and discuss the initial results of the program based on the feedback from tutors and data regarding the progression of students in the medical course.

RESULTS

In 2018, 33 students enrolled into the program. Students' performance difficulties were mainly associated with mental health problems and socioeconomic vulnerability. Of the 33 students, 27 (81.8%) were assisted by the Mental Health Support Service and 16 (48.5%) were assisted by the Social Assistance Service. In addition to the planning academic activity class load, tutors were able to assist students in solving socioeconomic issues, carrying out personal support interventions with the promotion of self-esteem, and presenting suggestions for behavioral changes in their routine. For most students (72%), the action plan proposed by the tutors was successful. Eight of the 14 (57%) students in the fourth year progressed to the final two years of in-hospital practical training (internship).

CONCLUSIONS

The Academic Tutoring Program showed positive results for most of the students. Close monitoring and tutor intervention allowed students with poor academic performance to overcome the low performance cycle. These important tasks demand time and energy from tutors, and institutional recognition of these professionals is essential for the successful maintenance of the program.

The Surgical Knowledge "Growth Curve": Predicting ABSITE Scores and Identifying "At-Risk" Residents

OBJECTIVE

Resident performance on the American Board of Surgery In-Training Examination (ABSITE) is used for evaluation of surgical knowledge and guides resident selection for institutional remediation programs. Remediation thresholds have historically been based on ABSITE percentile scores; however, this does not account for predictors that can impact a resident's exam performance. We sought to identify predictors of yearly ABSITE performance to help identify residents "at-risk" for performing below their expected growth trajectory.

DESIGN

The knowledge of the residents, as measured by standardized ABSITE scores, was modeled as a function of the corresponding postgraduate year via a linear mixed effects regression model. Additional model covariates included written USMLE-1-3 examination scores, gender, number of practice questions completed, and percentage correct of practice questions. For each resident, the predicted ABSITE standard score along with a 95% bootstrap prediction interval was obtained. Both resident-specific and population-level predictions for ABSITE standard scores were also estimated.

SETTING

The study was conducted at a single, large academic medical center (Massachusetts General Hospital, Boston, MA).

PARTICIPANTS

Six years of general surgery resident score reports at a single institution between 2014 and 2019 were deidentified and analyzed.

RESULTS

A total of 376 score reports from 130 residents were analyzed. Covariates that had a significant effect on the model included USMLE-1 score (PGY1: p = 0.013; PGY2: p = 0.007; PGY3: p = 0.011), USMLE-2 score (PGY1: p < 0.001; PGY2: p < 0.001; PGY3: p < 0.001; PGY4: p < 0.001; PGY5: p = 0.032), male gender (PGY1: p = 0.003; PGY2: p < 0.001; PGY3: p < 0.001; PGY4: p = 0.008), and number of practice questions completed (p=0.003). Five residents were identified as having "fallen off" their predicted knowledge curve, including a single resident on 2 occasions. Population prediction curves were obtained at 7 different covariate percentile levels (5%, 10%, 25%, 50%, 75%, 90%, and 95%) that could be used to plot predicted resident knowledge progress.

CONCLUSION

Performance on USMLE-1 and -2 examinations, male gender, and number of practice questions completed were positive predictors of ABSITE performance. Creating residency-wide knowledge growth curves as well as individualized predictive ABSITE performance models allows for more efficient identification of residents potentially at risk for poor ABSITE performance and structured monitoring of surgical knowledge progression.

Remediation and reassessment methods in pharmacy education: A systematic review

BACKGROUND

Colleges of pharmacy are currently required to implement a remediation program within their curricula, but no specifications are provided on the ideal methodology. While the need for successful remediation strategies continues to grow, literature describing positive or negative outcomes of different approaches is significantly lacking. The objective of this literature review was to describe and evaluate remediation methodologies in pharmacy education.

METHODS

This literature review was completed following PRISMA criteria. A search of the PubMed, Cochrane Library, Cumulative Index of Nursing and Allied Health, Academic Search Complete, PsycInfo, Scopus, and ProQuest Central databases was conducted in July 2019. Studies were included if they involved pharmacy student education and described either remediation or reassessment.

RESULTS

The evaluated studies discussed a range of course types being remediated, a large variety of remediation strategies and timeframes, and differing overall outcomes. No studies provided comparison of remediation techniques or provided details on the implementation of their chosen approaches. A consistent finding within the evaluated studies was the inclusion of prevention strategies to attempt to avoid the need for remediation preemptively. Overall outcomes for each remedial program were inconsistent and no clear patterns were evident other than an improvement in student performance following remediation.

IMPLICATIONS

Remediation strategies included course repetition, summer restudy, reassessment, and individualized plans. Outcomes varied significantly between studies, making methodology comparisons difficult. Future studies that include more detail and consistency in the reported outcomes would be beneficial to students and help clarify remediation for colleges of pharmacy.

Remediation Through Transformation: Applying Educational Theory to the Struggling Resident

The struggling medical resident is faced with many adaptive challenges that may require change in mindset. However, formal remediation within graduate medical education (GME) often employs overly structured technical solutions to address trainee deficiencies. These strategies may ultimately fail to result in sustained improvement. Transformative learning (TL) is an educational theory that has recently been explored as a teaching modality in health professions education. In 2013, Cranton published a three-part framework for TL. This framework, composed of the cognitive perspective, beyond rational TL, and TL for social change, has potential applications to GME remediation, specifically in helping individuals to overcome adaptive challenges. These strategies may be particularly useful within the traditionally difficult-to-remediate competencies of systems-based practice, practice-based learning and improvement, and professionalism. The authors provide a descriptive overview of each of Cranton's perspectives, introducing concrete examples drawn from the medical literature. This article will contrast current remediation strategies with those using TL theory in order to assist graduate medical educators in applying these principles to the remediation of their own struggling residents.

Seeing but not believing: Insights into the intractability of failure to fail

CONTEXT

Inadequate documentation of observed trainee incompetence persists despite research-informed solutions targeting this failure to fail phenomenon. Documentation could be impeded if assessment language is misaligned with how supervisors conceptualise incompetence. Because frameworks tend to itemise competence as well as being vague about incompetence, assessment design may be improved by better understanding and describing of how supervisors experience being confronted with a potentially incompetent trainee.

METHODS

Following constructivist grounded theory methodology, analysis using a constant comparison approach was iterative and informed data collection. We interviewed 22 physicians about their experiences supervising trainees who demonstrate incompetence; we quickly found that they bristled at the term 'incompetence,' so we began to use 'underperformance' in its place.

RESULTS

Physicians began with a belief and an expectation: all trainees should be capable of learning and progressing by applying what they learn to subsequent clinical experiences. Underperformance was therefore unexpected and evoked disbelief in supervisors, who sought alternate explanations for the surprising evidence. Supervisors conceptualised underperformance as: an inability to engage with learning due to illness, a life event or learning disorders, so that progression was stalled, or an unwillingness to engage with learning due to lack of interest, insight or humility.

CONCLUSION

Physicians conceptualise underperformance as problematic progression due to insufficient engagement with learning that is unresponsive to intensified supervision. Although failure to fail tends to be framed as a reluctance to document underperformance, the prior phase of disbelief prevents confident documentation of performance and delays identification of underperformance. The findings offer further insight and possible new solutions to address under-documentation of underperformance.

Principles of Remediation for the Struggling Neurosurgery Resident

BACKGROUND

When resident physicians fail to demonstrate appropriate milestone competencies early in their neurologic surgery residency, a plan of remediation is necessary.

METHODS

Once any psychologic, physical, or behavioral causes of identified knowledge or psychomotor deficiencies have been identified and addressed, the next step is to develop a plan to close these gaps. Specific areas that are assessed for deficits include medical knowledge, clinical reasoning and judgment, clinical skills, time management and organization, interpersonal skills, communication, and professionalism. Specific learning goals and objectives, as well as teaching and learning methods, pertain to the unique areas of deficit, and all of these must be considered with the goal of developing a resident-specific remediation plan.

RESULTS

A plan for assessment of the remediation process is described, including an evaluation of what constitutes individual resident remediation success.

CONCLUSIONS

Finally, a discussion of the prior resident remediation studies across many disciplines is made.

A qualitative exploration of the lived experience of GP trainees failing to progress in training

Challenges facing general practice are multiple and extreme. Amongst them is the increasing difficulty of recruiting and retaining General Practitioners (GPs). GPs cite heavy workload, work-related stress, little family time and psychological ill-health as factors influencing their decisions to leave or reduce working hours. Analysis of the literature suggests that these factors, amongst others, are present in GP training and trainees have similar experiences. An in-depth understanding of the challenges trainees in difficulty face is lacking.Our research aim was to better understand the factors that trainees perceive contribute to their failure to progress in training. A qualitative approach was adopted using semi-structured interviews with GP trainees identified as failing to progress satisfactorily or failing the MRCGP examinations. Interviews were audio-recorded and transcribed. Thematic analysis was used to understand the unique experiences of GP trainees and find common themes.Twenty-three interview transcripts were analysed. Emergent themes were presented using a framework of three distinct categories to aid data organisation and allocating themes and sub-themes: professional factors, personal factors, and social factors. Difficulties with managing work-load, poor motivation, lack of family time and psychological ill-health were significant themes for many. This study supports the evidence that difficulties facing GPs take root in training. Failure to fully understand trainees' journeys and associated challenges reduces opportunities to provide bespoke packages of care and remediation that fully address their needs.

Role of formative assessment in predicting academic success among GP registrars: a retrospective longitudinal study

OBJECTIVES

The James Cook University General Practice Training (JCU GPT) programme's internal formative exams were compared with the Royal Australian College of General Practitioners (RACGP) pre-entry exams to determine ability to predict final performance in the RACGP fellowship exams.

DESIGN

A retrospective longitudinal study.

SETTING

General Practice (GP) trainees enrolled between 2016 and 2019 at a Registered Training Organisation in regional Queensland, Australia.

PARTICIPANTS

376 GP trainees enrolled in the training programme.

EXPOSURE MEASURES

The pre-entry exams were Multiple-Mini Interviews (MMI), Situational Judgement Test (SJT) and Candidate Assessment and Applied Knowledge Test. The internal formative exams comprised multiple choice questions (MCQ1 and MCQ2), short answer questions, clinical skills and clinical reasoning.

PRIMARY OUTCOME MEASURE

The college exams were Applied Knowledge Test (AKT), Key Feature Problems (KFP) and Objective Structured Clinical Examination (OSCE).

RESULTS

Correlations (r), coefficients of determination (R²) and OR were used as parameters for estimating strength of relationship and precision of predictive accuracy. SJT and MMI were moderately (r=0.13 to 0.31) and MCQ1 and MCQ2 highly (r=0.37 to 0.53) correlated with all college exams (p<0.05 to p<0.01), with R² ranging from 0.070 to 0.376. MCQ1 was predictive of failure in all college exams (AKT: OR=2.32, KFP: OR=3.99; OSCE: OR=3.46); while MCQ2 predicted failure in AKT (OR=2.83) and KFP (OR=3.15).

CONCLUSION

We conclude that the internal MCQ formative exams predict performance in the RACGP fellowship exams. We propose that our formative assessment tools could be used as academic markers for early identification of potentially struggling trainees.

Impact of Intersession Course Remediation on NAPLEX/PCOA Scores in an Accelerated Doctor of Pharmacy Program

Objective. To compare Pharmacy Curriculum Outcomes Assessment (PCOA) scaled scores and North American Pharmacist Licensure Examination (NAPLEX) pass rates in students who completed a two-week intersession remediation or repeated a course with the scaled scores and pass rates of students who did not require any form of didactic remediation and did not have to repeat a course. Methods. Data examined for this study included NAPLEX/PCOA scores, NAPLEX pass/fail status, and remediation history for students at one college of pharmacy. Students from the graduating classes of 2016, 2017, and 2018 were organized into four groups: non-remediation, one course remediation and no repeats, more than one course remediation and no repeats, and one or more course repeats. Differences were analyzed using linear regression, logistic regression, and Pearson correlations. Results. The PCOA scores for students in the remediation groups were significantly lower than scores for students in the non-remediation groups, with a reduction of 37.8 to 50.9 points from the expected non-remediators' score. The NAPLEX scores for students who remediated more than one course or repeated one or more courses were 16-20 points lower compared to students who did not remediate. The likelihood of a student failing the NAPLEX was also not significantly lower for students who remediated one course but was significantly lower for other remediation groups. Conclusion. Although single course remediation in this curricular model appears to have minimal impact on NAPLEX outcomes and may be an acceptable intervention for many students, additional support and interventions may be warranted for students who qualify for remediation in multiple courses and/or for repeating a course.