The remediation challenge: theoretical and methodological insights from a systematic review

Diagnostic Reasoning Assessment Toolkit: Guided Reflection and Standardized Cases for At-Risk Final-Year Medical Students

INTRODUCTION

A failing diagnostic reasoning performance may represent student deficiency in a number of potential areas. However, many standard clinical skills assessments do not offer detailed assessments of diagnostic reasoning ability. This toolkit was designed to identify specific learner deficiencies with respect to diagnostic reasoning by focusing on individual student remedial work and by standardizing faculty evaluation.

METHODS

Educational objectives were derived from institutional patient care competency learning objectives at the Indiana University School of Medicine. Review of existing clinical skills remediation literature yielded a design that combined two learning methods: guided reflection and standardized patient cases.

RESULTS

Over the 2014-2015 academic year, 12 final-year medical students used this resource to help develop an individual remedial learning plan prior to retaking a failed standardized assessment. Students were generally satisfied with the combined guided reflection and standardized case learning methods.

DISCUSSION

Unique final-year medical student scheduling pressures, combined with a reporting time line for both institutional high-stakes OSCE remediation exams and the USMLE Step 2 Clinical Skills exam, incentivized failing students to schedule a retest on a short time line, often leaving little time for critical preparation. This resource offered an opportunity to efficiently spend limited preparation time to individualize exam preparation using a variety of faculty facilitators. The simplistic design was readily deployable to multiple faculty remediation mentors. Our institution can now provide a standardized diagnostic reasoning remedial evaluation using numerous clinical faculty based at any of our nine campuses.

Exploring the value and role of integrated supportive science courses in the reformed medical curriculum iMED: a mixed methods study

BACKGROUND

Heterogeneous basic science knowledge of medical students is an important challenge for medical education. In this study, the authors aimed at exploring the value and role of integrated supportive science (ISS) courses as a novel approach to address this challenge and to promote learning basic science concepts in medical education. ISS courses were embedded in a reformed medical curriculum.

METHODS

The authors used a mixed methods approach including four focus groups involving ISS course lecturers and students (two each), and five surveys of one student cohort covering the results of regular student evaluations including the ISS courses across one study year. They conducted their study at the University Medical Center Hamburg-Eppendorf between December 2013 and July 2014.

RESULTS

Fourteen first-year medical students and thirteen ISS course lecturers participated in the focus groups. The authors identified several themes focused on the temporal integration of ISS courses into the medical curriculum, the integration of ISS course contents into core curriculum contents, the value and role of ISS courses, and the courses' setting and atmosphere. The integrated course concept was positively accepted by both groups, with participants suggesting that it promotes retention of basic science knowledge. Values and roles identified by focus group participants included promotion of basic understanding of science concepts, integration of foundational and applied learning, and maximization of students' engagement and motivation. Building close links between ISS course contents and the core curriculum appeared to be crucial. Survey results confirmed qualitative findings regarding students' satisfaction, with some courses still requiring optimization.

CONCLUSIONS

Integration of supportive basic science courses, traditionally rather part of premedical education, into the medical curriculum appears to be a feasible strategy to improve medical students' understanding of basic science concepts and to increase their motivation and engagement.

Who is repeating anatomy? Trends in an undergraduate anatomy course

Anatomy courses frequently serve as prerequisites or requirements for health sciences programs. Due to the challenging nature of anatomy, each semester there are students remediating the course (enrolled in the course for a second time), attempting to earn a grade competitive for admissions into a program of study. In this retrospective study, remediation rates and trends in an undergraduate anatomy course with over 400 students enrolled each semester at a large Midwestern university were identified. Demographic data was collected from spring 2004 to spring 2010, including students' age, ethnicity, major of study, class standing, college admission tests (ACT and SAT®) scores, anatomy laboratory and lecture examination scores, and final anatomy grades for each semester. Eleven percent of the students repeated the course at least once. Gender, ethnicity, major of study and SAT scores were all shown to be associated with whether or not a student would need to repeat the course. On average, students who repeated anatomy demonstrated significant improvements in lecture and laboratory scores when comparing first and second enrollments in anatomy, and therefore also saw improved final course grades in their second enrollment. These findings will aid future instructors to identify and assist at-risk students to succeed in anatomy. Instructors from other institutions may also find the results to be useful for identifying students at risk for struggling.

Team Objective Structured Bedside Assessment (TOSBA) as formative assessment in undergraduate Obstetrics and Gynaecology: a cohort study

BACKGROUND

Team Objective Structured Bedside Assessment (TOSBA) is a learning approach in which a team of medical students undertake a set of structured clinical tasks with real patients in order to reach a diagnosis and formulate a management plan and receive immediate feedback on their performance from a facilitator. TOSBA was introduced as formative assessment to an 8-week undergraduate teaching programme in Obstetrics and Gynaecology (O&G) in 2013/14. Each student completed 5 TOSBA sessions during the rotation. The aim of the study was to evaluate TOSBA as a teaching method to provide formative assessment for medical students during their clinical rotation. The research questions were: Does TOSBA improve clinical, communication and/or reasoning skills? Does TOSBA provide quality feedback?

METHODS

A prospective cohort study was conducted over a full academic year (2013/14). The study used 2 methods to evaluate TOSBA as a teaching method to provide formative assessment: (1) an online survey of TOSBA at the end of the rotation and (2) a comparison of the student performance in TOSBA with their performance in the final summative examination.

RESULTS

During the 2013/14 academic year, 157 students completed the O&G programme and the final summative examination . Each student completed the required 5 TOSBA tasks. The response rate to the student survey was 68 % (n = 107/157). Students reported that TOSBA was a beneficial learning experience with a positive impact on clinical, communication and reasoning skills. Students rated the quality of feedback provided by TOSBA as high. Students identified the observation of the performance and feedback of other students within their TOSBA team as key features. High achieving students performed well in both TOSBA and summative assessments. The majority of students who performed poorly in TOSBA subsequently passed the summative assessments (n = 20/21, 95 %). Conversely, the majority of students who failed the summative assessments had satisfactory scores in TOSBA (n = 6/7, 86 %).

CONCLUSIONS

TOSBA has a positive impact on the clinical, communication and reasoning skills of medical students through the provision of high-quality feedback. The use of structured pre-defined tasks, the observation of the performance and feedback of other students and the use of real patients are key elements of TOSBA. Avoiding student complacency and providing accurate feedback from TOSBA are on-going challenges.

When students struggle with gross anatomy and histology: A strategy for monitoring, reviewing, and promoting student academic success in an integrated preclinical medical curriculum

Gross anatomy and histology are now often taught as parts of an integrated medical or dental curriculum. Although this puts these foundational basic sciences into a wider educational context, students may not fully appreciate their importance as essential components of their medical education and may not develop a sufficient level of competency, as they are not stand-alone courses. The early identification of medical or dental students who struggle with anatomy or histology and the facilitation of adequate didactic support constitute a significant problem in an integrated curriculum. The timely intervention by an academic review board in combination with an individualized faculty-mediated counseling and remediation process may provide an effective solution to this problem.

Time to Loosen the Apron Strings: Cohort-based Evaluation of a Learner-driven Remediation Model at One Medical School

BACKGROUND

Remediation in the era of competency-based assessment demands a model that empowers students to improve performance.

AIM

To examine a remediation model where students, rather than faculty, develop remedial plans to improve performance.

SETTING/PARTICIPANTS

Private medical school, 177 medical students.

PROGRAM DESCRIPTION

A promotion committee uses student-generated portfolios and faculty referrals to identify struggling students, and has them develop formal remediation plans with personal reflections, improvement strategies, and performance evidence. Students submit reports to document progress until formally released from remediation by the promotion committee.

PROGRAM EVALUATION

Participants included 177 students from six classes (2009-2014). Twenty-six were placed in remediation, with more referrals occurring during Years 1 or 2 (n = 20, 76 %). Unprofessional behavior represented the most common reason for referral in Years 3-5. Remedial students did not differ from classmates (n = 151) on baseline characteristics (Age, Gender, US citizenship, MCAT) or willingness to recommend their medical school to future students (p < 0.05). Two remedial students did not graduate and three did not pass USLME licensure exams on first attempt. Most remedial students (92 %) generated appropriate plans to address performance deficits.

DISCUSSION

Students can successfully design remedial interventions. This learner-driven remediation model promotes greater autonomy and reinforces self-regulated learning.

Medical students' personal experience of high-stakes failure: case studies using interpretative phenomenological analysis

BACKGROUND

Failing a high-stakes assessment at medical school is a major event for those who go through the experience. Students who fail at medical school may be more likely to struggle in professional practice, therefore helping individuals overcome problems and respond appropriately is important. There is little understanding about what factors influence how individuals experience failure or make sense of the failing experience in remediation. The aim of this study was to investigate the complexity surrounding the failure experience from the student's perspective using interpretative phenomenological analysis (IPA).

METHODS

The accounts of three medical students who had failed final re-sit exams, were subjected to in-depth analysis using IPA methodology. IPA was used to analyse each transcript case-by-case allowing the researcher to make sense of the participant's subjective world. The analysis process allowed the complexity surrounding the failure to be highlighted, alongside a narrative describing how students made sense of the experience.

RESULTS

The circumstances surrounding students as they approached assessment and experienced failure at finals were a complex interaction between academic problems, personal problems (specifically finance and relationships), strained relationships with friends, family or faculty, and various mental health problems. Each student experienced multi-dimensional issues, each with their own individual combination of problems, but experienced remediation as a one-dimensional intervention with focus only on improving performance in written exams. What these students needed to be included was help with clinical skills, plus social and emotional support. Fear of termination of the their course was a barrier to open communication with staff.

CONCLUSIONS

These students' experience of failure was complex. The experience of remediation is influenced by the way in which students make sense of failing. Generic remediation programmes may fail to meet the needs of students for whom personal, social and mental health issues are a part of the picture.

The struggling student: a thematic analysis from the self-regulated learning perspective

CONTEXT

Students who engage in self-regulated learning (SRL) are more likely to achieve academic success compared with students who have deficits in SRL and tend to struggle with academic performance. Understanding how poor SRL affects the response to failure at assessment will inform the development of better remediation.

METHODS

Semi-structured interviews were conducted with 55 students who had failed the final re-sit assessment at two medical schools in the UK to explore their use of SRL processes. A thematic analysis approach was used to identify the factors, from an SRL perspective, that prevented students from appropriately and adaptively overcoming failure, and confined them to a cycle of recurrent failure.

RESULTS

Struggling students did not utilise key SRL processes, which caused them to make inappropriate choices of learning strategies for written and clinical formats of assessment, and to use maladaptive strategies for coping with failure. Their normalisation of the experience and external attribution of failure represented barriers to their taking up of formal support and seeking informal help from peers.

CONCLUSIONS

This study identified that struggling students had problems with SRL, which caused them to enter a cycle of failure as a result of their limited attempts to access formal and informal support. Implications for how medical schools can create a culture that supports the seeking of help and the development of SRL, and improves remediation for struggling students, are discussed.

Twelve tips for addressing medical student and resident physician lapses in professionalism

Medical educators have gained significant ground in the practical and scholarly approach to professionalism. When a lapse occurs, thoughtful remediation to address the underlying issue can have a positive impact on medical students and resident physicians, while failure to address lapses, or to do so ineffectively, can have long-term consequences for learners and potentially patients. Despite these high stakes, educators are often hesitant to address lapses in professionalism, possibly due to a lack of time and familiarity with the process. Attention must be paid to generalizable, hands-on recommendations for daily use so that clinicians and administrators feel well equipped to tackle this often difficult yet valuable task. This article reviews the literature related to addressing unprofessional behavior among trainees in medicine and connects it to the shared experience of medical educators at one institution. The framework presented aims to provide practical guidance and empowerment for educators responsible for addressing medical student and resident physician lapses in professionalism.

Correlating students' educational background, study habits, and resource usage with learning success in medical histology

Histology is a traditional core basic science component of most medical and dental education programs and presents a didactic challenge for many students. Identifying students that are likely to struggle with histology would allow for early intervention to support and encourage their learning success. To identify student characteristics that are associated with learning success in histology, three first-year medical school classes at the University of Michigan (>440 students) were surveyed about their educational background, attitudes toward learning histology, and their use of histology learning strategies and resources. These characteristics were linked with the students' quiz and examination results in histology. Students who reported previous experience in histology or pathology and hold science or biomedical science college degrees usually did well in histology. Learning success in histology was also positively associated with students' perception that histology is important for their professional career. Other positive indicators were in-person participation in teacher-guided learning experiences, specifically lecture and laboratory sessions. In contrast, students who relied on watching histology lectures by video rather than going to lectures in-person performed significantly worse. These characteristics and learning strategies of students who did well in this very visual and challenging study subject should be of help for identifying and advising students early, who might be at risk of failing a histology course or component.

Developmental student support in undergraduate medical education: AMEE Guide No. 92

Developmental student support has a focus on developing the whole person, not only academic and clinical competence. The positive and proactive developmental approach is in marked contrast to the deficit and reactive approach to student support which only targets identified students who are considered to be "at risk". The medical school is a nexus for personal development, combining the personal identity formation journey of early adulthood with the variety of new experiences in medical school. Important aspects of developmental student support are the development of resilience and ensuring reasonable adjustments for students with learning difficulties and disabilities. Careers guidance is an essential aspect of developmental student support, including students with doubts about a career in medicine and who are leaving because of poor performance. Developmental student support requires an organizational culture in which student support is considered as the responsibility of everyone, with further support from named personal tutors.

Failure to fail: the institutional perspective

PURPOSE

To determine institutional barriers to placing failing students on probation, dismissing students.

METHODS

An online survey study was distributed to Student Affairs Deans or the equivalent at allopathic (MD) and osteopathic (DO) medical schools, and physician assistant (PA) and nurse practitioner (NP) schools across the United States. Nineteen (40%) of the 48 schools responded: six MD, four DO, five PA and four NP. The survey contained demographic questions and questions regarding probation and dismissal. Themes were independently coded and combined via consensus based on grounded theory. The survey was distributed until saturation of qualitative responses were achieved.

RESULTS

Respondents identified variations in the use of probation and dismissal and a wide range of barriers, with the greatest emphasis on legal concerns. Respondents felt that students were graduating who should not be allowed to graduate, and that the likelihood of a student being placed on probation or being terminated was highly variable.

DISCUSSION

Our results suggest that institution culture at heath professions schools across the United States may represent an obstacle in placing failing learners on probation and dismissing learners who should not graduate. Additional studies are needed to prove if these concerns are founded or merely fears.

Twelve tips for providing effective student support in undergraduate medical education

Medical students often require high levels of specialised institutional and personal support to facilitate success. Contributory factors may include personality type, course pressures and financial hardship. Drawing from research literature and the authors' experience, 12 tips are listed under five subheadings: policy and systems; people and resources; students; delivering support; limits of support. The 12 tips provide guidance to organisations and individual providers that encourages implementation of good practice and helps them better visualise their role within the system. By following the tips, medical schools can make more effective provisions for the expected, diverse and sometimes specialist needs of their students. Schools must take a proactive, anticipatory approach to provide appropriately for their entire student body. This ensures that students receive the best quality support, are more likely to succeed and are adequately prepared for their medical careers.

Prediction and prevention of failure: an early intervention to assist at-risk medical students

BACKGROUND

Consistent identification and prevention of failure for at-risk medical students is challenging, failing courses is costly to all stakeholders, and there is need for further research into duration, timing and structure of interventions to help students in difficulty.

AIMS

To verify the value of a new exam two weeks into medical school as a predictor of failure, and explore the requirements for a preventative intervention.

METHODS

Students who failed the two-week exam were invited to a series of large-group workshops and small-group follow-up meetings. Participants' subsequent exam performance was compared with non-participants.

RESULTS

About 71% of students who performed poorly in the new exam subsequently failed a course. Attendance at the workshops made no difference to short- or long-term pass rates. Attendance at more than three follow-up small group sessions significantly improved pass rates two semesters later, and was influenced by teacher experience.

CONCLUSIONS

Close similarity between predictor task and target task is important for accurate prediction of failure. Consideration should be given to dose effect and class size in the prevention of failure of at-risk students, and we recommend a systemic approach to intervention/remediation programmes, involving a whole semester of mandatory, weekly small group meetings with experienced teachers.

Remediation of at-risk medical students: theory in action

BACKGROUND

Previous work has shown that a programme that draws on a blend of theories makes a positive difference to outcomes for students who fail and repeat their first semester at medical school. Exploration of student and teacher perspectives revealed that remediation of struggling medical students can be achieved through a cognitive apprenticeship within a small community of inquiry. This community needs expert teachers capable of performing a unique combination of roles (facilitator, nurturing mentor, disciplinarian, diagnostician and role model), with high levels of teaching presence and practical wisdom. Yet, despite participants' convergent opinions on the elements of effective remediation, significant differences were found between outcomes of students working with experienced and inexperienced teachers. The current study explores the actual practice of teachers on this remediation course, aiming to exemplify elements of our theory of remediation and explore differences between teachers.

METHODS

Since it is in the classroom context that the interactions that constitute the complex process of remediation emerge, this practice-based research has focused on direct observation of classroom teaching. Nineteen hours of small group sessions were recorded and transcribed. Drawing on ethnography and sociocultural discourse analysis, selected samples of talk-in-context demonstrate how the various elements of remediation play out in practice, highlighting aspects that are most effective, and identifying differences between experienced and novice teachers.

RESULTS

Long-term student outcomes are strongly correlated to teacher experience (r, 0.81). Compared to inexperienced teachers, experienced teachers provide more challenging, disruptive facilitation, and take a dialogic stance that encourages more collaborative group dynamics. They are more expert at diagnosing cognitive errors, provide frequent metacognitive time-outs and make explicit links across the curriculum.

CONCLUSIONS

Remediation is effective in small groups where dialogue is used for collaborative knowledge construction and social regulation. This requires facilitation by experienced teachers who attend to details of both content and process, and use timely interventions to foster curiosity and the will to learn. These teachers should actively challenge students' language use, logical inconsistencies and uncertainties, problematize their assumptions, and provide a metacognitive regulatory voice that can generate attitudinal shifts and nurture the development of independent critical thinkers.

Profiling strugglers in a graduate-entry medicine course at Nottingham: a retrospective case study

BACKGROUND

10-15% of students struggle at some point in their medicine course. Risk factors include weaker academic qualifications, male gender, mental illness, UK ethnic minority status, and poor study skills. Recent research on an undergraduate medicine course provided a toolkit to aid early identification of students likely to struggle, who can be targeted by established support and study interventions. The present study sought to extend this work by investigating the number and characteristics of strugglers on a graduate-entry medicine (GEM) programme.

METHODS

A retrospective study of four GEM entry cohorts (2003-6) was carried out. All students who had demonstrated unsatisfactory progress or left prematurely were included. Any information about academic, administrative, personal, or social difficulties, were extracted from their course progress files into a customised database and examined.

RESULTS

362 students were admitted to the course, and 53 (14.6%) were identified for the study, of whom 15 (4.1%) did not complete the course. Students in the study group differed from the others in having a higher proportion of 2ii first degrees, and scoring less well on GAMSAT, an aptitude test used for admission. Within the study group, it proved possible to categorise students into the same groups previously reported (struggler throughout, pre-clinical struggler, clinical struggler, health-related struggler, borderline struggler) and to identify the majority using a number of flags for early difficulties. These flags included: missed attendance, unsatisfactory attitude or behaviour, health problems, social/family problems, failure to complete immunity status checks, and attendance at academic progress committee.

CONCLUSIONS

Problems encountered in a graduate-entry medicine course were comparable to those reported in a corresponding undergraduate programme. A toolkit of academic and non-academic flags of difficulty can be used for early identification of many who will struggle, and could be used to target appropriate support and interventions.