Optimising the delivery of remediation programmes for doctors: A realist review

"I'm on an island": A qualitative study of underperforming surgical trainee perspectives on remediation

BACKGROUND

There is a significant gap in the literature regarding trainees' perceptions of remediation. This study aims to explore surgical trainees' experiences and perspectives of remediation.

METHODS

This qualitative study used semi-structured interviews with 11 doctors who have experienced formal remediation as a surgical trainee. Reflexive thematic analysis was used for data analysis.

RESULTS

In this study, trainees perceived remediation as a harrowing and isolating experience, with long-lasting emotions. There was a perceived lack of clarity regarding explanations of underperformance and subjective goals. Remediation was viewed as a 'performance' and tick-box exercise with superficial plans, with challenging trainee/supervisor dynamics.

CONCLUSIONS

These findings about trainees' perspectives on remediation show a need for trainees to be better emotionally supported during remediation and that remediation plans must be improved to address deficits. Integrating the perspectives and experiences of surgical trainees who have undergone remediation should help improve remediation outcomes and patient care.

Locum doctors in English general practices: evidence from a national survey

BACKGROUND

Locum doctors give practices flexibility to deliver patient services but there are concerns about the impact of locum working on continuity of care, patient safety, team function, and cost.

AIM

To explore locum working in English general practices, and understand why and where locum doctors were needed and how they were engaged, supported, perceived, and managed.

DESIGN AND SETTING

An online survey was sent to 3745 practices.

METHOD

Quantitative responses were analysed using frequency tables, t-tests, and correlations. Free-text responses were analysed using thematic analysis.

RESULTS

In total, 605 (16.2%) responses were returned between June and December 2021. Practices made frequent use of locums, preferring regular locums familiar with processes and patients. Disadvantages of agency locums included cost, lack of patient familiarity, and impact on continuity of care. Care provided by locums was generally viewed as the same but sometimes worse compared with permanent GPs. Some practices reported that locums did not always perform the full range of duties, resulting in increased workload for other staff. Practices were largely unfamiliar with national guidance for organisations engaging locums, and, although processes such as verifying documentation were conducted, far fewer responders reported providing feedback, support for revalidation, or professional development.

CONCLUSION

Locum working is an essential part of English general practice, but this research raises some concerns about the robustness of arrangements for locum working and the impact on quality and safety of care. Further research is needed about the clinical practice and performance of locums, and to explore how locum working can be organised in ways that assure safe and high-quality care.

The role of feedback in supporting trainees who underperform in clinical environments

Introduction

Underperformance in clinical environments can be costly and emotional for all stakeholders. Feedback is an important pedagogical strategy for working with underperformance - both formal and informal strategies can make a difference. Feedback is a typical feature of remediation programs, and yet there is little consensus on how feedback should unfold in the context of underperformance.

Methods

This narrative review synthesises literature at the intersections of feedback and underperformance in clinical environments where service, learning and safety need to be considered. We do so with a critical eye towards generating insights for working with underperformance in the clinical environment.

Synthesis and discussion

There are compounding and multi-level factors that contribute to underperformance and subsequent failure. This complexity overwrites simplistic notions of 'earned' failure through individual traits and deficit. Working with such complexity requires feedback that goes beyond educator input or 'telling'. When we shift beyond feedback as input to process, we recognise that these processes are fundamentally relational, where trust and safety are necessary for trainees to share their weaknesses and doubts. Emotions are always present and they signal action. Feedback literacy might help us consider how to engage trainees with feedback so that they take an active (autonomous) role in developing their evaluative judgements. Finally, feedback cultures can be influential and take effort to shift if at all. A key mechanism running through all these considerations of feedback is enabling internal motivation, and creating conditions for trainees to feel relatedness, competence and autonomy. Broadening our perceptions of feedback, beyond telling, might help create environments for learning to flourish.

Applying and reporting relevance, richness and rigour in realist evidence appraisals: Advancing key concepts in realist reviews

The realist review/synthesis has become an increasingly prominent methodological approach to evidence synthesis that can inform policy and practice. While there are publication standards and guidelines for the conduct of realist reviews, published reviews often provide minimal detail regarding how they have conducted some methodological steps. This includes selecting and appraising evidence sources, which are often considered for their 'relevance, richness and rigour.' In contrast to other review approaches, for example, narrative reviews and meta-analyses, the inclusion criteria and appraisal of evidence within realist reviews depend less on the study's methodological quality and more on its contribution to our understanding of generative causation, uncovered through the process of retroductive theorising. This research brief aims to discuss the current challenges and practices for appraising documents' relevance, richness and rigour and to provide pragmatic suggestions for how realist reviewers can put this into practice.

Grand rounds in methodology: when are realist reviews useful, and what does a 'good' realist review look like?

Research in the quality and safety field often necessitates an approach that supports the development of an in-depth understanding of how a complex phenomenon occurs, or how an intervention works. Realist review is an increasingly popular form of evidence synthesis that provides a theory-driven, interpretive approach to secondary research. Realist reviews offer quality and safety researchers the opportunity to draw on diverse types of evidence to develop explanatory theory about how, when and for whom interventions 'work' or outcomes occur. The approach is flexible, iterative and practical, typically drawing on the experience of policymakers, practitioners and patients throughout the review. With the increasing use of realist reviews, some common misconceptions about the approach have become evident in the literature. This paper introduces what is involved when planning and conducting a realist review, and where the approach can offer most value, as well as outlining common challenges that researchers may face when adopting the approach, and recommended solutions. Our aim is to support researchers who are considering conducting a realist review to understand the key principles and concepts involved, and how they can go about producing high-quality work.

Changing Primary School Children's Engagement in Active School Travel Using Safe Routes to School Interventions: A Rapid Realist Review

Safe Routes to School (SR2S) interventions have been implemented in many economically developed countries to improve children's engagement in Active School Travel (AST). Evaluations have highlighted inconsistencies in SR2S intervention outcomes, raising questions as to how, why, and under what contextual conditions these interventions work. This review used a Rapid Realist Review (RRR) methodology to build, test, and refine an overarching program theory that unpicks the contextual factors and underlying mechanisms influencing children's engagement in AST. From the 45 included documents, 16 refined Context-Mechanism-Outcome Configurations (CMOCs) were developed and clustered into three partial program theories (i.e., implementor/implementation, child, and parent), with the associated mechanisms of: (1) School Reliance; (2) School Priority; (3) Fun; (4) Pride; (5) Perceived Safety; (6) Distrust; (7) Convenience; (8) Perceived Capabilities; and (9) Reassurance. The overarching program theory delineates the pathways between intervention implementation, children's motivation, parental decision-making, and children's engagement in AST. The findings suggest SR2S interventions can motivate children to engage in AST, but whether this motivation is translated into engagement is determined by parental decision-making. This review is novel for highlighting that many of the factors influencing parental decision-making are contextually driven and appear to be unaddressed by the current suite of SR2S intervention strategies. The review additionally highlights the complexity of parental perceptions of safety, with the traffic and the road environment shaping only part of this multidimensional mechanism. Practitioners and policymakers need to tailor SR2S interventions to local contexts to better influence parental decision-making for children's engagement in AST.

Strangers in a strange land: The experience of physicians undergoing remediation

INTRODUCTION

The experience of remediation in practising physicians has not been widely studied. Remediatees frequently present negative emotions, but observers can only infer the underlying reasons behind these. Understanding remediatees' perspectives may help those mandating and organising remediation to structure the process in ways that improve the experience for all concerned parties and maximise chances of a successful outcome for remediatees.

METHODS

Seventeen physicians who had undergone remediation for clinical competence concerns were interviewed via telephone. Participant data were first iteratively analysed thematically and then reanalysed using a narrative mode of analysis for each participant in order to understand the stories as wholes. Figured worlds (FW) theory was used as a lens for analysing the data for this constructivist research study.

RESULTS

Participants entering the FW of remediation perceived that their position as a 'good doctor' was threatened. Lacking experience with this world and with little available support to help them navigate it, participants used their agency to draw on various discursive threads within the FW to construct a narrative account of their remediation. In their narratives, participants tended to position themselves either as victims of regulatory bodies or as resilient individuals who could make the best of a difficult situation. In both cases, the chosen discursive threads enabled them to maintain their self-identity as 'good doctor'.

CONCLUSION

Remediation poses a threat to a physician's professional and personal identity. Focusing mainly on the educational aspect of remediation-that is, the improvement in knowledge and skills-risks missing its impact on physician identity. We need to ensure not only that we support physicians in dealing with this identity threat but that our assessment and remediation processes do not inadvertently encourage remediatees to draw on discursive threads that lead them to see themselves as victims.

Post graduate remediation programs in medicine: a scoping review

BACKGROUND

Recognizing that physicians may struggle to achieve knowledge, skills, attitudes and or conduct at one or more stages during their training has highlighted the importance of the 'deliberate practice of improving performance through practising beyond one's comfort level under guidance'. However, variations in physician, program, contextual and healthcare and educational systems complicate efforts to create a consistent approach to remediation. Balancing the inevitable disparities in approaches and settings with the need for continuity and effective oversight of the remediation process, as well as the context and population specific nature of remediation, this review will scrutinise the remediation of physicians in training to better guide the design, structuring and oversight of new remediation programs.

METHODS

Krishna's Systematic Evidence Based Approach is adopted to guide this Systematic Scoping Review (SSR in SEBA) to enhance the transparency and reproducibility of this review. A structured search for articles on remediation programs for licenced physicians who have completed their pre-registration postings and who are in training positions published between 1st January 1990 and 31st December 2021 in PubMed, Scopus, ERIC, Google Scholar, PsycINFO, ASSIA, HMIC, DARE and Web of Science databases was carried out. The included articles were concurrently thematically and content analysed using SEBA's Split Approach. Similarities in the identified themes and categories were combined in the Jigsaw Perspective and compared with the tabulated summaries of included articles in the Funnelling Process to create the domains that will guide discussions.

RESULTS

The research team retrieved 5512 abstracts, reviewed 304 full-text articles and included 101 articles. The domains identified were characteristics, indications, frameworks, domains, enablers and barriers and unique features of remediation in licenced physicians in training programs.

CONCLUSION

Building upon our findings and guided by Hauer et al. approach to remediation and Taylor and Hamdy's Multi-theories Model, we proffer a theoretically grounded 7-stage evidence-based remediation framework to enhance understanding of remediation in licenced physicians in training programs. We believe this framework can guide program design and reframe remediation's role as an integral part of training programs and a source of support and professional, academic, research, interprofessional and personal development.

Remediation in Practice: A Polarity to be Managed

Originally developed in the business literature, a polarity is a concept where 2 distinctive and opposing characteristics (poles), each presenting advantages and disadvantages or opportunities and pitfalls, must both be taken into account to ensure effective management of a challenging problem. Managing a polarity is a thorny endeavor because it entails striving to maximize the benefits of both poles while simultaneously minimizing or controlling the downsides of each. Previous investigations into stakeholder conceptualizations of remediation led us to suggest that remediation is framed in stakeholders' minds simultaneously as an educational endeavor (ie, the remediatee needs educational support to regain full competence) and a regulatory act (ie, the revocation of the individual's professional right to self-regulate their practice and learning). In this article, we argue that viewing remediation for practicing physicians as a polarity to be managed offers a framework that can further the conversation about how to address some of remediation's challenges.

Enhancing remediation by focusing on affective experience

Colonnello offers the affective neuroscience view as a means for better understanding the role of emotions in remediation and nurturing synergistic interactions between research and education.

Emotion in remediation: A scoping review of the medical education literature

OBJECTIVES

Remediation can be crucial and high stakes for medical learners, and experts agree it is often not optimally conducted. Research from other fields indicates that explicit incorporation of emotion improves education because of emotion's documented impacts on learning. Because this could present an important opportunity for improving remediation, we aimed to investigate how the literature on remediation interventions in medical education discusses emotion.

METHODS

The authors used Arksey and O'Malley's framework to conduct a scoping literature review of records describing remediation interventions in medical education, using PubMed, CINAHL Complete, ERIC, Web of Science and APA PsycInfo databases, including all English-language publications through 1 May 2020 meeting search criteria. They included publications discussing remediation interventions either empirically or theoretically, pertaining to physicians or physician trainees of any level. Two independent reviewers used a standardised data extraction form to report descriptive information; they reviewed included records for the presence of mentions of emotion, described the mentions and analysed results thematically.

RESULTS

Of 1644 records, 199 met inclusion criteria and were reviewed in full. Of those, 112 (56%) mentioned emotion in some way; others focused solely on cognitive aspects of remediation. The mentions of emotion fell into three themes based on when the emotion was cited as present: during regular coursework or practice, upon referral for remediation and during remediation. One-quarter of records (50) indicated potential intentional incorporation of emotion into remediation programme design, but they were non-specific as to how emotions related to the learning process itself.

CONCLUSION

Even though emotion is omnipresent in remediation, medical educators frequently do not factor emotion into the design of remediation approaches and rarely explicitly utilise emotion to improve the learning process. Applications from other fields may help medical educators leverage emotion to improve learning in remediation, including strategies to frame and design remediation.

Remediation programmes for practising doctors to restore patient safety: the RESTORE realist review

Background

An underperforming doctor puts patient safety at risk. Remediation is an intervention intended to address underperformance and return a doctor to safe practice. Used in health-care systems all over the world, it has clear implications for both patient safety and doctor retention in the workforce. However, there is limited evidence underpinning remediation programmes, particularly a lack of knowledge as to why and how a remedial intervention may work to change a doctor’s practice.

Objectives

To (1) conduct a realist review of the literature to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety; and (2) provide recommendations on tailoring, implementation and design strategies to improve remediation interventions for doctors.

Design

A realist review of the literature underpinned by the Realist And MEta-narrative Evidence Syntheses: Evolving Standards quality and reporting standards.

Data sources

Searches of bibliographic databases were conducted in June 2018 using the following databases: EMBASE, MEDLINE, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, Education Resources Information Center, Database of Abstracts of Reviews of Effects, Applied Social Sciences Index and Abstracts, and Health Management Information Consortium. Grey literature searches were conducted in June 2019 using the following: Google Scholar (Google Inc., Mountain View, CA, USA), OpenGrey, NHS England, North Grey Literature Collection, National Institute for Health and Care Excellence Evidence, Electronic Theses Online Service, Health Systems Evidence and Turning Research into Practice. Further relevant studies were identified via backward citation searching, searching the libraries of the core research team and through a stakeholder group.

Review methods

Realist review is a theory-orientated and explanatory approach to the synthesis of evidence that seeks to develop programme theories about how an intervention produces its effects. We developed a programme theory of remediation by convening a stakeholder group and undertaking a systematic search of the literature. We included all studies in the English language on the remediation of practising doctors, all study designs, all health-care settings and all outcome measures. We extracted relevant sections of text relating to the programme theory. Extracted data were then synthesised using a realist logic of analysis to identify context–mechanism–outcome configurations.

Results

A total of 141 records were included. Of the 141 studies included in the review, 64% related to North America and 14% were from the UK. The majority of studies (72%) were published between 2008 and 2018. A total of 33% of articles were commentaries, 30% were research papers, 25% were case studies and 12% were other types of articles. Among the research papers, 64% were quantitative, 19% were literature reviews, 14% were qualitative and 3% were mixed methods. A total of 40% of the articles were about junior doctors/residents, 31% were about practicing physicians, 17% were about a mixture of both (with some including medical students) and 12% were not applicable. A total of 40% of studies focused on remediating all areas of clinical practice, including medical knowledge, clinical skills and professionalism. A total of 27% of studies focused on professionalism only, 19% focused on knowledge and/or clinical skills and 14% did not specify. A total of 32% of studies described a remediation intervention, 16% outlined strategies for designing remediation programmes, 11% outlined remediation models and 41% were not applicable. Twenty-nine context–mechanism–outcome configurations were identified. Remediation programmes work when they develop doctors’ insight and motivation, and reinforce behaviour change. Strategies such as providing safe spaces, using advocacy to develop trust in the remediation process and carefully framing feedback create contexts in which psychological safety and professional dissonance lead to the development of insight. Involving the remediating doctor in remediation planning can provide a perceived sense of control in the process and this, alongside correcting causal attribution, goal-setting, destigmatising remediation and clarity of consequences, helps motivate doctors to change. Sustained change may be facilitated by practising new behaviours and skills and through guided reflection.

Limitations

Limitations were the low quality of included literature and limited number of UK-based studies.

Future work

Future work should use the recommendations to optimise the delivery of existing remediation programmes for doctors in the NHS.

Study registration

This study is registered as PROSPERO CRD42018088779.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 11. See the NIHR Journals Library website for further project information.