Realist methods in medical education research: what are they and what can they contribute?

A Mixed-Methods Realist Analysis of an Interdisciplinary Simulation Intervention for Psychiatry Residents

OBJECTIVES

Simulation research in postgraduate psychiatry remains limited, with minimal studies on interdisciplinary involvement and mechanisms of change. To address these gaps, the authors implemented a mixed-methods realist analysis of an interdisciplinary simulation intervention administered to psychiatry residents.

METHODS

The University of Calgary implemented a simulation intervention for psychiatry residents. Eight junior residents participated in or observed 4 scenarios and eighteen senior residents participated in or observed 8 scenarios. Scenarios lasted 15 minutes with a pre-simulation orientation and post-scenario debrief. Most scenarios involved interdisciplinary staff. Scenarios included agitated and suicidal patients; treatment-related emergencies; and challenging conversations. All residents completed pre- and post-simulation surveys reporting confidence levels. Changes in confidence were analyzed using paired t tests and differences between junior and senior residents' confidence using ANOVA. Eleven residents participated in 2 focus groups. Transcripts were analyzed using a constant comparative model to identify contexts, mechanisms, outcomes, and the relationship between these realist categories. Key themes were extracted using generic theme analysis.

RESULTS

Aggregated survey data demonstrated statistically significant improvements in self-reported confidence for 7 of 8 proposed scenarios, with variations in confidence outcomes between junior and senior residents. Four themes emerged: (1) How Simulations Facilitate Learning, (2) The Role of Pre-simulation Instructions, (3) Factors Facilitating Confidence, (4) Positive Effects of Interdisciplinary Involvement.

CONCLUSIONS

This study identifies possible mechanisms for residents' self-reported improvements in learning and confidence, which may help programs tailor interventions. Furthermore, this study suggests there may be benefits to interdisciplinary simulations, with self-reported outcomes of improved collaboration and safety planning.

Power, recovery and doing something worthwhile: A thematic analysis of expert patient perspectives in psychiatry education

Background

Objective

Design

Results

Conclusion

Patient Contribution

Which human factors design issues are influencing system performance in out-of-hours community palliative care? Integration of realist approaches with an established systems analysis framework to develop mid-range programme theory

OBJECTIVE

To develop mid-range programme theory from perceptions and experiences of out-of-hours community palliative care, accounting for human factors design issues that might be influencing system performance for achieving desirable outcomes through quality improvement.

SETTING

Community providers and users of out-of-hours palliative care.

PARTICIPANTS

17 stakeholders participated in a workshop event.

DESIGN

In the UK, around 30% of people receiving palliative care have contact with out-of-hours services. Interactions between emotions, cognition, tasks, technology and behaviours must be considered to improve safety. After sharing experiences, participants were presented with analyses of 1072 National Reporting and Learning System incident reports. Discussion was orientated to consider priorities for change. Discussions were audio-recorded and transcribed verbatim by the study team. Event artefacts, for example, sticky notes, flip chart lists and participant notes, were retained for analysis. Two researchers independently identified context-mechanism-outcome configurations using realist approaches before studying the inter-relation of configurations to build a mid-range theory. This was critically appraised using an established human factors framework called Systems Engineering Initiative for Patient Safety (SEIPS).

RESULTS

Complex interacting configurations explain relational human-mediated outcomes where cycles of thought and behaviour are refined and replicated according to prior experiences. Five such configurations were identified: (1) prioritisation; (2) emotional labour; (3) complicated/complex systems; (4a) system inadequacies and (4b) differential attention and weighing of risks by organisations; (5) learning. Underpinning all these configurations was a sixth: (6a) trust and access to expertise; and (6b) isolation at night. By developing a mid-range programme theory, we have created a framework with international relevance for guiding quality improvement work in similar modern health systems.

CONCLUSIONS

Meta-cognition, emotional intelligence, and informal learning will either overcome system limitations or overwhelm system safeguards. Integration of human-centred co-design principles and informal learning theory into quality improvement may improve results.

Resilience in advanced cancer caregiving. A systematic review and meta-synthesis

BACKGROUND

Close relatives provide much of the care to people with cancer. As resilience can shield family caregivers from mental health problems, there has been a burgeoning interest in resilience-promoting interventions. However, the evidence necessary for the development of these interventions is scant and unsynthesized.

AIM

To create an overall picture of evidence on resilience in cancer caregiving by a theory-driven meta-synthesis.

DESIGN

In this systematically constructed review a thematic synthesis approach has been applied. The original findings were coded and structured deductively according to the theoretical framework. Consequently, the codes were organized inductively into themes and subthemes.

DATA SOURCES

Through September 2019, five electronic databases were searched for qualitative studies on resilience in cancer caregiving. The search was extended by a supplementary hand search. Seventeen studies met the eligibility criteria.

RESULTS

The elements of resilience, as described in the pre-defined theoretical framework of Bonanno, are reflected in the lived experiences of family caregivers. The resilience process starts with the diagnosis of advanced cancer and may result in mental wellbeing, benefit finding, and personal growth. The process is influenced by context elements such as individual history, sociocultural background, caregiver characteristics, and the behavior of the supportive network. A repertoire of coping strategies that caregivers use throughout the caregiving process moderates the resilience process.

CONCLUSION

This review and theoretical synthesis reveal key elements of resilience in the process of cancer caregiving, including influencing factors and outcomes. Implications and avenues for further research are discussed.

What key conditions and mechanisms generate health inequalities research in different contexts? Study protocol for two realist explanatory case studies

Evidence on health inequalities has grown in recent decades, however, the capacity to generate health inequalities research is uneven, worldwide. A recent bibliometric analysis found notable inequalities of the global production of health inequalities scientific research across countries. What determines the capacity to produce high volumes of health inequalities scientific research, in different settings? What mechanisms are involved? To answer these questions requires in-depth knowledge on the health inequalities research production process, in different settings. We plan to conduct two realist explanatory case studies, to understand why and how particular settings (e.g. the United Kingdom and the city of Barcelona) have generated high volumes of health inequalities research over past decades, and identify the potential key contextual conditions and causal mechanisms involved. This study protocol outlines the rationale and methodology involved, highlights the strengths and limitations of the approach, and provides guidance on how to overcome certain operational challenges and ensure validity of research findings. Valuable learning may be derived from these case experiences, with implications for research, policy and practice. This work can serve as a tool for researcher and planners to guide the development of further case studies to evaluate health inequalities research capacities in other settings.

How rural immersion training influences rural work orientation of medical students: Theory building through realist evaluation

AIM

To develop theory about how contexts and mechanisms interact to contribute to openness to future rural practice by medical students undertaking immersive rural training.

METHODS

A realist evaluation based on RAMESES II protocol. We interviewed 23 students exploring Contexts (C) which were external (place-based) and internal (the student's characteristics), Mechanisms (M) (that drive a response) and Outcomes (O) (openness to rural work).

RESULTS

'Openness to rural work' related to: a desire to live rurally, work in rural medicine, or consider this as a possibility. This was triggered by responses to experience in rural places of an aspirational, intellectual and emotional nature (mechanisms). Students most affected were those with a strong motivation to help others and who value teamwork. Students with clearly envisaged career paths suited to metropolitan areas, or those retaining/prioritising strong social and community ties in metropolitan areas were less likely to commit to future rural work.

CONCLUSION

Our theory indicates multi-level stimuli activates openness. Implications are that rural immersion programs could select students with an orientation towards teamwork, without pre-set professional ideation, and with a strong commitment to helping others. Experiencing rural immersion will trigger aspirational, intellectual and emotional responses leading to rural work openness for such students.

Evaluation of a pilot rural mentorship programme for and by pre-clerkship medical students

Introduction

While medical school interventions can help address rural physician shortages, many urban Canadian medical students lack exposure to rural medicine. The Rural Mentorship Programme (RMP) is a 4-month pilot initiative designed by medical students to bridge this gap by pairing preclerkship medical students at an urban medical school with rural physician mentors to provide exposure to rural careers.

Methods

A realist-influenced methodology evaluated perceived benefits and challenges of RMP, assessed how RMP influenced mentee perceptions and intentions towards rural careers, and investigated factors leading to success. Quantitative and qualitative data were collected through evaluative pre-, post-, and 4-month post intervention surveys, mentor interviews and a mentee focus group. Likert scales assessed satisfaction, attainment of objectives and mentee changes in perceptions and intentions.

Results

18/23 mentees and 11/15 mentors completed at least 1 survey; 5 mentees joined the focus group and 3 mentors were interviewed. Most mentees were of non-rural backgrounds and initially neutral about pursuing rural practice. RMP helped mentees better understand rural careers. They especially valued the mandatory community clinical visit and forming relationships with mentors. Mentors enjoyed teaching, reflecting on their careers and demonstrating the merits of rural practice. Transportation and scheduling were major programme challenges.

Conclusions

This pilot suggests that structured mentorship programmes can improve understanding of, and provide exposure to, careers in rural medicine for urban medical students. Results will inform future programme development.

How can pharmacists develop patient-pharmacist communication skills? A realist synthesis

OBJECTIVE

To understand how pharmacists develop patient-pharmacist communication skills.

METHODS

A realist synthesis approach was used to understand how educational interventions work to improve patient-pharmacist communication. Initial programme theories were developed through a scoping search and stakeholder focus groups (faculty, students, patients and public). A systematic search was then conducted for evidence to test initial theories. Included papers were assessed for relevance and rigour. Extracted data was synthesised to refine the initial programme theories and develop modified programme theories.

RESULTS

Forty-seven papers were included in the final synthesis. Role-play with simulated patients and peers, video recording and lectures were the most widely reported interventions. Repeated practice, feedback, reflection and confidence were among the mechanisms by which interventions work. Modified programme theories relating to interactions of role-play, experiential learning, video recording, self-assessment and workshops were developed.

CONCLUSIONS

Outcomes of communication education interventions are influenced by the level of learner. Educational interventions that promote reflection are particularly useful.

PRACTICAL IMPLICATIONS

There are a wide range of theory-informed interventions, which should be used in a programmatic approach to communications education. A longitudinal programme of communication skills training, with intervention choice based on level of learning, is important.

Optimising the delivery of remediation programmes for doctors: A realist review

CONTEXT

Medical underperformance puts patient safety at risk. Remediation, the process that seeks to 'remedy' underperformance and return a doctor to safe practice, is therefore a crucially important area of medical education. However, although remediation is used in health care systems globally, there is limited evidence for the particular models or strategies employed. The purpose of this study was to conduct a realist review to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety.

METHOD

We conducted a realist literature review consistent with RAMESES standards. We developed a programme theory of remediation by carrying out a systematic search of the literature and through regular engagement with a stakeholder group. We searched bibliographic databases (MEDLINE, EMBASE, PsycINFO, HMIC, CINAHL, ERIC, ASSIA and DARE) and conducted purposive supplementary searches. Relevant sections of text relating to the programme theory were extracted and synthesised using a realist logic of analysis to identify context-mechanism-outcome configurations (CMOcs).

RESULTS

A 141 records were included. The majority of the studies were from North America (64%). 29 CMOcs were identified. Remediation programmes are effective when a doctor's insight and motivation are developed and behaviour change reinforced. Insight can be developed by providing safe spaces, using advocacy to promote trust and framing feedback sensitively. Motivation can be enhanced by involving the doctor in remediation planning, correcting causal attribution, goal setting and destigmatising remediation. Sustained change can be achieved by practising new behaviours and skills, and through guided reflection.

CONCLUSION

Remediation can work when it creates environments that trigger behaviour change mechanisms. Our evidence synthesis provides detailed recommendations on tailoring implementation and design strategies to improve remediation interventions for doctors.

What works for whom in compassion training programs offered to practicing healthcare providers: a realist review

BACKGROUND

Patients and families want their healthcare to be delivered by healthcare providers that are both competent and compassionate. While compassion training has begun to emerge in healthcare education, there may be factors that facilitate or inhibit the uptake and implementation of training into practice. This review identified the attributes that explain the successes and/or failures of compassion training programs offered to practicing healthcare providers.

METHODS

Realist review methodology for knowledge synthesis was used to consider the contexts, mechanisms (resources and reasoning), and outcomes of compassion training for practicing healthcare providers to determine what works, for whom, and in what contexts.

RESULTS

Two thousand nine hundred ninety-one articles underwent title and abstract screening, 53 articles underwent full text review, and data that contributed to the development of a program theory were extracted from 45 articles. Contexts included the clinical setting, healthcare provider characteristics, current state of the healthcare system, and personal factors relevant to individual healthcare providers. Mechanisms included workplace-based programs and participatory interventions that impacted teaching, learning, and the healthcare organization. Contexts were associated with certain mechanisms to effect change in learners' attitudes, knowledge, skills and behaviors and the clinical process.

CONCLUSIONS

In conclusion this realist review determined that compassion training may engender compassionate healthcare practice if it becomes a key component of the infrastructure and vision of healthcare organizations, engages institutional participation, improves leadership at all levels, adopts a multimodal approach, and uses valid measures to assess outcomes.

A participant perspective on collaborative reflection: video-stimulated interviews show what residents value and why

The potential of reflection for learning and development is broadly accepted across the medical curriculum. Our understanding of how exactly reflection yields its educational promise, however, is limited to broad hints at the relation between reflection and learning. Yet, such understanding is essential to the (re)design of reflection education for learning and development. In this qualitative study, we used participants' video-stimulated comments on actual practice to identify features that do or do not make collaborative reflection valuable to participants. In doing so, we focus on aspects of the interactional process that constitute the educational activity of reflection. To identify valuable and less valuable features of collaborative reflection, we conducted one-on-one video-stimulated interviews with Dutch general practice residents about collaborative reflection sessions in their training program. Residents were invited to comment on any aspect of the session that they did or did not value. We synthesized all positively and negatively valued features and associated explanations put forward in residents' narratives into shared normative orientations about collaborative reflection: what are the shared norms that residents display in telling about positive and negative experiences with collaborative reflection? These normative orientations display residents' views on the aim of collaborative reflection (educational value for all) and the norms that allegedly contribute to realizing this aim (inclusivity and diversity, safety, and efficiency). These norms are also reflected in specific educational activities that ostensibly contribute to educational value. As such, the current synthesis of normative orientations displayed in residents' narratives about valuable and less valuable elements of collaborative reflection deepen our understanding of reflection and its supposed connection with educational outcomes. Moreover, the current empirical endeavor illustrates the value of video-stimulated interviews as a tool to value features of educational processes for future educational enhancements.

Leveraging knowledge translation and implementation science in the pursuit of evidence informed health professions education

Evidence informed approaches to health professions education can ensure accountability to learners and society in providing meaningful and effective education and helping resource strained systems via streamlined and cost-efficient practices. Knowledge translation and implementation science are two areas of study originally developed in clinical medicine in response to concerns that health care practices were incongruent with the scientific evidence. Two decades of research have led to important advances in our understanding of the nature and magnitude of research-practice gaps, the factors that support or impede adoption of evidence in clinical decision-making, and in the design and evaluation of theory driven interventions to reduce gaps. This paper borrows concepts from knowledge translation and implementation science to further our thinking about how health professions education can 'truly' be evidence informed. The article is organised in four sections: a discussion of the impetus for the evidence informed health professions education movement; a description of the origins of knowledge translation and implementation science; a discussion on how knowledge translation and implementation science can be leveraged to advance the evidence informed health professions education agenda; and suggestions for future discussion and research. An example is used to illustrate the application of the underpinning principles of knowledge translation and implementation science. The authors suggest a theory driven, staged and systematic approach that integrates knowledge translation principles and processes and involves key stakeholders interested in promoting the application of educational research of evidence.

How does narrative medicine impact medical trainees' learning of professionalism? A qualitative study

BACKGROUND

Narrative medicine (NM) is an approach involving narrative skills and is regarded as a model for medical humanism and effective medical practice. This study aims to explore how NM impacts medical trainees' learning of professionalism during a clerkship in a Taiwanese clinical setting.

METHODS

A qualitative interview study adopting a purposive sampling method was undertaken. Thirty medical trainees participated in this study, including five fifth-year medical students (MSs), ten sixth-year MSs, nine seventh-year MSs, and six postgraduate year (PGY) trainees. Thematic framework analysis was applied, and a modified realist evaluation approach was further used to analyse the interview data.

RESULTS

We identified self-exploration, reflection, and awareness of professional identity as mechanisms explaining how NM impacted professionalism learning in our participants. Furthermore, empathy, communication, doctor-patient relationship and understanding patients were identified as the outcomes of the NM intervention for trainees' learning of professionalism.

CONCLUSIONS

NM facilitates medical trainees' self-exploration, reflection, and awareness of professional identity, thereby affecting their learning of professionalism in clinical settings. Adopting NM as an educational intervention in undergraduate medical education could play an important role in professionalism learning, as trainees can thereby be supported to gradually develop self-exploration and reflection capabilities and heightened awareness of professional identity reflectively through a narrative process.

Opening up the black box of a Gateway to Medicine programme: a realist evaluation

OBJECTIVES

A Gateway to Medicine programme, developed in partnership between a further and higher education setting and implemented to increase the socioeconomic diversity of medicine, was examined to identify precisely what works within the programme and why.

DESIGN

This study employed realist evaluation principles and was undertaken in three phases: document analysis and qualitative focus groups with widening access (WA) programme architects; focus groups and interviews with staff and students; generation of an idea of what works.

SETTING

Participants were recruited from a further/higher education setting and were either enrolled or involved in the delivery of a Gateway to Medicine programme.

PARTICIPANTS

Twelve staff were interviewed either individually (n=3) or in one of three group interviews. Nine focus groups (ranging from 5 to 18 participants in each focus group) were carried out with Gateway students from three consecutive cohorts at 2-3 points in their Gateway programme year.

RESULTS

Data were generated to determine what 'works' in the Gateway programme. Turning a realist lens on the data identified six inter-relating mechanisms which helped students see medicine as attainable and achievable and prepared them for the transition to medical school. These were academic confidence (M1); developing professional identity (M2); financial support/security (M3); supportive relationships with staff (M4) and peers (M5); and establishing a sense of belonging as a university student (M6).

CONCLUSIONS

By unpacking the 'black box' of a Gateway programme through realist evaluation, we have shown that such programmes are not solely about providing knowledge and skills but are rather much more complex in respect to how they work. Further work is needed to further test the mechanisms identified in our study in other contexts for theory development and to identify predictors of effectiveness in terms of students' preparedness to transition.

A realist evaluation exploring simulated patient role-play in pharmacist undergraduate communication training

BACKGROUND

Effective communication between pharmacists and patients is essential and improves health outcomes. Simulated patients (SPs) are trained to reproduce real-life situations and can help pharmacy students to develop and adapt their communication skills in a safe, learner-centred environment. The aim of this research was to explore how SP and pharmacy student role-play supports communication training.

METHODS

A mixed methods realist evaluation approach was adopted to test an initial theory relating to SP role-play for pharmacy students. The intervention tested involved complex communication cases in a men's and women's health module in year three of a new MPharm programme. This SP session was the first such session, of the programme which exclusively focused on complex communication skills for the students. Data collected comprised video-recordings of both training and mock OSCE sessions, and from student focus groups. Communication videos were scored using the Explanation and Planning Scale (EPSCALE) tool. Scores from SP and mock OSCE sessions were compared using the Wilcoxon-signed rank test. Focus groups were conducted with students about their experience of the training and analysed thematically, through a realist lens. Data was analysed for Context-Mechanism-Outcome configurations to produce modified programme theories.

RESULTS

Forty-six students (n = 46/59, 78 %) consented to their video-recorded interactions to be used. Students identified contextual factors relating to the timing within the course and the setting of the intervention, the debrief and student individual contexts. Mechanisms included authenticity, feedback, reflection, self-awareness and confidence. Negative responses included embarrassment and nervousness. They distinguished outcomes including increased awareness of communication style, more structured communication and increased comfort. However quantitative data showed a decrease (p < 0.001) in communication scores in the mock OSCE compared with scores from training sessions. Modified programme theories relating to SP training for pharmacy students were generated.

CONCLUSIONS

SP role-play is a valuable communication skills training approach. Emphasis should be placed on multiple stakeholder feedback and promotion of reflection. Time limits need to be considered in this context and adjusted to meet student needs, especially for students with lower levels of communication comfort and those communicating in languages different to their first language.

Health Care Providers as Agents of Change: Integrating PrEP With Other Sexual and Reproductive Health Services for Adolescent Girls and Young Women

Background: Successful integration of pre-exposure prophylaxis (PrEP) with existing reproductive health services will require iterative learning and adaptation. The interaction between the problem-solving required to implement new interventions and health worker motivation has been well-described in the public health literature. This study describes structural and motivational challenges faced by health care providers delivering PrEP to adolescent girls and young women (AGYW) alongside other SRH services, and the strategies used to overcome them. Methods: We conducted in-depth interviews (IDIs) and focus group discussions (FGDs) with HCWs from two demonstration projects delivering PrEP to AGYW alongside other SRH services. The Prevention Options for the Women Evaluation Research (POWER) is an open label PrEP study with a focus on learning about PrEP delivery in Kenyan and South African family planning, youth mobile services, and public clinics at six facilities. PrIYA focused on PrEP delivery to AGYW via maternal and child health (MCH) and family planning (FP) clinics in Kenya across 37 facilities. IDIs and FGDs were transcribed verbatim and analyzed using a combination of inductive and deductive methods. Results: We conducted IDIs with 36 participants and 8 FGDs with 50 participants. HCW described a dynamic process of operationalizing PrEP delivery to better respond to patient needs, including modifying patient flow, pill packaging, and counseling. HCWs believed the biggest challenge to sustained integration and scaling of PrEP for AGYW would be lack of health care worker motivation, primarily due to a misalignment of personal and professional values and expectations. HCWs frequently described concerns of PrEP provision being seen as condoning or promoting unprotected sex among young unmarried, sexually active women. Persuasive techniques used to overcome these reservations included emphasizing the social realities of HIV risk, health care worker professional identities, and vocational commitments to keeping young women healthy. Conclusion: Sustained scale-up of PrEP will require HCWs to value and prioritize its incorporation into daily practice. As with the provision of other SRH services, HCWs may have moral reservations about providing PrEP to AGYW. Strategies that strengthen alignment of HCW personal values with professional goals will be important for strengthening motivation to overcome delivery challenges.

How, why and under what circumstances does a quality improvement collaborative build knowledge and skills in clinicians working with people with dementia? A realist informed process evaluation

In increasingly constrained health and aged care services, strategies are needed to improve quality and translate evidence into practice. In dementia care, recent failures in quality and safety have led the WHO to prioritise the translation of known evidence into practice. While quality improvement collaboratives have been widely used in healthcare, there are few examples in dementia care.

We describe a recent quality improvement collaborative to improve dementia care across Australia and assess the implementation outcomes of acceptability and feasibility of this strategy to translate known evidence into practice. A realist-informed process evaluation was used to analyse how, why and under what circumstances a quality improvement collaborative built knowledge and skills in clinicians working in dementia care.

This realist-informed process evaluation developed, tested and refined the programme theory of a quality improvement collaborative. Data were collected pre-intervention and post-intervention using surveys and interviews with participants (n=28). A combined inductive and deductive data analysis process integrated three frameworks to examine the context and mechanisms of knowledge and skill building in participant clinicians.

A refined program theory showed how and why clinicians built knowledge and skills in quality improvement in dementia care. Six mechanisms were identified: motivation, accountability, identity, collective learning, credibility and reflective practice. These mechanisms, in combination, operated to overcome constraints, role boundaries and pessimism about improved practice in dementia care.

A quality improvement collaborative designed for clinicians in different contexts and roles was acceptable and feasible in building knowledge, skills and confidence of clinicians to improve dementia care. Supportive reflective practice and a credible, flexible and collaborative process optimised quality improvement knowledge and skills in clinicians working with people with dementia.

Trial registration number

ACTRN12618000268246.

Can learning from workplace feedback be enhanced by reflective writing? A realist evaluation in UK undergraduate medical education

Introduction: Doctors and medical students in the UK are currently required to provide evidence of learning by reflective writing on (among other things) feedback from colleagues. Although the theoretical value of reflecting-on-action is clear, research is still needed to know how to realise the potential of written reflection in medical education. This study arose out of efforts to improve medical student engagement with a reflective writing exercise. We used realist methodology to explain the disinclination of the majority to do written reflection on workplace feedback, and the benefits to the minority.Method: Realist evaluation is a suitable approach to researching complex interventions which have worked for some and not for others. Focus groups were held over a three-year period with year 3 and 4 students. Focus group transcripts were coded for context-mechanism-outcome configurations (the realist approach to analysing data) explaining students' choice not to write a reflection, to write a 'tick-box' reflection or to write for learning. A sub-set of eight students' reflections were also analysed to ascertain evidence of learning through reflection.Results and discussion: 27 students participated in 4 focus groups. Three summary theories emerged showing the importance of context. Firstly, written reflection is effortful and benefits those who invest in it for intrinsic reasons in situations when they need to think more deeply about a learning event. Secondly, following a reflective feedback discussion writing a reflection may add little because the learning has already taken place. Thirdly, external motivation tends to result in writing a 'tick-box' reflection.

Remediation programmes for practising doctors to restore patient safety: the RESTORE realist review

Background

An underperforming doctor puts patient safety at risk. Remediation is an intervention intended to address underperformance and return a doctor to safe practice. Used in health-care systems all over the world, it has clear implications for both patient safety and doctor retention in the workforce. However, there is limited evidence underpinning remediation programmes, particularly a lack of knowledge as to why and how a remedial intervention may work to change a doctor’s practice.

Objectives

To (1) conduct a realist review of the literature to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety; and (2) provide recommendations on tailoring, implementation and design strategies to improve remediation interventions for doctors.

Design

A realist review of the literature underpinned by the Realist And MEta-narrative Evidence Syntheses: Evolving Standards quality and reporting standards.

Data sources

Searches of bibliographic databases were conducted in June 2018 using the following databases: EMBASE, MEDLINE, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, Education Resources Information Center, Database of Abstracts of Reviews of Effects, Applied Social Sciences Index and Abstracts, and Health Management Information Consortium. Grey literature searches were conducted in June 2019 using the following: Google Scholar (Google Inc., Mountain View, CA, USA), OpenGrey, NHS England, North Grey Literature Collection, National Institute for Health and Care Excellence Evidence, Electronic Theses Online Service, Health Systems Evidence and Turning Research into Practice. Further relevant studies were identified via backward citation searching, searching the libraries of the core research team and through a stakeholder group.

Review methods

Realist review is a theory-orientated and explanatory approach to the synthesis of evidence that seeks to develop programme theories about how an intervention produces its effects. We developed a programme theory of remediation by convening a stakeholder group and undertaking a systematic search of the literature. We included all studies in the English language on the remediation of practising doctors, all study designs, all health-care settings and all outcome measures. We extracted relevant sections of text relating to the programme theory. Extracted data were then synthesised using a realist logic of analysis to identify context–mechanism–outcome configurations.

Results

A total of 141 records were included. Of the 141 studies included in the review, 64% related to North America and 14% were from the UK. The majority of studies (72%) were published between 2008 and 2018. A total of 33% of articles were commentaries, 30% were research papers, 25% were case studies and 12% were other types of articles. Among the research papers, 64% were quantitative, 19% were literature reviews, 14% were qualitative and 3% were mixed methods. A total of 40% of the articles were about junior doctors/residents, 31% were about practicing physicians, 17% were about a mixture of both (with some including medical students) and 12% were not applicable. A total of 40% of studies focused on remediating all areas of clinical practice, including medical knowledge, clinical skills and professionalism. A total of 27% of studies focused on professionalism only, 19% focused on knowledge and/or clinical skills and 14% did not specify. A total of 32% of studies described a remediation intervention, 16% outlined strategies for designing remediation programmes, 11% outlined remediation models and 41% were not applicable. Twenty-nine context–mechanism–outcome configurations were identified. Remediation programmes work when they develop doctors’ insight and motivation, and reinforce behaviour change. Strategies such as providing safe spaces, using advocacy to develop trust in the remediation process and carefully framing feedback create contexts in which psychological safety and professional dissonance lead to the development of insight. Involving the remediating doctor in remediation planning can provide a perceived sense of control in the process and this, alongside correcting causal attribution, goal-setting, destigmatising remediation and clarity of consequences, helps motivate doctors to change. Sustained change may be facilitated by practising new behaviours and skills and through guided reflection.

Limitations

Limitations were the low quality of included literature and limited number of UK-based studies.

Future work

Future work should use the recommendations to optimise the delivery of existing remediation programmes for doctors in the NHS.

Study registration

This study is registered as PROSPERO CRD42018088779.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 11. See the NIHR Journals Library website for further project information.

"It was great to break down the walls between patient and provider": liminality in a co-produced advisory course for psychiatry residents

Although rhetoric abounds about the importance of patient-, person- and relationship-centered approaches to health care, little is known about how to address the problem of dehumanization through medical and health professions education. One promising but under-theorized strategy is to co-produce education in collaboration with health service users. To this end, we co-produced a longitudinal course in psychiatry that paired people with lived experience of mental health challenges as advisors to fourth-year psychiatry residents at the University of Toronto. The goal of this study was to examine this novel, relationship-based course in order to understand co-produced health professions education more broadly. Using qualitative interviews with residents and advisors after the first iteration of the course, we explored how participants made meaning of the course and of what learning, if any, occurred, for whom and how. We found that the anthropological theory of liminality allowed us to understand participants' complex experiences and illuminated how this type of pedagogy may work to achieve its effects. Liminality also helped us understand why some participants resisted the course, and how we could more carefully think about co-produced, humanistic education and transformative learning.

The development, feasibility and acceptability of a coach-led intervention to ease novice community pharmacists' transition to practice

BACKGROUND

Despite reported benefits of transition support programmes for other healthcare professionals, no evidence-based support interventions exist to ease newly-registered novice community pharmacists' (NCPs) transition into practice.

OBJECTIVES

To develop an intervention to provide psychosocial support, support the development of professional behaviours and skills of novice pharmacists in community pharmacy and conduct an evaluation.

METHODS

The Medical Research Council (MRC) guidance for developing complex interventions was applied to develop a 17-week, pharmacist coach-led intervention, using a social media group, a face-to-face introductory workshop, two webinars, weekly case studies, portfolios (reflective logs and development plans) and a handbook. Twelve newly-registered NCPs participated. A coach log and semi-structured interviews collected data on feasibility, acceptability and perceived impact.

RESULTS

Findings suggest the intervention was feasible and highly acceptable to NCPs, who perceived the coach and social media group to be the most valuable components. The coach was described as non-judgemental, approachable and collaborative. Provision of guided one-to-one reflection was viewed as useful for debriefing, feedback and meaningful reflection, and supported development of reflection-in-action. The face-to-face workshop was considered important for establishing rapport and trust. The social media group was most valued for providing an accessible, confidential and responsive support network, in which NCPs felt psychologically safe to learn. This component was reported to present opportunities for developmental discourse and shared reflection with peers, thus reducing the sense of professional isolation. NCPs reported that the intervention led to increases in meaningful learning, confidence, critical reasoning, self-awareness and self-reflection. The webinars and handbook were identified as the least valuable components.

CONCLUSIONS

A transition-support intervention using an experienced pharmacist coach, delivered within a safe, supportive, albeit online facilitated learning environment, appeared feasible and valuable in supporting guided reflection and developmental discourse. This facilitates transformative learning, and supports NCPs to gain proficiency and become independent reflective practitioners.

Implementing a crèche-based community drowning programme in rural Bangladesh: a process evaluation

Background

Living and environmental conditions in rural Bangladesh expose children to drowning. The Anchal programme protects children through crèche-based supervision in an enclosed space run by locally recruited carers. It is unclear under what conditions the programme best operates to maximise protection. We conducted a process evaluation of Anchal to determine enabling factors and challenges to implementation.

Methods

Quantitative programme data were analysed to calculate metrics including child participation and fidelity of implementation to defined processes. Qualitative data collection with programme participants and implementers provided insights into barriers and enablers of implementation. Analysis was guided by the UK Medical Research Council’s process evaluation framework.

Results

Anchal operated 400 centres with an average of 22.2 children enrolled, as per target. However, daily attendance averaged lower than the 80% target. Children aged 1–2 years old, who are most at risk of drowning, were least likely to enrol and attend regularly due to low engagement with activities and parental concerns for safety. Greater distances and lower educational attainment in some regions reduced attendance and increased carer attrition.

Conclusions

The Anchal programme met most programme delivery targets. However, programme success could be improved through increasing supervision, providing communication training for implementing staff, designing programmes for children aged 1–2 years old, encouraging community ownership and providing child pick-up services. These contextual solutions can be adapted to similar programmes operating through grassroots-level engagement and recruitment of community health workers, to maximise their effectiveness and sustainability.

A realist evaluation of a safe medication administration education programme

BACKGROUND

Continuing professional education (CPE) for nurses is deemed an essential component to develop, maintain and update professional skills. However, there is little empirical evidence of its effectiveness or factors which may influence its application into practice.

OBJECTIVE

This paper explores a continuing professional education programme on the safe administration of medication and how new knowledge and skills are transferred into clinical practice.

DESIGN

Realist evaluation provided the framework for this study. Realist evaluation stresses the need to evaluate programmes within "context," and to ask what "mechanisms" are acting to produce which "outcomes." This realist evaluation had four distinct stages. Firstly, theories were built as conjectured CMO configurations (Stage 1 and 2), then these cCMO were tested (Stage 3) and they were then refined (Stage 4).

METHODS

Data was collected through document analysis and interviews (9) to build and refine CMOs. The conjectured CMOs were tested by clinical observation, interview (7), analysis of further documents and analysis of data from reported critical incidents and nursing care metric measurements.

RESULTS

This study has shown the significant role of the ward manager in the application of new learning from the education programme to practice. Local leadership was found to enable a patient safety culture and the adoption of a quality improvement approach. The multi-disciplinary team at both organisation and local level was also found to be a significant context for the application of the education programme into practice. Reasoning skills and receptivity to change were identified to be key mechanisms which were enabled within the described contexts.

CONCLUSION

The findings from this study should inform policy and practice on the factors required to ensure learning from CPE is applied in practice. The realist evaluation framework should be applied when evaluating CPE programmes as the rationale for such programmes is to maintain and improve patient care.

Context-acceptability theories: example of family planning interventions in five African countries

BACKGROUND

Family planning (FP) can lengthen birth intervals and potentially reduce the risk of foetal death, low birthweight, prematurity, and being small for gestational age. Effective FP is most easily achieved through access to and acceptability of modern contraceptive methods (MCMs). This study aimed to identify mechanisms of acceptability and the contexts in which they are triggered and to generate theories to improve the selection and implementation of effective interventions by studying an intervention integrating FP with childhood immunisation services.

METHODS

Qualitative interpretative synthesis of findings from realist evaluations of FP interventions in five African countries was guided by an analytical framework. Empirical mechanisms of acceptability were identified from semi-structured interviews and focus group discussions with key stakeholders (N = 253). The context in which these mechanisms were triggered was also defined. Empirical mechanisms of acceptability were matched to constructs of a theoretical framework of acceptability. Context-acceptability theories (CATs) were developed, which summarised constructs of acceptability triggered for specific actors in specified contexts. Examples of interventions that may be used to trigger acceptability for these actors were described.

RESULTS

Seven CATs were developed for contexts with strong beliefs in religious values and with powerful religious leaders, a traditional desire for large families, stigmatisation of MCM use, male partners who are non-accepting of FP, and rumours or experiences of MCM side effects. Acceptability mechanisms included alignment with values and beliefs without requiring compromise, actors' certainty about their ability to avoid harm and make the intervention work, and understanding the intervention and how it works. Additionally, acceptability by one group of actors was found to alter the context, triggering acceptability mechanisms amongst others.

CONCLUSIONS

This study demonstrated the value of embedding realist approaches within implementation research. CATs are transferable theories that answer the question: given the context, what construct of acceptability does an intervention need to trigger, or more simply, what intervention do we need to apply here to achieve our outcomes? CATs facilitate transfer of interventions across geographies within defined contexts.

Activity-Centred Analysis and Design (ACAD): Core purposes, distinctive qualities and current developments

This paper provides a summary account of Activity-Centred Analysis and Design (ACAD). ACAD offers a practical approach to analysing complex learning situations, in a way that can generate knowledge that is reusable in subsequent (re)design work. ACAD has been developed over the last two decades. It has been tested and refined through collaborative analyses of a large number of complex learning situations and through research studies involving experienced and inexperienced design teams. The paper offers a definition and high level description of ACAD and goes on to explain the underlying motivation. The paper also provides an overview of two current areas of development in ACAD: the creation of explicit design rationales and the ACAD toolkit for collaborative design meetings. As well as providing some ideas that can help teachers, design teams and others discuss and agree on their working methods, ACAD has implications for some broader issues in educational technology research and development. It questions some deep assumptions about the framing of research and design thinking, in the hope that fresh ideas may be useful to people involved in leadership and advocacy roles in the field.

Educational design research: Portraying, conducting, and enhancing productive scholarship

CONTEXT

Solutionism is the all-too-common human propensity to jump to a solution before adequately understanding the nature of a problem. Solutionism has long been prevalent in efforts to improve education at all levels, including medical education.

THESIS

Educational design research (EDR) is a genre of research that features the gaining of in-depth understanding of a problem before any prototype solution is designed and tested. It is different from other forms of scientific inquiry because it is committed to the simultaneous development of both theoretical insights and practical solutions, together with stakeholders. This approach is powerful for theory building because it privileges ecologically valid studies that embrace the complexity of investigating learning in authentic (as opposed to laboratory) settings. When conducted well, both the research process and its outcomes generate valuable contributions to practice.

PREVIEW

This article constitutes an expository essay on EDR, comprised of three movements. First, the approach is defined, its origins are presented, and its characteristics are described. Second, a generic model for conducting EDR is offered, and illustrated with examples from the field of medical education. Third, pathways towards advancing this form of inquiry are discussed, including ways to address inherent challenges and limitations, as well as recommendations for the medical education community. Although EDR is no panacea, this article illustrates how it can serve medical education research in a wide variety of geographic and disciplinary contexts.

Active learning of medical students in Taiwan: a realist evaluation

BACKGROUND

Active learning is defined as any instructional method that engages students in the learning process. Cultural differences in learning patterns can play an important role in engagement with active learning. We aimed to examine process models of active learning to understand what works, for whom and why.

METHODS

Forty-eight sixth- and seventh-year medical students with experience of active learning methods were purposively selected to participate in ten group interviews. Interactions around active learning were analysed using a realist evaluation framework to unpack the 'context-mechanism-outcome' (CMO) configurations.

RESULTS

Three core CMO configurations, including cultural, training and individual domains, were identified. In the cultural context of a strong hierarchical culture, the mechanisms of fear prompted students to be silent (outcome) and dare not give their opinions. In the training context of teacher-student familiarity alongside teachers' guidance, the mechanisms of learning motivation, self-regulation and enthusiasm were triggered, prompting positive learning outcomes and competencies (outcome). In the individual context of learning how to learn actively at an early stage within the medical learning environment, the mechanisms of internalisation, professional identity and stress resulted in recognising active learning and advanced preparation (outcomes).

CONCLUSIONS

We identified three CMO configurations of Taiwanese medical students' active learning. The connections among hierarchical culture, fear, teachers' guidance, motivation, the medical environment and professional identity have been shown to affect the complex interactions of learning outcomes. Fear derived from a hierarchical culture is a concern as it is a significant and specific contextual factor, often sparking fear with negative outcomes.

Useful to whom? Evaluation utilisation theory and boundaries for programme evaluation scope

CONTEXT

Programme evaluation is perpetually mandated in health professions education. Correspondingly, there has been an expansion in prescriptive methodological guides about 'how' to engage in various best practices in evaluation. However, what has gained less attention is an examination of the 'value' that different stakeholders seek to gain from programme evaluation. Evaluation utilisation theory and research can help us understand the diversity in both the driving forces for and the impact of programme evaluation. Awareness of the heterogeneity of evaluation utilisation priorities has implications for evaluation practices, including both methodological choices and understanding of the impact of programme evaluation in our field.

METHODS

In this article, I expound on the concept of evaluation utilisation by drawing on evaluation theory and research. 'Evaluation utilisation' refers to the application of programme evaluation processes and findings to influence thinking and action. Herein, different forms of 'evaluation utilisation' (including instrumental, conceptual, process and persuasive (symbolic and legitimative) utilisation) are discussed, as well as the related concept of 'evaluation misuse'. Furthermore, how the prioritisation of different forms of 'evaluation utilisation' can influence the scope and impact of evaluation scholarship are also discussed.

CONCLUSIONS

Programme evaluation is a form of inquiry that requires more than the exercise of robust methodological techniques. Rather, it necessitates attention to the, sometimes divergent, priorities of different stakeholder groups. Although there is scant research on evaluation practices in health professions education, evaluation utilisation theory can inform critical examination of evaluation practices and impact in our field. Critically, understanding this body of work can help inform those engaged in evaluation about what they are (or should be) prioritising when they conduct programme evaluation, and better align evaluation methodologies with their scholarly, curricular and administrative intentions. Implications for future research and high-quality, transparent evaluation scholarship are presented.

Entrepreneurship and Innovation in Health Sciences Education: a Scoping Review

BACKGROUND AND PURPOSE

This scoping review aimed to explore the connection between health education and entrepreneurship and to identify gaps in the current literature, educational models, and best practices regarding teaching medical professionals about entrepreneurship and innovation.

METHODS

The methodology for this review was based on the principles of Arksey and O'Malley's (2005) model for scoping review design. Results from Embase, MEDLINE, PsycINFO, Emcare, AMED, PubMed, and Google Scholar were scanned, filtered, and mapped.

RESULTS

Fifty-nine unique papers were found and mapped. The papers discussed common themes, including the entrepreneurial environment (n = 29), career planning and skill development (n = 3), and various skills crucial for the health entrepreneur. The satisfaction was high for most programs, but few reported more fulsome outcomes. The teaching techniques used to engage trainees or physicians in entrepreneurship were also fairly limited.

CONCLUSION

Though some programs are described, few have demonstrated efficacy. More attention should be paid towards faculty-level recruitment, development and reward, so that they may in turn teach these approaches. Those involved with educational planning can help close this gap.

Harmony or dissonance? The affordances of palliative care learning for emerging professional identity

INTRODUCTION

Patient demographics demand physicians who are competent in and embrace palliative care as part of their professional identity. Published literature describes ways that learners acquire knowledge, skills and attitudes for palliative care. These studies are, however, limited by their focus on the individual where learning is about acquisition. Viewing learning as a process of becoming through the interplay of individual, social relationships and cultures, offers a novel perspective from which to explore the affordances for professional identity development.

METHODS

Qualitative narrative methods were used to explore 45 narratives of memorable learning (NMLs) for palliative care recounted by 14 graduating family medicine residents in one family medicine residency program. Thematic and narrative analyses identified the affordances that support and constrain the dynamic emergence of professional identity.

RESULTS

Participants recounted affordances that supported and/or constrained their learning acting on personal (e.g. past experiences of death), interpersonal (e.g. professional support) and systemic (e.g. patient continuity) levels. Opportunities for developing professional identity were dynamic: factors acted in harmony, were misaligned, or colliding to support or constrain an emerging professional identity for palliative care practice.

CONCLUSION

Findings highlight how individual factors interplay with interpersonal and structural conditions in the workplace in dynamic and emergent ways that may support or constrain the emergence of professional identity. Viewing learning as a process of becoming allows teachers, curriculum developers and administrators to appreciate the complexity and importance of the interplay between the individual and the workplace affordances to create environments that nurture professional identity for palliative care practice.

Pause, Persist, Pivot: Key Decisions Health Professions Education Researchers Must Make About Conducting Studies During Extreme Events

When extreme events occur, some research becomes a clear priority, but what becomes of all other research? Does it stop indefinitely, or can it be paused with plans to resume, persist with modifications, or pivot to address new priorities? Facing this dilemma and witnessing it among their fellow health professions education researchers, the authors recognized a need for guidance. This Invited Commentary presents a framework, organized as key questions related to the research stage and process, to assist health professions education researchers in making decisions about how to proceed with research that was planned or in progress when an extreme event occurred. Although at the time of this writing, the COVID-19 pandemic was the extreme event at hand, the authors intentionally created questions and discussed considerations that can be helpful for thinking through decisions in a variety of disruptions in health professions education research-many of which require similar difficult decisions and creative solutions to carry important research forward and maintain high quality.

A realist synthesis of quality improvement curricula in undergraduate and postgraduate medical education: what works, for whom, and in what contexts?

BACKGROUND

With the integration of quality improvement (QI) into competency-based models of physician training, there is an increasing requirement for medical students and residents to demonstrate competence in QI. There may be factors that commonly facilitate or inhibit the desired outcomes of QI curricula in undergraduate and postgraduate medical education. The purpose of this review was to synthesise attributes of QI curricula in undergraduate and postgraduate medical education associated with curricular outcomes.

METHODS

A realist synthesis of peer-reviewed and grey literature was conducted to identify the common contexts, mechanisms, and outcomes of QI curricula in undergraduate and postgraduate medical education in order to develop a programme theory to articulate what works, for whom, and in what contexts.

RESULTS

18854 records underwent title and abstract screening, full texts of 609 records were appraised for eligibility, data were extracted from 358 studies, and 218 studies were included in the development and refinement of the final programme theory. Contexts included curricular strategies, levels of training, clinical settings, and organisational culture. Mechanisms were identified within the overall QI curricula itself (eg, clear expectations and deliverables, and protected time), in the didactic components (ie, content delivery strategies), and within the experiential components (eg, topic selection strategies, working with others, and mentorship). Mechanisms were often associated with certain contexts to promote educational and clinical outcomes.

CONCLUSION

This research describes the various pedagogical strategies for teaching QI to medical learners and highlights the contexts and mechanisms that could potentially account for differences in educational and clinical outcomes of QI curricula. Educators may benefit from considering these contexts and mechanisms in the design and implementation of QI curricula to optimise the outcomes of training in this competency area.

Scoping reviews in health professions education: challenges, considerations and lessons learned about epistemology and methodology

Scoping reviews are increasingly used in health professions education to synthesize research and scholarship, and to report on the depth and breadth of the literature on a given topic. In this Perspective, we argue that the philosophical stance scholars adopt during the execution of a scoping review, including the meaning they attribute to fundamental concepts such as knowledge and evidence, influences how they gather, analyze, and interpret information obtained from a heterogeneous body of literature. We highlight the principles informing scoping reviews and outline how epistemology-the aspect of philosophy that "deals with questions involving the nature of knowledge, the justification of beliefs, and rationality"-should guide methodological considerations, toward the aim of ensuring the production of a high-quality review with defensible and appropriate conclusions. To contextualize our claims, we illustrate some of the methodological challenges we have personally encountered while executing a scoping review on clinical reasoning and reflect on how these challenges could have been reconciled through a broader understanding of the methodology's philosophical foundation. We conclude with a description of lessons we have learned that might usefully inform other scholars who are considering undertaking a scoping review in their own domains of inquiry.

'What do we do, doctor?' Transitions of identity and responsibility: a narrative analysis

Transitioning from student to doctor is notoriously challenging. Newly qualified doctors feel required to make decisions before owning their new identity. It is essential to understand how responsibility relates to identity formation to improve transitions for doctors and patients. This multiphase ethnographic study explores realities of transition through anticipatory, lived and reflective stages. We utilised Labov's narrative framework (Labov in J Narrat Life Hist 7(1-4):395-415, 1997) to conduct in-depth analysis of complex relationships between changes in responsibility and development of professional identity. Our objective was to understand how these concepts interact. Newly qualified doctors acclimatise to their role requirements through participatory experience, perceived as a series of challenges, told as stories of adventure or quest. Rules of interaction within clinical teams were complex, context dependent and rarely explicit. Students, newly qualified and supervising doctors felt tensions around whether responsibility should be grasped or conferred. Perceived clinical necessity was a common determinant of responsibility rather than planned learning. Identity formation was chronologically mismatched to accepting responsibility. We provide a rich illumination of the complex relationship between responsibility and identity pre, during, and post-transition to qualified doctor: the two are inherently intertwined, each generating the other through successful actions in practice. This suggests successful transition requires a supported period of identity reconciliation during which responsibility may feel burdensome. During this, there is a fine line between too much and too little responsibility: seemingly innocuous assumptions can have a significant impact. More effort is needed to facilitate behaviours that delegate authority to the transitioning learner whilst maintaining true oversight.

Writing for publication: increasing the likelihood of success

The aim of this paper is to help writers at all levels improve their likelihood of success in having papers accepted by academic peer-reviewed journals, including the Journal of Interprofessional Care. We discuss the importance of reading both in your own discipline and also more widely across disciplines and fields of study. There are sections on the attributes of good authors, how to choose a journal, types of articles that are published and the structure of these, the contrast between research and evaluation, and how to plan a paper. We stress the importance of reading and complying with a journal's author guidelines and answering the 'so what' question by the end of the article. There is more detail about the main elements of a paper and what should be included in the introduction, methods, results (findings) and discussion to improve the quality of the reporting. As well as content we also focus on the style of writing. We finish with a discussion of the submission and review processes, why papers may be rejected and how to manage decisions on papers. Dissemination of scholarly work is paramount to the advancement of the interprofessional field; we invite authors to consider our advice and in so doing help strengthen the quality and rigor of interprofessional scholarship.

An Interprofessional Simulation-Based Orientation Program for Transitioning Novice Nurses to Critical Care Roles in the Emergency Department: Pilot Implementation and Evaluation

BACKGROUND

The emergency department (ED) relies on high-functioning teams to deliver consistent and safe patient care. Experts recommend that both emergency physicians and ED nurses participate in team training. However, there are currently no nationally accepted curricula for either profession to embed this training in their professional development, particularly for health workers who are novice or transitioning into critical care roles.

METHODS

An interprofessional educator team designed and embedded a series of simulation scenarios within a novel orientation program for novice nurses transitioning to critical care roles in the ED to teach clinical and teamwork skills for conjoint groups of resident physician and novice nurse learners. The team created four interprofessional simulations to represent the acuity and breadth of patient populations in the ED critical care bays.

INTERVENTION/REFINEMENT

To date, the team has conducted 24 two-week orientation sessions for 48 nurses and 51 resident physicians. Overall mean scores for the Debriefing Assessment for Simulation in Healthcare (DASH) instrument from nursing participants in the first 18 sessions were high. Qualitative evaluation data from both nurses and physicians demonstrated a positive impact of the simulations and provided insight into respective roles, identities, and priorities across professions. Participant feedback led to iterative steps in refinement of the simulations, including adjustments in debriefings and logistics of the orientation program.

IMPLICATIONS FOR PRACTICE

A team-based interprofessional simulation program was found to be feasible and acceptable for practicing novice physicians and nurses as part of a nursing critical care orientation program in the ED. Future work will assess the program's long-term impact on teamwork and safety in the actual clinical environment.

Supervision training in healthcare: a realist synthesis

Supervision matters: it serves educational, supportive and management functions. Despite a plethora of evidence on the effectiveness of supervision, scant evidence for the impact of supervision training exists. While three previous literature reviews have begun to examine the effectiveness of supervision training, they fail to explore the extent to which supervision training works, for whom, and why. We adopted a realist approach to answer the question: to what extent do supervision training interventions work (or not), for whom and in what circumstances, and why? We conducted a team-based realist synthesis of the supervision training literature focusing on Pawson's five stages: (1) clarifying the scope; (2) determining the search strategy; (3) study selection; (4) data extraction; and (5) data synthesis. We extracted contexts (C), mechanisms (M) and outcomes (O) and CMO configurations from 29 outputs including short (n = 19) and extended-duration (n = 10) supervision training interventions. Irrespective of duration, interventions including mixed pedagogies involving active and/or experiential learning, social learning and protected time served as mechanisms triggering multiple positive supervisor outcomes. Short-duration interventions also led to positive outcomes through mechanisms such as supervisor characteristics, whereas facilitator characteristics was a key mechanism triggering positive and negative outcomes for extended-duration interventions. Disciplinary and organisational contexts were not especially influential. While our realist synthesis builds on previous non-realist literature reviews, our findings extend previous work considerably. Our realist synthesis presents a broader array of outcomes and mechanisms than have been previously identified, and provides novel insights into the causal pathways in which short and extended-duration supervision training interventions produce their effects. Future realist evaluation should explore further any differences between short and extended-duration interventions. Educators are encouraged to prioritize mixed pedagogies, social learning and protected time to maximize the positive supervisor outcomes from training.

The student is key: A realist review of educational interventions to develop analytical and non-analytical clinical reasoning ability

OBJECTIVES

Clinical reasoning refers to the cognitive processes used by individuals as they formulate a diagnosis or treatment plan. Clinical reasoning is dependent on formal and experiential knowledge. Developing the ability to acquire and recall knowledge effectively for both analytical and non-analytical cognitive processing has patient safety implications. This realist review examines the way educational interventions develop analytical and non-analytical reasoning ability in undergraduate education. A realist review is theory-driven, seeking not only to identify if an intervention works, but also understand the reasons why, for whom, and in what circumstances. The aim of this study is to develop understanding about the way educational interventions develop effective analytical and non-analytical clinical reasoning ability, when they do, for whom and in what circumstances.

METHODS

Literature from a scoping search, combined with expert opinion and researcher experience was synthesised to generate an initial programme theory (IPT). Four databases were searched and articles relevant to the developing theory were selected as appropriate. Factors affecting educational outcomes at the individual student, teacher and wider organisational levels were investigated in order to further refine the IPT.

RESULTS

A total of 28 papers contributed to the overall programme theory. The review predominantly identified evidence of mechanisms for interventions at the individual student level. Key student level factors influencing the effectiveness of interventions included an individual's self-confidence, self-efficacy and pre-existing level of knowledge. These contexts influenced a variety of educational interventions, impacting both positively and negatively on educational outcomes.

CONCLUSIONS

Development of analytical and non-analytical clinical reasoning ability requires activities that enhance knowledge acquisition and recall alongside the accumulation of clinical experience and opportunities to practise reasoning in real or simulated clinical environments. However, factors such as pre-existing knowledge and self-confidence influence their effectiveness, especially amongst individuals with 'low knowledge.' Promoting non-analytical reasoning once novices acquire more clinical knowledge is important for the development of clinical reasoning in undergraduate education.

Practice-based learning: an appropriate means to acquire the attitude and skills for evidence-based medicine

OBJECTIVES

  To evaluate a practice-based, self-directed EBM-course in an undergraduate medical curriculum in terms of EBM attitude and motivation beliefs.

METHODS

This study was conducted in a 4-week course of the first-year undergraduate medical curriculum, which takes place twice in an academic year. One group of students (n=210) received a normal EBM-module in November. A practice-based EBM-module was implemented in January for another group of students (n=130). We approached all students following the courses for participation in our research project. In a quasi-experimental design, a validated survey was used to assess students' EBM task value and self-efficacy on a 7-point Likert-scale. In the experimental group, complementary qualitative data were gathered on attitude and motivation by open evaluative questions.

RESULTS

Overall response rate was 93,5%, resulting in 191 students in the control group and 127 students in the experimental group. We did not find differences between the groups in terms of EBM task value and self-efficacy. However, the experimental group showed a higher increased perception of the importance of EBM in decision making in clinical practice (60.0% vs 77.2%; χ²(1, N=318) = 8.432, p=0.004). These students obtained a better understanding of the complexities and time-consuming nature of EBM in medical practice.

CONCLUSIONS

The practice-based EBM-course helps students to reflect on practice and knowledge critically. Our findings indicate that integrating clinical practice in the undergraduate learning environment fosters attitude and motivation, suggesting that practice-based learning in EBM education may advance student development as a critically reflective practitioner.

Collaboration between parents and SLTs produces optimal outcomes for children attending speech and language therapy: Gathering the evidence

BACKGROUND

Collaboration between parents and speech and language therapists (SLTs) is seen as a key element in family-centred models. Collaboration can have positive impacts on parental and children's outcomes. However, collaborative practice has not been well described and researched in speech and language therapy for children and may not be easy to achieve. It is important that we gain a deeper understanding of collaborative practice with parents, how it can be achieved and how it can impact on outcomes. This understanding could support practitioners in daily practice with regard to achieving collaborative practice with parents in different contexts.

AIMS

To set a research agenda on collaborative practice between parents and SLTs in order to generate evidence regarding what works, how, for whom, in what circumstances and to what extent.

METHODS & PROCEDURES

A realist evaluation approach was used to make explicit what collaborative practice with parents entails. The steps suggested by the RAMESES II project were used to draft a preliminary programme theory about collaborative practice between parents and SLTs. This process generates explicit hypotheses which form a potential research agenda.

DISCUSSION & CONCLUSIONS

A preliminary programme theory of collaborative practice with parents was drafted using a realist approach. Potential contextual factors (C), mechanisms (M) and outcomes (O) were presented which could be configured into causal mechanisms to help explain what works for whom in what circumstances. CMO configurations were drafted, based on the relevant literature, which serve as exemplars to illustrate how this methodology could be used. In order to debate, test and expand our hypothesized programme theory for collaborative practice with parents, further testing against a broader literature is required alongside research to explore the functionality of the configurations across contexts. This paper highlights the importance of further research on collaborative practice with parents and the potential value of realist evaluation methodology. What this paper adds Current policy in education, health and social care advocates for family-centred care and collaborative practice with parents. Thereby, collaborative practice is the preferred practice for SLTs and parents. In this paper, we explore collaborative practice and use a realist evaluation approach to achieve the aim of setting a research agenda in this area. Researchers use realist evaluation, a methodology originally developed by Pawson and Tilley in the 1990s, to explore the causal link between interventions and outcomes, summarized as what works, how, for whom, in what circumstances and to what extent. Realist evaluation provides a framework to explore configurations between contexts (C), mechanisms (M) and outcomes (O). We used this methodology to take a first step at making explicit what collaborative practice is and how it might be achieved in different contexts. We did this by drafting a preliminary programme theory about collaborative practice, where we made explicit what context factors and mechanisms might influence outcomes in collaborative practice between parents and SLTs. Based on this programme theory, we argue for the need to develop a research agenda on collaborative practice with parents of children with speech, language and communication needs. The steps between a programme theory and a research agenda could entail exploring each CMO, or step in the programme theory, and evaluating it against the existing literature-both within and beyond speech and language therapy-to see how far it stands up. In this way, gaps could be identified that could be converted into research questions that would stimulate debate about a research agenda on collaborative practice. Understanding how collaborative practice can be achieved in different contexts could support SLTs to use mechanisms to optimise collaborative practice intentionally and tailor interventions to the specific needs of families, thereby enhancing collaborative practice between parents and SLTs.

Improving the Use of Simulation in Nursing Education: Protocol for a Realist Review

BACKGROUND

Nursing education has evolved in line with societal needs, and simulation-based learning (SBL) is increasingly being used to bridge the gap between practice and education. Previous literature reviews have demonstrated the effectiveness of using SBL in nursing education. However, there is a need to explore how and why it works to expand the theoretical foundation of SBL. Realist reviews are a theory-based approach to synthesizing existing evidence on how complex programs work in particular contexts or settings.

OBJECTIVE

This review aims to understand how, why, and in what circumstances the use of simulation affects learning as part of the bachelor's program in nursing.

METHODS

A realist review will be conducted in accordance with the realist template for a systematic review. In particular, we will identify and explore the underlying assumption of how SBL is supposed to work, that is, identify and explore program theories of SBL. The review will be carried out as an iterative process of searching, appraising, and synthesizing the evidence to uncover theoretical concepts that explain the causal effects of SBL. In the final section of the review, we will involve stakeholders in the Norwegian community in a web-based Delphi survey to ensure that the emerging theoretical framework derived from the published literature aligns with stakeholders' experience in practice.

RESULTS

The Norwegian Centre for Research Data (project number 60415) has approved the study. We have performed an initial literature search, whereas quality appraisal and data extraction are ongoing processes.

CONCLUSIONS

The final outcome of the review is anticipated to extend the theoretical foundation for using simulation as an integrated component of the bachelor's program in nursing. Furthermore, the findings will be used to produce a briefing document containing guidance for national stakeholders in the community of simulation-based nursing education. Finally, the review findings will be disseminated in a peer-reviewed journal as well as national and international conferences.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/16363.

Twelve tips for improvement-oriented evaluation of competency-based medical education

The shift to competency-based medical education (CBME) requires a new approach to program evaluation. CBME implementers need to embed evaluation in their programs to ensure their CBME adapts to the changing demands of the healthcare system. This 12 tips paper proposes that those advancing CBME use an improvement-oriented, utilization-focused approach to program evaluation. This will yield information that can help CBME implementers to continually examine the context, process and early outcomes of their programs. The paper uses examples from the College of Family Physicians of Canada's (CFPC's) evaluation of the implementation of the Triple C Competency-based curriculum in family medicine residency programs across Canada. These practical tips will be useful to medical educators looking to integrate evaluation into their CBME programs and to those considering other curriculum reform in health professions education.

Dental therapists in general dental practice. A literature review and case-study analysis to determine what works, why, how and in what circumstances

INTRODUCTION

In the United Kingdom, policy and guidance changes regarding the role of dental therapists (DTs) were implemented in recent years with a view to changing dental care to a more preventive-focussed, teamwork approach. However, success in the adoption of this model of working has been varied.

AIMS

Adopting a realist approach, our aim was, to examine the use of DTs in general dental practices in Wales, exploring what works, why, how and in what circumstances.

MATERIALS AND METHODS

The research comprised two stages. (a) A structured literature search, dual-coding papers for high-level factors describing the conditions or context(s) under which the mechanisms operated to produce outcomes. From this, we derived theories about how skill-mix operates in the general dental service. (b) Six case studies of general dental practices (three with a dental therapist/three without a dental therapist) employing a range of skill-mix models incorporating semi-structured interviews with all team members. We used the case studies/interviews to explore and refine the theories derived from the literature.

RESULTS

Eighty-four papers were coded. From this coding, we identified seven theories which reflected factors influencing general dental practices within three broad contexts: the dental practice as a business, as a healthcare provider and as a workplace. We tested these theories in interviews with 38 dental team members across the six care studies. As a result, we amended five of the theories.

CONCLUSION

Our analysis provides theory about outcomes that DTs may facilitate and the mechanisms that may assist the work of DTs within different contexts of general dental practice.

Building the Bridge to Quality: An Urgent Call to Integrate Quality Improvement and Patient Safety Education With Clinical Care

Current models of quality improvement and patient safety (QIPS) education are not fully integrated with clinical care delivery, representing a major impediment toward achieving widespread QIPS competency among health professions learners and practitioners. The Royal College of Physicians and Surgeons of Canada organized a 2-day consensus conference in Niagara Falls, Ontario, Canada, called Building the Bridge to Quality, in September 2016. Its goal was to convene an international group of educational and health system leaders, educators, frontline clinicians, learners, and patients to engage in a consensus-building process and generate a list of actionable strategies that individuals and organizations can use to better integrate QIPS education with clinical care.Four strategic directions emerged: prioritize the integration of QIPS education and clinical care, build structures and implement processes to integrate QIPS education and clinical care, build capacity for QIPS education at multiple levels, and align educational and patient outcomes to improve quality and patient safety. Individuals and organizations can refer to the specific tactics associated with the 4 strategic directions to create a road map of targeted actions most relevant to their organizational starting point.To achieve widespread change, collaborative efforts and alignment of intrinsic and extrinsic motivators are needed on an international scale to shift the culture of educational and clinical environments and build bridges that connect training programs and clinical environments, align educational and health system priorities, and improve both learning and care, with the ultimate goal of achieving improved outcomes and experiences for patients, their families, and communities.

Bibliometric Review of the Knowledge Base on Healthcare Management for Sustainability, 1994–2018

In response to the United Nations’ (UN) Sustainable Development Goals (SDGs), health care organizations throughout the world have adopted management initiatives designed to increase their sustainability. This review of research used bibliometric methods to analyze a dataset comprised of 477 documents extracted from the Scopus database. The review sought to document research on sustainable healthcare management (SHM) that has accumulated over the past 25 years. Results indicated that the intellectual structure of this body of knowledge is comprised of three schools of thought: (1) sustainable change in health care services, (2) innovations in managing health care operations, and (3) prioritizing and allocating resources for sustainability. The review also highlighted the recent topical focus of research in this literature. Key topics were linked to organization and management of health care services, quality of patient care, and sustainability of health care delivery.

A realist evaluation of the implementation of open visiting in an acute care setting for older people

BACKGROUND

Open visiting refers to the principle of unrestricted visiting hours in the hospital setting to enable relatives, families and carers to visit at any time. There has been recognition that open visiting supports the principle of patient and family supported care and improves communication. Despite this there has been difficulty in implementing open visiting and barriers identified. The aims of this study were therefore to evaluate the implementation of open visiting, the barriers to implementation, sustainability and the impact of open visiting on communication between health care professionals, families and carers.

METHODS

The study was conducted on two large acute wards for the older person. Realist evaluation methods were used to understand 'what works well, how, for whom and to what extent.' Mixed methods were employed including qualitative interviews and descriptive analyses of routine data sets. Following the methodology of realist evaluation, programme theories were identified a long with the context, mechanisms and outcomes of implementation, to better understand the implementation process.

RESULTS

The results of this study identified some key findings, demonstrating that open visiting does improve communication and can help to build trusting relationships between families/carers and health care professionals (HCP). Barriers to implementation were based on the belief that it would impinge on routines within the ward setting. To achieve the principles of patient and family/carer centred care, the key mechanisms are the confidence and skills of individual nurses and health care assistants to engage with relatives/carers, whilst retaining a sense of control, particularly when care is being delivered to other patients.

CONCLUSION

In summary, open visiting creates a positive culture which fosters better relationships between families/carers and HCPs. Involving families/carers as partners in care does not happen automatically in an environment where open visiting is the policy, but requires engagement with staff to encourage and support relatives/carers.