Equity, diversity and inclusion in simulation-based education: constructing a developmental framework for medical educators

BACKGROUND

Themes of equity, diversity and inclusion (EDI) arise commonly within healthcare simulation. Though faculty development guidance and standards include increasing reference to EDI, information on how faculty might develop in this area is lacking. With increasingly formal expectations being placed on simulation educators to adhere to EDI principles, we require a better understanding of the developmental needs of educators and clear guidance so that teams can work towards these expectations. Our study had two aims: Firstly, to explore the extent to which an existing competency framework for medical teachers to teach ethnic and cultural diversity is relevant for simulation educator competency in EDI, and secondly, informed by the data gathered, to construct a modified competency framework in EDI for simulation educators.

METHODS

We engaged our participants (10 simulation faculty) in a 5-month period of enhanced consideration of EDI, using the SIM-EDI tool to support faculty debriefing conversations focussed on EDI within a pre-existing programme of simulation. We interviewed participants individually at two timepoints and analysed transcript data using template analysis. We employed an existing competency framework for medical teachers as the initial coding framework. Competencies were amended for the simulation context, modified based on the data, and new themes were added inductively, to develop a new developmental framework for simulation educators.

RESULTS

Interview data supported the relevance of the existing competency framework to simulation. Modifications made to the framework included the incorporation of two inductively coded themes ('team reflection on EDI' and 'collaboration'), as well as more minor amendments to better suit the healthcare simulation context. The resultant Developmental Framework for Simulation Educators in EDI outlines 10 developmental areas we feel are required to incorporate consideration of EDI into simulation programmes during the design, delivery and debriefing phases. We propose that the framework acts as a basis for simulation faculty development in EDI.

CONCLUSIONS

Simulation faculty development in EDI is important and increasingly called for by advisory bodies. We present a Developmental Framework for Simulation Educators in EDI informed by qualitative data. We encourage simulation teams to incorporate this framework into faculty development programmes and report on their experiences.

From corners to community: exploring medical students' sense of belonging through co-creation in clinical learning

BACKGROUND

Belonging is critical for the development and wellbeing of medical students. Belonging, particularly within a 'relational being' paradigm, presents a significant challenge for students, especially within clinical learning environments. Co-creation is a learning relationship in which students are actively involved in the education process. It is inherently relational and promotes belonging within higher education environments. Little is known about utilising co-creation in the curriculum, within medical education. The aim of this study was to explore medical students' experience of co-creation of learning resources within the clinical learning environment.

METHODS

Following ethical approval, medical students were invited to become co-creators of a learning bulletin resource, within the paediatric acute receiving unit, at a paediatric teaching hospital. Interpretative phenomenological analysis (IPA) was used to enable an in-depth exploration of how medical students experienced co-creation within the clinical learning environment. Medical students participated in semi-structured interviews about their experience, which were transcribed verbatim and analysed using IPA. The analysis integrated individual lived experiences into an analytic summary.

RESULTS

Nine medical students participated. Three group experiential themes were identified: identity maturation; learning community and workplace integration. The support found within this co-created learning community, along with maturation of their identity, allowed the participants to experience a challenge to their existing worldview. This shift in perspective resulted in them responding and behaving in the workplace in new ways, which enabled them to belong as themselves in the clinical learning environment. These findings were situated within the developmental concept of self-authorship, as well as contributing to a new understanding of how co-creation promoted social integration.

CONCLUSIONS

Co-creation enabled students to learn in a meaningful way. The relational power of co-creation, can be harnessed to deliver participatory learning experiences, within our increasingly complex healthcare environment, to support the learning, development and integration of doctors of the future.

Snakes and ladders: An integrative literature review of refugee doctors' workforce integration needs

INTRODUCTION

Healthcare systems worldwide are facing a workforce crisis; meanwhile, refugee doctors throughout the world face difficulties in accessing work. The aims of this review were to explore the integration needs of refugee doctors into host healthcare systems from the refugee perspective, synthesise the literature to construct a theory of refugee doctor integration needs and explore how these needs are met or challenged on the pathway to full integration.

METHODS

In this integrative literature review, 11 databases and eight grey literature sources were searched by combining terms for refugee doctor and social integration and limiting to research published in or after 2003. Data were extracted, and quality scoring was completed independently by two researchers. This study utilised template analysis to perform a qualitative synthesis of the data. The multidimensional template included a pre-defined template based on a theoretical framework and a concurrent fully inductive template.

RESULTS

Twenty-two papers were included, incorporating the views of 339 doctors from 30 different home countries and 10 different host countries. The resultant theory included 'foundations' (rights and responsibilities) and three pillars. The 'learning' pillar included required knowledge and skills acquisition. The 'being' pillar encompassed necessary identity work. The 'connecting' pillar comprised social connections, which impacted all other domains. The random and non-linear path to integration faced by refugee doctors was also presented as a serious game.

DISCUSSION

This study produced a theory exploring refugee doctors' integration needs and how these are met or challenged. Medical educators developing courses for refugee doctors should attend not only to knowledge and skills acquisition but also social connections, identity work and rights and responsibilities. The theory highlights the central importance of social connections. Medical educators can therefore have a transformative impact on refugee doctors' integration. This may also contribute to society by helping to alleviate the workforce crisis.

"Ego massaging that helps": a framework analysis study of internal medicine trainees' interprofessional collaboration approaches

INTRODUCTION

Patient care depends on collaborative practice. Debate remains as to the best approach to providing education for collaboration, with educational interventions often far removed from the realities of the clinical workplace. Understanding the approaches used for collaboration in clinical practice could inform practical strategies for training. For internal medicine trainees, this involves collaboration with other professions but also with other specialties. This study aimed to explore the approaches that internal medicine trainees use for interprofessional collaboration and the ways that these approaches vary when internal medicine trainees interact with different healthcare provider groups.

METHODS

Following ethical approval and participant consent, interprofessional communication workshops between August 2020 and March 2021 were audio recorded and transcribed verbatim. Workshops involved groups of internal medicine trainees discussing collaboration challenges and the approaches they use in clinical practice. This framework analysis study used the interprofessional collaboration framework described by Bainbridge and Regehr (building social capital, perspective taking and negotiating priorities and resources), and cross-referenced the categorised data with the healthcare groups that trainees collaborate with, to look for patterns in the data.

RESULTS

Seventeen workshops, involving 100 trainees, were included. Trainees described relationship building, perspective taking and negotiating priorities and resources. Relationship building was a modification to the original framework domain of building social capital. Themes of power and civility transcended domains with evidence of using hierarchy as leverage when negotiating and employing civility as a tactical approach throughout.

DISCUSSION

This bi-dimensional analysis highlights patterns of perspective taking when collaborating with other specialties and professions, and the approaches to negotiation of courting favour and coercion when interacting with other specialties. This study provides evidence of the strategies currently utilised by internal medicine trainees, with different healthcare groups, and presents a modified framework which could inform the development of training for collaboration.

The development of a marker system for Pharmacists' Behavioural Skills

OBJECTIVES

Pharmacists increasingly require complex behavioural skills to fulfil enhanced roles within healthcare teams. Behavioural marker systems are used to assess behavioural (or non-technical) skills during immersive simulation. This study aimed to develop a marker system for pharmacists' behavioural skills in patient-focussed care scenarios, and to investigate its content validity.

METHODS

Literature describing existing marker systems and the requisite behavioural skills of pharmacists were presented to two expert panels, alongside video examples of pharmacists in patient-focussed care simulations. The expert panels used this information to develop a new behavioural marker system. A third expert panel assessed the content validity, and the item- and scale-content validity indices were calculated.

KEY FINDINGS

The resulting tool contains four categories, each with three or four skill elements: situation awareness (gathering information; recognising and understanding information; anticipating, preparing and planning), decision-making and prioritisation (identifying options; prioritising; dealing with uncertainty; implementing or reviewing decisions), collaborative working (involving the patient; information sharing; leadership or followership), self-awareness (role awareness; speaking up; escalating care; coping with stress). The scale-content validity index was 0.95 (ideal) and the only item below the acceptable cut-off was 'leadership or followership' (0.7).

CONCLUSIONS

This tool is the first marker system designed to assess the behavioural skills of pharmacists in patient-focussed care scenarios. There is evidence of good content validity. It is hoped that once validated, the Pharmacists' Behavioural Skills marker system will enable pharmacy educators to provide individualised and meaningful feedback on simulation participants' behavioural skills.

Online non-technical skills faculty training

BACKGROUND

The Medical Students Non-Technical Skills (Medi-StuNTS) system is a behavioural marker system (BMS) designed to identify and debrief non-technical skills (NTS) for medical students during immersive simulation. Educators must be adequately trained in using the BMS. This study aimed to design and implement an online platform to deliver a faculty development course on using Medi-StuNTS and evaluate the feasibility of this platform in training faculty to identify and debrief NTS.

APPROACH

The online platform was developed by faculty with expertise in NTS, based on guidance for faculty training programme requirements and the multimodal model for online education. Content was arranged in modules, using presentations, videos of simulation scenarios and interactive discussion boards.

EVALUATION

Fifteen participants completed the course and feedback over a two-month period. A feedback form was completed to assess feasibility, based on a feasibility framework. The areas of focus were acceptability, demand, implementation, practicality, adaptation, integration, expansion and limited efficacy. Feedback indicated that the course shows promise in improving the ability of faculty to identify and debrief NTS.

IMPLICATIONS

The platform was successfully developed and implemented and was able to reach a national audience due to its online nature. Specific strengths include increased flexibility and accessibility compared to in-person training. Feasibility assessment suggests that this newly developed online platform can work as an effective method for faculty development in order to increase skills in identifying and debriefing NTS using Medi-StuNTS. Future work will focus on expansion of the online platform and dissemination to an international audience.

'Us versus them': A social identity perspective of internal medicine trainees

INTRODUCTION

Silos and group boundaries in the clinical workplace can result in interprofessional conflict which can be a source of anxiety for doctors in training. The social identity perspective (SIP) incorporates theories of social identity and self-categorisation, and may provide a useful lens to understand the socialisation and identity development of doctors. This study aimed to determine if and how the SIP may provide insight into intergroup relations as experienced by internal medicine (IM) trainees in Scotland.

METHODS

Interprofessional communication workshops hosted as part of an IM boot camp between August 2020 and March 2021 were audio recorded and transcribed verbatim. Subsequent individual interviews with consenting trainees further explored social identity and intergroup relations. Data analysis employed template analysis and deductive independent coding with the SIP informing the initial coding template and new codes added inductively.

RESULTS

Seventeen workshops, involving 100 trainees, and ten subsequent individual interviews were included. Trainees related to the social identity of an IM doctor and to stereotypes within the workplace. They described intergroup tensions resulting from a perception of differing priorities. They experienced outgroup derogation and the impact of role modelling those in their social group during their identity development.

DISCUSSION

The SIP provides a useful lens to understand the social phenomena at play for IM trainees. It confirms the expectation of conflict between specialties and negative perceptions of outgroups. There is a need to consider the hidden curriculum of socialisation in the workplace during training and the influence of the learning environment on identity development.

The impact of simulation-based mastery learning, booster session timing and clinical exposure on confidence in intercostal drain insertion: a survey of internal medicine trainees in Scotland

BACKGROUND

Intercostal chest drain (ICD) insertion is a skill that medical trainees lack confidence in performing. This study explores the impact of a national programme of Simulation-Based Mastery Learning (SBML) on procedural confidence, including the impact of time intervals between booster sessions and interim clinical experience.

METHODS

Internal Medicine Trainees in Scotland were surveyed about confidence and clinical experience with ICD insertion before and immediately after SBML and booster session. Data were matched and analysed using paired sample t-tests. Short interval and long interval groups were compared using Student's unpaired t-test. The impact of interim clinical experience was assessed using Analysis of Variance.

RESULTS

Mean confidence in ICD insertion rose following SBML, fell between initial and booster session, and increased again following booster session (P =  < 0.001). 33 of 74 trainees had successfully inserted an ICD between sessions. Fall in confidence was unaffected by the time interval between training sessions, but was mitigated by interim clinical experience.

CONCLUSIONS

SBML boosts trainee confidence in ICD insertion. However, there is evidence of confidence decay, possibly due to a lack of clinical experience between sessions. More research is needed to explore barriers to transfer of skills from simulated to real-world environments.

Transfer of training from an internal medicine boot camp to the workplace: enhancing and hindering factors

BACKGROUND

The transfer of training to the workplace is the aim of training interventions. Three primary factors influence transfer: trainee characteristics, training design and work environment influences. Within medical education, the work environment factors influencing transfer of training remain underexplored. Burke and Hutchins' review of training transfer outlined five work environment influences: opportunity to perform, supervisor/peer support, strategic link, transfer climate and accountability. This study aimed to explore the ways in which work environment factors influence the transfer of training for medical trainees.

METHODS

Internal Medicine Training in Scotland includes a three-day boot camp involving simulation-based mastery learning of procedural skills, immersive simulation scenarios and communication workshops. Following ethical approval, trainees were invited to take part in interviews at least three months after following their boot camp. Interviews were semi-structured, anonymised, transcribed verbatim and analysed using template analysis. Member checking interviews were performed to verify findings.

RESULTS

A total of 26 trainees took part in interviews between January 2020 and January 2021. Trainees reported a lack of opportunities to perform procedures in the workplace and challenges relating to the transfer climate, including a lack of appropriate equipment and resistance to change in the workplace. Trainees described a strong sense of personal responsibility to transfer and they felt empowered to change practice in response to the challenges faced.

CONCLUSIONS

This study highlights barriers to transfer of training within the clinical workplace including procedural opportunities, a transfer climate with challenging equipment availability and, at times, an unsupportive workplace culture. Trainees are driven by their own sense of personal responsibility; medical educators and healthcare leaders must harness this enthusiasm and take heed of the barriers to assist in the development of strategies to overcome them.

Exploring the impact of the COVID-19 pandemic on doctors' core workplace needs: a qualitative study of internal medicine trainees in Scotland

OBJECTIVES

This study aimed to explore how the COVID-19 pandemic has impacted the workplace core needs of internal medicine (IM) trainees in Scotland.

DESIGN

This qualitative study used an observational approach of interprofessional workshops combined with subsequent individual interviews with IM trainees. Workshops and interviews were audiorecorded, transcribed verbatim and analysed utilising NVivo software. Template analysis was used with the Autonomy/control, Belonging and Competence (ABC) of doctors' core needs outlined in the 2019 General Medical Council report Caring for doctors, caring for patients as a conceptual lens for the study.

SETTING

The national IM boot camp in Scotland includes a 2-hour interprofessional workshop which is trainee led and explores current challenges in the workplace, including the impact of the pandemic on such relationships.

PARTICIPANTS

Twelve workshops, involving 72 trainees, were included with ten trainees taking part in the subsequent interview process. Trainees representing all four regions in Scotland were involved.

RESULTS

Trainees described all core needs having been impacted by the pandemic. They described a loss of autonomy with emergency rotas but also through a pervasive sense of uncertainty. The data revealed that work conditions improved initially with additional resources which have since been removed in some areas, affecting trainees' sense of value. Analysis found that belonging was affected positively in terms of increased camaraderie but also challenged through inability to socialise. There were concerns regarding developing competence due to a lack of teaching opportunities.

CONCLUSIONS

Using the ABC of doctor's core needs as a conceptual framework for this study highlighted the impact of the COVID-19 pandemic on all domains for IM trainees in Scotland. It has highlighted an opportunity to foster the renewed sense of camaraderie among healthcare teams, while rebuilding work conditions to support autonomy and competence.

Validity of the Medi-StuNTS behavioural marker system: assessing the non-technical skills of medical students during immersive simulation

Background

The Medical Students’ Non-Technical Skills (Medi-StuNTS) behavioural marker system (BMS) is the first BMS to be developed specifically for medical students to facilitate training in non-technical skills (NTS) within immersive simulated acute care scenarios. In order to begin implementing the tool in practice, validity evidence must be sought. We aimed to assess the validity of the Medi-StuNTS system with reference to Messick’s contemporary validity framework.

Methods

Two raters marked video-recorded performances of acute care simulation scenarios using the Medi-StuNTS system. Three groups were marked: third-year and fourth-year medical students (novices), final-year medical students (intermediates) and core medical trainees (experts). The scores were used to make assessments of relationships to the variable of clinical experience through expert–novice comparisons, inter-rater reliability, observability, exploratory factor analysis, inter-rater disagreements and differential item functioning.

Results

A significant difference was found between the three groups (p<0.005), with experts scoring significantly better than intermediates (p<0.005) and intermediates scoring significantly better than novices (p=0.001). There was a strong positive correlation between the two raters’ scores (r=0.79), and an inter-rater disagreement of more than one point in less than one-fifth of cases. Across all scenarios, 99.7% of skill categories and 84% of skill elements were observable. Factor analysis demonstrated appropriate grouping of skill elements. Inconsistencies in test performance across learner groups were shown specifically in the skill categories of situation awareness and decision making and prioritisation.

Conclusion

We have demonstrated evidence for several aspects of validity of the Medi-StuNTS system when assessing medical students’ NTS during immersive simulation. We can now begin to introduce this system into simulation-based education to maximise NTS training in this group.

Exploring transformative learning when developing medical students' non-technical skills

CONTEXT

Non-technical skills (NTS) training should be incorporated into medical students' education and simulation-based approaches are often utilised to facilitate this. Such experiences have the potential to foster transformative learning by facilitating a reassessment of one's prior assumptions and a significant shift in one's outlook, referred to as the process of perspective transformation. The aim of this research was to explore how NTS training might facilitate transformative learning in final-year medical students.

METHODS

Following ethical approval, medical student volunteers from four medical schools (Aberdeen, Dundee, Edinburgh and Glasgow) participated in simulation sessions, were debriefed with an emphasis on NTS using a behavioural marker system and then took part in focus groups. Focus group discussions were semi-structured and questions were based on the phases of perspective transformation identified by Jack Mezirow. Focus group discussions were audiorecorded, transcribed verbatim, anonymised and analysed using template analysis.

RESULTS

A total of 33 medical students took part in five focus groups. There was evidence of the following stages of perspective transformation: Phase 2 (self-examination with emotional disturbance, including fear, anxiety, guilt, shame and frustration); Phase 3 (critical assessment of assumptions, including the undervaluing of NTS, recognising that technical skills alone are insufficient, and recognising that it is possible to improve one's NTS); Phase 5 (exploring options for new roles, relationships and actions), and Phase 6 (planning a course of action for future simulations, as a medical student and as a doctor).

CONCLUSIONS

This study deepens our understanding of how exposure to NTS training in simulation-based education influences the learning of medical students and shows that such exposure can result in the cognitive phases of transformative learning. It provides us with valuable insights into medical students' perspectives on their learning of NTS at a pivotal stage in training and represents an interesting way of assessing the educational impact of such sessions.

Development of a Forced Choice Photographic Questionnaire for Photic Phenomena and Its Testing – Repeatability, Reliability and Validity

AIM

To design, develop and test a system for analysis of photic phenomena.

METHOD

Extensive background research, patient interviews and theoretical studies led to development of a set of photographic images resembling photic phenomena experienced by patients. These photographic images were processed and digitally altered to create scales of severity for each photic phenomenon in which patients indicated their severity of symptoms by choice of image. The system was tested for stability and validity.

RESULTS

The system showed excellent repeatability and reliability. Face, content, criterion and construct validity were all found to be acceptable.

CONCLUSION

The photographic images of photic phenomena analyser is an acceptable, validated measure for the assessment of photic phenomena, in both pseudophakic patients and those with cataract.