Designing and conducting simulation-based research

Theoretical, Conceptual, and Operational Aspects in Simulation Training With Rapid Cycle Deliberate Practice: An Integrative Review

SUMMARY STATEMENT

An integrative review following Whittemore and Knafl's 5-stage approach (problem identification, literature search, data evaluation, data analysis, and presentation) was conducted to synthesize the evidence on the theoretical, conceptual, and operational aspects of simulation training with rapid cycle deliberate practice (RCDP). After the literature search, 2 reviewers independently read and critically evaluated primary studies using the eligibility criteria. A third more experienced reviewer solved disagreements between the reviewers.This review included 31 articles. Eight themes were identified and grouped into 2 pre-established categories: theoretical/conceptual and operational aspects. The first category had the following 3 themes: definition of RCDP, concepts related to the principles of RCDP, and theories underpinning RCDP. The second category had the following 5 themes: total training time, number of participants in the training, training system, first scenario without intervention, and progressive difficulty. This review showed that knowledge about RCDP is still under construction. As a new simulation strategy, there are some theoretical, conceptual, and operational differences in the studies applying RCDP interventions as simulation training.

A National Simulation-Based Study of Pediatric Critical Care Transport Teams Performance

OBJECTIVES

To assess pediatric critical care transport (CCT) teams' performance in a simulated environment and to explore the impact of team and center characteristics on performance.

STUDY DESIGN

This observational, multicenter, simulation-based study enlisted a national cohort of pediatric transport centers. Teams participated in 3 scenarios: nonaccidental abusive head injury, sepsis, and cardiac arrest. The primary outcome was teams' simulation performance score. Secondary outcomes were associations between performance, center and team characteristics.

RESULTS

We recruited 78 transport teams with 196 members from 12 CCT centers. Scores on performance measures that were developed were 89% (IQR 78-100) for nonaccidental abusive head injury, 63.3% (IQR 45.5-81.8) for sepsis, and 86.6% (IQR 66.6-93.3) for cardiac arrest. In multivariable analysis, overall performance was higher for teams including a respiratory therapist (0.5 points [95% CI: 0.13, 0.86]) or paramedic (0.49 points [95% CI: 0.1, 0.88]) and dedicated pediatric teams (0.37 points [95% 0.06, 0.68]). Each year increase in program age was associated with an increase of 0.04 points (95% CI: 0.02, 0.06).

CONCLUSIONS

Dedicated pediatric teams, inclusion of respiratory therapists and paramedics, and center age were associated with higher simulation scores for pediatric CCT teams. These insights can guide efforts to enhance the quality of care for children during interfacility transports.

Enhancing discharge preparation for parents after complex cardiac surgery: evaluation of an e-learning resource for nurses

Parents need to be appropriately prepared by knowledgeable healthcare professionals before going home with their infant following cardiac surgery for complex congenital heart disease (CHD). A quality improvement project was undertaken between 2018 and 2021 to equip healthcare professionals including children's cardiac nurses with the knowledge required to use the Congenital Heart Assessment Tool (CHAT) to teach parents how to monitor their infant at home. The project involved developing, implementing and evaluating an e-learning resource that included simulated scenarios captured on video. An online survey showed that users perceived the e-learning resource as having a positive effect on their understanding of complex CHD and their practice of preparing parents for discharge and home monitoring.

Validation of a Novel Mobile Application for Assessing Pediatric Tracheostomy Emergency Simulations

Objective

Pediatric tracheostomy is associated with high morbidity and mortality, yet clinician knowledge and quality of tracheostomy care may vary widely. In situ simulation is effective at detecting and mitigating related latent safety threats, but evaluation via retrospective video review has disadvantages (eg, delayed analysis, and potential data loss). We evaluated whether a novel mobile application is accurate and reliable for assessment of in situ tracheostomy emergency simulations.

Methods

A novel mobile application was developed for assessment of tracheostomy emergency in situ simulation team performance. After 1.25 hours of training, 6 raters scored 10 tracheostomy emergency simulation videos for the occurrence and timing of 12 critical steps. To assess accuracy, rater scores were compared to a reference standard to determine agreement for occurrence or absence of critical steps and a timestamp within ±5 seconds. Interrater reliability was determined through Cohen's and Fleiss' kappa and intraclass correlation coefficient.

Results

Raters had 86.0% agreement with the reference standard when considering step occurrence and timing, and 92.8% agreement when considering only occurrence. The average timestamp difference from the reference standard was 1.3 ± 18.5 seconds. Overall interrater reliability was almost perfect for both step occurrence (Fleiss' kappa of 0.81) and timing of step (intraclass correlation coefficient of 0.99).

Discussion

Using our novel mobile application, raters with minimal training accurately and reliably assessed videos of tracheostomy emergency simulations and identified areas for future refinement.

Implications for Practice

With refinements, this innovative mobile application is an effective tool for real-time data capture of time-critical steps in in situ tracheostomy emergency simulations.

360-degree virtual reality video to teach neonatal resuscitation: an exploratory development study

Simulation is an effective training method for neonatal resuscitation (NR). However, the limitations brought about by the COVID-19 pandemic, and other resource constraints, have necessitated exploring alternatives. Virtual reality (VR), particularly 360-degree VR videos, have gained attraction in medical training due to their immersive qualities. The primary objectives of the study were to produce a high quality 360-degree virtual reality (VR) video capturing NR simulation and to determine if it could be an acceptable adjunct to teach NR. The secondary objective was to determine which aspects of NR could benefit from the incorporation of such a video in training. This was an exploratory development study. The first part consisted of producing the video using a GoPro action camera, Adobe Premiere Pro, and Unity Editor. In the second part participants were recruited, based on level of experience, to watch the video and answer questionnaires to determine acceptability (user experience and cognitive load) and aspects of NR which could benefit from the video. The video was successfully developed. Forty-six participants showed a strong general appreciation. User experience revealed high means (> 6) in the positive subscales and low means (< 4) for immersion side effect, with no difference between groups. Cognitive load was higher than anticipated. Participants indicated that this video could be effective for teaching crisis resource management principles, human and environment interactions, and procedural skills. The 360-degree VR video could be a potential new simulation adjunct for NR. Future studies are needed to evaluate learning outcomes of such videos.

Ventilation efficacy during paediatric cardiopulmonary resuscitation (PEDIVENT): simulation-based comparative study

Introduction

This simulation-based study aimed to evaluate the efficacy of ventilation during paediatric cardiopulmonary resuscitation (CPR) provided by healthcare professionals (HCPs) and lay rescuers (LRs). The objective was to assess the number of effective breaths delivered during the initial sequence of CPR. Effective ventilation plays a critical role during paediatric CPR as most cardiac arrests are secondary to hypoxia in origin. The recommendations on initial resuscitation in unresponsive, non-breathing children differ worldwide. The European Resuscitation Council (ERC) guidelines recommend five breaths before starting the chest compressions. Yet, this recommendation was based on the expert consensus historically and has not changed since 2000 because of the lack of evidence. This research addresses the identified knowledge gap, with potential implications for improving resuscitation practices and ultimately enhancing patient outcomes.

Methods

HCPs and LRs performed 90 s of CPR involving two mannequins: 5-kg Baby and 20-kg Junior. Both groups (HCPs and LRs) performed the task before and after structured CPR training, and the efficacy of ventilation before and after the training was compared. The HCPs provided bag-mask ventilation; LR performed dispatcher-assisted CPR with mouth-to-mouth ventilation.

Results

The number of participants that reached the primary outcome before and after the training in Baby was 26 (65%) vs. 40 (100%) in HCPs and 28 (60.9%) vs. 45 (97.8%) in LRs (improvement in both p < 0.001), respectively. The number of participants that reached the primary outcome before and after the training in the Junior mannequin was 31 (77.5%) vs. 32 (82.1%) in HCPs (p = 0.77) and 32 (82.1%) vs. 37 (94.9%) in LRs (p = 0.005), respectively.

Discussion

This simulation-based study is the first to investigate ventilation efficacy during paediatric CPR provided by HCPs and LRs. Ventilation represents an important aspect of good-quality CPR in children. The concept of initiating paediatric CPR with initial breaths, as stated in ERC guidelines 2021, is justifiable. Trained HCPs and LRs providing dispatcher-assisted CPR could deliver effective ventilation to paediatric mannequins. These findings can contribute to future research in this area and address identified knowledge gaps concerning resuscitation guidelines, given the unique practical application of simulation as a research tool.

How to co-design a prototype of a clinical practice tool: a framework with practical guidance and a case study

Clinical tools for use in practice-such as medicine reconciliation charts, diagnosis support tools and track-and-trigger charts-are endemic in healthcare, but relatively little attention is given to how to optimise their design. User-centred design approaches and co-design principles offer potential for improving usability and acceptability of clinical tools, but limited practical guidance is currently available. We propose a framework (FRamework for co-dESign of Clinical practice tOols or 'FRESCO') offering practical guidance based on user-centred methods and co-design principles, organised in five steps: (1) establish a multidisciplinary advisory group; (2) develop initial drafts of the prototype; (3) conduct think-aloud usability evaluations; (4) test in clinical simulations; (5) generate a final prototype informed by workshops. We applied the framework in a case study to support co-design of a prototype track-and-trigger chart for detecting and responding to possible fetal deterioration during labour. This started with establishing an advisory group of 22 members with varied expertise. Two initial draft prototypes were developed-one based on a version produced by national bodies, and the other with similar content but designed using human factors principles. Think-aloud usability evaluations of these prototypes were conducted with 15 professionals, and the findings used to inform co-design of an improved draft prototype. This was tested with 52 maternity professionals from five maternity units through clinical simulations. Analysis of these simulations and six workshops were used to co-design the final prototype to the point of readiness for large-scale testing. By codifying existing methods and principles into a single framework, FRESCO supported mobilisation of the expertise and ingenuity of diverse stakeholders to co-design a prototype track-and-trigger chart in an area of pressing service need. Subject to further evaluation, the framework has potential for application beyond the area of clinical practice in which it was applied.

Management of impacted fetal head at cesarean delivery

Globally, more than 1 in 5 women give birth by cesarean delivery, and at least 5% of these births are at full cervical dilatation. In these circumstances, and when labor has been prolonged in the first stage of labor, the fetal head can become low and wedged deep in the woman's pelvis, making it difficult to deliver the baby. This emergency is known as impacted fetal head. These are technically challenging births associated with serious risks to both the woman and the baby. The difficulty in disimpacting the fetal head increases maternal risks of hemorrhage and injury to adjacent organs and may have long-term consequences for future pregnancies. In addition, there can be associated neonatal consequences, such as skull fractures, brain hemorrhage, hypoxic brain injury, and, rarely, perinatal death. Globally, maternity staff are increasingly encountering this emergency, with studies in the United Kingdom suggesting that impacted fetal head may complicate as many as 1 in 10 emergency cesarean deliveries. Moreover, there has been a sharp increase in reports of perinatal brain injuries associated with impaction of the fetal head at cesarean delivery. When an impacted fetal head occurs, the maternity team can employ a range of approaches to help deliver the fetal head, including an assistant (another obstetrician or midwife) pushing the head up from the vagina, delivering the baby feet first (reverse breech extraction), administering tocolysis to relax the uterus, and using a balloon cephalic elevation device (Fetal Pillow) to elevate the baby's head. However, there is currently no consensus on how best to manage these births, resulting in a lack of confidence among maternity staff, variable practice, and potentially avoidable harm in some circumstances. This article examined the evidence for the prevention and management of this critical obstetrical emergency and outlined recommendations for best practices and training.

CPR Quality Officer role to improve CPR quality: A multi-centred international simulation randomised control trial

Background

An out-of-hospital cardiac arrest requires early recognition, prompt and quality clinical interventions, and coordination between different clinicians to improve outcomes. Clinical team leaders and clinical teams have high levels of cognitive burden. We aimed to investigate the effect of a dedicated Cardio-Pulmonary Resuscitation (CPR) Quality Officer role on team performance.

Methods

This multi-centre randomised control trial used simulation in universities from the UK, Poland, and Norway. Student Paramedics participated in out-of-hospital cardiac arrest scenarios before randomisation to either traditional roles or assigning one member as the CPR Quality Officer. The quality of CPR was measured using QCPR® and Advanced Life Support (ALS) elements were evaluated.

Results

In total, 36 teams (108 individuals) participated. CPR quality from the first attempt (72.45%, 95% confidence interval [CI] 64.94 to 79.97) significantly increased after addition of the CPR Quality role (81.14%, 95% CI 74.20 to 88.07, p = 0.045). Improvement was not seen in the control group. The time to first defibrillation had no significant difference in the intervention group between the first attempt (53.77, 95% CI 36.57-70.98) and the second attempt (48.68, 95% CI 31.31-66.05, p = 0.84). The time to manage an obstructive airway in the intervention group showed significant difference (p = 0.006) in the first attempt (168.95, 95% CI 110.54-227.37) compared with the second attempt (136.95, 95% CI 87.03-186.88, p = 0.1).

Conclusion

A dedicated CPR Quality Officer in simulated scenarios improved the quality of CPR compressions without a negative impact on time to first defibrillation, managing the airway, or adherence to local ALS protocols.

Understanding the Effects of Health Care Distance Simulation: A Systematic Review

ABSTRACT

The use of distance simulation has rapidly expanded in recent years with the physical distance requirements of the COVID-19 pandemic. With this development, there has been a concurrent increase in research activities and publications on distance simulation. The authors conducted a systematic review of the peer-reviewed distance health care simulation literature. Data extraction and a risk-of-bias assessment were performed on selected articles. Review of the databases and gray literature reference lists identified 10,588 titles for review. Of those, 570 full-text articles were assessed, with 54 articles included in the final analysis. Most of these were published during the COVID-19 pandemic (2020-2022). None of the included studies examined an outcome higher than a Kirkpatrick level of 2. Most studies only examined low-level outcomes such as satisfaction with the simulation session. There was, however, a distinction in studies that were conducted in a learning environment where all participants were in different locations ("distance only") as compared with where some of the participants shared the same location ("mixed distance"). This review exclusively considered studies that focused solely on distance. More comparative studies exploring higher level outcomes are required to move the field forward.

Health Care Simulation as a Training Tool for Epidemic Management: A Systematic Review

SUMMARY STATEMENT

The objective of this research was to identify and review studies that have evaluated the impact of simulation-based training on health care professionals during epidemics.All studies in health care simulation-based training published during the last 5 epidemics with a global impact (SARS-CoV, H1N1, MERS, Ebola, SARS-CoV-2; through July 2021) were selected from a systematic search of PUBMED, EMBASE, and key journals.The search strategy identified 274 studies; 148 met the inclusion criteria and were included. Most of the studies were developed in response to SARS-CoV-2 infection (n = 117, 79.1%), used a descriptive approach (n = 54, 36.5%), and were used to train technical skills (n = 82, 55.4%).This review demonstrates a growing interest in publications related to health care simulation and epidemics. Most of the literature is marked by limited study designs and outcome measurements, although there is a trend toward the use of more refined methodologies in the most recent publications. Further research should seek the best evidence-based instructional strategies to design training programs in preparation for future outbreaks.

Mixed-reality technology for clinical communication: objective assessment of the HoloLens 2 as a clinical communication device in a simulated on-call scenario

OBJECTIVE

Specialty on-call clinicians cover large areas and complex workloads. This study aimed to assess clinical communication using the mixed-reality HoloLens 2 device within a simulated on-call scenario.

METHOD

This study was structured as a randomised, within-participant, controlled study. Thirty ENT trainees used either the HoloLens 2 or a traditional telephone to communicate a clinical case to a consultant. The quality of the clinical communication was scored objectively and subjectively.

RESULTS

Clinical communication using the HoloLens 2 scored statistically higher than telephone (n = 30) (11.9 of 15 vs 10.2 of 15; p = 0.001). Subjectively, consultants judged more communication episodes to be inadequate when using the telephone (7 of 30) versus the HoloLens 2 (0 of 30) (p = 0.01). Qualitative feedback indicates that the HoloLens 2 was easy to use and would add value during an on-call scenario with remote consultant supervision.

CONCLUSION

This study demonstrated the benefit that mixed-reality devices, such as the HoloLens 2 can bring to clinical communication through increasing the accuracy of communication and confidence of the users.

Virtual Clinical Simulation for Training Amongst Undergraduate Medical Students: A Pilot Randomised Trial (VIRTUE-Pilot)

BACKGROUND

Clinical virtual simulators are promising new technologies that might facilitate teaching clinical skills.

OBJECTIVE

This study aimed to assess whether a virtual reality simulator might facilitate learning and improve adherence to current clinical guidelines.

METHODOLOGY

A double-masked randomised trial was undertaken among fourth-year medical students at Universidad Andres Bello, Chile. Participants were randomised to a clinical virtual simulator (Body Interact®, Body Interact Inc., Austin, TX) or a small-group discussion session on the management of myocardial infarction. Main outcomes included performance in an objective structured clinical examination (OSCE) and adherence to clinical recommendations. Analyses were undertaken under the intention to treat principle by an independent statistician.

RESULTS

Fifty students volunteered to participate. Most were female (30 students, 58.8%) and had a mean age of 23.0±2.7 years. Thirty-two participants (62.8%) had used virtual reality platforms before. Students allocated to the simulator showed better OSCE scores (mean difference: 2.8 points; 95% confidence interval (CI): -3.2 to +8.7 points, p=0.14) and were faster to implement diagnostic and therapeutic interventions, but not in a statistically significant way.

DISCUSSION

Academic performance was slightly improved by the use the simulator, although the overall effect was smaller than expected.

CONCLUSION

 This study examined the influence of a clinical virtual simulator on the academic performance and guideline adherence of undergraduate medical students, with small group discussions as a point of comparison. The findings revealed that there were no statistically significant distinctions between the two methods, potentially attributed to the selection of the comparator and the relatively brief intervention period.

Association between cardiopulmonary resuscitation audit results with in-situ simulation and in-hospital cardiac arrest outcomes and key performance indicators

INTRODUCTION

In-situ simulation (ISS) is a method to evaluate the performance of hospital units in performing cardiopulmonary resuscitation (CPR). It is conducted by placing a high-fidelity mannequin at hospital units with simulated scenarios and having each unit's performance evaluated. However, little is known about its impact on actual patient outcomes. Therefore, we aimed to evaluate the association between the ISS results and actual outcomes of patients with in-hospital cardiac arrest (IHCA).

METHODS

This retrospective study was conducted by reviewing Siriraj Hospital's CPR ISS results in association with the data of IHCA patients between January 2012 and January 2019. Actual outcomes were determined by patients' outcomes (sustained return of spontaneous circulation (ROSC) and survival to hospital discharge) and arrest performance indicators (time-to-first-epinephrine and time-to-defibrillation). These outcomes were investigated for association with the ISS scores in multilevel regression models with hospital units as clusters.

RESULTS

There were 2146 cardiac arrests included with sustained ROSC rate of 65.3% and survival to hospital discharge rate of 12.9%. Higher ISS scores were significantly associated with improved sustained ROSC rate (adjusted odds ratio 1.32 (95%CI 1.04, 1.67); p = 0.01) and a decrease in time-to-defibrillation (-0.42 (95%CI -0.73, -0.11); p = 0.009). Although higher scores were also associated with better survival to hospital discharge and a decrease in time-to-first-epinephrine, most models for these outcomes failed to reach statistical significance.

CONCLUSION

CPR ISS results were associated with some important patient outcomes and arrest performance indicators. Therefore, it may be an appropriate performance evaluation method that can guide the direction of improvement.

Data-informed debriefing for cardiopulmonary arrest: A randomized controlled trial

Aim

To determine if data-informed debriefing, compared to a traditional debriefing, improves the process of care provided by healthcare teams during a simulated pediatric cardiac arrest.

Methods

We conducted a prospective, randomized trial. Participants were randomized to a traditional debriefing or a data-informed debriefing supported by a debriefing tool. Participant teams managed a 10-minute cardiac arrest simulation case, followed by a debriefing (i.e. traditional or data-informed), and then a second cardiac arrest case. The primary outcome was the percentage of overall excellent CPR. The secondary outcomes were compliance with AHA guidelines for depth and rate, chest compression (CC) fraction, peri-shock pause duration, and time to critical interventions.

Results

A total of 21 teams (84 participants) were enrolled, with data from 20 teams (80 participants) analyzed. The data-informed debriefing group was significantly better in percentage of overall excellent CPR (control vs intervention: 53.8% vs 78.7%; MD 24.9%, 95%CI: 5.4 to 44.4%, p = 0.02), guideline-compliant depth (control vs. intervention: 60.4% vs 85.8%, MD 25.4%, 95%CI: 5.5 to 45.3%, p = 0.02), CC fraction (control vs intervention: 88.6% vs 92.6, MD 4.0%, 95%CI: 0.5 to 7.4%, p = 0.03), and peri-shock pause duration (control vs intervention: 5.8 s vs 3.7 s, MD -2.1 s, 95%CI: -3.5 to -0.8 s, p = 0.004) compared to the control group. There was no significant difference in time to critical interventions between groups.

Conclusion

When compared with traditional debriefing, data-informed debriefing improves CPR quality and reduces pauses in CPR during simulated cardiac arrest, with no improvement in time to critical interventions.

Adaptation of a Simulation Model and Checklist to Assess Pediatric Emergency Care Performance by Prehospital Teams

INTRODUCTION

Simulation tools to assess prehospital team performance and identify patient safety events are lacking. We adapted a simulation model and checklist tool of individual paramedic performance to assess prehospital team performance and tested interrater reliability.

METHODS

We used a modified Delphi process to adapt 3 simulation cases (cardiopulmonary arrest, seizure, asthma) and checklist to add remote physician direction, target infants, and evaluate teams of 2 paramedics and 1 physician. Team performance was assessed with a checklist of steps scored as complete/incomplete by raters using direct observation or video review. The composite performance score was the percentage of completed steps. Interrater percent agreement was compared with the original tool. The tool was modified, and raters trained in iterative rounds until composite performance scoring agreement was 0.80 or greater (scale <0.20 = poor; 0.21-0.39 = fair, 0.40-0.59 = moderate; 0.60-0.79 = good; 0.80-1.00 = very good).

RESULTS

We achieved very good interrater agreement for scoring composite performance in 2 rounds using 6 prehospital teams and 4 raters. The original 175 step tool was modified to 171 steps. Interrater percent agreement for the final modified tool approximated the original tool for the composite checklist (0.80 vs. 0.85), cardiopulmonary arrest (0.82 vs. 0.86), and asthma cases (0.80 vs. 0.77) but was lower for the seizure case (0.76 vs. 0.91). Most checklist items (137/171, 80%) had good-very good agreement. Among 34 items with fair-moderate agreement, 15 (44%) related to patient assessment, 9 (26%) equipment use, 6 (18%) medication delivery, and 4 (12%) cardiopulmonary resuscitation quality.

CONCLUSIONS

The modified checklist has very good agreement for assessing composite prehospital team performance and can be used to test effects of patient safety interventions.

Informing Simulation Design: A Qualitative Phenomenological Study of the Experiences of Bereaved Parents and Actors

INTRODUCTION

Simulations, which represent reality, are effective in pediatric healthcare communication skills education and training. Parents are increasingly engaged in simulation development, particularly for authentic character development, to help achieve greater psychological fidelity. For simulated encounters related to a child's end-of-life, involvement of bereaved parents would make sense. However, this is challenging because there is limited research to guide their inclusion and significant responsibility for any approach to be thoughtful and psychologically safe for participating parents. This study explores the impact and experiences of bereaved parents and actors who participated in simulation design.

METHODS

This qualitative phenomenological study involved five bereaved parents and two actors who participated in a full-day workshop to design and develop characters for use in a simulation. Individual semistructured interviews were conducted up to four weeks after the workshop. Data collected from these telephone interviews were analyzed using inductive content analysis.

RESULTS

Bereaved parents found the workshop emotionally challenging but positive, worthwhile, and beneficial. Similarly, actors found the workshop helpful in character development and, although it was an intense experience for them, it validated the importance of their work. Key elements of our research findings could inform future such activities.

CONCLUSIONS

Involving bereaved parents in simulation design can be psychologically safe and beneficial for both parents and actors. Ongoing involvement of bereaved parents may lead to higher-quality simulated experiences, allowing clinicians to practice skills to enhance care provided at a child's end-of-life.

Effects of the Interruption Management Strategy "Stay S.A.F.E." During Medication Administration

PURPOSE

This study measured the impact of the Stay S.A.F.E. intervention on nursing students' management of and response to interruptions during medication administration. Time to return to the primary task, performance (procedural failures and error rate), and perceived task load were evaluated.

DESIGN

This experimental study used a randomized prospective trial.

METHODS

Nursing students were randomized into two groups. Group 1 (the experimental group) received two educational PowerPoints: the Stay S.A.F.E. strategy and medication safety practices. Group 2 (the control group) received educational PowerPoint on medication safety practices. Nursing students participated in three simulations where they were interrupted during a simulated medication administration. Eye tracking of students' eye movements determined focus, time to return to the primary task, performance including procedural failures and errors, and fixation time on the interrupter. The perceived task load was measured using the NASA Task Load Index.

RESULTS

The intervention group, which was the Stay S.A.F.E. group, demonstrated a significant reduction in time away from task. There was a significant difference in perceived task load across the three simulations, including decreased frustration scores for this group as well. The control group members reported a higher mental demand, increased effort, and frustration.

CLINICAL RELEVANCE

Rehabilitation units often hire new nursing graduates or individuals with little experience. For new graduates they have typically practiced their skills without interruptions. However, interruptions in performing care, particularly in medication management, occur frequently in real-world situations. Improving the education of nursing students related to interruption management has the potential to improve their transition to practice and patient care.

CONCLUSION

Students who received the Stay S.A.F.E. training, a strategy to manage interruptions in care, had decreasing frustration over time and spent more time on the task of medication administration.

Blockchain technology for sustainable development: a systematic literature review

Purpose

Blockchain technology (BCT) is one of the latest disruptive innovations, brought along with-it immense scope of diverse applications contributing towards sustainable development (SD). The consistent increase in the publications reveal that the application of BCT for SD has become popular among researchers and practitioners in past few years, in turn, urged for a systematic literature review (SLR) to get an insight into the research journey travelled so far and setting directions for future research in this area. Therefore, this study aims to identify, map and synthesize the available literature on application of BCT for SD.

Design/methodology/approach

The automatic and manual search resulted into 1,277 studies from Scopus and Web of Science database. Further applying inclusion and exclusion criterion resulted in bringing out total of 157 studies, which were termed as primary studies. Based on the results of descriptive analysis, conducted through Bibliometric and VOSviewer software, the characteristics of BCT and its key capabilities, contributing towards shaping the recent SD literature, were critically examined. Identified research themes for clustering primary studies were aligned with United Nations Sustainability Development Goals (UNSDG). A mind-map was also prepared on the basis of thematic classification of primary studies.

Findings

The research themes “business practice and economic sustainability”, “agriculture and food security” and “business practice and environment sustainability” were found to be the focal points of scholarly attention. Synthesis and analysis of primary studies resulted into classification of research gaps under four categories – theoretical foundation, methodological limitation, research themes and technology implementation challenges. The study was concluded by sensitizing and sanitizing the concrete research questions for future research.

Research limitations/implications

The research findings shall be a roadmap for research scholars, academicians and practitioners to comprehend the present state of knowledge in the domain of “BCT application for SD” and decide upon adopting the future course of action to attain the UNSDGs by the year 2030.

Originality/value

To the best of the authors’ knowledge, the current study is the first attempt in its own sense to analyse and synthesize the available literature on “attaining SD through BCT” using SLR approach.

Video-Recorded In Situ Simulation Before Moving to the New Combined Neonatal/Pediatric Intensive Care Facility: An Observational Study

OBJECTIVES

Moving an ICU to a new location is a challenge. The objective of this study was to use in situ simulation to identify potential problems and solutions with the new environment before commencing patient care.

DESIGN

Planned, observational video-recorded simulation study using four scenarios: delivery room management of term-neonate; delivery room management of extremely low-birth-weight infant; management and transfer of an infant with respiratory syncytial virus bronchiolitis and apnea; and management and transfer of an adolescent with septic shock.

SETTING

Academic tertiary neonatal and combined neonatal ICU/PICU.

PARTICIPANTS

Sixteen volunteers (eight physicians, eight nurses).

INTERVENTIONS

Standardized briefing introduction, with before versus after survey of thoughts about each scenario, and after 8 weeks, debriefing at least 60 minutes and additional video recording.

MEASUREMENTS AND MAIN RESULTS

A total of 91 potential problem areas were identified and included issues related to technical aspects ( n = 29), infrastructure ( n = 27), administration ( n = 19), and structure ( n = 16). Fifty-three (58%) of these potential issues could be resolved before the move, including: 15 of 29 technical, 15 of 27 infrastructure, nine of 19 administration, and 14 of 16 structural. The video analysis revealed an additional 13 problem areas (six technical, three infrastructure, two administration, and two structural). Participants felt more confident 8 weeks after the simulations (χ 2 = 12.125; p < 0.002). All 16 participants confirmed the usefulness of the in situ simulation, the majority wanted further introductions to the new ward ( n = 13) and noted a positive impact of the changes on the new ward ( n = 12).

CONCLUSIONS

In situ simulation before moving into a new facility identifies numerousness potential problem areas. Survey shows that providers feel better prepared and are more confident. Video recording reveals additional difficulties not addressed in conventional verbal debriefing.

Development, implementation, and evaluation of a simulation-based educational curriculum for pediatric hospitalists

BACKGROUND AND OBJECTIVES

Minimal published simulation-based educational training exists for practicing pediatric hospitalists. Our aim was to determine specific pediatric hospital medicine (PHM) knowledge, skill, and competency needs aligned with our scope of practice and evaluate the impact of a simulation-based training curriculum.

DESIGN AND METHODS

Baseline and post-training surveys were administered to 48 physicians providing self-ratings on a 5-point scale from Novice to Expert on published PHM competencies. Results were used to develop a targeted simulation curriculum. Participants were considered competent in a domain if their mean score was 3 or greater. We categorized participant responses to individual questions into nine domain scores on survey self-assessments. Score analysis was performed using the signed-rank test and McNemar's test. Post-training evaluations solicited curriculum acceptance and perceived clinical value.

RESULTS

The baseline response rate was 98% and the post-training response rate was 85%. Areas with the lowest competency on baseline self-assessment included advanced airway management (38%), vascular access and emergency medications (38%), code cart skills (19%), team communication (51%), and medically complex care (49%). Post-training scores improved significantly for five of nine domains, with the largest gains in the "not competent" at baseline group. Percent competent (% with mean score >3) increased significantly in three domains (advanced airway management, code cart skills, and complex care). Participants rated educational sessions favorably (98%) and most (95%) reported using knowledge/skills learned for patient care.

CONCLUSION

Baseline self-assessment results were instrumental in curriculum design. Post-training analysis revealed gains in multiple domains and identified opportunities for future interventions. Most hospitalists reported participation positively impacted patient care with high learner satisfaction.

Emotional Activation in Simulation: Measuring the Influence of Participant Roles and Scenario Design

INTRODUCTION

The degree of emotional activation required for optimal learning in either hands-on or observer roles is unclear, as is the level of stress that impedes learning. Measuring emotional activation is time-consuming, and many scales measure threat or anxiety without considering pleasurable activation. This study examined emotional activation in the observer and hands-on roles in 2 different scenario designs.

METHODS

This study was a 2-cohort, parallel study of graduate nurses and doctors completing 2 different courses in managing the deteriorating patient. We examined emotional activation by role across 2 scenario designs. We measured emotional activation on 3 anchored measures scales: the State Trait Anxiety Inventory, Cognitive Appraisal Index, and the Affect Grid with data analysis using analysis of variance and repeated measures.

RESULTS

Hands-on learners experienced higher anxiety, threat, and arousal levels and less pleasure than observers in both scenario designs. There were no differences in pre-emotional and postemotional activation in immersive scenarios for either role and increased arousal and decreased threat and anxiety in the hands-on role in the pause-and-discuss scenario design.

CONCLUSIONS

Hands-on learners were more emotionally activated than observers in both scenario designs. There was significant perceived anxiety, threat, and pleasurable arousal in both roles and both scenario designs. Pause-and-discuss scenarios demonstrated similar levels of activation as the immersive scenario design. The Affect Grid provided a quick subjective view of arousal and pleasure in simulation participants, potentially providing educators with an indication of whether emotional activation is positive (excitement) or negative (stressful) and may be helpful in educational planning and future research.

Validation of a novel birth simulator for impacted fetal head at cesarean section: An observational simulation study

INTRODUCTION

Impacted fetal head (IFH) is a challenging complication of cesarean section (CS) associated with significant morbidity. Training opportunities for IFH have been reported as inconsistent and inadequate. This study assessed the validity of a novel birth simulator for IFH at cesarean section.

MATERIAL AND METHODS

Obstetricians and midwives collaborated with model-making company, Limbs & Things (UK), to modify the original PROMPT Flex® simulator and develop a new "Enhanced CS Module" for IFH at cesarean section. Changes included addition of a retractable uterus and restricted pelvic inlet, and the fetal mannequin was modified to allow accurate limb articulation and flexion at the waist. Obstetricians and midwives from three maternity units in Southwest England were individually recorded, each undertaking three simulated scenarios of IFH at cesarean section. Obstetricians were asked to deliver the fetal head and midwives, to perform a vaginal push-up. Participants completed a questionnaire on realism (face validity) and usefulness for training (content validity) with five-point Likert scale responses. Construct validity was assessed by testing an a priori hypothesis that "experts" (consultant obstetricians with >7 years' experience) would be more likely to achieve delivery than "novices" (registrars with <7 years' experience). Performance variables were compared between groups using Chi-square and Mann-Whitney U-tests.

RESULTS

In all, 105 simulated scenarios were undertaken by 35 obstetricians and midwives. A range of techniques were employed to deliver the IFH including change of hand, vaginal disimpaction and reverse breech extraction. Overall, 86% (30/35) described the model as fairly (4)/very realistic (5) (median = 4, interquartile range [IQR] = 4-5). The model was considered fairly (4)/very useful (5) for training by 97% (34/35; median = 5; IQR = 5-5). Experts delivered the fetal head in all simulations (36/36) and novices delivered the head in 76.9% (30/39) (p = 0.002). Experts delivered the fetal head 58% quicker than novices (median = 66.8 s, IQR = 53-86 vs median = 104 s, IQR = 67.7-137).

CONCLUSIONS

This novel birth trainer realistically simulates IFH at cesarean section and allows rehearsal of all disimpaction techniques. It was reported to be very useful for training and distinguishes between novice and expert obstetricians. Techniques for IFH are difficult to learn experientially. Simulation is likely to provide an effective and safe form of training.

Assessing team behaviours and time to defibrillation during simulated cardiac arrest: a pilot study of internal medicine trainees

Understanding team behaviours leading to successful outcomes in resuscitation could help guide future training. Guidelines recommend defibrillation for shockable rhythm cardiac arrests within 2 minutes. This observational pilot study aimed to determine whether teamwork behaviours among medical trainees differed when time to defibrillation (TTD) was less than 2 minutes, versus 2 minutes or more.

Following ethical approval, groups of six internal medicine trainee (IMT) doctors in Scotland formed an

Twenty-three videos involving 138 trainees were scored using the TEAM tool. Scores ranged from 19–39.5/44 (mean 28.2). Mean TTD was 86.2 seconds (range 24–224), with 17/23 teams achieving defibrillation in under 2 minutes. Those achieving fast TTD achieved higher TEAM scores, and the result was statistically significant (30.1 ± 5.0 vs 22.9 ± 3.3,

This observational pilot study found that improved team performance, as measured by the TEAM tool, was associated with faster defibrillation by IMT doctors in simulated cardiac arrest. It highlighted the importance of adaptability as a team behaviour associated with successful performance, which is of interest to those involved in training high stakes emergency teams.

Pediatric Interfacility Transport Curriculum: Its Impact on the Pediatric Intensive Care and Emergency Medicine Fellows' Performance and Confidence

OBJECTIVE

Pediatric interfacility transports are frequent. Despite the absence of a formal pediatric transport curriculum in eastern Canada, directly managing patients during transport and medical direction of the referring center and transport team are part of the pediatric critical care medicine (PCCM) and pediatric emergency medicine (PEM) program requirements. The authors developed a pediatric interfacility transport curriculum and measured its impact on fellows' confidence and performance.

METHODS

This was a pilot interventional prospective study in Montreal, Canada. Postcurriculum surveys were used to measure confidence, and high-fidelity simulations were used to measure performance. A target threshold for confidence was defined before implementation, and pre- and post values were compared. The simulation scenario and assessment checklist were locally developed.

RESULTS

The participants were 11 PCCM and 3 PEM fellows. The content of the curriculum and educational methods were selected based on the literature and a needs assessment survey. All participants rated themselves as confident at the end of the curriculum. Eighty-three percent of the participants were deemed proficient with a perfect interrater agreement.

CONCLUSION

The pediatric transport curriculum had a positive impact on PEM and PCCM fellows' confidence and performance in transport. Further studies should look at the impact of such a curriculum on participants' real-life performance and patient care.

Adherence to guideline recommendations in the management of pediatric cardiac arrest: a multicentre observational simulation-based study

BACKGROUND AND IMPORTANCE

Pediatric cardiac arrest is a rare emergency with associated high mortality. Its management is challenging and deviations from guidelines can affect clinical outcomes.

OBJECTIVES

To evaluate the adherence to guideline recommendations in the management of a pediatric cardiac arrest scenario by teams of pediatric residents. Secondarily, the association between the use of the Pediatric Advanced Life Support-2015 (PALS-2015) pocket card, and the teams' adherence to international guidelines, were explored.

DESIGN, SETTINGS AND PARTICIPANTS

Multicentre observational simulation-based study at three Italian University Hospitals in 2018, including PALS-2015 certified pediatric residents in their 3rd-5th year of residency program, divided in teams of three.

INTERVENTION OR EXPOSURE

Each team conducted a standard nonshockable pediatric cardiac arrest scenario and independently decided whether to use the PALS-2015 pocket card.

OUTCOME MEASURE AND ANALYSIS

The primary outcome was the overall number and frequency of individual deviations from the PALS-2015 guidelines, measured by the novel c-DEV15plus score (range 0-15). Secondarily, the performance on the validated Clinical Performance Tool for asystole scenarios, the time to perform resuscitation tasks and cardiopulmonary resuscitation (CPR) quality metrics were compared between the teams that used and did not use the PALS-2015 pocket card.

MAIN RESULTS

Twenty-seven teams (81 residents) were included. Overall, the median number of deviations per scenario was 7 out of 15 [interquartile range (IQR), 6-8]. The most frequent deviations were delays in positioning of a CPR board (92.6%), calling for adrenaline (92.6%), calling for help (88.9%) and incorrect/delayed administration of adrenaline (88.9%). The median Clinical Performance Tool score was 9 out of 13 (IQR, 7-10). The comparison between teams that used ( n  = 13) and did not use ( n  = 14) the PALS-2015 pocket card showed only significantly higher Clinical Performance Tool scores in the former group [9 (IQR 9-10) vs. 7 (IQR 6-8); P  = 0.002].

CONCLUSIONS

Deviations from guidelines, although measured by means of a nonvalidated tool, were frequent in the management of a pediatric cardiac arrest scenario by pediatric residents. The use of the PALS-2015 pocket card was associated with better Clinical Performance Tool scores but was not associated with less deviations or shorter times to resuscitation tasks.

Effectiveness of a Game-Based Phone Application in Educating Health Care Workers on the Proper Use of Personal Protective Equipment

Objective This study explored the feasibility and effects of a game-based phone application for training health care workers to use personal protective equipment. Method A single-blind randomized controlled trial was conducted. All participants in the experimental group (n = 123) and the control group (n = 125) received 75 minutes of training and were provided with a video and a paper copy of the procedures. Participants in the experimental group used an additional game-based phone application to simulate the procedures. Results Participants in the experimental group practiced a median of 15 times (range, 14-19 times). The learning curve indicated that they needed at least 12 repetitions to master the skill. Score improvements (Z = -2.257, p = .024) in the experimental group were significantly superior to those in the control group, as were the incidences of procedural errors of hand hygiene (χ² = 4.085, p = .043) and protective clothing (χ² = 5.394, p = .02). Conclusion The game-based phone application simulation guided participants to practice enough times to master the skill, enhance their skill performance, and reduce the incidence of procedural errors. [J Contin Educ Nurs. 2022;53(5):212-220.].

An improved congenital heart assessment tool: a quality improvement outcome

BACKGROUND

CHD was the most prevalent congenital anomaly (60.9 per 10,000, 95% CI 59.0-62.8) in England in 2018, with 1767 babies born with severe cardiac defects. The 30-day survival rates for complex procedures continue to improve; however despite care advances, the early post-operative period and first year of life remain a critical time for these infants. The Congenital Heart Assessment Tool was developed to support parental decision-making, standardise care provision, improve communication, and the safety and quality of care.

AIM

To further evaluate the Congenital Heart Assessment Tool.

DESIGN

A four centre collaborative mixed-methods quality improvement project funded by The Health Foundation, involving eight phases conducted during 2016-2018. Phases six to eight (clinical simulation exercise, parent workshop, and updated tool) are reported in this paper.

RESULTS

Four themes emerged from the clinical simulation exercise (phase six) including: improving documentation; preparation of parents; preparation of health care professionals; and communication. One main theme emerged from the parent workshop (phase seven): "what parents know versus what professionals know [about CHD]".

CONCLUSION

These phases further validated the effectiveness of the CHATm in terms of triggering amber and red indicators and demonstrated parents' ability to identify deterioration in their infant's clinical condition. Recommendations arising from the quality improvement project enabled the project team to create an updated version of the Congenital Heart Assessment Tool, CHAT2.

Effectiveness of a Mobile App in Reducing Therapeutic Turnaround Time and Facilitating Communication between Caregivers in a Pediatric Emergency Department: A Randomized Controlled Pilot Trial

For maintaining collaboration and coordination among emergency department (ED) caregivers, it is essential to effectively share patient-centered information. Indirect activities on patients, such as searching for laboratory results and sharing information with scattered colleagues, waste resources to the detriment of patients and staff. Therefore, we conducted a pilot study to evaluate the initial efficacy of a mobile app to facilitate rapid mobile access to central laboratory results and remote interprofessional communication. A total of 10 ED residents and registered nurses were randomized regarding the use of the app versus conventional methods during semi-simulated scenarios in a pediatric ED (PED). The primary outcome was the elapsed time in minutes in each group from the availability of laboratory results to their consideration by participants. The secondary outcome was the elapsed time to find a colleague upon request. Time to consider laboratory results was significantly reduced from 23 min (IQR 10.5–49.0) to 1 min (IQR 0–5.0) with the use of the app compared to conventional methods (92.2% reduction in mean times, p = 0.0079). Time to find a colleague was reduced from 24 min to 1 min (i.e., 93.0% reduction). Dedicated mobile apps have the potential to improve information sharing and remote communication in emergency care.

Effects of using an abdominal simulator to develop palpatory competencies in 3rd year medical students

BACKGROUND

Medical school faculty are hard pressed to provide clerkship students with sufficient opportunity to develop and practice their capacity to perform a competent clinical examination, including the palpatory examination of the abdomen. We evaluated the impact of training with an abdominal simulator, AbSim, designed to monitor the depth, location, and thoroughness of their palpation and to provide concurrent and summative feedback regarding their performance.

METHODS

All third-year medical students were given the opportunity to develop their palpatory skills with the AbSim simulator during the family medicine rotation. The performance of those who studied with the simulator was measured by its sensors, before and after a training session that included visual feedback regarding the depth and coverage of the student's manual pressure. Additionally, all students reported their confidence in their evolving abdominal palpation skills at the beginning and end of the rotation.

RESULTS

119 (86.9%) of 137 students filled out the initial questionnaire, and 73 (61.3%) studied with the abdominal simulator. The training produced a highly significant improvement in their overall performance (4 measures, p's < 0.001). Pre-training performance (depth calibration and thoroughness of coverage) was not related to the number of months of previous clinical rotations nor to previous internal medicine or surgery rotations. There was little relation between students' confidence in their abdominal examination skills and objective measures of their palpatory performance; however, students who chose the training started with less confidence, and became more confident after training.

CONCLUSIONS

Guided abdominal simulator practice increased medical students' capacity to perform an abdominal examination with more appropriate depth and thoroughness of palpation. Interpretation of changes in confidence are uncertain, because confidence was unrelated to objectively measured performance. However, students with low initial confidence in their abdominal examination seemed to be more likely to choose to study with the abdominal simulator.

Quality of Resuscitative Care Provided to an Infant With Abusive Head Trauma in Community Emergency Departments: An In Situ, Prospective, Simulation-Based Study

OBJECTIVES

Abusive head trauma (AHT) is a very common and serious form of physical abuse, and a major cause of mortality and morbidity for young children. Early Recognition and supportive care of children with AHT is a common challenge in community emergency department (CEDs). We hypothesized that standardized, in situ simulation can be used to measure and compare the quality of resuscitative measures provided to children with AHT in a diverse set of CEDs.

METHODS

This prospective, simulation-based study measured teams' performance across CEDs. The primary outcome was overall adherence to AHT using a 15-item performance assessment checklist based on the number of tasks performed correctly on the checklist.

RESULTS

Fifty-three multiprofessional teams from 18 CEDs participated in the study. Of 270 participants, 20.7% were physicians, 65.2% registered nurses, and 14.1% were other providers. Out of all tasks, assessment of airway/breathing was the most successfully conducted task by 53/53 teams (100%). Although 43/53 teams (81%) verbalized the suspicion for AHT, only 21 (39.6%) of 53 teams used hyperosmolar agent, 4 (7.5%) of 53 teams applied cervical spine collar stabilization, and 6 (11.3%) of 53 teams raised the head of the bed. No significant difference in adherence to the checklist was found in the CEDs with an inpatient pediatric service or these with designated adult trauma centers compared with CEDs without. Community emergency departments closer to the main academic center outperformed CEDs these that are further away.

CONCLUSIONS

This study used in situ simulation to describe quality of resuscitative care provided to an infant presenting with AHT across a diverse set of CEDs, revealing variability in the initial recognition and stabilizing efforts and provided and targets for improvement. Future interventions focusing on reducing these gaps could improve the performance of CED providers and lead to improved patient outcomes.

Putting self-regulated learning in context: Integrating self-, co-, and socially shared regulation of learning

Processes involved in the regulation of learning have been researched for decades, because of its impact on academic and workplace performance. In fact, self-regulated learning is the focus of countless studies in health professions education and higher education in general. While we will always need competent individuals who are able to regulate their own learning, developments in healthcare require a shift from a focus on the individual to the collective: collaboration within and between healthcare teams is at the heart of high-quality patient care. Concepts of collaborative learning and collective competence challenge commonly held conceptualisations of regulatory learning and call for a focus on the social embeddedness of regulatory learning and processes regulating the learning of the collective. Therefore, this article questions the alignment of current conceptualisations of regulation of learning with demands for collaboration in current healthcare. We explore different conceptualisations of regulation of learning (self-, co-, and socially shared regulation of learning), and elaborate on how the integration of these conceptualisations adds to our understanding of regulatory learning in healthcare settings. Building on these insights, we furthermore suggest ways forward for research and educational practice.

Development of a Mannequin for Simulation-Based Trials Involving Respiratory Viral Spread During Respiratory Arrest and Cardiopulmonary Arrest Scenarios

During the coronavirus disease 2019 (COVID-19) pandemic, mannequin models have been developed to mimic viral spread using fluorescent particles. These models use contraptions such as a spray gun or an exploding latex balloon to emanate a sudden acceleration of particles, simulating a "cough" reflex. No models have been developed to mimic passive aerosolization of viral particles during a cardiopulmonary arrest simulation. Our novel approach to aerosolization of simulated viral spread allows for a continuous flow of particles, which allows us to maintain components of high-fidelity team-based simulations. Our simulated model emanated GloGerm (Moab, UT) from the respiratory tract using a continuous nebulization chamber. Uniquely, the construction of our apparatus allowed for the ability to perform full, simulated cardiopulmonary resuscitation scenarios (such as chest compressions, bag-mask ventilation, and endotracheal intubation) on a high-fidelity mannequin while visualizing potential contamination spread at the conclusion of the simulation. Positive feedback from users included the ability to visualize particulate contamination after cardiopulmonary resuscitations in the context of personal protective equipment usage and roles in resuscitation (i.e. physician, respiratory therapist, nurse). Negative criticism towards the simulation included the lack of certain high-fidelity feedback markers of the mannequin (auscultating breath sounds and checking pulses) due to the construction of the particle aerosolization mechanism.

A Novel Application of the Modified Angoff Method to Rate Case Difficulty in Simulation-Based Research

INTRODUCTION

Simulation use in research is often limited by controlling for scenario difficulty when using repeated measures. Our study assesses the feasibility of the Modified Angoff Method to reach expert consensus regarding difficulty of medical simulations. We compared scores with participant physiologic stress.

METHODS

Emergency medicine physicians with expertise in simulation education were asked to review 8 scenarios and estimate the percentage of resident physicians who would perform all critical actions using the modified Angoff method. A standard deviation (SD) of less than 10% of estimated percentage correct signified consensus. Twenty-five residents then performed the 6 scenarios that met consensus and heart rate variability (HRV) was measured.

RESULTS

During round 1, experts rated 4/8 scenarios within a 10% SD for postgraduate year 3 (PGY3) and 3/8 for PGY4 residents. In round 2, 6/8 simulation scenarios were within an SD of 10% points for both years. Intraclass correlation coefficient was 0.84 for PGY3 ratings and 0.89 for PGY4 ratings. A mixed effects analysis of variance showed no significant difference in HRV change from rest to simulation between teams or scenarios. Modified Angoff Score was not a predictor of HRV (multiple R2 = 0.0176).

CONCLUSIONS

Modified Angoff ratings demonstrated consensus in quantifying the estimated percentage of participants who would complete all critical actions for most scenarios. Although participant HRV did decrease during the scenarios, we were unable to significantly correlate this with ratings. This modified Angoff method is a feasible approach to evaluate simulation difficulty for educational and research purposes and may decrease the time and resources necessary for scenario piloting.

Improving Pediatric Diabetic Ketoacidosis Management in Community Emergency Departments Using a Simulation-Based Collaborative Improvement Program

OBJECTIVES

The majority of pediatric patients with diabetic ketoacidosis (DKA) present to community emergency departments (CEDs) that are less prepared to care for acutely ill children owing to low pediatric volume and limited pediatric resources and guidelines. This has impacted the quality of care provided to pediatric patients in CEDs. We hypothesized that a simulation-based collaborative program would improve the quality of the care provided to simulated pediatric DKA patients presenting to CEDs.

METHODS

This prospective interventional study measured adherence of multiprofessional teams caring for pediatric DKA patients preimplementation and postimplementation of an improvement program in simulated setting. The program consisted of (a) a postsimulation debriefing, (b) assessment reports, (c) distribution of educational materials and access to pediatric resources, and (d) ongoing communication with the academic medical center (AMC). All simulations were conducted in situ (in the CED resuscitation bay) and were facilitated by a collaborative team from the AMC. A composite adherence score was calculated using a critical action checklist. A mixed linear regression model was performed to examine the impact of CED and team-level variables on the scores.

RESULTS

A total of 91 teams from 13 CEDs participated in simulated sessions. There was a 22-point improvement of overall adherence to the DKA checklist from the preintervention to the postintervention simulations. Six of 9 critical checklist actions showed statistically significant improvement. Community emergency departments with medium pediatric volume showed the most overall improvement. Teams from CEDs that are further from the AMC showed the least improvement from baseline.

CONCLUSIONS

This study demonstrated a significant improvement in adherence to pediatric DKA guidelines in CEDs across the state after execution of an in situ simulation-based collaborative improvement program.

Simulation-based assessment of care for infant cardiogenic shock in the emergency department

BACKGROUND

Congenital heart disease (CHD) is the leading cause of infant deaths associated with birth defects. Neonates with undiagnosed CHD often present to general emergency departments (GEDs) for initial resuscitation that are less prepared than paediatric centres, resulting in disparities in the quality of care. Neonates with undiagnosed CHD represent a challenge; thus, it is necessary for GEDs to be prepared for this population.

AIM

To evaluate the process of resuscitative care provided to a neonate in cardiogenic shock due to CHD in the GEDs in a simulated setting and to describe the impact of teams and GED variables on the process of care.

METHODS

This is a prospective simulation-based assessment of the process of care provided to a neonate with coarctation of the aorta in cardiogenic shock. Simulation sessions were conducted at participating GEDs utilizing each GED's interdisciplinary team and resources. The primary outcome was adherence to best practice, as measured by a 15-item overall composite adherence score (CAS). In addition, we stratified the overall CAS into CHD-critical items and the general resuscitation items CAS. The secondary outcome was the impact of the team's and GED's characteristics on the scores.

FINDINGS

This study enrolled 32 teams from 12 GEDs. Among 161 participants, 103 (63.97%) were registered nurses, 33 (20.50%) were physicians, 17 (10.56%) were respiratory therapists, and 8 (4.97%) were other medical professionals. The overall median CAS was 84, with the CHD-critical items having a median CAS of 34.5. The most underperformed tasks are checking pulses on the upper and lower extremities (44%), obtaining blood pressure in the upper and lower extremities (25%), and administering prostaglandin E1 (22%).

CONCLUSIONS

Using in situ simulation in a set of GEDs, we revealed gaps in the resuscitation care of neonates with CHD in cardiogenic shock.

RELEVANCE TO CLINICAL PRACTICE

These findings highlight the importance of targeted improvement programs for high-stakes illnesses in GED.

Impact of a Mobile App on Paramedics' Perceived and Physiologic Stress Response During Simulated Prehospital Pediatric Cardiopulmonary Resuscitation: Study Nested Within a Multicenter Randomized Controlled Trial

BACKGROUND

Out-of-hospital cardiac arrests (OHCAs) are stressful, high-stake events that are associated with low survival rates. Acute stress experienced in this situation is associated with lower cardiopulmonary resuscitation performance in calculating drug dosages by emergency medical services. Children are particularly vulnerable to such errors. To date, no app has been validated to specifically support emergency drug preparation by paramedics through reducing the stress level of this procedure and medication errors.

OBJECTIVE

This study aims to determine the effectiveness of an evidence-based mobile app compared with that of the conventional preparation methods in reducing acute stress in paramedics at the psychological and physiological levels while safely preparing emergency drugs during simulated pediatric OHCA scenarios.

METHODS

In a parent, multicenter, randomized controlled trial of 14 emergency medical services, perceived and physiologic stress of advanced paramedics with drug preparation autonomy was assessed during a 20-minute, standardized, fully video-recorded, and highly realistic pediatric OHCA scenario in an 18-month-old child. The primary outcome was participants' self-reported psychological stress perceived during sequential preparations of 4 intravenous emergency drugs (epinephrine, midazolam, 10% dextrose, and sodium bicarbonate) with the support of the PedAMINES (Pediatric Accurate Medication in Emergency Situations) app designed to help pediatric drug preparation (intervention) or conventional methods (control). The State-Trait Anxiety Inventory and Visual Analog Scale questionnaires were used to measure perceived stress. The secondary outcome was physiologic stress, measured by a single continuous measurement of the participants' heart rate with optical photoplethysmography.

RESULTS

From September 3, 2019, to January 21, 2020, 150 advanced paramedics underwent randomization. A total of 74 participants were assigned to the mobile app (intervention group), and 76 did not use the app (control group). A total of 600 drug doses were prepared. Higher State-Trait Anxiety Inventory-perceived stress increase from baseline was observed during the scenario using the conventional methods (mean 35.4, SD 8.2 to mean 49.8, SD 13.2; a 41.3%, 35.0 increase) than when using the app (mean 36.1, SD 8.1 to mean 39.0, SD 8.4; a 12.3%, 29.0 increase). This revealed a 30.1% (95% CI 20.5%-39.8%; P<.001) lower relative change in stress response in participants who used the app. On the Visual Analog Scale questionnaire, participants in the control group reported a higher increase in stress at the peak of the scenario (mean 7.1, SD 1.8 vs mean 6.4, SD 1.9; difference: -0.8, 95% CI -1.3 to -0.2; P=.005). Increase in heart rate during the scenario and over the 4 drugs was not different between the 2 groups.

CONCLUSIONS

Compared with the conventional method, dedicated mobile apps can reduce acute perceived stress during the preparation of emergency drugs in the prehospital setting during critical situations. These findings can help advance the development and evaluation of mobile apps for OHCA management and should be encouraged.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03921346; https://clinicaltrials.gov/ct2/show/NCT03921346.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1186/s13063-019-3726-4.

Preparedness for Pediatric Office Emergencies: A Multicenter, Simulation-Based Study

OBJECTIVES

Pediatric emergencies can occur in pediatric primary care offices. However, few studies have measured emergency preparedness, or the processes of emergency care, provided in the pediatric office setting. In this study, we aimed to measure emergency preparedness and care in a national cohort of pediatric offices.

METHODS

This was a multicenter study conducted over 15 months. Emergency preparedness scores were calculated as a percentage adherence to 2 checklists on the basis of the American Academy of Pediatrics guidelines (essential equipment and supplies and policies and protocols checklists). To measure the quality of emergency care, we recruited office teams for simulation sessions consisting of 2 patients: a child with respiratory distress and a child with a seizure. An unweighted percentage of adherence to checklists for each case was calculated.

RESULTS

Forty-eight teams from 42 offices across 9 states participated. The mean emergency preparedness score was 74.7% (SD: 12.9). The mean essential equipment and supplies subscore was 82.2% (SD: 15.1), and the mean policies and protocols subscore was 57.1% (SD: 25.6). Multivariable analyses revealed that independent practices and smaller total staff size were associated with lower preparedness. The median asthma case performance score was 63.6% (interquartile range: 43.2-81.2), whereas the median seizure case score was 69.2% (interquartile range: 46.2-80.8). Offices that had a standardized process of contacting emergency medical services (EMS) had a higher rate of activating EMS during the simulations.

CONCLUSIONS

Pediatric office preparedness remains suboptimal in a multicenter cohort, especially in smaller, independent practices. Academic and community partnerships using simulation can help address gaps and implement important processes like contacting EMS.

Simulation-based research in emergency medicine in Canada: Priorities and perspectives

OBJECTIVE

Simulation plays an integral role in the Canadian healthcare system with applications in quality improvement, systems development, and medical education. High-quality, simulation-based research will ensure its effective use. This study sought to summarize simulation-based research activity and its facilitators and barriers, as well as establish priorities for simulation-based research in Canadian emergency medicine (EM).

METHODS

Simulation-leads from Canadian departments or divisions of EM associated with a general FRCP-EM training program surveyed and documented active EM simulation-based research at their institutions and identified the perceived facilitators and barriers. Priorities for simulation-based research were generated by simulation-leads via a second survey; these were grouped into themes and finally endorsed by consensus during an in-person meeting of simulation leads. Priority themes were also reviewed by senior simulation educators.

RESULTS

Twenty simulation-leads representing all 14 invited institutions participated in the study between February and May, 2018. Sixty-two active, simulation-based research projects were identified (median per institution = 4.5, IQR 4), as well as six common facilitators and five barriers. Forty-nine priorities for simulation-based research were reported and summarized into eight themes: simulation in competency-based medical education, simulation for inter-professional learning, simulation for summative assessment, simulation for continuing professional development, national curricular development, best practices in simulation-based education, simulation-based education outcomes, and simulation as an investigative methodology.

CONCLUSION

This study summarized simulation-based research activity in EM in Canada, identified its perceived facilitators and barriers, and built national consensus on priority research themes. This represents the first step in the development of a simulation-based research agenda specific to Canadian EM.

Massive Hemorrhage Protocol Application and Teamwork Skills

OBJECTIVE

Massive hemorrhages (MHs) are rare but serious complications of pediatric trauma and obstetric cases. This study aimed to evaluate the impact of interprofessional simulation to improve adherence to a MH protocol (MHP), teamwork skills and confidence levels during a hemorrhagic crisis situation.Methods: This was a pre-post experimental study conducted at a tertiary care mother-child simulation center. Pediatric emergency and obstetric teams were submitted to simulated trauma and postpartum MH scenarios. Training consisted of two case scenarios followed by debriefing sessions and a lecture on the MHP. The primary outcome was adherence to MHP processes (checklist) measured prior to and 2 weeks following training sessions. Other outcomes were the measure of teamwork skills (Mayo High Performance Teamwork Scale) and confidence of the participants.

RESULTS

Sixty-two health care professionals were involved in eight interprofessional teams. Mean scores for adherence to the MHP improved from 19.1 in the pretraining phase to 25.8 in the posttraining phase (difference of 6.7; 95% confidence interval [CI] = 4.4 to 8.9). Mean scores pertaining to teamwork skills also improved significantly between pre- and posttraining phases (difference = 3.9; 95% CI = 1.5 to 6.4). Confidence questionnaires showed significant improvements in the posttraining phase (difference = 6.9; 95% CI = 5.3 to 8.3).

CONCLUSIONS

Targeted training involving simulation and protocol review improved participant adherence to MHP processes and teamwork skills. Confidence levels improved across all disciplines.

Medical Emergency Management in the Dental Office (MEMDO): A Pilot Study Assessing a Simulation-Based Training Curriculum for Dentists

In the event of a medical emergency in the dental office, the dentist must be able to identify a patient in distress, assess the situation, and institute proper management. This study assessed the impact of a simulation-based medical emergency preparedness curriculum on a resident's ability to manage medical emergencies. This interventional and pre-post educational pilot study included 8 participants who completed a standard curriculum and 8 who completed a modified curriculum (N = 16). The intervention consisted of a comprehensive medical emergency preparedness curriculum that replaced lecture sessions in a standard curriculum. Participants completed performance assessments using scenario-based objective structured clinical examinations (OSCEs) that were recorded and evaluated by calibrated faculty reviewers using a customized scoring grid. The intervention group performed significantly better than the control group on their summative OSCEs, averaging 90.9 versus 61.2 points out of 128 (p = .0009). All participants from the intervention group passed their summative OSCE with scores >60%, while none from the control group received passing scores. Completion of a simulation-based medical emergency preparedness curriculum significantly improved resident performance during simulated medical emergencies.

Interprofessional education in the rural environment to enhance multidisciplinary care in future practice: Breaking down silos in tertiary health education

OBJECTIVE

Western Sydney University has implemented a rural interprofessional learning programme to promote collaborative care approaches to enhance cross-discipline communications, improve knowledge and clarity of roles and improve patient care and outcomes.

DESIGN

Rural interprofessinal learning is an interprofessional educational approach, consisting of simulations of complex health events. Simulation methodology frames the study with a focus on human interaction. A mixed-methods evaluation has been conducted, incorporating pre- and post- event participant surveys along with semi-structured focus groups.

SETTING

Simulations are conducted in the rural setting, including community settings, working farms and rural hospitals.

MAIN OUTCOME MEASURES

Reflexive thematic analysis was used to identify themes measuring students' perceptions of interdisciplinary care, knowlede of other health discipline roles and skills and how they believe the exercise will influence their future practice. Facilitator feedback regarding the efficacy of the simulations was also recorded and analysed using reflexive thematic analysis.

PARTICIPANTS

Care of simulated patient(s)/bystander(s) is primarily provided by paramedicine, nursing and medical students; however, increasing interest has expanded the programme to include students from a range of allied health professions. Simulations are facilitated by a multidisciplinary team of experienced practitioners and specialists.

INTERVENTION

Four rural interprofessional learning events have been held.

RESULTS

120 students have participated in the evaluation. Findings include increased understanding of the contributions of other disciplines in enhancing patient care, team approaches, cross-discipline communication and a need to engage in collaborative care in future practice.

CONCLUSION

Creating a collaborative learning environment creates a culture of multidisciplinary care, enhancing patient care and improving outcomes. The rural interprofessional learning model is an effective interprofessional educational approach, which can be repeated, refined and improved for continual professional development.

Mindfulness Is Related to the Situational Awareness of Medical Students Confronted with Life-Threatening Emergency Situations

BACKGROUND

Emergency medicine can impose a heavy psychological burden on healthcare workers. Stress experienced during life-threatening situations may disrupt situational awareness (SA), i.e., the perception of environmental elements with respect to time and space, the comprehension of their meaning, and the projection of their state into the near future. We aimed to investigate whether mindfulness (a special way of paying attention: conscious, non-judgmental, and oriented to the present moment) can be related to the SA levels among final-year medical students confronted with life-threatening situations during medical simulations.

METHODS

The simulations were constructed as high-fidelity scenarios in children and adults (ClinicalTrials.gov ID: NCT03761355). The components of mindfulness were assessed using the Five Facet Mindfulness Questionnaire. SA among students was assessed using The Situation Awareness Global Assessment Technique at three levels: (1) data, (2) comprehension, and (3) projection.

RESULTS

In total, 117 students were included. Level 1 SA positively correlated with the overall mindfulness score and its components, i.e., nonreactivity, conscious presence, and nonjudgment. Moreover, level 3 SA significantly correlated with the description, but not with the overall mindfulness score. A regression model showed that nonreactivity explained 34% of Level 1 of SA variability. The addition of conscious presence and nonjudgment into this model did not change its predictive value.

CONCLUSIONS

nonreactivity a component of mindfulness of final-year medical students is related to the meticulous data collection of patients in life-threatening situations.

Correlation between real-time heart rate and fatigue in chest compression providers during cardiopulmonary resuscitation: A simulation-based interventional study

BACKGROUND

The American Heart Association guidelines recommend switching chest compression providers at least every 2 min depending on their fatigue during cardiopulmonary resuscitation (CPR). Although the provider's heart rate is widely used as an objective indicator for detecting fatigue, the accuracy of this measure is debatable.

OBJECTIVES

This study was designed to determine whether real-time heart rate is a measure of fatigue in compression providers.

STUDY DESIGN

A simulation-based prospective interventional study including 110 participants.

METHODS

Participants performed chest compressions in pairs for four cycles using advanced cardiovascular life support simulation. Each participant's heart rate was measured using wearable healthcare devices, and qualitative variables regarding individual compressions were obtained from computerized devices. The primary outcome was correct depth of chest compressions. The main exposure was the change in heart rate, defined as the difference between the participant's heart rate during individual compressions and that before the simulation was initiated.

RESULTS

With a constant compression duration for one cycle, the overall accuracy of compression depth significantly decreased with increasing heart rate. Female participants displayed significantly decreased accuracy of compression depth with increasing heart rate (odds ratio [OR]: 0.97; 95% confidence interval [CI]: 0.95-0.98; P < .001). Conversely, male participants displayed significantly improved accuracy with increasing heart rate (OR: 1.03; 95% CI: 1.02-1.04; P < .001).

CONCLUSION

Increasing heart rate could reflect fatigue in providers performing chest compressions with a constant duration for one cycle. Thus, provider rotation should be considered according to objectively measured fatigue during CPR.

Impact of a shared decision-making mHealth tool on caregivers' team situational awareness, communication effectiveness, and performance during pediatric cardiopulmonary resuscitation: study protocol of a cluster randomized controlled trial

Background

Effective team communication, coordination, and situational awareness (SA) by team members are critical components to deliver optimal cardiopulmonary resuscitation (CPR). Complexity of care during CPR, involvement of numerous providers, miscommunication, and other exogenous factors can all contribute to negatively influencing patient care, thus jeopardizing survival. We aim to investigate whether an mHealth supportive tool (the Interconnected and Focused Mobile Apps on patient Care Environment [InterFACE]) developed as a collaborative platform to support CPR providers in real-time and share patient-centered information would increase SA during pediatric CPR.

Methods

We will conduct a prospective, cluster randomized controlled trial by groups of 6 participants in a tertiary pediatric emergency department (33,000 consultations/year) with pediatric physicians and nurses. We will compare the impact of the InterFACE tool with conventional communication methods on SA and effective team communication during a standardized pediatric in-hospital cardiac arrest and a polytrauma high-fidelity simulations. Forty-eight participants will be randomized (1:1) to consecutively perform two 20-min video-recorded scenarios using either the mHealth tool or conventional methods. The primary endpoint is the SA score, measured with the Situation Awareness Global Assessment Technique (SAGAT) instrument. Enrollment will start in late 2020 and data analysis in early 2021. We anticipate that the intervention will be completed by early 2021 and study results will be submitted in mid 2021 for publication.

Discussion

This clinical trial will assess the impact of a collaborative mHealth tool on increasing situational awareness and effective team communication during in-hospital pediatric resuscitation. As research in this area is scarce, the results generated by this study may become of paramount importance in improving the care of children receiving in-hospital CPR, in the era of increasing communication technology.

Trial registration

ClinicalTrials.gov NCT04464603. Registered on 9 July 2020.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05170-3.

Influence of Cardiopulmonary Resuscitation Coaching on Interruptions in Chest Compressions During Simulated Pediatric Cardiac Arrest

OBJECTIVES

To determine the impact of a cardiopulmonary resuscitation coach on the frequency and duration of pauses during simulated pediatric cardiac arrest.

DESIGN

This is a secondary analysis of video data collected from a prospective multicenter trial. Forty simulated pediatric cardiac arrest scenarios (20 noncoach and 20 coach teams), each lasting 18 minutes in duration, were reviewed by three clinical experts to document events surrounding each pause in chest compressions.

SETTING

Four pediatric academic medical centers from Canada and the United States.

SUBJECTS

Two-hundred healthcare providers in five-member interprofessional resuscitation teams that included either a cardiopulmonary resuscitation coach or a noncoach clinical provider.

INTERVENTIONS

Teams were randomized to include either a trained cardiopulmonary resuscitation coach or an additional noncoach clinical provider.

MEASUREMENTS AND MAIN RESULTS

The frequency, duration, and associated factors with each interruption in chest compressions were recorded and compared between the groups with and without a cardiopulmonary resuscitation coach, using t tests, Wilcoxon rank-sum tests, or chi-squared tests, depending on the distribution and types of outcome variables. Mixed-effect linear models were used to explore the effect of cardiopulmonary resuscitation coaching on pause durations, accounting for multiple measures of pause duration within teams. A total of 655 pauses were identified (noncoach n = 304 and coach n = 351). Cardiopulmonary resuscitation-coached teams had decreased total mean pause duration (98.6 vs 120.85 s, p = 0.04), decreased intubation pause duration (median 4.0 vs 15.5 s, p = 0.002), and similar mean frequency of pauses (17.6 vs 15.2, p = 0.33) when compared with noncoach teams. Teams with cardiopulmonary resuscitation coaches are more likely to verbalize the need for pause (86.5% vs 73.7%, p < 0.001) and coordinate change of the compressors, rhythm check, and pulse check (31.7% vs 23.2%, p = 0.05). Teams with cardiopulmonary resuscitation coach have a shorter pause duration than non-coach teams, adjusting for number and types of tasks performed during the pause.

CONCLUSIONS

When compared with teams without a cardiopulmonary resuscitation coach, the inclusion of a trained cardiopulmonary resuscitation coach leads to improved verbalization before pauses, decreased pause duration, shorter pauses during intubation, and better coordination of key tasks during chest compression pauses.

Change in Cardiopulmonary Resuscitation Performance Over Time During Simulated Pediatric Cardiac Arrest and the Effect of Just-in-Time Training and Feedback

OBJECTIVES

Effective cardiopulmonary resuscitation (CPR) is critical to ensure optimal outcomes from cardiac arrest, yet trained health care providers consistently struggle to provide guideline-compliant CPR. Rescuer fatigue can impact chest compression (CC) quality during a cardiac arrest event, although it is unknown if visual feedback or just-in-time training influences change of CC quality over time. In this study, we attempt to describe the changes in CC quality over a 12-minute simulated resuscitation and examine the influence of just-in-time training and visual feedback on CC quality over time.

METHODS

We conducted secondary analysis of data collected from the CPRCARES study, a multicenter randomized trial in which CPR-certified health care providers from 10 different pediatric tertiary care centers were randomized to receive visual feedback, just-in-time CPR training, or no intervention. They participated in a simulated cardiac arrest scenario with 2 team members providing CCs. We compared the quality of CCs delivered (depth and rate) at the beginning (0-4 minutes), middle (4-8 minutes), and end (8-12 minutes) of the resuscitation.

RESULTS

There was no significant change in depth over the 3 time intervals in any of the arms. There was a significant increase in rate (128 to 133 CC/min) in the no intervention arm over the scenario duration (P < 0.05).

CONCLUSIONS

There was no significant drop in CC depth over a 12-minute cardiac arrest scenario with 2 team members providing compressions.

Being Prepared During the Evolving COVID-19 Pandemic: A Neonatal Experience in Training and Simulation

Background: Rapid spread of the COVID-19 pandemic raised an urgent need for preparedness in the healthcare sector, including training of healthcare workers to cope with the burden of infected cases while ensuring proper protection of themselves. Improper infection prevention and control measures were key reasons for infection in healthcare workers during the early phase of the outbreak. Objectives/Methods: This paper describes the combined approach of 3 restructured hospitals in Singapore in preparing and training neonatal healthcare workers' during the COVID-19 pandemic crisis, as well as lessons learnt during this process. Results: Information sharing was conducted in the form of e-learning, emphasizing on topics like disease knowledge and infection prevention and control procedures. Skills and competency training were carried out in the form of simulation, with sessions scaled into 4 levels progressing from individual task training to larger group simulations involving multiple disciplines and departments. Challenges encountered included information fatigue by large amount of constantly changing information and multiple amendments to workflows as more information arose. Difficulties conducting training and simulation sessions included restriction of group size to mitigate infection risk amongst participants and the limited supply of personal protective equipment prioritized for direct patient care. Conclusion: Healthcare institutions should ensure adequate dissemination of conceptual knowledge as well as skills competency training of staff in infection control measures for the protection of healthcare workers and patient safety. Ongoing training for sustainability of knowledge and skills, while adapting to the rapidly evolving situation is important in the preparation for future outbreaks.