Development of Distance Simulation Educator Guidelines in Healthcare: A Delphi Method Application

INTRODUCTION

The abrupt disruption of in-person instruction in health care during the COVID-19 pandemic resulted in the rapid adoption of distance simulation as an immediate alternative to providing in-person simulation-based education. This massive instructional shift, combined with the lack of educator training in this domain, led to challenges for both learners and educators. This study aimed to disseminate the first set of competencies required of and unique to effective distance simulation educators.

METHODS

This was a multiphasic and iterative modified Delphi study validating the content of carefully and rigorously synthesized literature. Experts were invited from around the globe to participate in this study with mandatory attendance at an annual health care simulation conference to openly discuss the guidelines presented as competencies in this document. We divided each competency into "Basic" and "Advanced" levels, and agreement was sought for these levels individually. The experts provided their opinion by choosing the options of "Keep, Modify, or Delete." A free-marginal kappa of 0.60 was chosen a priori.

RESULTS

At the conclusion of the Delphi process, the number of competencies changed from 66 to 59, basic subcompetencies from 216 to 196, and advanced subcompetencies from 179 to 182.

CONCLUSIONS

This article provides the first set of consensus guidelines to distance simulation educators in health care, and paved the way for further research in distance simulation as a modality.

Understanding the Effects of Health Care Distance Simulation: A Systematic Review

ABSTRACT

The use of distance simulation has rapidly expanded in recent years with the physical distance requirements of the COVID-19 pandemic. With this development, there has been a concurrent increase in research activities and publications on distance simulation. The authors conducted a systematic review of the peer-reviewed distance health care simulation literature. Data extraction and a risk-of-bias assessment were performed on selected articles. Review of the databases and gray literature reference lists identified 10,588 titles for review. Of those, 570 full-text articles were assessed, with 54 articles included in the final analysis. Most of these were published during the COVID-19 pandemic (2020-2022). None of the included studies examined an outcome higher than a Kirkpatrick level of 2. Most studies only examined low-level outcomes such as satisfaction with the simulation session. There was, however, a distinction in studies that were conducted in a learning environment where all participants were in different locations ("distance only") as compared with where some of the participants shared the same location ("mixed distance"). This review exclusively considered studies that focused solely on distance. More comparative studies exploring higher level outcomes are required to move the field forward.

Society for Simulation in Healthcare Guidelines for Simulation Training

BACKGROUND

Simulation has become a staple in the training of healthcare professionals with accumulating evidence on its effectiveness. However, guidelines for optimal methods of simulation training do not currently exist.

METHODS

Systematic reviews of the literature on 16 identified key questions were conducted and expert panel consensus recommendations determined using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) methodology.

OBJECTIVE

These evidence-based guidelines from the Society for Simulation in Healthcare intend to support healthcare professionals in decisions on the most effective methods for simulation training in healthcare.

RESULTS

Twenty recommendations on 16 questions were determined using GRADE. Four expert recommendations were also provided.

CONCLUSIONS

The first evidence-based guidelines for simulation training are provided to guide instructors and learners on the most effective use of simulation in healthcare.

Health Care Simulation in Person and at a Distance: A Systematic Review

ABSTRACT

Distance simulation is a method of health care training in which the learners and facilitators are in different physical locations. Although methods of distance simulation have existed in health care for decades, this approach to education became much more prevalent during the COVID-19 pandemic. This systematic review studies a subset of distance simulation that includes combined in-person and distance simulation elements, identified here as "mixed- distance simulation." A review of the distance simulation literature identified 10,929 articles. Screened by inclusion and exclusion criteria, 34 articles were ultimately included in this review. The findings of this review present positive and negative aspects of mixed-distance simulation formats, a description of the most frequent configurations related to delivery, terminology challenges, as well as future directions including the need for faculty development, methodological rigor, and reporting details.

Debriefing Methods for Simulation in Healthcare: A Systematic Review

ABSTRACT

Debriefing is a critical component in most simulation experiences. With the growing number of debriefing concepts, approaches, and tools, we need to understand how to debrief most effectively because there is little empiric evidence to guide us in their use. This systematic review explores the current literature on debriefing in healthcare simulation education to understand the evidence behind practice and clarify gaps in the literature. The PICO question for this review was defined as "In healthcare providers [P], does the use of one debriefing or feedback intervention [I], compared to a different debriefing or feedback intervention [C], improve educational and clinical outcomes [O] in simulation-based education?" We included 70 studies in our final review and found that our current debriefing strategies, frameworks, and techniques are not based on robust empirical evidence. Based on this, we highlight future research needs.

Distance simulation in the health professions: a scoping review

BACKGROUND

Distance simulation is defined as simulation experiences in which participants and/or facilitators are separated from each other by geographic distance and/or time. The use of distance simulation as an education technique expanded rapidly with the recent COVID-19 pandemic, with a concomitant increase in scholarly work.

METHODS

A scoping review was performed to review and characterize the distance simulation literature. With the assistance of an informationist, the literature was systematically searched. Each abstract was reviewed by two researchers and disagreements were addressed by consensus. Risk of bias of the included studies was evaluated using the Risk of Bias 2 (RoB 2) and Risk of Bias in Non-randomized Studies of Interventions (ROBINS-I) tools.

RESULTS

Six thousand nine hundred sixty-nine abstracts were screened, ultimately leading to 124 papers in the final dataset for extraction. A variety of simulation modalities, contexts, and distance simulation technologies were identified, with activities covering a range of content areas. Only 72 papers presented outcomes and sufficient detail to be analyzed for risk of bias. Most studies had moderate to high risk of bias, most commonly related to confounding factors, intervention classification, or measurement of outcomes.

CONCLUSIONS

Most of the papers reviewed during the more than 20-year time period captured in this study presented early work or low-level outcomes. More standardization around reporting is needed to facilitate a clear and shared understanding of future distance simulation research. As the broader simulation community gains more experience with distance simulation, more studies are needed to inform when and how it should be used.

Factors Associated With Improved Pediatric Resuscitative Care in General Emergency Departments

OBJECTIVES

To describe the quality of pediatric resuscitative care in general emergency departments (GEDs) and to determine hospital-level factors associated with higher quality.

METHODS

Prospective observational study of resuscitative care provided to 3 in situ simulated patients (infant seizure, infant sepsis, and child cardiac arrest) by interprofessional GED teams. A composite quality score (CQS) was measured and the association of this score with modifiable and nonmodifiable hospital-level factors was explored.

RESULTS

A median CQS of 62.8 of 100 (interquartile range 50.5-71.1) was noted for 287 resuscitation teams from 175 emergency departments. In the unadjusted analyses, a higher score was associated with the modifiable factor of an affiliation with a pediatric academic medical center (PAMC) and the nonmodifiable factors of higher pediatric volume and location in the Northeast and Midwest. In the adjusted analyses, a higher CQS was associated with modifiable factors of an affiliation with a PAMC and the designation of both a nurse and physician pediatric emergency care coordinator, and nonmodifiable factors of higher pediatric volume and location in the Northeast and Midwest. A weak correlation was noted between quality and pediatric readiness scores.

CONCLUSIONS

A low quality of pediatric resuscitative care, measured using simulation, was noted across a cohort of GEDs. Hospital factors associated with higher quality included: an affiliation with a PAMC, designation of a pediatric emergency care coordinator, higher pediatric volume, and geographic location. A weak correlation was noted between quality and pediatric readiness scores.

Setting an Agenda: Results of a Consensus Process on Research Directions in Distance Simulation

BACKGROUND

The COVID-19 pandemic forced rapid implementation and refinement of distance simulation methodologies in which participants and/or facilitators are not physically colocated. A review of the distance simulation literature showed that heterogeneity in many areas (including nomenclature, methodology, and outcomes) limited the ability to identify best practice. In April 2020, the Healthcare Distance Simulation Collaboration was formed with the goal of addressing these issues. The aim of this study was to identify future research priorities in the field of distance simulation using data derived from this summit.

METHODS

This study analyzed textual data gathered during the consensus process conducted at the inaugural Healthcare Distance Simulation Summit to explore participant perceptions of the most pressing research questions regarding distance simulation. Participants discussed education and patient safety standards, simulation facilitators and barriers, and research priorities. Data were qualitatively analyzed using an explicitly constructivist thematic analysis approach, resulting in the creation of a theoretical framework.

RESULTS

Our sample included 302 participants who represented 29 countries. We identified 42 codes clustered within 4 themes concerning key areas in which further research into distance simulation is needed: (1) safety and acceptability, (2) educational/foundational considerations, (3) impact, and (4) areas of ongoing exploration. Within each theme, pertinent research questions were identified and categorized.

CONCLUSIONS

Distance simulation presents several challenges and opportunities. Research around best practices, including educational foundation and psychological safety, are especially important as is the need to determine outcomes and long-term effects of this emerging field.

From Concept to Publication: Effectiveness of the International Network for Simulation-Based Pediatric Innovation, Research, and Education Project Development Process at Generating Simulation Scholarship

BACKGROUND

As simulation matures, it is critical to develop pathways for researchers. A recent analysis, however, demonstrates a low conversion rate between abstract and peer-reviewed journal publication in our field. The International Network for Simulation-based Pediatric Innovation, Research, and Education has used the ALERT Presentation process for the past decade as a means of accelerating research. In this study, we analyze the scholarly products attributable to ALERT Presentations.

METHODS

Surveys were distributed to all International Network for Simulation-based Pediatric Innovation, Research, and Education Advanced Look Exploratory Research Template (ALERT) Presentation first authors from January 2011 through January 2020. Presenters were asked to provide information on abstracts, grants, journal publications, and book chapters related to their ALERT Presentation, as well as basic demographic information. A structured literature search was conducted for those ALERT Presentations whose authors did not return a survey. The resulting database was descriptively analyzed, and statistical correlations between demographic variables and scholarship were examined.

RESULTS

One hundred sixty-five new ALERT presentations were presented over 10 years. We identified 361 associated scholarly works (170 conference abstracts, 125 peer-reviewed journal publications, 65 grants, and 1 book chapter). Sixty-one percent (101 of 165) of ALERT Presentations produced at least 1 item of scholarship, and 59% (34 of 58) of ALERT Presentations that resulted in at least 1 abstract also led to at least 1 peer-reviewed journal article. Presenter gender was associated with likelihood of journal publication.

CONCLUSIONS

The ALERT Presentation process is an effective approach for facilitating the development of projects that result in disseminated scholarship. Wider adoption may benefit other simulation and education research networks.

Characterizing preferred terms for geographically distant simulations: distance, remote and telesimulation

Simulationists lack standard terms to describe new practices accommodating pandemic restrictions. A standard language around these new simulation practices allows ease of communication among simulationists in various settings.

We explored consensus terminology for simulation accommodating geographic separation of participants, facilitators or equipment. We used an iterative process with participants of two simulation conferences, with small groups and survey ranking.

Small groups (n = 121) and survey ranking (n = 54) were used with

This research has deepened our understanding of how simulationists interpret this terminology, including the derived themes: (1) physical distance/separation, (2) overarching nature of the term and (3) implications from existing terms. We further deepen the conceptual discussion on healthcare simulation aligned with the search of the terminologies. We propose there are nuances that prevent an early consensus recommendation. A taxonomy of descriptors specifying the conduct of

Characterizing preferred terms for geographically distant simulations: distance, remote and telesimulation

Simulationists lack standard terms to describe new practices accommodating pandemic restrictions. A standard language around these new simulation practices allows ease of communication among simulationists in various settings.

We explored consensus terminology for simulation accommodating geographic separation of participants, facilitators or equipment. We used an iterative process with participants of two simulation conferences, with small groups and survey ranking.

Small groups (n = 121) and survey ranking (n = 54) were used with

This research has deepened our understanding of how simulationists interpret this terminology, including the derived themes: (1) physical distance/separation, (2) overarching nature of the term and (3) implications from existing terms. We further deepen the conceptual discussion on healthcare simulation aligned with the search of the terminologies. We propose there are nuances that prevent an early consensus recommendation. A taxonomy of descriptors specifying the conduct of

Closing the Loop: Program Description and Qualitative Analysis of a Pediatric Posttransfer Follow-up and Feedback Program

OBJECTIVES

Follow-up and feedback foster improvement. General emergency medicine providers working in community hospitals desire follow-up and feedback on pediatric patients transferred to children's hospitals. We implemented a novel program to provide these data to our colleagues. The objective of this study was to explore stakeholder perspectives of our program.

METHODS

We provided secure, electronic reports on transfers from 7 general emergency departments (GEDs). Patient follow-up and feedback data were delivered to the GED's pediatric emergency care coordinator. Seven pediatric emergency care coordinators and 2 children's hospital liaisons participated in semistructured interviews. Five researchers coded and analyzed transcribed data using the constant comparative method of grounded theory. Codes were refined and clustered to develop themes.

RESULTS

Perceived values of the program included GED appreciation of closing the loop on transferred patients, providing education, and informing quality improvement. Participants valued the concise and timely nature of the reports and their empathetic delivery. Facilitators of program implementation included established professional relationships between the GED and the children's hospital liaisons and a GED's culture of self-inquiry. Barriers to program implementation included potential medicolegal exposure and the time burden for report generation and processing. Suggested programmatic improvements included focusing on generalizable, evidence-based learning points and analyzing care trends.

CONCLUSIONS

Stakeholders of our pediatric posttransfer follow-up and feedback program reported many benefits and provided key suggestions that may promote successful dissemination of similar programs nationwide. Examining data trends in transferred children may focus efforts to improve the care of children across all emergency care settings.

Pediatric Emergency Medicine ECHO (Extension for Community Health Care Outcomes): Cultivating Connections to Improve Pediatric Emergency Care

BACKGROUND

An Extension for Community Health Care Outcomes (ECHO) provides the opportunity for specialists at academic medical centers (AMCs) and frontline community generalists to engage in bidirectional learning. Specialists provide generalists with the current best evidence, and generalists share the local challenges applying this evidence to their practice. All ECHO participants strategize how to navigate these challenges together. Pediatric emergency medicine (PEM) may benefit from this knowledge translation strategy because most children seek emergency care from generalists in community emergency departments (CEDs) where variations in care between the AMC and the CED have been reported.

METHODS

Our objective was to use ECHO to cultivate a PEM community of practice that facilitated knowledge translation and generated future CED pediatric improvement initiatives. As such, we developed, implemented, and evaluated a PEM ECHO. We conducted general and targeted needs assessments to inform our curriculum and formatted the sessions to generate bidirectional learning. A postparticipation evaluation collected self-reported perceptions about knowledge translation, planned provider practice changes, and perceptions of the formation of a community of practice. Additionally, we solicited information on the implementation of any pediatric improvement activities attributed to the PEM ECHO.

RESULTS

Thirteen 1-hour sessions covered the chosen PEM topics. Participants represented diverse CEDs, with varied experience and roles in caring for children. All respondents (13/13) appreciated the ECHO learning format, reported improved PEM knowledge, and perceived the cultivation of a community of practice. Nine (85%) individuals attributed implementation of new pediatric improvement activities to the PEM ECHO.

CONCLUSIONS

Our PEM ECHO was associated with improved perceptions of PEM knowledge, cultivated a community of practice, and facilitated the implementation of CED pediatric improvement activities. The PEM ECHO's bidirectional learning format generated new initiatives and partnerships aiming to improve the emergency care of children.

Readiness for and Response to Coronavirus Disease 2019 Among Pediatric Healthcare Providers: The Role of Simulation for Pandemics and Other Disasters

OBJECTIVES

Early preparation for the training and education of healthcare providers, as well as the continuation or modification of routine medical education programs, is of great importance in times of the coronavirus disease 2019 pandemic or other public health emergencies. The goal of this study was to characterize these self-reported efforts by the pediatric simulation community.

DESIGN

This was a global, multicenter survey developed via a Delphi process.

SETTING

International survey study.

SUBJECTS

The survey was sent to 555 individual members of the three largest international pediatric simulation societies (The International Pediatric Simulation Society, International Network for Simulation-based Pediatric Innovation, Research & Education, and Netzwerk Kindersimulation e.V.) between April 27, 2020, and May 18, 2020.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

Description of coronavirus disease 2019 pandemic simulation-based preparation activities of pediatric acute and critical care healthcare providers. The Delphi process included 20 content experts and required three rounds to reach consensus. The survey was completed by 234 participants (42.2%) from 19 countries. Preparation differed significantly between the geographic regions, with 79.3% of Anglo-American/Anglo-Saxon, 82.6% of Indian, and 47.1% of European participants initiating specifically coronavirus disease 2019-related simulation activities. Frequent modifications to existing simulation programs included the use of telesimulation and virtual reality training. Forty-nine percent of institutions discontinued noncoronavirus disease 2019-related simulation training.

CONCLUSIONS

The swift incorporation of disease-specific sessions and the transition of standard education to virtual or hybrid simulation training modes occurred frequently. The approach used, however, depended heavily on local requirements, limitations, and circumstances. In particular, the use of telesimulation allowed education to continue while maintaining social distancing requirements.

Closing the gap: a call for a common blueprint for remote distance telesimulation

The physical requirements mandated by the COVID-19 pandemic have presented a challenge and an opportunity for simulation educators. Although there were already examples of simulation being delivered at a distance, the pandemic forced this technique into the mainstream. With any new discipline, it is important for the community to agree on vocabulary, methods and reporting guidelines. This editorial is a call to action for the simulation community to start this process so that we can best describe and use this technique.

National preparedness survey of pediatric intensive care units with simulation centers during the coronavirus pandemic

BACKGROUND

The coronavirus disease pandemic caught many pediatric hospitals unprepared and has forced pediatric healthcare systems to scramble as they examine and plan for the optimal allocation of medical resources for the highest priority patients. There is limited data describing pediatric intensive care unit (PICU) preparedness and their health worker protections.

AIM

To describe the current coronavirus disease 2019 (COVID-19) preparedness efforts among a set of PICUs within a simulation-based network nationwide.

METHODS

A cross-sectional multi-center national survey of PICU medical director(s) from children’s hospitals across the United States. The questionnaire was developed and reviewed by physicians with expertise in pediatric critical care, disaster readiness, human factors, and survey development. Thirty-five children’s hospitals were identified for recruitment through a long-established national research network. The questions focused on six themes: (1) PICU and medical director demographics; (2) Pediatric patient flow during the pandemic; (3) Changes to the staffing models related to the pandemic; (4) Use of personal protective equipment (PPE); (5) Changes in clinical practice and innovations; and (6) Current modalities of training including simulation.

RESULTS

We report on survey responses from 22 of 35 PICUs (63%). The majority of PICUs were located within children’s hospitals (87%). All PICUs cared for pediatric patients with COVID-19 at the time of the survey. The majority of PICUs (83.4%) witnessed decreases in non-COVID-19 patients, 43% had COVID-19 dedicated units, and 74.6% pivoted to accept adult COVID-19 patients. All PICUs implemented changes to their staffing models with the most common changes being changes in COVID-19 patient room assignment in 50% of surveyed PICUs and introducing remote patient monitoring in 36% of the PICU units. Ninety-five percent of PICUs conducted training for donning and doffing of enhanced PPE. Even 6 months into the pandemic, one-third of PICUs across the United States reported shortages in PPE. The most common training formats for PPE were hands-on training (73%) and video-based content (82%). The most common concerns related to COVID-19 practice were changes in clinical protocols and guidelines (50%). The majority of PICUs implemented significant changes in their airway management (82%) and cardiac arrest management protocols in COVID-19 patients (68%). Simulation-based training was the most commonly utilized training modality (82%), whereas team training (73%) and team dynamics (77%) were the most common training objectives.

CONCLUSIONS

A substantial proportion of surveyed PICUs reported on large changes in their preparedness and training efforts before and during the pandemic. PICUs implemented broad strategies including modifications to staffing, PPE usage, workflow, and clinical practice, while using simulation as the preferred training modality. Further research is needed to advance the level of preparedness, support staff assuredness, and support deep learning about which preparedness actions were effective and what lessons are needed to improve PICU care and staff protection for the next COVID-19 patient waves.

Cost-effectiveness of a video game versus live simulation for disaster training

Introduction

Disaster triage training for emergency medical service (EMS) providers is unstandardised. We hypothesised that disaster triage training with the paediatric disaster triage (PDT) video game ‘60 s to Survival’ would be a cost-effective alternative to live simulation-based PDT training.

Methods

We synthesised data for a cost-effectiveness analysis from two previous studies. The video game data were from the intervention arm of a randomised controlled trial that compared triage accuracy in a live simulation scenario of exposed vs unexposed groups to the video game. The live simulation and feedback data were from a prospective cohort study evaluating live simulation and feedback for improving disaster triage skills. Postintervention scores of triage accuracy were measured for participants via live simulations and compared between both groups. Cost-effectiveness between the live simulation and video game groups was assessed using (1) A net benefit regression model at various willingness-to-pay (WTP) values. (2) A cost-effectiveness acceptability curve (CEAC).

Results

The total cost for the live simulation and feedback training programme was $81 313.50 and the cost for the video game was $67 822. Incremental net benefit values at various WTP values revealed positive incremental net benefit values, indicating that the video game is more cost-effective compared with live simulation and feedback. Moreover, the CEAC revealed a high probability (>0.6) at various WTP values that the video game is more cost-effective.

Conclusions

A video game-based simulation disaster triage training programme was more cost-effective than a live simulation and feedback-based programme. Video game-based training could be a simple, scalable and sustainable solution to training EMS providers.

Comparison of Two Telemedicine Delivery Modes for Neonatal Resuscitation Support: A Simulation-Based Randomized Trial

INTRODUCTION

Previous research has described technical aspects of telemedicine and the clinical impact of provider-to-patient telemedicine; however, little is known about provider-to-provider telemedical interventions.

OBJECTIVE

The primary aim of this study was to compare two telemedicine delivery modes on the quality of a simulated neonatal resuscitation. Our secondary aim was to evaluate the providers' task load.

METHODS

This was a prospective, single-center, randomized, simulation-based trial comparing a remote neonatal team leader ("teleleader") versus a remote consultant ("teleconsultant"). Participants resuscitated a simulated, apneic, and bradycardic neonate. Performance was assessed by video review and task load was measured by the self-reported NASA task load index (NASA-TLX) tool. In the teleleader group, one remote neonatal specialist assumed the role of team leader in the resuscitation. In the teleconsultant group, the same remote specialist assumed the role of teleconsultant.

RESULTS

Twenty-two participants were included in the analyses. The teleleader group was associated with a higher overall checklist score compared to teleconsultants (median score 68%, interquartile range [IQR]: 66-69 vs. 58%, IQR: 42-62; p = 0.016). No significant difference was seen in overall subjective workload as measured by the NASA-TLX tool. However, mental demand and frustration were significantly greater with teleconsultants compared to teleleaders (mean mental demand: 14.1 vs. 17.0 out of 21; frustration: 7.9 vs. 14.7 out of 21).

CONCLUSIONS

Simulated neonates randomized to teams with teleleaders received significantly better resuscitative care compared to those randomized to teams with teleconsultants. Mental demand and frustration were higher for providers in the teleconsultant compared to teleleader teams.

Impact of telemedicine on neonatal resuscitation in the emergency department: a simulation-based randomised trial

Background

The delivery and initial resuscitation of a newborn infant are required but rarely practised skills in emergency medicine. Deliveries in the emergency department are high-risk events and deviations from best practices are associated with poor outcomes.

Introduction

Telemedicine can provide emergency medicine providers real-time access to a Neonatal Resuscitation Program (NRP)-trained paediatric specialist. We hypothesised that adherence to NRP guidelines would be higher for participants with access to a remotely located NRP-trained paediatric specialist via telemedicine compared with participants without access.

Materials and methods

Prospective single-centre randomised trial. Emergency Medicine residents were randomised into a telemedicine or standard care group. The participants resuscitated a simulated, apnoeic and bradycardic neonate. In the telemedicine group a remote paediatric specialist participated in the resuscitation. Simulations were video recorded and assessed for adherence to guidelines using four critical actions. The secondary outcome of task load was measured through participants' completion of the NASA Task Load Index (NASA-TLX) and reviewers completed a detailed NRP checklist.

Results

Twelve participants were included. The use of telemedicine was associated with significantly improved adherence to three of the four critical actions reflecting NRP guidelines as well as a significant improvement in the overall score (p<0.001). On the NASA-TLX, no significant difference was seen in overall subjective workload assessment, but of the subscore components, frustration was statistically significantly greater in the control group (p<0.001).

Conclusions

In this study, telemedicine improved adherence to NRP guidelines. Future work is needed to replicate these findings in the clinical environment.

Rapid Cycle Deliberate Practice (RCDP) as a Method to Improve Airway Management Skills - A Randomized Controlled Simulation Study

Background: Paediatric intubations are a relatively rare but critical procedure that requires adequate practice to achieve skillful performance. Simulation is a method to teach intubation skills in a safe environment. Rapid Cycle Deliberate Practice (RCDP), as a method of simulation debriefing, has been shown to improve pediatric resident resuscitation skills. It has not been demonstrated if RCDP can be effectively used in procedural skills training. The objective of this study was to determine if RCDP with feedback in real-time, as well as an opportunity to repeat the action, is superior to a simulation where no feedback is provided during the simulation and is instead provided after the simulation.

Materials and Methods: This was a randomized controlled single-blinded study. All participants were videotaped during a simulated pre-assessment intubation, then received either the intervention (RCDP) or the control teaching (feedback after the simulation), followed by a post-assessment intubation. These videos were scored by two independent raters on an intubation checklist. The primary outcome was the change in score. The secondary outcome was intubation success.

Results: Thirty-five students met the inclusion criteria. The RCDP group achieved a significantly higher score improvement in the preparation and post-procedure care categories. The overall score change in the RCDP group was significantly higher than in the control group, with a mean difference of -11.86 (CI -15.57 to -8.15, p<0.00001), but there was no significant improvement in intubation success.

Conclusion: Our study suggests that RCDP is an effective method to teach the procedural skill of intubation with an emphasis on procedural choreography. RCDP could be an appropriate method for debriefing learners in procedural skills training in this population.

GPS Devices in a Simulated Mass Casualty Event

OBJECTIVE

The aim of this study was to assess the staff perception of a global positioning system (GPS) as a patient tracking tool at an emergency department (ED) receiving patients from a simulated mass casualty event.

METHODS

During a regional airport disaster drill a plane crash with 46 pediatric patients was simulated. Personnel from airport fire, municipal fire, law enforcement, emergency medical services, and emergency medicine departments were present. Twenty of the 46 patient actors required transport for medical evaluation, and we affixed GPS devices to 12 of these actors. At the hospital, ED staff including attending physicians, fellows and nurses working in the ED during the time of the drill accessed a map through an application that provided real-time geolocation of these devices. The primary outcome was staff reception of the GPS device as assessed via Likert scale survey after the event. The secondary outcomes were free text feedback from staff and event debriefing observations.

RESULTS

Queried registered nurses, attending physicians, and pediatric emergency medicine fellows perceived the GPS device as an advantage for patient care during a disaster. The GPS device allowed multiple-screen real-time tracking and improved situational awareness in cases with and without EMS radio communication prior to arrival at the hospital.

CONCLUSION

ED staff reported that the use of GPS trackers in a disaster improved real-time tracking and could potentially improve patient management during a mass casualty event.

Protocol for a systematic review on the extent of non-publication of research studies and associated study characteristics

BACKGROUND

Methodological research has found that non-published studies often have different results than those that are published, a phenomenon known as publication bias. When results are not published, or are published selectively based on the direction or the strength of the findings, healthcare professionals and consumers of healthcare cannot base their decision-making on the full body of current evidence.

METHODS

As part of the OPEN project (http://www.open-project.eu) we will conduct a systematic review with the following objectives:1. To determine the proportion and/or rate of non-publication of studies by systematically reviewing methodological research projects that followed up a cohort of studies that a. received research ethics committee (REC) approval,b. were registered in trial registries, orc. were presented as abstracts at conferences.2. To assess the association of study characteristics (for example, direction and/or strength of findings) with likelihood of full publication.To identify reports of relevant methodological research projects we will conduct electronic database searches, check reference lists, and contact experts. Published and unpublished projects will be included. The inclusion criteria are as follows:a. RECs: methodological research projects that examined the subsequent proportion and/or rate of publication of studies that received approval from RECs;b. Trial registries: methodological research projects that examine the subsequent proportion and/or rate of publication of studies registered in trial registries;c. Conference abstracts: methodological research projects that examine the subsequent proportion and/or rate of full publication of studies which were initially presented at conferences as abstracts.

PRIMARY OUTCOMES

Proportion/rate of published studies; time to full publication (mean/median; cumulative publication rate by time).

SECONDARY OUTCOMES

Association of study characteristics with full publication.The different questions (a, b, and c) will be investigated separately. Data synthesis will involve a combination of descriptive and statistical summaries of the included methodological research projects.

DISCUSSION

Results are expected to be publicly available in mid 2013.