Validity evidence for a team-leading assessment tool in pediatric emergency resuscitations using video review

Background

Effective leadership of health care action teams has demonstrated positive influence on team performance and patient care, but there is no consensus on how to assess these skills. We developed a novel team leadership assessment tool for leaders of interprofessional pediatric resuscitation teams and collected validity evidence for this tool using video review.

Methods

This was a prospective cohort study from November 2021 to October 2022. A novel team leadership assessment tool was developed using literature review and local expertise and then piloted and refined using medical simulation. Pediatric emergency medicine (PEM) fellows from a single tertiary care pediatric medical center were enrolled, and videos of one medical resuscitation and one trauma resuscitation were collected per fellow each month. Three reviewers underwent reviewer training and then scored the videos using the assessment tool. Raters provided feedback on feasibility and ease of use using a 5-point Likert scale. Inter-rater reliability for the assessment tool using Gwet's agreement coefficient and the association between performance and clinical level of training using generalized linear mixed model were calculated.

Results

Twelve PEM fellows enrolled and 146 videos were reviewed. The inter-rater reliability for each domain ranged from 0.45 (p < 0.0001) to 0.59 (p < 0.0001), with the inter-rater reliability of the total score being 0.49 (p < 0.0001). The reviewers' mean ratings of the elements of the tool were as follows: clarity of the domains (4.6/5), the independence of each domain from each other (3.9/5), the ease of use of the 5-point Likert scale (4.5/5), the usefulness of the provided examples for each domain (4.6/5), and the ability to assess each domain without having to rewatch (4.5/5). The tool differentiated between levels of clinical training for two of the six domains (p < 0.02).

Conclusions

We developed a novel team leadership assessment tool for pediatric resuscitation team leaders that demonstrated moderate inter-rater reliability. The tool was easy to use and feasible for educators to assess the performance of PEM trainees in complex high-stakes clinical situations.

Multiuser immersive virtual reality simulation for interprofessional sepsis recognition and management

INTRODUCTION

Sepsis is a leading cause of pediatric mortality. While there has been significant effort toward improving adherence to evidence-based care, gaps remain. Immersive multiuser virtual reality (MUVR) simulation may be an approach to enhance provider clinical competency and situation awareness for sepsis.

METHODS

A prospective, observational pilot of an interprofessional MUVR simulation assessing a decompensating patient from sepsis was conducted from January to June 2021. The study objective was to establish validity and acceptability evidence for the platform by assessing differences in sepsis recognition between experienced and novice participants. Interprofessional teams assessed and managed a patient together in the same VR experience with the primary outcome of time to recognition of sepsis utilizing the Situation Awareness Global Assessment Technique analyzed using a logistic regression model. Secondary outcomes were perceived clinical accuracy, relevancy to practice, and side effects experienced.

RESULTS

Seventy-two simulations included 144 participants. The cumulative odds ratio of recognizing sepsis at 2 min into the simulation in comparison to later time points by experienced versus novice providers were significantly higher with a cumulative odds ratio of 3.70 (95% confidence interval: 1.15-9.07, p = .004). Participants agreed that the simulation was clinically accurate (98.6%) and will impact their practice (81.1%), with a high degree of immersion (95.7%-99.3%), and the majority of side effects were perceived as mild (70.4%-81.4%).

CONCLUSIONS

Our novel MUVR simulation demonstrated significant differences in sepsis recognition between experienced and novice participants. This validity evidence along with the data on the simulation's acceptability supports expanded use in training and assessment.

Improving Pediatric Procedural Skills for EMS Clinicians: A Longitudinal Simulation-Based Curriculum with Novel, Remote, First-Person-View Video-Based Outcome Measurement

OBJECTIVE

Emergency medical services (EMS) clinicians are expected to provide expert care to all patients, but face obstacles in maintaining skillsets required in the care of critically ill or injured children. The objectives of this study were to describe and assess the effectiveness of a pediatric-focused, simulation-based, procedural training program for EMS clinicians, delivered on-site by a pediatric simulation education team. We also describe a novel, remote, asynchronous performance outcome measurement system using first-person-view video review.

METHODS

This was a prospective study of simulation-based training and procedural outcomes. The study population involved EMS clinicians at three fire-based EMS agencies stratified as urban, suburban, and rural sites. The primary outcome was performance of intraosseous catheterization (IO), bag-valve-mask ventilation (BVM), and supraglottic device placement (SGD), measured across three time points. Secondary outcomes were identification of differences across EMS agencies and participant survey responses.

RESULTS

We obtained video data from 122 clinicians, totaling 561 videos, with survey response rates of 89.0-91.3%. Pre-intervention scores were high: least-square means (95% confident-intervals) 9.5 (8.9, 10.2) for IO; 9.6 (9.3, 9.9) for BVM; and 11.6 (10.9, 12.2) for SGD. There was significant improvement post-intervention: 11.5 (10.7, 12.3) for IO; 11.0 (10.7, 11.4) for BVM; and 13.6 (12.8, 14.4) for SGD. Improvement was maintained at follow-up after a median of 9.5 months: 10.5 (9.8, 11.2) for IO; 10.2 (9.9, 10.6) for BVM; and 12.4 (11.7, 13.1) for SGD. There were no statistical differences between sites. Of survey respondents, half had not cared for a critically ill or injured child in at least a year, the vast majority had not had hands-on pediatric training in over 6 months, and the majority felt that training should occur at least every 6 months.

CONCLUSIONS

Our pediatric-focused, simulation-based procedural training program was associated with improvement and maintenance of high-baseline procedural performance for EMS clinicians over the study period. Findings were consistent across sites. Remote assessment was feasible. Participant surveys emphasized a desire for more pediatric-focused training and highlighted the low frequency of clinical exposure to procedures potentially needed in the care of critically ill or injured pediatric patients.

Rapid cycle deliberate practice to improve airway skills and performance of trainees in a pediatric emergency department

Objective

The study objective was to determine the effect of a rapid cycle deliberate practice (RCDP) program on simulated and actual airway skills by pediatric emergency medicine (PEM) fellows.

Methods

We designed and implemented a 12-month RCDP airway skills curriculum for PEM fellows at an academic pediatric institution. The curriculum was designed using airway training literature, RCDP principals, and internal quality assurance airway video review program. Simulation training scenarios increased in complexity throughout the curriculum. PEM fellows participated in monthly sessions. Two PEM faculty facilitated the sessions, utilizing a step-by-step objective structured clinical evaluation (OSCE)-style tool for each scenario. Data were collected for all four levels of the Kirkpatrick Model of Training Evaluation-participant response (reaction, pre-post session survey), skills performance in the simulation setting (learning, pre-post OSCE), skills performance for actual patients (behavior, video review), and patient outcomes (results, video review).

Results

During the study period (August 2021 to June 2022), 13 PEM fellows participated in 112 sessions (mean nine sessions per fellow). PEM fellows reported improved comfort in all domains of airway management, including intubation performance. Participant OSCE scores improved posttraining (pretraining median score for trainees 57 [IQR 57-59], posttraining median 61 [IQR 61-62], p = 0.0005). Over the 12 months, PEM fellows performed 45 intubation attempts in the pediatric emergency department (median patient age 4 years [IQR 1-9 years]). Compared to a 5-year historical cohort, participants had higher first-pass success (87% vs. 71%, p = 0.028) and shorter attempt duration (22 s vs. 29 s, p = 0.018). There was no significant difference in the frequency of oxyhemoglobin desaturation in the training period versus the historical period (7% vs. 15%, p = 0.231).

Conclusions

At multiple levels of educational outcomes, including participant behavior and patient outcomes, an RCDP program was associated with improved airway skills and performance of PEM fellows.

Tolerability and Acceptability of Autonomous Immersive Virtual Reality Incorporating Digital Twin Technology for Mass Training in Healthcare

INTRODUCTION

As part of onboarding and systems testing for a clinical expansion, immersive virtual reality (VR) incorporating digital twin technology was used. While digital twin technology has been leveraged by industry, its use in health care has been limited with no prior application for onboarding or training. The tolerability and acceptability of immersive VR for use by a large population of healthcare staff were unknown.

METHODS

A prospective, observational study of an autonomous immersive VR onboarding experience to a new clinical space was conducted from May to September 2021. Participants were healthcare staff from several critical care and acute care units. Primary outcomes were tolerance and acceptability measured by reported adverse effects and degree of immersion. Secondary outcomes were attitudes toward the efficacy of VR compared with standard onboarding experiences.

RESULTS

A total of 1522 healthcare staff participated. Rates of adverse effects were low and those with prior VR experience were more likely to report no adverse effects. Odds of reporting immersion were high across all demographic groups, though decreased with increasing age. The preference for VR over low-fidelity methods was high across all demographics; however, preferences were mixed when compared with traditional simulation and real-time clinical care.

CONCLUSIONS

Large-scale VR onboarding is feasible, tolerable, and acceptable to a diverse population of healthcare staff when using digital twin technology. This study also represents the largest VR onboarding experience to date and may address preconceived notions that VR-based training in health care is not ready for widespread adoption.

Making a move: Using simulation to identify latent safety threats before the care of injured patients in a new physical space

BACKGROUND

In today's rapidly changing health care environment, hospitals are expanding into newly built spaces. Preserving patient safety by identifying latent safety threats (LSTs) in advance of opening a new physical space is key to continued excellent care. At our level 1 pediatric trauma center, the hospital undertook a 5-year project to build a critical care tower, including a new emergency department with five trauma bays. To allow for identification and mitigation of LSTs before opening, we performed simulation-based clinical systems testing.

METHODS

Eight simulation scenarios were developed, based on actual patient presentations, incorporating a variety of injury patterns. Scenarios included workflow and movement from the helipad and squad entrance as well as to radiology, the operating room, and the pediatric intensive care unit. A multiple resuscitation scenario was also designed to test the use of all five bays simultaneously. Multidisciplinary high-fidelity simulations were conducted in the new tower. Key trauma and emergency department stakeholders facilitated all sessions, using a structured framework for systems integration debriefing framework and failure mode and effect analysis to identify and prioritize LSTs, respectively.

RESULTS

Eight sessions were conducted for 2 months. A total of 201 staff participated, including trauma surgeons, respiratory therapists, nurses, emergency physicians, x-ray technicians, pharmacists, emergency medical services, and operating room staff. In total, 118 LSTs (average of 14.8/session) were identified. Latent safety threats were categorized. An action plan for mitigation was developed after applying failure mode and effects analysis prioritization scores (based on severity, probability, and ease of detection).

CONCLUSION

Systems-focused trauma simulations identified a large number of LSTs before the opening of a new critical care building. Identification of LSTs is feasible and facilitates mitigation before actual patient care begins, improving patient safety.

LEVEL OF EVIDENCE

Therapeutic/Care Management; Level IV.

Just-in-Time, Just-in-Place Virtual Training in the Pediatric Emergency Department: A Novel Approach to Impact the Perfusion Exam

Background

Early identification of shock is vital in decreasing morbidity and mortality in the pediatric population. Although residents are taught the perfusion portion of the rapid cardiopulmonary assessment at our institution, they perform it at the bedside with 8.4% completing 1 part of the assessment and 9.7% verbalizing their findings. Newer technologies, including virtual reality (VR), offer immersive training to close this clinical gap.

Objective

To assess senior pediatric residents' performance of a perfusion exam and verbalization of their perfusion assessment following VR-based Just-in-Time/Just-in-Place (JITP) training compared to video-based JITP training. We hypothesized that JITP media training was feasible, and VR JITP was more effective than video-based training.

Methods

Residents were randomized to VR or video-based training during shifts in the emergency department. Clinical performance was assessed by review of a video-recorded patient encounter using a standardized assessment tool and by an in-person, two question shock assessment. Residents completed a survey assessing attitudes toward their intervention at the time of training.

Results

Eighty-five senior pediatric residents were enrolled; 84 completed training. Sixty-four (76%) residents had a patient encounter available for video review (VR 33; Video 31). Fourteen residents in the VR group (42.4%, 95% CI 25.5% to 60.8%) and 13 residents in the video group (41.9%, 95% CI 24.6% to 60.9%) completed a perfusion exam AND verbalized an assessment during their next clinical encounter (X2 p-value 1.00). Fifty-one of 64 residents (79.7%) completed the two-step shock assessment; 50 (98%) agreed with supervising physician's assessment. VR was rated more effective than reading, low-fidelity manikin, standardized patient encounters, traditional didactic teaching, and online learning. Video was rated more effective than online learning, traditional didactic teaching, and reading.

Conclusion

Novel video and VR JITP perfusion exam and assessment trainings are impactful and well-received by senior pediatric residents.

Development and Implementation of Augmented Reality Enhanced High-Fidelity Simulation for Recognition of Patient Decompensation

INTRODUCTION

Simulation is a core aspect of training and assessment; however, simulation laboratories are limited in their ability to visually represent mental, respiratory, and perfusion status. Augmented reality (AR) represents a potential adjunct to address this gap.

METHODS

A prospective, observational pilot of interprofessional simulation assessing a decompensating patient was conducted from April to June 2019. Teams completed 2 simulations: (1) traditional training (TT) using a manikin (Laerdal SimJunior) and (2) AR-enhanced training (ART) using a manikin plus an AR patient. The primary outcome was self-assessed effectiveness at the assessment of patient decompensation. Secondary outcomes were attitudes toward and adverse effects during the AR training.

RESULTS

Twenty-one simulation sessions included 84 participants in headsets. Participants reported improved ability to assess the patient's mental status, respiratory status, and perfusion status (all P < 0.0001) during ART in comparison to TT. Similar findings were noted for recognition of hypoxemia, shock, apnea, and decompensation (all P ≤ 0.0003) but not for recognition of cardiac arrest (P = 0.06). Most participants agreed or strongly agreed that ART accurately depicted a decompensating patient (89%), reinforced key components of the patient assessment (88%), and will impact how they care for patients (68%). Augmented reality-enhanced training was rated more effective than manikin training and standardized patients and equally as effective as bedside teaching.

CONCLUSIONS

This novel application of AR to enhance the realism of manikin simulation demonstrated improvement in self-assessed recognition of patient decompensation. Augmented reality may represent a viable modality for increasing the clinical impact of training.

The Medical Resuscitation Committee: Interprofessional Program Development to Optimize Care for Critically Ill Medical Patients in an Academic Pediatric Emergency Department

ABSTRACT

Provision of optimal care to critically ill patients in a pediatric emergency department is challenging. Specific challenges include the following: (a) patient presentations are highly variable, representing the full breadth of human disease and injury, and are often unannounced; (b) care team members have highly variable experience and skills and often few meaningful opportunities to practice care delivery as a team; (c) valid data collection, for quality assurance/improvement and clinical research, is limited when relying on traditional approaches such as medical record review or self-report; (d) specific patient presentations are relatively uncommon for individual providers, providing few opportunities to establish and refine the requisite knowledge and skill; and (e) unscientific or random variation in care delivery. In the current report, we describe our efforts for the last decade to address these challenges and optimize care delivery to critically ill patients in a pediatric emergency department. We specifically describe the grassroots development of an interprofessional medical resuscitation program. Key components of the program are as follows: (a) a database of all medical patients undergoing evaluation in the resuscitation suite, (b) peer review and education through video-based case review, (c) a program of emergency department in situ simulation, and (d) the development of cognitive aids for high-acuity, low-frequency medical emergencies.

Identification of the Physiologically Difficult Airway in the Pediatric Emergency Department

BACKGROUND

The risk factors for peri-intubation cardiac arrest in critically ill children are incompletely understood. The study objective was to derive physiologic risk factors for deterioration during tracheal intubation in a pediatric emergency department (PED).

METHODS

This was a retrospective cohort study of patients undergoing emergency tracheal intubation in a PED. Using the published literature and expert opinion, a multidisciplinary team developed high-risk criteria for peri-intubation arrest: 1) hypotension, 2) concern for cardiac dysfunction, 3) persistent hypoxemia, 4) severe metabolic acidosis (pH < 7.1), 5) post-return of spontaneous circulation (ROSC), and 6) status asthmaticus. We completed a structured review of the electronic health record for a historical cohort of patients intubated in the PED. The primary outcome was peri-intubation arrest. Secondary outcomes included tracheal intubation success rate, extracorporeal membrane oxygenation (ECMO) activation, and in-hospital mortality. We compared outcomes between patients meeting one or more versus no high-risk criteria.

RESULTS

Peri-intubation cardiac arrest occurred in 5.6% of patients who met at least one high-risk criterion compared to 0% in patients meeting none (5.6% difference, 95% confidence interval [CI] = 1.0 to 18.1, p = 0.028). Patients meeting at least one criterion had higher rates of any postintubation cardiac arrest in the PED (11.1% vs. 0%, 11.1% difference, 95% CI = 4.1 to 25.3, p = 0.0007), in-hospital mortality (25% vs. 2.3%, 22.7% difference, 95% CI = 11.0 to 38.9, p < 0.0001), ECMO activation (8.3% vs. 0%, 8.3% difference, 95% CI = 2.5 to 21.8, p = 0.004), and lower likelihood of first-pass intubation success (47.2% vs. 66.1%, -18.9% difference, 95% CI = -35.5 to -1.5, p = 0.038), respectively.

CONCLUSIONS

We have developed criteria that successfully identify physiologically difficult airways in the PED. Children with hypotension, persistent hypoxemia, concern for cardiac dysfunction, severe metabolic acidosis, status asthmaticus or who are post-ROSC are at higher risk for peri-intubation cardiac arrest and in-hospital mortality. Further multicenter investigation is needed to validate our findings.

Retention of Basic Neonatal Resuscitation Skills and Bag-Mask Ventilation in Pediatric Residents Using Just-in-Place Simulation of Varying Frequency and Intensity: A Pilot Randomized Controlled Study

OBJECTIVES

Pediatric residents quickly lose neonatal resuscitation (NR) skills after initial training. Helping Babies Breathe is a skills-based curriculum emphasizing basic NR skills needed within the "Golden Minute" after birth. With this pilot study, we evaluated the feasibility of implementing a Golden Minute review and the impact on overall performance and bag-mask ventilation (BMV) skills in pediatric interns during and/or after their NICU rotation, with varying frequency and/or intensity of "just-in-place" simulation.

METHODS

During their NICU rotation, interns at 1 delivery hospital received the Golden Minute module and hands-on simulation practice. All enrolled interns were randomly assigned to weekly retraining or no retraining for their NICU month and every 1- or 3-month retraining post-NICU for the remainder of their intern year, based on a factorial design. The primary measure was the score on a 21-item evaluation tool administered at the end of intern year, which was compared to the scores received by interns at another hospital (controls).

RESULTS

Twenty-eight interns were enrolled in the intervention. For the primary outcome, at the end of intern year, the 1- and 3-month groups had higher scores (18.8 vs 18.6 vs 14.4; P < .01) and shorter time to effective BMV (10.6 vs 20.4 vs 52.8 seconds; P < .05 for both comparisons) than those of controls. However, the 1- and 3-month groups had no difference in score or time to BMV.

CONCLUSIONS

This pilot study revealed improvement in simulated performance of basic NR skills in interns receiving increased practice intensity and/or frequency than those who received the current standard of NR training.

Lessons learned from administration of high-dose methylprednisolone sodium succinate for acute pediatric spinal cord injuries

OBJECTIVE Methylprednisolone sodium succinate (MPSS) has been studied as a pharmacological adjunct that may be given to patients with acute spinal cord injury (ASCI) to improve neurological recovery. MPSS treatment became the standard of care in adults despite a lack of evidence supporting clinical benefit. More recently, new guidelines from neurological surgeon groups recommended no longer using MPSS for ASCI, due to questionable clinical benefit and known complications. However, little information exists in the pediatric population regarding MPSS use in the setting of ASCI. The aim of this paper was to describe steroid use and side effects in patients with ASCI at the authors' Level 1 pediatric trauma center in order to inform other hospitals that may still use this therapy. METHODS A retrospective chart review was conducted to determine adherence in ordering and delivery according to the guideline of the authors' institution and to determine types and frequency of complications. Inclusion criteria included age < 17 years, blunt trauma, physician concern for ASCI, and admission for ≥ 24 hours or treatment with high-dose intravenous MPSS. Exclusion criteria included penetrating trauma, no documentation of ASCI, and incomplete medical records. Charts were reviewed for a predetermined list of complications. RESULTS A total of 602 patient charts were reviewed; 354 patients were included in the study. MPSS was administered in 59 cases. In 34 (57.5%) the order was placed correctly. In 13 (38.2%) of these 34 cases, MPSS was administered according to the recommended timeline protocol. Overall, only 13 (22%) of 59 patients received the therapy according to protocol with regard to accurate ordering and administration. Among the patients with ASCI, 20 (55.6%) of the 36 who received steroids had complications, which was a significantly higher rate than in those who did not receive steroids (8 [24.2%] of 33, p = 0.008). Among the patients without ASCI, 10 (43.5%) of the 23 who received steroids also experienced significantly more complications than patients who did not receive steroids (50 [19.1%] of 262, p = 0.006). CONCLUSIONS High-dose MPSS for ASCI was not delivered to pediatric patients according to protocol with a high degree of reliability. Patients receiving steroids for pediatric ASCI were significantly more likely to experience complications than patients not receiving steroids. The findings presented, including complications of steroid use, support removal of high-dose MPSS as a treatment option for pediatric ASCI.

Using Simulation to Develop Care Models for Rapid Response and Code Teams at a Satellite Facility

BACKGROUND

Our institution recently completed an expansion of an acute care inpatient unit within a satellite hospital that does not include an on-site ICU or PICU. Because of expected increases in volume and acuity, new care models for Rapid Response Teams (RRTs) and Code Blue Teams were necessary.

OBJECTIVES

Using simulation-based training, our objectives were to define the optimal roles and responsibilities for team members (including ICU physicians via telemedicine), refine the staffing of RRTs and code Teams, and identify latent safety threats (LSTs) before opening the expanded inpatient unit.

METHODS

The laboratory-based intervention consisted of 8 scenarios anticipated to occur at the new campus, with each simulation followed by an iterative debriefing process and a 30-minute safety talk delivered within 4-hour interprofessional sessions. In situ sessions were delivered after construction and before patients were admitted.

RESULTS

A total of 175 clinicians completed a 4-hour course in 17 sessions. Over 60 clinicians participated during 2 in situ sessions before the opening of the unit. Eleven team-level knowledge deficits, 19 LSTs, and 25 system-level issues were identified, which directly informed changes and refinements in care models at the bedside and via telemedicine consultation.

CONCLUSIONS

Simulation-based training can assist in developing staffing models, refining the RRT and code processes, and identify LSTs in a new pediatric acute care unit. This training model could be used as a template for other facilities looking to expand pediatric acute care at outlying smaller, more resource-limited facilities to evaluate new teams and environments before patient exposure.

Studying the Safety and Performance of Rapid Sequence Intubation: Data Collection Method Matters

OBJECTIVE

We sought to describe and compare chart and video review as data collection sources for the study of emergency department (ED) rapid sequence intubation (RSI).

METHODS

This retrospective cohort study compares the availability and content of key RSI outcome and process data from two sources: chart and video data from 12 months of pediatric ED RSI. Key outcomes included adverse effects (oxyhemoglobin desaturation, physiologic changes, inadequate paralysis, vomiting), process components (number of laryngoscopy attempts, end-tidal CO₂ detection), and timing data (duration of preoxygenation and laryngoscopy attempts).

RESULTS

We reviewed 566 documents from 114 cases with video data. Video review detected higher rates of adverse effects (67%) than did chart review (46%, p < 0.0001), identifying almost twice the rate of desaturation noted in the chart (34% vs. 18%, p = 0.0002). The performance and timing of key RSI processes were significantly more reliably available via video review (timing and duration of preoxygenation, as well as timing, duration, and number of laryngoscopy attempts, all p < 0.05). Video review identified 221 laryngoscopy attempts, whereas chart review only identified 187.

CONCLUSIONS

When compared with video review for retrospective study of RSI in a pediatric ED, chart review significantly underestimated adverse effects, inconsistently contained data on important RSI process elements, rarely provided time data, and often conflicted with observations made on video review. Interpretation of and design of future studies of RSI should take into consideration the quality of the data source.

High-fidelity simulation versus case-based discussion for teaching medical students in Brazil about pediatric emergencies

OBJECTIVE

To compare high-fidelity simulation with case-based discussion for teaching medical students about pediatric emergencies, as assessed by a knowledge post-test, a knowledge retention test and a survey of satisfaction with the method.

METHODS

This was a non-randomized controlled study using a crossover design for the methods, as well as multiple-choice questionnaire tests and a satisfaction survey. Final-year medical students were allocated into two groups: group 1 participated in an anaphylaxis simulation and a discussion of a supraventricular tachycardia case, and conversely, group 2 participated in a discussion of an anaphylaxis case and a supraventricular tachycardia simulation. Students were tested on each theme at the end of their rotation (post-test) and 4-6 months later (retention test).

RESULTS

Most students (108, or 66.3%) completed all of the tests. The mean scores for simulation versus case-based discussion were respectively 43.6% versus 46.6% for the anaphylaxis pre-test (p=0.42), 63.5% versus 67.8% for the post-test (p=0.13) and 61.5% versus 65.5% for the retention test (p=0.19). Additionally, the mean scores were respectively 33.9% versus 31.6% for the supraventricular tachycardia pre-test (p=0.44), 42.5% versus 47.7% for the post-test (p=0.09) and 41.5% versus 39.5% for the retention test (p=0.47). For both themes, there was improvement between the pre-test and the post-test (p<0.05), and no significant difference was observed between the post-test and the retention test (p>0.05). Moreover, the satisfaction survey revealed a preference for simulation (p<0.001).

CONCLUSION

As a single intervention, simulation is not significantly different from case-based discussion in terms of acquisition and retention of knowledge but is superior in terms of student satisfaction.

Factors associated with oxyhemoglobin desaturation during rapid sequence intubation in a pediatric emergency department: findings from multivariable analyses of video review data

OBJECTIVES

In a video-based study of rapid sequence intubation (RSI) in a pediatric emergency department (PED), 33% of children experienced oxyhemoglobin desaturation (SpO2 < 90%). To inform targeted improvement interventions, we planned multivariable analyses to identify patient and process variables (including time-based data around performance of key RSI process elements uniquely available from video review) associated with desaturation during pediatric RSI.

METHODS

These were planned analyses of data collected during a retrospective, video-based study of RSI in a high-volume, academic PED. For variables with plausible associations with desaturation, multiple logistic regression and generalized estimating equations were used to identify those characteristics independently associated with desaturation at both the patient and the attempt levels.

RESULTS

The authors analyzed video data from 114 patients undergoing RSI over 12 months. Desaturation was more common in patients 24 months of age and younger (59%) than in patients older than 24 months of age (10%). Variables associated with desaturation in patients 24 months of age and younger were duration of attempts (both individual and cumulative), the occurrence of esophageal intubation, a respiratory indication for intubation, and young age. The receiver operating characteristics curve for the model had an area under the curve of 0.80 (95% confidence interval [CI] = 0.67 to 0.92). Forty-six percent of desaturations occurred after 45 seconds of laryngoscopy, and 82% after 30 seconds. The odds ratio for desaturation on individual attempts lasting longer than 30 seconds (vs. those 30 seconds or less) was 5.7 (95% CI = 2.26 to 14.36).

CONCLUSIONS

For children 24 months of age or younger undergoing RSI in a PED, respiratory indication for intubation, esophageal intubation, and duration of laryngoscopy (both individual and cumulative) were associated with desaturation; the number of attempts was not. Interventions to limit attempt duration in the youngest children may improve the safety of RSI.

Identification of latent safety threats using high-fidelity simulation-based training with multidisciplinary neonatology teams

BACKGROUND

Latent safety threats (LSTs) are errors in design, organization, training, or maintenance that may contribute to medical errors and have a significant impact on patient safety. The investigation described in this article was conducted as part of a larger prospective, longitudinal evaluation using laboratory- and in situ simulation-based training sessions to improve technical and nontechnical skills of neonatal ICU (NICU) providers at a Level III academic NICU.

METHODS

Simulations were performed in laboratory (4 scenarios per session) and in situ (1 scenario per session) settings with multidisciplinary neonatology teams. Facilitators and subjects identified LSTs during standardized debriefings immediately following each scenario After enrollment, facilitators classified LSTs into equipment, medication, personnel, resource, or technical skill. Pervasive team knowledge gaps were further subclassified into lack of awareness or understanding, procedure performed incorrectly, omission of necessary action, or inappropriate action.

RESULTS

In a 19-month period of enrollment (August 2009-March 2011), 177 subjects of 202 NICU providers were trained in the laboratory, 135 of whom participated in the in situ sessions. In the laboratory, 22 sessions were completed, with 70 LSTs identified (0.8 LSTs per scenario). During the 16 in situ sessions, 29 LSTs (1.8 LSTs per scenario) were identified. The 99 LSTs were reported to NICU leadership, leading to 19 documented improvements.

CONCLUSIONS

The NICU setting has a high rate of previously unidentified LSTs. Conducting in situ scenarios allows for the identification of novel LSTs not detected in the simulation laboratory. The subsequent clinical improvements made to the actual clinical care environment are the best objective evidence of the benefits of simulation-based multidisciplinary team training.

Impact of multidisciplinary simulation-based training on patient safety in a paediatric emergency department

BACKGROUND

Cincinnati Children's Hospital is one of the busiest paediatric emergency departments (ED) in the USA; high volume, high acuity and frequent interruptions contribute to an increased risk for error.

OBJECTIVE

To improve patient safety in a paediatric ED by implementing a multidisciplinary, simulation-based curriculum emphasising teamwork and communication.

METHODS

Subjects included all healthcare providers in the ED. Multidisciplinary teams participated in simulation-based training focused on teamwork and communication behaviours in critical clinical scenarios. The Safety Attitudes Questionnaire, tests of knowledge and evaluations of critical simulations and actual performance in the ED resuscitation bay were assessed. Methods to sustain improvements included mandatory participation of all new staff in simulation-based training and the introduction of routine in situ simulations.

RESULTS

289 participants attended the initial training. 151 participants attended the re-evaluation at a mean of 10.2 months later. Sustained improvements in knowledge and attitudes were demonstrated. Knowledge tests at baseline, postintervention and re-evaluation had scores of 86%, 96% and 93%, respectively. Friedman's test analysis of SAQ scores at baseline, postintervention and re-evaluation indicated significant attitude changes. The ED with a preintervention baseline of 2-3 patient safety events per year has now sustained more than 1000 days without a patient safety event. This improvement occurred even though the time required in initial simulation training has been condensed from 12 to 4 h.

CONCLUSIONS

Simulation training is an effective tool to modify safety attitudes and teamwork behaviours in an ED. Sustaining cultural and behavioural changes requires repeated practice opportunities.

Rapid sequence intubation for pediatric emergency patients: higher frequency of failed attempts and adverse effects found by video review

STUDY OBJECTIVE

Using video review, we seek to determine the frequencies of first-attempt success and adverse effects during rapid sequence intubation (RSI) in a large, tertiary care, pediatric emergency department (ED).

METHODS

We conducted a retrospective study of children undergoing RSI in the ED of a pediatric institution. Data were collected from preexisting video and written records of care provided. The primary outcome was successful tracheal intubation on the first attempt at laryngoscopy. The secondary outcome was the occurrence of any adverse effect during RSI, including episodes of physiologic deterioration. We collected time data from the RSI process by using video review. We explored the association between physician type and first-attempt success.

RESULTS

We obtained complete records for 114 of 123 (93%) children who underwent RSI in the ED during 12 months. Median age was 2.4 years, and 89 (78%) were medical resuscitations. Of the 114 subjects, 59 (52%) were tracheally intubated on the first attempt. Seventy subjects (61%) had 1 or more adverse effects during RSI; 38 (33%) experienced oxyhemoglobin desaturation and 2 required cardiopulmonary resuscitation after physiologic deterioration. Fewer adverse effects were documented in the written records than were observed on video review. The median time from induction through final endotracheal tube placement was 3 minutes. After adjusting for patient characteristics and illness severity, attending-level providers were 10 times more likely to be successful on the first attempt than all trainees combined.

CONCLUSION

Video review of RSI revealed that first-attempt failure and adverse effects were much more common than previously reported for children in an ED.

Evaluation, management, and outcome of focal bacterial infections (FBIs) in nontoxic infants under two months of age

BACKGROUND

Well-appearing young infants with focal bacterial infections present to the emergency department (ED) and are often admitted for a sepsis evaluation of blood, urine, and spinal fluid. However, the risk of concomitant systemic infections (CSI) in this population is not well reported, specifically comparing febrile to afebrile infants. We hypothesized that afebrile, well-appearing infants under two months of age with a defined focal bacterial infection on exam have a very low risk of CSI.

METHODS

This retrospective study was conducted at an urban, academic, tertiary care pediatric hospital ED on patients seen from January 2000-December 2005. Eligible infants were less than 60 days of age, well-appearing on exam, and with normal-for-age vital signs who presented with a focal bacterial infection on exam. Exclusion criteria included immunodeficiency, indwelling catheter, previous admission for bacterial infection, or current use of systemic antibiotics. Main study outcome was risk of CSI in febrile and afebrile groups.

RESULTS

One hundred ninety seven patients were included in the study population. Of these, 39 were febrile and 158 were afebrile. Four patients had a documented CSI: one case of S. pneumoniae bacteremia and three cases of E. coli urinary tract infection. Of these 4 infants, 3 were febrile (7.7% CSI risk) and 1 was afebrile (0.6%). Febrile infants had a significantly higher risk of CSI (OR 13.1, 95% CI 1.3, 129.5).

CONCLUSIONS

CSI is very uncommon in afebrile, well-appearing infants under 60 days of age with a focal bacterial infection.