Simulation-Based Training in High-Quality Cardiopulmonary Resuscitation Among Neonatal Intensive Care Unit Providers

Implementation of a multi-site neonatal simulation improvement program: a cost analysis

BACKGROUND

To improve patient outcomes and provider team practice, the California Perinatal Quality Care Collaborative (CPQCC) created the Simulating Success quality improvement program to assist hospitals in implementing a neonatal resuscitation training curriculum. This study aimed to examine the costs associated with the design and implementation of the Simulating Success program.

METHODS

From 2017-2020, a total of 14 sites participated in the Simulating Success program and 4 of them systematically collected resource utilization data. Using a micro-costing approach, we examined costs for the design and implementation of the program occurring at CPQCC and the 4 study sites. Data collection forms were used to track personnel time, equipment/supplies, space use, and travel (including transportation, food, and lodging). Cost analysis was conducted from the healthcare sector perspective. Costs incurred by CPQCC were allocated to participant sites and then combined with site-specific costs to estimate the mean cost per site, along with its 95% confidence interval (CI). Cost estimates were inflation-adjusted to 2022 U.S. dollars.

RESULTS

Designing and implementing the Simulating Success program cost $228,148.36 at CPQCC, with personnel cost accounting for the largest share (92.2%), followed by program-related travel (6.1%), equipment/supplies (1.5%), and space use (0.2%). Allocating these costs across participant sites and accounting for site-specific resource utilizations resulted in a mean cost of $39,210.69 per participant site (95% CI: $34,094.52-$44,326.86). In sensitivity analysis varying several study assumptions (e.g., number of participant sites, exclusion of design costs, and useful life span of manikins), the mean cost per site changed from $35,645.22 to $39,935.73. At all four sites, monthly cost of other neonatal resuscitation training was lower during the program implementation period (mean = $1,112.52 per site) than pre-implementation period (mean = $2,504.01 per site). In the 3 months after the Simulating Success program ended, monthly cost of neonatal resuscitation training was also lower than the pre-implementation period at two of the four sites.

CONCLUSIONS

Establishing a multi-site neonatal in situ simulation program requires investment of sufficient resources. However, such programs may have financial and non-financial benefits in the long run by offsetting the need for other neonatal resuscitation training and improving practice.

A Statewide Collaboration to Deliver and Evaluate a Pediatric Critical Care Simulation Curriculum for Emergency Medical Services

OBJECTIVE

Care of the critically ill child is a rare but stressful event for emergency medical services (EMS) providers. Simulation training can improve resuscitation care and prehospital outcomes but limited access to experts, simulation equipment, and cost have limited adoption by EMS systems. Our objective was to form a statewide collaboration to develop, deliver, and evaluate a pediatric critical care simulation curriculum for EMS providers.

METHODS

We describe a statewide collaboration between five academic centers to develop a simulation curriculum and deliver it to EMS providers. Cases were developed by the collaborating PEM faculty, reviewed by EMS regional directors, and based on previously published EMS curricula, a statewide needs assessment, and updated state EMS protocols. The simulation curriculum was comprised of 3 scenarios requiring recognition and acute management of critically ill infants and children. The curriculum was implemented through 5 separate education sessions, led by a faculty lead at each site, over a 6 month time period. We evaluated curriculum effectiveness with a prospective, interventional, single-arm educational study using pre-post assessment design to assess the impact on EMS provider knowledge and confidence. To assess the intervention effect on knowledge scores while accounting for nested data, we estimated a mixed effects generalized regression model with random effects for region and participant. We assessed for knowledge retention and self-reported practice change at 6 months post-curriculum. Qualitative analysis of participants' written responses immediately following the curriculum and at 6 month follow-up was performed using the framework method.

RESULTS

Overall, 78 emergency medical technicians (EMTs) and 109 paramedics participated in the curriculum over five separate sessions. Most participants were male (69%) and paramedics (58%). One third had over 15 years of clinical experience. In the regression analysis, mean pediatric knowledge scores increased by 9.8% (95% CI: 7.2%, 12.4%). Most (93% [95% CI: 87.2%, 96.5%]) participants reported improved confidence caring for pediatric patients. Though follow-up responses were limited, participants who completed follow up surveys reported they had used skills acquired during the curriculum in clinical practice.

CONCLUSION

Through statewide collaboration, we delivered a pediatric critical care simulation curriculum for EMS providers that impacted participant knowledge and confidence caring for pediatric patients. Follow-up data suggest that knowledge and skills obtained as part of the curriculum was translated into practice. This strategy could be used in future efforts to integrate simulation into EMS practice.