Air Medical Simulation Training: A Retrospective Review of Cost and Effectiveness

Assessment of learning in simulator-based arthroscopy training with the diagnostic arthroscopy skill score (DASS) and neurophysiological measures

PURPOSE

Virtual arthroscopic training has become increasingly popular. However, there is a lack of efficiency-based tracking of the trainee, which may be critical for determining the specifics of training programs and adapting them for the needs of each trainee. This study aims to evaluate and compare the measures obtained with a non-invasive neurophysiological method with The Diagnostic Arthroscopy Skill Score (DASS), a commonly used assessment tool for evaluating arthroscopic skills.

METHODS

The study collected simulator performance scores, consisting of "Triangulation Right Hand", "Triangulation Left Hand", "Catch the Stars" and "Three Rings" and DASS scores from 22 participants (11 novices, 11 experts). These scores were obtained while participants underwent a structured program of exercises for the fundamentals of arthroscopic surgery training (FAST) and knee module using a simulator-based arthroscopy device. During the evaluation, data on oxy-hemoglobin and deoxy-hemoglobin levels in the prefrontal cortex were collected using the Functional Near-Infrared Spectroscopy (fNIRS) imaging system. Performance scores, DASS scores, and fNIRS data were subsequently analyzed to determine any correlation between performance and cortex activity.

RESULTS

The simulator performance scores and the DASSPart2 scores were significantly higher in the expert group compared to the novice group (200.1 ± 28.5 vs 172.5 ± 48.9, p = 0.04 and 9.4 ± 5.6 vs. 5.4 ± 5.6 p = 0.02). In the expert group, fNIRS data showed a significantly lower prefrontal cortex activation during fundamental tasks in the FAST module, indicating significantly more efficient mental resource use.

CONCLUSION

The analysis of cognitive workload changes during simulation-based arthroscopy training revealed a significant correlation between the trainees' DASS scores and fNIRS data. This correlation suggests the potential use of fNIRS data and DASS scores as additional metrics to create adaptive training protocols for each participant. By incorporating these metrics, the training process can be optimized, leading to more efficient arthroscopic training and better preparedness for clinical operations.

LEVEL OF EVIDENCE

III.

The Royal Flying Doctor Service Initiation of Helicopter Video Simulation Orientation Training for Air Medical Crews in Western Australia: A Pilot Study

OBJECTIVE

In May 2022, the Royal Flying Doctor Service Western Operations in Western Australia pioneered the introduction of the first organizational helicopter emergency service with 2 Eurocopter EC145 helicopters. This article describes the pilot study undertaken, assessing the implementation and flight crew confidence outcomes of the supplementation of video simulation training to standard clinical training for helicopter air medical retrieval.

METHODS

Survey assessments using a 5-point Likert scale provided anonymous demographic data with summarized results of the means and standard deviations. Nonparametric tests were used to compare responses between the control and experimental groups from pretraining to postintervention to postpractical.

RESULTS

The findings showed an increase in confidence rates after a classroom session and further increases after a practical session in the control group. The intervention group showed a small rise in overall confidence levels after being shown video simulations following the completion of their classroom session before commencing their practical session. This study established that regardless of the airframe, clinical staff, often with significant experience in air medical retrieval and critical care medicine, do not automatically have confidence in performing critical care procedures in a new aircraft type to which they have not previously been oriented. The results display a statistically significant increase in confidence levels in procedural performance after the classroom session compared with the pretraining questionnaire, with a subtle further rise when video simulations are included in the classroom session. When a classroom session is subsequently supplemented with a practical simulation session, confidence levels continue to rise.

CONCLUSION

Implementing a comprehensive educational strategy including classroom and practical elements for clinical staff in their orientation to new aircraft improves their confidence in performing critical care procedures if required in flight. The addition of in-flight prerecorded videos demonstrating these critical care procedures is a useful adjunct to simulation training for flight crew in air medical retrieval, and further analytical studies may indeed show a statistically significant improvement in staff confidence.

High-Fidelity Simulation With Debriefing: Best Practice Education for Flight Nurses?

OBJECTIVE

High-fidelity simulation with debriefing has been shown to be effective in maintaining high-risk, low-volume proficiencies in nursing. The purpose of this evidence-based practice project was to implement high-fidelity simulation with debriefing to measure improvements in flight nurse skill acuity and retention when performing intubations.

METHODS

This was a prospective evidence-based project conducted before and after a debriefing intervention that took place at HealthNet Aeromedical Services, Charleston, WV. Participants were flight nurses who were asked to intubate during a high-fidelity simulation session and participate in a debriefing session to reflect on their performance. They were then tested on 7-month skill retention. Eight subjects completed all stages of the study and were included in the analysis.

RESULTS

The mean ± standard deviation time to successful intubation predebriefing was 26.9 ± 11.9 seconds; for postdebriefing, it was 24.8 ± 5.8 seconds. The mean ± standard deviation checklist score before debriefing was 7.9 ± 0.4 points, whereas for postdebriefing it was 9.4 ± 0.7 points.

CONCLUSION

The implementation of debriefing after simulation improved the time to intubation and produced better clinical judgment and mastery while performing the intubation.

Technology-enhanced simulation in emergency medicine: Updated systematic review and meta-analysis 1991-2021

Background

Over the past decade, the use of technology-enhanced simulation in emergency medicine (EM) education has grown, yet we still lack a clear understanding of its effectiveness. This systematic review aims to identify and synthesize studies evaluating the comparative effectiveness of technology-enhanced simulation in EM.

Methods

We searched MEDLINE, EMBASE, PsycINFO, CINAHL, ERIC, Web of Science, and Scopus to identify EM simulation research that compares technology-enhanced simulation with other instructional modalities. Two reviewers screened articles for inclusion and abstracted information on learners, clinical topics, instructional design features, outcomes, cost, and study quality. Standardized mean difference (SMD) effect sizes were pooled using random effects.

Results

We identified 60 studies, enrolling at least 5279 learners. Of these, 23 compared technology-enhanced simulation with another instructional modality (e.g., living humans, lecture, small group), and 37 compared two forms of technology-enhanced simulation. Compared to lecture or small groups, we found simulation to have nonsignificant differences for time skills (SMD 0.33, 95% confidence interval [CI] -0.23 to 0.89, n = 3), but a large, significant effect for non-time skills (SMD 0.82, 95% CI 0.18 to 1.46, n = 8). Comparison of alternative types of technology-enhanced simulation found favorable associations with skills acquisition, of moderate magnitude, for computer-assisted guidance (compared to no computer-assisted guidance), for time skills (SMD 0.50, 95% CI -1.66 to 2.65, n = 2) and non-time skills (SMD 0.57, 95% CI 0.33 to 0.80, n = 6), and for more task repetitions (time skills SMD 1.01, 95% CI 0.16 to 1.86, n = 2) and active participation (compared to observation) for time skills (SMD 0.85, 95% CI 0.25 to 1.45, n = 2) and non-time skills (SMD 0.33 95% CI 0.08 to 0.58, n = 3).

Conclusions

Technology-enhanced simulation is effective for EM learners for skills acquisition. Features such as computer-assisted guidance, repetition, and active learning are associated with greater effectiveness.

Fatal Air Medical Accidents in the United States (2000-2020)

INTRODUCTION

Currently, many airplanes and helicopters are used as air ambulances to transport high-acuity patients. Unfortunately, civilian air medical transport in the United States has experienced a significant number of serious and fatal accidents. At the moment, additional research is needed to identify what factors affect air medical safety.

METHODS

Accident reports from the National Transportation Safety Board (NTSB) were queried. Accident reports were analyzed if the accident occurred from 2000 through 2020, involved a helicopter or airplane on an air medical flight (as identified by the NTSB), and had at least one fatality. The date of the accident, the model of aircraft involved, and NTSB-determined probable causes of the accident were examined.

RESULTS

Eighty-seven (87) accidents and 239 fatalities took place from January 2000 through December 2020. Nearly three-fourths (72.4%) of fatalities occurred on helicopters, while just 27.6% occurred on airplanes. Interpreting the NTSB findings, various human factors probably contributed to 87.4% of fatalities. These include pilot disorientation, pilot errors, maintenance errors, impairment, fatigue, or weather misestimation. Nighttime-related factors probably contributed to 38.9% of fatalities, followed by weather-related factors (35.6%), and various mechanical failures (17.2%).

CONCLUSION

These data show that the probable causes of fatal air medical accidents are primarily human factors and are, therefore, likely preventable. Developing a safety-first culture with a focus on human factors training has been shown to improve outcomes across a wide range of medical specialties (eg, anesthesia, surgery, and resuscitation). While there have been fewer fatal accidents in recent years, a continued emphasis on various training modalities seems warranted.

Neuroadaptive Training via fNIRS in Flight Simulators

Training to master a new skill often takes a lot of time, effort, and financial resources, particularly when the desired skill is complex, time sensitive, or high pressure where lives may be at risk. Professions such as aircraft pilots, surgeons, and other mission-critical operators that fall under this umbrella require extensive domain-specific dedicated training to enable learners to meet real-world demands. In this study, we describe a novel neuroadaptive training protocol to enhance learning speed and efficiency using a neuroimaging-based cognitive workload measurement system in a flight simulator. We used functional near-infrared spectroscopy (fNIRS), which is a wearable, mobile, non-invasive neuroimaging modality that can capture localized hemodynamic response and has been used extensively to monitor the anterior prefrontal cortex to estimate cognitive workload. The training protocol included four sessions over 2 weeks and utilized realistic piloting tasks with up to nine levels of difficulty. Learners started at the lowest level and their progress adapted based on either behavioral performance and fNIRS measures combined (neuroadaptive) or performance measures alone (control). Participants in the neuroadaptive group were found to have significantly more efficient training, reaching higher levels of difficulty or significantly improved performance depending on the task, and showing consistent patterns of hemodynamic-derived workload in the dorsolateral prefrontal cortex. The results of this study suggest that a neuroadaptive personalized training protocol using non-invasive neuroimaging is able to enhance learning of new tasks. Finally, we outline here potential avenues for further optimization of this fNIRS based neuroadaptive training approach. As fNIRS mobile neuroimaging is becoming more practical and accessible, the approaches developed here can be applied in the real world in scale.

High-Fidelity Simulation Training for Helicopter Emergency Medical Services Flight Nurses: A Report From the First Italian Experience

OBJECTIVE

Simulation-based training has a significant effect in enhancing professionals' skills in the helicopter emergency medical service (HEMS) setting and is reported to be more effective than other learning strategies. The main objective of this study was to assess the efficacy of a specific high-fidelity simulation (HFS) training course for HEMS nurses before entering into operational service.

METHODS

This report describes the first Italian experience of a specifically designed HFS training program for HEMS nurses held in Bologna, Italy, in a dedicated scenario with a mock-up helicopter and an advanced mannequin.

RESULTS

A total of 14 nurses participated in the SAFE2019 (Simulazione ad Alta Fedeltà per l'Elisoccorso-High-Fidelity Simulation for HEMS) courses. The aspects considered most useful and effective were related to team working, communication issues, and nontechnical skills (NTS) development. Moreover, participants suggested implementing a series of scheduled HFS retraining sessions.

CONCLUSION

HFS in a dedicated HEMS scenario during the orientation period has contributed to enhanced technical competencies and NTS, increasing comfort and situational awareness for new entrant flight nurses. Simulation may represent a valuable resource to assess and maintain competencies through periodic retraining sessions for full HEMS teams or when new devices are adopted.

Efficacy and efficiency of indoor nighttime human external cargo mission simulation in a high-fidelity training Centre

Background

The human external cargo (HEC) operations conducted by Helicopter Emergency Medical Services (HEMS) rarely take place at night, making it difficult for crew members to attain and maintain the level of expertise needed to perform winch operations in the dark. As EASA requirements for training cannot currently be met, we evaluated whether simulation training could be an option.

Methods

This paper reports on a training concept using indoor simulation for the training of nighttime HEC operations. Participants’ experience and perceptions were evaluated with a survey and the procedural and economic advantages of the simulation approach were compared with those of the usual outdoor HEC training.

Results

Most participants had limited exposure to real-life nighttime HEC missions before undergoing the simulation-based training. The frequency of training cycles in simulation was much higher compared to conventional training (60 cycles indoors vs. 20 outdoors for HEMS-TC, 20 cycles indoors vs. 4 outdoors for MCM). Trainees perceived that their technical and non-technical skills (NTS) improved with the training. The estimated costs of standard outdoor-based nighttime HEC training (138€ per cycle) are at least 6.5 times higher than the costs of indoor simulated training (approximately 21€ per cycle). With a change to simulation, carbon dioxide emissions could potentially be reduced by more than 35 tons.

Conclusions

Indoor simulation training of night HEC operations has advantages with regard to cost-effectiveness, environmental friendliness, and self-reported improvements in skills and knowledge. Its use is feasible and could improve crew and patient safety and fulfill regulatory demands for training intensity.

In situ simulation training in helicopter emergency medical services: feasible for on-call crews?

Simulation-based training of emergency teams offers a safe learning environment in which training in the management of the critically ill patient can be planned and practiced without harming the patient. We developed a concept for in situ simulation that can be carried out during on-call time. The aim of this study is to investigate the feasibility of introducing in situ, simulation-based training for the on-call team on a busy helicopter emergency medical service (HEMS) base. We carried out a one-year prospective study on simulation training during active duty at a busy Norwegian HEMS base, which has two helicopter crews on call 24/7. Training was conducted as low fidelity in situ simulation while the teams were on call. The training took place on or near the HEMS base. Eight scenarios were developed with learning objectives related to the mission profile of the base which includes primary missions for both medical and trauma patients of all ages, and interhospital transport of adults, children, and neonates. All scenarios included learning objectives for non-technical skills. A total of 44 simulations were carried out. Total median (quartiles) time consumption for on-call HEMS crew was 65 (59-73) min. Time for preparation of scenarios was 10 (5-11) min, time for simulations was 20 (19-26) min, cleaning up 7 (6-10) min, and debrief 35 (30-40) min. For all items on the questionnaire, the majority of respondents replied with the two most positive categories on the Likert scale. Our results demonstrate that in situ simulation training for on-call crews on a busy HEMS base is feasible with judicious investment of time and money. The participants were very positive about their experience and the impact of this type of training.