Global consensus statement on simulation-based practice in healthcare

Simulation plays a pivotal role in addressing universal healthcare challenges, reducing education inequities, and improving mortality, morbidity and patient experiences. It enhances healthcare processes and systems, contributing significantly to the development of a safety culture within organizations. It has proven to be cost-effective and successful in enhancing team performance, fostering workforce resilience and improving patient outcomes.Through an international collaborative effort, an iterative consultation process was conducted with 50 societies operating across 67 countries within six continents. This process revealed common healthcare challenges and simulation practices worldwide. The intended audience for this statement includes policymakers, healthcare organization leaders, health education institutions, and simulation practitioners. It aims to establish a consensus on the key priorities for the broad adoption of exemplary simulation practice that benefits patients and healthcare workforces globally.Key recommendations Advocating for the benefits that simulation provides to patients, staff and organizations is crucial, as well as promoting its adoption and integration into daily learning and practice throughout the healthcare spectrum. Low-cost, high-impact simulation methods should be leveraged to expand global accessibility and integrate into system improvement processes as well as undergraduate and postgraduate curricula. Support at institutional and governmental level is essential, necessitating a unified and concerted approach in terms of political, strategic and financial commitment.It is imperative that simulation is used appropriately, employing evidence-based quality assurance approaches that adhere to recognized standards of best practice. These standards include faculty development, evaluation, accrediting, credentialing, and certification.We must endeavor to provide equitable and sustainable access to high-quality, contextually relevant simulation-based learning opportunities, firmly upholding the principles of equity, diversity and inclusion. This should be complemented with a renewed emphasis on research and scholarship in this field.Call for action We urge policymakers and leaders to formally acknowledge and embrace the benefits of simulation in healthcare practice and education. This includes a commitment to sustained support and a mandate for the application of simulation within education, training, and clinical environments.We advocate for healthcare systems and education institutions to commit themselves to the goal of high-quality healthcare and improved patient outcomes. This commitment should encompass the promotion and resource support of simulation-based learning opportunities for individuals and interprofessional teams throughout all stages and levels of a caregiver's career, in alignment with best practice standards.We call upon simulation practitioners to champion healthcare simulation as an indispensable learning tool, adhere to best practice standards, maintain a commitment to lifelong learning, and persist in their fervent advocacy for patient safety.This statement, the result of an international collaborative effort, aims to establish a consensus on the key priorities for the broad adoption of exemplary simulation practice that benefits patients and healthcare workforces globally.

Lego® bricks assisted training of the novice debriefers

Lego® Serious Play® is a guided workshop in which participants construct Lego creations to represent symbolic and metaphorical ideas in response to assignments. How to encourage inexperienced debriefers to concentrate on dialogue and communications strategies rather than engage in an unstructured debate on technical or behavioral abilities is one of the main challenges in training people to debrief a high-fidelity simulation session. We explore the use of Lego bricks in this study to build straightforward, standardised situations that debriefers in training can use to practice leading discussion. With this method, the different debriefing methodologies may be practiced focusing exclusively on method and dialogue, without getting involved or having to concentrate on the technical aspects.

Adherence to guideline recommendations in the management of pediatric cardiac arrest: a multicentre observational simulation-based study

BACKGROUND AND IMPORTANCE

Pediatric cardiac arrest is a rare emergency with associated high mortality. Its management is challenging and deviations from guidelines can affect clinical outcomes.

OBJECTIVES

To evaluate the adherence to guideline recommendations in the management of a pediatric cardiac arrest scenario by teams of pediatric residents. Secondarily, the association between the use of the Pediatric Advanced Life Support-2015 (PALS-2015) pocket card, and the teams' adherence to international guidelines, were explored.

DESIGN, SETTINGS AND PARTICIPANTS

Multicentre observational simulation-based study at three Italian University Hospitals in 2018, including PALS-2015 certified pediatric residents in their 3rd-5th year of residency program, divided in teams of three.

INTERVENTION OR EXPOSURE

Each team conducted a standard nonshockable pediatric cardiac arrest scenario and independently decided whether to use the PALS-2015 pocket card.

OUTCOME MEASURE AND ANALYSIS

The primary outcome was the overall number and frequency of individual deviations from the PALS-2015 guidelines, measured by the novel c-DEV15plus score (range 0-15). Secondarily, the performance on the validated Clinical Performance Tool for asystole scenarios, the time to perform resuscitation tasks and cardiopulmonary resuscitation (CPR) quality metrics were compared between the teams that used and did not use the PALS-2015 pocket card.

MAIN RESULTS

Twenty-seven teams (81 residents) were included. Overall, the median number of deviations per scenario was 7 out of 15 [interquartile range (IQR), 6-8]. The most frequent deviations were delays in positioning of a CPR board (92.6%), calling for adrenaline (92.6%), calling for help (88.9%) and incorrect/delayed administration of adrenaline (88.9%). The median Clinical Performance Tool score was 9 out of 13 (IQR, 7-10). The comparison between teams that used ( n  = 13) and did not use ( n  = 14) the PALS-2015 pocket card showed only significantly higher Clinical Performance Tool scores in the former group [9 (IQR 9-10) vs. 7 (IQR 6-8); P  = 0.002].

CONCLUSIONS

Deviations from guidelines, although measured by means of a nonvalidated tool, were frequent in the management of a pediatric cardiac arrest scenario by pediatric residents. The use of the PALS-2015 pocket card was associated with better Clinical Performance Tool scores but was not associated with less deviations or shorter times to resuscitation tasks.

Improving learning by playing with an app: The FantaTraining® experience with anesthesia trainees

Background: FantaTraining ^® is an app that simulates a football league. Each participant represents a team, and the game is played with the opposing team by answering a questionnaire. In the intervals between games, participants can practice by consulting the educational material (films, short texts, or slides) in the app. Various prizes are offered to the winners of the championship. In this study, we aimed to evaluate whether the use of the FantaTraining ^® app could improve the learning of anesthesia trainees registered in an online obstetric anesthesia course.

Methods: The study involved 282 trainees in anesthesia, from five Italian universities, registered in the Online Obstetric Anesthesia Course (OOAC) who were given the app. They were randomly allocated into two groups according to whether the app had been enabled to allow the participant to play the league (study group, n=137), or not (control group, n=145). All the trainees underwent entry and final tests, consisting of the same 40 multiple choice questions, respectively before and after completing the OOAC course.

Results: There were no differences in the scores obtained in the pre-course test between the groups. The mean score obtained in the final test was significantly greater than that obtained in the entry one in both groups (P<0.05) but the final test score obtained by the participants of the study group was significantly greater than that obtained by the control group. (P<0.001), regardless of the university of origin and year of specialization. Trainees stated that the app had helped their study, improving understanding and motivation, without increasing the intensity of study.

Conclusions: Using the FantaTraining ^® app greatly improved trainees’ final exam performance after the online obstetric anesthesia course. The FantaTraining ^® app seems a promising tool to improve learning outcomes by strengthening learning behaviors and attitudes towards learning.

Logistic Red Flags in Mass-Casualty Incidents and Disasters: A Problem-Based Approach

BACKGROUND

Mass-casualty incidents (MCIs) and disasters are characterized by a high heterogeneity of effects and may pose important logistic challenges that could hamper the emergency rescue operations.The main objective of this study was to establish the most frequent logistic challenges (red flags) observed in a series of Italian disasters with a problem-based approach and to verify if the 80-20 rule of the Pareto principle is respected.

METHODS

A series of 138 major events from 1944 through 2020 with a Disaster Severity Score (DSS) ≥ four and five or more victims were analyzed for the presence of twelve pre-determined red flags.A Pareto graph was built considering the most frequently observed red flags, and eventual correlations between the number of red flags and the components of the DSS were investigated.

RESULTS

Eight out of twelve red flags covered 80% of the events, therefore not respecting the 80-20 rule; the number of red flags showed a low positive correlation with most of the components of the DSS score. The Pareto analysis showed that potential hazards, casualty nest area > 2.5km2, number of victims over 50, evacuation noria over 20km, number of nests > five, need for extrication, complex access to victims, and complex nest development were the most frequently observed red flags.

CONCLUSIONS

Logistic problems observed in MCIs and disaster scenarios do not follow the 80-20 Pareto rule; this demands for careful and early evaluation of different logistic red flags to appropriately tailor the rescue response.

PediAppRREST: effectiveness of an interactive cognitive support tablet app in reducing deviations from guidelines in the management of paediatric cardiac arrest: protocol for a simulation-based randomised controlled trial

INTRODUCTION

Paediatric cardiac arrest (PCA), despite its low incidence, has a high mortality. Its management is complex and deviations from guideline recommendations occur frequently. We developed a new interactive tablet app, named PediAppRREST, to support the management of PCA. The app received a good usability evaluation in a previous pilot trial. The aim of the study is to evaluate the effectiveness of the PediAppRREST app in reducing deviations from guideline recommendations in PCA management.

METHODS AND ANALYSIS

This is a multicentre, simulation-based, randomised controlled, three-parallel-arm study. Participants are residents in Paediatric, Emergency Medicine, and Anaesthesiology programmes in Italy. All 105 teams (315 participants) manage the same scenario of in-hospital PCA. Teams are randomised by the study statistician into one of three study arms for the management of the PCA scenario: (1) an intervention group using the PediAppRREST app or (2) a control group Paediatric Advanced Life Support (CtrlPALS+) using the PALS pocket reference card; or (3) a control group (CtrlPALS-) not allowed to use any PALS-related cognitive aid. The primary outcome of the study is the number of deviations (delays and errors) in PCA management from PALS guideline recommendations, according to a novel checklist, named c-DEV15plus. The c-DEV15plus scores will be compared between groups with a one-way analysis of variance model, followed by the Tukey-Kramer multiple comparisons adjustment procedure in case of statistical significance.

ETHICS AND DISSEMINATION

The Ethics Committee of the University Hospital of Padova, coordinating centre of the trial, deemed the project to be a negligible risk study and approved it through an expedited review process. The results of the study will be disseminated in peer-reviewed journals, and at national and international scientific conferences. Based on the study results, the PediAppRREST app will be further refined and will be available for download by institutions/healthcare professionals.

TRIAL REGISTRATION NUMBER

NCT04619498; Pre-results.

Use of backboards in cardiopulmonary resuscitation: a systematic review and meta-analysis

To achieve optimal chest compression depth, victims of cardiac arrest should be placed on a firm surface. Backboards are usually placed between the mattress and the back of a patient in the attempt to increase cardiopulmonary resuscitation (CPR) quality, but their effectiveness remains controversial. A systematic search was performed to include studies on humans and simulation manikins assessing CPR quality with or without backboards. The primary outcome of the meta-analysis was the difference in chest compression depth between these two conditions. Out of 557 records, 16 studies were included in the review and all were performed on manikins. The meta-analysis, performed on 15 articles, showed that the use of backboards during CPR increases chest compression depth by 1.46 mm in manikins. Despite statistically significant, this increase could have a limited clinical impact on CPR, due to the substantial heterogeneity of experimental conditions and the scarcity of other CPR quality indicators.

Assessing anaesthesiology and intensive care specialty physicians: An Italian language multisource feedback system

BACKGROUND

Physician professionalism, including anaesthesiologists and intensive care doctors, should be continuously assessed during training and subsequent clinical practice. Multi-source feedback (MSF) is an assessment system in which healthcare professionals are assessed on several constructs (e.g., communication, professionalism, etc.) by multiple people (medical colleagues, coworkers, patients, self) in their sphere of influence. MSF has gained widespread acceptance for both formative and summative assessment of professionalism for reflecting on how to improve clinical practice.

METHODS

Instrument development and psychometric analysis (feasibility, reliability, construct validity via exploratory factor analysis) for MSF questionnaires in a postgraduate specialty training in Anaesthesiology and intensive care in Italy. Sixty-four residents at the Università del Piemonte Orientale (Italy) Anesthesiology Residency Program. Main outcomes assessed were: development and psychometric testing of 4 questionnaires: self, medical colleague, coworker and patient assessment.

RESULTS

Overall 605 medical colleague questionnaires (mean of 9.3 ±1.9) and 543 coworker surveys (mean 8.4 ±1.4) were collected providing high mean ratings for all items (> 4.0 /5.0). The self-assessment item mean score ranged from 3.1 to 4.3. Patient questionnaires (n = 308) were returned from 31 residents (40%; mean 9.9 ± 6.2). Three items had high percentages of "unable to assess" (> 15%) in coworker questionnaires. Factor analyses resulted in a two-factor solution: clinical management with leadership and accountability accounting for at least 75% of the total variance for the medical colleague and coworker's survey with high internal consistency reliability (Cronbach's α > 0.9). Patient's questionnaires had a low return rate, a limited exploratory analysis was performed.

CONCLUSIONS

We provide a feasible and reliable Italian language MSF instrument with evidence of construct validity for the self, coworkers and medical colleague. Patient feedback was difficult to collect in our setting.

Role of health simulation centres in the COVID-19 pandemic response in Italy: a national study

Introduction

The COVID-19 pandemic has dramatically affected the Italian health systems and drastically impacted healthcare workers’ daily routine and training. Simulation is an efficient tool to provide medical education, especially in the case of incoming public health emergencies. This study investigated the role and activities of Italian simulation centres (SCs) during the acute phase of the COVID-19 pandemic.

Methods

The population was identified through a web search. The directors of Italian SCs were contacted via email and then enrolled. A structured interview was created, internally validated and administrated by phone to participants.

Results

Following the government’s ordinance, 37 (88.37%) SCs had to be closed to the public. Twenty (46.51%) SCs organised in situ simulation while 7 (16.28%) of them organised simulation inside the centre. Twenty-three (53.49%) SCs resorted to telematic modalities to provide training about COVID-19 and 21 (48.84%) of them for other training. Up to date, 13 SCs are still closed to the public.

Conclusions

Italy has been severely hit by COVID-19, with differences between the regions. Almost all the SCs were closed, with only a few delivering training. The SCs took advantage of emergent technologies to create new ways to train people safely. Unfortunately, nearly one-fourth of Italian SCs have not reopened yet. The evolution of the COVID-19 epidemic calls for reconsideration about training activities including adequate safety measures implemented for all individuals involved.

An innovative and safe way to train novice ear nose and throat residents through simulation: the SimORL experience

Medical simulation enables trainees to learn procedural skills in a tailored, non-threatening, controlled environment that can provide feedback and educational experiences. The goals of this study are to describe the set-up and execution of an educational intervention (SimORL) in Ear Nose and Throat (ENT) simulation, to report confidence in performing basic ENT procedures before and after the event and investigate whether participants would find it useful and educationally effective. SimORL was a two-day formative event held at SIMNOVA - Eastern Piedmont Simulation Centre, Italy. The event was open to ENT trainees from any Italian ENT training program; participants were divided into 5 teams and rotated around 10 different simulation stations over two days. Stations included: high-fidelity, skill trainer, computer based, wet lab and dissection. Stations were: virtual otoscopy (OtoSim^®), simulated clinical cases with high-fidelity mannequin (e.g. epistaxis) or standardised patients (e.g. vestibular neuronitis), robotic surgery (Da Vinci^®), human anatomy (zSPACE AIO^®), surgical tracheostomy (wet model), cadaveric sino-nasal endoscopy (wet model), crisis resource management (team exercise), surgical sutures (Limbs&Things SkinPad^®), surgical set station and team building exercises. Participants were asked to complete a pre- and post-test that queried previous experience and confidence using 10-item unanchored semantic scales. Results are presented as median (25-75 percentile). Satisfaction was assessed by a validated 5-item Likert Simulation Experience Scale (SSES). Twenty-three ENT trainees attended SimORL 2018. Only 3 participants reported limited previous simulation experience. Pre-post confidence significantly improved between before and after the event. Overall satisfaction with Simulation Experience Scale (SSES) was very high with a median of 4.5 of 5. Regarding simulation evaluation, the most appreciated station was nasal endoscopy (10/10), while the least appreciated was otoscopy (6/10). SimORL proved to be a highly rated and useful educational tool to improve junior ENT trainees’ confidence in performing basic ENT procedures.

COVID-19 crisis, safe reopening of simulation centres and the new normal: food for thought

Background

The world is facing a massive burden from the coronavirus disease 2019 (COVID-19) pandemic. Governments took the extraordinary step of locking down their own countries to curb the spread of the coronavirus. After weeks of severe restrictions, countries have begun to relax their strict lockdown measures. However, reopening will not be back to normal.

Simulation facilities (SF) are training spaces that enable health professionals and students to learn skills and procedures in a safe and protected environment. Today’s clinicians and students have an expectation that simulation laboratories are part of lifelong healthcare education. There is great uncertainty about how COVID-19 will impact future training in SF. In particular, the delivery of training activities will benefit of adequate safety measures implemented for all individuals involved.

This paper discusses how to safely reopen SF in the post-lockdown phase.

Main body

The paper outlines 10 focus points and provides operational tips and recommendations consistent with current international guidelines to reopen SF safely in the post-lockdown phase. Considering a variety of national advices and regulations which describe initial measures for the reopening of workplaces as well as international public health recommendations, we provide points of reflection that can guide decision-makers and SF leaders on how to develop local approaches to specific challenges. The tips have been laid out taking also into account two main factors: (a) the SF audience, mainly consisting of undergraduate and postgraduate healthcare professionals, who might face exposure to COVID-19 infection, and (b) for many simulation-based activities, such as teamwork training, adequate physical distancing cannot be maintained.

Conclusions

The planning of future activities will have to be based not only on safety but also on flexibility principles.

Sharing common methods consistent with national and international health guidelines, while taking into account the specific characteristics of the different contexts and centres, will ultimately foster dissemination of good practices.

This article seeks to further the conversation. It is our hope that this manuscript will prompt research about the impact of such mitigation procedures and measures in different countries.

Augmented Reality Learning Environment for Basic Life Support and Defibrillation Training: Usability Study

Background

Basic life support (BLS) is crucial in the emergency response system, as sudden cardiac arrest is still a major cause of death worldwide. Unfortunately, only a minority of victims receive cardiopulmonary resuscitation (CPR) from bystanders. In this context, training could be helpful to save more lives, and technology-enhanced BLS simulation is one possible solution.

Objective

The aim of this study is to assess the feasibility and acceptability of our augmented reality (AR) prototype as a tool for BLS training.

Methods

Holo-BLSD is an AR self-instruction training system, in which a standard CPR manikin is “augmented” with an interactive virtual environment that reproduces realistic scenarios. Learners can use natural gestures, body movements, and spoken commands to perform their tasks, with virtual 3D objects anchored to the manikin and the environment. During the experience, users were trained to use the device while being guided through an emergency simulation and, at the end, were asked to complete a survey to assess the feasibility and acceptability of the proposed tool (5-point Likert scale; 1=Strongly Disagree, 5=Strongly Agree).

Results

The system was rated easy to use (mean 4.00, SD 0.94), and the trainees stated that most people would learn to use it very quickly (mean 4.00, SD 0.89). Voice (mean 4.48, SD 0.87), gaze (mean 4.12, SD 0.97), and gesture interaction (mean 3.84, SD 1.14) were judged positively, although some hand gesture recognition errors reduced the feeling of having the right level of control over the system (mean 3.40, SD 1.04).

Conclusions

We found the Holo-BLSD system to be a feasible and acceptable tool for AR BLS training.

Cognitive appraisals and team performance under stress: A simulation study

OBJECTIVES

The present study explored how challenge and threat responses to stress relate to performance, anxiety, confidence, team identity and team characteristics (time spent in training and postgraduate experience) in a medical simulation-based team competition.

METHODS

The study was conducted during a national simulation-based training event for residents, the SIMCUP Italia 2018. The SIMCUP is a simulation competition in which teams of four compete in simulated medical emergency scenarios. Cross-sectional data were collected prior to the 3 days of the competition. Subjects included 95 participants on 24 teams. Before the competition on each day, participants completed brief self-report measures that assessed demands and resources (which underpin challenge and threat responses to stress), cognitive and somatic anxiety, self-confidence and team identification. Participants also reported time (hours) spent practising as a team and years of postgraduate experience. A team of referees judged each scenario for performance and assigned a score. A linear mixed model using demands and resources was built to model performance.

RESULTS

The data showed that both demands and resources have positive effects on performance (31 [11-50.3] [P < .01] and 54 [25-83.3] [P < .01] percentage points increase for unitary increases in demands and resources, respectively); however, this is balanced by a negative interaction between the two (demands * resources interaction coefficient = -10 [-16 to -4.2]). A high level of resources is associated with better performance until demands become very high. Cognitive and somatic anxieties were found to be correlated with demands (Pearson's r = .51 [P < .01] and Pearson's r = .48 [P < .01], respectively). Time spent training was associated with greater perceptions of resources (Pearson's r = .36 [P < .01]).

CONCLUSIONS

We describe a model of challenge and threat that allows for the estimation of performance according to perceived demands and resources, and the interaction between the two. Higher levels of resources and lower demands were associated with better performance.

Heart rate assessment using NeoTapAdvancedSupport: a simulation study

BACKGROUND

NeoTapAdvancedSupport (NeoTapAS) is a mobile application, based on a screen tapping method that calculates the heart rate (HR). We aimed to evaluate the accuracy of NeoTapAS in reliably determining HR from auscultation in a high-fidelity simulated newborn resuscitation scenario.

METHODS

Paediatric residents assessed HR by auscultation plus NeoTapAS in an asphyxiated term infant scenario and orally communicated the estimated HR. An external observer simultaneously documented the actual HR set in the manikin and the communicated HR.

RESULTS

One hundred and sixty HR measurements were recorded. The agreement between communicated and set HR was good (Cohen's kappa 0.80, 95% CI 0.72 to 0.87; Bangdiwala's weighted agreement strength statistic 0.93). Bland-Altman plot showed a mean difference between communicated and set HR values of 1 beats per minute (bpm) (95% agreement limits -9 to 11 bpm).

CONCLUSION

NeoTapAS showed a good accuracy in estimating HR and it could be an important resource in settings with limited availability of ECG monitor.

Simulation-based medical training for paediatric residents in Italy: a nationwide survey

BACKGROUND

A prompt start to an appropriate neonatal and paediatric resuscitation is critical to reduce mortality and morbidity. However, residents are rarely exposed to real emergency situations. Simulation-based medical training (SBMT) offers the opportunity to improve medical and non-technical skills in a controlled setting. This survey describes the availability and current use of SBMT by paediatric residents in Italy with the purpose of understanding residents' expectations regarding neonatal and paediatric emergency training, and identifying gaps and potential areas for future implementation.

METHODS

A survey was developed and distributed to Italian residents. SBMT was defined as any kind of training with a mannequin in a contextualised clinically realistic scenario.

RESULTS

The response rate was 14.4%, covering the 71% of Italian paediatric residency programmes. Among them, 88% stated that Out of the 274 residents, 88% stated that they received less than 5 h of SBMT during the past training year, with 66% not participating in any kind of simulation activity. In 62% of the programmes no simulation training facility was available to residents. Among those who received SBMT, 46% used it for procedures and skills, 30% for clinical scenarios, but only 24% of them reported a regular use for debriefing. Of the overall respondents, 93% were interested in receiving SBMT to improve decision-making abilities in complex medical situations, to improve technical/procedural skills, and to improve overall competency in neonatal and paediatric emergencies, including non-technical skills. The main barriers to the implementation of SBMT programmes in Italian paediatric residencies were: the lack of experts (57%), the lack of support from the school director (56%), the lack of organisation in planning simulation centre courses (42%) and the lack of teaching materials (42%).

CONCLUSIONS

This survey shows the scarce use of SBMT during paediatric training programmes in Italy and points out the main limitations to its diffusion. This is a call to action to develop organised SBMT during paediatric residency programs, to train qualified personnel, and to improve the quality of education and care in this field.

Manufacture of a Multi-Purpose Low-Cost Animal Bench-Model for Teaching Tracheostomy

Tracheostomy is one of the most frequent procedures, performed through various techniques in the intensive care unit and emergency situations. Despite this, there is a lack of training on this procedure that affects its outcome, which is also dependent on operator's dexterity. Here, we take the specific training and simulation into consideration. This article aims to describe every step of the manufacture of a new multi-purpose low-cost animal bench-model, with the support of video and images, and to obtain an opinion about the quality of this model by administering a questionnaire to professionals with experience in the procedures. Ten experts in the technique were enrolled. The model scored an average of 3.45/5 for its anatomical realism; 4.75/5 for its usefulness as a training tool for simulation courses and assessments. The time necessary to build the model was 15 minutes, and the cost amounted to 10€. The animal bench-model was considered a very useful simulator for tracheostomy training and assessments. Therefore, it could be used as a tool for medical courses and residencies.

Wearable Proximity Sensors for Monitoring a Mass Casualty Incident Exercise: Feasibility Study

BACKGROUND

Over the past several decades, naturally occurring and man-made mass casualty incidents (MCIs) have increased in frequency and number worldwide. To test the impact of such events on medical resources, simulations can provide a safe, controlled setting while replicating the chaotic environment typical of an actual disaster. A standardized method to collect and analyze data from mass casualty exercises is needed to assess preparedness and performance of the health care staff involved.

OBJECTIVE

In this study, we aimed to assess the feasibility of using wearable proximity sensors to measure proximity events during an MCI simulation. In the first instance, our objective was to demonstrate how proximity sensors can collect spatial and temporal information about the interactions between medical staff and patients during an MCI exercise in a quasi-autonomous way. In addition, we assessed how the deployment of this technology could help improve future simulations by analyzing the flow of patients in the hospital.

METHODS

Data were obtained and collected through the deployment of wearable proximity sensors during an MCI functional exercise. The scenario included 2 areas: the accident site and the Advanced Medical Post, and the exercise lasted 3 hours. A total of 238 participants were involved in the exercise and classified in categories according to their role: 14 medical doctors, 16 nurses, 134 victims, 47 Emergency Medical Services staff members, and 27 health care assistants and other hospital support staff. Each victim was assigned a score related to the severity of his/her injury. Each participant wore a proximity sensor, and in addition, 30 fixed devices were placed in the field hospital.

RESULTS

The contact networks show a heterogeneous distribution of the cumulative time spent in proximity by the participants. We obtained contact matrices based on the cumulative time spent in proximity between the victims and rescuers. Our results showed that the time spent in proximity by the health care teams with the victims is related to the severity of the patient's injury. The analysis of patients' flow showed that the presence of patients in the rooms of the hospital is consistent with the triage code and diagnosis, and no obvious bottlenecks were found.

CONCLUSIONS

Our study shows the feasibility of the use of wearable sensors for tracking close contacts among individuals during an MCI simulation. It represents, to our knowledge, the first example of unsupervised data collection-ie, without the need for the involvement of observers, which could compromise the realism of the exercise-of face-to-face contacts during an MCI exercise. Moreover, by permitting detailed data collection about the simulation, such as data related to the flow of patients in the hospital, such deployment provides highly relevant input for the improvement of MCI resource allocation and management.

Medical simulation in pharmacology learning and retention: A comparison study with traditional teaching in undergraduate medical students

The purpose of the study was to determine whether low-high fidelity medical simulation improves learning and long-lasting retention of pharmacology knowledge, compared to lecture alone, in undergraduate medical students. Ninety students, before a 45-minute lecture, were randomized into three groups - sham (S), low (LF), and high fidelity (HF) simulation - to participate in an interactive simulation session. To evaluate immediate and long-lasting retention, a 20-item structured questionnaire on inotropic agents was administered to 90 students before and after a 45-minute lecture, after simulation, and 3 months later. In all groups, the rate of correct answers increased after lecture, while no difference was observed between different groups (P = 0.543). After simulation, students in the HF group provided more correct answers compared to S or LF group (P > 0.001). After 3 months, a significant decrease in the number of correct answers was observed in S (P < 0.001) and LF (P < 0.001) groups, but not in the HF group (P = 0.066). Moreover, HF simulation resulted in an increased number of correct answers compared to the LF (P < 0.001) or S simulation (P < 0.001). These data suggest that advanced medical simulation teaching applied to pharmacology is associated with more effective learning and long-lasting retention compared to lecture alone.

A novel simulation competition format as an effective instructional tool in post-graduate medical education

Objective

Medical simulation competitions are a growing reality. This study aims at exploring if a novel format of simulation competition (SIMCUP) can be an effective educational format in post-graduate education.

Design

We designed a 2-day event that included scientific educational lectures, an orientation to the competition, familiarization with the simulation lab, and competition time. Day 1 was devoted to preliminary rounds and was structured using an Objective Structured Clinical Examination (OSCE)-like system. On day 2, the first four teams advanced to semi-finals and then to finals, which were held using a classical SimWars style.

Setting and subjects

A total of 14 four-participant teams participated in the event over two editions (Ed.1 in 2015 and Ed.2 in 2016).

Interventions

External referees evaluated both technical and non-technical skills for each simulated scenario. Each participant was also administered pre- and post-test questionnaires covering self-perception about the confidence in managing simulated clinical cases, educational effectiveness, satisfaction with the simulation experience, and previous simulation training.

Main results

Overall participants found SIMCUP a useful learning experience, rating it 10 [9, 10] and 10 [7.75–10] out of 10 for Ed.1 and Ed.2, respectively. Participants reported, using a 10-point semantic differential scale ranging from “1 - strongly disagree.” to “10 - strongly agree,” finding both days to be educationally effective: day 1 was rated 9 [7–10] and 9 [8–10] as day 2 was rated 8 [7–10] and 8 [7–10] for Ed. 1 and Ed. 2, respectively.

Participants’ self-perception regarding the confidence of managing the specific scenarios significantly improved immediately after the event as measured by pre- and post-questionnaires for all stations and during both editions.

Conclusion

This study suggests that simulation competition can serve as an effective instructional format in residency training.

Electronic supplementary material

The online version of this article (10.1186/s41077-018-0075-4) contains supplementary material, which is available to authorized users.

Prioritization in medical school simulation curriculum development using survey tools and desirability function: a pilot experiment

BACKGROUND

In Italy, there is no framework of procedural skills that all medical students should be able to perform autonomously at graduation. The study aims at identifying (1) a set of essential procedural skills and (2) which abilities could be potentially taught with simulation. Desirability score was calculated for each procedure to determine the most effective manner to proceed with simulation curriculum development.

METHODS

A web poll was conducted at the School of Medicine in Novara, looking at the level of expected and self-perceived competency for common medical procedures. Three groups were enrolled: (1) faculty, (2) junior doctors in their first years of practice, and (3) recently graduated medical students. Level of importance of procedural skills for independent practice expressed by teachers, level of mastery self-perceived by learners (students and junior doctors) and suitability of simulation training for the given technical skills were measured. Desirability function was used to set priorities for future learning.

RESULTS

The overall mean expected level of competency for the procedural skills was 7.9/9. Mean level of self reported competency was 4.7/9 for junior doctors and 4.4/9 for recently graduated students. The highest priority skills according to the desirability function were urinary catheter placement, nasogastric tube insertion, and incision and drainage of superficial abscesses.

CONCLUSIONS

This study identifies those technical competencies thought by faculty to be important and assessed the junior doctors and recent graduates level of self-perceived confidence in performing these skills. The study also identifies the perceived utility of teaching these skills by simulation. The study prioritizes those skills that have a gap between expected and observed competency and are also thought to be amenable to teaching by simulation. This allows immediate priorities for simulation curriculum development in the most effective manner. This methodology may be useful to researchers in other centers to prioritize simulation training.

Anesthesiology Resident Induction Month: a pilot study showing an effective and safe way to train novice residents through simulation

BACKGROUND

The transition of new residents from medical school to the post-graduate clinical environment remains challenging. We hypothesized that an introductory simulation course could improve new residents' performance in anesthesiology.

METHODS

The Anesthesiology Residents Induction Month (ARIM) program was designed as a non-clinical simulation training program aiming at providing the theoretical and practical skills to safely approach, as junior anesthesiologists, the operating rooms. For each participant, specific knowledge, procedural skills and non-technical performance were assessed with a pre and post-test approach, before and immediately after the participation in the study.

RESULTS

Fifteen first-month residents participated in the study. As compared to pre-test, residents significantly improved in all three evaluated areas. Pre-test knowledge assessment mean improved from 56% to 73% in the post-test (P<0.001). In the procedural skills assessment, pre-test mean improved from 43% to 77% (P<0.001) and non-technical skills assessment improved from 3.17 to 4.61 (in a scale out of seven points) in the post-test (P<0.001).

CONCLUSIONS

Data suggest that an intensive simulation-based program can be an effective way for first-year residents to rapidly acquire and develop basic skills specific to anesthesiology. There might be benefits to begin residency with a training program aiming at developing and standardizing technical and non-technical skills.

An Italian version of the Ottawa Crisis Resource Management Global Rating Scale: a reliable and valid tool for assessment of simulation performance

Objective measurement of simulation performance requires a validated and reliable tool. However, no published Italian language assessment tool is available. Translation of a published English language tool, the Ottawa Crisis Resource Management Global Rating Scale (GRS), may lead to a validated and reliable tool. After developing an Italian language translation of the English language tool, the study measured the reliability of the new tool by comparison with the English language tool used independently in the same simulation scenarios. In addition, the validity of the Italian language tool was measured by comparison to a skills score also applied independently. The correlation coefficient between the Italian language overall GRS and the English language overall GRS was 0.82 (adjusted 95 % confidence interval: 0.62-0.92). The correlation coefficient between the Italian language overall GRS and the skill score was 0.85 (adjusted 95 % confidence interval 0.68-0.94). This study demonstrated that the Italian language GRS has acceptable reliability when compared with the English language tool, suggesting that it can be used reliably to evaluate the performance during simulated emergencies. The study also suggests that the tool has acceptable validity for assessing the simulation performance. The study suggests that the Italian language GRS translation has reasonable reliability when compared with the English language GRS and reasonable validity when compared with the assessment of the skills scores. Data suggest that the instrument is adequately reliable for informal and formative type of examinations, but may require further confirmation before use for high-stake examinations such as licensing.

Education and Training of Emergency Medical Teams: Recommendations for a Global Operational Learning Framework

An increasing number of international emergency medical teams are deployed to assist disaster-affected populations worldwide. Since Haiti earthquake those teams have been criticised for ill adapted care, lack of preparedness in addition to not coordinating with the affected country healthcare system. The Emergency Medical Teams (EMTs) initiative, as part of the Word Health Organization’s Global Health Emergency Workforce program, aims to address these shortcomings by improved EMT coordination, and mechanisms to ensure quality and accountability of national and international EMTs. An essential component to reach this goal is appropriate education and training. Multiple disaster education and training programs are available. However, most are centred on individuals’ professional development rather than on the EMTs operational performance. Moreover, no common overarching or standardised training frameworks exist. In this report, an expert panel review and discuss the current approaches to disaster education and training and propose a three-step operational learning framework that could be used for EMTs globally. The proposed framework includes the following steps: 1) ensure professional competence and license to practice, 2) support adaptation of technical and non-technical professional capacities into the low-resource and emergency context and 3) prepare for an effective team performance in the field. A combination of training methodologies is also recommended, including individual theory based education, immersive simulations and team training. Agreed curriculum and open access training materials for EMTs need to be further developed, ideally through collaborative efforts between WHO, operational EMT organizations, universities, professional bodies and training agencies.  Keywords: disasters; education; emergencies; global health; learning

Evaluation of a new community-based curriculum in disaster medicine for undergraduates

BACKGROUND

Nowadays, many medical schools include training in disaster medicine in undergraduate studies. This study evaluated the efficacy of a disaster medicine curriculum recently designed for Saudi Arabian medical students.

METHODS

Participants were 15 male and 14 female students in their fourth, fifth or sixth year at Jazan University Medical School, Saudi Arabia. The course was held at the Research Center in Emergency and Disaster Medicine and Computer Sciences Applied to the Medical Practice in Novara, Italy.

RESULTS

The overall mean score on a test given before the course was 41.0 % and it increased to 67.7 % on the post-test (Wilcoxon test for paired samples: z = 4.71, p < 0.0001). There were no significant differences between the mean scores of males and females, or between students in their fourth, fifth or sixth year of medical school.

CONCLUSIONS

These results show that this curriculum is effective for teaching disaster medicine to undergraduate medical students. Adoption of this course would help to increase the human resources available for dealing with disaster situations.

Assessment of disaster preparedness among emergency departments in Italian hospitals: a cautious warning for disaster risk reduction and management capacity

STUDY HYPOTHESIS

Since the 1990s, Italian hospitals are required to comply with emergency disaster plans known as Emergency Plan for Massive Influx of Casualties. While various studies reveal that hospitals overall suffer from an insufficient preparedness level, the aim of this study was to better determine the preparedness level of Emergency Departments of Italian hospitals by assessing the knowledge-base of emergency physicians regarding basic disaster planning and procedures.

METHODS

A prospective observational study utilized a convenience sample of Italian Emergency Departments identified from the Italian Ministry of Health website. Anonymous telephone interviews were conducted of medical consultants in charge at the time in the respective Emergency Departments, and were structured in 3 parts: (1) general data and demographics, (2) the current disaster plan and (3) protocols and actions of the disaster plan.

RESULTS

Eighty-five Emergency Departments met inclusion criteria, and 69 (81 %) agreed to undergo the interview. Only 45 % of participants declared to know what an Emergency Plan for Massive Influx of Casualties is, 41 % believed to know who has the authority to activate the plan, 38 % knew who is in charge of intra-hospital operations. In Part 3 physicians revealed a worrisome inconsistency in critical content knowledge of their answers.

CONCLUSIONS

Results demonstrate a poor knowledge-base of basic hospital disaster planning concepts by Italian Emergency Department physicians-on-duty. These findings should alert authorities to enhance staff disaster preparedness education, training and follow-up to ensure that these plans are known to all who have responsibility for disaster risk reduction and management capacity.

Proposal for a community-based disaster management curriculum for medical school undergraduates in Saudi Arabia

OBJECTIVES

Health professional preparedness is a key element of disaster response; overall there is a need for increased disaster medicine training worldwide. The objective of this study was to design and develop a curriculum in community-based disaster medicine for Saudi Arabian medical undergraduates.

METHODS

A structured five-step approach was used to develop a curriculum. Expert stakeholders from the Saudi Arabian and international disaster medicine communities were surveyed to determine objectives and content. Learning strategies were carefully considered to maximize participation and retention. Particular attention was paid to equipping learners with the teaching skills required to promote disaster preparedness in their local communities.

CURRICULUM DESIGN

The course consists of 2 weeks of classroom activities followed by 8 weeks of e-learning structured within five domains of disaster medicine. The curriculum introduces core principles in emergency medicine, public health, and disaster management. Simulations, experiential activities, case studies, and role-playing activities are all used to promote higher levels of cognitive engagement. Special content addresses the adult-learning process, and students design their own community-based seminars in disaster preparedness.

CONCLUSIONS

The curriculum is designed to promote learning in disaster medicine. Given the paucity of disaster medicine educators in the region, student graduates of this program would be able to improve disaster preparedness in Saudi Arabia by launching their own community-based disaster preparedness initiatives. The program could also be adapted for use throughout the Middle East.

Virtual Disaster Simulation: Lesson Learned from an International Collaboration That Can Be Leveraged for Disaster Education in Iran

Disaster education needs innovative educational methods to be more effective compared to traditional approaches. This can be done by using virtual simulation method. This article presents an experience about using virtual simulation methods to teach health professional on disaster medicine in Iran.

The workshop on the "Application of New Technologies in Disaster Management Simulation" was held in Tehran in January 2015. It was co-organized by the Disaster and Emergency Health Academy of Tehran University of Medical Sciences and Emergency and the Research Center in Disaster Medicine and Computer Science applied to Medicine (CRIMEDIM), Università del Piemonte Orientale. Different simulators were used by the participants, who were from the health system and other relevant fields, both inside and outside Iran.

As a result of the workshop, all the concerned stakeholders are called on to support this new initiative of incorporating virtual training and exercise simulation in the field of disaster medicine, so that its professionals are endowed with field-based and practical skills in Iran and elsewhere.

Virtual simulation technology is recommended to be used in education of disaster management. This requires capacity building of instructors, and provision of technologies. International collaboration can facilitate this process. Keywords: Virtual simulation, disaster management, education, training, Iran

Disaster medicine curricula in Saudi Arabian medical schools

Background:Disaster medicine training in medical school is a key element of disaster preparedness, and several international educational authorities have called for an increase in this specific type of training. The objective of this study was to assess the current state of disaster medicine education in the Kingdom of Saudi Arabia.Methods:All 30 medical schools in Saudi Arabia were invited to participate in the study, and a 25-item online survey was sent to those that consented.Results:The response rate was 67%. Only three of the responding 20 universities currently have disaster medicine programs, and they spend an average of three hours per year on the subject. Respondents without disaster medicine curricula indicated that a mandatory, accredited course in the final three years of the six-year program was their preferred method for implementation, and most favored a blended approach.Conclusions:The study found that there is a paucity of disaster medicine programs in Saudi Arabia. Most schools indicated a willingness to implement such training in their undergraduate programs but cited lack of an adequate number of relevant professionals as a major impediment.

Combining Dedicated Online Training and Apprenticeships in the Field to Assist in Professionalization of Humanitarian Aid Workers: a 2-year Pilot Project for Anesthesia and Intensive Care Residents Working in Resource Constrained and Low-income Countries

Introduction: As a result of the gaps in humanitarian response highlighted by several reports, the international community called for an increased professionalization of humanitarian aid workers. This paper describes a pilot project by an Italian university and a non-profit, non-governmental organization to implement a medical apprenticeship in low-income countries during Anesthesia and Intensive Care Medicine residencies. Methods: Before deployment, participants were required to complete a dedicated online training course about safety and security in the field, principles of anesthesia at the district hospital level, emergency and essential surgical care, essentials of medical treatment in resource-constrained environments and psychological support in emergencies. Results: At the end of the program, a qualitative self-evaluation questionnaire administered to participants highlighted how the project allowed the participants to advance their professional skills when working in a low-resource environment, while also mastering their adapting skills and the ability to interact and cooperate with local healthcare personnel. The project also proved to be a means for personal growth, making these experiences a recommendation for all residents as a necessary step for the professionalization of healthcare personnel involved in humanitarian aid.

Italian medical students and disaster medicine: awareness and formative needs

OBJECTIVE

Over the last century, the number of disasters has increased. Many governments and scientific institutions agree that disaster medicine education should be included in the standard medical curriculum. Italian medical students' perceptions of mass casualty incidents and disasters and whether-and if so to what extent-such topics are part of their academic program were investigated.

DESIGN, SETTING, AND PARTICIPANTS

A Web-based survey was disseminated to all students registered with the national medical students' association (Segretariato Italiano Studenti Medicina), a member of the International Federation of Medical Students' Associations. The survey consisted of 14 questions divided into four sections.

RESULTS

Six hundred thirty-nine medical students completed the survey; 38.7 percent had never heard about disaster medicine; 90.9 percent had never attended elective academic courses on disaster medicine; 87.6 percent had never attended non-academic courses on disaster medicine; 91.4 percent would welcome the introduction of a course on disaster medicine in their core curriculum; and 94.1 percent considered a knowledge of disaster medicine important for their future career.

CONCLUSIONS

Most of the students surveyed had never attended courses on disaster medicine during their medical school program. However, respondents would like to increase their knowledge in this area and would welcome the introduction of specific courses into the standard medical curriculum.

Utstein-style template for uniform data reporting of acute medical response in disasters

BACKGROUND

In 2003, the Task Force on Quality Control of Disaster Management (WADEM) published guidelines for evaluation and research on health disaster management and recommended the development of a uniform data reporting tool. Standardized and complete reporting of data related to disaster medical response activities will facilitate the interpretation of results, comparisons between medical response systems and quality improvement in the management of disaster victims.

METHODS

Over a two-year period, a group of 16 experts in the fields of research, education, ethics and operational aspects of disaster medical management from 8 countries carried out a consensus process based on a modified Delphi method and Utstein-style technique.

RESULTS

The EMDM Academy Consensus Group produced an Utstein-style template for uniform data reporting of acute disaster medical response, including 15 data elements with indicators, that can be used for both research and quality improvement.

CONCLUSION

It is anticipated that the Utstein-style template will enable better and more accurate completion of reports on disaster medical response and contribute to further scientific evidence and knowledge related to disaster medical management in order to optimize medical response system interventions and to improve outcomes of disaster victims.