Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis

Teaching Metabolism in Upper-Division Undergraduate Biochemistry Courses using Online Computational Systems and Dynamical Models Improves Student Performance

Understanding metabolic function requires knowledge of the dynamics, interdependence, and regulation of metabolic networks. However, multiple professional societies have recognized that most undergraduate biochemistry students acquire only a surface-level understanding of metabolism. We hypothesized that guiding students through interactive computer simulations of metabolic systems would increase their ability to recognize how individual interactions between components affect the behavior of a system under different conditions. The computer simulations were designed with an interactive activity (i.e., module) that used the predict-observe-explain model of instruction to guide students through a process in which they iteratively predict outcomes, test their predictions, modify the interactions of the system, and then retest the outcomes. We found that biochemistry students using modules performed better on metabolism questions compared with students who did not use the modules. The average learning gain was 8% with modules and 0% without modules, a small to medium effect size. We also confirmed that the modules did not create or reinforce a gender bias. Our modules provide instructors with a dynamic, systems-driven approach to help students learn about metabolic regulation and equip students with important cognitive skills, such as interpreting and analyzing simulation results, and technical skills, such as building and simulating computer-based models.

An Approach to Economic Evaluation in Undergraduate Anatomy Education

Medical education research is becoming increasingly concerned with the value (defined as "educational outcomes per dollar spent") of different teaching approaches. However, the financial costs of various approaches to teaching anatomy are under-researched, making evidence-based comparisons of the value of different teaching approaches impossible. Therefore, the aims of this study were to report the cost of six popular anatomy teaching methods through a specific, yet generalizable approach, and to demonstrate a process in which these results can be used in conjunction with existing effectiveness data to undertake an economic evaluation. A cost analysis was conducted to report the direct and indirect costs of six anatomy teaching methods, using an established approach to cost-reporting. The financial information was then combined with previously published information about the effectiveness of these six teaching methods in increasing anatomy knowledge, thereby demonstrating how estimations of value can be made. Dissection was reported as the most expensive teaching approach and computer aided instruction/learning (CAI/L) was the least, based on an estimation of total cost per student per year and assuming a student cohort size of just over 1,000 (the United Kingdom average). The demonstrated approach to economic evaluation suggested computer aided instruction/learning as the approach that provided the most value, in terms of education outcomes per dollar spent. The study concludes by suggesting that future medical education research should incorporate substantially greater consideration of cost, in order to draw important conclusions about value for learners.

Educator's Learning Alignment Instrument (ELAI)

OBJECTIVE

To report the development and initial testing of a questionnaire designed to assess the concept of learning alignment within chiropractic college courses.

METHODS

A 36-item questionnaire, Educator's Learning Alignment Instrument (ELAI), was created to evaluate how learning goals, course activities, and assessments align within a college course. Questionnaire development was informed by learning theories and tested using a 2-phased electronic survey mechanism among a chiropractic college faculty. Phase 1 included completing the ELAI for a currently implemented course. Phase 2 included questions about confidential reports generated from ELAI data.

RESULTS

Thirty-one of 46 (67%) respondents completed an ELAI. Twelve (38%) participated in phase 2. Twenty-one (68%) courses demonstrated consistent learning focus across goals, activities, and assessments. Aggregate data from early, middle, and late chiropractic program courses revealed progressive shifts toward higher-level learning. Eighty-seven percent of courses contained 1 or more individual learning areas with potentially misaligned goals, activities, or assessment. Ninety-seven percent of respondents completed ELAI questions within 20 minutes. Most (87%) phase 2 respondents noted the report accurately reflected the course. Sixty-seven percent of phase 2 respondents agreed that confidential reports provided useful information to inform course design.

CONCLUSION

The ELAI is a nonburdensome instrument that can facilitate faculty reflection on how aligned learning concepts are applied in a course and provide novel data to assess general learning focus within college courses and within programs. Results indicate ELAI questions can be revised to improve clarity. Additional research comparing ELAI responses from experts, peer educators, and students is recommended.

Current Status of Handheld Otoscopy Training: A Systematic Review

OBJECTIVE

Otoscopy is a frequently performed procedure and competency in this skill is important across many specialties. We aim to systematically review current medical educational evidence for training of handheld otoscopy skills.

METHODS

Following the PRISMA guideline, studies reporting on training and/or assessment of handheld otoscopy were identified searching the following databases: PubMed, Embase, OVID, the Cochrane Library, PloS Medicine, Directory of Open Access Journal (DOAJ), and Web of Science. Two reviewers extracted data on study design, training intervention, educational outcomes, and results. Quality of educational evidence was assessed along with classification according to Kirkpatrick's model of educational outcomes.

RESULTS

The searches yielded a total of 6064 studies with a final inclusion of 33 studies for the qualitative synthesis. Handheld otoscopy training could be divided into workshops, physical simulators, web-based training/e-learning, and smartphone-enabled otoscopy. Workshops were the most commonly described educational intervention and typically consisted of lectures, hands-on demonstrations, and training on peers. Almost all studies reported a favorable effect on either learner attitude, knowledge, or skills. The educational quality of the studies was reasonable but the educational outcomes were mostly evaluated on the lower Kirkpatrick levels with only a single study determining the effects of training on actual change in the learner behavior.

CONCLUSION

Overall, it seems that any systematic approach to training of handheld otoscopy is beneficial in training regardless of learner level, but the heterogeneity of the studies makes comparisons between studies difficult and the relative effect sizes of the interventions could not be determined.

Assessing competence in cochlear implant surgery using the newly developed Cochlear Implant Surgery Assessment Tool

PURPOSE

To develop and gather validity evidence for a novel tool for assessment of cochlear implant (CI) surgery, including virtual reality CI surgery training.

METHODS

Prospective study gathering validity evidence according to Messick's framework. Four experts developed the CI Surgery Assessment Tool (CISAT). A total of 35 true novices (medical students), trained novices (residents) and CI surgeons performed two CI-procedures each in the Visible Ear Simulator, which were rated by three blinded experts. Classical test theory and generalizability theory were used for reliability analysis.

RESULTS

The CISAT significantly discriminated between the three groups (p < 0.001). The generalizability coefficient was 0.76 and most of the score variance (53.3%) was attributable to the participant and only 6.8% to the raters. When exploring a standard setting for CI surgery, the contrasting groups method suggested a pass/fail score of 36.0 points (out of 55), but since the trained novices performed above this, we propose using the mean CI surgeon performance score (45.3 points).

CONCLUSION

Validity evidence for simulation-based assessment of CI performance supports the CISAT. Together with the standard setting, the CISAT might be used to monitor progress in competency-based training of CI surgery and to determine when the trainee can advance to further training.

Evaluating the Instructional Design and Effect on Knowledge, Teamwork, and Skills of Technology-Enhanced Simulation-Based Training in Obstetrics in Uganda: Stepped-Wedge Cluster Randomized Trial

BACKGROUND

Simulation-based training is a common strategy for improving the quality of facility-based maternity services and is often evaluated using Kirkpatrick's theoretical model. The results on the Kirkpatrick levels are closely related to the quality of the instructional design of a training program. The instructional design is generally defined as the "set of prescriptions for teaching methods to improve the quality of instruction with a goal of optimizing learning outcomes."

OBJECTIVE

The aim of this study is to evaluate the instructional design of a technology-enhanced simulation-based training in obstetrics, the reaction of participants, and the effect on knowledge, teamwork, and skills in a low-income country.

METHODS

A stepped-wedge cluster randomized trial was performed in a university hospital in Kampala, Uganda, with an annual delivery volume of over 31,000. In November 2014, a medical simulation center was installed with a full-body birthing simulator (Noelle S550, Gaumard Scientific), an interactive neonate (Simon S102 Newborn CPR Simulator, Gaumard Scientific), and an audio and video recording system. Twelve local obstetricians were trained and certified as medical simulation trainers. From 2014 to 2016, training was provided to 57 residents in groups of 6 to 9 students. Descriptive statistics were calculated for ten instructional design features of the training course measured by the 42-item ID-SIM (Instructional Design of a Simulation Improved by Monitoring). The Wilcoxon signed rank test was conducted to investigate the differences in scores on knowledge, the Clinical Teamwork Scale, and medical technical skills.

RESULTS

The mean scores on the ten instructional design features ranged from 54.9 (95% CI 48.5-61.3) to 84.3 (95% CI 80.9-87.6) out of 100. The highest mean score was given on the feature feedback and the lowest scores on repetitive practice and controlled environment. The overall score for the training day was 92.8 out of 100 (95% CI 89.5-96.1). Knowledge improved significantly, with a test score of 63.4% (95% CI 60.7-66.1) before and 78.9% (95% CI 76.8-81.1) after the training (P<.001). The overall score on the 10-point Clinical Teamwork Scale was 6.0 (95% CI 4.4-7.6) before and 5.9 (95% CI 4.5-7.2) after the training (P=.78). Medical technical skills were scored at 55.5% (95% CI 47.2-63.8) before and 65.6% (95% CI 56.5-74.7) after training (P=.08).

CONCLUSIONS

Most instructional design features of a technology-enhanced simulation-based training in obstetrics in a low-income country were scored high, although intervals were large. The overall score for the training day was high, and knowledge did improve after the training program, but no changes in teamwork and (most) medical technical skills were found. The lowest-scored instructional design features may be improved to achieve further learning aims.

TRIAL REGISTRATION

ISRCTN Registry ISRCTN98617255; http://www.isrctn.com/ISRCTN98617255.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1186/s12884-020-03050-3.

The impact of an electronic guide on students' self-directed learning in simulation clinic

INTRODUCTION

Simulation training on high-fidelity simulated models have been used to provide a safe and effective training platform for dental students to develop the skills necessary to treat patients. To surpass challenges of traditional pedagogies in simulation training and reinforce self-directed learning, a bespoke computer application, PerioPal, was designed to complement training of dental students in periodontal instrumentation.

MATERIALS AND METHODS

This study evaluated the impact of PerioPal on a cohort of 92 second-year dental students at an Australian University. During the first semester in 2019, they received traditional simulation periodontal instrumentation training (control semester). In the following semester, PerioPal was implemented as a technological teaching adjunct (intervention semester). Student perceptions of their learning experiences were gathered through a qualitative and quantitative questionnaire. Impact on student performance was evaluated through comparing periodontal instrumental assessment results in control and interventionsemesters.

RESULTS

With introduction of PerioPal, students perceived that the simulation clinic learning environment, better contributed to the speed at which they learnt new instrumentation as well as being able to self-pace their work. They commented that instructional videos and independent learning were most beneficial. Interestingly, students suggested that PerioPal aided their preparation for theoretical assessments more than their practical assessments. After introduction of PerioPal a minor improvement of average practical assessment marks was observed but could not be statistically confirmed as significant.

CONCLUSION

Although the computer-supported learning did not lead to improvement of the students' practical performance a positive effect on the student self-paced learning experience and engagement in simulated environment were observed.

See Like an Expert: Gaze-Augmented Training Enhances Skill Acquisition in a Virtual Reality Robotic Suturing Task

Introduction: The da Vinci Skills Simulator (DVSS) is an effective platform for robotic skills training. Novel training methods using expert gaze patterns to guide trainees have demonstrated superiority to traditional instruction. Portable head-mounted eye-trackers (HMET) offer the opportunity for eye tracking technology to enhance surgical robotic simulation training. Objective: To evaluate if training guided by expert gaze patterns can improve trainee performance over standard movement training techniques during robotic simulation. Methods: Medical students were recruited and randomized into gaze training (GT, n = 9) and movement training (MT, n = 8) groups. First, the participants reviewed an instructional video, with the GT group emulating expert gaze patterns and the MT group (n = 8) standard movement-based instruction. Training consisted of 10 repetitions of "Suture Sponge 3" on the DVSS while wearing HMET; the first three repetitions were followed by group-appropriate video coaching (gaze vs movement feedback), while the remaining repetitions were without feedback. Finally, two multitasking repetitions with a secondary bell-counting task were completed. Primary outcomes included DVSS scores during training and multitasking. Secondary outcomes included metrics collected from the HMET (gaze patterns and gaze entropy). Results: Total score, efficiency, and penalties improved significantly over the training in both groups; the GT group achieved higher scores on every attempt. Total scores in the GT group were higher than the MT group postvideo review (20.3 ± 21.8 vs 3.0 ± 6.2, p = 0.047), after coaching repetitions (61.8 ± 18.8 vs 30.1 ± 26.2, p = 0.01), and at the last training attempt (73.0 ± 16.5 vs 63.1 ± 17.4, p = 0.247). During multitasking, the GT group maintained higher total scores (75 ± 10.1 vs 63.3 ± 15.3, p = 0.01), efficiency (86.3 ± 7.4 vs 77.4 ± 11.2, p = 0.009), and superior secondary task performance (error: 6.3% ± 0.06 vs 10.7% ± 0.11, p = 0.20). Gaze entropy (cognitive-load indicator) and gaze pattern analysis showed similar trends. Conclusion: Gaze-augmented training leads to more efficient movements through adoption of expert gaze patterns that withstand additional stressors.

The Science of Workplace Instruction: Learning and Development Applied to Work

Learning is the engagement in mental processes resulting in the acquisition and retention of knowledge, skills, and/or affect over time and applied when needed. Building on this definition, we integrate the science of training and the science of learning to propose a new science of workplace instruction, linking the design of instructional events to instructional outcomes such as transfer and job performance through the mediating effects of learner events and learning outcomes. We propose three foundational elements: the learner, instructional principles, and training delivery (methods and media). Understanding and applying instructional principles are the primary methods for enhancing training effectiveness; thus, we detail 15 empirically supported principles. We then discuss the erroneous pursuit of aptitude-by-treatment interactions under the guise of learner styles and age-specific instruction. Finally, we offer suggestions for future research that draw on the foundation of instructional principles to optimize self-directed learning and learning in synthetic learning environments.

Procedural virtual reality simulation training for robotic surgery: a randomised controlled trial

Background

Virtual reality (VR) training is widely used for surgical training, supported by comprehensive, high-quality validation. Technological advances have enabled the development of procedural-based VR training. This study assesses the effectiveness of procedural VR compared to basic skills VR in minimally invasive surgery.

Methods

26 novice participants were randomised to either procedural VR (n = 13) or basic VR simulation (n = 13). Both cohorts completed a structured training programme. Simulator metric data were used to plot learning curves. All participants then performed parts of a robotic radical prostatectomy (RARP) on a fresh frozen cadaver. Performances were compared against a cohort of 9 control participants without any training experience. Performances were video recorded and assessed blindly using GEARS post hoc.

Results

Learning curve analysis demonstrated improvements in technical skill for both training modalities although procedural training was associated with greater training effects.

Any VR training resulted in significantly higher GEARS scores than no training (GEARS score 11.3 ± 0.58 vs. 8.8 ± 2.9, p = 0.002). Procedural VR training was found to be more effective than both basic VR training and no training (GEARS 11.9 ± 2.9 vs. 10.7 ± 2.8 vs. 8.8 ± 1.4, respectively, p = 0.03).

Conclusions

This trial has shown that a structured programme of procedural VR simulation is effective for robotic training with technical skills successfully transferred to a clinical task in cadavers. Further work to evaluate the role of procedural-based VR for more advanced surgical skills training is required.

Electronic supplementary material

The online version of this article (10.1007/s00464-020-08197-w) contains supplementary material, which is available to authorized users.

Impact of Simulation-based Mastery Learning on Resident Skill Managing Mechanical Ventilators

Background: Caring for patients requiring mechanical ventilation is complex, and residents may lack adequate skill for managing these patients. Simulation-based mastery learning (SBML) is an educational model that trains clinicians to a high standard and can reduce complications. The mastery learning model has not been applied to ventilator management. Objective: The purpose of this study was to determine whether SBML, as compared with traditional training, is an effective strategy for teaching residents the skills necessary to manage patients requiring mechanical ventilation. Methods: We developed an SBML curriculum and a 47-item skills checklist to test ventilator management for patients with normal, restricted, and obstructed lung physiology. A minimum passing standard (MPS) on the checklist was set using the Mastery Angoff method. Residents rotating through the medical intensive care unit in Academic Year 2017-2018 were assigned to SBML or traditional training based on their medical intensive care unit team. The SBML group was pretested on a ventilator simulator using the skills checklist. They then received a 1.5-hour session (45 min didactic and 45 min deliberate practice on the simulator with feedback). At rotation completion, they were posttested on the simulator using the checklist until the MPS was met. Both SBML-trained and traditionally trained groups received teaching during daily bedside rounds and twice weekly didactic lectures. At rotation completion, traditionally trained residents were tested using the same skills checklist on the simulator. We compared pretest and posttest performance among SBML-trained residents and end of the rotation test performances between the SBML-trained and traditionally trained residents. Results: The MPS was set at 87% on the checklist. Fifty-seven residents were assigned to the SBML-trained group and 49 were assigned to the traditionally trained group. Mean checklist scores for SBML-trained residents improved from 51.4% (standard deviation [SD] = 17.5%) at pretest to 86.1% (SD = 7.6%) at initial posttest and 92.5% (SD = 3.7%) at final (mastery) posttest (both P < 0.001). Forty-two percent of residents required more than one attempt at the posttest to meet or exceed the MPS. At rotation completion, the traditionally trained residents had a mean test score of 60.9% (SD = 13.3%). Conclusion: SBML is an effective strategy to train residents on mechanical ventilator management. An SBML curriculum may augment traditional training methods to further equip residents to safely manage ventilated patients.

Evaluation of 3 Cognitive Load Measures During Repeated Simulation Exercises for Novice Anesthesiology Residents

INTRODUCTION

Maintaining an appropriate level of cognitive load during simulations is crucial to optimize learning. We evaluated 3 subjective measures of cognitive load in a simulated operating room (OR) context across multiple scenarios of varying complexity.

METHODS

This observational study of 25 first-year anesthesiology residents took place during a 5-day simulation "Boot Camp." Each day, participants completed 2 different high-fidelity scenarios in a fully equipped simulated OR. After each simulation, participants completed 3 cognitive load measures: the Paas scale, NASA Task Load Index (TLX), and Cognitive Load Component (CLC) questionnaire. Two-way repeated-measures and mixed-design analyses of variance, with the cognitive load measures and scenarios as independent factors, were used to determine the effect of using different measures to report cognitive load.

RESULTS

Cognitive load scores reported by all measures correlated significantly with one another (P < 0.01): TLX and Paas (r = 0.65); Paas and CLC (r = 0.63); and TLX and CLC (r = 0.61). The CLC subscale scores (intrinsic, extraneous, germane) also correlated significantly with composite TLX and Paas scores (P < 0.01). Scenarios and measures displayed significant interaction: F(10, 210) = 3.01, P = 0.001. Participants reported highest overall cognitive load using the Paas scale.

CONCLUSIONS

All cognitive load measures were sensitive to scenario variability and showed similar fluctuation patterns across the 10 scenarios. The findings suggest that cognitive load measures can help create benchmarks based on learner perceptions of cognitive burden for different simulation scenarios.

Effects of a Simulation With Team-Based Learning on Knowledge, Team Performance, and Teamwork for Nursing Students

Simulation and team-based learning are reported as useful strategies in nursing education. However, empirical evidence on the effects of participating in an integrated course of team-based learning and simulation is limited. The aim of this study was to identify the effects of a nursing simulation program with team-based learning on knowledge, team performance, and teamwork among Korean nursing students. A one-group pretest-posttest design was used. Fourth-year students (N = 229) participated in a 32-hour nursing simulation program with team-based learning. Each of the three sessions of the program involved a 3-hour task training with video-assisted learning and skills performance assessment, 1-hour team-based learning, and 4-hour simulation session with a high-fidelity simulator. In addition to the knowledge test and performance assessment, participants completed a self-administered questionnaire on teamwork. Participants achieved higher scores in the Group Readiness Assurance Test than they did in the Individual Readiness Assurance Test. The posttest scores on team performance and teamwork were significantly higher than their pretest scores. The simulation with team-based learning induced favorable effects on participants' knowledge, performance, and teamwork. A curricular integration of simulation program with team-based learning is consistent with achieving outcomes-based learning in nursing education.

Learning process of ultrasound-guided Ilio-fascial compartment block on a simulator: a feasibility study

BACKGROUND

Ultrasound-guided fascia iliaca compartment block (US-FICB) is not part of the learning curriculum of the emergency physicians (EP) and is usually performed by anesthesiologists. However, several studies promote EP to use this procedure. The goal of this study was to assess the feasibility of a training concept for non-anesthesiologists for the US-FICB on a simulator based on a validating learning path.

METHOD

This was a feasibility study. Emergency physicians and medical students received a 1-day training with a learning phase (theoretical and practical skills), followed by an assessment phase. The primary outcome at the assessment phase was the number of attempts before successfully completing the procedure. The secondary outcomes were the success rate at first attempt, the length of procedure (LOP), and the stability of the probe, corresponding to the visualization of the needle tip (and its tracking) throughout the procedure, evaluated on a Likert scale.

RESULTS

A total of 25 participants were included. The median number of attempts was 2.0 for emergency physicians and 2.5 for medical students, and this difference was not significant (p = 0.140). Seven participants (28%) succeeded at the first attempt of the procedure; the difference between emergency physicians and medical students was not significant (37% versus 21%; p = 0.409). The average LOP was 19.7 min with a significant difference between emergency physicians and medical students (p = 0.001). There was no significant difference regarding the stability of the probe between the two groups.

CONCLUSION

Our 1-day training for non-anesthesiologists with or without previous skills in ultrasound seems to be feasible for learning the US-FICB procedure on a simulator.

The Use of in situ Simulation in Healthcare Education: Current Perspectives

In situ simulation is the practice of using simulated scenarios in a clinical environment itself rather than in training facilities to promote learning and improved clinical care. The use of in situ simulation has been increasingly used to train healthcare staff in dealing with emergencies, resuscitation and clinical skills. The aim of this study is to provide an overview of the themes, perspectives and approaches to in situ simulation for educational purposes with healthcare staff. The literature search included studies describing and evaluating in situ simulations with an educational component. We carried out a narrative synthesis and extracted data on the clinical setting, the simulation purpose, design, evaluation method and impact. In situ simulation has proved useful in a range of different specialties for skills improvement and team development. Simulation design ranges in terms of fidelity, duration and topic. No specific design has shown to be the most efficient. However, adopting a design that fits into the specific centers resources, educational needs and clinical demands is the most important consideration.

Research on simulation in radiography education: a scoping review protocol

BACKGROUND

Today, there are fewer opportunities for health care students and staff for skills training through direct patient contact. The World Health Organization therefore recommends learning about patient safety through hands-on experience and simulation. Simulation has the potential to improve skills through training in a controlled environment, and simulation has a positive effect on knowledge and skills, and even patient-related outcomes. Reviews addressing the use of simulation across the different radiography specialties are lacking. Further knowledge on simulation in radiography education is needed to inform curriculum design and future research. The purpose of this scoping review is to explore, map, and summarize the extent, range, and nature of published research on simulation in radiography education.

METHODS

We will follow the methodological framework for scoping reviews originally described by Arksey and O'Malley. We will search the MEDLINE, Embase, Epistemonikos, The Cochrane Library, ERIC, Scopus, and sources of grey literature. A comprehensive search strategy for Ovid MEDLINE was developed in collaboration with a research librarian. An example of a full electronic search from the Ovid MEDLINE (1641 articles records, January 9, 2020) is provided and will be used to adapt the search strategy to each database. Two independent review authors will screen all abstracts and titles, and full-text publications during a second stage. Next, they will extract data from each included study using a data extraction form informed by the aim of the study. A narrative account of all studies included will be presented. We will present a simple numerical analysis related to the extent, nature, and distribution of studies, and we will use content analysis to map the different simulation interventions and learning design elements reported. Any type of simulation intervention within all types of radiography specializations will be included. Our search strategy is not limited by language or date of publication.

DISCUSSION

An overview of publications on simulation in radiography education across all radiography specialties will help to inform future research and will be useful for stakeholders within radiography education using simulation, both in the academic and clinical settings.

SYSTEMATIC REVIEW REGISTRATION

Open Science Framework (OSF). Submitted on October 18, 2020.

Accuracy of Physicians' Electrocardiogram Interpretations: A Systematic Review and Meta-analysis

IMPORTANCE

The electrocardiogram (ECG) is the most common cardiovascular diagnostic test. Physicians' skill in ECG interpretation is incompletely understood.

OBJECTIVES

To identify and summarize published research on the accuracy of physicians' ECG interpretations.

DATA SOURCES

A search of PubMed/MEDLINE, Embase, Cochrane CENTRAL (Central Register of Controlled Trials), PsycINFO, CINAHL (Cumulative Index to Nursing and Allied Health), ERIC (Education Resources Information Center), and Web of Science was conducted for articles published from database inception to February 21, 2020.

STUDY SELECTION

Of 1138 articles initially identified, 78 studies that assessed the accuracy of physicians' or medical students' ECG interpretations in a test setting were selected.

DATA EXTRACTION AND SYNTHESIS

Data on study purpose, participants, assessment features, and outcomes were abstracted, and methodological quality was appraised with the Medical Education Research Study Quality Instrument. Results were pooled using random-effects meta-analysis.

MAIN OUTCOMES AND MEASURES

Accuracy of ECG interpretation.

RESULTS

Of 1138 studies initially identified, 78 assessed the accuracy of ECG interpretation. Across all training levels, the median accuracy was 54% (interquartile range [IQR], 40%-66%; n = 62 studies) on pretraining assessments and 67% (IQR, 55%-77%; n = 47 studies) on posttraining assessments. Accuracy varied widely across studies. The pooled accuracy for pretraining assessments was 42.0% (95% CI, 34.3%-49.6%; n = 24 studies; I2 = 99%) for medical students, 55.8% (95% CI, 48.1%-63.6%; n = 37 studies; I2 = 96%) for residents, 68.5% (95% CI, 57.6%-79.5%; n = 10 studies; I2 = 86%) for practicing physicians, and 74.9% (95% CI, 63.2%-86.7%; n = 8 studies; I2 = 22%) for cardiologists.

CONCLUSIONS AND RELEVANCE

Physicians at all training levels had deficiencies in ECG interpretation, even after educational interventions. Improved education across the practice continuum appears warranted. Wide variation in outcomes could reflect real differences in training or skill or differences in assessment design.

Implementing, embedding and sustaining simulation-based education: What helps, what hinders

OBJECTIVES

Although there is much evidence to support the use of simulation-based education (SBE) in undergraduate education of health care professionals, less attention has been paid to how SBE, viewed as a complex intervention, is implemented and becomes embedded and sustained. This paper aims to explore factors that inhibited or promoted SBE becoming normal practice in undergraduate health care professional programmes.

METHODS

Participants involved in the organisation, design and delivery of SBE in the north of England were recruited purposefully from higher education institutions (HEI) and National Health Service (NHS) Trusts through local networks for qualitative telephone interviews. Transcripts were analysed inductively using a hybrid approach involving simultaneous inductive open coding and deductive coding using normalisation process theory (NPT) as a theoretical lens.

FINDINGS

A total of 12 NHS staff from 11 trusts and seven individuals from four HEIs were interviewed. There was considerable variation in the approach taken to implementation across organisations, which resulted in varying degrees of embeddedness. Implementation was challenged or enabled by organisational leadership, professional buy-in and the development and maturity of the strategic approach. Variation in understanding of the scope and pedagogical aims of SBE led to inequity between professions and organisations in investment and participation, as well as design and delivery of SBE.

CONCLUSIONS

Given the complexity of SBE, best practice in implementation should be considered fundamental to the successful delivery of SBE. The findings provide an explanation of how contextual factors can support or hinder implementation to maximise potential benefits and learning outcomes; this understanding can be used to better inform development of SBE strategies and highlight potential factors needed to navigate contextual barriers so that learning outcomes can be maximised.

Sim for Life: Foundations-A Simulation Educator Training Course to Improve Debriefing Quality in a Low Resource Setting: A Pilot Study

INTRODUCTION

Despite the importance of debriefing, little is known about the effectiveness of training programs designed to teach debriefing skills. In this study, we evaluated the effectiveness of a faculty development program for new simulation educators at Mbarara University of Science and Technology in Uganda, Africa.

METHODS

Healthcare professionals were recruited to attend a 2-day simulation educator faculty development course (Sim for Life: Foundations), covering principles of scenario design, scenario execution, prebriefing, and debriefing. Debriefing strategies were contextualized to local culture and focused on debriefing structure, conversational strategies, and learner centeredness. A debriefing worksheet was used to support debriefing practice. Trained simulation educators taught simulation sessions for 12 months. Debriefings were videotaped before and after initial training and before and after 1-day refresher training at 12 months. The quality of debriefing was measured at each time point using the Objective Structured Assessment of Debriefing (OSAD) tool by trained, calibrated, and blinded raters.

RESULTS

A total of 13 participants were recruited to the study. The mean (95% confidence interval) OSAD scores pretraining, posttraining, and at 12 months before and after refresher were 18.2 (14.3-22.1), 26.7 (22.8-30.6), 25.5 (21.2-29.9), and 27.0 (22.4-31.6), respectively. There was a significant improvement from pretraining to posttraining (P < 0.001), with no significant decay from posttraining to 12 months (P = 0.54). There was no significant difference in OSAD scores pre- versus post-refresher training at 12 months (P = 0.49).

CONCLUSIONS

The Sim for Life Foundations program significantly improves debriefing skills with retention of debriefing skills at 12 months.

Learning to diagnose collaboratively: validating a simulation for medical students

Objectives: Physicians with different professional backgrounds often diagnose a patients' problem collaboratively. In this article, we first introduce a process model for collaborative diagnosing (CDR model), describe the development of a simulation used to empirically examine the facilitation of collaborative diagnostic reasoning. Based on a contemporary validity framework [1], we further suggest indicators for validity and collect initial evidence with respect to the scoring, generalization, extrapolation, and implication inferences to assess the validity of the simulation when used to assess effects of learning interventions. Method: In a quasi-experimental study, we assessed objectivity and reliability of the simulation and compared medical students with low and advanced prior knowledge to practitioners with high prior knowledge with respect to their diagnostic accuracy, diagnostic efficiency, information sharing skills, and their intrinsic cognitive load. Additionally, we obtained authenticity ratings from practitioners with high prior knowledge. Results: The results yielded satisfying initial evidence for the validity of the scoring and the extrapolation inferences as ratings are objective, and the simulation and the collaborative process is perceived as rather authentic. Additionally, participants on different levels of prior knowledge differ with respect to their diagnostic accuracy, diagnostic efficiency, information sharing skills, and their reported intrinsic cognitive load. With one exception (information sharing skills), the generalization inference seems to be valid as well. Conclusions: We conclude that collecting validity evidence for the simulation was an important step towards a better interpretation of the simulation. We found that the simulation is an authentic and valid representation of the chosen collaborative situation and that the collected validity evidence offers sufficient evidence for an initial validation of the simulation. Nevertheless, the validation process highlighted some important gaps that need further consideration. We further conclude that applying a validation model to the context of empirical research is promising and encourage other researchers to follow the example.

Evaluation of a 3-Dimensional-Printed Head Simulation Technique for Teaching Flexible Nasopharyngoscopy to Radiation Oncology Residents

Purpose

Simulation-based medical education is an effective tool for medical teaching, but simulation-based medical education deployment in radiation oncology (RO) is limited. Flexible nasopharyngoscopy (FNP), an essential skill for RO residents, requires practice that typically occurs on volunteer patients, introducing the potential for stress and discomfort. We sought to develop a high-fidelity simulator and intervention that provides RO residents the opportunity to develop FNP skills in a low-pressure environment.

Methods and Materials

Computed tomography images were used to create an anatomically accurate 3-dimensional–printed model of the head and neck region. An intervention incorporating didactic instruction, multimedia content, and FNP practice on the model was designed and administered to RO residents attending the Anatomy and Radiology Contouring Bootcamp. Participants completed pre- and postintervention evaluations of the training session and model fidelity, and self-assessments of FNP skill and confidence performing FNP. Participants were video recorded performing FNP pre- and postintervention. Videos were scored by a blinded observer on a predefined rubric. Changes in scores were evaluated using the Wilcoxon signed-rank test.

Results

Twenty-four participants from 17 institutions and 4 countries completed the intervention, 50% were women, and most were senior residents. Postintervention, FNP confidence and FNP performance improved significantly (mean ± standard deviation on a 10-point scale: 1.8 ± 1.8, P < .001; 2.2 ± 2.0, P < .001, respectively). Participants felt the model was helpful (mean ± standard deviation on a 5-point scale: 4.2 ± 0.6), anatomically correct (4.1 ± 0.9), and aided in spatial comprehension (4.3 ± 0.8). Overall satisfaction for the intervention was high (4.3 ± 0.8). Participants strongly agreed the intervention should be integrated into RO training programs (4.3 ± 0.8).

Conclusions

A 3-dimensional–printed model and associated intervention were effective at improving FNP performance and the teaching method was rated highly by participants. RO residents may benefit from broader dissemination of this technique to improve trainee performance.

The use of a stronger instructional design by implementing repetitive practice in simulation-based obstetric team training: trainees’ satisfaction

Objective

This study compares satisfaction levels from multiprofessional obstetric care teams about simulation-based obstetric team training courses with and without the instructional design feature repetitive practice.

Methods

The present study is part of a multicentre cluster-randomised controlled trial (TOSTI trial) that investigated the effectiveness of a 1 day, multiprofessional, simulation-based obstetric team training. The initial training group received a training which was designed based on best practice. After 1 year, the control group received a training course in which the instructional design was changed by providing repetitive practice. All participants were asked to fill in a 29-item evaluation form with seven questions about baseline characteristics and 22 questions about training features. The questions about training features could be rated on a scale of 1 to 5. Finally, all participants were asked to rate the total training day on a scale of 1–10.

Results

The best practice group consisted of 471 trainees and the repetitive practice group of 549, including gynaecologists, residents, midwives and nurses. The best practice group rated the total training day significantly higher than the repetitive practice group (mean 8.8, SD 0.6 and mean 8.7, SD 0.6; p<0.003, Cohen’s d=0.19). Several training features were also scored higher in the best practice group.

Conclusion

This study showed that obstetric healthcare professionals rated a simulation-based obstetric team training course, with and without repetition of scenarios, both high. The training without the repetitive elements gained higher scores for the total training dayand several, and several training features were scored higher. The difference between the mean scores and the effect sizes for the training features were small. This implies that repetitive practice can be integrated in simulation-based team training to optimise learning effects, with small effects on trainees satisfaction.

The influence of a serious game's narrative on students' attitudes and learning experiences regarding delirium: an interview study

BACKGROUND

Delirium is a neuropsychiatric syndrome that affects patients' attention and awareness as a result of a physical condition. In recent years, persistent gaps in delirium education have led to suboptimal delirium care. Still, little is known about what are the most important aspects of effective delirium education. Serious games are both entertainment and an interactive, safe learning environment where players can experiment and create new knowledge. They have the potential to contribute to improved delirium education. We used a video-based serious games' narrative to explore aspects essential to enhance students' attitudes and learning experiences regarding delirium.

METHODS

We created a semi-structured interview guide and interviewed seven nursing and nine medical students about their attitudes and learning experiences, after they had played the game. A qualitative descriptive design and inductive content analysis with constant comparison were used.

RESULTS

The patient's and nurse's perspective, interactivity to experiment, realistic views on care options, and feedback on care actions were important for enhancing students' attitudes and learning experiences regarding delirium. Students felt these aspects encouraged them to get actively involved in and experiment with the study material, which in turn led to enhanced reflection on delirium care and education. Our findings highlight the importance of a more patient-oriented focus to delirium education to drive attitudinal change. Students' learning experiences were further enhanced through their affective responses provoked by the perspectives, interactivity, realism, and feedback.

CONCLUSIONS

Students considered the characters' perspectives, interactivity, realism, and feedback important aspects of the game to enhance their attitudes towards delirious patients and enrich their learning experiences. A patient-oriented narrative provides a clinically relevant experience in which reflection plays an important role. The serious game also serves as medium to actively experiment with care solutions to create better understanding of how healthcare professionals can influence a delirious patient's experience.

Scoping Evidence Review on Training and Skills Assessment for Open Emergency Surgery

OBJECTIVE

Scope evidence on technical performance metrics for open emergency surgery. Identify surgical performance metrics and procedures used in trauma training courses.

DESIGN

Structured literature searches of electronic databases were conducted from January 2010 to December 2019 to identify systematic reviews of tools to measure surgical skills employed in vascular or trauma surgery evaluation and training.

SETTING AND PARTICIPANTS

Faculty of Shock Trauma Anesthesiology Research Center, University of Maryland School of Medicine, Uniformed Services University of Health Sciences, Bethesda, Maryland and Implementation Science, King's College, London.

RESULTS

The evidence from 21 systematic reviews including over 54,000 subjects enrolled into over 840 eligible studies, identified that the Objective Structured Assessment of Technical Skill was used for elective surgery not for emergency trauma and vascular control surgery procedures. The Individual Procedure Score (IPS), used to evaluate emergency trauma procedures performed before and after training, distinguished performance of residents from experts and practicing surgeons. IPS predicted surgeons who make critical errors and need remediation interventions. No metrics showed Kirkpatrick's Level 4 evidence of technical skills training benefit to emergency surgery outcomes.

CONCLUSIONS

Expert benchmarks, errors, complication rates, task completion time, task-specific checklists, global rating scales, Objective Structured Assessment of Technical Skills, and IPS were found to identify surgeons, at all levels of seniority, who are in need of remediation of technical skills for open surgical hemorrhage control. Large-scale, multicenter studies are needed to evaluate any benefit of trauma technical skills training on patient outcomes.

Simulation in psychiatry for medical doctors: A systematic review and meta-analysis

CONTEXT

Most medical doctors are likely to work with patients experiencing mental health conditions. However, educational opportunities for medical doctors to achieve professional development in the field of psychiatry are often limited. Simulation training in psychiatry may be a useful tool to foster this development.

OBJECTIVES

The purpose of this study was to assess the effectiveness of simulation training in psychiatry for medical students, postgraduate trainees and medical doctors.

METHODS

For this systematic review and meta-analysis, we searched eight electronic databases and trial registries up to 31 August 2018. We manually searched key journals and the reference lists of selected studies. We included randomised and non-randomised controlled studies and single group pre- and post-test studies. Our main outcomes were based on Kirkpatrick levels. We included data only from randomised controlled trials (RCTs) using random-effects models.

RESULTS

From 46 571 studies identified, we selected 163 studies and combined 27 RCTs. Interventions included simulation by role-play (n = 69), simulated patients (n = 72), virtual reality (n = 22), manikin (n = 5) and voice simulation (n = 2). Meta-analysis found significant differences at immediate post-tests for simulation compared with active and inactive control groups for attitudes (standardised mean difference [SMD] = 0.52, 95% confidence interval [CI] 0.31-0.73 [I²  = 0.0%] and SMD = 0.28, 95% CI 0.04-0.53 [I²  = 52.0%], respectively), skills (SMD = 1.37, 95% CI 0.56-2.18 [I²  = 93.0%] and SMD = 1.49, 95% CI 0.39-2.58 [I²  = 93.0%], respectively), knowledge (SMD = 1.22, 95% CI 0.57-1.88 [I²  = 0.0%] and SMD = 0.72, 95% CI 0.14-1.30 [I²  = 80.0%], respectively), and behaviours (SMD = 1.07, 95% CI 0.49-1.65 [I²  = 68.0%] and SMD = 0.45, 95% CI 0.11-0.79 [I²  = 41.0%], respectively). Significant differences in terms of patient benefit and doctors' behaviours and skills were found at the 3-month follow-up.

CONCLUSIONS

Despite heterogeneity in methods and simulation interventions, our findings demonstrate the effectiveness of simulation training in psychiatry training.

Student Acceptance of Using Augmented Reality Applications for Learning in Pharmacy: A Pilot Study

Creating engaging learning experiences that are easy to use and support the different learning requirements of university students is challenging. However, improvements in simulation technologies, such as augmented reality (AR) and virtual reality (VR), are making such changes possible. The aim of this study is to use a mobile-based AR technology to develop an interactive learning module about contraceptive devices and medicines and to measure its acceptability and usability by undergraduate pharmacy students. The learning module comprising AR images of contraceptive medicines, case studies relating to their use and a series of directed questions was completed by 33 pharmacy students. Students answered a survey to collect information about the usability and acceptability of AR for learning. The results show that the majority of students reported that AR is a useful resource for learning about medicines compared to more traditional methods, such as didactic lectures and tutorials. Students indicated that the AR application was easy to use and improved their knowledge of medicines. These findings suggest that AR technology is a useful tool to create engaging and easy to use learning experiences for university students.

Simulation-based training and assessment of mobile pre-hospital SARS-CoV-2 diagnostic teams in Styria, Austria

The World Health Organization has declared coronavirus disease 2019 (COVID-19) a pandemic. Polymerase chain reaction testing for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is the diagnostic gold standard of COVID-19. We have developed a simulation-based training program for mobile prehospital diagnostic teams in the province of Styria, Austria, and performed a prospective observational study on its applicability and effectivity.The 1-day curriculum uses theoretical instruction, technical skills training, and simulator-based algorithm training to teach and train prehospital patient identification and communication, donning the personal protective equipment, collection of naso-/oropharyngeal swabs for SARS-CoV-2 polymerase chain reaction testing, doffing the personal protective equipment, and sample logistics. Trainings were conducted at the SIM CAMPUS simulation hospital, Eisenerz, using high-fidelity patient simulation. To ensure achievement of predefined learning outcomes, participants had to undergo a final simulator-based objective structured clinical examination.In March 2020, 45 emergency medical assistants and 1 physician of the Austrian Red Cross participated on a voluntary basis. Forty-five of the 46 participants (97.8%) completed the curriculum successfully, with mean objective structured clinical examination ratings of 98.6%.Using several proven educational concepts, we have successfully drafted and implemented a training program for mobile prehospital SARS-CoV-2 diagnostic teams. Based on simulation-based objective structured examinations, it has prepared participants effectively for preclinical duties.

Development and Assessment of a Simulator for in Vivo Confocal Microscopy in Fungal and Acanthamoeba Keratitis

BACKGROUND AND PURPOSE

In vivo confocal microscopy (IVCM) is a non-invasive imaging technique that allows morphological analysis as a diagnostic approach of the cornea in real time, thus providing a suspected diagnosis of fungal or amoebic keratitis immediately, whereas culture or PCR require several days or even weeks. Since these infections are rare, it is difficult for ophthalmologists to gain the experience necessary to differentiate infection from normal findings or artefacts. The purpose of this project was to establish a simulator, on which physicians could practice as well as acquiring a database of IVCM images of fungal or amoebic keratitis and respective analyses.

PATIENTS AND METHODS

An IVCM simulator was set up with cadaver human corneas, infected with either acanthamoeba, candida or aspergillus. Twenty-one ophthalmologists were trained in IVC microscopy first in a Dry Lab, then practically on the simulator. For evaluation, the participants were asked to fill out a standardized questionnaire, with a pre- and post-course self-assessment.

RESULTS

The self-assessed theoretical and practical skills in differentiating infectious from non-infectious keratitis in IVCM significantly increased (p = 0.0001, p = 0.0002, respectively). The barrier to use this technique decreased (p = 0.0474).

CONCLUSION

A very simple protocol based on a model of ex vivo corneal mycotic and amoebic infections can be used to train novices in the structured approach and diagnostic use of IVCM for corneal infections.

Emerging Theories Influencing the Teaching of Clinical Nursing Skills

BACKGROUND

Recognition is increasing that many psychomotor skills essential for safe nursing practice are not being retained. New theories and methods are emerging that, when applied in an organized pedagogical model, could influence initial learning and the retention of critical psychomotor skills.

METHOD

This article explains and applies emerging educational theories and concepts relevant to skills teaching in nursing.

RESULTS

Theories and concepts on cognitive load, deliberate practice, mastery learning, overlearning, spaced learning, and skill decay are integrated to provide a framework for teaching skills in nursing. An example is included of using this framework for skills instruction and practice.

CONCLUSION

This framework may improve the nurse educator's ability to prepare learners to perform skills safely in both the skills laboratory and patient care settings and to retain skills. [J Contin Educ Nurs. 2019;50(6):257-262.].

High-fidelity simulation-based education in pre-registration healthcare programmes: a systematic review of reviews to inform collaborative and interprofessional best practice

Simulation-based education (SBE) is recognized as an effective interprofessional teaching and learning method. Whilst there is a large volume of research evidence concerning elements of SBE there is a lack of clarity concerning foundational principles of best practice. This is important for educators wishing to utilize high-quality SBE to deliver interprofessional education. The aim of this review is to synthesize review evidence of SBE best practice in a broad range of pre-registration healthcare programs and contextualize findings in light of relevant educational theory. A systematic search of PubMed, Scopus, Medline/Ovid, British Nursing Index, and the Cochrane Library databases was undertaken in February 2020. Data extraction and quality evaluation were undertaken by two authors. Fifteen reviews were included. In addition to identifying barriers and enablers to implementation, three interdependent themes regarding SBE best practice were found: curriculum level integration and planning (curriculum level integration, the opportunity for deliberate repeated practice, distribution, and sequencing); simulation design and delivery (clearly defined learning outcomes and benchmarks, pre-brief, multiple learning strategies, interactivity and individualized learning, feedback, and debrief); and resources (facilitator competency, controlled environments). These themes broadly align with the social constructivist theory of experiential learning whereby structured opportunities to learn via concrete experience, reflective observation, abstract conceptualization, and active experimentation are provided through effective planning, design, and delivery of SBE. Interdependencies suggest that integration of SBE at curriculum-level enables planning and implementation of best practice principles which are associated with effective learning, which also inform and facilitate the availability of adequate simulation resources.

Lessons learned in preparing for and responding to the early stages of the COVID-19 pandemic: one simulation's program experience adapting to the new normal

Use of simulation to ensure an organization is ready for significant events, like COVID-19 pandemic, has shifted from a "backburner" training tool to a "first choice" strategy for ensuring individual, team, and system readiness. In this report, we summarize our simulation program's response during the COVID-19 pandemic, including the associated challenges and lessons learned. We also reflect on anticipated changes within our program as we adapt to a "new normal" following this pandemic. We intend for this report to function as a guide for other simulation programs to consult as this COVID-19 crisis continues to unfold, and during future challenges within global healthcare systems. We argue that this pandemic has cemented simulation programs as fundamental for any healthcare organization interested in ensuring its workforce can adapt in times of crisis. With the right team and set of partners, we believe that sustained investments in a simulation program will amplify into immeasurable impacts across a healthcare system.

Design and validation of a low-cost, high-fidelity model for robotic pyeloplasty simulation training

INTRODUCTION/BACKGROUND

Owing to restrictions in operative experiences, urology residents can no longer solely rely on 'hands-on' operative time to master their surgical skills by the end of residency. Simulation training could help residents master basic surgical skills and steps of a procedure to maximize time in the operative room. However, simulators can be expensive or tedious to set up, limiting the availability to residents and training programs.

OBJECTIVE

The authors sought to develop and validate an inexpensive, high-fidelity training model for robotic pyeloplasty.

STUDY DESIGN

Pyeloplasty models were created using Dragon Skin® FX-Pro tissue-mimicking silicone cast over 3-dimensional molds. Urology faculty and trainees completed a demographic questionnaire. The participants viewed a brief instructional video and then independently performed robotic dismembered pyeloplasty on the model. Acceptability and content validity were evaluated via post-task evaluation of the model. Construct validity was evaluated by comparing procedure completion time, the Global Evaluative Assessment of Robotic Skills (GEARS) score, blinded subjective physical evaluation of repair quality (1-10 scale), and flow rate between experts and novices.

RESULTS

In total, 5 urology faculty, 6 fellows, and 14 residents participated. The median robotic console experience among faculty, fellows, and residents was 8 years (interquartile range [IQR] = 6-11), 3.5 years (IQR = 2-4 years), and 0 years (IQR = 0-0.5 years), respectively. The median procedure completion time was 29 min (IQR = 26-40 min), and the median flow rate was 1.11 mL/s (IQR = 0-1.34 mL/s). All faculty had flow rates >1.25 mL/s and procedure times <30 min compared with 2 of 6 fellows and none of the residents (P < 0.001). All faculty, half of the fellows, and none of the residents achieved a GEARS score ≥20, with a median resident score of 12.5 (IQR = 8-13) (P < 0.001). For repair quality, all faculty scored ≥9 (out of 10), all fellows scored ≥8, and the median score among residents was 6 (IQR = 2-6) (P < 0.001). The material cost was $1.32/model, and the average production time was 0.12 person-hours/model.

DISCUSSION AND CONCLUSION

This low-cost pyeloplasty model exhibits acceptability and content validity. Construct validity is supported by significant correlation between participant expertise and simulator performance across multiple assessment domains. The model has excellent potential to be used as a training tool in urology and allows for repetitive practice of pyeloplasty skills before live cases.

Aha! Taking on the myth that simulation-derived surprise enhances learning

OBJECTIVES

This paper aims to discuss the recurring education-related issue of the high-fidelity simulation myth. In the current instantiation, educators erroneously believe that trainees benefit from authentic uncertainty and surprise in simulation-based training.

METHODS

We explore the origins of this myth within the experiential learning and social constructivism theories and propose an evidence-based solution of transparent and guided instruction in simulation.

RESULTS

Constructivist theories highlight meaning making as the benefit of inquiry and discovery learning strategies. Inappropriate translation of this epistemology into an element of curriculum design creates unfortunate unintended consequences.

CONCLUSIONS

We propose that the translation of constructivist theories of learning within simulation-based education has resulted in a pervasive myth, which decrees that scenarios must introduce realistic tension or surprises to encourage exploration and insightful problem solving. We argue that this myth is masquerading as experiential learning. In this narrative review, we interpret our experiences and observations of simulation-based education through our expertise in education science and curriculum design. We offer anecdotal evidence along with a review of selected literature to establish the presence of this previously undetected myth.

Simulation-based training of vaginal twin delivery for experienced gynaecologists: Useful or not?

OBJECTIVE

It is important to train clinicians to maintain and optimise maternal and neonatal outcomes after vaginal twin delivery. Simulation-based training provides opportunities for training in a realistic way without harming patients. The aim of this study is to evaluate the effect of simulation-based training concerning twin vaginal delivery on knowledge and comfort of obstetrician-gynaecologists.

STUDY DESIGN

Obstetrician-gynaecologists participated in a twin vaginal delivery simulation between March 2018 and May 2019. Simulation-based training consisted of standardized patient interviews, didactic sessions and three different simulation-based scenarios: internal podalic version and breech extraction, assisted vaginal delivery and vaginal breech delivery with problems of aftercoming head. Pre- and posttraining, participants were asked to fill out questionnaires exploring knowledge concerning vertex-vertex twin deliveries and vertex-nonvertex twin deliveries, level of comfort performing various obstetric manoeuvres and counselling on mode of delivery for women pregnant with twins. Our primary outcome of interest was a change in knowledge or comfort surrounding vaginal twin delivery after completion of the simulation-based training.

RESULTS

The estimated median number of vaginal twin deliveries performed by the participating thirty-four obstetrician-gynaecologists was 50 (IQR 20-100). Significant improvements were seen in knowledge regarding twin deliveries with vertex-nonvertex presentation (p < 0.01). In two of three questions regarding twin delivery with vertex-vertex presentation significant improvements were seen as well (p < 0.01). Before training, 40.6% of participants felt comfortable to perform internal podalic version compared to 91.2% afterwards (p < 0.01). Comfort with breech extraction increased from 69.7% to 97.1% pre- and posttraining, respectively (p < 0.01). Before training only 55.9% would strongly counsel patients towards vaginal twin delivery as opposed to 73.5% after training (p = 0.07).

CONCLUSIONS

Simulation-based training results in beneficial effects on knowledge and comfort concerning vaginal twin deliveries for obstetrician-gynaecologists. This training suggested a potential impact on provider practice with a more favourable attitude towards twin vaginal birth.

Comparing Training Techniques in Personal Protective Equipment Use

INTRODUCTION

Physicians' management of hazardous material (HAZMAT) incidents requires personal protective equipment (PPE) utilization to ensure the safety of victims, facilities, and providers; therefore, providing effective and accessible training in its use is crucial. While an emphasis has been placed on the importance of PPE, there is debate about the most effective training methods. Circumstances may not allow for a traditional in-person demonstration; an accessible video training may provide a useful alternative.

HYPOTHESIS

Video training of Emergency Medicine (EM) residents in the donning and doffing of Level C PPE is more effective than in-person training.

NULL HYPOTHESIS

Video training of EM residents in the donning and doffing of Level C PPE is equally effective compared with in-person training.

METHODS

A randomized, controlled pilot trial was performed with 20 EM residents as part of their annual Emergency Preparedness training. Residents were divided into four groups, with Group 1 and Group 2 viewing a demonstration video developed by the Emergency Preparedness Team (EPT) and Group 3 and Group 4 receiving the standard in-person demonstration training by an EPT member. The groups then separately performed a donning and doffing simulation while blinded evaluators assessed critical tasks utilizing a prepared evaluation tool. At the drill's conclusion, all participants also completed a self-evaluation survey about their subjective interpretations of their respective trainings.

RESULTS

Both video and in-person training modalities showed significant overall improvement in participants' confidence in doffing and donning PPE equipment (P <.05). However, no statistically significant difference was found in the number of failed critical tasks in donning or doffing between the training modalities (P >.05). Based on these results, the null hypothesis cannot be rejected. However, these results were limited by the small sample size and the study was not sufficiently powered to show a difference between training modalities.

CONCLUSION

In this pilot study, video and in-person training were equally effective in training for donning and doffing Level C PPE, with similar error rates in both modalities. Further research into this subject with an appropriately powered study is warranted to determine whether this equivalence persists using a larger sample size.

A Survey Assessing Pediatric Transport Team Composition and Training

OBJECTIVE

The aim of this study was to assess national pediatric/neonatal specialty transport teams' composition and training requirements to determine if any current standardization exists.

METHODS

This was a survey of the transport teams listed with the American Academy of Pediatrics via SurveyMonkey.

RESULTS

While most of the teams maintain internal criteria for team competency and training, there is large variation across team compositions. The vast majority of the teams have a nurse-led team with the addition of another nurse, medic, and/or respiratory therapist regardless of mode of transport. Many of the teams report adjusting team composition based on acuity. Fewer than 15% of teams have a physician as a standard team member. More than 80% required a minimum number of supervised intubations prior to independent practice; however, the number varied largely from as little as 3 to as many as 30. Eighty-eight percent of the teams report using simulation as part of their education program, but again there were marked differences between teams as to how it was used.

CONCLUSIONS

There is tremendous variability nationally among pediatric/neonatal transport teams regarding training requirements, certifications, and team composition. The lack of standardization regarding team member qualifications or maintenance of competency among specialized transport teams should be looked at more closely, and evidence-based guidelines may help lead to further improved outcomes in the care of critically ill pediatric patients in the prehospital setting.

The use of simulation to prepare and improve responses to infectious disease outbreaks like COVID-19: practical tips and resources from Norway, Denmark, and the UK

In this paper, we describe the potential of simulation to improve hospital responses to the COVID-19 crisis. We provide tools which can be used to analyse the current needs of the situation, explain how simulation can help to improve responses to the crisis, what the key issues are with integrating simulation into organisations, and what to focus on when conducting simulations. We provide an overview of helpful resources and a collection of scenarios and support for centre-based and in situ simulations.

A Nationwide Needs Assessment to Identify and Prioritize Technical Procedures for Simulation in Obstetrics and Gynaecology: A Delphi Study

OBJECTIVE

The aims of the study were to identify and prioritize technical procedures that should be developed and integrated in a simulation-based curriculum for obstetrics and gynaecology residents.

METHODS

The Delphi method was used, consisting of three rounds of survey questionnaires. Key leaders across Denmark were invited to participate. In Delphi round 1, the participants individually identified technical procedures that newly authorized specialists should be able to perform. These procedures were sent to round 2 to be explored for need for simulation-based training by estimating frequency of procedures, number of doctors, potential patient risk and/or discomfort, and feasibility of simulation. Round 3 consisted of elimination and prioritization of remaining procedures (Canadian Task Force Classification III).

RESULTS

A total of 165 key leaders were invited. Response rates were 61%, 50%, and 53%, respectively. Identified procedures in Round 1 were as follows: gynaecology (n = 51), obstetrics (n = 40), and general procedures (n = 10). A needs assessment formula was used to calculate needs for training on the basis of the answers in round 2 and produce a preliminary prioritized list that was sent to round 3 for final exploration. Round 3 consisted of elimination and final prioritization, where gynaecology (n = 17) prioritized basic laparoscopy, vaginal ultrasound, and laparoscopy with salpingostomy and salpingectomy; obstetrics procedures (n = 16) prioritized basic resuscitation of newborn, vacuum extraction, and management of shoulder dystocia; and one general procedure (basic adult resuscitation) was included.

CONCLUSION

A needs assessment using the Delphi method produced a prioritized list of technical procedures suitable for simulation. This can guide the development of simulation-based training programs.

DebriefLive: A Pilot Study of a Virtual Faculty Development Tool for Debriefing

INTRODUCTION

The quality of healthcare simulation learning relies heavily on effective debriefers. Traditional methods of faculty development in debriefing lack a structured approach to achieve expertise via graduated and reflective practice.

METHODS

The Simulation Learning, Education and Research Network (SimLEARN) developed DebriefLive, a virtual teaching environment, bringing together faculty and participant debriefers from across the Veterans Health Administration. Recorded simulation sessions were viewed followed by the opportunity for participant debriefers to debrief virtual learners. Participant debriefers were then provided structured and objective debriefings of the debriefings with the added opportunity for immediate practice. Program evaluation data for the pilot sessions were collected via electronic survey including a mix of Likert scale questions as well as short answer responses.

RESULTS

On a 7-point Likert scale, participant debriefers (n = 15) rated the content as effective (mean = 6.67, SD = 0.47) and appropriate to their level (mean = 6.47, SD = 0.47). The technology of video-based scenarios (mean = 6.6, SD = 0.61), followed by avatar-based debriefing sessions (mean = 6.6, SD = 0.8), was felt to be accurate and appropriate. All participants would agree or strongly agree with recommending this training program to colleagues.

CONCLUSIONS

Simulation instructors and fellows across the spectrum of the Veterans Health Administration found the innovative computer-based faculty development program DebriefLive acceptable as well as effective in increasing self-efficacy in debriefing. DebriefLive is an innovative and potentially disruptive tool, combining best practices in simulation theory and virtual technologies, for the training and assessment of debriefers.

Focused cardiac ultrasound training in medical students: Using an independent, simulator-based curriculum to objectively measure skill acquisition and learning curve

BACKGROUND

Using simulators built and validated at the University of Washington (UW), the study sought to test whether medical students can learn the basic skills of focused cardiac ultrasound (FoCUS) from an individually paced, simulator-based curriculum, how skills improve, and the rate at which these skills are acquired.

METHODS

The curriculum presented didactic material interspersed with hands-on practice. Psychomotor skill was measured by the angle error of the acquired image view plane relative to the correct image view plane. The rate of learning was assessed at baseline, after 7 practice cases, and after 10 cases. To assess the rate of learning, the same case was repeatedly presented at all three tests. To assess students' ability to apply their learning, a previously unseen post-test was included.

RESULTS

A total of 41 students completed the course. Average angle error improved from 43° ± 24 pretraining to 23° ± 16 post-training, with most students falling within one SD of the view angle acquired by sonographers. Regarding learning curve, or the rate of skill acquisition, an angle error of 43 ± 24° (pre) changed to 22 ± 14° (interim test, P < .0001 vs. pretest) and remained at that level for the post-test evaluation on both the repeated case (23 ± 16°) and the new case (26 ± 18°).

CONCLUSIONS

This study describes the learning curve and technical skill acquisition in FoCUS. A simulator-based curriculum improved medical student's skills in an objective and quantifiable manner. The individually paced curriculum allowed for independent knowledge and skill attainment, without facilitator oversight.

Managing the tension: From innovation to application in health professions education

Innovations in education are essential for solving problems and introducing new ways of thinking. However, implementation of these innovations must take several factors into consideration, including the context, the environment, the stakeholders, the technology needed, the cost, the pace of implementation, appropriateness, and available resources. When these factors are not balanced and considered, tensions arise. This paper describes tensions in five major educational domains, namely curriculum, instruction, assessment, accreditation/regulation, and faculty development. For each of these domains, the typical problems are described, and solutions are presented to manage the tension.

Assembly Line Education: A Novel Educational Technique for Today's Learners

Background

Education is undergoing a transformation. The traditional passive lectures are failing to capture and inspire the new generation of learners who value more active and collaborative learning techniques.

Objective

We sought to create a novel educational technique to integrate into our curriculum that would be more personalized, employ more active learning and collaboration, and allow for an effective assessment of resident strengths and weaknesses.

Discussion

We created a monthly assembly line education academic half-day that evolved to replace one of the typical in-classroom didactics each month. Faculty run small-group simulation rooms, procedure workshops, competitive ultrasound, and wellness stations through which residents and medical students rotate.

Conclusion

This novel education technique resulted in a more personalized approach that increased resident interest, sparked the creation of a very popular MedEd-Simulation elective, and allowed the faculty to gain a better sense of resident strengths and deficiencies.