Issues of cost-benefit and cost-effectiveness for simulation in health professions education

High-fidelity simulation versus case-based tutorial sessions for teaching pharmacology: Convergent mixed methods research investigating undergraduate medical students' performance and perception

INTRODUCTION

Medical educators strive to improve their curricula to enhance the student learning experience. The use of high-fidelity simulation within basic and clinical medical science subjects has been one of these initiatives. However, there is paucity of evidence on using simulation for teaching pharmacology, especially in the Middle East and North Africa region, and the effectiveness of this teaching modality, relative to more traditional ones, have not been sufficiently investigated. Accordingly, this study compares the effects of high-fidelity simulation, which is designed in alignment with adult and experiential learning theories, and traditional case-based tutorial sessions on the performance and perception of undergraduate Year 2 medical students in pharmacology in Dubai, United Arab Emirates.

METHODS

This study employed a convergent mixed methods approach. Forty-nine medical students were randomly assigned to one of two groups during the 16-week pharmacology course. Each group underwent one session delivered via high-fidelity simulation and another via a case-based tutorial. A short multiple-choice question quiz was administered twice (immediately upon completion of the respective sessions and 5 weeks afterwards) to assess knowledge retention. Furthermore, to explore the students' perceptions regarding the two modes of learning delivery (independently and in relation to each other), an evaluation survey was administered following the delivery of each session. Thereafter, the iterative joint display analysis was used to develop a holistic understanding of the effect of high-fidelity simulation in comparison to traditional case-based tutorial sessions on pharmacology learning in the context of the study.

RESULTS

There was no statistically significant difference in students' knowledge retention between high-fidelity simulation and case-based tutorial sessions. Yet, students expressed a greater preference for high-fidelity simulation, describing the corresponding sessions as more varied, better at reinforcing learning, and closer to reality. As such, the meta-inferences led to expansion of the overall understanding around students' satisfaction, to both confirmation and expansion of the systemic viewpoint around students' preferences, and lastly to refinement in relation to the perspective around retained knowledge.

CONCLUSION

High-fidelity simulation was found to be as effective as case-based tutorial sessions in terms of students' retention of knowledge. Nonetheless, students demonstrated a greater preference for high-fidelity simulation. The study advocates caution in adapting high-fidelity simulation, where careful appraisal can lend itself to identifying contexts where it is most effective.

Pilot Evaluation of Silicone Surrogates for Oral Mucosa Simulation in Craniofacial Surgical Training

Surgical simulators are crucial in early craniofacial and plastic surgical training, necessitating synthetic materials that accurately replicate tissue properties. Recent critiques of our lab's currently deployed silicone surrogate have highlighted numerous areas for improvement. To further refine our models, our group's objective is to find a composition of materials that is closest in fidelity to native oral mucosa during surgical rehearsal by expert craniofacial surgeons. Fifteen platinum silicone-based surrogate samples were constructed with variable hardness and slacker percentages. These samples underwent evaluation of tactile sensation, hardness, needle puncture, cut resistance, suture retention, defect repair, and tensile elasticity. Expert craniofacial surgeon evaluators provided focused qualitative feedback on selected top-performing samples for further assessment and statistical comparisons. An evaluation revealed surrogate characteristics that were satisfactory and exhibited good performance. Sample 977 exhibited the highest performance, and comparison with the original surrogate (sample 810) demonstrated significant improvements in critical areas, emphasizing the efficacy of the refined composition. The study identified a silicone composition that directly addresses the feedback received by our team's original silicone surrogate. The study underscores the delicate balance between biofidelity and practicality in surgical simulation. The need for ongoing refinement in surrogate materials is evident to optimize training experiences for early surgical learners.

An update on simulation training in rhinology: a systematic review of evidence

BACKGROUND

Rhinological procedures demand a high degree of technical expertise and anatomical knowledge. Because of limited surgical opportunities, ethical considerations and the complexity of these procedures, simulation-based training has become increasingly important. This review aimed to evaluate the effectiveness of simulation models used in rhinology training.

METHODS

Searches were conducted on PubMed, Embase, Cochrane and Google Scholar for studies conducted between July 2012 and July 2022. The Preferred Reporting Items for Systematic Reviews and Meta-Analysis ('PRISMA') protocol defined a final list of articles. Each validated study was assigned a level of evidence and a level of recommendation based on the Oxford Centre of Evidence-Based Medicine classification.

RESULTS

Following exclusions, 42 articles were identified which encompassed six types of simulation models and 26 studies evaluated validity. The rhinological skills assessed included endoscopic sinus surgery (n = 28), skull base/cerebrospinal fluid leak repair (n = 14), management of epistaxis and/or sphenopalatine artery ligation (n = 8), and septoplasty and septorhinoplasty (n = 6). All studies reported the beneficial impact of their simulation models on trainee development.

CONCLUSION

Simulation training in rhinology is a valuable adjunct to traditional surgical education. Although evidence is of moderate quality, the findings highlight the importance of simulation-based training in rhinology training.

Analysis of cybersickness in virtual nursing simulation: a German longitudinal study

BACKGROUND

Innovative educational approaches such as simulation-based nursing education using virtual reality (VR) technologies provide new opportunities for nursing education. However, there is a lack of information on side effects, especially health-related side effects, of head-mounted displays (HMDs) on the human body when using VR devices for nursing simulation. This study aims to validate the German version of the Virtual Reality Sickness Questionnaire (VRSQ) and to evaluate its associations with sex and age, as reflected in the VRSQG scores (total score, oculomotor, and disorientation) over time.

METHODS

A longitudinal-sectional study was conducted. In addition to the VRSQG (pre-, post-, and 20 min post-intervention), participants (all nursing students) completed data on personal characteristics. Participants completed a VR simulation of a blood draw. Confirmatory factor analysis (CFA) was used to evaluate whether the measured construct was consistent with the original. In addition to the validity, internal consistency was analyzed and generalized linear models (GLMs) were used for data analysis.

RESULTS

A total of 38 nursing students (mean age 26.8 years; SD = 7.1, 79.0% female) participated. The mean time spent in the VR simulation was 21 min. All participants completed the entire simulation. The CFA indicates (CFI = 0.981, SRMR = 0.040) VRSQG structure is given. Internal consistency showed low values for the subdomain Oculomotor (Cronbach alpha 0.670). For Disorientation and the Total score values showed a sufficient internal consistency. GLMs showed significant between subject associations with age over time with VRSQG total score, oculomotor, and disorientation. Older nursing students start with higher VRSQG-Scores. Over time, an approximation occurs, so that all participants reach a similar level by the final measurement point. No associations were found between sex (male/female) and VRSQG scores.

CONCLUSIONS

The VRSQG is a reliable and valid self-assessment for measuring cybersickness in VR based nursing simulations, with cybersickness symptoms positively associated with age. However, in depth-evaluation regarding age-associations with cybersickness should be done. As well as studies to explore additional associations and emphasizes the importance of establishing cut-off values to assess the clinical relevance of the scores.

Unleashing excellence: using a project management approach to effectively implement a simulation curriculum to improve residents' preparedness

BACKGROUND

Integrating innovative, simulation-based training programs into medical curricula frequently encounters familiar challenges, including scepticism, limited faculty time, and financial constraints. Recognized for its success in business projects, the Harvard Project Management Theory emerges as a promising approach to optimizing the implementation process and achieving sustainable success. This study endeavours to elucidate the application of project management theory in our implementation process and assess its impact on the clinical preparedness of novice residents.

METHODS

The research utilized a structured four-phase implementation strategy-Planning, Build-up, Execution, and Closing-to develop a simulation-based education curriculum. Incorporating project management tools like project charters and risk management tools played a crucial role in facilitating the effective implementation of standardized processes and improved clinical outcomes. Essential components of this innovative management approach encompass stakeholder engagement, milestone definition, and the alignment of institutional policies and processes.

RESULTS

A collective of 395 residents actively engaged in eight monthly simulation-based events, reflecting an average participation rate of 39 residents per lecture (± 19). A noteworthy enhancement was observed in the average rating for knowledge gain, with a significant improvement from 5.9/10 to 8.8/10 (p = 0.0001). Participants highlighted the program's considerable impact on future clinical practice (4.7/5) and teamwork (4.8/5) as particularly valuable aspects. The introduction of a novel organizational structure received favourable feedback from faculty members, with a notable rating of 4.8/5 for predictive time planning. Qualitative insights from the evaluation highlighted the significance of targeted incentive schemes in optimizing the implementation process.

CONCLUSION

This project underscores the constructive influence of project management principles in designing simulation-based curricula, explicitly focusing on stakeholder engagement, faculty motivation, and data utilization. Adopting the Harvard Project Management Approach emerges as a catalyst for heightened success in curriculum design, contributing to enhanced emergency preparedness among novice residents. The positive outcomes observed in this study provide valuable insights for future implementations, offering a foundation for refining and optimizing medical education programs to meet the evolving needs of learners and stakeholders alike.

Efficacy of 3D-printed eye model to enhance retinoscopy skills

We conducted a prospective study to evaluate the efficacy of simulation-based education using a three-dimensional (3D)-printed schematic eye model in improving the retinoscopy refraction skills of medical students. A schematic eye model was printed using a fused deposition modeling-based 3D printer. Twenty medical students randomized into 3D (n = 10) and control (n = 10) groups received a 1-h lecture on the principles and methods of manifest refraction and were shown how to use the retinoscope and sciascope bars. The 3D group additionally attended a tutorial on the schematic eye. Both groups performed refractive examinations on four eyes of volunteer patients, and the results were recorded as a baseline. Instructor feedback and refraction practice was provided with the 3D group or with control group. To account for subject fatigue, patients spent no more than 8 min on the examination. After a 1-h break to allow for fatigue and familiarity, refraction tests were repeated on four randomly selected eyes of patients. Students' refraction readings were compared with the autorefractor values using a spherical equivalent value and blur strength. All participants measured the time required to complete the refraction test and reported their subjective confidence in the results of each refraction test. Refractive errors before and after training did not differ between the control and 3D groups, with a significant improvement in errors observed in both groups (p = 0.005 and 0.008, respectively). The time to complete refraction before and after training did not differ between the two groups, both of which showed a significant reduction in time (p = 0.005 and 0.028, respectively). Pre- and post-training confidence scores for the accuracy of each refraction on a 10-point Likert scale were not significantly different. However, when comparing score changes between pre- and post-training, only the control group showed a significant increase in confidence (p = 0.005). Tests for the non-inferiority of refractive errors after training indicated that the 3D group was non-inferior to the control group. In conclusion, training in retinoscopy refraction skills using a 3D-printed eye model resulted in significant improvement in accuracy and speed compared to practice with real patients. Except for better confidence in the control group, schematic eye model training was not inferior to practice with real patients.

Establishment of a simulation centre: Challenges and solutions

The change in curriculum and increasing need for active healthcare professionals providing quality patient care has emphasised simulation-based regular training, reskilling and simulation centres to deliver these. However, there is limited literature on how to establish a simulation centre and overcome the challenges relating to developing faculty and maintaining the financial viability of these centres. Our review focuses on this gap in the current literature. The findings are presented as 1) identification of the methods of establishing a simulation centre, 2) setting up the resource in a simulation centre and 3) faculty development and curricular integration in a simulation centre. The space of a simulation centre depends on the organisation's or training body's needs. There is no single design which is recommended. Establishing a simulation centre should consider the needs of the organisation, educators and learners along with the available resources and ensure that curriculum integration and standards are met.

Virtual reality simulation for nursing education: effectiveness and feasibility

Virtual Reality simulation (VRS) is an innovative and emerging technology that has the potential to offer increased numbers of pre-registration students authentic learning experiences compared to traditional simulation- based education (SBE) with simulated participants. The aim was to evaluate learner outcomes of SBE compared to 4 fully immersive VRS scenarios, for vocational and higher education nursing students at a training and further education institute in Melbourne, Australia. A mixed methods quasi-experimental design study was conducted over two semesters from 2019 to 2020. Participants were 675 pre-registration nursing students. The intervention group (VRS n = 393) received 4 three-dimensional, immersive VRS modules. The control group (SBE n = 282) received 4 face-to-face large group immersive simulations. In the VRS group 95% of students actively participated, compared to SBE (on average 15%). Knowledge test scores were initially significantly greater (p < 0.01) for VRS versus SBE students, but not maintained post clinical placement. Intervention students found VRS to be realistic and prepared them for clinical practice. Some technical difficulties were identified with VRS. VRS was found to be more cost effective than SBE. VRS fostered critical thinking and provided an efficient and sustainable platform for learning about complex clinical situations.

Contaminated Airway Task Training: How to Adapt an Existing Airway Manikin Head for Active Airway Soiling

The massively contaminated airway is an important and often daunting entity for airway providers. Although massively contaminated airways are considered high acuity, low-occurrence presentations in emergency medicine and pre-hospital settings, formal training in the management of contaminated airways is heterogeneous and infrequent. To facilitate training and augment simulation, an airway task trainer is critical. To our knowledge, this is the first readily accessible, peer-reviewed, detailed technical report to build a low-cost, high-fidelity, contaminated airway task trainer. This trainer can be seamlessly integrated into simulated resuscitation scenarios and/or airway training workshops, reinforcing skill acquisition and retention for the management of the massively contaminated airway.

Virtual reality in simulation-based emergency skills training: A systematic review with a narrative synthesis

Objective

An important role is predicted for virtual reality (VR) in the future of medical education. We performed a systematic review of the literature with a narrative synthesis, to examine the current evidence for VR in simulation-based emergency skills training. We broadly define emergency skills as any clinical skill used in the emergency care of patients across all clinical settings.

Methods

This systematic review followed the Preferred Reporting Items for Systematic Reviews and Meta Analyses (PRISMA) guidelines. The data sources accessed during this study included: PubMed, CINAHL, EMBASE, AMED, EMCARE, HMIC, BNI, PsychINFO, Medline, CENTRAL, SCOPUS, Web of Science, BIOSIS Citation Index, ERIC, ACM Digital Library, IEEE Xplore, and ProQuest Dissertations and Thesis Global. Cochrane's Rob 2 and ROBVIS tools were used during study quality assessment. No ethical review was required for this work.

Results

Thirty-four articles published between 14th March 1998 and 1st March 2022 were included in this review. Studies were predominantly conducted in the USA and Europe and focussed on a variety of healthcare disciplines including medical, nursing, and allied health. VR education was delivered using head-mounted displays, Cave Automatic Virtual Environment systems, and bespoke setups. These systems delivered education in a variety of areas (emergency medicine, equipment training, obstetrics, and basic/advanced life support). Subjective potential advantages of this technology included realism, replayability, and time-effectiveness. Reports of adverse events were low in frequency across the included studies. Whilst clear educational benefit was generally noted, this was not reflected in changes to patient-based outcomes.

Conclusion

There may be educational benefit to using VR in the context of simulation-based emergency skills training including knowledge gain and retention, skill performance, acceptability, usability, and validity. Currently, there is insufficient evidence to demonstrate clear cost-effectiveness, or direct improvement of patient or institutional outcomes, at this stage.

Exploring objective measures for assessing team performance in healthcare: an interview study

Introduction

Effective teamwork plays a critical role in achieving high-performance outcomes in healthcare. Consequently, conducting a comprehensive assessment of team performance is essential for providing meaningful feedback during team trainings and enabling comparisons in scientific studies. However, traditional methods like self-reports or behavior observations have limitations such as susceptibility to bias or being resource consuming. To overcome these limitations and gain a more comprehensive understanding of team processes and performance, the assessment of objective measures, such as physiological parameters, can be valuable. These objective measures can complement traditional methods and provide a more holistic view of team performance. The aim of this study was to explore the potential of the use of objective measures for evaluating team performance for research and training purposes. For this, experts in the field of research and medical simulation training were interviewed to gather their opinions, ideas, and concerns regarding this novel approach.

Methods

A total of 34 medical and research experts participated in this exploratory qualitative study, engaging in semi-structured interviews. During the interview, experts were asked for (a) their opinion on measuring team performance with objective measures, (b) their ideas concerning potential objective measures suitable for measuring team performance of healthcare teams, and (c) their concerns regarding the use of objective measures for evaluating team performance. During data analysis responses were categorized per question.

Results

The findings from the 34 interviews revealed a predominantly positive reception of the idea of utilizing objective measures for evaluating team performance. However, the experts reported limited experience in actively incorporating objective measures into their training and research. Nevertheless, they identified various potential objective measures, including acoustical, visual, physiological, and endocrinological measures and a time layer. Concerns were raised regarding feasibility, complexity, cost, and privacy issues associated with the use of objective measures.

Discussion

The study highlights the opportunities and challenges associated with employing objective measures to assess healthcare team performance. It particularly emphasizes the concerns expressed by medical simulation experts and team researchers, providing valuable insights for developers, trainers, researchers, and healthcare professionals involved in the design, planning or utilization of objective measures in team training or research.

Cost-effectiveness of virtual reality and wet laboratory cataract surgery simulation

PURPOSE

To evaluate the cost-effectiveness of phacoemulsification simulation training in virtual reality simulator and wet laboratory on operating theater performance.

METHODS

Residents were randomized to a combination of virtual reality and wet laboratory phacoemulsification or wet laboratory phacoemulsification. A reference control group consisted of trainees who had wet laboratory training without phacoemulsification. All trainees were assessed on operating theater performance in 3 sequential cataract patients. International Council of Ophthalmology Surgical Competency Assessment Rubric-phacoemulsification (ICO OSCAR phaco) scores by 2 masked independent graders and cost data were used to determine the incremental cost-effectiveness ratio (ICER). A decision model was constructed to indicate the most cost-effective simulation training strategy based on the willingness to pay (WTP) per ICO OSCAR phaco score gained.

RESULTS

Twenty-two trainees who performed phacoemulsification in 66 patients were analyzed. Trainees who had additional virtual reality simulation achieved higher mean ICO OSCAR phaco scores compared with trainees who had wet laboratory phacoemulsification and control (49.5 ± standard deviation [SD] 9.8 vs 39.0 ± 15.8 vs 32.5 ± 12.1, P < .001). Compared with the control group, ICER per ICO OSCAR phaco of wet laboratory phacoemulsification was $13,473 for capital cost and $2209 for recurring cost. Compared with wet laboratory phacoemulsification, ICER per ICO OSCAR phaco of additional virtual reality simulator training was US $23,778 for capital cost and $1879 for recurring cost. The threshold WTP values per ICO OSCAR phaco score for combined virtual reality simulator and wet laboratory phacoemulsification to be most cost-effective was $22,500 for capital cost and $1850 for recurring cost.

CONCLUSIONS

Combining virtual reality simulator with wet laboratory phacoemulsification training is effective for skills transfer in the operating theater. Despite of the high capital cost of virtual reality simulator, its relatively low recurring cost is more favorable toward cost-effectiveness.

Simulated virtual on-call training programme for improving non-specialised junior doctors' confidence in out-of-hours psychiatry: quantitative assessment

AIMS AND METHOD

To investigate whether a psychiatry-specific virtual on-call training programme improved confidence of junior trainees in key areas of psychiatry practice. The programme comprised one 90 min lecture and a 2 h simulated on-call shift where participants were bleeped to complete a series of common on-call tasks, delivered via Microsoft Teams.

RESULTS

Thirty-eight trainees attended the lecture, with a significant improvement in confidence in performing seclusion reviews (P = 0.001), prescribing psychiatric medications for acute presentations (P < 0.001), working in section 136 suites (places of safety) (P = 0.001) and feeling prepared for psychiatric on-call shifts (P = 0.002). Respondents reported that a virtual on-call practical session would be useful for their training (median score of 7, interquartile range 5-7.75). Eighteen participants completed the virtual on-call session, with significant improvement in 9 out of the 10 tested domains (P < 0.001).

CLINICAL IMPLICATIONS

The programme can be conducted virtually, with low resource requirements. We believe it can improve trainee well-being, patient safety, the delivery of training and induction of rotating junior doctors during the COVID-19 pandemic and it supports the development and delivery of practical training in psychiatry.

A cost analysis of a 5-day simulation-based learning program for speech-language pathology student training

Purpose: There is poor reporting of the cost of simulation and greater transparency is needed. The primary study aim was to conduct a financial analysis of the university/training institution costs associated with a 5-day simulation-based learning program for speech-language pathology students. The secondary aim was to consider the economic costs of the model.Method: Costs associated with the delivery of a 5-day simulation-based learning program for speech-language pathology students from six Australian universities were collected regarding: (a) pre-program training, (b) personnel, (c) room hire, (d) equipment, and (e) consumables. Both financial costs and economic costs (Australian dollar, at June 2017) were calculated per university site, and per student.Result: The simulation program was run 21 times involving 176 students. Average total financial cost per program ranged from $4717 to $11 425, with cost variation primarily attributed to local labour costs and various use of in-kind support. Average financial cost per student was $859 (range $683-$1087), however this was almost double ($1461 per student, range $857-$2019) in the economic cost calculation. Personnel was the largest contributing cost component accounting for 76.6% of financial costs. Personnel was also the highest contributing cost in the economic analysis, followed by room hire.Conclusion: This study provides clarity regarding financial and economic costing for a 5-day simulation-based learning program. These data can help universities consider potential up-front financial costs, and well as strategies for financial cost minimisation, when implementing simulation-based learning within the university context.

Uses of simulation-based education for anesthesiology training, certification and recertification: A scoping review

Objectives

To conduct a comprehensive scoping review focusing on published anesthesiology-specific training based on simulation to assess up-to-date uses of simulation-based education in anesthesiology training. Our goal was to establish a solid ground for building standardized and accredited curricula for simulation-based education in the specialty of anesthesia in the near future.

Methods

We searched the PubMed, CINAHL and EMBASE databases on May 10, 2021 for relevant articles. We followed the five-stage scoping review methodology: identifying a research question, identifying relevant studies, study selection, charting the data, and synthesis of results.

Results

Our initial electronic search identified 5609 potential articles. After abstract screening and removing duplicates, 636 articles were evaluated in full text for inclusion or exclusion. Based on this strategy, 283 articles were included in this review. We mapped the current practice of simulation in training and certification across different anesthesiology subspecialties.

Conclusions

Significant effort has been placed into the use of simulation for training, certification, and recertification in anesthesiology. Future effort to develop simulation-based training that can be generalized to trainees in this specialty, similar to other fields such as aviation and space sciences, will enhance the standardization of training and hence patient safety.

Physiotherapy students' empathy towards Australians living in rural settings: A pre-test post-test evaluation of a stand-alone rural simulation activity

OBJECTIVE

To investigate how a rural simulation activity influenced physiotherapy students' rural empathy, and to explore students' perception of the activity.

SETTING

A metropolitan university in Queensland, Australia.

PARTICIPANTS

Second year undergraduate physiotherapy students.

DESIGN

A single cohort pre-test post-test evaluation was undertaken to evaluate a rural simulation activity. Participants received the rural simulation activity, featuring an immersive video and telehealth simulation with a standardised patient portrayed by an actor. Participants undertook a structured debrief and guided reflection following the simulation. Outcome measures included the Rural Comprehensive State Empathy Scale (R-CSES) and the Satisfaction with Simulation Experience Scale. Group interviews were undertaken regarding participant perceptions of the activity. Wilcoxon Rank-Sum tests were used to analyse survey data, and group interview data were subject to thematic analyses.

RESULTS

A total of 102 students undertook the activity, with an outcome measure response rate of 92.2% (94/102). Intra-personal rural empathy increased following the activity as demonstrated by the overall R-CSES score [pre-test: 101.5 (90-110.75) vs post-test 107 (100-120); p = <0.001; r = 0.39]. There was high satisfaction with the experience [mean SSES score = 18/21]. Two themes were generated from the group interview data: (1) effect on perceptions of rural practice and (2) feedback regarding the simulation.

CONCLUSION

A rural simulation activity using an immersive video, standardised patient, and a structured debrief increased physiotherapy students' empathy towards Australians living in rural settings. Students were satisfied with the activity and felt that it improved their understanding of the challenges of rural healthcare.

Twelve tips for using tactical decision games to teach non-technical skills

Tactical decision games (TDGs) have been used in healthcare and other safety-critical industries to develop non-technical skills training (NTS). TDGs have been shown to be a realistic, feasible, and useful way of teaching NTS such as decision making, task prioritisation, situational awareness, and team working. Our 12-tips for using TDG to teach NTS are based on our experience of integrating them into an undergraduate medical and nursing programme. We cover how to design successful TDGs, how to facilitate and debrief them and how to integrate TDGs into curricula. We have found TDGs to be a cost-effective, low fidelity, and useful method of delivering NTS teaching, ideally as an adjunct to immersive simulation. Learners find them a useful way to be introduced to NTS in a safe and relaxed environment, with particular emphasis on critical decision making and prioritisation.

Impact of pre-registration extended immersive ward-based simulation on student learning in preparation for clinical placement

BACKGROUND

Graduate nurses commonly experience significant challenges in transitioning to professional practice. The practice readiness of graduate nurses continues to be a concern for nurse educators and industry partners. Introduction of pre-registration extended immersive ward-based simulation can provide opportunities for students to practice the role of registered nurse before graduation. It is not clear if participation in simulation-based learning transfers to increased preparedness for dealing with real-life situations following entry into the workforce.

OBJECTIVE

To report on student views on how ward-based immersive simulation assisted in preparing for clinical placement and graduate practice.

DESIGN

A qualitative, descriptive design was used to conduct a series of face-to-face focus groups.

SETTING

School of Nursing and Midwifery metropolitan Western Australian university.

PARTICIPANTS

Final year baccalaureate nursing students who had participated in six four-hour simulation workshops between February and April 2021 were selected through purposive sampling.

METHODS

Focus group and interview data was transcribed from audio recordings. A six-phase approach was used to analyse data into themes and sub-themes. The study adhered to the consolidated criteria for reporting of qualitative research.

RESULTS

Three focus groups and one interview were conducted. Eight themes emerged. Student learning was identified as occurring in a variety of ways, such as how to work as a team and was influenced by a number of factors, such as the capacity for students to self-reflect.

CONCLUSIONS

Learning opportunities for students to practice how to think and work independently as a registered nurse is something that can be supported by pre-registration extended immersive ward-based simulation. Understanding of what will be expected of them once qualified can make students more prepared for professional practice enabling them to apply knowledge gained from simulated experiences to a similar situation as a graduate nurse.

Cost-Effectiveness Analysis in Performance Assessments: A Case Study of the Objective Structured Clinical Examination

Medical education assessments are becoming more complex, resulting in the inappropriateness of traditional methods primarily consisting of direct observations, oral examinations, and multiple-choice tests. Advancements in research methods have led to the formation of new modalities, namely performance assessments, which are, on the other hand, always costly in development and implementation. Proposing using the Program Effectiveness and Cost Generalization flow within an assessment context (PRECOG-A), this brief report explores the real financial cost drivers associated with an assessment case in the context of medical education, presents the steps in bridging the effectiveness with its psychometric properties via cost-effectiveness analysis, and evaluates the two-side outcomes for further evaluation decision-making. Referentially providing a framework to investigators and researchers, the illustration of PRECOG-A in this study outlines instructional guidelines for conducting cost-effectiveness analysis in a performance assessment.

Comparison of simulation-based interprofessional education and video-enhanced interprofessional education in improving the learning outcomes of medical and nursing students: A quasi-experimental study

BACKGROUND

Use of interprofessional education has greatly expanded and is widely used to foster interprofessional collaborative practice competency in health professionals, especially during medical emergencies. Identifying the interprofessional education delivery mode that can maximize learning outcomes within available resources is crucial for achieving the sustainability of an interprofessional education program.

OBJECTIVES

To examine the learning outcomes of simulation-based interprofessional education and video-enhanced interactive discussion interprofessional education modules and to analyze the variable costs between these two interprofessional education modules.

DESIGN

A prospective quasi-experimental study.

SETTING

A medical university in Northern Taiwan.

PARTICIPANTS

24 medical students and 48 nursing students enrolled in a 4-week simulation-based interprofessional education or video-enhanced interactive discussion interprofessional education program.

METHODS

Students' medical task performance, critical medical task performance, team behavior performance, and interprofessional collaboration attitude were examined at the pretest and posttest by using an objective structured checklist and team performance rating scale with a hands-on simulation model and structured questionnaires. The variable costs for simulation-based interprofessional education and video-enhanced interactive discussion interprofessional education were estimated upon the completion of the course.

RESULTS

All learning outcomes significantly improved for both the groups from the pretest to posttest. After the intervention, the simulation-based interprofessional education group exhibited significantly higher scores in medical task performance, critical medical task performance and team behavior performance than the video-enhanced interactive discussion interprofessional education group at the posttest. No significant difference was noted in interprofessional collaboration attitude between the groups. Cost analysis revealed that the simulation-based interprofessional education program was approximately two times more expensive in terms of staffing costs and required 1.3 times greater space charges than the video-enhanced interactive discussion interprofessional education program.

CONCLUSION

Both simulation-based interprofessional education and video-enhanced interactive discussion interprofessional education modules effectively improved medical and nursing students' medical task performance, critical medical task performance and team behavior performance. The simulation-based interprofessional education group had more favorable learning outcomes, but the associated costs were higher. Educators should consider both learning outcomes and cost when choosing a design strategy simulation-based interprofessional education vs. video-enhanced interactive discussion interprofessional education for interprofessional education module development.

Effectiveness of high- and low-fidelity simulation-based medical education in teaching cardiac auscultation: a systematic review and meta-analysis

Simulation-based medical education (SBME) is an evolving method of teaching cardiac examination skills to healthcare learners. It has been deliberated how effective this teaching modality is and whether high-fidelity methods are more effective than low-fidelity methods. This systematic review aimed to assess the effectiveness of high-fidelity SBME in teaching cardiac auscultation compared with no intervention or another active teaching intervention (low-fidelity SBME) using evidence from randomized controlled trials (RCTs).

Literature searches were performed on Medline, Embase, PsychInfo and Cinahl. RCTs that compared the effectiveness of high-fidelity simulation against no intervention or high-fidelity simulation against low-fidelity simulation in teaching cardiac auscultation to healthcare learners were included. Outcomes were knowledge, skills and satisfaction relating to cardiac auscultation education. Data were analyzed using Review Manager 5.3 software.

Seventeen RCTs (n = 1055) were included. Twelve RCTs (n = 692) compared high-fidelity simulation with no intervention. The pooled effect sizes for knowledge and skills were 1.39 (95% confidence interval [CI], 0.39–2.38;

This review’s findings suggest that high-fidelity SBME is an effective teaching method for cardiac auscultation education. Interestingly, there was no significant difference in knowledge or skills among learners when comparing high-fidelity simulation with low-fidelity simulation. Further research is needed to establish the effectiveness of different forms of SBME as educational interventions.

The impact of virtual reality simulation training on operative performance in laparoscopic cholecystectomy: meta-analysis of randomized clinical trials

BACKGROUND

Simulation training can improve the learning curve of surgical trainees. This research aimed to systematically review randomized clinical trials (RCT) evaluating the performance of junior surgical trainees following virtual reality training (VRT) and other training methods in laparoscopic cholecystectomy.

METHODS

MEDLINE (PubMed), Embase (Ovid SP), Web of Science, Scopus and LILACS were searched for trials randomizing participants to VRT or no additional training (NAT) or simulation training (ST). Outcomes of interest were the reported performance using global rating scores (GRS), the Objective Structured Assessment of Technical Skill (OSATS) and Global Operative Assessment of Laparoscopic Skills (GOALS), error counts and time to completion of task during laparoscopic cholecystectomy on either porcine models or humans. Study quality was assessed using the Cochrane Risk of Bias Tool. PROSPERO ID: CRD42020208499.

RESULTS

A total of 351 titles/abstracts were screened and 96 full texts were reviewed. Eighteen RCT were included and 15 manuscripts had data available for meta-analysis. Thirteen studies compared VRT and NAT, and 4 studies compared VRT and ST. One study compared VRT with NAT and ST and reported GRS only. Meta-analysis showed OSATS score (mean difference (MD) 6.22, 95%CI 3.81 to 8.36, P < 0.001) and time to completion of task (MD -8.35 min, 95%CI 13.10 to 3.60, P = <0.001) significantly improved after VRT compared with NAT. No significant difference was found in GOALS score. No significant differences were found between VRT and ST groups. Intraoperative errors were reported as reduced in VRT groups compared with NAT but were not suitable for meta-analysis.

CONCLUSION

Meta-analysis suggests that performance measured by OSATS and time to completion of task is improved with VRT compared with NAT for junior trainee in laparoscopic cholecystectomy. However, conclusions are limited by methodological heterogeneity and more research is needed to quantify the potential benefit to surgical training.

The Use of Simulation-Based Education With New Graduate Nurses in Emergency Department and Acute Care Settings: A Scoping Review

Background The literature questions if newly graduated nurses are truly ready to practice at the bedside. Simulation has been shown to bridge the gap between theory and practice. The purpose of this study was to investigate what is known about the use of simulation education with novice graduate nurses in critical care settings in the hospital. Method A scoping review was conducted using the PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Articles published in English between 2015 and September 2021 that focused on simulation education with novice graduate nurses in a critical care setting were included. Results The review yielded six articles. Conclusion The literature is scant on the use of simulation in critical care areas with novice graduate nurses. Additional inquiry is needed related to the role of learners, cost, timing, setting, and educational practices. More studies with stronger research designs and valid and reliable measurement instruments are also needed. Finally, there is a need to better understand the effects of simulation on novice nurse graduates' knowledge and skills as well as patient outcomes. [J Contin Educ Nurs. 2022;53(7):301-306.].

Training to proficiency in surgery using simulation: is there a moral obligation?

A deontological approach to surgical ethics advocates that patients have the right to receive the best care that can be provided. The 'learning curve' in surgical skill is an observable and measurable phenomenon. Surgical training may therefore carry risk to patients. This can occur directly, through inadvertent harm, or indirectly through theatre inefficiency and associated costs. Trainee surgeon operating, however, is necessary from a utilitarian perspective, with potential risk balanced by the greater societal need to train future independent surgeons.New technology means that the surgical learning curve could take place, at least in part, outside of the operating theatre. Simulation-based deliberate practice could be used to obtain a predetermined level of proficiency in a safe environment, followed by simulation-based assessment of operative competence. Such an approach would require an overhaul of the current training paradigm and significant investment in simulator technology. This may increasingly be viewed as necessary in light of well-discussed pressures on surgical trainees and trainers.This article discusses the obligations to trainees, trainers and training bodies raised by simulation technology, and outlines the current arguments both against and in favour of a simulation-based training-to-proficiency model in surgery. The significant changes to the current training paradigm that would be required to implement such a model are also discussed.

Implementation of a structured emergency nursing framework results in significant cost benefit

Background

Patients are at risk of deterioration on discharge from an emergency department (ED) to a ward, particularly in the first 72 h. The implementation of a structured emergency nursing framework (HIRAID) in regional New South Wales (NSW), Australia, resulted in a 50% reduction of clinical deterioration related to emergency nursing care. To date the cost implications of this are unknown. The aim of this study was to determine any net financial benefits arising from the implementation of the HIRAID emergency nursing framework.

Methods

This retrospective cohort study was conducted between March 2018 and February 2019 across two hospitals in regional NSW, Australia. Costs associated with the implementation of HIRAID at the study sites were calculated using an estimate of initial HIRAID implementation costs (AUD) ($492,917) and ongoing HIRAID implementation costs ($134,077). Equivalent savings per annum (i.e. in less patient deterioration) were calculated using projected estimates of ED admission and patient deterioration episodes via OLS regression with confidence intervals for incremental additional deterioration costs per episode used as the basis for scenario analysis.

Results

The HIRAID-equivalent savings per annum exceed the costs of implementation under all scenarios (Conservative, Expected and Optimistic). The estimated preliminary savings to the study sites per annum was $1,914,252 with a payback period of 75 days. Conservative projections estimated a net benefit of $1,813,760 per annum by 2022–23. The state-wide projected equivalent savings benefits of HIRAID equalled $227,585,008 per annum, by 2022–23.

Conclusions

The implementation of HIRAID reduced costs associated with resources consumed from patient deterioration episodes. The HIRAID-equivalent savings per annum to the hospital exceed the costs of implementation across a range of scenarios, and upscaling would result in significant patient and cost benefit.

Communication content during debriefing in simulation-based medical education: An analytic framework and mixed-methods analysis

BACKGROUND

Debriefing is an indispensable component of simulation-based medical education, and it has great potential for contributions to reflective learning. Little is known about the relevance of communication during debriefings. We developed a category framework to assess the communication content of debriefings, which we used to analyze possible relationships to participant learning outcomes.

METHOD

We deductively and inductively developed a category framework for qualitative content analysis of debriefings. We coded 20 debriefings using this framework, and correlated debriefing frequency with learning outcomes (i.e. engagement, satisfaction, individual and team learning success).

RESULTS

The category framework comprised 9 main and 81 subcategories (48 debriefers, 27 participants, 6 simulated patients), which yielded good intercoder agreement. Debriefers and participants communicated equally using mostly advocacy, inquiry, illustration, and confirmation. Debriefer questions and participant inputs were positively related to learning outcomes. In contrast, guess-what-I-am-thinking, apologies, observations, use of materials, participant descriptions, simple repetition of statements, and evaluation by other participants were not positively associated with learning outcomes.

CONCLUSION

This study provides important new information about communication content during debriefings. The association between communication content and learning outcomes appears particularly relevant to further enhance efficacy of debriefings and simulation-based medical education.

Cost-effectiveness of a quality improvement project, including simulation-based training, on reducing door-to-needle times in stroke thrombolysis

BACKGROUND

Rapid revascularisation in acute ischaemic stroke is crucial to reduce its total burden including societal costs. A quality improvement (QI) project that included streamlining the stroke care pathway and simulation-based training was followed by a significant reduction in median door-to-needle time (27 to 13 min) and improved patient outcomes after stroke thrombolysis at our centre. Here, we present a retrospective cost-effectiveness analysis of the QI project.

METHODS

Costs for implementing and sustaining QI were assessed using recognised frameworks for economic evaluations. Effectiveness was calculated from previously published outcome measures. Cost-effectiveness was presented as incremental cost-effectiveness ratios including costs per minute door-to-needle time reduction per patient, and costs per averted death in the 13-month post-intervention period. We also estimated incremental cost-effectiveness ratios for a projected 5-year post-intervention period and for varying numbers of patients treated with thrombolysis. Furthermore, we performed a sensitivity analysis including and excluding costs of unpaid time.

RESULTS

All costs including fixed costs for implementing the QI project totalled US$44 802, while monthly costs were US$2141. We calculated a mean reduction in door-to-needle time of 13.1 min per patient and 6.36 annual averted deaths. Across different scenarios, the estimated costs per minute reduction in door-to-needle time per patient ranged from US$13 to US$29, and the estimated costs per averted death ranged from US$4679 to US$10 543.

CONCLUSIONS

We have shown that a QI project aiming to improve stroke thrombolysis treatment at our centre can be implemented and sustained at a relatively low cost with increasing cost-effectiveness over time. Our work builds on the emerging theory and practice for economic evaluations in QI projects and simulation-based training. The presented cost-effectiveness data might help guide healthcare leaders planning similar interventions.

The influence of simulated medication administration learning on the clinical performance of nursing students: A comparative quasi-experimental study

BACKGROUND

Medication administration is a main role of nurses, and by mastering this skill, medication errors can be reduced. Simulation provides a safe environment for learning and improving medication administration. Simulation design may influence the students' learning curve and ability to transfer skills into the clinical setting.

OBJECTIVE

To examine the influence of simulation-based learning of the medication administration process, on satisfaction, self-perception of preparedness, and clinical performance of students who practice simulation either individually or in a group.

DESIGN

A comparative quasi-experimental study.

SETTING

A public university in southern Israel.

PARTICIPANTS

Third-year nursing students in two consecutive academic years (78 in the individual sample and 50 in the group sample).

METHODS

Nursing students participated in a scenario-based simulation for medication administration either individually or in a group. Self-reported questionnaires evaluated participants' satisfaction with the simulation experience, and perception of preparedness before and after the simulation. Faculty members observed and evaluated participants' medication administration during the simulation and in the clinical setting. Paired t-tests were performed to compare preparedness before and after the simulation experience. Linear regression models were formulated to elicit the predictors of preparedness after simulation and evaluations for medication administration in the clinical setting.

RESULTS

The simulation experience increased participants' preparedness both when designed for an individual student and for a group of students. Simulation performance was the main contributor to the participant preparedness among the individual sample (β = 0.51, p < 0.01), whereas previous preparedness was the main contributor among the group sample (β = 0.42, p < 0.01). The association between simulation performance and clinical performance was mediated by preparedness after simulation in the individual sample, but not in the group sample.

CONCLUSIONS

Simulation improves students' preparedness for medication administration. Individual simulation also impacts clinical performance, via preparedness. Further research is needed to identify other factors that facilitate skills transfer into the clinical setting.

Learning by doing: To explore the influence of Simulation on Clinical Decision-Making Approaches on Final Year Medical Students at the University of Duisburg-Essen, Germany

This article was migrated. The article was marked as recommended. Background: Final year medical students at the University Duisburg-Essen, Germany, are unsatisfied with their clinical judgement skills in common elective and emergency clinical situations. A competency based medical curriculum determines that clinical judgement is an essential tool in effective patient care, patient safety and limiting clinical error. Approaches to clinical judgement include either analytical, intuitive or a combination of both approaches. Novices show specific factors, which are typical in inexperienced clinicians. Simulation provides opportunities in a competency-based medical education curriculum. There is limited evidence showing that simulation can provide an effective environment for teaching and learning clinical decision-making skills. This project explores how final year medical students at the University of Duisburg-Essen approach the clinical decision-making process as well as how simulation influences this process. Methods: Ethics approval was obtained from the local ethics committee. After completing a 10-week simulation course,thirty-five students completed a clinical decision-making instrument to categorise their clinical decision-making approaches. The Novice Decision Making Model and the Cognitive Continuum Model were combined with learning theories in Simulation (Social Cognitive Theory) and used to explore and interpret data collected through questionnaires, interviews and observation. Results: The majority (60%) of students employed a predominantly analytic approach, some students showed intuitive tendencies in clinical situations. During interviews students displayed typical novice approaches to decision-making and expressed positive comments relating to simulation. Conclusions: Simulation presents an opportunity for teaching and learning clinical decision-making. Results show the need for further inquiry into learning clinical decision-making through simulation. This research provides initial evidence that simulation can be incorporated into curricular teaching of clinical decision-making.

Crisis Management Simulation: Review of Current Experience

Crisis management simulation is important in training the next generation of surgeons. In this review, we highlight our experiences with the cavernous carotid injury model. We then delve into other crisis simulation models available for the neurosurgical specialty. The discussion focuses upon how these trainings can continue to evolve. Much work is yet to be done in this exciting arena and we present several avenues for future discovery. Simulation continues to be an important training tool for the surgical learner.

Training Simulators for Gastrointestinal Endoscopy: Current and Future Perspectives

Simple Summary

Over the last decades, visual endoscopy has become a gold standard for the detection and treatment of gastrointestinal cancers. However, mastering endoscopic procedures is complex and requires long hours of practice. In this context, simulation-based training represents a valuable opportunity for acquiring technical and cognitive skills, suiting the different trainees’ learning pace and limiting the risks for the patients. In this regard, the present contribution aims to present a critical and comprehensive review of the current technology for gastrointestinal (GI) endoscopy training, including both commercial products and platforms at a research stage. Not limited to it, the recent revolution played by the technological advancements in the fields of robotics, artificial intelligence, virtual/augmented reality, and computational tools on simulation-based learning is documented and discussed. Finally, considerations on the future trend of this application field are drawn, highlighting the impact of the most recent pandemic and the current demographic trends.

Abstract

Gastrointestinal (GI) endoscopy is the gold standard in the detection and treatment of early and advanced GI cancers. However, conventional endoscopic techniques are technically demanding and require visual-spatial skills and significant hands-on experience. GI endoscopy simulators represent a valid solution to allow doctors to practice in a pre-clinical scenario. From the first endoscopy mannequin, developed in 1969, several simulation platforms have been developed, ranging from purely mechanical systems to more complex mechatronic devices and animal-based models. Considering the recent advancement of technologies (e.g., artificial intelligence, augmented reality, robotics), simulation platforms can now reach high levels of realism, representing a valid and smart alternative to standard trainee/mentor learning programs. This is particularly true nowadays, when the current demographic trend and the most recent pandemic demand, more than ever, the ability to cope with many patients. This review offers a broad view of the technology available for GI endoscopy training, including platforms currently in the market and the relevant advancements in this research and application field. Additionally, new training needs and new emerging technologies are discussed to understand where medical education is heading.

The Scope of Hospital-Based Simulation

BACKGROUND

Healthcare simulation has expanded dramatically; however, little is known about the scope of simulation in acute care hospitals.

METHODS

A descriptive, cross-sectional online survey was used. Participants included nurse executives from acute care hospitals in California.

RESULTS

Most organizations (96%) used simulation primarily for education, 37% used simulation for health system integration and systems testing, 30% used it for error investigation, 15% used it for research, and 15% used it for patient/family education.

CONCLUSIONS

Organizations have a substantial opportunity to increase the scope of simulation beyond education to include systems integration, clinical systems testing, and other translational simulation activities. This targeted focus on patient safety and quality will allow hospitals to improve financial performance and maximize scarce resources.

The Impact of Coronavirus Disease 2019 on Maxillofacial Surgery Training in Portugal: The Resident’s Perspective

Introduction

Methods

Results

Discussion

Conclusion

Simulation-based curriculum development: lessons learnt in Global Health education

BACKGROUND

Simulation based medical education (SBME) allows learners to acquire clinical skills without exposing patients to unnecessary risk. This is especially applicable to Emergency Medicine training programs where residents are expected to demonstrate proficiency in the management of time critical, low frequency, and highly-morbidity conditions. This study aims to describe the process through which a SBME curriculum was created, in a limited simulation resource setting at a 4-year Emergency Medicine (EM) residency program at the American University of Beirut Medical Center.

METHODS

A case-based pilot simulation curriculum was developed following Kern's 6 step approach to curriculum design. The curricular objectives were identified through an anonymous survey of the program's residents and faculty. Curriculum outcomes were assessed, and the curriculum was revised to address curricular barriers. Evaluations of the revised curriculum were collected during the simulation sessions and through a whole revised curriculum evaluation at the end of the first year of its implementation.

RESULTS

14/20 residents (70%) and 8/8 faculty (100%) completed the needs assessment from which objectives for the pilot curriculum were developed and implemented through 6 2-h sessions over a 1-year period. Objectives were not met and identified barriers included cost, scheduling, resources, and limited faculty time. The revised curriculum addressed these barriers and 24 40-min sessions were successfully conducted during the following year. The sessions took place 3 at a time, in 2-h slots, using the same scenario to meet the objectives of the different learners' levels. 91/91 evaluations were collected from participants with overall positive results. The main differences between the pilot and the revised curricula included: a better understanding of the simulation center resources and faculty's capabilities.

CONCLUSION

Simulation-based education is feasible even with limited-resources. However, understanding the resources available, and advocating for protected educator time are essential to implementing a successful EM simulation curriculum.

The effect of multiple exposures in scenario-based simulation-A mixed study systematic review

Aims

To examine the use and effects of multiple simulations in nursing education.

Design

A mixed study systematic review. Databases (CINAHL, Medline, PubMed, EMBASE, ERIC, Education source and Science Direct) were searched for studies published until April 2020.

Method

Researchers analysed the articles. Bias risk was evaluated using the Critical Appraisal Skills Programme and Cochrane Risk of Bias tool.

Results

In total, 27 studies were included and four themes identified. Students participated in multiple simulation sessions, over weeks to years, which included 1-4 scenarios in various nursing contexts. Simulations were used to prepare for, or partly replace, students' clinical practice. Learning was described in terms of knowledge, competence and confidence.

Conclusion

Multiple scenario-based simulation is a positive intervention that can be implemented in various courses during every academic year to promote nursing students' learning. Further longitudinal research is required, including randomized studies, with transparency regarding study design and instruments.

Physiotherapy students can be educated to portray realistic patient roles in simulation: a pragmatic observational study

BACKGROUND

Simulation-based education (SBE) has many benefits for learners, but costs can limit embedding SBE in health professional curricula. Peer simulation involves students portraying patient roles, and may reduce costs while still providing the benefits of other SBE experiences. However, the quality of the SBE may be impacted if students cannot portray authentic and realistic patient roles. The aim of this study was to investigate whether targeted education was associated with observable changes to physiotherapy students' abilities to portray patient roles in SBE.

METHODS

Second year pre-registration physiotherapy students (n = 40) participated. Students completed online and face-to-face education about SBE, patient portrayal skills, and how to portray a specific patient role. Students were video-recorded portraying patient roles in practical exams before and after the program. Three blinded independent assessors rated the overall quality of portrayals using a purpose-developed assessment instrument.

RESULTS

Twenty-three sets of pre- and post-program videos were analysed. Correlations between assessor scores spanned 0.62 to 0.82 for analyses of interest, which justified using average assessor ratings in analysis. Statistically significant higher scores were seen for post-program assessments for overall portrayal scores (mean difference 6.5, 95%CI [1.51-11.45], p = 0.013), accuracy (mean difference 3.4, 95%CI [0.69-6.13], p = 0.016) and quality (mean difference 3.1, 95%CI [0.64-5.49], p = 0.016).

CONCLUSIONS

Physiotherapy students appear capable of playing realistic patient roles. Peer simulation can be embedded into health professional programs, and education in patient role portrayal appears to be associated with improvements in portrayal quality and realism. Given these findings, further investigation, including testing program effects in a randomised study, is warranted.

Computer based simulation in CT and MRI radiography education: Current role and future opportunities

OBJECTIVE

The use of Computer-based simulation (CBS), a form of simulation which utilises digital and web based platforms, is widely acknowledged in healthcare education. This literature review explores the current evidence relating to CBS activities in supporting radiographer education in CT and MRI.

KEY FINDINGS

Journal articles published between 2010 and 2020 were reviewed (n = 663). The content was evaluated and summarised with the following headings; current utility, overview of CBS types, knowledge acquisition and evaluation, and student perspective. CBS utility in CT and MRI radiography education is limited. Its current use is for pre-registration education, and the interfaces used vary in design but are predominantly used as a preclinical learning tool to support the training of geometric scan planning, image acquisition and reconstruction, and associated technical skills. CBS was positively acknowledged by student radiographers; based on its inherent flexibility, self-paced learning and the ability to practice in a safe environment. Nonetheless, the educational validation of CBS in CT and MRI education pertaining to knowledge and skill acquisition has not been fully assessed through rigorous academic assessments and metrics.

CONCLUSION

The current use of CBS in CT and MRI education is limited. The development of software programmes with functionality and capability that correlates with current clinical practice is imperative; and to enable more research in CBS utility to be undertaken to establish the efficacy of this pedagogical approach.

IMPLICATIONS FOR PRACTICE

Due to limited placement opportunities, the use of simulation is increasing and evolving; in line with the approach to design and deliver high quality Simulation Based Education (SBE) in Diagnostic Radiography education. The continued development, utility and evaluation of CBS interfaces to support student radiographers at pre and post registration level is therefore essential.

Developing an Innovative Medical Training Simulation Device for Peripheral Venous Access: A User-Centered Design Approach

Nurses and other health students may lack the proper time for training procedural tasks, such as peripheral venous access. There is a need to develop these abilities in novices so that errors can be avoided when treating real patients. Nonetheless, from an experiential point of view, the simulation devices offered in the market do not always make sense for educators and trainees. This could make the adoption of new technology difficult. The purpose of this case study is to describe the development of an innovative simulation device and to propose concrete tactics for the involvement of the educators and trainees. We used a participative design based approach, with an ethnographic basis, where incremental cycles of user testing, development and iteration were involved. The study showcases methods from the field of design and anthropology that can be used to develop future simulation devices that resonate with students and educators to achieve a long term learning experience. Results could shed a light on new ways for the involvement of educators and students to create devices that resonate with them, making learning significant and effective.

Simulation as a pedagogical learning method for critical paediatric nursing in Bachelor of Nursing programmes: a qualitative study

BACKGROUND

In the national education plan for Bachelor of Nursing in Norway, it is emphasized that focus areas for practical studies must include experience related to paediatric nursing. However, given the paucity of children's wards in Norwegian hospitals, few students are offered this. The purpose of this study is to explore undergraduate nursing student's perception of using simulation as a learning method to obtain knowledge and skills in delivering quality healthcare to children and their parents in emergencies.

METHOD

A total of 36 students participated in focus groups. The students were asked to reflect on their learning outcomes regarding the educational method during the simulation. In addition, the students were encouraged to discuss whether this pedagogical method was useful in preparing them to deal with critical medical situations in relation to children and their parents. The interviews were transcribed and analyzed using qualitative content analysis.

RESULTS

Three subjects emerged from the analysis. The first, simulation as an educational method, showed that the students thought that simulation gave a greater degree of realism and seriousness than other learning activities. The second subject, preparedness for later practice, showed that the students perceived simulation as one of the ways in which they were best prepared for the profession as a nurse. The students emphasized the benefit of having concentrated on children and their parents. The third subject, stress and leadership, showed that simulation as a method was stressful to most students, and lack of knowledge and anxiety about conducting other students kept them from taking the lead. However, the students experienced that they learned a lot about themselves and how they appear as nurses.

CONCLUSION

The bachelor-level student nurses experienced simulation as a realistic and effective educational method for gaining knowledge in the critical healthcare of children and their parents. Simulation made them reflect on a nurse's area of responsibility in emergencies. When offered practical experience in children's wards, the use of simulation as a didactic method may help students develop sufficient competence to act appropriately and expediently in critical paediatric nursing settings.

TRIAL REGISTRATION

The study (number 52776) was approved by the Norwegian Centre for Research Data.

Cost-effectiveness of a video game versus live simulation for disaster training

Introduction

Disaster triage training for emergency medical service (EMS) providers is unstandardised. We hypothesised that disaster triage training with the paediatric disaster triage (PDT) video game ‘60 s to Survival’ would be a cost-effective alternative to live simulation-based PDT training.

Methods

We synthesised data for a cost-effectiveness analysis from two previous studies. The video game data were from the intervention arm of a randomised controlled trial that compared triage accuracy in a live simulation scenario of exposed vs unexposed groups to the video game. The live simulation and feedback data were from a prospective cohort study evaluating live simulation and feedback for improving disaster triage skills. Postintervention scores of triage accuracy were measured for participants via live simulations and compared between both groups. Cost-effectiveness between the live simulation and video game groups was assessed using (1) A net benefit regression model at various willingness-to-pay (WTP) values. (2) A cost-effectiveness acceptability curve (CEAC).

Results

The total cost for the live simulation and feedback training programme was $81 313.50 and the cost for the video game was $67 822. Incremental net benefit values at various WTP values revealed positive incremental net benefit values, indicating that the video game is more cost-effective compared with live simulation and feedback. Moreover, the CEAC revealed a high probability (>0.6) at various WTP values that the video game is more cost-effective.

Conclusions

A video game-based simulation disaster triage training programme was more cost-effective than a live simulation and feedback-based programme. Video game-based training could be a simple, scalable and sustainable solution to training EMS providers.

Preliminary report of a simulation community of practice needs analysis

Aim

To understand the current needs related to education and training, and other investment priorities, in simulated learning environments in Australia following a significant period of government funding for simulation-based learning.

Methods

A mixed methods study, comprising qualitative focus groups and individual interviews, followed by a quantitative cross-sectional survey informed by themes emerging from the qualitative data.

Findings

Two focus groups and 22 individual interviews were conducted. Participants included simulation educators, technical users and new adopters. Survey data were collected from 152 responses. Barriers at the introduction and maintenance stages of simulated learning included irregular staff training resulting in inconsistent practice, and lack of onsite technical support. Educators lacked skills in some simulation and debriefing techniques, and basic education and research skills were limited, while technicians raised concerns regarding the maintenance of equipment and managing budgets.

Discussion and conclusion

Despite its effectiveness as an education tool, barriers remain at the introduction and maintenance stages of simulated learning environments. Efforts to improve the integrity and sustainability of simulation training should be informed by a comprehensive needs analysis. The resulting data should be used to address barriers in a way that maximises the limited resources and funding available for this important learning tool.

Evaluation of communication skills training programs at North American veterinary medical training institutions

OBJECTIVE

To describe how North American veterinary medical teaching institutions (VMTIs) provide communication skills training to students.

SAMPLE

Faculty coordinators of communication skills training programs (CSTPs) at 30 North American VMTIs.

PROCEDURES

An online survey instrument was designed and administered to each respondent followed by a telephone (n = 28) or in-person (2) interview. The survey and interview process were designed to evaluate all aspects of CSTPs, such as communication framework used, program format, number of student-contact hours, staffing models, outcome assessment, faculty background, program priorities, and challenges. Descriptive results were generated, and guidelines for future development of CSTPs were recommended.

RESULTS

27 US and 3 Canadian VMTIs were represented, and communication skills training was required at all. Twenty-five CSTPs used the Calgary-Cambridge Guide framework. Respondents provided a mean of 33 student-contact hours of training, primarily in the first 3 years of the veterinary curriculum in lecture (mean, 12 hours), communication laboratory (13 hours), and self-study (8 hours) formats with formative feedback. Communication skills training was integrated with other disciplines at 27 VMTIs. Most CSTPs were coordinated and taught by 1 faculty member with a < 0.50 full-time equivalent commitment and no administrative support. Stated priorities included acquisition of resources for CSTP faculty, administrative support, and video-equipped facilities; increasing integration of CSTPs into curricula; and assessment of educational outcomes.

CONCLUSIONS AND CLINICAL RELEVANCE

Results suggested that support for CSTPs and recognition of their value continue to grow, but a lack of resources, faculty expertise, validated methods for outcomes assessment, and leadership remain challenges.

Medical simulation utilization among pediatric anesthesiology fellowship programs

BACKGROUND

Simulation-based education is a mainstay in education of pediatric anesthesiology trainees. Despite the known benefits, there is variability in its use and availability among various pediatric anesthesiology fellowship programs.

AIM

The primary aim was to understand the current state of simulation-based education among pediatric anesthesiology fellowship programs and define barriers that impede the development of an effective simulation program.

METHODS

This survey-based, observational study of simulation activities within United States-based pediatric anesthesiology fellowship programs was approved by the Institutional Review Boards (IRB) of the authors' institutions. A 35-question survey was developed in an iterative manner by simulation educators (AA, WW, DY) and a statistician familiar with survey-based research (AN) using research electronic data capture (REDCap) for tool development and data collation. Descriptive and thematic analyses were performed on the quantitative and qualitative responses in the survey, respectively, and were stratified with small, medium, and large fellowship programs.

RESULTS

Forty-five of 60 (75%) fellowship programs responded to the survey. The presence of a dedicated simulation program director and number of simulation instructors was positively associated with the size of program and years in operation. Dedicated simulation support was variable across programs and was usually present within the larger programs. A positive association also existed for educational activities among all programs mostly based on size of program and years in operation. Protected time was the most commonly cited barrier to having a comprehensive and sustainable simulation program. There was general agreement for establishing a standardized and shared curriculum among fellowship programs. Approximately 70% of simulation programs had no formal simulation instructor training requirement.

CONCLUSIONS

Simulation-based curricula are broadly offered by many fellowship programs. Improved collaboration locally, regionally, and nationally may improve educational opportunities for fellowship programs, particularly the small ones. These efforts may begin with the development of a standardized curriculum and formal instructor training programs.

Implementing Virtual Simulated Person Methodology to Support the Shift to Online Learning: Technical Report

The COVID-19 pandemic has dramatically changed how education is delivered worldwide. The resultant rise of e-learning, whereby teaching is undertaken remotely and on digital platforms, has extensively impacted universities and other higher education organizations around the world. One approach to support this change in education delivery is the use of virtual simulation approaches. Our team at SimXSpace has piloted a virtual workshop using Zoom, an online video-conferencing platform, and virtual simulated persons (SPs) to support communication and interpersonal skills among learners. The main objective of the pilot virtual workshop was to develop and implement the SP methodology remotely via the Zoom platform (Zoom Video Communications, San Jose, California) and to evaluate its effectiveness as an immersive environment for simulation. The virtual workshop involved four instructors who intend to implement virtual SPs within their courses, two workshop facilitators, and two SPs. The workshop was conducted synchronously using Zoom features. The workshop followed a predefined structure and was completed as planned. Outcomes suggest that remote simulation delivery using virtual SPs and delivered online via Zoom is feasible and provides an effective environment in which to conduct SP methodology to teach communication and interpersonal skills. The findings suggest that remote simulation and virtual SPs can support experiential education and provide an effective and engaging learning environment. The virtual workshop was successful and laid a foundation for future online training programs for the use of SP methodology. Moreover, it formed an effective outline for subsequent iterations of this virtual training workshop and prompted discussion of plans for future workshops with various programs across a pan-university context.

Improving junior doctor medicine prescribing and patient safety: An intervention using personalised, structured, video-enhanced feedback and deliberate practice

AIMS

This research investigated the effectiveness of an intervention for improving the prescribing and patient safety behaviour among Foundation Year doctors. The intervention consisted of simulated clinical encounters with subsequent personalised, structured, video-enhanced feedback and deliberate practice, undertaken at the start of four-month sub-specialty rotations.

METHODS

Three prospective, non-randomised control intervention studies were conducted, within two secondary care NHS Trusts in England. The primary outcome measure, error rate per prescriber, was calculated using daily prescribing data. Prescribers were grouped to enable a comparison between experimental and control conditions using regression analysis. A break-even analysis evaluated cost-effectiveness.

RESULTS

There was no significant difference in error rates of novice prescribers who received the intervention when compared with those of experienced prescribers. Novice prescribers not participating in the intervention had significantly higher error rates (P = .026, 95% confidence interval [CI] Wald 0.093 to 1.436; P = .026, 95% CI 0.031 to 0.397) and patients seen by them experienced significantly higher prescribing error rates (P = .007, 95% CI 0.025 to 0.157). Conversely, patients seen by the novice prescribers who received the intervention experienced a significantly lower rate of significant errors compared to patients seen by the experienced prescribers (P = .04, 95% CI -0.068 to -0.001). The break-even analysis demonstrates cost-effectiveness for the intervention.

CONCLUSION

Simulated clinical encounters using personalised, structured, video-enhanced feedback and deliberate practice improves the prescribing and patient safety behaviour of Foundation Year doctors. The intervention is cost-effective with potential to reduce avoidable harm.

How can communicative competence instruction in medical studies be improved through digitalization?

The teaching of communicative competence plays an increasingly important role in medical education. In addition to traditional teaching formats, such as role-plays with simulated patients, technology-based approaches become more important in medical education. Teaching materials are increasingly augmented by videos of simulated doctor-patient conversations. This combination allows the content of teaching materials to be demonstrated with video or for videos to create a basis for reflection activities. In addition, conversation videos can illustrate different qualities of clinical communication and serve as illustrative material for describing particular issues in more detail. In addition to teaching clinical communicative competence, the assessment of this competence also plays an important role in medical educational research. So far, this has mainly been conducted through direct observation using checklists or rating scales. Relatively little is known about the assessment of communicative competence using standardized online-based tests. Situational Judgement Tests (SJTs) offer a promising approach in this respect. The BMBF-funded (BMBF = Bundesministerium für Bildung und Forschung - Federal Ministry of Education and Research) joint project voLeA (Entwicklung videobasierter Lehr- und Assessmentmodule zur Gesprächskompetenz im Medizinstudium = Development of video-based teaching and assessment modules for communicative competence in medical studies) addresses these two issues. Specifically, the project is engaged in developing e-learning modules to promote communicative competence and an assessment of this competence using an SJT. The present paper focuses on the benefits of technology-based learning and assessment units for clinical communicative competence in medical studies, using the voLeA project as an example.

Virtual Reality Triage Training Can Provide Comparable Simulation Efficacy for Paramedicine Students Compared to Live Simulation-Based Scenarios

Background: Mass-casualty incidents (MCIs) are catastrophic. Whether they arise from natural or man-made disasters, the nature of such incidents and the multiple casualties involved can rapidly overwhelm response personnel. Mass-casualty triage training is traditionally taught via either didactic lectures or table top exercises. This training fails to provide an opportunity for practical application or experiential learning in immersive conditions. Further, large-scale simulations are heavily resource-intensive, logistically challenging, require the coordination and time of multiple personnel, and are costly to replicate. This study compared the simulation efficacy of a bespoke virtual-reality (VR) MCI simulation with an equivalent live simulation scenario designed for undergraduate paramedicine students. Methods: Both simulations involved ten injured patients resulting from a police car chase and shooting. Twenty-nine second-year paramedicine students completed the live and VR simulation in a random order. The training efficacy of the VR and live simulation was evaluated with respect to student immersion and task-difficulty, clinical decision-making (i.e. triage card allocation accuracy and timeliness), learning satisfaction, and cost of delivery. Results: While perceived physical demand was higher in the live simulation compared to VR (p < 0.001), no differences were observed across mental demand, temporal demand, performance, effort or frustration domains. No differences were found for participant satisfaction across the two platforms. No differences were observed in the number of triage cards correctly allocated to patients in each platform. However, participants were able to allocate cards far quicker in VR (p < .001). Cost of running the VR came to AUD $712.04 (staff time), compared to the live simulations which came to AUD $9,413.71 (staff time, moulage, actors, director, prop vehicle), approximately 13 times more expensive. Conclusion: The VR simulation provided near identical simulation efficacy for paramedicine students compared to the live simulation. VR MCI training resources represent an exciting new direction for authentic and cost-effective education and training for medical professionals.

These may not be the courses you are seeking: a systematic review of open online courses in health professions education

INTRODUCTION

Open Online Courses (OOCs) are increasingly presented as a possible solution to the many challenges of higher education. However, there is currently little evidence available to support decisions around the use of OOCs in health professions education. The aim of this systematic review was to summarise the available evidence describing the features of OOCs in health professions education and to analyse their utility for decision-making using a self-developed framework consisting of point scores around effectiveness, learner experiences, feasibility, pedagogy and economics.

METHODS

Electronic searches of PubMed, Medline, Embase, PsychInfo and CINAHL were made up to April 2019 using keywords related to OOC variants and health professions. We accepted any type of full text English publication with no exclusions made on the basis of study quality. Data were extracted using a custom-developed, a priori critical analysis framework comprising themes relating to effectiveness, economics, pedagogy, acceptability and learner experience.

RESULTS

54 articles were included in the review and 46 were of the lowest levels of evidence, and most were offered by institutions based in the United States (n = 11) and United Kingdom (n = 6). Most studies provided insufficient course detail to make any confident claims about participant learning, although studies published from 2016 were more likely to include information around course aims and participant evaluation. In terms of the five categories identified for analysis, few studies provided sufficiently robust evidence to be used in formal decision making in undergraduate or postgraduate curricula.

CONCLUSION

This review highlights a poor state of evidence to support or refute claims regarding the effectiveness of OOCs in health professions education. Health professions educators interested in developing courses of this nature should adopt a critical and cautious position regarding their adoption.

Interdisciplinary in situ simulation-based medical education in the emergency department of a teaching hospital in Nepal

BACKGROUND

Simulation is well established as an effective strategy to train health care professionals in both technical and nontechnical skills and to prevent errors. Despite its known efficacy, adequate implementation is restricted due to the financial burden in resource-limited settings like ours. We therefore pursued to introduce cost-effective in situ simulation (ISS) in the emergency department (ED) to explore its impact on perception and learning experience among multidisciplinary health care professionals and to identify and remediate the latent safety threats (LST).

METHODS

This is a prospective cross-sectional study with a mixed method research design, which was conducted in the ED of Dhulikhel Hospital-Kathmandu University Hospital. The pretest questionnaire was used to determine baseline knowledge, attitude, and confidence of the staff. The ISS with minimal added cost was conducted involving multidisciplinary healthcare workers. The LSTs were recorded and appropriate remediation was performed. Voluntary post simulation feedback was collected after the sessions.

RESULTS

Overall 56 staff participated in at least one of the 35 simulation sessions, among which 45 (80%) responded to the questionnaires`. Twenty participants (45.5%) were reluctant to use the defibrillator. The self-reported confidence level of using defibrillator was low 29 (64.6%). The knowledge score ranged from 0 to 8 with the median score of 3 and a mean of 3.29 ± 1.8. There was no statistically significant difference in knowledge scores among participants of different occupational backgrounds, previous training, duration of work experience, and previous use of a defibrillator. A total of 366 LSTs {individual (43%), medication (17%), equipment (4%), and system/team (36%)} were identified (10.45 LST per ISS). The overall feedback from the participants was positive. Eighty percent of participants reported increased skills to use a defibrillator, and 82% reported increased confidence for managing such cases. They also agreed upon the need and continuity of such type of simulation in their workplace.

CONCLUSIONS

The baseline knowledge score and the confidence level of the staff were low. Self-reported feedback suggested increased confidence level and teamwork skills after ISS. It promoted identification and remediation of latent safety threats. ISS serves as a cost-effective powerful educational model that can be implemented even in settings where finances and space are limited.