A targeted systematic review of cost analyses for implementation of simulation-based education in healthcare

Nursing students' perception of digital technology in clinical education among undergraduate programs: A qualitative systematic review

BACKGROUND

Although past research has highlighted the importance of digital technology in clinical education among undergraduate nursing programs, facilitators and barriers to application still need to be systematically understood.

AIM

The objective of this systematic review is to synthesize existing literature reporting on nursing students' experiences with digital technology in clinical education among undergraduate programs to identify gaps and design future educational programs.

METHODS

We conducted a qualitative systematic review and reported the following Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines. PubMed, Embase, CINAHL, Web of Science databases were searched for studies published in English. Qualitative studies focusing on nursing students' experiences of digital technology in clinical education were included, and data were synthesized by extracting findings, developing categories, and developing synthesized findings.

RESULTS

Six synthesized findings were concluded:1) nature of digital education, 2) facilitators, 3) barriers, 4) benefits to learning, 5) mixed experience, and 6) challenges.

CONCLUSIONS

The systematic review revealed that the utilization of digital technology in clinical practice is beneficial to the learning of undergraduate nursing students. Facilitators and challenges of digital education, as well as barriers to digital education identified in this review can be used to design more effective digital education activities. Digital technology can be used to supplement traditional teaching, and it is worthwhile to explore more in the area of digital education to promote the cultivation of nursing students' competency.

Demystifying the Technology Barriers of Nurse Educators

BACKGROUND

Technology is pivotal in nursing education, with methods such as the flipped classroom, active learning, and patient simulation becoming integral. Despite this, persistent barriers hinder technology's full integration.

METHODS

An online survey collected data from nursing faculty members (n = 1761) in prelicensure nursing programs. The survey assessed their views on technology, barriers, training needs, and importance in classroom and simulation settings.

RESULTS

Participants highlighted financial support, commitment, and administrative support as critical for technology adoption. Statistical analysis of the results revealed differences in the rankings of the importance of technology, emphasizing the significance of these factors. Additionally, time in the classroom was noted as a significant barrier.

CONCLUSIONS

Technology's role in nursing education continues to expand. Overcoming financial constraints and enhancing faculty buy-in are essential for successful technology integration, ultimately, improving informatics competencies and advancing technological nursing education.

Transforming the delivery of care from "I" to "We" by developing the crisis resource management skills in pediatric interprofessional teams to handle common emergencies through simulation

BACKGROUND

The healthcare system is highly complex, and adverse events often result from a combination of human factors and system failures, especially in crisis situations. Crisis resource management skills are crucial to optimize team performance and patient outcomes in such situations. Simulation-based training offers a promising approach to developing such skills in a controlled and realistic environment.

METHODS

This study employed a mixed-methods (quantitative-qualitative) design and aimed to assess the effectiveness of a simulation-based training workshop in developing crisis resource management skills in pediatric interprofessional teams at a tertiary care hospital. The effectiveness of the intervention was evaluated using Kirkpatrick's Model, focusing on reaction and learning levels, employing the Collaboration and Satisfaction about Care Decisions scale, Clinical Teamwork Scale, and Ottawa Global Rating Scale for pre- and post-intervention assessments. Focused group discussions were conducted with the participants to explore their experiences and perceptions of the training.

RESULTS

Thirty-nine participants, including medical students, nurses, and residents, participated in the study. Compared to the participants' pre-workshop performance, significant improvements were observed across all measured teamwork and performance components after the workshop, including improvement in scores in team communication (3.16 ± 1.20 to 7.61 ± 1.0, p < 0.001), decision-making (3.50 ± 1.54 to 7.16 ± 1.42, p < 0.001), leadership skills (2.50 ± 1.04 to 5.44 ± 0.6, p < 0.001), and situation awareness (2.61 ± 1.13 to 5.22 ± 0.80, p < 0.001). No significant variations were observed post-intervention among the different teams. Additionally, participants reported high levels of satisfaction, perceived the training to be highly valuable in improving their crisis resource management skills, and emphasized the importance of role allocation and debriefing.

CONCLUSIONS

The study underscores the effectiveness of simulation-based training in developing crisis resource management skills in pediatric interprofessional teams. The findings suggest that such training can impact learning transfer to the workplace and ultimately improve patient outcomes. The insights from our study offer additional valuable considerations for the ongoing refinement of simulation-based training programs. There is a need to develop more comprehensive clinical skills evaluation methods to better assess the transferability of these skills in real-world settings. The potential challenges unveiled in our study, such as physical exhaustion during training, must be considered when refining and designing such interventions.

Exploring the Distribution of 3D-Printed Simulator Designs Using Open-Source Databases to Facilitate Simulation-Based Learning Through a University and Nonprofit Collaboration: Protocol for a Scoping Review

BACKGROUND

Advancements in technology have enhanced education, training, and application in health care. However, limitations are present surrounding the accessibility and use of simulation technology (eg, simulators) for health profession education. Improving the accessibility of technology developed in university-based research centers by nonprofit organizations (NPOs; eg, hospitals) has the potential to benefit the health of populations worldwide. One example of such technology is 3D-printed simulators.

OBJECTIVE

This scoping review aims to identify how the use of open-source databases for the distribution of simulator designs used for 3D printing can promote credible solutions for health care training while minimizing the risks of commercialization of designs for profit.

METHODS

This scoping review will follow the Arksey and O'Malley methodological framework and the Joanna Briggs Institute guidance for scoping reviews. Ovid MEDLINE, CINAHL, Web of Science, and PsycINFO will be searched with an applied time frame of 2012 to 2022. Additionally, gray literature will be searched along with reference list searching. Papers that explore the use of open-source databases in academic settings and the health care sector for the distribution of simulator designs will be included. A 2-step screening process will be administered to titles and abstracts, then full texts, to establish paper eligibility. Screening and data extraction of the papers will be completed by 2 reviewers (MS and SS) for quality assurance. The scoping review will report information on the facilitation of distributing 3D-printed simulator designs through open-source databases.

RESULTS

The results of this review will identify gaps in forming partnerships with NPOs and university-based research centers to share simulator designs. The scoping review will be initiated in December 2024.

CONCLUSIONS

The information collected will be relevant and useful for stakeholders such as health care providers, researchers, and NPOs for the purpose of overcoming the gaps in research regarding the use and distribution of simulation technology. The scoping review has not been conducted yet. Therefore, there are currently no findings to report on.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/53167.

Implementation of a multi-site neonatal simulation improvement program: a cost analysis

BACKGROUND

To improve patient outcomes and provider team practice, the California Perinatal Quality Care Collaborative (CPQCC) created the Simulating Success quality improvement program to assist hospitals in implementing a neonatal resuscitation training curriculum. This study aimed to examine the costs associated with the design and implementation of the Simulating Success program.

METHODS

From 2017-2020, a total of 14 sites participated in the Simulating Success program and 4 of them systematically collected resource utilization data. Using a micro-costing approach, we examined costs for the design and implementation of the program occurring at CPQCC and the 4 study sites. Data collection forms were used to track personnel time, equipment/supplies, space use, and travel (including transportation, food, and lodging). Cost analysis was conducted from the healthcare sector perspective. Costs incurred by CPQCC were allocated to participant sites and then combined with site-specific costs to estimate the mean cost per site, along with its 95% confidence interval (CI). Cost estimates were inflation-adjusted to 2022 U.S. dollars.

RESULTS

Designing and implementing the Simulating Success program cost $228,148.36 at CPQCC, with personnel cost accounting for the largest share (92.2%), followed by program-related travel (6.1%), equipment/supplies (1.5%), and space use (0.2%). Allocating these costs across participant sites and accounting for site-specific resource utilizations resulted in a mean cost of $39,210.69 per participant site (95% CI: $34,094.52-$44,326.86). In sensitivity analysis varying several study assumptions (e.g., number of participant sites, exclusion of design costs, and useful life span of manikins), the mean cost per site changed from $35,645.22 to $39,935.73. At all four sites, monthly cost of other neonatal resuscitation training was lower during the program implementation period (mean = $1,112.52 per site) than pre-implementation period (mean = $2,504.01 per site). In the 3 months after the Simulating Success program ended, monthly cost of neonatal resuscitation training was also lower than the pre-implementation period at two of the four sites.

CONCLUSIONS

Establishing a multi-site neonatal in situ simulation program requires investment of sufficient resources. However, such programs may have financial and non-financial benefits in the long run by offsetting the need for other neonatal resuscitation training and improving practice.

Realistic simulation and medical students' performance in the Advanced Cardiac Life Support course: a comparative study

Clinical practice has benefited from new methodologies such as realistic simulation (RS). RS involves recreating lifelike scenarios to more accurately reflect real clinical practice, enhancing learners' skills and decision-making within controlled environments, and experiencing remarkable growth in medical education. However, RS requires substantial financial investments and infrastructure. Hence, it is essential to determine the effectiveness of RS in the development of skills among medical students, which will improve the allocation of resources while optimizing learning. This cross-sectional study was carried out in the simulation laboratory of a medical school, and the performance of students who underwent two different curriculum matrices (without RS and with RS, from 2021 to 2022) in the Advanced Cardiac Life Support (ACLS) course was compared. This test was chosen considering that the competencies involved in cardiac life support are essential, regardless of the medical specialty, and that ACLS is a set of life-saving protocols used worldwide. We observed that the impact of RS can be different for practical abilities when compared with the theoretical ones. There was no correlation between the general academic performance and students' grades reflecting the RS impact. We conclude that RS leads to less remediation and increased competence in practical skills. RS is an important learning strategy that allows repeating, reviewing, and discussing clinical practices without exposing the patient to risks.NEW & NOTEWORTHY Realistic simulation (RS) positively affected the performance of the students differently; it had more influence on practical abilities than theoretical knowledge. No correlation between the general academic performance and grades of the students without RS or with RS was found, providing evidence that RS is an important tool in Advanced Cardiac Life Support education.

Preparing for practice, the effects of repeated immersive simulation on the knowledge and self-efficacy of undergraduate nursing students: A mixed methods study

AIM

The aim of this study was to compare the effects of two immersive simulation-based education instructional designs, immersive simulation with team deliberate practice and immersive repeated standard simulation, when delivered over the same time on the knowledge and self-efficacy of nursing students.

BACKGROUND

Implementing immersive simulation-based education is not without its resource challenges, making it prohibitive for simulation educators to include it in their curricula. Subsequently, there is a need to identify instructional designs that meet these challenges.

DESIGN

A two-stage mixed methods approach was used to compare the two instructional designs.

METHODS

In stage one, data were collected using questionnaires and differences estimated using analysis of covariance. In stage two, data were collected from two focus groups and analysed using a qualitative content analysis approach. Data were collected as part of a doctoral study completed in 2019 and was analysed for this study between 2022 and 2023. The justification for this study was that the identification of effective designs for immersive simulation remains a key research priority following the increase in allowable simulation hours by the Nursing and Midwifery Council.

RESULTS

In stage one, there was no statistical significance in the participant's knowledge or self-efficacy between the models. In stage two, four themes were identified: vulnerability, development of knowledge, development of self-efficacy and preparation for placement. In contrast to stage one, participants reported that the repeated nature of both designs reinforced their knowledge base increased their self-efficacy, reduced their anxiety levels, and helped them to prepare for placement.

CONCLUSION

The results inferred that both designs had a positive impact on the participants. Overall, participants reported that it helped them prepare for placements. Based on the findings, wherever possible, repeated immersive simulation-based education designs should be used and not a standalone immersive simulation-based education scenarios. If resources allow, this could be either a repeated scenario, or if there are resource constraints to use, over the same time, immersive simulation with team deliberate practice, or a similar model. Thus, giving a potential return on investment, one that supports simulation educators making those sensitive decisions regarding the inclusion of immersive simulation with team deliberate practice in their curriculum. Further research is needed into this area to ascertain the design features that maximise this impact and support a move away from standalone scenarios to an approach that uses repetitive immersive simulation.

An accelerated dispensing course for grad entry students - Can we teach dispensing skills over a day?

BACKGROUND AND PURPOSE

This study aimed to evaluate an accelerated dispensing course for graduate entry (GE) pharmacy students with prior science-related degrees to join undergraduate (UG) students in year three of the Monash Pharmacy degree.

EDUCATIONAL ACTIVITY AND SETTING

A one day accelerated dispensing course using MyDispense software was delivered to 59 GE students. The accelerated dispensing course was identical to the standard three-week dispensing course delivered to UG students. The same assessment of dispensing skills was conducted after course completion for both UG and GE students and included dispensing four prescriptions of varying difficulty. The assessment scores of the UG and GE students were compared. Perception data from the accelerated course were also collected.

FINDINGS

The accelerated dispensing curriculum was well received by students. They found the simulation relevant to practice, easy to navigate, and helpful for preparing them for assessment. Overall, 5.1% of GE students failed the assessment, which was lower than the 32.6% failure rate in the UG cohort. Comparison of assessment grades between UG and GE students showed no notable disadvantage to attainment of learning outcomes with the accelerated curriculum. However, UG students were more likely to provide unsafe instructions compared to GE students in their labeling for three out of four prescriptions.

SUMMARY

An accelerated dispensing curriculum can be effectively delivered to mature learners with a prior science-related degree as no notable deficiencies were identified when comparing the assessment results of GE students against UG students when both student cohorts undertook the same dispensing assessment.

'It's not everybody's snapshot. It's just an insight into that world': A qualitative study of multiple perspectives towards understanding the mental health experience and addressing stigma in healthcare students through virtual reality

Objective

The resurgence of virtual reality (VR) technologies has led to their increased use in contemporary healthcare education. One promising application is simulating the experiences of individuals with mental health conditions (MHCs) to reduce stigma among future healthcare professionals. This study set out to explore what those impacted by, or involved in, the education of healthcare students think about using VR in this way.

Methods

One individual interview and five focus groups were conducted with healthcare students (n = 7), healthcare educators (n = 6), and lived experience experts (n = 5). Before sharing their perspectives, participants familiarised themselves with VR equipment and immersive materials simulating MHCs. The constant comparative method and thematic analysis were used to analyse the data.

Results

Participants recognised the acceptability and utility of VR for addressing mental health stigma in healthcare students, emphasising the immersive nature of this technology. However, some participants raised concerns about the limited insight VR could provide into the experiences of patients with the same MHCs and its potential emotional impact on users. Participants recommended the incorporation of interactive, realistic environments with a person-centred focus into future VR-based stigma reduction interventions while stressing the importance of providing healthcare students with opportunities for reflection and support.

Conclusions

Healthcare students, healthcare educators, and lived experience experts highlighted both advantages and barriers associated with using VR to understand the experience of patients with MHCs. Furthermore, the recommendations put forward can inform the design, content, and delivery of VR-based stigma reduction interventions in healthcare education.

A cost analysis of a 5-day simulation-based learning program for speech-language pathology student training

Purpose: There is poor reporting of the cost of simulation and greater transparency is needed. The primary study aim was to conduct a financial analysis of the university/training institution costs associated with a 5-day simulation-based learning program for speech-language pathology students. The secondary aim was to consider the economic costs of the model.Method: Costs associated with the delivery of a 5-day simulation-based learning program for speech-language pathology students from six Australian universities were collected regarding: (a) pre-program training, (b) personnel, (c) room hire, (d) equipment, and (e) consumables. Both financial costs and economic costs (Australian dollar, at June 2017) were calculated per university site, and per student.Result: The simulation program was run 21 times involving 176 students. Average total financial cost per program ranged from $4717 to $11 425, with cost variation primarily attributed to local labour costs and various use of in-kind support. Average financial cost per student was $859 (range $683-$1087), however this was almost double ($1461 per student, range $857-$2019) in the economic cost calculation. Personnel was the largest contributing cost component accounting for 76.6% of financial costs. Personnel was also the highest contributing cost in the economic analysis, followed by room hire.Conclusion: This study provides clarity regarding financial and economic costing for a 5-day simulation-based learning program. These data can help universities consider potential up-front financial costs, and well as strategies for financial cost minimisation, when implementing simulation-based learning within the university context.

The Efficacy and Cost-Effectiveness of a Simulation-Based Primary Care Procedural Skills Training Program for Advanced Practice Providers

INTRODUCTION

The purpose of this program evaluation was to investigate the efficacy of simulation-based primary care procedural skills training to increase participant confidence, knowledge, and skill in performing the procedures included in the training and to evaluate the cost-effectiveness of the training.

METHODS

A retrospective, within-subjects analysis of the change in perceived confidence, skill, and knowledge in procedure performance after the simulation-based primary care procedural skills training program measured by pretraining and post-training Likert scale surveys and change in clinical procedure performance frequency for abscess incision and drainage and laceration repair up to 6 months before and 6 months after the training in the outpatient setting was performed.

RESULTS

Participants self-reported higher median confidence, perceived skill, and perceived knowledge of all procedures included in the training course, with statistically significant increases for all procedures. A mean increase in laceration repairs in the clinical setting of 10% after training was found. Higher median performance of abscess incision and drainage after training (median = 20.00%, n = 25) compared with before training (median = 0.00%, n = 25) and a mean increase in performance of abscess incision and drainage in the clinical setting of 6% after training was found, but increases were not statistically significant.

DISCUSSION

Participation in a 2-day simulation-based primary care procedural skills training program was an effective method to increase confidence, perceived skill, and knowledge of outpatient procedures among practicing providers. Further evaluation to establish return on investment is needed, because statistically significant increases in clinical procedure performance were unable to be demonstrated.

High-fidelity virtual reality simulation training in enhancing competency assessment in orthopaedic training

Surgical competence is the ability to successfully apply academic knowledge, clinical skills and professional behaviour to inpatient care. Along with ensuring patient safety, the ability to communicate effectively, collaborative teamwork and probity, and achieving satisfactory competencies form the fundamental principles of good medical practice. Current strategies to develop surgical competencies include a range of formative and summative assessments. The cancellation of traditional face-to-face meetings and training opportunities during the COVID-19 pandemic had a profound impact on the delivery of medical education and opportunities to achieve surgical competencies. Simulation learning has been used since before the pandemic to deliver surgical training across all grades and specialities, including orthopaedic surgery. Simulation-based training provides a safe, controlled environment to develop skill acquisition. Simulated surgery using virtual reality has evolved following developments in software and hardware. This article explores the role of high-fidelity virtual reality simulation to assess competencies in orthopaedic training in the post-COVID-19 era, and examines whether simulation could be used within the curriculum to augment and improve training.

Development of pediatric simulation-based education - a systematic review

BACKGROUND

This systematic literature review explored the general characteristics, validation, and reliability of pediatric simulation-based education (P-SBE).

METHODS

A literature search was conducted between May 23 and 28 using the PRISMA guidelines, which covered databases such as MEDLINE, EMBASE, CINAHL, and Cochrane Library. In the third selection process, the original texts of 142 studies were selected, and 98 documents were included in the final content analysis.

RESULTS

A total of 109 papers have been published in the ten years since 2011. Most of the study designs were experimental studies, including RCT with 76 articles. Among the typologies of simulation, advanced patient simulation was the most common (92), and high-fidelity simulation was the second most common (75). There were 29 compatibility levels and professional levels, with 59 scenarios related to emergency interventions and 19 scenarios related to communication feasibility and decision making. Regarding the effect variable, 65 studies confirmed that skills were the most common. However, validity of the scenarios and effect variables was not verified in 56.1% and 67.3% of studies, respectively.

CONCLUSION

Based on these findings, simulation based-education (SBE) is an effective educational method that can improve the proficiency and competence of medical professionals dealing with child. Learning through simulation provides an immersive environment in which learners interact with the presented patient scenario and make decisions, actively learning the attitudes, knowledge, and skills necessary for medical providers. In the future, it is expected that such research on SBE will be actively followed up and verified for its validity and reliability.

Technology-enhanced simulation in emergency medicine: Updated systematic review and meta-analysis 1991-2021

Background

Over the past decade, the use of technology-enhanced simulation in emergency medicine (EM) education has grown, yet we still lack a clear understanding of its effectiveness. This systematic review aims to identify and synthesize studies evaluating the comparative effectiveness of technology-enhanced simulation in EM.

Methods

We searched MEDLINE, EMBASE, PsycINFO, CINAHL, ERIC, Web of Science, and Scopus to identify EM simulation research that compares technology-enhanced simulation with other instructional modalities. Two reviewers screened articles for inclusion and abstracted information on learners, clinical topics, instructional design features, outcomes, cost, and study quality. Standardized mean difference (SMD) effect sizes were pooled using random effects.

Results

We identified 60 studies, enrolling at least 5279 learners. Of these, 23 compared technology-enhanced simulation with another instructional modality (e.g., living humans, lecture, small group), and 37 compared two forms of technology-enhanced simulation. Compared to lecture or small groups, we found simulation to have nonsignificant differences for time skills (SMD 0.33, 95% confidence interval [CI] -0.23 to 0.89, n = 3), but a large, significant effect for non-time skills (SMD 0.82, 95% CI 0.18 to 1.46, n = 8). Comparison of alternative types of technology-enhanced simulation found favorable associations with skills acquisition, of moderate magnitude, for computer-assisted guidance (compared to no computer-assisted guidance), for time skills (SMD 0.50, 95% CI -1.66 to 2.65, n = 2) and non-time skills (SMD 0.57, 95% CI 0.33 to 0.80, n = 6), and for more task repetitions (time skills SMD 1.01, 95% CI 0.16 to 1.86, n = 2) and active participation (compared to observation) for time skills (SMD 0.85, 95% CI 0.25 to 1.45, n = 2) and non-time skills (SMD 0.33 95% CI 0.08 to 0.58, n = 3).

Conclusions

Technology-enhanced simulation is effective for EM learners for skills acquisition. Features such as computer-assisted guidance, repetition, and active learning are associated with greater effectiveness.

Teaching strategies of clinical reasoning in advanced nursing clinical practice: A scoping review

AIM/OBJECTIVE

To report and synthesize the main strategies for teaching clinical reasoning described in the literature in the context of advanced clinical practice and promote new areas of research to improve the pedagogical approach to clinical reasoning in Advanced Practice Nursing.

BACKGROUND

Clinical reasoning and clinical thinking are essential elements in the advanced nursing clinical practice decision-making process. The quality improvement of care is related to the development of those skills. Therefore, it is crucial to optimize teaching strategies that can enhance the role of clinical reasoning in advanced clinical practice.

DESIGN

A scoping review was conducted using the framework developed by Arksey and O'Malley as a research strategy. Consistent with the nature of scoping reviews, a study protocol has been established.

METHODS

The studies included and analyzed in this scoping review cover from January 2016 to June 2022. Primary studies and secondary revision studies, published in biomedical databases, were selected, including qualitative ones. Electronic databases used were: CINAHL, PubMed, Cochrane Library, Scopus, and OVID. Three authors independently evaluated the articles for titles, abstracts, and full text.

RESULTS

1433 articles were examined, applying the eligibility and exclusion criteria 73 studies were assessed for eligibility, and 27 were included in the scoping review. The results that emerged from the review were interpreted and grouped into three macro strategies (simulations-based education, art and visual thinking, and other learning approaches) and nineteen educational interventions.

CONCLUSIONS

Among the different strategies, the simulations are the most used. Despite this, our scoping review reveals that is necessary to use different teaching strategies to stimulate critical thinking, improve diagnostic reasoning, refine clinical judgment, and strengthen decision-making. However, it is not possible to demonstrate which methodology is more effective in obtaining the learning outcomes necessary to acquire an adequate level of judgment and critical thinking. Therefore, it will be necessary to relate teaching methodologies with the skills developed.

Impact of scenario validity and group size on learning outcomes in high-fidelity simulation: A systematics review and meta-analysis

OBJECTIVES

To determine the effects related to scenario validity and group size in high-fidelity simulation among undergraduate nursing students.

DESIGN

A systematic review and meta-analysis of randomized controlled trials and quasi-experiment.

DATA SOURCES

Embase, PubMed, Web of Science, Wangfang database, and Cochrane Library, China National Knowledge Infrastructure were searched from the start of each database to February 22, 2022. The references and citations lists were manually screened to find additional references.

REVIEW METHODS

Screening and quality assessment of the retrieved studies were conducted independently by two authors. Discussions with a third author sorted out any discrepancies between the two authors. Using meta-analysis procedures based on a random-effect model, outcome data were synthesized and standard mean difference was computed with a 95 % confidence interval.

RESULTS

Thirty-three studies were included. A total 4077 undergraduate nursing students were recruited, of which 2068 participated in experimental groups. High-fidelity simulation with scenario validity was better than high-fidelity simulation without scenario validity in cultivating undergraduate nursing students' knowledge (p = 0.03), and they were equivalent in improving students' skills (p = 0.75). Groups of six or fewer students in each high-fidelity simulation tend to be more effective at promoting knowledge (standard mean difference = 0.98) and skill (standard mean difference = 1.00), but the differences were not statistically significant.

CONCLUSIONS

High-fidelity simulation with scenario validity and with less than six students in each group can be more effective in cultivating knowledge and skills among undergraduate nursing students. For high-fidelity simulation to be as effective as possible, nursing instructors should ensure scenario validity and limit the number of students in each group to under six.

Filipino nursing students' use of low-cost simulators during the COVID-19 pandemic: A summative content analysis of YouTube videos

This study examined Filipino nursing students' use of household materials as low-cost simulators and how they aid in online return demonstrations. Summative content analysis guided this study. We collected uploaded YouTube videos (n = 14) depicting Filipino nursing students using low-cost simulators in their skills demonstration. We used Bengtsson's approach to content analysis to analyze the data. Four themes of low-cost simulators were identified: home and hardware, health and beauty, creative articles, and entertainment. The categories under home and hardware were tools, containers, furniture, and packaging. Health and beauty low-cost simulators were toiletries and medical supplies. Creative articles included fabrics, clothing accessories, and stationeries. Entertainment low-cost-simulators had toys and computer accessories. During the COVID-19 pandemic, our research uncovered home equipment employed as low-cost simulators to help nursing students' online simulation of skills demonstration. We recommend further investigation of whether students learned using low-cost simulators.

Dyad learning versus individual learning under medical simulation conditions: a systematic review

Background: Dyad learning is a two-person learning dynamic in which one student observes the other performing tasks, with their roles then being reversed such that both students experience the observer and the performer role. The efficacy of dyad learning has been tested in medical education contexts, such as in medical simulation. To our knowledge, this is the first systematic review that has evaluated the efficacy of dyad learning in a medical simulation context. Methods: PubMed, Google Scholar, Cochrane Library databases were searched in September 2021 and January 2022. Prospective studies of randomized design that compared dyad learning to a single medical student or physician learning in a medical simulation were included. Non-English language studies, secondary literature papers, non-human based studies, and papers that were published prior to 2000 were excluded. The methodological quality of these studies was assessed using the Medical Education Research Study Quality Instrument (MERSQI). The Kirkpatrick model was used to conceptualize study outcomes. Results: The identified papers included eight studies from four countries that totaled 475 participants. Students reported positively on their experiences as dyads, especially regarding the social aspects of it. Studies showed non-inferior learning outcomes for dyads. As most studies were one or two days long, there is limited evidence that this non-inferiority extends to longer term training modules. There is some evidence to suggest that dyad learning outcomes may be replicable in a clinical context following simulation training. Conclusions: Dyad learning in medical simulation is a pleasant experience for students and may be as effective as conventional learning. These findings set the foundation for future studies of longer duration, which is needed to determine the efficacy of dyad learning in lengthier curriculums and long-term knowledge retention. While cost-reduction is an implied benefit, studies that explicate cost reduction are needed to formalize this.

"Important but risky": attitudes of global thought leaders towards cost and value research in health professions education

Studies of cost and value can inform educational decision making, yet our understanding of the barriers to such research is incomplete. To address this gap, our aim was to explore the attitudes of global thought leaders in HPE towards cost and value research. This was a qualitative virtual interview study underpinned by social constructionism. In telephone or videoconference interviews in 2018-2019, we asked global healthcare professional thought leaders their views regarding HPE cost and value research, outstanding research questions in this area and why addressing these questions was important. Analysis was inductive and thematic, and incorporated review and comments from the original interviewees (member checking). We interviewed 11 thought leaders, nine of whom gave later feedback on our data interpretation (member checking). We identified four themes: Cost research is really important but potentially risky (quantifying and reporting costs provides evidence for decision-making but could lead to increased accountability and loss of autonomy); I don't have the knowledge and skills (lack of economic literacy); it's not what I went into education research to do (professional identity); and it's difficult to generate generalizable findings (the importance of context). This study contributes to a wider conversation in the literature about cost and value research by bringing in the views of global HPE thought leaders. Our findings provide insight to inform how best to engage and empower educators and researchers in the processes of asking and answering meaningful, acceptable and relevant cost and value questions in HPE.

The Use of Simulation-Based Education With New Graduate Nurses in Emergency Department and Acute Care Settings: A Scoping Review

Background The literature questions if newly graduated nurses are truly ready to practice at the bedside. Simulation has been shown to bridge the gap between theory and practice. The purpose of this study was to investigate what is known about the use of simulation education with novice graduate nurses in critical care settings in the hospital. Method A scoping review was conducted using the PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Articles published in English between 2015 and September 2021 that focused on simulation education with novice graduate nurses in a critical care setting were included. Results The review yielded six articles. Conclusion The literature is scant on the use of simulation in critical care areas with novice graduate nurses. Additional inquiry is needed related to the role of learners, cost, timing, setting, and educational practices. More studies with stronger research designs and valid and reliable measurement instruments are also needed. Finally, there is a need to better understand the effects of simulation on novice nurse graduates' knowledge and skills as well as patient outcomes. [J Contin Educ Nurs. 2022;53(7):301-306.].

Digital Education for Health Professionals: An Evidence Map, Conceptual Framework, and Research Agenda

BACKGROUND

Health professions education has undergone major changes with the advent and adoption of digital technologies worldwide.

OBJECTIVE

This study aims to map the existing evidence and identify gaps and research priorities to enable robust and relevant research in digital health professions education.

METHODS

We searched for systematic reviews on the digital education of practicing and student health care professionals. We searched MEDLINE, Embase, Cochrane Library, Educational Research Information Center, CINAHL, and gray literature sources from January 2014 to July 2020. A total of 2 authors independently screened the studies, extracted the data, and synthesized the findings. We outlined the key characteristics of the included reviews, the quality of the evidence they synthesized, and recommendations for future research. We mapped the empirical findings and research recommendations against the newly developed conceptual framework.

RESULTS

We identified 77 eligible systematic reviews. All of them included experimental studies and evaluated the effectiveness of digital education interventions in different health care disciplines or different digital education modalities. Most reviews included studies on various digital education modalities (22/77, 29%), virtual reality (19/77, 25%), and online education (10/77, 13%). Most reviews focused on health professions education in general (36/77, 47%), surgery (13/77, 17%), and nursing (11/77, 14%). The reviews mainly assessed participants' skills (51/77, 66%) and knowledge (49/77, 64%) and included data from high-income countries (53/77, 69%). Our novel conceptual framework of digital health professions education comprises 6 key domains (context, infrastructure, education, learners, research, and quality improvement) and 16 subdomains. Finally, we identified 61 unique questions for future research in these reviews; these mapped to framework domains of education (29/61, 47% recommendations), context (17/61, 28% recommendations), infrastructure (9/61, 15% recommendations), learners (3/61, 5% recommendations), and research (3/61, 5% recommendations).

CONCLUSIONS

We identified a large number of research questions regarding digital education, which collectively reflect a diverse and comprehensive research agenda. Our conceptual framework will help educators and researchers plan, develop, and study digital education. More evidence from low- and middle-income countries is needed.

Translation of an evidence-based virtual reality simulation-based interprofessional education into health education curriculums: An implementation science method

BACKGROUND

The development of interprofessional competencies through an evidence-based program is paramount to nurture a collaborative practice-ready workforce for patient-centered care and safety.

AIMS

To describe an implementation science approach for translation of an evidence-based virtual reality simulation-based interprofessional education (VR-Sim-IPE) program into medical and nursing curriculums, and to evaluate the implementation outcomes.

METHODS

Implementation strategies from the "Expert Recommendations for Implementing Change" were used to support implementation of the VR-Sim-IPE program. This included recruiting and training 28 practicing clinicians as facilitators to deliver the program to 599 medical and nursing students. Proctor's conceptual framework for implementation outcomes was applied with multiple data collection methods to evaluate the VR-Sim-IPE program. An online survey was administered to measure the levels of acceptability, appropriateness, feasibility, and adoption. Forty-four sessions of structured observations were carried out to examine the facilitators' implementation fidelity. Individual interviews were conducted with 15 facilitators to identify the facilitators and barriers to the program implementation. An implementation cost analysis was also conducted.

RESULTS

Both facilitators and students had positive perceptions of the acceptability, adoption, appropriateness, and feasibility of the VR-Sim-IPE program. Facilitators were observed to implement the program with high fidelity, including program adherence, dosage, quality of delivery, and student responsiveness. While opportunities to contribute and learn, as well as receiving training and support, were identified as facilitators to implementation, the lack of familiarity with the virtual environment, varying levels of student participation, and facilitating interprofessional groups were reported barriers. The implementation costs amounted to USD45,648.50.

CONCLUSION

The evaluation of implementation outcomes identifies strategies for future implementation that could potentially enhance program acceptance, reduce implementation cost, improve penetration, and achieve program sustainability. These include increasing facilitation group size, preparing students to be active participants, and incorporating interprofessional facilitation skills in facilitators' training.

A Qualitative Assessment of Studies Evaluating the Classification Accuracy of Personnel Using START in Disaster Triage: A Scoping Review

Background

Mass casualty incidents (MCIs) can occur as a consequence of a wide variety of events and often require overwhelming prehospital and emergency support and coordinated emergency response. A variety of disaster triage systems have been developed to assist health care providers in making difficult choices with regards to prioritization of victim treatment. The simple triage and rapid treatment (START) triage system is one of the most widely used triage algorithms; however, the research literature addressing real-world or simulation studies documenting the classification accuracy of personnel using START is lacking.

Aims and Objectives

To explore the existing literature related to the current state of knowledge about studies assessing the classification accuracy of the START triage system.

Design

Scoping review based on Arksey and O'Malley's methodological framework and narrative synthesis based on methods described by Popay and colleagues were performed.

Results

The literature search identified 1,820 citations, of which 32 studies met the inclusion criteria. Thirty were peer-reviewed articles and 28 published in the last 10 years (i.e., 2010 and onward). Primary research studies originated in 13 countries and included 3,706 participants conducting triaging assessments involving 2,950 victims. Included studies consisted of five randomized controlled trials, 17 non-randomized controlled studies, eight descriptive studies, and two mixed-method studies. Simulation techniques, mode of delivery, contextual features, and participants' required skills varied among studies. Overall, there was no consistent reporting of outcomes across studies and results were heterogeneous. Data were extracted from the included studies and categorized into two themes: (1) typology of simulations and (2) START system in MCIs simulations. Each theme contains sub-themes regarding the development of simulation employing START as a system for improving individuals' preparedness. These include types of simulation training, settings, and technologies. Other sub-themes include outcome measures and reference standards.

Conclusion

This review demonstrates a variety of factors impacting the development and implementation of simulation to assess characteristics of the START system. To further improve simulation-based assessment of triage systems, we recommend the use of reporting guidelines specifically designed for health care simulation research. In particular, reporting of reference standards and test characteristics need to improve in future studies.

Neonatal Simulation Program: A 5 Years Educational Journey From Qatar

We describe the process of implementation, adaptation, expansion and some related clinical intuitional impacts of the neonatal simulation program since its launch in 2016 in a non-simulation neonatal unit. The team has developed 6 types of curricula: 1 full-day course and 5 half-day workshops. A total of 35 free of charge simulation courses/workshops were conducted, 32 in Qatar and 3 abroad with a total of 799 diverse participants. There was a steady increase in the overall success rate of PICC insertion from 81.7% (309/378) to 97.6% (439/450) across 3 years (P < 0.0001). The first attempt PICC insertion success rate has been also increased from 57.7% (218/378) to 66.9% (301/450) across 3 years. The mean duration of PICC insertion has been improved from 39.7 ± 25 to 34.9 ± 12.4 min after implementing the program (P = 0.33). The mean duration of the LISA catheter insertion at the beginning of the workshop was 23.5 ± 15.9 compared to 12.1 ± 8.5 s at the end of the workshop (P = 0.001). When it came to clinical practise in real patients by the same participants, the overall LISA catheter insertion success rate was 100% and the first attempt success rate was 80.4%. The mean duration of LISA catheter insertion in real patients was 26.9 ± 13.9 s compared to the end of the workshop (P = 0.001). The mean duration of the endotracheal intubation at the beginning of the workshop was 12.5 ± 9.2 compared to 4.2 ± 3.8 s at the end of the workshop (P = 0.001). In real patients, the first-attempt intubation success rate has been improved from 37/139 (26.6%) in the first year to 141/187 (75.5%) in the second year after the program implementation (P = 0.001). The mean duration of successful endotracheal intubation attempts has been improved from 39.1 ± 52.4 to 20.1 ± 9.9 s (P = 0.78). As per the participants, the skills learned in the program sessions help in protecting neonates from potential harm and improve the overall neonatal outcome. Implementing a neonatal simulation program is a promising and feasible idea. Our experience can be generalised and replicated in other neonatal care institutions.

Reassuringly expensive - A commentary on obstetric emergency training in high-resource settings

The pathophysiologic origins of obstetrical emergencies are complicated and may well be influenced by events prior to conception. Such problems are not likely to be resolved soon, and in the meantime, high-resource countries simply cannot afford to divert more and more money to litigation and the costs of preventable morbidities for either mother or child. It is long past time we tackled these acute care problems where most first occur-the Maternity unit. It is reasonable to ask whether hospitals (and society at large) are getting what they believe they are buying. Training to satisfy a regulation without improving patient outcomes functionally erects one more barrier to the pursuit of optimal patient outcomes. Why then continue squandering limited resources and precious lives if current hospital training is not improving outcomes? In this monograph, I focus on training programs for the management of obstetrical emergencies.

Cost-effectiveness of a quality improvement project, including simulation-based training, on reducing door-to-needle times in stroke thrombolysis

BACKGROUND

Rapid revascularisation in acute ischaemic stroke is crucial to reduce its total burden including societal costs. A quality improvement (QI) project that included streamlining the stroke care pathway and simulation-based training was followed by a significant reduction in median door-to-needle time (27 to 13 min) and improved patient outcomes after stroke thrombolysis at our centre. Here, we present a retrospective cost-effectiveness analysis of the QI project.

METHODS

Costs for implementing and sustaining QI were assessed using recognised frameworks for economic evaluations. Effectiveness was calculated from previously published outcome measures. Cost-effectiveness was presented as incremental cost-effectiveness ratios including costs per minute door-to-needle time reduction per patient, and costs per averted death in the 13-month post-intervention period. We also estimated incremental cost-effectiveness ratios for a projected 5-year post-intervention period and for varying numbers of patients treated with thrombolysis. Furthermore, we performed a sensitivity analysis including and excluding costs of unpaid time.

RESULTS

All costs including fixed costs for implementing the QI project totalled US$44 802, while monthly costs were US$2141. We calculated a mean reduction in door-to-needle time of 13.1 min per patient and 6.36 annual averted deaths. Across different scenarios, the estimated costs per minute reduction in door-to-needle time per patient ranged from US$13 to US$29, and the estimated costs per averted death ranged from US$4679 to US$10 543.

CONCLUSIONS

We have shown that a QI project aiming to improve stroke thrombolysis treatment at our centre can be implemented and sustained at a relatively low cost with increasing cost-effectiveness over time. Our work builds on the emerging theory and practice for economic evaluations in QI projects and simulation-based training. The presented cost-effectiveness data might help guide healthcare leaders planning similar interventions.

Defining Priority Areas for Critical Care Simulation: A Modified Delphi Consensus Project

Background Simulation is used in critical care for skill development, formative assessment, and interprofessional team performance. Healthcare educators need to balance the relatively high cost to deliver simulation education with the potential impact on healthcare quality. It is unclear how to prioritize simulation in critical care education, especially considering interprofessional needs across adult and pediatric populations. The objective of this study was to prioritize topics for critical care educators developing simulation-based educational interventions. Methodology A modified Delphi process was used to identify and prioritize critical care topics taught using simulation. We disseminated a multi-institutional survey to understand critical care simulation topics using a three-round modified Delphi technique. An expert panel was recruited based on their expertise with simulation-based education through the Society for Simulation in Healthcare and the Society of Critical Care Medicine lists. Critical care topics originated using content derived from multiple critical care board examination contents. Additional content for a critical care simulation-based curriculum was generated. Results Consensus and prioritization were achieved in three rounds, with 52 simulation experts participating. The first Delphi round surveyed priority topics in critical care content and generated additional topics for inclusion in round two. The second Delphi round added the content with the highest-ranked items from round one to generate a set of simulation-based topic priorities. The third Delphi round asked participants to determine the importance of each priority item taught via simulation compared to other modalities for clinical education. This round yielded 106 topics over four domains categorized into (1) Diagnosis and Management of Clinical Problems, (2) Procedural Skills, (3) Teamwork and Communication Skills, and (4) General Knowledge and Knowledge of Technical Adjuncts. Conclusions The modified Delphi survey revealed a prioritized, consensus-based list of topics and domains for critical care educators to focus on when creating a simulation-based critical care curriculum. Future work will focus on developing specific simulation-based critical care curricula.