Development and Implementation of Augmented Reality Enhanced High-Fidelity Simulation for Recognition of Patient Decompensation

Innovative Technology to Improve Simulation Access for Rural Clinicians

Rural pediatric clinicians face barriers to accessing health care simulation, an educational standard to prepare for high-acuity, low-occurrence (HALO) events. Simulation is typically accessible in urban academic medical centers, as it is resource-intensive owing to the necessary equipment and expertise needed to implement training. Rural hospitals face geographic and financial barriers to providing simulation training. Paradoxically, rural clinicians may benefit from additional training owing to infrequent clinical HALO events in rural centers. Emerging simulation modalities, including mobile simulation, telesimulation, and extended reality, offer more accessible simulation alternatives for rural clinicians, addressing geographic and financial gaps in access.

The impact of surgical simulation and training technologies on general surgery education

The landscape of general surgery education has undergone a significant transformation over the past few years, driven in large part by the advent of surgical simulation and training technologies. These innovative tools have revolutionized the way surgeons are trained, allowing for a more immersive, interactive, and effective learning experience. In this review, we will explore the impact of surgical simulation and training technologies on general surgery education, highlighting their benefits, challenges, and future directions. Enhancing the technical proficiency of surgical residents is one of the main benefits of surgical simulation and training technologies. By providing a realistic and controlled environment, With the use of simulations, residents may hone their surgical skills without compromising patient safety. Research has consistently demonstrated that training with simulations enhances surgical skills., reduces errors, and enhances overall performance. Furthermore, simulators can be programmed to mimic a wide range of surgical scenarios, enabling residents to cultivate the essential critical thinking and decision-making abilities required to manage intricate surgical cases. Another area of development is incorporating simulation-based training into the wider surgical curriculum. As simulation technologies become more widespread, they will need to be incorporated into the fabric of surgical education, rather than simply serving as an adjunct to traditional training methods. This will require a fundamental shift in the way surgical education is delivered, with a greater emphasis on simulation-based training and assessment.

A Comparison of Virtual Reality to Traditional Simulation in Health Professions Education: A Systematic Review

ABSTRACT

With the increasing availability of virtual reality (VR) and its lower overall costs of use, the objective of this review was to compare VR to traditional simulation in terms of learning outcomes. Studies were included if they met the following criteria: ( a ) research study (of any design), ( b ) focused on learners in health professions, and ( c ) compared VR with traditional simulation. Studies were excluded for the following reasons: ( a ) not a research study, ( b ) focused on learners outside health professions, ( c ) used screen-based or computer-based simulation, ( d ) used a task trainer, and ( e ) did not involve a comparison of VR to traditional simulation. The searches were run on November 11 and 12, 2021, in CINAHL via EBSCO, Ovid Embase, ERIC via EBSCO, IEEE Xplore, Ovid Medline, Ovid PsycINFO, Scopus, and Web of Science Core Collection. Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines guided the review. A team of researchers applied Kirkpatrick's Levels, Melnyk's Levels of Evidence, and Critical Appraisal Skills Programme guidelines to assess the level of evidence and look for bias. Fifteen studies were reviewed including 11 randomized controlled trials. The lead researcher synthesized the study results into 3 categories: (1) traditional simulation performed better, (2) VR performed better, and (3) comparable outcomes. There is insufficient evidence to endorse one form of simulation (VR or traditional) as more effective at this time. The body of evidence contained too few studies to draw meaningful conclusions to answer the guiding question. The studies covered a large range of modalities, learner groups, and healthcare topics, preventing a meta-analysis. Based on the literature and experience, we recommend that VR experiences be proctored, include debriefing, have a backup plan for cybersickness or myopia, and have time and costs documented. Use of VR is likely to expand; thus, research is needed to inform the best contexts and applications.

Virtual and augmented reality in intensive care medicine: a systematic review

BACKGROUND

Virtual reality (VR) and augmented reality (AR) are rapidly developing technologies that offer a wide range of applications and enable users to experience digitally rendered content in both physical and virtual space. Although the number of studies about the different use of VR and AR increases year by year, a systematic overview of the applications of these innovative technologies in intensive care medicine is lacking. The aim of this systematic review was to provide a detailed summary of how VR and AR are currently being used in various areas of intensive care medicine.

METHODS

We systematically searched PubMed until 1st March 2023 to identify the currently existing evidence for different applications of VR and AR for both health care providers in the intensive care unit and children or adults, who were in an intensive care unit because of a critical illness.

RESULTS

After screening the literature, a total of 59 studies were included. Of note, a substantial number of publications consists of case reports, study plans or are lacking a control group. Furthermore, study designs are seldom comparable. However, there have been a variety of use cases for VR and AR that researchers have explored. They can help intensive care unit (ICU) personnel train, plan, and perform difficult procedures such as cardiopulmonary resuscitation, vascular punctures, endotracheal intubation or percutaneous dilatational tracheostomy. Patients might benefit from VR during invasive interventions and ICU stay by alleviating stress or pain. Furthermore, it enables contact with relatives and can also assist patients in their rehabilitation programs.

CONCLUSION

Both, VR and AR, offer multiple possibilities to improve current care, both from the perspective of the healthcare professional and the patient. It can be assumed that VR and AR will develop further and their application in health care will increase.

Augmented Reality Integration in Manikin-Based Simulations: Bringing Basic Science to the Critical Care Bedside with Limited Augmented Reality Resources

Immersive simulation and augmented reality (AR) are powerful educational tools in high-risk medical professions. Basic science AR, such as anatomic holograms, are gaining popularity. Many educators want to adopt AR and integrate basic science review in high-risk clinical decision-making but cannot afford it. In this project, we designed three AR integrated manikin-based simulations (ARI-MBS) by combining critical care scenarios with commercially available AR programs. Using a single headset and limited equipment, we technically integrated AR into MBS in a way that both students and faculty found rewarding. We present our design, so that others may replicate it.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40670-023-01821-z.

How Augmenting Reality Changes the Reality of Simulation: Ethnographic Analysis

BACKGROUND

Simulation-based medical education (SBME) provides key medical training for providers to safely and ethically practice high-risk events. Augmented reality (AR)-enhanced simulation projects digital images of realistic examination findings into a participant's field of view, which allows nuanced physical examination findings such as respiratory distress and skin perfusion to be prominently displayed. It is unknown how AR compares to traditional mannequin (TM)-based simulation with regard to influencing participant attention and behavior.

OBJECTIVE

The purpose of this study is to use video-based focused ethnography-a problem-focused, context-specific descriptive form of research whereby the research group collectively analyzes and interprets a subject of interest-to compare and categorize provider attention and behavior during TM and AR and provide suggestions for educators looking to delineate these 2 modalities.

METHODS

Twenty recorded interprofessional simulations (10 TM, 10 AR) featuring a decompensating child were evaluated through video-based focused ethnography. A generative question was posed: "How do the attention and behavior of participants vary based on the simulation modality?" Iterative data collection, analysis, and pattern explanation were performed by a review team spanning critical care, simulation, and qualitative expertise.

RESULTS

The attention and behavior of providers during TM and AR simulation clustered into three core themes: (1) focus and attention, (2) suspension of disbelief, and (3) communication. Participants focused on the mannequin during AR, especially when presented with changing physical examination findings, whereas in TM, participants focused disproportionately on the cardiorespiratory monitor. When participants could not trust what they were seeing or feeling in either modality, the illusion of realism was lost. In AR, this manifested as being unable to physically touch a digital mannequin, and in TM, participants were often unsure if they could trust their physical examination findings. Finally, communication differed, with calmer and clearer communication during TM, while AR communication was more chaotic.

CONCLUSIONS

The primary differences clustered around focus and attention, suspension of disbelief, and communication. Our findings provide an alternative methodology to categorize simulation, shifting focus from simulation modality and fidelity to participant behavior and experience. This alternative categorization suggests that TM simulation may be superior for practical skill acquisition and the introduction of communication strategies for novice learners. Meanwhile, AR simulation offers the opportunity for advanced training in clinical assessment. Further, AR could be a more appropriate platform for assessing communication and leadership by more experienced clinicians due to the generated environment being more representative of decompensation events. Further research will explore the attention and behavior of providers in virtual reality-based simulations and real-life resuscitations. Ultimately, these profiles will inform the development of an evidence-based guide for educators looking to optimize simulation-based medical education by pairing learning objectives with the ideal simulation modality.

Perceptions About Augmented Reality in Remote Medical Care: Interview Study of Emergency Telemedicine Providers

BACKGROUND

Augmented reality (AR) and virtual reality (VR) have increasingly appeared in the medical literature in the past decade, with AR recently being studied for its potential role in remote health care delivery and communication. Recent literature describes AR's implementation in real-time telemedicine contexts across multiple specialties and settings, with remote emergency services in particular using AR to enhance disaster support and simulation education. Despite the introduction of AR in the medical literature and its potential to shape the future of remote medical services, studies have yet to investigate the perspectives of telemedicine providers regarding this novel technology.

OBJECTIVE

This study aimed to understand the applications and challenges of AR in telemedicine anticipated by emergency medicine providers with a range of experiences in using telemedicine and AR or VR technology.

METHODS

Across 10 academic medical institutions, 21 emergency medicine providers with variable exposures to telemedicine and AR or VR technology were recruited for semistructured interviews via snowball sampling. The interview questions focused on various potential uses of AR, anticipated obstacles that prevent its implementation in the telemedicine area, and how providers and patients might respond to its introduction. We included video demonstrations of a prototype using AR during the interviews to elicit more informed and complete insights regarding AR's potential in remote health care. Interviews were transcribed and analyzed via thematic coding.

RESULTS

Our study identified 2 major areas of use for AR in telemedicine. First, AR is perceived to facilitate information gathering by enhancing observational tasks such as visual examination and granting simultaneous access to data and remote experts. Second, AR is anticipated to supplement distance learning of both minor and major procedures and nonprocedural skills such as cue recognition and empathy for patients and trainees. AR may also supplement long-distance education programs and thereby support less specialized medical facilities. However, the addition of AR may exacerbate the preexisting financial, structural, and literacy barriers to telemedicine. Providers seek value demonstrated by extensive research on the clinical outcome, satisfaction, and financial benefits of AR. They also seek institutional support and early training before adopting novel tools such as AR. Although an overall mixed reception is anticipated, consumer adoption and awareness are key components in AR's adoption.

CONCLUSIONS

AR has the potential to enhance the ability to gather observational and medical information, which would serve a diverse set of applications in remote health care delivery and education. However, AR faces obstacles similar to those faced by the current telemedicine technology, such as lack of access, infrastructure, and familiarity. This paper discusses the potential areas of investigation that would inform future studies and approaches to implementing AR in telemedicine.

The Art of Sim-Making: What to Learn from Film-Making

The components of each stage have similarities as well as differences, which make each unique in its own right. As the film-making and the movie industry may have much we can learn from, some of these will be covered under the different sections of the paper, for example, "Writing Powerful Narratives," depiction of emotional elements, specific industry-driven developments as well as the "cultural considerations" in both. For medical simulation and simulation-based education, the corresponding stages are as follows: DevelopmentPreproductionProductionPostproduction andDistribution. The art of sim-making has many similarities to that of film-making. In fact, there is potentially much to be learnt from the film-making process in cinematography and storytelling. Both film-making and sim-making can be seen from the artistic perspective as starting with a large piece of blank, white sheet of paper, which will need to be colored by the "artists" and personnel involved; in the former, to come up with the film and for the latter, to engage learners and ensure learning takes place, which is then translated into action for patients in the actual clinical care areas. Both entities have to go through a series of systematic stages. For film-making, the stages are as follows: Identification of problems and needs analysisSetting objectives, based on educational strategiesImplementation of the simulation activityDebriefing and evaluation, as well asFine-tuning for future use and archiving of scenarios/cases.

Augmented Reality in Pediatric Septic Shock Simulation: Randomized Controlled Feasibility Trial

BACKGROUND

Septic shock is a low-frequency but high-stakes condition in children requiring prompt resuscitation, which makes it an important target for simulation-based education.

OBJECTIVE

In this study, we aimed to design and implement an augmented reality app (PediSepsisAR) for septic shock simulation, test the feasibility of measuring the timing and volume of fluid administration during septic shock simulation with and without PediSepsisAR, and describe PediSepsisAR as an educational tool. We hypothesized that we could feasibly measure our desired data during the simulation in 90% of the participants in each group. With regard to using PediSepsisAR as an educational tool, we hypothesized that the PediSepsisAR group would report that it enhanced their awareness of simulated patient blood flow and would more rapidly verbalize recognition of abnormal patient status and desired management steps.

METHODS

We performed a randomized controlled feasibility trial with a convenience sample of pediatric care providers at a large tertiary care pediatric center. Participants completed a prestudy questionnaire and were randomized to either the PediSepsisAR or control (traditional simulation) arms. We measured the participants' time to administer 20, 40, and 60 cc/kg of intravenous fluids during a septic shock simulation using each modality. In addition, facilitators timed how long participants took to verbalize they had recognized tachycardia, hypotension, or septic shock and desired to initiate the sepsis pathway and administer antibiotics. Participants in the PediSepsisAR arm completed a poststudy questionnaire. We analyzed data using descriptive statistics and a Wilcoxon rank-sum test to compare the median time with event variables between groups.

RESULTS

We enrolled 50 participants (n=25 in each arm). The timing and volume of fluid administration were captured in all the participants in each group. There was no statistically significant difference regarding time to administration of intravenous fluids between the two groups. Similarly, there was no statistically significant difference between the groups regarding time to verbalized recognition of patient status or desired management steps. Most participants in the PediSepsisAR group reported that PediSepsisAR enhanced their awareness of the patient's perfusion.

CONCLUSIONS

We developed an augmented reality app for use in pediatric septic shock simulations and demonstrated the feasibility of measuring the volume and timing of fluid administration during simulation using this modality. In addition, our findings suggest that PediSepsisAR may enhance participants' awareness of abnormal perfusion.