The feasibility and usability of mixed reality teaching in a hospital setting based on self-reported perceptions of medical students

BACKGROUND

Clinical teaching during encounters with real patients lies at the heart of medical education. Mixed reality (MR) using a Microsoft HoloLens 2 (HL2) offers the potential to address several challenges: including enabling remote learning; decreasing infection control risks; facilitating greater access to medical specialties; and enhancing learning by vertical integration of basic principles to clinical application. We aimed to assess the feasibility and usability of MR using the HL2 for teaching in a busy, tertiary referral university hospital.

METHODS

This prospective observational study examined the use of the HL2 to facilitate a live two-way broadcast of a clinician-patient encounter, to remotely situated third and fourth year medical students. System Usability Scale (SUS) Scores were elicited from participating medical students, clinician, and technician. Feedback was also elicited from participating patients. A modified Evaluation of Technology-Enhanced Learning Materials: Learner Perceptions Questionnaire (mETELM) was completed by medical students and patients.

RESULTS

This was a mixed methods prospective, observational study, undertaken in the Day of Surgery Assessment Unit. Forty-seven medical students participated. The mean SUS score for medical students was 71.4 (SD 15.4), clinician (SUS = 75) and technician (SUS = 70) indicating good usability. The mETELM Questionnaire using a 7-point Likert Scale demonstrated MR was perceived to be more beneficial than a PowerPoint presentation (Median = 7, Range 6-7). Opinion amongst the student cohort was divided as to whether the MR tutorial was as beneficial for learning as a live patient encounter would have been (Median = 5, Range 3-6). Students were positive about the prospect of incorporating of MR in future tutorials (Median = 7, Range 5-7). The patients' mETELM results indicate the HL2 did not affect communication with the clinician (Median = 7, Range 7-7). The MR tutorial was preferred to a format based on small group teaching at the bedside (Median = 6, Range 4-7).

CONCLUSIONS

Our study findings indicate that MR teaching using the HL2 demonstrates good usability characteristics for providing education to medical students at least in a clinical setting and under conditions similar to those of our study. Also, it is feasible to deliver to remotely located students, although certain practical constraints apply including Wi-Fi and audio quality.

Feasibility of a novel augmented reality overlay for cervical screw placement in phantom spine models

STUDY DESIGN

Feasibility study.

PURPOSE

A phantom model was used to evaluate the accuracy of a novel augmented reality (AR) system for cervical screw placement.

OVERVIEW OF LITERATURE

The use of navigation systems is becoming increasingly common in spine procedures. However, numerous factors limit the feasibility of regular and widespread use of navigation tools during spine surgery. AR is a new technology that has already demonstrated utility as a navigation tool during spine surgery. However, advancements in AR technology are needed to increase its adoption by the medical community.

METHODS

AR technology that uses a fiducial-less registration system was tested in a preclinical cervical spine phantom model study for accuracy during spinal screw placement. A three-dimensional reconstruction of the spine along with trajectory lines was superimposed onto the phantom model using an AR headset. Participants used the AR system to guide screw placement, and post-instrumentation scans were compared for accuracy assessment.

RESULTS

Twelve cervical screws were placed under AR guidance. All screws were placed in an acceptable anatomic position. The average distance error for the insertion point was 2.73±0.55 mm, whereas that for the endpoint was 2.71±0.69 mm. The average trajectory angle error for all insertions was 2.69°±0.59°.

CONCLUSIONS

This feasibility study describes a novel registration approach that superimposes spinal anatomy and trajectories onto the surgeon's real-world view of the spine. These results demonstrate reasonable accuracy in the preclinical model. The results of this study demonstrate that this technology can assist with accurate screw placement. Further investigation using cadaveric and clinical models is warranted.

Infections of cardiac implantable electronic devices and how to improve transvenous lead extraction by the virtual reality

Introduction

Infections in cardiac implantable electronic devices (CIED) are increasing over time and associated with substantially mortality and healthcare costs. The best approach is the complete removal of the system by transvenous lead extraction (TLE). However, when leads are more than 10 years old, this technique requires considerable expertise and failures with the result of abandoned leads or serious complications may occur. The aim of this study is to describe our experience using virtual and mixed reality in the preoperative planning of complex cases.

Patients and methods

Consecutive patients from a referral centre with CIED infections in which TLE was judged difficult. Synchronized computed tomography (CT) scan images were processed and transferred to a fully immersive virtual reality room and also to the operative room (mixed reality) for better guidance during the extracting procedure.

Results

Ten patients (seven with local and three with systemic infections) were preoperative evaluated. Processed images and virtual reality showed intense adherences of the leads to the veins, right ventricle, and right atrium endocardium and between them that preclude a difficult extraction and required a carefully planning and sometimes a different technical approach. The anticipated difficulty was confirmed by the higher times of fluoroscopy. All leads were extracted and no complications were registered.

Conclusions

Preoperative planning is essential for evaluation of TLE difficulty and prevention of unexpected situations. Virtual reality seems an estimable aid for operators in planning difficult cases and also an excellent tool for teaching.

Supplementary information

The online version contains supplementary material available at 10.1007/s12055-023-01663-9.

Extended reality in cranial and spinal neurosurgery - a bibliometric analysis

PURPOSE

This bibliometric analysis of the top 100 cited articles on extended reality (XR) in neurosurgery aimed to reveal trends in this research field. Gender differences in authorship and global distribution of the most-cited articles were also addressed.

METHODS

A Web of Science electronic database search was conducted. The top 100 most-cited articles related to the scope of this review were retrieved and analyzed for trends in publications, journal characteristics, authorship, global distribution, study design, and focus areas. After a brief description of the top 100 publications, a comparative analysis between spinal and cranial publications was performed.

RESULTS

From 2005, there was a significant increase in spinal neurosurgery publications with a focus on pedicle screw placement. Most articles were original research studies, with an emphasis on augmented reality (AR). In cranial neurosurgery, there was no notable increase in publications. There was an increase in studies assessing both AR and virtual reality (VR) research, with a notable emphasis on VR compared to AR. Education, surgical skills assessment, and surgical planning were more common themes in cranial studies compared to spinal studies. Female authorship was notably low in both groups, with no significant increase over time. The USA and Canada contributed most of the publications in the research field.

CONCLUSIONS

Research regarding the use of XR in neurosurgery increased significantly from 2005. Cranial research focused on VR and resident education while spinal research focused on AR and neuronavigation. Female authorship was underrepresented. North America provides most of the high-impact research in this area.

The bibliometric analysis of extended reality in surgical training: Global and Chinese perspective

Objectives

The prospect of extended reality (XR) being integrated with surgical training curriculum has attracted scholars. However, there is a lack of bibliometric analysis to help them better understand this field. Our aim is to analyze relevant literature focusing on development trajectory and research directions since the 21st century to provide valuable insights.

Methods

Papers were retrieved from the Web of Science Core Collection. Microsoft Excel, VOSviewer, and CiteSpace were used for bibliometric analysis.

Results

Of the 3337 papers published worldwide, China contributed 204, ranking fifth. The world's enthusiasm for this field has been growing since 2000, whereas China has been gradually entering since 2001. Although China had a late start, its growth has accelerated since around 2016 due to the reform of the medical postgraduate education system and the rapid development of Chinese information technology, despite no research explosive period has been yet noted. International institutions, notably the University of Toronto, worked closely with others, while Chinese institutions lacked of international and domestic cooperation. Sixteen stable cooperation clusters of international scholars were formed, while the collaboration between Chinese scholars was not yet stable. XR has been primarily applied in orthopedic surgery, cataract surgery, laparoscopic training and intraoperative use in neurosurgery worldwide.

Conclusions

There is strong enthusiasm and cooperation in the international research on the XR-based surgical training. Chinese scholars are making steady progress and have great potential in this area. There has not been noted an explosive research phase yet in the Chinese pace. The research on several surgical specialties has been summarized at the very first time. AR will gradually to be more involved and take important role of the research.

Assessing the impact of mixed reality-assisted informed consent: A study protocol

Background

Informed consent is a crucial aspect of modern medicine, but it can be challenging due to the complexity of the information involved. Mixed reality (MR) has emerged as a promising technology to improve communication. However, there is a lack of comprehensive research on the impact of MR on medical informed consent. The proposed research protocol provides a solid foundation for conducting future investigations and developing MR-based protocols that can enhance patients' understanding and engagement in the decision-making process.

Methods

This study will employ a randomized controlled trial design. Two arms will be defined: MR-assisted informed consent (MRaIC) as the experimental arm and conventional informed consent (CIC) as the control arm consent, with 52 patients in each group. The protocol includes the use of questionnaires to analyze the anxiety levels and the awareness of the procedure that the patient is going to perform to study the impact of MRaIC versus CIC before medical procedures.

Results

The study will evaluate the impact of MR on patients' information comprehension, engagement during the process of obtaining informed consent, emotional reactions, and consent decisions. Ethical concerns will be addressed.

Conclusion

This study protocol provides a comprehensive approach to investigate the impact of MR on medical informed consent. The findings may contribute to a better understanding of the effects of MR on information comprehension, engagement during the process of obtaining informed consent, psychological experience, consent decisions, and ethical considerations. The integration of MR technology has the potential to enhance surgical communication practices and improve the informed consent process.

Relationship between demographic and social variables and performance in virtual reality among healthcare personnel: an observational study

BACKGROUND

Virtual reality is emerging as an important component of medical education. Although the benefits of virtual reality are apparent, the optimal strategy to orient to or differentiate learners in the virtual space have not been delineated. The purpose of this study was to investigate the relationships between demographic variables, social variables, and self-perceived comfort with technology to performance on a standardized non-medical virtual reality experience.

METHODS

This observational study was performed at the International Meeting on Simulation in Healthcare in 2022. This conference includes medical and non-medical attendees. Participants provided demographic information and participated in a scored non-medical VR experience due to the heterogeneity of the sample. Participants then completed a System Usability Index and NASA Task Load Index form. Participants were dividedintolow scoring, medium scoring, and high scoring groups according to their final game score for further analysis.

RESULTS

95 participants were included in final analysis. 55 (57.9%) of participants had prior virtual reality experience. Higher scores were associated with younger age (11.09, p < 0.001), identifying as male (11.09, p < 0.001), and a higher frequency of playing video games in the past (18.96, p < 0.001). The high score group was more likely to report comfort with virtual reality (6.29, p = 0.003) as well as comfort with new technology (4.61, p = 0.012). NASA Task Load Index scores trended down and System Usability Index scores trended up with increasing score. Being a nurse was a positive predictor of a higher score when compared to physicians in the multivariate analysis.

CONCLUSION

Performance during an immersive virtual reality experience was most closely related to age, gender, and frequency of playing video games. Self-perceived comfort with virtual reality was more predictive of score than prior virtual reality experience.

How I do it? Surgical clipping of a large right internal carotid artery-superior hypophyseal artery aneurysm

BACKGROUND

Microsurgery alone often proves to be challenging in treating paraclinoid internal carotid artery (ICA) aneurysms, which are known for their complex anatomy.

METHOD

A 53-year-old female with a large right ICA-superior hypophyseal artery (SHA) aneurysm underwent clipping repair. Mixed reality technology was utilized in the preoperative planning and anatomical study. During the surgery, the anterior clinoid process was removed intradurally to improve access to the aneurysm neck. The aneurysm was then secured with a long curved clip. The patient's recovery was successful without any complications.

CONCLUSION

This report aims to shed light on the intricacies involved in clipping ICA-SHA aneurysms.

Exploring mobile mixed reality for critical thinking in nursing and healthcare education: A systematic review

BACKGROUND

The shortage of nursing and healthcare clinical placements has prompted the investigation of ways to supplement authentic learning. Mobile mixed reality has become increasingly available, however, the affordances and design principles for the facilitation of critical thinking are yet to be explored.

OBJECTIVE

To examine how mobile mixed reality facilitates critical thinking in nursing and healthcare higher education.

DESIGN

Systematic review.

REVIEW METHODS

A search in seven databases (MEDLINE, PsychINFO, AMED, ERIC, Scopus, Cochrane, and Web of Science) was conducted with 3488 titles and abstracts screened. The quality of the included studies was evaluated using the Mixed Methods Assessment Tool (MMAT).

RESULTS

A total of 12 studies with 1108 participants were included. The breadth of healthcare disciplines was limited to five disciplines that utilised bespoke scenarios on head-mounted displays. Most scenarios were emergency or critical response, with limited time for pre-brief, debrief, or overall user time. Only two studies directly measured critical thinking, with others including indirect reference to diagnoses, interpretation, analysis, or evaluation of healthcare scenarios. Affordances and design principles for the future development of mobile mixed reality for critical thinking in nursing and healthcare higher education are identified.

CONCLUSIONS

While some pedagogical affordances of mobile mixed reality can be identified in a narrow number of healthcare disciplines, there remain to be limited valid measures of critical thinking used to quantify effectiveness. Future studies would benefit from considering scenarios beyond emergency and critical responses, including longitudinal studies that reflect the development of critical thinking over time, and exploration of co-designed scenarios with and by nursing and healthcare students.

Augmented Reality Registration System for Visualization of Skull Landmarks

BACKGROUND

Augmented reality (AR) is an emerging technology in neurosurgery with the potential to become a strategic tool in the delivery of care and education for trainees. Advances in technology have demonstrated promising use for improving visualization and spatial awareness of critical neuroanatomic structures. In this report, we employ a novel AR registration system for the visualization and targeting of skull landmarks.

METHODS

A markerless AR system was used to register 3-dimensional reconstructions of suture lines onto the head via a head-mounted display. Participants were required to identify craniometric points with and without AR assistance. Targeting error was measured as the Euclidian distance between the user-defined location and the true craniometric point on the subjects' heads.

RESULTS

All participants successfully registered 3-dimensional reconstructions onto the subjects' heads. Targeting accuracy was significantly improved with AR (3.59 ± 1.29 mm). Across all target points, AR increased accuracy by an average of 19.96 ± 3.80 mm. Posttest surveys revealed that participants felt the technology increased their confidence in identifying landmarks (4.6/5) and that the technology will be useful for clinical care (4.2/5).

CONCLUSIONS

While several areas of improvement and innovation can further enhance the use of AR in neurosurgery, this report demonstrates the feasibility of a markerless headset-based AR system for visualizing craniometric points on the skull. As the technology continues to advance, AR is expected to play an increasingly significant role in neurosurgery, transforming how surgeries are performed and improving patient care.

Advanced Visualization Engineering for Vision Disorders: A Clinically Focused Guide to Current Technology and Future Applications

Head-mounted visualization technology, often in the form of virtual, augmented, and mixed reality (VAMR), has revolutionized how visual disorders may be approached clinically. In this manuscript, we review the available literature on VAMR for visual disorders and provide a clinically oriented guide to how VAMR technology has been deployed for visual impairments. The chief areas of clinical investigation with VAMR are divided include (1) vision assessment, (2) vision simulation, and (3) vision rehabilitation. We discuss in-depth the current literature of these areas in VAMR and upcoming/future applications to combat the detrimental impact of visual impairment worldwide.

An interactive augmented reality software for facial reconstructive surgeries

BACKGROUND AND OBJECTIVE

Surgical trainees need a lot of training and practice before being able to operate independently. The current approach of surgical education mainly involves didactic teaching and psychomotor training through physical models or real tissue. Due to the unavailability of physical resources and lack of objective ways of evaluation, there is a demand for developing alternative training methods for surgeons. In this paper, we present an application that provides additional training opportunities to surgical trainees in the field of facial reconstructive surgeries.

METHODS

We built a mobile augmented reality application that helps the user to visualize important concepts and experiment with different surgical plans for facial reconstructive surgeries. The application can overlay relaxed skin tension lines on a live video input or a patient's photo, which serve as bases for aligning a skin flap. A surgical trainee can interactively compare different skin flap design choices with estimated final scars on a photo of a patient. Data collection capability is also added to the application, and we performed a Monte Carlo experiment with simulated users (five classes of 100 users each) as an example of objectively measuring user performance.

RESULTS

The application can overlay relaxed skin tension lines on a patient's face in real time on a modern mobile device. Accurate overlays were achieved in over 91% as well as 84% and 88% out of 263 generated face images, depending on the method. Visual comparisons of the three overlay methods are presented on sample faces from different population groups. From the Monte Carlo experiment, we see that user actions in each class follow a normal distribution with a distinct set of parameters.

CONCLUSIONS

This application can serve as a basis for teaching surgical trainees the fundamentals of different facial reconstructive procedures, especially concepts related to relaxed skin tension lines and skin flaps. It can objectively evaluate the performance of surgical trainees in a course. This setup focuses on illustrating the relationship between the orientation of skin flaps and relaxed skin tension lines, which is a prerequisite of minimizing scarring in patients in addition to good surgical techniques.

Augmented reality in spine surgery - past, present, and future

BACKGROUND CONTEXT

Augmented reality (AR) is increasingly recognized as a valuable tool in spine surgery. Here we provides an overview of the key developments and technological milestones that have laid the foundation for AR applications in this field. We also assess the quality of existing studies on AR systems in spine surgery and explore potential future applications.

PURPOSE

The purpose of this narrative review is to examine the role of AR in spine surgery. It aims to highlight the evolution of AR technology in this context, evaluate the existing body of research, and outline potential future directions for integrating AR into spine surgery.

STUDY DESIGN

Narrative review.

METHODS

We conducted a thorough literature search to identify studies and developments related to AR in spine surgery. Relevant articles, reports, and technological advancements were analyzed to establish the historical context and current state of AR in this field.

RESULTS

The review identifies significant milestones in the development of AR technology for spine surgery. It discusses the growing body of research and highlights the strengths and weaknesses of existing investigations. Additionally, it presents insights into the potential for AR to enhance spine surgical education and speculates on future applications.

CONCLUSIONS

Augmented reality has emerged as a promising adjunct in spine surgery, with notable advancements and research efforts. The integration of AR into the spine surgery operating room holds promise, as does its potential to revolutionize surgical education. Future applications of AR in spine surgery may include real-time navigation, enhanced visualization, and improved patient outcomes. Continued development and evaluation of AR technology are essential for its successful implementation in this specialized surgical field.

Revaiah P, Stanuch M, Skalski A, Onuma Y, Serruys PW. Feasibility and accuracy of real-time 3D-holographic graft length measurements

Aims

Mixed reality (MR) holograms can display high-definition images while preserving the user's situational awareness. New MR software can measure 3D objects with gestures and voice commands; however, these measurements have not been validated. We aimed to assess the feasibility and accuracy of using 3D holograms for measuring the length of coronary artery bypass grafts.

Methods and results

An independent core lab analyzed follow-up computer tomography coronary angiograms performed 30 days after coronary artery bypass grafting in 30 consecutive cases enrolled in the FASTTRACK CABG trial. Two analysts, blinded to clinical information, performed holographic reconstruction and measurements using the CarnaLife Holo software (Medapp, Krakow, Poland). Inter-observer agreement was assessed in the first 20 cases. Another analyst performed the validation measurements using the CardIQ W8 CT system (GE Healthcare, Milwaukee, Wisconsin). Seventy grafts (30 left internal mammary artery grafts, 31 saphenous vein grafts, and 9 right internal mammary artery grafts) were measured. Holographic measurements were feasible in 97.1% of grafts and took 3 minutes 36 s ± 50.74 s per case. There was an excellent inter-observer agreement [interclass correlation coefficient (ICC) 0.99 (0.97-0.99)]. There was no significant difference between the total graft length on hologram and CT [187.5 mm (157.7-211.4) vs. 183.1 mm (156.8-206.1), P = 0.50], respectively. Hologram and CT measurements are highly correlated (r = 0.97, P < 0.001) with an excellent agreement [ICC 0.98 (0.97-0.99)].

Conclusion

Real-time holographic measurements are feasible, quick, and accurate even for tortuous bypass grafts. This new methodology can empower clinicians to visualize and measure 3D images by themselves and may provide insights for procedural strategy.

Reliability of repeated exposure to the human elevated plus-maze in virtual reality: Behavioral, emotional, and autonomic responses

Approach-avoidance conflicts are a hallmark of anxiety-related behaviors. A gold standard for assessing anxiety-related behaviors in rodents is the elevated plus-maze (EPM), which was recently translated to humans using immersive virtual reality. Repeated behavioral testing is particularly interesting for clinical and pharmacological research in humans but could be limited by habituation effects. Here, we tested whether comparable strategies that are used in rodents (different environments and inter-trial interval of 28 days) are sufficient to avoid habituation or sensitization effects on the EPM, making it possible to perform repeated measurement of anxiety-related behavior in humans. Moreover, we developed two novel virtual environments for repeated testing to explore whether a scenario resembling the real world is superior to a video game-like EPM in terms of lifelike physiological, emotional, and behavioral responses. On a behavioral level, no significant differences but a high correlation between first and repeated exposure to the human EPM independent of EPM version were found. On a psychophysiological level, salivary alpha-amylase, skin-conductance, and respiratory frequency increased at first and second exposure independent of EPM version. However, at repeated exposure, skin-conductance and heart rate showed indicators for anticipatory anxiety and a small sensitization effect, while no effect of real-world resemblance on these physiological measures was found. This was also reflected in slightly higher subjective anxiety levels at second exposure, although subjective anxiety still correlated strongly between first and second exposure. In conclusion, the human EPM can be used for longitudinal assessments of human anxiety-related behavior when strategies to avoid habituation and sensitization are considered.

Case report: Use of markerless augmented reality system for ventriculoperitoneal shunt placement

Background

Ventriculoperitoneal (VP) shunt placement is one of the most commonly performed neurosurgical procedures, yet failure rates remain very high. Surface landmarks are typically used to guide VP shunt placement, but they are not reliable in identifying the target anatomy. Augmented reality (AR) is a promising new technology that has the potential to improve the accuracy and effectiveness of neurosurgical procedures. We describe the use of AR for the surgical planning of a VP shunt.

Case Description

A 62-year-old male with a history of subarachnoid hemorrhage presented with delayed hydrocephalus. A computed tomography scan was obtained that confirmed dilated ventricles, requiring a right VP shunt. The patient was brought to the operating room, where the AR system was used for visualization and planning.

Conclusion

In this study, we describe the use of AR for VP shunt placement. The AR system consists of a Microsoft HoloLens 2 head-mounted display and a novel markerless registration system, which was used to register patient-specific 3D models onto the patient's head for visualizing target anatomy and planning an operative approach. The AR system was used to plan the VP shunt placement in the operating room. This system is easy to use and provides a visualization of the patient's anatomy, which can be used to plan an optimal trajectory. We believe that this has the potential to improve the accuracy and outcomes of VP shunt placements, and further studies are needed to characterize the system's accuracy and benefits.

Effect of Intraoperative Mixed-Reality use on Nonsurgical Team Members in the Neurosurgical Operating Room: An Explorative Study

OBJECTIVES

Mixed-reality (MxR) implementation in the neurosurgical operating room (OR) is emerging, but the impact of this technology on the nonsurgical OR staff has not been investigated yet. The purpose of this study is to evaluate the nonsurgical OR team's perception of the impact of intraoperative MxR use.

METHODS

The evaluation occurred in a neurosurgical institution implementing MxR perioperatively on a daily basis for 15 months. The questionnaire measuring the impact of MxR consisted of 5 binary questions and 4 subquestions measured on a 7-point Likert scale.

RESULTS

Fifteen nonsurgical staff members of a neurosurgical OR team were interviewed. Most (85%) of the cohort stated that MxR changed their perception of the surgery, improving understanding of the spatial orientation (median 6, interquartile range 5-7) and of the pathology dimensions (6, 5.5-7). One participant (7%) was of the opinion that MxR disrupted the OR workflow. The majority (60%) stated that use of the holograms improved efficiency in the OR. The participants were neutral about the potential role of MxR to improve communication among different OR team members (4, 2-5) and overall teamwork (4, 2-5).

CONCLUSIONS

The use of 3-Dimensional interactive holograms of neurosurgical cases in the nonsterile intraoperative phase was not perceived as distractive, and neither was OR flow disruption by members of the nonsurgical OR staff. MxR was considered an adjunct to improve OR efficiency. A thorough understanding of the impact of MxR's implementation on the nonsurgical staff could lead to targeted improvement of the MxR use and, potentially, to increasing the quality of the teamwork.

A new mixed reality tool for training in minimally invasive robotic-assisted surgery

Robotic-assisted surgery (RAS) is developing an increasing role in surgical practice. Therefore, it is of the utmost importance to introduce this paradigm into surgical training programs. However, the steep learning curve of RAS remains a problem that hinders the development and widespread use of this surgical paradigm. For this reason, it is important to be able to train surgeons in the use of RAS procedures. RAS involves distinctive features that makes its learning different to other minimally invasive surgical procedures. One of these features is that the surgeons operate using a stereoscopic console. Therefore, it is necessary to perform RAS training stereoscopically. This article presents a mixed-reality (MR) tool for the stereoscopic visualization, annotation and collaborative display of RAS surgical procedures. The tool is an MR application because it can display real stereoscopic content and augment it with virtual elements (annotations) properly registered in 3D and tracked over time. This new tool allows the registration of surgical procedures, teachers (experts) and students (trainees), so that the teacher can share a set of videos with their students, annotate them with virtual information and use a shared virtual pointer with the students. The students can visualize the videos within a web environment using their personal mobile phones or a desktop stereo system. The use of the tool has been assessed by a group of 15 surgeons during a robotic-surgery master's course. The results show that surgeons consider that this tool can be very useful in RAS training.

Application of Mixed Reality to Ultrasound-guided Femoral Arterial Cannulation During Real-time Practice in Cardiac Interventions

Mixed reality opens interesting possibilities as it allows physicians to interact with both, the real physical and the virtual computer-generated environment and objects, in a powerful way. A mixed reality system, based in the HoloLens 2 glasses, has been developed to assist cardiologists in a quite complex interventional procedure: the ultrasound-guided femoral arterial cannulations, during real-time practice in interventional cardiology. The system is divided into two modules, the transmitter module, responsible for sending medical images to HoloLens 2 glasses, and the receiver module, hosted in the HoloLens 2, which renders those medical images, allowing the practitioner to watch and manage them in a 3D environment. The system has been successfully used, between November 2021 and August 2022, in up to 9 interventions by 2 different practitioners, in a large public hospital in central Spain. The practitioners using the system confirmed it as easy to use, reliable, real-time, reachable, and cost-effective, allowing a reduction of operating times, a better control of typical errors associated to the interventional procedure, and opening the possibility to use the medical imagery produced in ubiquitous e-learning. These strengths and opportunities were only nuanced by the risk of potential medical complications emerging from system malfunction or operator errors when using the system (e.g., unexpected momentary lag). In summary, the proposed system can be taken as a realistic proof of concept of how mixed reality technologies can support practitioners when performing interventional and surgical procedures during real-time daily practice.

Assessment of the viability of integrating virtual reality programs in practical tests for the Korean Radiological Technologists Licensing Examination: a survey study

PURPOSE

The objective of this study was to assess the feasibility of incorporating virtual reality/augmented reality (VR/AR) programs into practical tests administered as part of the Korean Radiological Technologists Licensing Examination (KRTLE). This evaluation is grounded in a comprehensive survey that targeted enrolled students in departments of radiology across the nation.

METHODS

In total, 682 students from radiology departments across the nation were participants in the survey. An online survey platform was used, and the questionnaire was structured into 5 distinct sections and 27 questions. A frequency analysis for each section of the survey was conducted using IBM SPSS ver. 27.0.

RESULTS

Direct or indirect exposure to VR/AR content was reported by 67.7% of all respondents. Furthermore, 55.4% of the respondents expressed that VR/AR could be integrated into their classes, which signified a widespread acknowledgment of VR among the students. With regards to the integration of a VR/AR or mixed reality program into the practical tests for purposes of the KRTLE, a substantial amount of the respondents (57.3%) exhibited a positive inclination and recommended its introduction.

CONCLUSION

The application of VR/AR programs within practical tests of the KRTLE will be used as an alternative for evaluating clinical examination procedures and validating job skills.

A novel mixed reality-guided dental implant placement navigation system based on virtual-actual registration

BACKGROUNDS

The key to successful dental implant surgery is to place the implants accurately along the pre-operative planned paths. The application of surgical navigation systems can significantly improve the safety and accuracy of implantation. However, the frequent shift of the views of the surgeon between the surgical site and the computer screen causes troubles, which is expected to be solved by the introduction of mixed-reality technology through the wearing of HoloLens devices by enabling the alignment of the virtual three-dimensional (3D) image with the actual surgical site in the same field of view.

METHODS

This study utilized mixed reality technology to enhance dental implant surgery navigation. Our first step was reconstructing a virtual 3D model from pre-operative cone-beam CT (CBCT) images. We then obtained the relative position between objects using the navigation device and HoloLens camera. Via the algorithms of virtual-actual registration, the transformation matrixes between the HoloLens devices and the navigation tracker were acquired through the HoloLens-tracker registration, and the transformation matrixes between the virtual model and the patient phantom through the image-phantom registration. In addition, the algorithm of surgical drill calibration assisted in acquiring transformation matrixes between the surgical drill and the patient phantom. These algorithms allow real-time tracking of the surgical drill's location and orientation relative to the patient phantom under the navigation device. With the aid of the HoloLens 2, virtual 3D images and actual patient phantoms can be aligned accurately, providing surgeons with a clear visualization of the implant path.

RESULTS

Phantom experiments were conducted using 30 patient phantoms, with a total of 102 dental implants inserted. Comparisons between the actual implant paths and the pre-operatively planned implant paths showed that our system achieved a coronal deviation of 1.507 ± 0.155 mm, an apical deviation of 1.542 ± 0.143 mm, and an angular deviation of 3.468 ± 0.339°. The deviation was not significantly different from that of the navigation-guided dental implant placement but better than the freehand dental implant placement.

CONCLUSION

Our proposed system realizes the integration of the pre-operative planned dental implant paths and the patient phantom, which helps surgeons achieve adequate accuracy in traditional dental implant surgery. Furthermore, this system is expected to be applicable to animal and cadaveric experiments in further studies.

How I do it? Preoperative Microsoft HoloLens 2 planning-assisted surgical clipping of a fetal posterior cerebral artery aneurysm

BACKGROUND

The treatment of intracranial aneurysms has predominantly shifted towards endovascular strategies, but complex cases still necessitate microsurgery. Preoperative stimulation can be beneficial for inexperienced young neurosurgeons in preparing for safe microsurgery.

METHOD

A 72-year-old female with a left irregular fetal posterior cerebral artery (PCA) aneurysm underwent clipping repair. Microsoft HoloLens 2, utilizing mixed reality technology, was employed for preoperative stimulation and anatomical study. During the operation, we successfully identified the planned relationship between the aneurysm and the fetal PCA. The patient was cured without any complications.

CONCLUSION

We hope that this report will highlight the significance of Microsoft HoloLens 2 in microsurgical planning and education.

Challenges and promises of mixed-reality interventions in acquired brain injury rehabilitation: A scoping review

BACKGROUND

Acquired brain injury (ABI) can lead to significant impairments and difficulties in everyday life, necessitating the need for rehabilitation. Mixed-reality (MR) technologies have revolutionized the delivery of neurorehabilitation therapies. However, inconsistencies in research methodology, diverse study populations and designs, and exaggerated claims in the research, media, and private consumer sectors have impacted the knowledge base of the field, including within the context of ABI rehabilitation.

OBJECTIVE

This scoping review aims to explore MR-systems in ABI rehabilitation, while assessing the evidence base and technology readiness levels of these systems.

METHODS

Seven databases were searched for studies, which were screened and analyzed by two independent raters. The types of MR systems, levels of evidence, and technology readiness levels were extracted and analyzed using descriptive analyses.

RESULTS

Twenty-six studies were included in the review, all of which focused on ABI etiologies stemming from strokes. Across studies, upper-limb motor rehabilitation was the most common rehabilitation target of MR interventions, followed by gait, cognition, and lower-extremity functioning. At present, overall results indicate low evidence for MR-applications in ABI rehabilitation, with a median technology readiness level of 6, corresponding to system prototypes being tested in relevant environments.

CONCLUSION

Although challenges regarding system usability and design were reported, results appear promising with ongoing research. With variability across studies, technologies, and populations, determining the effectiveness of MR interventions in ABI remains a challenge, necessitating the need for ongoing innovation, research, and development of these systems.

Educational value of mixed reality combined with a three-dimensional printed model of aortic disease for vascular surgery in the standardized residency training of surgical residents in China: a case control study

BACKGROUND

The simulated three-dimensional (3D) printed anatomical model of the aorta, which has become the norm in medical education, has poor authenticity, tactility, feasibility, and interactivity. Therefore, this study explored the educational value and effect of mixed reality (MR) combined with a 3D printed model of aortic disease in training surgical residents.

METHOD

Fifty-one resident physicians who rotated in vascular surgery were selected and divided into traditional (27) and experimental (24) teaching groups using the random number table method. After undergoing the experimental and traditional training routines on aortic disease, both the groups took a theoretical test on aortic disease and an assessment of the simulation based on the Michigan Standard Simulation Experience Scale (MiSSES) template. Their scores and assessment results were compared. The study was conducted at the Department of Vascular Surgery of Peking University People's Hospital, Beijing, China.

RESULTS

In the theoretical test on aortic disease, the experimental teaching group obtained higher mean total scores (79.0 ± 9.1 vs. 72.6 ± 7.5, P = 0.013) and higher scores in anatomy/ pathophysiology (30.8 ± 5.4 vs. 24.8 ± 5.8; P < 0.001) than the traditional teaching group. The differences in their scores in the differential diagnosis (25.8 ± 3.0 vs. 23.3 ± 4.9; P = 0.078) and treatment (22.5 ± 11.8 vs. 24.5 ± 8.2; P = 0.603) sessions were insignificant. The MR-assisted teaching stratified the vascular residents through the MiSSES survey. Overall, 95.8% residents (23/24) strongly or somewhat agreed that the MR was adequately realistic and the curriculum helped improve the ability to understanding aortic diseases. Further, 91.7% residents (22/24) strongly or somewhat agreed that the MR-assisted teaching was a good training tool for knowledge on aortic diseases. All residents responded with "Good" or "Outstanding" on the overall rating of the MR experience.

CONCLUSIONS

MR combined with the 3D printed model helped residents understand and master aortic disease, particularly regarding anatomy and pathophysiology. Additionally, the realistic 3D printing and MR models improved the self-efficacy of residents in studying aortic diseases, thus greatly stimulating their enthusiasm and initiative to study.

Systematic Review of Extended Reality Digital Therapy for Enhancing Mental Health Among South Korean Adolescents and Young Adults

Digital therapy using extended reality (XR) holds great promise for addressing the mental health needs of adolescents and young adults. This study addresses a notable research gap in South Korea by systematically reviewing XR-based digital therapy for the mental health of South Korean adolescents and young adults. We analyzed 26 studies encompassing various aspects, including study type, publication date, research field, research methodology, data sources, program types, program content, sample characteristics, target population, assessment tools, and program effectiveness. Notably, 46.15% of the studies employed an experimental design, whereas over 53% utilized non-experimental approaches. Experimental studies lacked a genuine design, standardized questionnaires, and control variables. Similarly, non-experimental studies failed to report specific literature selection criteria. Consequently, future studies should adopt rigorous methodologies to enhance reliability and validity. Moreover, over 85% of the 26 studies focused solely on virtual reality and did not incorporate augmented or mixed reality. This study identifies the limitations of the previous research. These findings emphasize the need for structured investigations to advance the development of XR-based digital therapy to promote mental health in adolescents and young adults in South Korea.