Assessment of the utility of Mixed Reality in medical education

A comprehensive study on unraveling the advances of immersive technologies (VR/AR/MR/XR) in the healthcare sector during the COVID-19: Challenges and solutions

The current COVID-19 pandemic has affected almost every aspect of life but its impact on the healthcare landscape is conspicuously adverse. However, digital technologies played a significant contribution in coping with the challenges spawned by this pandemic. In this list of applied digital technologies, the role of immersive technologies in battling COVID-19 is notice-worthy. Immersive technologies consisting of virtual reality (VR), augmented reality (AR), mixed reality (MR), extended reality (XR), metaverse, gamification, etc. have shown enormous market growth within the healthcare system, particularly with the emergence of pandemics. These technologies supplemented interactivity, immersive experience, 3D modeling, touching sensory elements, simulation, and feedback mechanisms to tackle the COVID-19 disease in healthcare systems. Keeping in view the applicability and significance of immersive technological advancement, the major aim of this study is to identify and highlight the role of immersive technologies concerning handling COVID-19 in the healthcare setup. The contribution of immersive technologies in the healthcare domain for the different purposes such as medical education, medical training, proctoring, online surgeries, stress management, social distancing, physical fitness, drug manufacturing and designing, and cognitive rehabilitation is highlighted. A comprehensive and in-depth analysis of the collected studies has been performed to understand the current research work and future research directions. A state-of-the-artwork is presented to identify and discuss the various issues involving the adoption of immersive technologies in the healthcare area. Furthermore, the solutions to these emerging challenges and issues have been provided based on an extensive literature study. The results of this study show that immersive technologies have the considerable potential to provide massive support to stakeholders in the healthcare system during current COVID-19 situation and future pandemics.

Interactive teaching of medical 3D cardiac anatomy: atrial anatomy enhanced by ECG and 3D visualization

The most commonly applied way of teaching students to convey the foundations of human anatomy and physiology involves textbooks and lectures. This way of transmitting knowledge causes difficulties for students, especially in the context of three-dimensional imaging of organ structures, and as a consequence translates into difficulties with imagining them. Even despite the rapid uptake of knowledge dissemination provided by online materials, including courses and webinars, there is a clear need for learning programs featuring first-hand immersive experiences tailored to suit individual study paces. In this paper, we present an approach to enhance a classical study program by combining multi-modality data and representing them in a Mixed Reality (MR)-based environment. The advantages of the proposed approach have been proven by the conducted investigation of the relationship between atrial anatomy, its electrophysiological characteristics, and resulting P wave morphology on the electrocardiogram (ECG). Another part of the paper focuses on the role of the sinoatrial node in ECG formation, while the MR-based visualization of combined micro-computed tomography (micro-CT) data with non-invasive CineECG imaging demonstrates the educational application of these advanced technologies for teaching cardiac anatomy and ECG correlations.

Delivering clinical tutorials to medical students using the Microsoft HoloLens 2: A mixed-methods evaluation

BACKGROUND

Mixed reality offers potential educational advantages in the delivery of clinical teaching. Holographic artefacts can be rendered within a shared learning environment using devices such as the Microsoft HoloLens 2. In addition to facilitating remote access to clinical events, mixed reality may provide a means of sharing mental models, including the vertical and horizontal integration of curricular elements at the bedside. This study aimed to evaluate the feasibility of delivering clinical tutorials using the Microsoft HoloLens 2 and the learning efficacy achieved.

METHODS

Following receipt of institutional ethical approval, tutorials on preoperative anaesthetic history taking and upper airway examination were facilitated by a tutor who wore the HoloLens device. The tutor interacted face to face with a patient and two-way audio-visual interaction was facilitated using the HoloLens 2 and Microsoft Teams with groups of students who were located in a separate tutorial room. Holographic functions were employed by the tutor. The tutor completed the System Usability Scale, the tutor, technical facilitator, patients, and students provided quantitative and qualitative feedback, and three students participated in semi-structured feedback interviews. Students completed pre- and post-tutorial, and end-of-year examinations on the tutorial topics.

RESULTS

Twelve patients and 78 students participated across 12 separate tutorials. Five students did not complete the examinations and were excluded from efficacy calculations. Student feedback contained 90 positive comments, including the technology's ability to broadcast the tutor's point-of-vision, and 62 negative comments, where students noted issues with the audio-visual quality, and concerns that the tutorial was not as beneficial as traditional in-person clinical tutorials. The technology and tutorial structure were viewed favourably by the tutor, facilitator and patients. Significant improvement was observed between students' pre- and post-tutorial MCQ scores (mean 59.2% Vs 84.7%, p < 0.001).

CONCLUSIONS

This study demonstrates the feasibility of using the HoloLens 2 to facilitate remote bedside tutorials which incorporate holographic learning artefacts. Students' examination performance supports substantial learning of the tutorial topics. The tutorial structure was agreeable to students, patients and tutor. Our results support the feasibility of offering effective clinical teaching and learning opportunities using the HoloLens 2. However, the technical limitations and costs of the device are significant, and further research is required to assess the effectiveness of this tutorial format against in-person tutorials before wider roll out of this technology can be recommended as a result of this study.

Advances and Innovations in Ablative Head and Neck Oncologic Surgery Using Mixed Reality Technologies in Personalized Medicine

The benefit of computer-assisted planning in head and neck ablative and reconstructive surgery has been extensively documented over the last decade. This approach has been proven to offer a more secure surgical procedure. In the treatment of cancer of the head and neck, computer-assisted surgery can be used to visualize and estimate the location and extent of the tumor mass. Nowadays, some software tools even allow the visualization of the structures of interest in a mixed reality environment. However, the precise integration of mixed reality systems into a daily clinical routine is still a challenge. To date, this technology is not yet fully integrated into clinical settings such as the tumor board, surgical planning for head and neck tumors, or medical and surgical education. As a consequence, the handling of these systems is still of an experimental nature, and decision-making based on the presented data is not yet widely used. The aim of this paper is to present a novel, user-friendly 3D planning and mixed reality software and its potential application for ablative and reconstructive head and neck surgery.