Using Mixed Reality Headsets to Deliver Remote Bedside Teaching During the COVID-19 Pandemic: Feasibility Trial of HoloLens 2

Holo-Stroke: Assessing for Immersive Stroke Care Through Stroke Hologram Teleportation

Background: Augmented reality enables the wearer to see both their physical environment and virtual objects. Holograms could allow 3D video of providers to be transmitted to distant sites, allowing patients to interact with virtual providers as if they are in the same physical space. Our aim was to determine if Tele-Stroke augmented with Holo-Stroke, compared with Tele-Stroke alone, could improve satisfaction and perception of immersion for the patient. Methods: Kinect cameras positioned at 90-degree intervals around the hub practitioner were used. Cameras streamed real-time optical video to a unity point-cloud program where the data were stitched together in a 360-degree view. The resultant hologram was positioned in 3D space and was visible through the head-mounted display by the patient. Radiology images were shared in Tele-Stroke and via hologram. Likert satisfaction questions were administered. Wilcoxon signed-rank testing was used. Results: Each of the 30 neurology clinic participants scored both Tele-Stroke and Holo-Stroke. Out of these, 29 patients completed the assessments (1 failure owing to computer reboot). Average age was 52 years, with 53.3% of the patients being female, 70.0% being White, and 13.3% being Hispanic. Likert scale score median "Overall" was 32 Tele-Stroke versus 48 Holo-Stroke (p < 0.00001), "Immersion" was 5 versus 10 (p < 0.00001), "Beneficial Technique" was 6 versus 10 (p < 0.00001), and "Ability to See Images" was 5 versus 10 (p < 0.00001). Discussion: Holo-Stroke 3D holographic Tele-Stroke exams resulted in feasibility, satisfaction, and high perception of immersion for the patient. Patients were enthusiastic for the more immersive, personal discussion with their provider and a robust way to experience radiology images. Though further assessments are needed, Holo-Stroke can help the provider "be there, not just see there!"

A comprehensive study on unraveling the advances of immersive technologies (VR/AR/MR/XR) in the healthcare sector during the COVID-19: Challenges and solutions

The current COVID-19 pandemic has affected almost every aspect of life but its impact on the healthcare landscape is conspicuously adverse. However, digital technologies played a significant contribution in coping with the challenges spawned by this pandemic. In this list of applied digital technologies, the role of immersive technologies in battling COVID-19 is notice-worthy. Immersive technologies consisting of virtual reality (VR), augmented reality (AR), mixed reality (MR), extended reality (XR), metaverse, gamification, etc. have shown enormous market growth within the healthcare system, particularly with the emergence of pandemics. These technologies supplemented interactivity, immersive experience, 3D modeling, touching sensory elements, simulation, and feedback mechanisms to tackle the COVID-19 disease in healthcare systems. Keeping in view the applicability and significance of immersive technological advancement, the major aim of this study is to identify and highlight the role of immersive technologies concerning handling COVID-19 in the healthcare setup. The contribution of immersive technologies in the healthcare domain for the different purposes such as medical education, medical training, proctoring, online surgeries, stress management, social distancing, physical fitness, drug manufacturing and designing, and cognitive rehabilitation is highlighted. A comprehensive and in-depth analysis of the collected studies has been performed to understand the current research work and future research directions. A state-of-the-artwork is presented to identify and discuss the various issues involving the adoption of immersive technologies in the healthcare area. Furthermore, the solutions to these emerging challenges and issues have been provided based on an extensive literature study. The results of this study show that immersive technologies have the considerable potential to provide massive support to stakeholders in the healthcare system during current COVID-19 situation and future pandemics.

The feasibility and usability of mixed reality teaching in a hospital setting based on self-reported perceptions of medical students

BACKGROUND

Clinical teaching during encounters with real patients lies at the heart of medical education. Mixed reality (MR) using a Microsoft HoloLens 2 (HL2) offers the potential to address several challenges: including enabling remote learning; decreasing infection control risks; facilitating greater access to medical specialties; and enhancing learning by vertical integration of basic principles to clinical application. We aimed to assess the feasibility and usability of MR using the HL2 for teaching in a busy, tertiary referral university hospital.

METHODS

This prospective observational study examined the use of the HL2 to facilitate a live two-way broadcast of a clinician-patient encounter, to remotely situated third and fourth year medical students. System Usability Scale (SUS) Scores were elicited from participating medical students, clinician, and technician. Feedback was also elicited from participating patients. A modified Evaluation of Technology-Enhanced Learning Materials: Learner Perceptions Questionnaire (mETELM) was completed by medical students and patients.

RESULTS

This was a mixed methods prospective, observational study, undertaken in the Day of Surgery Assessment Unit. Forty-seven medical students participated. The mean SUS score for medical students was 71.4 (SD 15.4), clinician (SUS = 75) and technician (SUS = 70) indicating good usability. The mETELM Questionnaire using a 7-point Likert Scale demonstrated MR was perceived to be more beneficial than a PowerPoint presentation (Median = 7, Range 6-7). Opinion amongst the student cohort was divided as to whether the MR tutorial was as beneficial for learning as a live patient encounter would have been (Median = 5, Range 3-6). Students were positive about the prospect of incorporating of MR in future tutorials (Median = 7, Range 5-7). The patients' mETELM results indicate the HL2 did not affect communication with the clinician (Median = 7, Range 7-7). The MR tutorial was preferred to a format based on small group teaching at the bedside (Median = 6, Range 4-7).

CONCLUSIONS

Our study findings indicate that MR teaching using the HL2 demonstrates good usability characteristics for providing education to medical students at least in a clinical setting and under conditions similar to those of our study. Also, it is feasible to deliver to remotely located students, although certain practical constraints apply including Wi-Fi and audio quality.

Leveraging Space-Flown Technologies to Deliver Healthcare with Holographic Physical Examinations

INTRODUCTION: Musculoskeletal injuries are one of the more common injuries in spaceflight. Physical assessment of an injury is essential for diagnosis and treatment. Unfortunately, when musculoskeletal injuries occur in space, the flight surgeon is limited to two-dimensional videoconferencing and, potentially, observations made by the crew medical officer. To address these limitations, we investigated the feasibility of performing physical examinations on a three-dimensional augmented reality projection using a mixed-reality headset, specifically evaluating a standard shoulder examination.METHODS: A simulated patient interaction was set up between Western University in London, Ontario, Canada, and Huntsville, AL, United States. The exam was performed by a medical student, and a healthy adult man volunteered to enable the physical exam.RESULTS: All parts of the standard shoulder physical examination according to the Bates Guide to the Physical Exam were performed with holoportation. Adaptation was required for the palpation and some special tests.DISCUSSION: All parts of the physical exam were able to be completed. The true to anatomical size of the holograms permitted improved inspection of the anatomy compared to traditional videoconferencing. Palpation was completed by instructing the patient to palpate themselves and comment on relevant findings asked by the examiner. Range of motion and special tests for specific pathologies were also able to be completed with some modifications due to the examiner not being present to provide resistance. Future work should aim to improve the graphics, physician communication, and haptic feedback during holoportation.Levschuk A, Whittal J, Trejos AL, Sirek A. Leveraging space-flown technologies to deliver healthcare with holographic physical examinations. Aerosp Med Hum Perform. 2024; 95(4):214-218.

Learning technology in health professions education: Realising an (un)imagined future

CONTEXT

Technology is being introduced, used and studied in almost all areas of health professions education (HPE), often with a claim of making HPE better in one way or another. However, it remains unclear if technology has driven real change in HPE. In this article, we seek to develop an understanding of the transformative capacity of learning technology in HPE.

METHODS AND OUTCOMES

We first consider the wider scholarship highlighting the intersection between technology and pedagogy, articulating what is meant by transformation and the role of learning technology in driving educational transformation. We then undertake a synthesis of the current high visibility HPE-focused research. We sampled the literature in two ways-for the five highest impact factor health professional education journals over the past decade and for all PubMed indexed journals for the last 3 years-and categorised the extant research against the Substitution, Augmentation, Modification, Redefinition model. We found that the majority of research we sampled focussed on substituting or augmenting learning through technology, with relatively few studies using technology to modify or redefine what HPE is through the use of technology. Of more concern was the lack of theoretical justification for pedagogical improvement, including transformation, underpinning the majority of studies.

CONCLUSIONS

While all kinds of technology use in learning have their place, the next step for HPE is the robust use of technology aiming to lead transformation. This should be guided by transformational educational theory and aligned with pedagogical context. We challenge HPE practitioners and scholars to work thoughtfully and with intent to enable transformation in education for future health professionals.

HoloLens® platform for healthcare professionals simulation training, teaching, and its urological applications: an up-to-date review

The advancements of technological devices and software are putting mixed reality in the frontline of teaching medical personnel. The Microsoft® HoloLens 2® offers a unique 3D visualization of a hologram in a physical, real environment and allows the urologists to interact with it. This review provides a state-of-the-art analysis of the applications of the HoloLens® in a medical and healthcare context of teaching through simulation designed for medical students, nurses, residents especially in urology. Our objective has been to perform a comprehensively analysis of the studies in PubMed/Medline database from January 2016 to April 2023. The identified articles that researched Microsoft HoloLens, having description of feasibility and teaching outcomes in medicine with an emphasize in urological healthcare, have been included. The qualitative analysis performed identifies an increasing use of HoloLens in a teaching setting that covers a great area of expertise in medical sciences (anatomy, anatomic pathology, biochemistry, pharmacogenomics, clinical skills, emergency medicine and nurse education, imaging), and above these urology applications (urological procedures and technique, skill improvement, perception of complex renal tumors, accuracy of calyx puncture guidance in percutaneous nephrolithotomy and targeted biopsy of the prostate) can mostly benefit from it. The future potential of HoloLens technology in teaching is immense. So far, studies have focused on feasibility, applicability, perception, comparisons with traditional methods, and limitations. Moving forward, research should also prioritize the development of applications specifically for urology. This will require validation of needs and the creation of adequate protocols to standardize future research efforts.

Realizing consumers' existential dreams via product marketing and mixed reality: a perspective based on affective neuroscience theories

In an era of swift societal changes and escalating consumerism, this paper presents an exploration of an innovative approach that integrates product marketing strategies, mixed reality (MR) technology, and affective neuroscience theories to actualize consumers' existential dreams. MR, with its unique capacity to blend the virtual and real worlds, can enhance the consumer experience by creating immersive, personalized environments that resonate with consumers' existential aspirations. Insights from affective neuroscience, specifically the brain's processing of emotions, guide the development of emotionally engaging marketing strategies, which strengthen the connection between consumers, products, and brands. These integrated strategies not only present a novel blueprint for companies to deepen consumer engagement but also promise more fulfilling and meaningful consumer experiences. Moreover, this approach contributes to societal well-being and prosperity, marking a significant stride in the field of marketing.

Perceptions About Augmented Reality in Remote Medical Care: Interview Study of Emergency Telemedicine Providers

BACKGROUND

Augmented reality (AR) and virtual reality (VR) have increasingly appeared in the medical literature in the past decade, with AR recently being studied for its potential role in remote health care delivery and communication. Recent literature describes AR's implementation in real-time telemedicine contexts across multiple specialties and settings, with remote emergency services in particular using AR to enhance disaster support and simulation education. Despite the introduction of AR in the medical literature and its potential to shape the future of remote medical services, studies have yet to investigate the perspectives of telemedicine providers regarding this novel technology.

OBJECTIVE

This study aimed to understand the applications and challenges of AR in telemedicine anticipated by emergency medicine providers with a range of experiences in using telemedicine and AR or VR technology.

METHODS

Across 10 academic medical institutions, 21 emergency medicine providers with variable exposures to telemedicine and AR or VR technology were recruited for semistructured interviews via snowball sampling. The interview questions focused on various potential uses of AR, anticipated obstacles that prevent its implementation in the telemedicine area, and how providers and patients might respond to its introduction. We included video demonstrations of a prototype using AR during the interviews to elicit more informed and complete insights regarding AR's potential in remote health care. Interviews were transcribed and analyzed via thematic coding.

RESULTS

Our study identified 2 major areas of use for AR in telemedicine. First, AR is perceived to facilitate information gathering by enhancing observational tasks such as visual examination and granting simultaneous access to data and remote experts. Second, AR is anticipated to supplement distance learning of both minor and major procedures and nonprocedural skills such as cue recognition and empathy for patients and trainees. AR may also supplement long-distance education programs and thereby support less specialized medical facilities. However, the addition of AR may exacerbate the preexisting financial, structural, and literacy barriers to telemedicine. Providers seek value demonstrated by extensive research on the clinical outcome, satisfaction, and financial benefits of AR. They also seek institutional support and early training before adopting novel tools such as AR. Although an overall mixed reception is anticipated, consumer adoption and awareness are key components in AR's adoption.

CONCLUSIONS

AR has the potential to enhance the ability to gather observational and medical information, which would serve a diverse set of applications in remote health care delivery and education. However, AR faces obstacles similar to those faced by the current telemedicine technology, such as lack of access, infrastructure, and familiarity. This paper discusses the potential areas of investigation that would inform future studies and approaches to implementing AR in telemedicine.

Towards Wearable Augmented Reality in Healthcare: A Comparative Survey and Analysis of Head-Mounted Displays

Head-mounted displays (HMDs) have the potential to greatly impact the surgical field by maintaining sterile conditions in healthcare environments. Google Glass (GG) and Microsoft HoloLens (MH) are examples of optical HMDs. In this comparative survey related to wearable augmented reality (AR) technology in the medical field, we examine the current developments in wearable AR technology, as well as the medical aspects, with a specific emphasis on smart glasses and HoloLens. The authors searched recent articles (between 2017 and 2022) in the PubMed, Web of Science, Scopus, and ScienceDirect databases and a total of 37 relevant studies were considered for this analysis. The selected studies were divided into two main groups; 15 of the studies (around 41%) focused on smart glasses (e.g., Google Glass) and 22 (59%) focused on Microsoft HoloLens. Google Glass was used in various surgical specialities and preoperative settings, namely dermatology visits and nursing skill training. Moreover, Microsoft HoloLens was used in telepresence applications and holographic navigation of shoulder and gait impairment rehabilitation, among others. However, some limitations were associated with their use, such as low battery life, limited memory size, and possible ocular pain. Promising results were obtained by different studies regarding the feasibility, usability, and acceptability of using both Google Glass and Microsoft HoloLens in patient-centric settings as well as medical education and training. Further work and development of rigorous research designs are required to evaluate the efficacy and cost-effectiveness of wearable AR devices in the future.

Use of virtual reality compared to the role-playing methodology in basic life support training: a two-arm pilot community-based randomised trial

INTRODUCTION

Virtual reality (VR) is a technology that allows us to replace our real environment with one created with digital media. This technology is increasingly used in the training of healthcare professionals, and previous studies show that the involvement and motivation of students who participate in activities that use VR increases compared to those who undergo training with the traditional methodology. The main aim of the study is to evaluate the learning curve of the students using a VR environment, to evaluate the satisfaction with the training activity and the cost, and to compare them with training that uses role-playing methodology.

METHODOLOGY

Two-arm community-based randomised trial. The control arm will base the training on the usual role-playing methodology. The second arm or intervention arm will base the Basic Life Support (BLS) training on a VR programme.

RESULTS

Statistically significant differences are observed in the percentage of correct answers in favour of the group that used VR as a learning methodology in the test taken at the end of the course. These differences disappear when comparing the results of the test performed at six months. The satisfaction rating of the role-playing training activity has a score of 9.37 out of a total of 10 and satisfaction with the VR methodology has a score of 9.72. The cost analysis shows that the cost of training a student by role-playing is 32.5 euros and, if trained by VR, it is 41.6 euros.

CONCLUSIONS

VR is a tool that allows the consolidation of a greater amount of knowledge in the short term and can be used for situations such as pandemics, where traditional formats are not available. In relation to student satisfaction with the training activity, the rating in both groups is very high and the differences are minimal. The results will be directly applicable to the decision making of BLS training in Central Catalonia in relation to the scheduling of training activities that use the VR methodology in an uncertain environment.

Microsoft HoloLens 2 in Medical and Healthcare Context: State of the Art and Future Prospects

In the world reference context, although virtual reality, augmented reality and mixed reality have been emerging methodologies for several years, only today technological and scientific advances have made them suitable to revolutionize clinical care and medical contexts through the provision of enhanced functionalities and improved health services. This systematic review provides the state-of-the-art applications of the Microsoft^® HoloLens 2 in a medical and healthcare context. Focusing on the potential that this technology has in providing digitally supported clinical care, also but not only in relation to the COVID-19 pandemic, studies that proved the applicability and feasibility of HoloLens 2 in a medical and healthcare scenario were considered. The review presents a thorough examination of the different studies conducted since 2019, focusing on HoloLens 2 medical sub-field applications, device functionalities provided to users, software/platform/framework used, as well as the study validation. The results provided in this paper could highlight the potential and limitations of the HoloLens 2-based innovative solutions and bring focus to emerging research topics, such as telemedicine, remote control and motor rehabilitation.