Application of Virtual and Augmented Reality Technology in Hip Surgery: Systematic Review

Augmented and Virtual Reality Applications in Rhinology: A Scoping Review

OBJECTIVES

Virtual reality (VR) and augmented reality (AR) are innovative technologies that have a wide range of potential applications in the health care industry. The aim of this study was to investigate the body of research on AR and VR applications in rhinology by performing a scoping review.

DATA SOURCES

PubMed, Scopus, and Embase.

REVIEW METHODS

According to PRISM-ScR guidelines, a scoping review of literature on the application of AR and/or VR in the context of Rhinology was conducted using PubMed, Scopus, and Embase.

RESULTS

Forty-nine articles from 1996 to 2023 met the criteria for review. Five broad types of AR and/or VR applications were found: preoperative, intraoperative, training/education, feasibility, and technical. The subsequent clinical domains were recognized: craniovertebral surgery, nasal endoscopy, transsphenoidal surgery, skull base surgery, endoscopic sinus surgery, and sinonasal malignancies.

CONCLUSION

AR and VR have comprehensive applications in Rhinology. AR for surgical navigation may have the most emerging potential in skull base surgery and endoscopic sinus surgery. VR can be utilized as an engaging training tool for surgeons and residents and as a distraction analgesia for patients undergoing office-based procedures. Additional research is essential to further understand the tangible effects of these technologies on measurable clinical results. Laryngoscope, 2024.

3D-SARC: A Pilot Study Testing the Use of a 3D Augmented-Reality Model with Conventional Imaging as a Preoperative Assessment Tool for Surgical Resection of Retroperitoneal Sarcoma

BACKGROUND

Retroperitoneal sarcomas (RPSs) present a surgical challenge, with complex anatomic relationships to organs and vascular structures. This pilot study investigated the role of three-dimensional (3D) augmented reality (3DAR) compared with standard imaging in preoperative planning and resection strategies.

METHODS

For the study, 13 patients who underwent surgical resection of their RPS were selected based on the location of their tumor (right, left, pelvis). From the patients' preoperative computed tomography (CT) scans, 3DAR models were created using a D2P program and projected by an augmented-reality (AR) glass (Hololens). The 3DAR models were evaluated by three experienced sarcoma surgeons and compared with the baseline two-dimensional (2D) contrast-enhanced CT scans.

RESULTS

Three members of the surgical team evaluated 13 models of retroperitoneal sarcomas, resulting in a total of 26 responses. When the surgical team was asked to evaluate whether the 3DAR better prepared the surgeon for planned surgical resection, 10 responses favored the 3DAR, 5 favored the 2D CT scans and 11 showed no difference (p = 0.074). According to 15 (57.6 %) of the 26 responses, the 3DAR offered additional value over standard imaging in the preoperative planning (median score of 4; range, 1-5). The median stated likelihood that the surgeons would consult the 3DAR was 5 (range, 2-5) for the preoperative setting and 3 (range, 1-5) for the intraoperative setting.

CONCLUSIONS

This pilot study suggests that the use of 3DAR may provide additional value over current standard imaging in the preoperative planning for surgical resection of RPS, and the technology merits further study.

Recent trends in bone tissue engineering: a review of materials, methods, and structures

Bone tissue engineering (BTE) provides the treatment possibility for segmental long bone defects that are currently an orthopedic dilemma. This review explains different strategies, from biological, material, and preparation points of view, such as using different stem cells, ceramics, and metals, and their corresponding properties for BTE applications. In addition, factors such as porosity, surface chemistry, hydrophilicity and degradation behavior that affect scaffold success are introduced. Besides, the most widely used production methods that result in porous materials are discussed. Gene delivery and secretome-based therapies are also introduced as a new generation of therapies. This review outlines the positive results and important limitations remaining in the clinical application of novel BTE materials and methods for segmental defects.

Development of Augmented Reality Vision for Osteosynthesis Using a 3D Camera

BACKGROUND

We developed a 3D camera system to track motion in a surgical field. This system has the potential to introduce augmented reality (AR) systems non-invasively, eliminating the need for the invasive AR markers conventionally required. The present study was performed to verify the real-time tracking accuracy of this system, assess the feasibility of integrating this system into the surgical workflow, and establish its potential to enhance the accuracy and efficiency of orthopedic procedures.

METHODS

To evaluate the accuracy of AR technology using a 3D camera, a forearm bone model was created. The forearm model was depicted using a 3D camera, and its accuracy was verified in terms of the positional relationship with a 3D bone model created from previously imaged CT data. Images of the surgical field (capturing the actual forearm) were taken and saved in nine poses by rotating the forearm from pronation to supination. The alignment of the reference points was computed at the three points of CT versus the three points of the 3D camera, yielding a 3D rotation matrix representing the positional relationship. In the original system, a stereo vision-based 3D camera, with a depth image resolution of 1280×720 pixels, 30 frames per second, and a lens field of view of 64 specifications, with a baseline of 3 cm, capable of optimally acquiring real-time 3D data at a distance of 40-60 cm from the subject was used. In the modified system, the following modifications were made to improve tracking performance: (1) color filter processing was changed from HSV to RGB, (2) positional detection accuracy was modified with supporting marker sizes of 8 mm in diameter, and (3) the detection of marker positions was stabilized by calculating the marker position for each frame. Tracking accuracy was examined with the original system and modified system for the following parameters: differences in the rotation matrix, maximum and minimum inter-reference point errors between CT-based and camera-based 3D data, and the average error for the three reference points.

RESULTS

In the original system, the average difference in rotation matrices was 5.51±2.68 mm. Average minimum and maximum errors were 1.10±0.61 and 15.53±12.51 mm, respectively. The average error of reference points was 6.26±4.49 mm. In the modified system, the average difference in rotation matrices was 4.22±1.73 mm. Average minimum and maximum errors were 0.79±0.49 and 1.94±0.87 mm, respectively. The average error of reference points was 1.41±0.58 mm. In the original system, once tracking failed, it was difficult to recover tracking accuracy. This resulted in a large maximum error in supination positions. These issues were resolved by the modified system. Significant improvements were achieved in maximum errors and average errors using the modified system (P<0.05).

CONCLUSION

AR technology using a 3D camera was developed. This system allows direct comparisons of 3D data from preoperative CT scans with 3D data acquired from the surgical field using a 3D camera. This method has the advantage of introducing AR into the surgical field without invasive markers.

The application of extended reality technology-assisted intraoperative navigation in orthopedic surgery

Extended reality (XR) technology refers to any situation where real-world objects are enhanced with computer technology, including virtual reality, augmented reality, and mixed reality. Augmented reality and mixed reality technologies have been widely applied in orthopedic clinical practice, including in teaching, preoperative planning, intraoperative navigation, and surgical outcome evaluation. The primary goal of this narrative review is to summarize the effectiveness and superiority of XR-technology-assisted intraoperative navigation in the fields of trauma, joint, spine, and bone tumor surgery, as well as to discuss the current shortcomings in intraoperative navigation applications. We reviewed titles of more than 200 studies obtained from PubMed with the following search terms: extended reality, mixed reality, augmented reality, virtual reality, intraoperative navigation, and orthopedic surgery; of those 200 studies, 69 related papers were selected for abstract review. Finally, the full text of 55 studies was analyzed and reviewed. They were classified into four groups-trauma, joint, spine, and bone tumor surgery-according to their content. Most of studies that we reviewed showed that XR-technology-assisted intraoperative navigation can effectively improve the accuracy of implant placement, such as that of screws and prostheses, reduce postoperative complications caused by inaccurate implantation, facilitate the achievement of tumor-free surgical margins, shorten the surgical duration, reduce radiation exposure for patients and surgeons, minimize further damage caused by the need for visual exposure during surgery, and provide richer and more efficient intraoperative communication, thereby facilitating academic exchange, medical assistance, and the implementation of remote healthcare.

State of the Art in Immersive Interactive Technologies for Surgery Simulation: A Review and Prospective

Immersive technologies have thrived on a strong foundation of software and hardware, injecting vitality into medical training. This surge has witnessed numerous endeavors incorporating immersive technologies into surgery simulation for surgical skills training, with a growing number of researchers delving into this domain. Relevant experiences and patterns need to be summarized urgently to enable researchers to establish a comprehensive understanding of this field, thus promoting its continuous growth. This study provides a forward-looking perspective by reviewing the latest development of immersive interactive technologies for surgery simulation. The investigation commences from a technological standpoint, delving into the core aspects of virtual reality (VR), augmented reality (AR) and mixed reality (MR) technologies, namely, haptic rendering and tracking. Subsequently, we summarize recent work based on the categorization of minimally invasive surgery (MIS) and open surgery simulations. Finally, the study showcases the impressive performance and expansive potential of immersive technologies in surgical simulation while also discussing the current limitations. We find that the design of interaction and the choice of immersive technology in virtual surgery development should be closely related to the corresponding interactive operations in the real surgical speciality. This alignment facilitates targeted technological adaptations in the direction of greater applicability and fidelity of simulation.

Virtual and augmented reality in biomedical engineering

BACKGROUND

In the future, extended reality technology will be widely used. People will be led to utilize virtual reality (VR) and augmented reality (AR) technologies in their daily lives, hobbies, numerous types of entertainment, and employment. Medical augmented reality has evolved with applications ranging from medical education to picture-guided surgery. Moreover, a bulk of research is focused on clinical applications, with the majority of research devoted to surgery or intervention, followed by rehabilitation and treatment applications. Numerous studies have also looked into the use of augmented reality in medical education and training.

METHODS

Using the databases Semantic Scholar, Web of Science, Scopus, IEEE Xplore, and ScienceDirect, a scoping review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria. To find other articles, a manual search was also carried out in Google Scholar. This study presents studies carried out over the previous 14 years (from 2009 to 2023) in detail. We classify this area of study into the following categories: (1) AR and VR in surgery, which is presented in the following subsections: subsection A: MR in neurosurgery; subsection B: spine surgery; subsection C: oral and maxillofacial surgery; and subsection D: AR-enhanced human-robot interaction; (2) AR and VR in medical education presented in the following subsections; subsection A: medical training; subsection B: schools and curriculum; subsection C: XR in Biomedicine; (3) AR and VR for rehabilitation presented in the following subsections; subsection A: stroke rehabilitation during COVID-19; subsection B: cancer and VR, and (4) Millimeter-wave and MIMO systems for AR and VR.

RESULTS

In total, 77 publications were selected based on the inclusion criteria. Four distinct AR and/or VR applications groups could be differentiated: AR and VR in surgery (N = 21), VR and AR in Medical Education (N = 30), AR and VR for Rehabilitation (N = 15), and Millimeter-Wave and MIMO Systems for AR and VR (N = 7), where N is number of cited studies. We found that the majority of research is devoted to medical training and education, with surgical or interventional applications coming in second. The research is mostly focused on rehabilitation, therapy, and clinical applications. Moreover, the application of XR in MIMO has been the subject of numerous research.

CONCLUSION

Examples of these diverse fields of applications are displayed in this review as follows: (1) augmented reality and virtual reality in surgery; (2) augmented reality and virtual reality in medical education; (3) augmented reality and virtual reality for rehabilitation; and (4) millimeter-wave and MIMO systems for augmented reality and virtual reality.

Virtual reality psychological intervention helps reduce preoperative anxiety in patients undergoing carotid artery stenting: a single-blind randomized controlled trial

Objective

This study aimed to explore the effectiveness and applicability of a psychological intervention using virtual reality (VR) to reduce preoperative anxiety in patients undergoing carotid artery stenting (CAS).

Methods

A total of 114 patients aged 18-86 years who were scheduled to undergo CAS were randomized to the VR and control groups. Patients in the VR group used a VR headset to view a 16-min psychological intervention video, while those in the control group used a tablet for viewing. The primary assessment instrument was the State Anxiety Inventory (S-AI), which was given 20 min before and after the intervention and 24 h after surgery. Secondary assessment tools were the Self-efficacy for Managing Chronic Disease (SEMCD-6) scale, which was completed before the intervention and 24 h after the operation, a smart bracelet to assess sleep quality, monitored in the evening before the operation, and the VR Suitability and Satisfaction Questionnaire, completed 24 h after the operation.

Results

The two groups were similar in terms of demographic information, preintervention STAI scores and preintervention SEMCD-6 scores (p > 0.05). S-AI scores were lower in both groups after the intervention and surgery, and the scores of the VR group were lower than those of the control group (p = 0.036, p = 0.014). SEMCD-6 scores post-surgery had improved in both groups, but the VR group had significantly higher scores than the control group (p = 0.005). Smart bracelet measurements showed no significant differences in postintervention sleep quality between the two groups (p = 0.540). For satisfaction, the VR group scored higher in all aspects except scheduling. A total of 47 (85.45%) patients reported having a comfortable experience, and only 5 (9.09%) experienced mild adverse effects.

Conclusion

The use of a virtual reality psychological intervention was beneficial to reduce the anxiety of patients before CAS and improved their self-efficacy. As virtual reality devices evolve and demonstrate better comfort and safety, more comprehensive and in-depth research of the use of VR to reduce patient anxiety should be performed in the future.Clinical trial registration:https://www.chictr.org.cn/showproj.aspx?proj=186412, identifier ChiCTR2200066219.