Current status of augmented reality in cerebrovascular surgery: a systematic review

Augmented and Virtual Reality Applications in Rhinology: A Scoping Review

OBJECTIVES

Virtual reality (VR) and augmented reality (AR) are innovative technologies that have a wide range of potential applications in the health care industry. The aim of this study was to investigate the body of research on AR and VR applications in rhinology by performing a scoping review.

DATA SOURCES

PubMed, Scopus, and Embase.

REVIEW METHODS

According to PRISM-ScR guidelines, a scoping review of literature on the application of AR and/or VR in the context of Rhinology was conducted using PubMed, Scopus, and Embase.

RESULTS

Forty-nine articles from 1996 to 2023 met the criteria for review. Five broad types of AR and/or VR applications were found: preoperative, intraoperative, training/education, feasibility, and technical. The subsequent clinical domains were recognized: craniovertebral surgery, nasal endoscopy, transsphenoidal surgery, skull base surgery, endoscopic sinus surgery, and sinonasal malignancies.

CONCLUSION

AR and VR have comprehensive applications in Rhinology. AR for surgical navigation may have the most emerging potential in skull base surgery and endoscopic sinus surgery. VR can be utilized as an engaging training tool for surgeons and residents and as a distraction analgesia for patients undergoing office-based procedures. Additional research is essential to further understand the tangible effects of these technologies on measurable clinical results. Laryngoscope, 134:4433-4440, 2024.

Beyond the visible: preliminary evaluation of the first wearable augmented reality assistance system for pancreatic surgery

PURPOSE

The retroperitoneal nature of the pancreas, marked by minimal intraoperative organ shifts and deformations, makes augmented reality (AR)-based systems highly promising for pancreatic surgery. This study presents preliminary data from a prospective study aiming to develop the first wearable AR assistance system, ARAS, for pancreatic surgery and evaluating its usability, accuracy, and effectiveness in enhancing the perioperative outcomes of patients.

METHODS

We developed ARAS as a two-phase system for a wearable AR device to aid surgeons in planning and operation. This system was used to visualize and register patient-specific 3D anatomical models during the surgery. The location and precision of the registered 3D anatomy were evaluated by assessing the arterial pulse and employing Doppler and duplex ultrasonography. The usability, accuracy, and effectiveness of ARAS were assessed using a five-point Likert scale questionnaire.

RESULTS

Perioperative outcomes of five patients underwent various pancreatic resections with ARAS are presented. Surgeons rated ARAS as excellent for preoperative planning. All structures were accurately identified without any noteworthy errors. Only tumor identification decreased after the preparation phase, especially in patients who underwent pancreaticoduodenectomy because of the extensive mobilization of peripancreatic structures. No perioperative complications related to ARAS were observed.

CONCLUSIONS

ARAS shows promise in enhancing surgical precision during pancreatic procedures. Its efficacy in preoperative planning and intraoperative vascular identification positions it as a valuable tool for pancreatic surgery and a potential educational resource for future surgical residents.

Augmented Reality Integration in Skull Base Neurosurgery: A Systematic Review

Background and Objectives: To investigate the role of augmented reality (AR) in skull base (SB) neurosurgery. Materials and Methods: Utilizing PRISMA methodology, PubMed and Scopus databases were explored to extract data related to AR integration in SB surgery. Results: The majority of 19 included studies (42.1%) were conducted in the United States, with a focus on the last five years (77.8%). Categorization included phantom skull models (31.2%, n = 6), human cadavers (15.8%, n = 3), or human patients (52.6%, n = 10). Microscopic surgery was the predominant modality in 10 studies (52.6%). Of the 19 studies, surgical modality was specified in 18, with microscopic surgery being predominant (52.6%). Most studies used only CT as the data source (n = 9; 47.4%), and optical tracking was the prevalent tracking modality (n = 9; 47.3%). The Target Registration Error (TRE) spanned from 0.55 to 10.62 mm. Conclusion: Despite variations in Target Registration Error (TRE) values, the studies highlighted successful outcomes and minimal complications. Challenges, such as device practicality and data security, were acknowledged, but the application of low-cost AR devices suggests broader feasibility.

Augmented Reality in Neurosurgery: A New Paradigm for Training

Augmented reality (AR) involves the overlay of computer-generated images onto the user's real-world visual field to modify or enhance the user's visual experience. With respect to neurosurgery, AR integrates preoperative and intraoperative imaging data to create an enriched surgical experience that has been shown to improve surgical planning, refine neuronavigation, and reduce operation time. In addition, AR has the potential to serve as a valuable training tool for neurosurgeons in a way that minimizes patient risk while facilitating comprehensive training opportunities. The increased use of AR in neurosurgery over the past decade has led to innovative research endeavors aiming to develop novel, more efficient AR systems while also improving and refining present ones. In this review, we provide a concise overview of AR, detail current and emerging uses of AR in neurosurgery and neurosurgical training, discuss the limitations of AR, and provide future research directions. Following the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), 386 articles were initially identified. Two independent reviewers (GH and AC) assessed article eligibility for inclusion, and 31 articles are included in this review. The literature search included original (retrospective and prospective) articles and case reports published in English between 2013 and 2023. AR assistance has shown promise within neuro-oncology, spinal neurosurgery, neurovascular surgery, skull-base surgery, and pediatric neurosurgery. Intraoperative use of AR was found to primarily assist with surgical planning and neuronavigation. Similarly, AR assistance for neurosurgical training focused primarily on surgical planning and neuronavigation. However, studies included in this review utilize small sample sizes and remain largely in the preliminary phase. Thus, future research must be conducted to further refine AR systems before widespread intraoperative and educational use.

Twin-S: a digital twin for skull base surgery

PURPOSE

Digital twins are virtual replicas of real-world objects and processes, and they have potential applications in the field of surgical procedures, such as enhancing situational awareness. We introduce Twin-S, a digital twin framework designed specifically for skull base surgeries.

METHODS

Twin-S is a novel framework that combines high-precision optical tracking and real-time simulation, making it possible to integrate it into image-guided interventions. To guarantee accurate representation, Twin-S employs calibration routines to ensure that the virtual model precisely reflects all real-world processes. Twin-S models and tracks key elements of skull base surgery, including surgical tools, patient anatomy, and surgical cameras. Importantly, Twin-S mirrors real-world drilling and updates the virtual model at frame rate of 28.

RESULTS

Our evaluation of Twin-S demonstrates its accuracy, with an average error of 1.39 mm during the drilling process. Our study also highlights the benefits of Twin-S, such as its ability to provide augmented surgical views derived from the continuously updated virtual model, thus offering additional situational awareness to the surgeon.

CONCLUSION

We present Twin-S, a digital twin environment for skull base surgery. Twin-S captures the real-world surgical progresses and updates the virtual model in real time through the use of modern tracking technologies. Future research that integrates vision-based techniques could further increase the accuracy of Twin-S.

Preclinical Application of Augmented Reality in Pediatric Craniofacial Surgery: An Accuracy Study

Background: Augmented reality (AR) allows the overlapping and integration of virtual information with the real environment. The camera of the AR device reads the object and integrates the virtual data. It has been widely applied to medical and surgical sciences in recent years and has the potential to enhance intraoperative navigation. Materials and methods: In this study, the authors aim to assess the accuracy of AR guidance when using the commercial HoloLens 2 head-mounted display (HMD) in pediatric craniofacial surgery. The Authors selected fronto-orbital remodeling (FOR) as the procedure to test (specifically, frontal osteotomy and nasal osteotomy were considered). Six people (three surgeons and three engineers) were recruited to perform the osteotomies on a 3D printed stereolithographic model under the guidance of AR. By means of calibrated CAD/CAM cutting guides with different grooves, the authors measured the accuracy of the osteotomies that were performed. We tested accuracy levels of ±1.5 mm, ±1 mm, and ±0.5 mm. Results: With the HoloLens 2, the majority of the individuals involved were able to successfully trace the trajectories of the frontal and nasal osteotomies with an accuracy level of ±1.5 mm. Additionally, 80% were able to achieve an accuracy level of ±1 mm when performing a nasal osteotomy, and 52% were able to achieve an accuracy level of ±1 mm when performing a frontal osteotomy, while 61% were able to achieve an accuracy level of ±0.5 mm when performing a nasal osteotomy, and 33% were able to achieve an accuracy level of ±0.5 mm when performing a frontal osteotomy. Conclusions: despite this being an in vitro study, the authors reported encouraging results for the prospective use of AR on actual patients.

Head-Mounted Augmented Reality in the Planning of Cerebrovascular Neurosurgical Procedures: A Single-Center Initial Experience

BACKGROUND

Augmented reality (AR) technology has played an increasing role in cerebrovascular neurosurgery over the last 2 decades. Hence, we aim to evaluate the technical and educational value of head-mounted AR in cerebrovascular procedures.

METHODS

This is a single-center retrospective study of patients who underwent open surgery for cranial and spinal cerebrovascular lesions between April and August 2022. In all cases, the Medivis Surgical AR platform and HoloLens 2 were used for preoperative and intraoperative (preincision) planning. Surgical plan adjustment due to the use of head-mounted AR and subjective educational value of the tool were recorded.

RESULTS

A total of 33 patients and 35 cerebrovascular neurosurgical procedures were analyzed. Procedures included 12 intracranial aneurysm clippings, 6 brain and 1 spinal arteriovenous malformation resections, 2 cranial dural arteriovenous fistula obliterations, 3 carotid endarterectomies, two extracranial-intracranial direct bypasses, two encephaloduroangiosynostosis for Moyamoya disease, 1 biopsy of the superficial temporal artery, 2 microvascular decompressions, 2 cavernoma resections, 1 combined intracranial aneurysm clipping and encephaloduroangiosynostosis for Moyamoya disease, and 1 percutaneous feeder catheterization for arteriovenous malformation embolization. Minor changes in the surgical plan were recorded in 16 of 35 procedures (45.7%). Subjective educational value was scored as "very helpful" for cranial, spinal arteriovenous malformations, and carotid endarterectomies; "helpful" for intracranial aneurysm, dural arteriovenous fistulas, direct bypass, encephaloduroangiosynostosis, and superficial temporal artery-biopsy; and "not helpful" for cavernoma resection and microvascular decompression.

CONCLUSIONS

Head-mounted AR can be used in cerebrovascular neurosurgery as an adjunctive tool that might influence surgical strategy, enable 3-dimensional understanding of complex anatomy, and provide great educational value in selected cases.

Mixed Reality in der Gefäßchirurgie – ein Scoping Review

Hintergrund „Mixed Reality“ (MR) erlaubt die Projektion von virtuellen Objekten in das Sichtfeld des Anwenders durch ein Head-mounted Display (HMD). Im gefäßchirurgischen Behandlungsspektrum könnten MR-Anwendungen in Zukunft einen Nutzen darstellen. Im folgenden Scoping Review soll eine Orientierung über die aktuelle Anwendung der genannten Technologien im Bereich der Gefäßchirurgie gegeben und Forschungsziele für die Zukunft definiert werden. Material und Methoden Es erfolgte eine systematische Literaturrecherche in PubMed (MEDLINE) mit den Suchbegriffen „aorta“, „intervention“, „endovsacular intervention“, „vascular surgery“, „aneurysm“, „endovascular“, „vascular access“ jeweils in Kombination mit „mixed reality“ oder „augmented reality“. Die Suche erfolgte nach PRISMA-Leitlinie (Preferred Reporting Items for Systematic reviews and Meta-Analyses) für Scoping Reviews. Ergebnisse Aus 547 Literaturstellen konnten 8 relevante Studien identifiziert werden. Die Suchergebnisse konnten in 2 Anwendungskategorien eingeteilt werden: (1) MR mit dem Ziel des Informationsmanagements und zur Verbesserung der periprozeduralen Ergonomie gefäßchirurgischer Eingriffe (n = 3) sowie (2) MR mit dem Ziel der intraoperativen Navigation bei gefäßchirurgischen Eingriffen (n = 5). Die Registrierung des physischen Patienten mit dem virtuellen Objekt und das Tracking von Instrumenten in der MR-Umgebung zur intraoperativen Navigation ist dabei im Fokus des wissenschaftlichen Interesses und konnte technisch erfolgreich am Phantom- und Tiermodell gezeigt werden. Die bisher vorgestellten Methoden sind jedoch mit hohem infrastrukturellem Aufwand und relevanten Limitationen verbunden. Schlussfolgerung Der Einsatz von MR im Bereich der Gefäßchirurgie ist grundsätzlich vielversprechend. Für die Zukunft sollten alternative, pragmatische Registrierungsmethoden mit entsprechender Quantifizierung des Positionierungsfehlers angestrebt werden. Die entwickelten Soft- und Hardwarelösungen sollten auf das Anforderungsprofil der Gefäßchirurgie angepasst werden. Das elektromagnetische Instrumenten-Tracking erscheint als sinnvolle, komplementäre Technologie zur Umsetzung der MR-assistierten Navigation.