Cerebral Anatomy Detection and Surgical Planning in Patients with Anterior Skull Base Meningiomas Using a Virtual Reality Technique

Narrative review of patient-specific 3D visualization and reality technologies in skull base neurosurgery: enhancements in surgical training, planning, and navigation

Recent advances in medical imaging, computer vision, 3-dimensional (3D) modeling, and artificial intelligence (AI) integrated technologies paved the way for generating patient-specific, realistic 3D visualization of pathological anatomy in neurosurgical conditions. Immersive surgical simulations through augmented reality (AR), virtual reality (VR), mixed reality (MxR), extended reality (XR), and 3D printing applications further increased their utilization in current surgical practice and training. This narrative review investigates state-of-the-art studies, the limitations of these technologies, and future directions for them in the field of skull base surgery. We begin with a methodology summary to create accurate 3D models customized for each patient by combining several imaging modalities. Then, we explore how these models are employed in surgical planning simulations and real-time navigation systems in surgical procedures involving the anterior, middle, and posterior cranial skull bases, including endoscopic and open microsurgical operations. We also evaluate their influence on surgical decision-making, performance, and education. Accumulating evidence demonstrates that these technologies can enhance the visibility of the neuroanatomical structures situated at the cranial base and assist surgeons in preoperative planning and intraoperative navigation, thus showing great potential to improve surgical results and reduce complications. Maximum effectiveness can be achieved in approach selection, patient positioning, craniotomy placement, anti-target avoidance, and comprehension of spatial interrelationships of neurovascular structures. Finally, we present the obstacles and possible future paths for the broader implementation of these groundbreaking methods in neurosurgery, highlighting the importance of ongoing technological advancements and interdisciplinary collaboration to improve the accuracy and usefulness of 3D visualization and reality technologies in skull base surgeries.

Radiologically derived 3D virtual models for neurosurgical planning

Three dimensional (3D) virtual models for neurosurgery have demonstrated substantial clinical utility, especially for neuro-oncological cases. Computer-aided design (CAD) modelling of radiological images can provide realistic and high-quality 3D models which neurosurgeons may use pre-operatively for surgical planning. 3D virtual models are useful as they are the basis for other models that build off this design. 3D virtual models are quick to segment but can also be easily added to normal neurosurgical and radiological workflow without disruption. Three anatomically complex neuro-oncology cases that were referred from a single institution by three different neurosurgeons were segmented and 3D virtual models were created for pre-operative surgical planning. A face-to-face interview was performed with the surgeons after the models were delivered to gauge the usefulness of the model in pre-surgical planning. All three neurosurgeons found that the 3D virtual model was useful for presurgical planning. Specifically, the virtual model helped in planning operative positioning, understanding spatial relationship between lesion and surrounding critical anatomy and identifying anatomy that will be encountered intra-operatively in a sequential manner. It provided benefit in Multidisciplinary team (MDT) meetings and patient education for shared decision making.3D virtual models are beneficial for pre-surgical planning and patient education for shared decision making for neurosurgical neuro-oncology cases. We believe this could be further expanded to other surgical specialties. The integration of 3D virtual models into normal workflow as the initial step will provide an easier transition into modalities that build off the virtual models such as printed, virtual, augmented and mixed reality models.

Virtual reality-based surgical planning simulator for tumorous resection in FreeForm Modeling: an illustrative case of clinical teaching

The importance of virtual reality (VR) has been emphasized by many medical studies, yet it has been relatively under-applied to surgical operation. This study characterized how VR has been applied in clinical education and evaluated its tutorial utility by designing a surgical model of tumorous resection as a simulator for preoperative planning and medical tutorial. A 36-year-old male patient with a femoral tumor who was admitted to the Affiliated Jiangmen Traditional Chinese Medicine Hospital was randomly selected and scanned by computed tomography (CT). The data in digital imaging and communications in medicine (*.DICOM) format were imported into Mimics to reconstruct a femoral model, and were generated to the format of *.stl executing in the computer-aided design (CAD) software SenSable FreeForm Modeling (SFM). A bony tumor was simulated by adding clay to the femur, the procedure of tumorous resection was virtually performed with a toolkit called Phantom, and its bony defect was filled with virtual cement. A 3D workspace was created to enable the individual multimodality manipulation, and a virtual operation of tumorous excision was successfully carried out with indefinitely repeated running. The precise delineation of surgical margins was shown to be achieved with expert proficiency and inexperienced hands among 43 of 50 participants. This simulative educator presented an imitation of high definition, those trained by VR models achieved a higher success rate of 86% than the rate of 74% achieved by those trained by conventional methods. This tumorous resection was repeatably handled by SFM, including the establishment of surgical strategy, whereby participants felt that respondent force feedback was beneficial to surgical teaching programs, enabling engagement of learning experiences by immersive events which mimic real-world circumstances to reinforce didactic and clinical concepts.

Mixed Reality for Cranial Neurosurgical Planning: A Single-Center Applicability Study With the First 107 Subsequent Holograms

BACKGROUND AND OBJECTIVES

Mixed reality (MxR) benefits neurosurgery by improving anatomic visualization, surgical planning and training. We aim to validate the usability of a dedicated certified system for this purpose.

METHODS

All cases prepared with MxR in our center in 2022 were prospectively collected. Holographic rendering was achieved using an incorporated fully automatic algorithm in the MxR application, combined with contrast-based semiautomatic rendering and/or manual segmentation where necessary. Hologram segmentation times were documented. Visualization during surgical preparation (defined as the interval between finalized anesthesiological induction and sterile draping) was performed using MxR glasses and direct streaming to a side screen. Surgical preparation times were compared with a matched historical cohort of 2021. Modifications of the surgical approach after 3-dimensional (3D) visualization were noted. Usability was assessed by evaluating 7 neurosurgeons with more than 3 months of experience with the system using a Usefulness, Satisfaction and Ease of use (USE) questionnaire.

RESULTS

One hundred-seven neurosurgical cases prepared with a 3D hologram were collected. Surgical indications were oncologic (63/107, 59%), cerebrovascular (27/107, 25%), and carotid endarterectomy (17/107, 16%). Mean hologram segmentation time was 39.4 ± 20.4 minutes. Average surgical preparation time was 48.0 ± 17.3 minutes for MxR cases vs 52 ± 17 minutes in the matched 2021 cohort without MxR (mean difference 4, 95% CI 1.7527-9.7527). Based on the 3D hologram, the surgical approach was modified in 3 cases. Good usability was found by 57% of the users.

CONCLUSION

The perioperative use of 3D holograms improved direct anatomic visualization while not significantly increasing intraoperative surgical preparation time. Usability of the system was adequate. Further technological development is necessary to improve the automatic algorithms and reduce the preparation time by circumventing manual and semiautomatic segmentation. Future studies should focus on quantifying the potential benefits in teaching, training, and the impact on surgical and functional outcomes.

Experience in the Application of Augmented Reality Technology in the Surgical Treatment of Patients Suffering Primary and Recurrent Pelvic Tumors

Surgical treatment of locally spread tumors in pelvic organs remains an urgent and complicated oncological problem. The recurrence rate after radical treatment ranges from 15.1% to 45.2%. The key to successful and safe surgical intervention lies in meticulous planning and intraoperative navigation, including the utilization of augmented reality (AR) technology. This paper presents the experience of clinically testing an AR technology application algorithm in the surgical treatment of 11 patients. The main stages of the algorithm are described. Radical operations incorporating intraoperative AR technology with favorable outcomes were performed on eight patients. One patient underwent a palliative intervention, while two patients did not undergo surgery. The testing of the algorithm for the application of AR technology in the surgical treatment of primary and recurrent pelvic tumors demonstrated both a technical possibility and reproducibility of this algorithm and the AR technology itself in clinical practice.

3D color multimodality fusion imaging as an augmented reality educational and surgical planning tool for extracerebral tumors

Extracerebral tumors often occur on the surface of the brain or at the skull base. It is important to identify the peritumoral sulci, gyri, and nerve fibers. Preoperative visualization of three-dimensional (3D) multimodal fusion imaging (MFI) is crucial for surgery. However, the traditional 3D-MFI brain models are homochromatic and do not allow easy identification of anatomical functional areas. In this study, 33 patients with extracerebral tumors without peritumoral edema were retrospectively recruited. They underwent 3D T1-weighted MRI, diffusion tensor imaging (DTI), and CT angiography (CTA) sequence scans. 3DSlicer, Freesurfer, and BrainSuite were used to explore 3D-color-MFI and preoperative planning. To determine the effectiveness of 3D-color-MFI as an augmented reality (AR) teaching tool for neurosurgeons and as a patient education and communication tool, questionnaires were administered to 15 neurosurgery residents and all patients, respectively. For neurosurgical residents, 3D-color-MFI provided a better understanding of surgical anatomy and more efficient techniques for removing extracerebral tumors than traditional 3D-MFI (P < 0.001). For patients, the use of 3D-color MFI can significantly improve their understanding of the surgical approach and risks (P < 0.005). 3D-color-MFI is a promising AR tool for extracerebral tumors and is more useful for learning surgical anatomy, developing surgical strategies, and improving communication with patients.

Virtual Surgical Planning and Three-Dimensional Models for Precision Sinonasal and Skull Base Surgery

Sinonasal and skull base malignancies represent a rare, heterogenous group of pathologies with an incidence of 0.556 per 100,000 persons in the population. Given the numerous critical anatomic structures located adjacent to the sinonasal cavity and skull base, surgery for tumors in this region requires careful pre-operative planning with the assistance of radiological imaging and intraoperative image guidance technologies to reduce the risk of complications. Virtual surgical planning (VSP) and three-dimensional models (3DMs) are adjunctive technologies which assist clinicians to better visualize patient anatomy using enhanced digital radiological images and physical stereolithographic models based on patients' personal imaging. This review summarizes our institutional experience with VSP and 3DMs in sinonasal and skull base surgical oncology. A clinical case series is used to thematically illustrate the application of VSP and 3DMs in surgical ablation, reconstruction, patient communication, medical education, and interdisciplinary teamwork in sinonasal and skull base surgery.

Tumor Lung Visualization and Localization through Virtual Reality and Thermal Feedback Interface

The World Health Organization estimates that there were around 10 million deaths due to cancer in 2020, and lung cancer was the most common type of cancer, with over 2.2 million new cases and 1.8 million deaths. While there have been advances in the diagnosis and prediction of lung cancer, there is still a need for new, intelligent methods or diagnostic tools to help medical professionals detect the disease. Since it is currently unable to detect at an early stage, speedy detection and identification are crucial because they can increase a patient's chances of survival. This article focuses on developing a new tool for diagnosing lung tumors and providing thermal touch feedback using virtual reality visualization and thermal technology. This tool is intended to help identify and locate tumors and measure the size and temperature of the tumor surface. The tool uses data from CT scans to create a virtual reality visualization of the lung tissue and includes a thermal display incorporated into a haptic device. The tool is also tested by touching virtual tumors in a virtual reality application. On the other hand, thermal feedback could be used as a sensory substitute or adjunct for visual or tactile feedback. The experimental results are evaluated with the performance comparison of different algorithms and demonstrate that the proposed thermal model is effective. The results also show that the tool can estimate the characteristics of tumors accurately and that it has the potential to be used in a virtual reality application to "touch" virtual tumors. In other words, the results support the use of the tool for diagnosing lung tumors and providing thermal touch feedback using virtual reality visualization, force, and thermal technology.

Immersive Virtual Reality for Patient-Specific Preoperative Planning: A Systematic Review

Background. Immersive virtual reality (iVR) facilitates surgical decision-making by enabling surgeons to interact with complex anatomic structures in realistic 3-dimensional environments. With emerging interest in its applications, its effects on patients and providers should be clarified. This systematic review examines the current literature on iVR for patient-specific preoperative planning. Materials and Methods. A literature search was performed on five databases for publications from January 1, 2000 through March 21, 2021. Primary studies on the use of iVR simulators by surgeons at any level of training for patient-specific preoperative planning were eligible. Two reviewers independently screened titles, abstracts, and full texts, extracted data, and assessed quality using the Quality Assessment Tool for Studies with Diverse Designs (QATSDD). Results were qualitatively synthesized, and descriptive statistics were calculated. Results. The systematic search yielded 2,555 studies in total, with 24 full-texts subsequently included for qualitative synthesis, representing 264 medical personnel and 460 patients. Neurosurgery was the most frequently represented discipline (10/24; 42%). Preoperative iVR did not significantly improve patient-specific outcomes of operative time, blood loss, complications, and length of stay, but may decrease fluoroscopy time. In contrast, iVR improved surgeon-specific outcomes of surgical strategy, anatomy visualization, and confidence. Validity, reliability, and feasibility of patient-specific iVR models were assessed. The mean QATSDD score of included studies was 32.9%. Conclusions. Immersive VR improves surgeon experiences of preoperative planning, with minimal evidence for impact on short-term patient outcomes. Future work should focus on high-quality studies investigating long-term patient outcomes, and utility of preoperative iVR for trainees.

Three-dimensional technologies in presurgical planning of bone surgeries: current evidence and future perspectives

BACKGROUND

The recent development of three-dimensional (3D) technologies introduces a novel set of opportunities to the medical field in general, and specifically to surgery. The preoperative phase has proven to be a critical factor in surgical success. Utilization of 3D technologies has the potential to improve preoperative planning and overall surgical outcomes. In this narrative review article, the authors describe existing clinical data pertaining to the current use of 3D printing, virtual reality, and augmented reality in the preoperative phase of bone surgery.

METHODS

The methodology included keyword-based literature search in PubMed and Google Scholar for original articles published between 2014 and 2022. After excluding studies performed in nonbone surgery disciplines, data from 61 studies of five different surgical disciplines were processed to be included in this narrative review.

RESULTS

Among the mentioned technologies, 3D printing is currently the most advanced in terms of clinical use, predominantly creating anatomical models and patient-specific instruments that provide high-quality operative preparation. Virtual reality allows to set a surgical plan and to further simulate the procedure via a 2D screen or head mounted display. Augmented reality is found to be useful for surgical simulation upon 3D printed anatomical models or virtual phantoms.

CONCLUSIONS

Overall, 3D technologies are gradually becoming an integral part of a surgeon's preoperative toolbox, allowing for increased surgical accuracy and reduction of operation time, mainly in complex and unique surgical cases. This may eventually lead to improved surgical outcomes, thereby optimizing the personalized surgical approach.

Practical Application of Augmented/Mixed Reality Technologies in Surgery of Abdominal Cancer Patients

The technology of augmented and mixed reality (AR/MR) is useful in various areas of modern surgery. We considered the use of augmented and mixed reality technologies as a method of preoperative planning and intraoperative navigation in abdominal cancer patients. Practical use of AM/MR raises a range questions, which demand suitable solutions. The difficulties and obstacles we encountered in the practical use of AR/MR are presented, along with the ways we chose to overcome them. The most demonstrative case is covered in detail. The three-dimensional anatomical model obtained from the CT scan needed to be rigidly attached to the patient’s body, and therefore an invasive approach was developed, using an orthopedic pin fixed to the pelvic bones. The pin is used both similarly to an X-ray contrast marker and as a marker for augmented reality. This solution made it possible, not only to visualize the anatomical structures of the patient and the border zone of the tumor, but also to change the position of the patient during the operation. In addition, a noninvasive (skin-based) marking method was developed that allows the application of mixed and augmented reality during operation. Both techniques were used (8 clinical cases) for preoperative planning and intraoperative navigation, which allowed surgeons to verify the radicality of the operation, to have visual control of all anatomical structures near the zone of interest, and to reduce the time of surgical intervention, thereby reducing the complication rate and improving the rehabilitation period.

Augmented reality-assisted craniofacial reconstruction in skull base lesions - an innovative technique for single-step resection and cranioplasty in neurosurgery

Defects of the cranial vault often require cosmetic reconstruction with patient-specific implants, particularly in cases of craniofacial involvement. However, fabrication takes time and is expensive; therefore, efforts must be made to develop more rapidly available and more cost-effective alternatives. The current study investigated the feasibility of an augmented reality (AR)-assisted single-step procedure for repairing bony defects involving the facial skeleton and the skull base. In an experimental setting, nine neurosurgeons fabricated AR-assisted and conventionally shaped ("freehand") implants from polymethylmethacrylate (PMMA) on a skull model with a craniofacial bony defect. Deviations of the surface profile in comparison with the original model were quantified by means of volumetry, and the cosmetic results were evaluated using a multicomponent scoring system, each by two blinded neurosurgeons. Handling the AR equipment proved to be quite comfortable. The median volume deviating from the surface profile of the original model was low in the AR-assisted implants (6.40 cm³) and significantly reduced in comparison with the conventionally shaped implants (13.48 cm³). The cosmetic appearance of the AR-assisted implants was rated as very good (median 25.00 out of 30 points) and significantly improved in comparison with the conventionally shaped implants (median 14.75 out of 30 points). Our experiments showed outstanding results regarding the possibilities of AR-assisted procedures for single-step reconstruction of craniofacial defects. Although patient-specific implants still represent the gold standard in esthetic aspects, AR-assisted procedures hold high potential for an immediately and widely available, cost-effective alternative providing excellent cosmetic outcomes.

Virtual Reality in the Neurosciences: Current Practice and Future Directions

Virtual reality has made numerous advancements in recent years and is used with increasing frequency for education, diversion, and distraction. Beginning several years ago as a device that produced an image with only a few pixels, virtual reality is now able to generate detailed, three-dimensional, and interactive images. Furthermore, these images can be used to provide quantitative data when acting as a simulator or a rehabilitation device. In this article, we aim to draw attention to these areas, as well as highlight the current settings in which virtual reality (VR) is being actively studied and implemented within the field of neurosurgery and the neurosciences. Additionally, we discuss the current limitations of the applications of virtual reality within various settings. This article includes areas in which virtual reality has been used in applications both inside and outside of the operating room, such as pain control, patient education and counseling, and rehabilitation. Virtual reality's utility in neurosurgery and the neurosciences is widely growing, and its use is quickly becoming an integral part of patient care, surgical training, operative planning, navigation, and rehabilitation.

[Perioperative augmented reality technology in surgical treatment of locally advanced recurrent rectal cancer]

Rectal cancer occupies the leading position among cancers, and incidence of locally advanced recurrences is still high despite comprehensive treatment. Combined resections are usually associated with high perioperative risks. These procedures are technically complex interventions requiring further improvement. Virtual reality technology in surgical treatment of locally advanced rectal cancer recurrence has not been widely discussed. The authors present multidisciplinary construction of the matched topographic-anatomical virtual model and virtual planning of the combined surgical intervention. Intraoperative use of augmented reality allowed specifying topographic and anatomical features of surgical area, level of vascular ligation, localization of tumor fixation points and resection borders. These data ensured safety and quality of resection. Further research of augmented reality technology and improvement of its technical aspects will improve the results of surgical treatment of patients with locally advanced pelvic tumors and recurrences.