The use of mixed reality in the preoperative planning of colorectal surgery: Preliminary experience with a narrative review

New advanced technologies have recently been developed and preliminarily applied to surgery, including virtual reality (VR), augmented reality (AR) and mixed reality (MR). We retrospectively review all colorectal cases in which we used holographic 3D reconstruction from February 2020 to December 2022. This innovative approach was used to identify vascular anomalies, pinpoint tumor locations, evaluate infiltration into neighboring organs and devise surgical plans for both training and educating trainee assistants. We have also provided a state-of-the-art analysis, briefly highlighting what has been stated by the scientific literature to date. VR facilitates training and anatomical assessments, while AR enhances training and laparoscopic performance evaluations. MR, powered by HoloLens, enriches anatomic recognition, navigation, and visualization. Successful implementation was observed in 10 colorectal cancer cases, showcasing the effectiveness of MR in improving preoperative planning and its intraoperative application. This technology holds significant promise for advancing colorectal surgery by elevating safety and reliability standards.

The surgical metaverse

Recent developments have seen acceleration in the development of virtual reality (VR) and augmented reality (AR) technology. Through these developments, the metaverse has emerged. Within the metaverse, users create an avatar to experience an immersive, interactive extended reality. Current front-runners in its implementation are the financial, communication and entertainment sectors. This technology, however, is receiving greater recognition in the medical world, with national and international surgical bodies acknowledging the benefits that VR and the metaverse will have on surgical training and patient care. Its versatility means that we are likely to see VR related technology become intimately woven into the fabric of surgery in the next two decade. In this article, the impact of the metaverse on the surgical field will be discussed.

360° video recording inside a GI endoscopy room: Technical feasibility and its potential use for the acquisition of gastrointestinal endoscopy skills. Pilot experience

New advances in video processing, 3-dimensional designs, and augmented/virtual reality are exciting and evolving fields. These new tools can facilitate the learning phase of basic or advanced endoscopic procedures. Herein, we explain our initial experience, creating an immersive virtual reality (IVR) by using 360-degree recording videos from an interventional endoscopy room. Some common terms used around this technology, such as Augmented reality (AR), Virtual Reality (VR), Three hundred sixty videos, and Mixed Reality (MR), are discussed below. Three examples of VR 360 endoscopic room videos are included in this article.

Virtual reality and intracorporeal navigation in urology

OBJECTIVE

To provide an overview of the meaning and types of virtual reality (VR) system, its current applications in the field of urology and future implications.

SYNTHESIS OF THE EVIDENCE

The concept of VR involves the generation of computer environments with which a user can interact directly. Urology technologies and surgical practices are constantly evolving and RV simulation has become an important complement in urologist training curricula, taking into account not only simulations in surgical techniques, but also in non-surgical techniques such as communication and decision making. VR approaches for image-guided surgery have demonstrated potential in the field of urology by supporting guidance for various disorders. An increasing number of pre and intraoperative imaging modalities have been used to create detailed surgical route maps. The tracing of these surgical roadmaps with the surgical vision of real life has been produced in different ways (electromagnetic, acoustic, optical ...), recommending the combination of several approaches to provide a superior result. One of the disadvantages of navigation systems is soft tissue deformations, requiring confirmatory images. Although early studies report that navigation surgeries provide results equal to or greater than conventional approaches, most of the work has been done in relatively small groups of patients, thus requiring studies with larger sample sizes.

CONCLUSIONS

The development of VR offers urologists many opportunities, with surgical simulation being one of its most important applications today. Likewise, the first clinical studies have demonstrated the potential of augmented reality (2D and 3D models) to improve surgical accuracy, describing different navigation systems for different urological surgical interventions.