The utility of virtual reality and augmented reality in spine surgery

The newborn delivery room of tomorrow: emerging and future technologies

Advances in neonatal care have resulted in improved outcomes for high-risk newborns with technologies playing a significant part although many were developed for the neonatal intensive care unit. The care provided in the delivery room (DR) during the first few minutes of life can impact short- and long-term neonatal outcomes. Increasingly, technologies have a critical role to play in the DR particularly with monitoring and information provision. However, the DR is a unique environment and has major challenges around the period of foetal to neonatal transition that need to be overcome when developing new technologies. This review focuses on current DR technologies as well as those just emerging and further over the horizon. We identify what key opinion leaders in DR care think of current technologies, what the important DR measures are to them, and which technologies might be useful in the future. We link these with key technologies including respiratory function monitors, electoral impedance tomography, videolaryngoscopy, augmented reality, video recording, eye tracking, artificial intelligence, and contactless monitoring. Encouraging funders and industry to address the unique technological challenges of newborn care in the DR will allow the continued improvement of outcomes of high-risk infants from the moment of birth. IMPACT: Technological advances for newborn delivery room care require consideration of the unique environment, the variable patient characteristics, and disease states, as well as human factor challenges. Neonatology as a speciality has embraced technology, allowing its rapid progression and improved outcomes for infants, although innovation in the delivery room often lags behind that in the intensive care unit. Investing in new and emerging technologies can support healthcare providers when optimising care and could improve training, safety, and neonatal outcomes.

Integrating Augmented Reality in Spine Surgery: Redefining Precision with New Technologies

INTRODUCTION

The integration of augmented reality (AR) in spine surgery marks a significant advancement, enhancing surgical precision and patient outcomes. AR provides immersive, three-dimensional visualizations of anatomical structures, facilitating meticulous planning and execution of spine surgeries. This technology not only improves spatial understanding and real-time navigation during procedures but also aims to reduce surgical invasiveness and operative times. Despite its potential, challenges such as model accuracy, user interface design, and the learning curve for new technology must be addressed. AR's application extends beyond the operating room, offering valuable tools for medical education and improving patient communication and satisfaction.

MATERIAL AND METHODS

A literature review was conducted by searching PubMed and Scopus databases using keywords related to augmented reality in spine surgery, covering publications from January 2020 to January 2024.

RESULTS

In total, 319 articles were identified through the initial search of the databases. After screening titles and abstracts, 11 articles in total were included in the qualitative synthesis.

CONCLUSION

Augmented reality (AR) is becoming a transformative force in spine surgery, enhancing precision, education, and outcomes despite hurdles like technical limitations and integration challenges. AR's immersive visualizations and educational innovations, coupled with its potential synergy with AI and machine learning, indicate a bright future for surgical care. Despite the existing obstacles, AR's impact on improving surgical accuracy and safety marks a significant leap forward in patient treatment and care.

Emerging Technologies in Hand Orthopedic Surgery: Current Trends and Future Directions

Emerging technologies are changing hand surgery by improving surgical precision, minimizing tissue disruption, and expediting patient recovery. These advancements have the potential to revolutionize surgical procedures, patient outcomes, and rehabilitation processes. However, there are still challenges that need to be addressed before these technologies can be widely adopted. These challenges include the learning curve for surgeons, high costs, and ethical considerations. Future research should focus on addressing the limitations of these technologies, exploring their long-term effects, and evaluating their cost-effectiveness. To successfully implement them, a collaborative approach involving clinicians, researchers, engineers, and policymakers is necessary. This review provides an overview of current and future trends in emerging technologies for hand orthopedic surgery.

Advances in Anterolateral Approaches to the Lumbar Spine: A Focus on Technological Developments

A historical overview of the evolution of anterolateral approaches to the lumber spine and associated patient outcomes is presented. In addition, the modern incorporation of new technologies is discussed, including interbody cages, intraoperative image guidance, robotics, augmented reality, and machine learning, which have significantly improved the spine surgery safety and efficacy profile. Current challenges and future directions are also covered, emphasizing the need for further research and development, particularly in robotic assistance and machine learning algorithms.

Innovations in Spine Surgery: A Narrative Review of Current Integrative Technologies

Neurosurgical technologies have become increasingly more adaptive, featuring real-time and patient-specific guidance in preoperative, intraoperative, and postoperative settings. This review offers insight into how these integrative innovations compare with conventional approaches in spine surgery, focusing on machine learning (ML), artificial intelligence, augmented reality and virtual reality, and spinal navigation systems. Data on technology applications, diagnostic and procedural accuracy, intraoperative times, radiation exposures, postoperative outcomes, and costs were extracted and compared with conventional methods to assess their advantages and limitations. Preoperatively, augmented reality and virtual reality have applications in surgical training and planning that are more immersive, case specific, and risk-free and have been shown to enhance accuracy and reduce complications. ML algorithms have demonstrated high accuracy in predicting surgical candidacy (up to 92.1%) and tailoring personalized treatments based on patient-specific variables. Intraoperatively, advantages include more accurate pedicle screw insertion (96%-99% with ML), enhanced visualization, reduced radiation exposure (49 μSv with O-arm navigation vs. 556 μSv with fluoroscopy), increased efficiency, and potential for fewer intraoperative complications compared with conventional approaches. Postoperatively, certain ML and artificial intelligence models have outperformed conventional methods in predicting all postoperative complications of >6000 patients as well as predicting variables contributing to in-hospital and 90-day mortality. However, applying these technologies comes with limitations, such as longer operative times (up to 35.6% longer) with navigation, dependency on datasets, costs, accessibility, steep learning curve, and inherent software malfunctions. As these technologies advance, continuing to assess their efficacy and limitations will be crucial to their successful integration within spine surgery.

Augmented Reality and Virtual Reality in Spine Surgery: A Comprehensive Review

Augmented reality (AR) and virtual reality (VR) are powerful technologies with proven utility and tremendous potential. Spine surgery, in particular, may benefit from these developing technologies for resident training, preoperative education for patients, surgical planning and execution, and patient rehabilitation. In this review, the history, current applications, challenges, and future of AR/VR in spine surgery are examined.

Virtual, Augmented, and Mixed Reality Applications for Surgical Rehearsal, Operative Execution, and Patient Education in Spine Surgery: A Scoping Review

Background and Objectives: Advances in virtual reality (VR), augmented reality (AR), and mixed reality (MR) technologies have resulted in their increased application across many medical specialties. VR's main application has been for teaching and preparatory roles, while AR has been mostly used as a surgical adjunct. The objective of this study is to discuss the various applications and prospects for VR, AR, and MR specifically as they relate to spine surgery. Materials and Methods: A systematic review was conducted to examine the current applications of VR, AR, and MR with a focus on spine surgery. A literature search of two electronic databases (PubMed and Scopus) was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). The study quality was assessed using the MERSQI score for educational research studies, QUACS for cadaveric studies, and the JBI critical appraisal tools for clinical studies. Results: A total of 228 articles were identified in the primary literature review. Following title/abstract screening and full-text review, 46 articles were included in the review. These articles comprised nine studies performed in artificial models, nine cadaveric studies, four clinical case studies, nineteen clinical case series, one clinical case-control study, and four clinical parallel control studies. Teaching applications utilizing holographic overlays are the most intensively studied aspect of AR/VR; the most simulated surgical procedure is pedicle screw placement. Conclusions: VR provides a reproducible and robust medium for surgical training through surgical simulations and for patient education through various platforms. Existing AR/MR platforms enhance the accuracy and precision of spine surgeries and show promise as a surgical adjunct.

A spatial registration method based on 2D-3D registration for an augmented reality spinal surgery navigation system

BACKGROUND

In order to provide accurate and reliable image guidance for augmented reality (AR) spinal surgery navigation, a spatial registration method has been proposed.

METHODS

In the AR spinal surgery navigation system, grayscale-based 2D/3D registration technology has been used to register preoperative computed tomography images with intraoperative X-ray images to complete the spatial registration, and then the fusion of virtual image and real spine has been realised.

RESULTS

In the image registration experiment, the success rate of spine model registration was 90%. In the spinal model verification experiment, the surface registration error of the spinal model ranged from 0.361 to 0.612 mm, and the total average surface registration error was 0.501 mm.

CONCLUSION

The spatial registration method based on 2D/3D registration technology can be used in AR spinal surgery navigation systems and is highly accurate and minimally invasive.

Augmented Reality-Assisted Spine Surgery: An Early Experience Demonstrating Safety and Accuracy with 218 Screws

STUDY DESIGN

Prospective cohort study.

OBJECTIVES

In spine surgery, accurate screw guidance is critical to achieving satisfactory fixation. Augmented reality (AR) is a novel technology to assist in screw placement and has shown promising results in early studies. This study aims to provide our early experience evaluating safety and efficacy with an Food and Drug Administration-approved head-mounted (head-mounted device augmented reality (HMD-AR)) device.

METHODS

Consecutive adult patients undergoing AR-assisted thoracolumbar fusion between October 2020 and August 2021 with 2 -week follow-up were included. Preoperative, intraoperative, and postoperative data were collected to include demographics, complications, revision surgeries, and AR performance. Intraoperative 3D imaging was used to assess screw accuracy using the Gertzbein-Robbins (G-R) grading scale.

RESULTS

Thirty-two patients (40.6% male) were included with a total of 222 screws executed using HMD-AR. Intraoperatively, 4 (1.8%) were deemed misplaced and revised using AR or freehand. The remaining 218 (98.2%) screws were placed accurately. There were no intraoperative adverse events or complications, and AR was not abandoned in any case. Of the 208 AR-placed screws with 3D imaging confirmation, 97.1% were considered clinically accurate (91.8% Grade A, 5.3% Grade B). There were no early postoperative surgical complications or revision surgeries during the 2 -week follow-up.

CONCLUSIONS

This early experience study reports an overall G-R accuracy of 97.1% across 218 AR-guided screws with no intra or early postoperative complications. This shows that HMD-AR-assisted spine surgery is a safe and accurate tool for pedicle, cortical, and pelvic fixation. Larger studies are needed to continue to support this compelling evolution in spine surgery.

Augmented reality for minimally invasive spinal surgery

Background

Augmented reality (AR) is an emerging technology that can overlay computer graphics onto the real world and enhance visual feedback from information systems. Within the past several decades, innovations related to AR have been integrated into our daily lives; however, its application in medicine, specifically in minimally invasive spine surgery (MISS), may be most important to understand. AR navigation provides auditory and haptic feedback, which can further enhance surgeons' capabilities and improve safety.

Purpose

The purpose of this article is to address previous and current applications of AR, AR in MISS, limitations of today's technology, and future areas of innovation.

Methods

A literature review related to applications of AR technology in previous and current generations was conducted.

Results

AR systems have been implemented for treatments related to spinal surgeries in recent years, and AR may be an alternative to current approaches such as traditional navigation, robotically assisted navigation, fluoroscopic guidance, and free hand. As AR is capable of projecting patient anatomy directly on the surgical field, it can eliminate concern for surgeon attention shift from the surgical field to navigated remote screens, line-of-sight interruption, and cumulative radiation exposure as the demand for MISS increases.

Conclusion

AR is a novel technology that can improve spinal surgery, and limitations will likely have a great impact on future technology.

Practical Use of Augmented Reality Modeling to Guide Revision Spine Surgery: An Illustrative Case of Hardware Failure and Overriding Spondyloptosis

BACKGROUND AND IMPORTANCE

Augmented reality (AR) is a novel technology with broadening applications to neurosurgery. In deformity spine surgery, it has been primarily directed to the more precise placement of pedicle screws. However, AR may also be used to generate high fidelity three-dimensional (3D) spine models for cases of advanced deformity with existing instrumentation. We present a case in which an AR-generated 3D model was used to facilitate and expedite the removal of embedded instrumentation and guide the reduction of an overriding spondyloptotic deformity.

CLINICAL PRESENTATION

A young adult with a remote history of a motor vehicle accident treated with long-segment posterior spinal stabilization presented with increasing back pain and difficulty sitting upright in a wheelchair. Imaging revealed pseudoarthrosis with multiple rod fractures resulting in an overriding spondyloptosis of T6 on T9. An AR-generated 3D model was useful in the intraoperative localization of rod breaks and other extensively embedded instrumentation. Real-time model thresholding expedited the safe explanation of the defunct system and correction of the spondyloptosis deformity.

CONCLUSION

An AR-generated 3D model proved instrumental in a revision case of hardware failure and high-grade spinal deformity.

Process management of ergonomic workplace based on augmented reality principles

Ergonomics is an important element of managing performance and productivity in a company. Nowadays, the ergonomic parameters are set in line with the implementation of the Industry 4.0 concept. The paper highlights the link between virtual reality (VR) and augmented reality (AR), when combined with the traditional ergonomic procedure.  Automation and digitization contribute to a significant extent to the creation of ergonomic workplaces and the elimination of the negative effects of non-ergonomic workplaces on people. The aim of the paper is to determine the essential elements of the system process approach to ergonomics management. This is achieved through an analysis of the current approaches from Industry 4.0 and a focus on the augmented reality approach. The backbone of the triple combination of "man-machine-environment" determines the ergonomic setting of work and the workplace. Subsequently, the presented case study examines the link between ergonomic workplace principles and data analytics for VR/AR technology. The scientific contribution of the paper lies in the discussion of the case study results, which is beneficial for the ergonomic design of workplaces.

Simulation Training in Spine Surgery

Simulated surgery is part of a growing paradigm shift in surgical education as a whole. Various modalities from cadaver models to virtual reality have been developed and studied within the context of surgical education. Simulation training in spine surgery has an immense potential to improve education and ultimately improve patient safety. This is due to the inherent risk of operating the spine and the technical difficulty of modern techniques. Common procedures in the modern orthopaedic armamentarium, such as pedicle screw placement, can be simulated, and proficiency is rapidly achieved before application in patients. Furthermore, complications such as dural tears can be simulated and effectively managed in a safe environment with simulation. New techniques with steeper learning curves, such as minimally invasive techniques, can now be safely simulated. Hence, augmenting surgical education through simulation has great potential to benefit trainees and practicing orthopaedic surgeons in modern spine surgery techniques. Additional work will aim to improve access to such technologies and integrate them into the current orthopaedic training curriculum.

Virtual Reality in Medical Students' Education: Scoping Review

BACKGROUND

Virtual reality (VR) produces a virtual manifestation of the real world and has been shown to be useful as a digital education modality. As VR encompasses different modalities, tools, and applications, there is a need to explore how VR has been used in medical education.

OBJECTIVE

The objective of this scoping review is to map existing research on the use of VR in undergraduate medical education and to identify areas of future research.

METHODS

We performed a search of 4 bibliographic databases in December 2020. Data were extracted using a standardized data extraction form. The study was conducted according to the Joanna Briggs Institute methodology for scoping reviews and reported in line with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines.

RESULTS

Of the 114 included studies, 69 (60.5%) reported the use of commercially available surgical VR simulators. Other VR modalities included 3D models (15/114, 13.2%) and virtual worlds (20/114, 17.5%), which were mainly used for anatomy education. Most of the VR modalities included were semi-immersive (68/114, 59.6%) and were of high interactivity (79/114, 69.3%). There is limited evidence on the use of more novel VR modalities, such as mobile VR and virtual dissection tables (8/114, 7%), as well as the use of VR for nonsurgical and nonpsychomotor skills training (20/114, 17.5%) or in a group setting (16/114, 14%). Only 2.6% (3/114) of the studies reported the use of conceptual frameworks or theories in the design of VR.

CONCLUSIONS

Despite the extensive research available on VR in medical education, there continue to be important gaps in the evidence. Future studies should explore the use of VR for the development of nonpsychomotor skills and in areas other than surgery and anatomy.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1136/bmjopen-2020-046986.

New Approach to Accelerated Image Annotation by Leveraging Virtual Reality and Cloud Computing

Three-dimensional imaging is at the core of medical imaging and is becoming a standard in biological research. As a result, there is an increasing need to visualize, analyze and interact with data in a natural three-dimensional context. By combining stereoscopy and motion tracking, commercial virtual reality (VR) headsets provide a solution to this critical visualization challenge by allowing users to view volumetric image stacks in a highly intuitive fashion. While optimizing the visualization and interaction process in VR remains an active topic, one of the most pressing issue is how to utilize VR for annotation and analysis of data. Annotating data is often a required step for training machine learning algorithms. For example, enhancing the ability to annotate complex three-dimensional data in biological research as newly acquired data may come in limited quantities. Similarly, medical data annotation is often time-consuming and requires expert knowledge to identify structures of interest correctly. Moreover, simultaneous data analysis and visualization in VR is computationally demanding. Here, we introduce a new procedure to visualize, interact, annotate and analyze data by combining VR with cloud computing. VR is leveraged to provide natural interactions with volumetric representations of experimental imaging data. In parallel, cloud computing performs costly computations to accelerate the data annotation with minimal input required from the user. We demonstrate multiple proof-of-concept applications of our approach on volumetric fluorescent microscopy images of mouse neurons and tumor or organ annotations in medical images.

XR (Extended Reality: Virtual Reality, Augmented Reality, Mixed Reality) Technology in Spine Medicine: Status Quo and Quo Vadis

In recent years, with the rapid advancement and consumerization of virtual reality, augmented reality, mixed reality, and extended reality (XR) technology, the use of XR technology in spine medicine has also become increasingly popular. The rising use of XR technology in spine medicine has also been accelerated by the recent wave of digital transformation (i.e., case-specific three-dimensional medical images and holograms, wearable sensors, video cameras, fifth generation, artificial intelligence, and head-mounted displays), and further accelerated by the COVID-19 pandemic and the increase in minimally invasive spine surgery. The COVID-19 pandemic has a negative impact on society, but positive impacts can also be expected, including the continued spread and adoption of telemedicine services (i.e., tele-education, tele-surgery, tele-rehabilitation) that promote digital transformation. The purpose of this narrative review is to describe the accelerators of XR (VR, AR, MR) technology in spine medicine and then to provide a comprehensive review of the use of XR technology in spine medicine, including surgery, consultation, education, and rehabilitation, as well as to identify its limitations and future perspectives (status quo and quo vadis).

Vertebrae segmentation in reduced radiation CT imaging for augmented reality applications

PURPOSE

There is growing evidence for the use of augmented reality (AR) navigation in spinal surgery to increase surgical accuracy and improve clinical outcomes. Recent research has employed AR techniques to create accurate auto-segmentations, the basis of patient registration, using reduced radiation dose intraoperative computed tomography images. In this study, we aimed to determine if spinal surgery AR applications can employ reduced radiation dose preoperative computed tomography (pCT) images.

METHODS

We methodically decreased the imaging dose, with the addition of Gaussian noise, that was introduced into pCT images to determine the image quality threshold that was required for auto-segmentation. The Gaussian distribution's standard deviation determined noise level, such that a scalar multiplier (L: [0.00, 0.45], with steps of 0.03) simulated lower doses as L increased. We then enhanced the images with denoising algorithms to evaluate the effect on the segmentation.

RESULTS

The pCT radiation dose was decreased to below the current lowest clinical threshold and the resulting images produced segmentations that were appropriate for input into AR applications. This held true at simulated dose L = 0.06 (estimated 144 mAs) but not at L = 0.09 (estimated 136 mAs). The application of denoising algorithms to the images resulted in increased artifacts and decreased bone density.

CONCLUSIONS

The pCT image quality that is required for AR auto-segmentation is lower than that which is currently employed in spinal surgery. We recommend a reduced radiation dose protocol of approximately 140 mAs. This has the potential to reduce the radiation experienced by patients in comparison to procedures without AR support. Future research is required to identify the specific, clinically relevant radiation dose thresholds required for surgical navigation.

CorFix: Virtual Reality Cardiac Surgical Planning Software for Designing Patient-Specific Vascular Grafts: Development and Pilot Usability Study (Preprint)

Background

Patients with single ventricle heart defects receive 3 stages of operations culminating in the Fontan procedure. During the Fontan procedure, a vascular graft is sutured between the inferior vena cava and pulmonary artery to divert deoxygenated blood flow to the lungs via passive flow. Customizing the graft configuration can maximize the long-term benefits. However, planning patient-specific procedures has several challenges, including the ability for physicians to customize grafts and evaluate their hemodynamic performance.

Objective

The aim of this study was to develop a virtual reality (VR) Fontan graft modeling and evaluation software for physicians. A user study was performed to achieve 2 additional goals: (1) to evaluate the software when used by medical doctors and engineers, and (2) to explore the impact of viewing hemodynamic simulation results in numerical and graphical formats.

Methods

A total of 5 medical professionals including 4 physicians (1 fourth-year resident, 1 third-year cardiac fellow, 1 pediatric intensivist, and 1 pediatric cardiac surgeon) and 1 biomedical engineer voluntarily participated in the study. The study was pre-scripted to minimize the variability of the interactions between the experimenter and the participants. All participants were trained to use the VR gear and our software, CorFix. Each participant designed 1 bifurcated and 1 tube-shaped Fontan graft for a single patient. A hemodynamic performance evaluation was then completed, allowing the participants to further modify their tube-shaped design. The design time and hemodynamic performance for each graft design were recorded. At the end of the study, all participants were provided surveys to evaluate the usability and learnability of the software and rate the intensity of VR sickness.

Results

The average times for creating 1 bifurcated and 1 tube-shaped graft after a single 10-minute training session were 13.40 and 5.49 minutes, respectively, with 3 out 5 bifurcated and 1 out of 5 tube-shaped graft designs being in the benchmark range of hepatic flow distribution. Reviewing hemodynamic performance results and modifying the tube-shaped design took an average time of 2.92 minutes. Participants who modified their tube-shaped graft designs were able to improve the nonphysiologic wall shear stress (WSS) percentage by 7.02%. All tube-shaped graft designs improved the WSS percentage compared to the native surgical case of the patient. None of the designs met the benchmark indexed power loss.

Conclusions

VR graft design software can quickly be taught to physicians with no engineering background or VR experience. Improving the CorFix system could improve performance of the users in customizing and optimizing grafts for patients. With graphical visualization, physicians were able to improve WSS percentage of a tube-shaped graft, lowering the chance of thrombosis. Bifurcated graft designs showed potential strength in better flow split to the lungs, reducing the risk for pulmonary arteriovenous malformations.

Real-time navigation guidance with intraoperative CT imaging for pedicle screw placement using an augmented reality head-mounted display: a proof-of-concept study

OBJECTIVE

Augmented reality (AR) has the potential to improve the accuracy and efficiency of instrumentation placement in spinal fusion surgery, increasing patient safety and outcomes, optimizing ergonomics in the surgical suite, and ultimately lowering procedural costs. The authors sought to describe the use of a commercial prototype Spine AR platform (SpineAR) that provides a commercial AR head-mounted display (ARHMD) user interface for navigation-guided spine surgery incorporating real-time navigation images from intraoperative imaging with a 3D-reconstructed model in the surgeon's field of view, and to assess screw placement accuracy via this method.

METHODS

Pedicle screw placement accuracy was assessed and compared with literature-reported data of the freehand (FH) technique. Accuracy with SpineAR was also compared between participants of varying spine surgical experience. Eleven operators without prior experience with AR-assisted pedicle screw placement took part in the study: 5 attending neurosurgeons and 6 trainees (1 neurosurgical fellow, 1 senior orthopedic resident, 3 neurosurgical residents, and 1 medical student). Commercially available 3D-printed lumbar spine models were utilized as surrogates of human anatomy. Among the operators, a total of 192 screws were instrumented bilaterally from L2-5 using SpineAR in 24 lumbar spine models. All but one trainee also inserted 8 screws using the FH method. In addition to accuracy scoring using the Gertzbein-Robbins grading scale, axial trajectory was assessed, and user feedback on experience with SpineAR was collected.

RESULTS

Based on the Gertzbein-Robbins grading scale, the overall screw placement accuracy using SpineAR among all users was 98.4% (192 screws). Accuracy for attendings and trainees was 99.1% (112 screws) and 97.5% (80 screws), respectively. Accuracy rates were higher compared with literature-reported lumbar screw placement accuracy using FH for attendings (99.1% vs 94.32%; p = 0.0212) and all users (98.4% vs 94.32%; p = 0.0099). The percentage of total inserted screws with a minimum of 5° medial angulation was 100%. No differences were observed between attendings and trainees or between the two methods. User feedback on SpineAR was generally positive.

CONCLUSIONS

Screw placement was feasible and accurate using SpineAR, an ARHMD platform with real-time navigation guidance that provided a favorable surgeon-user experience.

Virtual reality as a learning tool in spinal anatomy and surgical techniques

Background

Surgical simulation is a valuable educational tool for trainees to practice in a safe, standardized, and controlled environment. Interactive feedback-based virtual reality (VR) has recently moved to the forefront of spine surgery training, with most commercial products focusing on instrumentation. There is a paucity of learning tools directed at decompression principles. The purpose of this study was to evaluate the efficacy of VR simulation and its educational role in learning spinal anatomy and decompressive techniques.

Methods

A VR simulation module was created with custom-developed software. Orthopaedic and neurosurgical trainees were prospectively enrolled and interacted with patient-specific 3D models of lumbar spinal stenosis while wearing a headset. A surgical toolkit allowed users to perform surgical decompression, specifically removing soft tissues and bone. The module allowed users to perform various techniques in posterior decompressions and comprehend anatomic areas of stenosis. Pre- and post-module testing, and utility questionnaires were administered to provide both quantitative and qualitative evaluation of the module as a learning device.

Results

28 trainees were enrolled (20-orthopaedic, 8-neurosurgery) in the study. Pre-test scores on anatomic knowledge progressively improved and showed strong positive correlation with year-in-training (Pearson's r = 0.79). Following simulation, the average improvement in post-test scores was 11.4% in junior trainees (PGYI-III), and 1.0% in senior trainees (PGYIII-Fellows). Knowledge improvement approached statistical significance amongst junior trainees (p = 0.0542). 89% of participants found the VR module useful in understanding and learning the pathology of spinal stenosis. 71% found it useful in comprehending decompressive techniques. 96% believed it had utility in preoperative planning with patient-specific models.

Conclusions

Our original VR spinal decompression simulation has shown to be overwhelmingly positively received amongst trainees as both a learning module of patho-anatomy and patient-specific preoperative planning, with particular benefit for junior trainees.

Validation of a Virtual Reality Simulator for Percutaneous Pedicle Screw Insertion

INTRODUCTION

Working-hour restrictions, rota gaps and an increasing drive for theatre efficiency have resulted in challenges to surgical training. As a result, Virtual Reality (VR) has emerged as a popular tool to augment this training. Our aim was to evaluate the validity of a VR simulator for performing percutaneous pedicle screw guidewire insertion.

MATERIALS AND METHODS

Twenty-four participants were divided into three equal groups depending on prior surgical experience: a novice group (<10 procedures), an intermediate group (10-50 procedures) and an expert group (>50 procedures). All subjects performed four guidewire insertions on a TraumaVision® simulator (Swemac Innovation AB, Linköping, Sweden) in a set order. Six outcome measures were recorded; total score, time, fluoroscopy exposure, wire depth, zone of placement and wall violations.

RESULTS

There were statistically significant differences between the groups for time taken (p<0.001) and fluoroscopy exposure (p<0.001). The novice group performed the worst, and the expert group outperformed both intermediates and novices in both categories. Other outcome results were good and less variable. There was an observed learning effect in the novice and intermediate groups between each of the attempts for both time taken and fluoroscopy exposure.

CONCLUSIONS

The study contributes constructive evidence to support the validity of the TraumaVision® simulator as a training tool for pedicle screw guidewire insertion. The simulator is less suitable as an assessment tool. The learning effect was evident in the less experienced groups, suggesting that VR may offer a greater benefit in the early stages of training. Further work is required to assess transferability to the clinical setting.

Updates to the Current Landscape of Augmented Reality in Medicine

Objective

With the introduction of the Google Glass in 2013, the use of augmented reality (AR) and virtual reality (VR) technology has been sharply accelerating in the field of medicine. Despite numerous hurdles and inadequacies identified with the initial devices, current product offering and the need for remote patient care has driven advancements and adoption of the newer generation of devices. This study aims to evaluate the current use of augmented reality devices and the current hurdles to implementation by surveying authors who have recently published on this topic.

Design

A 22-question survey was shared with authors of 27 recent publications relating to usage of augmented reality in medicine between the years of 2019 and 2020.

Results

Eighty-two percent of participants were located in North America while the rest were located in Europe. Interestingly, over 65% of respondents were over the age of 40. Almost half of respondents (45%) used the technology for image review while almost a third (27%) used it for capturing and sharing video. Most concerns to implementation were related to privacy (38%) or reimbursement (33%).

Conclusion

Despite the hurdles reported by respondents, the advancements in AR/VR have come a long way since their introduction and have great potential for continued usage in medicine. Despite this, however, it is important to recognize that cost, security, and battery life continue to serve as hurdles preventing the widespread adoption of this technology to mass markets.

Opportunities and challenges of using augmented reality and heads-up display in orthopaedic surgery: A narrative review

BACKGROUND & AIM

Utilization of augmented reality (AR) and heads-up displays (HUD) to aid orthopaedic surgery has the potential to benefit surgeons and patients alike through improved accuracy, safety, and educational benefits. With the COVID-19 pandemic, the opportunity for adoption of novel technology is more relevant. The aims are to assess the technology available, to understand the current evidence regarding the benefit and to consider challenges to implementation in clinical practice.

METHODS & RESULTS

PRISMA guidelines were used to filter the literature. Of 1004 articles returned the following exclusion criteria were applied: 1) reviews/commentaries 2) unrelated to orthopaedic surgery 3) use of other AR wearables beyond visual aids leaving 42 papers for review.This review illustrates benefits including enhanced accuracy and reduced time of surgery, reduced radiation exposure and educational benefits.

CONCLUSION

Whilst there are obstacles to overcome, there are already reports of technology being used. As with all novel technologies, a greater understanding of the learning curve is crucial, in addition to shielding our patients from this learning curve. Improvements in usability and implementing surgeons' specific needs should increase uptake.

Virtual Reality in Preoperative Planning of Adolescent Idiopathic Scoliosis Surgery Using Google Cardboard

OBJECTIVE

Preoperative planning in spine surgery is a fundamental step of the surgical workup and is often assisted by direct visualization of anatomical 2-dimensional images. This process is time-consuming and may excessively approximate the 3-dimensional (3D) nature of spinal anatomy. Virtual reality (VR) is an emerging technology capable of reconstructing an interactive 3D anatomical model that can be freely explored and manipulated.

METHODS

Sixty patients with adolescent idiopathic scoliosis underwent correction of the scoliotic curve by posterior arthrodesis after preoperative planning using traditional on-screen visualization of computed tomography scans (control group, n = 30) or exploration of a 3D anatomical model in VR using Google Cardboard (Google Inc.) (VR group, n = 30). Mean operative time, blood loss, length of hospital stay, and surgeon's satisfaction were assessed after surgery.

RESULTS

The use of VR led to a significant decrease in operative time and bleeding while increasing the surgeon's satisfaction compared to the control group.

CONCLUSION

Preoperative planning with VR turned out to be effective in terms of operative time and blood loss reduction. Moreover, such technology proved to be reproducible, costeffective, and more satisfactory compared to conventional planning.

Narrative review of intraoperative imaging guidance for decompression-only surgery

Decompression of the spine is defined as removal of bony and soft tissue structures in order to provide space for the spinal cord and/or nerve roots. This definition, however, underscores the dangers and complexity of safely providing anatomical space for these neurologic structures. Complications such as neurologic injury, vascular injury, and durotomy can make these procedures hazardous for the patient and surgeon. Furthermore, inability to fully decompress the neural elements will result in continued symptoms for patients. Intraoperative image guidance can provide important anatomical landmarks to perform these decompressive surgeries safely and efficiently. In particular, performing decompression surgery utilizing minimally invasive techniques with image guidance can allow for the least amount of muscle/soft tissue trauma possible. Within our article we outline research on the forefront of use of intra-operative imaging guidance for spine surgery and implications for decompression surgery. We also outline a case from the senior author to illustrate an example of image-guided spine decompression for cervical radiculopathy. Future technology, such as augmented reality and robotics, is also discussed in the context of image guided decompression. The authors hope this article shows surgeons that use of image guidance in specific clinical situations can allow for better/safer spinal decompression procedures.

Device profile of the XVision-spine (XVS) augmented-reality surgical navigation system: overview of its safety and efficacy

Introduction: The field of augmented reality mediated spine surgery is growing rapidly and holds great promise for improving surgical capabilities and patient outcomes. Augmented reality can assist with complex or atypical cases involving challenging anatomy. As neuronavigation evolves, fundamental technical limitations remain in line-of-sight interruption and operator attention shift, which this novel augmented reality technology helps to address.Areas covered: XVision is a recently FDA-approved head mounted display for intraoperative neuronavigation, compatible with all current conventional pedicle screw technology. The device is a wireless, customizable headset with an integrated surgical tracking system and transparent retinal display. This review discusses the available literature on the safety and efficacy of XVision, as well as the current state of augmented reality technology in spine surgery.Expert opinion: Augmented-reality spine surgery is an emerging technology that may increase precision, efficiency, and safety as well as decrease radiation exposure of manual and robotic computer-navigated pedicle screw insertion techniques. The initial clinical experience with XVision has shown good outcomes and it has received positive operator feedback. Now that initial clinical safety and efficacy has been demonstrated, ongoing experience must be studied to empirically validate this technology and generate further innovation in this rapidly evolving field.

[Potential of digitalization in undergraduate and postgraduate medical education and training in orthopedics and trauma surgery]

INTRODUCTION

In its digital agenda the German Federal Government pursues the ambitious objective to facilitate digital competence and perform research into digital learning and teaching processes. Considerable investments are to be concentrated into the future viability of education, academic research and digitalization. As far as academic teaching and further education are concerned, not only in the field of orthopedics and trauma surgery, three aspects can be identified: digital organization, digital competence and digital tools.

DIGITAL APPLICATIONS

New formats, such as the elective subject digital health of the Charité in Berlin, enable digital competences to be mediated in a multimodal and interdisciplinary way. With the help of a newly developed app the University of Essen provides teachers and students with mobile and flexible access to information on lectures in terms of content and organization. Especially because of transparency, high legal compliance and predictability, the digital logbook for the resident training program promises a real innovation for trainees in the further training reformation. Augmented and virtual reality play a crucial role in the imparting of practical skills and interconnect high-tech with classical craftsmanship. Digital training course formats have significantly gained in importance and are meanwhile well-established tools for efficient advanced medical training.

OUTLOOK

If orthopedic and trauma surgeons take an active role in the process of digitalization of teaching, they can take part in decisions, adequately prepare the colleagues of tomorrow, optimize patient care, encourage innovations and altogether improve the discipline even more.

The Application of Virtual Reality in Cervical Spinal Surgery: A Review

In recent years, clinicians have used virtual reality (VR) to simulate real-world environments for medical purposes. The use of VR systems in the field of cervical spine surgery can lead to effective surgical training programs without causing harm to patients. Moreover, both imaging and VR can be used before surgery to assist preoperative surgical planning. VR devices have a variety of built-in motion sensors, therefore kinematic data can be recorded while users are wearing VR devices and performing some actions for the evaluation of cervical spine activity and exercise ability. Therapists have also applied VR to cervical spine rehabilitation and showed good results. At present, the application of VR systems in cervical spine surgery has great potential, but current research is insufficient. Here, we review the latest advancements in VR technology used in cervical spine surgery and discuss potential directions for future work.

Technical Considerations of Interlaminar Approach for Lumbar Disc Herniation

With the evolution of endoscopic instruments and techniques, full-endoscopic spine surgery has attracted more attention worldwide in recent years. At the initial stage, surgeons conducted endoscopic lumbar discectomy using the transforaminal approach. Next, interlaminar endoscopic lumbar discectomy was developed to treat a herniation disc at the L5-S1 level. The progression in interlaminar endoscopic techniques has further broadened the indications for full-endoscopic spine surgery. However, the steep learning curve of endoscopic procedures has remained challenging. The use of interlaminar endoscopic lumbar discectomy entails many essential skills to manage the different anatomical structures of the spine. From the perspective of successful and safe interlaminar endoscopic lumbar discectomy, we have discussed the technical considerations for endoscopic procedures.

Robotic Spine Surgery and Augmented Reality Systems: A State of the Art

Instrumented spine procedures have been performed for decades to treat a wide variety of spinal disorders. New technologies have been employed to obtain a high degree of precision, to minimize risks of damage to neurovascular structures and to diminish harmful exposure of patients and the operative team to ionizing radiations. Robotic spine surgery comprehends 3 major categories: telesurgical robotic systems, robotic-assisted navigation (RAN) and virtual augmented reality (AR) systems, including AR and virtual reality. Telesurgical systems encompass devices that can be operated from a remote command station, allowing to perform surgery via instruments being manipulated by the robot. On the other hand, RAN technologies are characterized by the robotic guidance of surgeon-operated instruments based on real-time imaging. Virtual AR systems are able to show images directly on special visors and screens allowing the surgeon to visualize information about the patient and the procedure (i.e., anatomical landmarks, screw direction and inclination, distance from neurological and vascular structures etc.). The aim of this review is to focus on the current state of the art of robotics and AR in spine surgery and perspectives of these emerging technologies that hold promises for future applications.