1
|
Ohashi M, Sato M, Tashi H, Minato K, Makino T, Kawashima H. Mixed Reality-Based Navigation for Pedicle Screw Placement: A Preliminary Study Using a 3D-Printed Spine Model. Cureus 2024; 16:e59240. [PMID: 38813326 PMCID: PMC11133951 DOI: 10.7759/cureus.59240] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/28/2024] [Indexed: 05/31/2024] Open
Abstract
Background and objectives Mixed reality (MR) is one of the image processing technologies that allows the user to manipulate three-dimensional (3D) virtual images (hologram). The aim of this study was to evaluate the accuracy of MR-based pedicle screw (PS) placement using 3D spine models. Materials and methods Using the preoperative CT data of a patient with adolescent idiopathic scoliosis (AIS) who had undergone posterior spinal fusion in our hospital, a 3D-printed spine model was created. On the other hand, a 3D hologram of the same patient was automatically created using the preoperative CT data uploaded to the Holoeyes MD service website (Holoeyes Inc., Tokyo, Japan). Using a Magic Leap One® headset (Magic Leap Inc., Plantation, FL), the 3D hologram with lines of predetermined PS trajectories was superimposed onto the 3D-printed spine model and PS were inserted bilaterally along with the trajectory lines from T5 to L3. As a control, we used a readymade 3D spine model of AIS and inserted PS bilaterally with a freehand technique from T4 to L3. The rate of pedicle violation was compared between the MR-based and freehand techniques. Results A total of 22 and 24 PS were placed into the 3D-printed spine model of our patient and the readymade 3D spine model, respectively. The rate of pedicle violation was 4.5% (1/22 screws) in the MR-based technique and 29.2% (7/24 screws) in the freehand technique (P = 0.049). Conclusions We demonstrated a significantly lower rate of PS misplacement in the MR-based technique than in the freehand technique. Therefore, an MR-assisted system is a promising tool for PS placement in terms of feasibility, safety, and accuracy, warranting further studies including cadaveric and clinical studies.
Collapse
Affiliation(s)
- Masayuki Ohashi
- Department of Orthopedic Surgery, Niigata University Graduate School of Medical and Dental Sciences, Niigata, JPN
| | - Masayuki Sato
- Department of Orthopedic Surgery, Niigata University Graduate School of Medical and Dental Sciences, Niigata, JPN
| | - Hideki Tashi
- Department of Orthopedic Surgery, Niigata University Graduate School of Medical and Dental Sciences, Niigata, JPN
| | - Keitaro Minato
- Department of Orthopedic Surgery, Niigata University Graduate School of Medical and Dental Sciences, Niigata, JPN
| | - Tatsuo Makino
- Department of Orthopedic Surgery, Niigata University Graduate School of Medical and Dental Sciences, Niigata, JPN
| | - Hiroyuki Kawashima
- Department of Orthopedic Surgery, Niigata University Graduate School of Medical and Dental Sciences, Niigata, JPN
| |
Collapse
|
2
|
Youssef S, McDonnell JM, Wilson KV, Turley L, Cunniffe G, Morris S, Darwish S, Butler JS. Accuracy of augmented reality-assisted pedicle screw placement: a systematic review. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2024; 33:974-984. [PMID: 38177834 DOI: 10.1007/s00586-023-08094-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/23/2023] [Revised: 12/06/2023] [Accepted: 12/08/2023] [Indexed: 01/06/2024]
Abstract
OBJECTIVE Conventional freehand methods of pedicle screw placement are associated with significant complications due to close proximity to neural and vascular structures. Recent advances in augmented reality surgical navigation (ARSN) have led to its adoption into spine surgery. However, little is known regarding its overall accuracy. The purpose of this study is to delineate the overall accuracy of ARSN pedicle screw placement across various models. METHODS A systematic review was conducted of Medline/PubMed, Cochrane and Embase Library databases according to the PRISMA guidelines. Relevant data extracted included reports of pedicle screw placement accuracy and breaches, as defined by the Gertzbein-Robbins classification, in addition to deviation from pre-planned trajectory and entry point. Accuracy was defined as the summation of grade 0 and grade 1 events per the Gertzbein-Robbins classification. RESULTS Twenty studies reported clinically accurate placed screws. The range of clinically accurate placed screws was 26.3-100%, with 2095 screws (93.1%) being deemed clinically accurate. Furthermore, 5.4% (112/2088) of screws were reported as grade two breaches, 1.6% (33/2088) grade 3 breaches, 3.1% (29/926) medial breaches and 2.3% (21/926) lateral breaches. Mean linear deviation ranged from 1.3 to 5.99 mm, while mean angular/trajectory deviation ranged 1.6°-5.88°. CONCLUSION The results of this study highlight the overall accuracy of ARSN pedicle screw placement. However, further robust prospective studies are needed to accurately compare to conventional methods of pedicle screw placement.
Collapse
Affiliation(s)
- Salma Youssef
- School of Medicine, University College Dublin, Belfield, Dublin, Ireland
| | - Jake M McDonnell
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland
- Trinity Biomedical Sciences Institute, Trinity College Dublin, Dublin, Ireland
| | - Kielan V Wilson
- School of Medicine, University College Dublin, Belfield, Dublin, Ireland.
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland.
| | - Luke Turley
- Department of Orthopaedics, Tallaght University Hospital, Tallaght, Dublin, Ireland
| | - Gráinne Cunniffe
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland
| | - Seamus Morris
- School of Medicine, University College Dublin, Belfield, Dublin, Ireland
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland
| | - Stacey Darwish
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland
- Department of Orthopaedics, St. Vincent's University Hospital, Dublin, Ireland
| | - Joseph S Butler
- School of Medicine, University College Dublin, Belfield, Dublin, Ireland
- National Spinal Injuries Unit, Mater Misericordiae University Hospital, Dublin, Ireland
| |
Collapse
|
3
|
Bui T, Ruiz-Cardozo MA, Dave HS, Barot K, Kann MR, Joseph K, Lopez-Alviar S, Trevino G, Brehm S, Yahanda AT, Molina CA. Virtual, Augmented, and Mixed Reality Applications for Surgical Rehearsal, Operative Execution, and Patient Education in Spine Surgery: A Scoping Review. MEDICINA (KAUNAS, LITHUANIA) 2024; 60:332. [PMID: 38399619 PMCID: PMC10890632 DOI: 10.3390/medicina60020332] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/17/2024] [Revised: 02/05/2024] [Accepted: 02/11/2024] [Indexed: 02/25/2024]
Abstract
Background and Objectives: Advances in virtual reality (VR), augmented reality (AR), and mixed reality (MR) technologies have resulted in their increased application across many medical specialties. VR's main application has been for teaching and preparatory roles, while AR has been mostly used as a surgical adjunct. The objective of this study is to discuss the various applications and prospects for VR, AR, and MR specifically as they relate to spine surgery. Materials and Methods: A systematic review was conducted to examine the current applications of VR, AR, and MR with a focus on spine surgery. A literature search of two electronic databases (PubMed and Scopus) was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). The study quality was assessed using the MERSQI score for educational research studies, QUACS for cadaveric studies, and the JBI critical appraisal tools for clinical studies. Results: A total of 228 articles were identified in the primary literature review. Following title/abstract screening and full-text review, 46 articles were included in the review. These articles comprised nine studies performed in artificial models, nine cadaveric studies, four clinical case studies, nineteen clinical case series, one clinical case-control study, and four clinical parallel control studies. Teaching applications utilizing holographic overlays are the most intensively studied aspect of AR/VR; the most simulated surgical procedure is pedicle screw placement. Conclusions: VR provides a reproducible and robust medium for surgical training through surgical simulations and for patient education through various platforms. Existing AR/MR platforms enhance the accuracy and precision of spine surgeries and show promise as a surgical adjunct.
Collapse
Affiliation(s)
- Tim Bui
- Department of Neurological Surgery, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Miguel A. Ruiz-Cardozo
- Department of Neurological Surgery, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Harsh S. Dave
- Department of Neurological Surgery, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Karma Barot
- Department of Neurological Surgery, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Michael Ryan Kann
- Department of Neurological Surgery, Washington University School of Medicine, St. Louis, MO 63110, USA
- University of Pittsburgh School of Medicine, Pittsburgh, PA 15261, USA
| | - Karan Joseph
- Department of Neurological Surgery, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Sofia Lopez-Alviar
- Department of Neurological Surgery, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Gabriel Trevino
- Department of Neurological Surgery, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Samuel Brehm
- Department of Neurological Surgery, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Alexander T. Yahanda
- Department of Neurological Surgery, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Camilo A Molina
- Department of Neurological Surgery, Washington University School of Medicine, St. Louis, MO 63110, USA
| |
Collapse
|
4
|
Männle D, Pohlmann J, Monji-Azad S, Hesser J, Rotter N, Affolter A, Lammert A, Kramer B, Ludwig S, Huber L, Scherl C. Artificial intelligence directed development of a digital twin to measure soft tissue shift during head and neck surgery. PLoS One 2023; 18:e0287081. [PMID: 37556451 PMCID: PMC10411805 DOI: 10.1371/journal.pone.0287081] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2023] [Accepted: 07/14/2023] [Indexed: 08/11/2023] Open
Abstract
Digital twins derived from 3D scanning data were developed to measure soft tissue deformation in head and neck surgery by an artificial intelligence approach. This framework was applied suggesting feasibility of soft tissue shift detection as a hitherto unsolved problem. In a pig head cadaver model 104 soft tissue resection had been performed. The surface of the removed soft tissue (RTP) and the corresponding resection cavity (RC) was scanned (N = 416) to train an artificial intelligence (AI) with two different 3D object detectors (HoloLens 2; ArtecEva). An artificial tissue shift (TS) was created by changing the tissue temperature from 7,91±4,1°C to 36,37±1,28°C. Digital twins of RTP and RC in cold and warm conditions had been generated and volumes were calculated based on 3D surface meshes. Significant differences in number of vertices created by the different 3D scanners (HoloLens2 51313 vs. ArtecEva 21694, p<0.0001) hence result in differences in volume measurement of the RTC (p = 0.0015). A significant TS could be induced by changing the temperature of the tissue of RC (p = 0.0027) and RTP (p = <0.0001). RC showed more correlation in TS by heating than RTP with a volume increase of 3.1 μl or 9.09% (p = 0.449). Cadaver models are suitable for training a machine learning model for deformable registration through creation of a digital twin. Despite different point cloud densities, HoloLens and ArtecEva provide only slightly different estimates of volume. This means that both devices can be used for the task.TS can be simulated and measured by temperature change, in which RC and RTP react differently. This corresponds to the clinical behaviour of tumour and resection cavity during surgeries, which could be used for frozen section management and a range of other clinical applications.
Collapse
Affiliation(s)
- David Männle
- Department of Otorhinolaryngology, Head and Neck Surgery, University Hospital Mannheim, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Jan Pohlmann
- Department of Otorhinolaryngology, Head and Neck Surgery, University Hospital Mannheim, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Sara Monji-Azad
- Mannheim Institute for Intelligent Systems in Medicine (MIISM), Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Jürgen Hesser
- Mannheim Institute for Intelligent Systems in Medicine (MIISM), Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
- Interdisciplinary Center for Scientific Computing (IWR), Heidelberg University, Heidelberg, Germany
- Central Institute for Computer Engineering (ZITI), Heidelberg University, Heidelberg, Germany
- CZS Heidelberg Center for Model-Based AI, Heidelberg University, Heidelberg, Germany
- AI Health Innovation Cluster, Heidelberg-Mannheim Health and Life Science Alliance, Heidelberg University, Heidelberg, Germany
| | - Nicole Rotter
- Department of Otorhinolaryngology, Head and Neck Surgery, University Hospital Mannheim, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Annette Affolter
- Department of Otorhinolaryngology, Head and Neck Surgery, University Hospital Mannheim, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Anne Lammert
- Department of Otorhinolaryngology, Head and Neck Surgery, University Hospital Mannheim, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Benedikt Kramer
- Department of Otorhinolaryngology, Head and Neck Surgery, University Hospital Mannheim, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Sonja Ludwig
- Department of Otorhinolaryngology, Head and Neck Surgery, University Hospital Mannheim, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Lena Huber
- Department of Otorhinolaryngology, Head and Neck Surgery, University Hospital Mannheim, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Claudia Scherl
- Department of Otorhinolaryngology, Head and Neck Surgery, University Hospital Mannheim, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
- AI Health Innovation Cluster, Heidelberg-Mannheim Health and Life Science Alliance, Heidelberg University, Heidelberg, Germany
| |
Collapse
|
5
|
Pierzchajlo N, Stevenson TC, Huynh H, Nguyen J, Boatright S, Arya P, Chakravarti S, Mehrki Y, Brown NJ, Gendreau J, Lee SJ, Chen SG. Augmented Reality in Minimally Invasive Spinal Surgery: A Narrative Review of Available Technology. World Neurosurg 2023; 176:35-42. [PMID: 37059357 DOI: 10.1016/j.wneu.2023.04.030] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2023] [Accepted: 04/08/2023] [Indexed: 04/16/2023]
Abstract
INTRODUCTION Spine surgery has undergone significant changes in approach and technique. With the adoption of intraoperative navigation, minimally invasive spinal surgery (MISS) has arguably become the gold standard. Augmented reality (AR) has now emerged as a front-runner in anatomical visualization and narrower operative corridors. In effect, AR is poised to revolutionize surgical training and operative outcomes. Our study examines the current literature on AR-assisted MISS, synthesizes findings, and creates a narrative highlighting the history and future of AR in spine surgery. MATERIAL AND METHODS Relevant literature was gathered using the PubMed (Medline) database from 1975 to 2023. Pedicle screw placement models were the primary intervention in AR. These were compared to the outcomes of traditional MISS RESULTS: We found that AR devices on the market show promising clinical outcomes in preoperative training and intraoperative use. Three prominent systems were as follows: XVision, HoloLens, and ImmersiveTouch. In the studies, surgeons, residents, and medical students had opportunities to operate AR systems, showcasing their educational potential across each phase of learning. Specifically, one facet described training with cadaver models to gauge accuracy in pedicle screw placement. AR-MISS exceeded free-hand methods without unique complications or contraindications. CONCLUSIONS While still in its infancy, AR has already proven beneficial for educational training and intraoperative MISS applications. We believe that with continued research and advancement of this technology, AR is poised to become a dominant player within the fundamentals of surgical education and MISS operative technique.
Collapse
Affiliation(s)
| | | | - Huey Huynh
- Mercer University, School of Medicine, Savannah, GA, USA
| | - Jimmy Nguyen
- Mercer University, School of Medicine, Savannah, GA, USA
| | | | - Priya Arya
- Mercer University, School of Medicine, Savannah, GA, USA
| | | | - Yusuf Mehrki
- Department of Neurosurgery, University of Florida, Jacksonville, FL, USA
| | - Nolan J Brown
- Department of Neurosurgery, University of California Irvine, Orange, CA, USA
| | - Julian Gendreau
- Department of Biomedical Engineering, Johns Hopkins Whiting School of Engineering, Baltimore, MD, USA
| | - Seung Jin Lee
- Department of Neurosurgery, Mayo Clinic, Jacksonville, FL, USA
| | - Selby G Chen
- Department of Neurosurgery, Mayo Clinic, Jacksonville, FL, USA
| |
Collapse
|
6
|
McCloskey K, Turlip R, Ahmad HS, Ghenbot YG, Chauhan D, Yoon JW. Virtual and Augmented Reality in Spine Surgery: A Systematic Review. World Neurosurg 2023; 173:96-107. [PMID: 36812986 DOI: 10.1016/j.wneu.2023.02.068] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 02/13/2023] [Accepted: 02/14/2023] [Indexed: 02/24/2023]
Abstract
BACKGROUND Augmented reality (AR) and virtual reality (VR) implementation in spinal surgery has expanded rapidly over the past decade. This systematic review summarizes the use of AR/VR technology in surgical education, preoperative planning, and intraoperative guidance. METHODS A search query for AR/VR technology in spine surgery was conducted through PubMed, Embase, and Scopus. After exclusions, 48 studies were included. Included studies were then grouped into relevant subsections. Categorization into subsections yielded 12 surgical training studies, 5 preoperative planning, 24 intraoperative usage, and 10 radiation exposure. RESULTS VR-assisted training significantly reduced penetration rates or increased accuracy rates compared to lecture-based groups in 5 studies. Preoperative VR planning significantly influenced surgical recommendations and reduced radiation exposure, operating time, and estimated blood loss. For 3 patient studies, AR-assisted pedicle screw placement accuracy ranged from 95.77% to 100% using the Gertzbein grading scale. Head-mounted display was the most common interface used intraoperatively followed by AR microscope and projector. AR/VR also had applications in tumor resection, vertebroplasty, bone biopsy, and rod bending. Four studies reported significantly reduced radiation exposure in AR group compared to fluoroscopy group. CONCLUSIONS AR/VR technologies have the potential to usher in a paradigm shift in spine surgery. However, the current evidence indicates there is still a need for 1) defined quality and technical requirements for AR/VR devices, 2) more intraoperative studies that explore usage outside of pedicle screw placement, and 3) technological advancements to overcome registration errors via the development of an automatic registration method.
Collapse
Affiliation(s)
- Kyle McCloskey
- Department of Neurosurgery, Drexel University College of Medicine, Philadelphia, Pennsylvania, USA
| | - Ryan Turlip
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Hasan S Ahmad
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Yohannes G Ghenbot
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Daksh Chauhan
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Jang W Yoon
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA.
| |
Collapse
|
7
|
Li H, Zhang P, Wang G, Liu H, Yang X, Wang G, Sun Z. Real-Time Navigation with Guide Template for Pedicle Screw Placement Using an Augmented Reality Head-Mounted Device: A Proof-of-Concept Study. Indian J Orthop 2023; 57:776-781. [PMID: 37128571 PMCID: PMC10147887 DOI: 10.1007/s43465-023-00859-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/11/2022] [Accepted: 02/26/2023] [Indexed: 05/03/2023]
Abstract
Objective This study aims to explore the real-time navigation with guide template using an augmented reality head-mounted device (ARHMD) for pedicle screw placement. Methods The spatial coordinate relationships between augmented reality images and real objects were established through the custom-made guide template, and the registration and tracking were completed using an ARHMD. The feasibility and accuracy of this method were verified by pedicle screw placement in 2 lumbar models. According to the Gertzbein-Robbins grading scale, the accuracy of pedicle screw placement was assessed. The navigation errors were estimated by measuring the deviation values of entry point and trajectory angle. Results A total of 20 pedicle K-wires were placed into L1-L5 in 2 lumbar models, which were successfully completed, with an average time of 11.5 min per model and 69 s per screw. The overall K-wires placement accuracy was 100% (20 screws). The navigation error was 2.77 ± 0.82 mm for the deviation value of entry point, and 3.03° ± 0.94° for the deviation value of trajectory angle. Conclusions The application of an ARHMD combined with guide template for pedicle screw placement is a promising navigation approach.
Collapse
Affiliation(s)
- Haowei Li
- Tsinghua University School of Medicine, Beijing, 100091 China
| | - Peihai Zhang
- Department of Neurosurgery, Beijing Tsinghua Changgung Hospital, Tsinghua University, Beijing, 102218 China
| | - Guangzhi Wang
- Tsinghua University School of Medicine, Beijing, 100091 China
| | - Huiting Liu
- Peking Union Medical College Hospital, Beijing, 100730 China
| | - Xuejun Yang
- Department of Neurosurgery, Beijing Tsinghua Changgung Hospital, Tsinghua University, Beijing, 102218 China
| | - Guihuai Wang
- Department of Neurosurgery, Beijing Tsinghua Changgung Hospital, Tsinghua University, Beijing, 102218 China
| | - Zhenxing Sun
- Department of Neurosurgery, Beijing Tsinghua Changgung Hospital, Tsinghua University, Beijing, 102218 China
| |
Collapse
|
8
|
Medress ZA, Bobrow A, Tigchelaar SS, Henderson T, Parker JJ, Desai A. Augmented Reality-Assisted Resection of a Large Presacral Ganglioneuroma: 2-Dimensional Operative Video. Oper Neurosurg (Hagerstown) 2023; 24:e284-e285. [PMID: 36701554 DOI: 10.1227/ons.0000000000000542] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2022] [Accepted: 09/22/2022] [Indexed: 01/27/2023] Open
Affiliation(s)
- Zachary A Medress
- Department of Neurosurgery, Stanford University Medical Center, Stanford, California, USA
| | | | - Seth S Tigchelaar
- Department of Neurosurgery, Stanford University Medical Center, Stanford, California, USA
| | | | - Jonathon J Parker
- Department of Neurosurgery, Stanford University Medical Center, Stanford, California, USA
| | - Atman Desai
- Department of Neurosurgery, Stanford University Medical Center, Stanford, California, USA
| |
Collapse
|
9
|
Ma L, Huang T, Wang J, Liao H. Visualization, registration and tracking techniques for augmented reality guided surgery: a review. Phys Med Biol 2023; 68. [PMID: 36580681 DOI: 10.1088/1361-6560/acaf23] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2022] [Accepted: 12/29/2022] [Indexed: 12/31/2022]
Abstract
Augmented reality (AR) surgical navigation has developed rapidly in recent years. This paper reviews and analyzes the visualization, registration, and tracking techniques used in AR surgical navigation systems, as well as the application of these AR systems in different surgical fields. The types of AR visualization are divided into two categories ofin situvisualization and nonin situvisualization. The rendering contents of AR visualization are various. The registration methods include manual registration, point-based registration, surface registration, marker-based registration, and calibration-based registration. The tracking methods consist of self-localization, tracking with integrated cameras, external tracking, and hybrid tracking. Moreover, we describe the applications of AR in surgical fields. However, most AR applications were evaluated through model experiments and animal experiments, and there are relatively few clinical experiments, indicating that the current AR navigation methods are still in the early stage of development. Finally, we summarize the contributions and challenges of AR in the surgical fields, as well as the future development trend. Despite the fact that AR-guided surgery has not yet reached clinical maturity, we believe that if the current development trend continues, it will soon reveal its clinical utility.
Collapse
Affiliation(s)
- Longfei Ma
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, People's Republic of China
| | - Tianqi Huang
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, People's Republic of China
| | - Jie Wang
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, People's Republic of China
| | - Hongen Liao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100084, People's Republic of China
| |
Collapse
|
10
|
Chegini S, Edwards E, McGurk M, Clarkson M, Schilling C. Systematic review of techniques used to validate the registration of augmented-reality images using a head-mounted device to navigate surgery. Br J Oral Maxillofac Surg 2023; 61:19-27. [PMID: 36513525 DOI: 10.1016/j.bjoms.2022.08.007] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Revised: 07/31/2022] [Accepted: 08/17/2022] [Indexed: 12/14/2022]
Abstract
Augmented-reality (AR) head-mounted devices (HMD) allow the wearer to have digital images superposed on to their field of vision. They are being used to superpose annotations on to the surgical field akin to a navigation system. This review examines published validation studies on HMD-AR systems, their reported protocols, and outcomes. The aim was to establish commonalities and an acceptable registration outcome. Multiple databases were systematically searched for relevant articles between January 2015 and January 2021. Studies that examined the registration of AR content using a HMD to guide surgery were eligible for inclusion. The country of origin, year of publication, medical specialty, HMD device, software, and method of registration, were recorded. A meta-analysis of the mean registration error was conducted. A total of 4784 papers were identified, of which 23 met the inclusion criteria. They included studies using HoloLens (Microsoft) (n = 22) and nVisor ST60 (NVIS Inc) (n = 1). Sixty-six per cent of studies were in hard tissue specialties. Eleven studies reported registration errors using pattern markers (mean (SD) 2.6 (1.8) mm), and four reported registration errors using surface markers (mean (SD) 3.8 (3.7) mm). Three studies reported registration errors using manual alignment (mean (SD) 2.2 (1.3) mm). The majority of studies in this review used in-house software with a variety of registration methods and reported errors. The mean registration error calculated in this study can be considered as a minimum acceptable standard. It should be taken into consideration when procedural applications are selected.
Collapse
Affiliation(s)
- Soudeh Chegini
- University College London, Charles Bell House, 43-45 Foley St, London W1W 7TY, United Kingdom.
| | - Eddie Edwards
- University College London, Charles Bell House, 43-45 Foley St, London W1W 7TY, United Kingdom
| | - Mark McGurk
- University College London, Charles Bell House, 43-45 Foley St, London W1W 7TY, United Kingdom
| | - Matthew Clarkson
- University College London, Charles Bell House, 43-45 Foley St, London W1W 7TY, United Kingdom
| | - Clare Schilling
- University College London, Charles Bell House, 43-45 Foley St, London W1W 7TY, United Kingdom
| |
Collapse
|
11
|
Tigchelaar SS, Medress ZA, Quon J, Dang P, Barbery D, Bobrow A, Kin C, Louis R, Desai A. Augmented Reality Neuronavigation for En Bloc Resection of Spinal Column Lesions. World Neurosurg 2022; 167:102-110. [PMID: 36096393 DOI: 10.1016/j.wneu.2022.08.143] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 08/28/2022] [Accepted: 08/30/2022] [Indexed: 11/22/2022]
Abstract
BACKGROUND Primary tumors involving the spine are relatively rare but represent surgically challenging procedures with high patient morbidity. En bloc resection of these tumors necessitates large exposures, wide tumor margins, and poses risks to functionally relevant anatomical structures. Augmented reality neuronavigation (ARNV) represents a paradigm shift in neuronavigation, allowing on-demand visualization of 3D navigation data in real-time directly in line with the operative field. METHODS Here, we describe the first application of ARNV to perform distal sacrococcygectomies for the en bloc removal of sacral and retrorectal lesions involving the coccyx in 2 patients, as well as a thoracic 9-11 laminectomy with costotransversectomy for en bloc removal of a schwannoma in a third patient. RESULTS In our experience, ARNV allowed our teams to minimize the length of the incision, reduce the extent of bony resection, and enhanced visualization of critical adjacent anatomy. All tumors were resected en bloc, and the patients recovered well postoperatively, with no known complications. Pathologic analysis confirmed the en bloc removal of these lesions with negative margins. CONCLUSIONS We conclude that ARNV is an effective strategy for the precise, en bloc removal of spinal lesions including both sacrococcygeal tumors involving the retrorectal space and thoracic schwannomas.
Collapse
Affiliation(s)
- Seth S Tigchelaar
- Department of Neurosurgery, Stanford University Medical Center, Stanford, California, USA.
| | - Zachary A Medress
- Department of Neurosurgery, Stanford University Medical Center, Stanford, California, USA
| | - Jennifer Quon
- Department of Neurosurgery, Stanford University Medical Center, Stanford, California, USA
| | - Phuong Dang
- Surgical Theater, Inc., Cleveland, Ohio, USA
| | | | | | - Cindy Kin
- Department of Surgery, Stanford University Medical Center, Stanford, California, USA
| | - Robert Louis
- The Brain and Spine Center, Hoag Memorial Hospital Presbyterian Newport Beach, Newport Beach, California, USA; Pickup Family Neurosciences Institute, Hoag Memorial Hospital Presbyterian Newport Beach, Newport Beach, California, USA
| | - Atman Desai
- Department of Neurosurgery, Stanford University Medical Center, Stanford, California, USA
| |
Collapse
|
12
|
Harel R, Anekstein Y, Raichel M, Molina CA, Ruiz-Cardozo MA, Orrú E, Khan M, Mirovsky Y, Smorgick Y. The XVS System During Open Spinal Fixation Procedures in Patients Requiring Pedicle Screw Placement in the Lumbosacral Spine. World Neurosurg 2022; 164:e1226-e1232. [PMID: 35671991 DOI: 10.1016/j.wneu.2022.05.134] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 05/30/2022] [Accepted: 05/31/2022] [Indexed: 11/16/2022]
Abstract
OBJECTIVE This pilot study was undertaken to evaluate the safety, performance, and usability of the Xvision-Spine (XVS) System (Augmedics, Arlington Heights, IL) during open spinal fixation procedures in patients requiring pedicle screw placement in the lumbosacral spine. METHODS The XVS System is an augmented reality head-mounted display (HMD) based on a computer navigation system designed to assist surgeons in accurately placing pedicle screws. It uses an HMD-mounted tracking camera to provide optical tracking technology, and provides the surgeon a translucent direct near-eye display of the navigated surgical instrument's location relative to the computed tomographic image. We report the preliminary results of a prospective series of all consecutive patients who underwent augmented reality-assisted pedicle screw placement in the lumbosacral vertebrae at 3 institutions. Clinical accuracy for each pedicle screw was graded with Gertzbein-Robbins scores by 2 independent and blinded neuroradiologists. RESULTS The 19 study participants included 8 men and 11 women with a mean age of 59.13 ± 12.09 and 59.91 ± 12.89 years, respectively. Seventeen procedures were successfully completed via the XVS System. Two procedures were not completed due to technical issues with the system's intraoperative scanner. A total of 86 screws were inserted. The accuracy of the XVS System was 97.7%. CONCLUSIONS The XVS System's performance in accurate placement of pedicle screws in the lumbosacral vertebrae had an overall accuracy of 97.7%. These preliminary results were comparable to the accuracy of other manual computer-assisted navigation systems reported in the literature.
Collapse
Affiliation(s)
- Ran Harel
- Department of Neurosurgery and the Spine Unit, Sheba Medical Center, Tel Hashomer, Israel, affiliated to the Sackler Faculty of Medicine, Tel-Aviv University, Tel-Aviv, Israel
| | - Yoram Anekstein
- Department of Orthopedic Surgery and the Spine Unit, Shamir (Assaf Harofeh) Medical Center, Zerifin, Israel, affiliated to the Sackler Faculty of Medicine, Tel-Aviv University, Tel-Aviv, Israel
| | - Michael Raichel
- Department of Orthopedic Surgery and the Spine Unit, Haemek Medical Center, Affula, Israel
| | - Camilo A Molina
- Department of Neurosurgery, Washington University School of Medicine in St Louis, St Louis, Missouri, USA
| | - Miguel A Ruiz-Cardozo
- Department of Neurosurgery, Washington University School of Medicine in St Louis, St Louis, Missouri, USA
| | - Emanuele Orrú
- Department of Neuroradiology, The Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
| | - Majid Khan
- Department of Neurosurgery, Washington University School of Medicine in St Louis, St Louis, Missouri, USA
| | - Yigal Mirovsky
- Department of Orthopedic Surgery and the Spine Unit, Shamir (Assaf Harofeh) Medical Center, Zerifin, Israel, affiliated to the Sackler Faculty of Medicine, Tel-Aviv University, Tel-Aviv, Israel
| | - Yossi Smorgick
- Department of Orthopedic Surgery and the Spine Unit, Shamir (Assaf Harofeh) Medical Center, Zerifin, Israel, affiliated to the Sackler Faculty of Medicine, Tel-Aviv University, Tel-Aviv, Israel.
| |
Collapse
|
13
|
Augmented Reality-Assisted Percutaneous Pedicle Screw Instrumentation: A Cadaveric Feasibility and Accuracy Study. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12105261] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Percutaneous pedicle screw instrumentation is the keystone of minimally invasive spine surgery. Percutaneous screw placement demands experience and relies greatly on intra-operative image guidance. This study aims to validate the feasibility and accuracy of augmented-reality (AR)-assisted percutaneous pedicle screw instrumentation. One cadaveric torso was prepared for this study. After a pre-operative computed tomography (CT) scan, the images were transferred to an AR station to generate a 3D hologram. The 3D hologram and navigation images were projected to a pair of goggles with a display screen. With registration, the 3D spine hologram was overlayed onto the cadaver. Bilateral instrumentation from T6 to L5 was performed by two surgeons using AR assistance. A post-operative CT scan was obtained. The Gertzbein–Robbins scale (grade 0–3) was used for accuracy assessment. A total of 24 screws were placed. The overall screw accuracy was 87.5%. There were three major medial breaches that occurred on Rt T6/7/8, which were the most distant screws from the iliac reference. The cause of the three major medial breaches appeared to be related to their distance from the iliac reference. AR-assisted percutaneous pedicle screw instrumentation could improve anatomical visualization, facilitate surgical workflow, and provide an intuitive way of performing surgery.
Collapse
|
14
|
Augmented Reality: Mapping Methods and Tools for Enhancing the Human Role in Healthcare HMI. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12094295] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Background: Augmented Reality (AR) represents an innovative technology to improve data visualization and strengthen the human perception. Among Human–Machine Interaction (HMI), medicine can benefit most from the adoption of these digital technologies. In this perspective, the literature on orthopedic surgery techniques based on AR was evaluated, focusing on identifying the limitations and challenges of AR-based healthcare applications, to support the research and the development of further studies. Methods: Studies published from January 2018 to December 2021 were analyzed after a comprehensive search on PubMed, Google Scholar, Scopus, IEEE Xplore, Science Direct, and Wiley Online Library databases. In order to improve the review reporting, the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines were used. Results: Authors selected sixty-two articles meeting the inclusion criteria, which were categorized according to the purpose of the study (intraoperative, training, rehabilitation) and according to the surgical procedure used. Conclusions: AR has the potential to improve orthopedic training and practice by providing an increasingly human-centered clinical approach. Further research can be addressed by this review to cover problems related to hardware limitations, lack of accurate registration and tracking systems, and absence of security protocols.
Collapse
|
15
|
Liu Y, Lee MG, Kim JS. Spine Surgery Assisted by Augmented Reality: Where Have We Been? Yonsei Med J 2022; 63:305-316. [PMID: 35352881 PMCID: PMC8965436 DOI: 10.3349/ymj.2022.63.4.305] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/19/2021] [Revised: 02/02/2022] [Accepted: 02/09/2022] [Indexed: 11/27/2022] Open
Abstract
This present systematic review examines spine surgery literature supporting augmented reality (AR) technology and summarizes its current status in spinal surgery technology. Database search strategies were retrieved from PubMed, Web of Science, Cochrane Library, Embase, from the earliest records to April 1, 2021. Our review briefly examines the history of AR, and enumerates different device application workflows in a variety of spinal surgeries. We also sort out the pros and cons of current mainstream AR devices and the latest updates. A total of 45 articles are included in our review. The most prevalent surgical applications included are the augmented reality surgical navigation system and head-mounted display. The most popular application of AR is pedicle screw instrumentation in spine surgery, and the primary responsible surgical levels are thoracic and lumbar. AR guidance systems show high potential value in practical clinical applications for the spine. The overall number of cases in AR-related studies is still rare compared to traditional surgical-assisted techniques. These lack long-term clinical efficacy and robust surgical-related statistical data. Changing healthcare laws as well as the increasing prevalence of spinal surgery are generating critical data that determines the value of AR technology.
Collapse
Affiliation(s)
- Yanting Liu
- Department of Neurosurgery, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| | - Min-Gi Lee
- Department of Neurosurgery, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| | - Jin-Sung Kim
- Department of Neurosurgery, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea.
| |
Collapse
|
16
|
XR (Extended Reality: Virtual Reality, Augmented Reality, Mixed Reality) Technology in Spine Medicine: Status Quo and Quo Vadis. J Clin Med 2022; 11:jcm11020470. [PMID: 35054164 PMCID: PMC8779726 DOI: 10.3390/jcm11020470] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Revised: 01/01/2022] [Accepted: 01/11/2022] [Indexed: 02/06/2023] Open
Abstract
In recent years, with the rapid advancement and consumerization of virtual reality, augmented reality, mixed reality, and extended reality (XR) technology, the use of XR technology in spine medicine has also become increasingly popular. The rising use of XR technology in spine medicine has also been accelerated by the recent wave of digital transformation (i.e., case-specific three-dimensional medical images and holograms, wearable sensors, video cameras, fifth generation, artificial intelligence, and head-mounted displays), and further accelerated by the COVID-19 pandemic and the increase in minimally invasive spine surgery. The COVID-19 pandemic has a negative impact on society, but positive impacts can also be expected, including the continued spread and adoption of telemedicine services (i.e., tele-education, tele-surgery, tele-rehabilitation) that promote digital transformation. The purpose of this narrative review is to describe the accelerators of XR (VR, AR, MR) technology in spine medicine and then to provide a comprehensive review of the use of XR technology in spine medicine, including surgery, consultation, education, and rehabilitation, as well as to identify its limitations and future perspectives (status quo and quo vadis).
Collapse
|
17
|
Visualization, navigation, augmentation. The ever-changing perspective of the neurosurgeon. BRAIN AND SPINE 2022; 2:100926. [PMID: 36248169 PMCID: PMC9560703 DOI: 10.1016/j.bas.2022.100926] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Revised: 07/23/2022] [Accepted: 08/10/2022] [Indexed: 11/22/2022]
|
18
|
Eichberg DG, Ivan ME, Di L, Shah AH, Luther EM, Lu VM, Komotar RJ, Urakov TM. Augmented Reality for Enhancing Image-Guided Neurosurgery: Superimposing the Future onto the Present. World Neurosurg 2021; 157:235-236. [PMID: 34929765 DOI: 10.1016/j.wneu.2021.09.126] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Affiliation(s)
- Daniel G Eichberg
- Department of Neurological Surgery, University of Miami Miller School of Medicine, Miami, Florida, USA
| | - Michael E Ivan
- Department of Neurological Surgery, University of Miami Miller School of Medicine, Miami, Florida, USA; Sylvester Comprehensive Cancer Center, Miami, Florida, USA
| | - Long Di
- Department of Neurological Surgery, University of Miami Miller School of Medicine, Miami, Florida, USA
| | - Ashish H Shah
- Department of Neurological Surgery, University of Miami Miller School of Medicine, Miami, Florida, USA
| | - Evan M Luther
- Department of Neurological Surgery, University of Miami Miller School of Medicine, Miami, Florida, USA
| | - Victor M Lu
- Department of Neurological Surgery, University of Miami Miller School of Medicine, Miami, Florida, USA
| | - Ricardo J Komotar
- Department of Neurological Surgery, University of Miami Miller School of Medicine, Miami, Florida, USA; Sylvester Comprehensive Cancer Center, Miami, Florida, USA
| | - Timur M Urakov
- Department of Neurological Surgery, University of Miami Miller School of Medicine, Miami, Florida, USA
| |
Collapse
|
19
|
Uddin SA, Hanna G, Ross L, Molina C, Urakov T, Johnson P, Kim T, Drazin D. Augmented Reality in Spinal Surgery: Highlights From Augmented Reality Lectures at the Emerging Technologies Annual Meetings. Cureus 2021; 13:e19165. [PMID: 34873508 PMCID: PMC8631483 DOI: 10.7759/cureus.19165] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/31/2021] [Indexed: 12/26/2022] Open
Abstract
Introduction Augmented reality (AR) is an advanced technology and emerging field that has been adopted into spine surgery to enhance care and outcomes. AR superimposes a three-dimensional computer-generated image over the normal anatomy of interest in order to facilitate visualization of deep structures without the ability to directly see them. Objective To summarize the latest literature and highlight AR from the annual “Spinal Navigation, Emerging Technologies and Systems Integration” meeting lectures presented by the Seattle Science Foundation (SSF) on the development and use of augmented reality in spinal surgery. Methods We performed a comprehensive literature review from 2016 to 2020 on PubMed to correlate with lectures given at the annual “Emerging Technologies” conferences. After the exclusion of papers that concerned non-spine surgery specialties, a total of 54 papers concerning AR in spinal applications were found. The articles were then categorized by content and focus. Results The 54 papers were divided into six major focused topics: training, proof of concept, feasibility and usability, clinical evaluation, state of technology, and nonsurgical applications. The greatest number of papers were published during 2020. Each paper discussed varied topics such as patient rehabilitation, proof of concept, workflow, applications in neurological and orthopedic spine surgery, and outcomes data. Conclusions The recent literature and SSF lectures on AR provide a solid base and demonstrate the emergence of an advanced technology that offers a platform for an advantageous technique that is superior, in that it allows the operating surgeon to focus directly on the patient rather than a guidance screen.
Collapse
Affiliation(s)
| | - George Hanna
- Neurosurgery, Cedars-Sinai Spine Center, Los Angeles, USA
| | - Lindsey Ross
- Neurology and Neurosurgery, Cedars-Sinai Medical Center, Los Angeles, USA
| | - Camilo Molina
- Neurological Surgery, Washington University School of Medicine, St. Louis, USA
| | - Timur Urakov
- Neurological Surgery, University of Miami, Miami, USA
| | - Patrick Johnson
- Neurological Surgery, Cedars-Sinai Medical Center, Los Angeles, USA
| | - Terrence Kim
- Orthopedic Surgery, Cedars-Sinai Medical Center, Los Angeles, USA
| | - Doniel Drazin
- Medicine, Pacific Northwest University of Health Sciences, Yakima, USA
| |
Collapse
|
20
|
Augmented Reality (AR) in Orthopedics: Current Applications and Future Directions. Curr Rev Musculoskelet Med 2021; 14:397-405. [PMID: 34751894 DOI: 10.1007/s12178-021-09728-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 09/27/2021] [Indexed: 01/05/2023]
Abstract
PURPOSE OF REVIEW Imaging technologies (X-ray, CT, MRI, and ultrasound) have revolutionized orthopedic surgery, allowing for the more efficient diagnosis, monitoring, and treatment of musculoskeletal aliments. The current review investigates recent literature surrounding the impact of augmented reality (AR) imaging technologies on orthopedic surgery. In particular, it investigates the impact that AR technologies may have on provider cognitive burden, operative times, occupational radiation exposure, and surgical precision and outcomes. RECENT FINDINGS Many AR technologies have been shown to lower provider cognitive burden and reduce operative time and radiation exposure while improving surgical precision in pre-clinical cadaveric and sawbones models. So far, only a few platforms focusing on pedicle screw placement have been approved by the FDA. These technologies have been implemented clinically with mixed results when compared to traditional free-hand approaches. It remains to be seen if current AR technologies can deliver upon their multitude of promises, and the ability to do so seems contingent upon continued technological progress. Additionally, the impact of these platforms will likely be highly conditional on clinical indication and provider type. It remains unclear if AR will be broadly accepted and utilized or if it will be reserved for niche indications where it adds significant value. One thing is clear, orthopedics' high utilization of pre- and intra-operative imaging, combined with the relative ease of tracking rigid structures like bone as compared to soft tissues, has made it the clear beachhead market for AR technologies in medicine.
Collapse
|
21
|
Lim S, Ha J, Yoon S, Tae Sohn Y, Seo J, Chul Koh J, Lee D. Augmented Reality Assisted Surgical Navigation System for Epidural Needle Intervention. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:4705-4708. [PMID: 34892262 DOI: 10.1109/embc46164.2021.9629804] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
Abstract
An augmented reality (AR)-assisted surgical navigation system was developed for epidural needle intervention. The system includes three components: a virtual reality-based surgical planning software, a patient and tool tracking system, and an AR-based surgical navigation system. A three-dimensional (3D) path plan for the epidural needle was established on the preoperative computed tomography (CT) image. The plan is then registered to the intraoperative space by 3D models of the target vertebrae using skin markers and real-time tracking information. In the procedure, the plan and tracking information are transmitted to the head-mounted display (HMD) through a wireless network such that the device directly visualizes the plan onto the back surface of the patient. The physician determines the entry point and inserts the needle into the target based on the direct visual guidance of the system. An experiment was conducted to validate the system using two torso phantoms that mimic human respiration. The experimental results demonstrated that the time and the number of X-rays required for needle insertion were significantly decreased by the proposed method (43.6±20.55sec, 2.9±1.3times) compared to those of the conventional fluoroscopy-guided approach (124.5 ± 46.7s, 9.3±2.4times), whereas the average targeting errors were similar in both cases. The proposed system may potentially decrease ionizing radiation exposure not only to the patient but also to the medical team.
Collapse
|
22
|
Augmented reality-navigated pedicle screw placement: a cadaveric pilot study. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2021; 30:3731-3737. [PMID: 34350487 DOI: 10.1007/s00586-021-06950-w] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/08/2020] [Revised: 11/04/2020] [Accepted: 07/25/2021] [Indexed: 10/20/2022]
Abstract
PURPOSE Augmented reality (AR) is an emerging technology with great potential for surgical navigation through its ability to provide 3D holographic projection of otherwise hidden anatomical information. This pilot cadaver study investigated the feasibility and accuracy of one of the first holographic navigation techniques for lumbar pedicle screw placement. METHODS Lumbar computer tomography scans (CT) of two cadaver specimens and their reconstructed 3D models were used for pedicle screw trajectory planning. Planned trajectories and 3D models were subsequently uploaded to an AR head-mounted device. Randomly, k-wires were placed either into the left or the right pedicle of a vertebra (L1-5) with or without AR-navigation (by holographic projection of the planned trajectory). CT-scans were subsequently performed to assess accuracy of both techniques. RESULTS A total of 18 k-wires could be placed (8 navigated, 10 free hand) by two experienced spine surgeons. In two vertebrae, the AR-navigation was aborted because the registration of the preoperative plan with the intraoperative anatomy was imprecise due to a technical failure. The average differences of the screw entry points between planning and execution were 4.74 ± 2.37 mm in the freehand technique and 5.99 ± 3.60 mm in the AR-navigated technique (p = 0.39). The average deviation from the planned trajectories was 11.21° ± 7.64° in the freehand technique and 5.88° ± 3.69° in the AR-navigated technique (p = 0.09). CONCLUSION This pilot study demonstrates improved angular precision in one of the first AR-navigated pedicle screw placement studies worldwide. Technical shortcomings need to be eliminated before potential clinical applications.
Collapse
|
23
|
Yanni DS, Ozgur BM, Louis RG, Shekhtman Y, Iyer RR, Boddapati V, Iyer A, Patel PD, Jani R, Cummock M, Herur-Raman A, Dang P, Goldstein IM, Brant-Zawadzki M, Steineke T, Lenke LG. Real-time navigation guidance with intraoperative CT imaging for pedicle screw placement using an augmented reality head-mounted display: a proof-of-concept study. Neurosurg Focus 2021; 51:E11. [PMID: 34333483 DOI: 10.3171/2021.5.focus21209] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Accepted: 05/17/2021] [Indexed: 11/06/2022]
Abstract
OBJECTIVE Augmented reality (AR) has the potential to improve the accuracy and efficiency of instrumentation placement in spinal fusion surgery, increasing patient safety and outcomes, optimizing ergonomics in the surgical suite, and ultimately lowering procedural costs. The authors sought to describe the use of a commercial prototype Spine AR platform (SpineAR) that provides a commercial AR head-mounted display (ARHMD) user interface for navigation-guided spine surgery incorporating real-time navigation images from intraoperative imaging with a 3D-reconstructed model in the surgeon's field of view, and to assess screw placement accuracy via this method. METHODS Pedicle screw placement accuracy was assessed and compared with literature-reported data of the freehand (FH) technique. Accuracy with SpineAR was also compared between participants of varying spine surgical experience. Eleven operators without prior experience with AR-assisted pedicle screw placement took part in the study: 5 attending neurosurgeons and 6 trainees (1 neurosurgical fellow, 1 senior orthopedic resident, 3 neurosurgical residents, and 1 medical student). Commercially available 3D-printed lumbar spine models were utilized as surrogates of human anatomy. Among the operators, a total of 192 screws were instrumented bilaterally from L2-5 using SpineAR in 24 lumbar spine models. All but one trainee also inserted 8 screws using the FH method. In addition to accuracy scoring using the Gertzbein-Robbins grading scale, axial trajectory was assessed, and user feedback on experience with SpineAR was collected. RESULTS Based on the Gertzbein-Robbins grading scale, the overall screw placement accuracy using SpineAR among all users was 98.4% (192 screws). Accuracy for attendings and trainees was 99.1% (112 screws) and 97.5% (80 screws), respectively. Accuracy rates were higher compared with literature-reported lumbar screw placement accuracy using FH for attendings (99.1% vs 94.32%; p = 0.0212) and all users (98.4% vs 94.32%; p = 0.0099). The percentage of total inserted screws with a minimum of 5° medial angulation was 100%. No differences were observed between attendings and trainees or between the two methods. User feedback on SpineAR was generally positive. CONCLUSIONS Screw placement was feasible and accurate using SpineAR, an ARHMD platform with real-time navigation guidance that provided a favorable surgeon-user experience.
Collapse
Affiliation(s)
- Daniel S Yanni
- 1Pickup Family Neurosciences Institute, Hoag Memorial Hospital Presbyterian Newport Beach; and.,2Disc Comfort, Inc., Newport Beach, California
| | - Burak M Ozgur
- 1Pickup Family Neurosciences Institute, Hoag Memorial Hospital Presbyterian Newport Beach; and
| | - Robert G Louis
- 1Pickup Family Neurosciences Institute, Hoag Memorial Hospital Presbyterian Newport Beach; and
| | - Yevgenia Shekhtman
- 3Neuroscience Institute, Hackensack Meridian JFK Medical Center, Edison; and
| | - Rajiv R Iyer
- 4Department of Orthopedic Surgery, Columbia University; and
| | | | - Asha Iyer
- 3Neuroscience Institute, Hackensack Meridian JFK Medical Center, Edison; and
| | - Purvee D Patel
- 5Department of Neurological Surgery, Rutgers New Jersey Medical School, Newark, New Jersey
| | - Raja Jani
- 5Department of Neurological Surgery, Rutgers New Jersey Medical School, Newark, New Jersey
| | - Matthew Cummock
- 5Department of Neurological Surgery, Rutgers New Jersey Medical School, Newark, New Jersey
| | - Aalap Herur-Raman
- 6George Washington University School of Medicine, Washington, DC; and
| | | | - Ira M Goldstein
- 5Department of Neurological Surgery, Rutgers New Jersey Medical School, Newark, New Jersey
| | - Michael Brant-Zawadzki
- 1Pickup Family Neurosciences Institute, Hoag Memorial Hospital Presbyterian Newport Beach; and
| | - Thomas Steineke
- 3Neuroscience Institute, Hackensack Meridian JFK Medical Center, Edison; and
| | - Lawrence G Lenke
- 4Department of Orthopedic Surgery, Columbia University; and.,8Department of Neurological Surgery, NewYork-Presbyterian/Allen Hospital, New York, New York
| |
Collapse
|
24
|
Ivan ME, Eichberg DG, Di L, Shah AH, Luther EM, Lu VM, Komotar RJ, Urakov TM. Augmented reality head-mounted display-based incision planning in cranial neurosurgery: a prospective pilot study. Neurosurg Focus 2021; 51:E3. [PMID: 34333466 DOI: 10.3171/2021.5.focus20735] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2020] [Accepted: 05/13/2021] [Indexed: 11/06/2022]
Abstract
OBJECTIVE Monitor and wand-based neuronavigation stations (MWBNSs) for frameless intraoperative neuronavigation are routinely used in cranial neurosurgery. However, they are temporally and spatially cumbersome; the OR must be arranged around the MWBNS, at least one hand must be used to manipulate the MWBNS wand (interrupting a bimanual surgical technique), and the surgical workflow is interrupted as the surgeon stops to "check the navigation" on a remote monitor. Thus, there is need for continuous, real-time, hands-free, neuronavigation solutions. Augmented reality (AR) is poised to streamline these issues. The authors present the first reported prospective pilot study investigating the feasibility of using the OpenSight application with an AR head-mounted display to map out the borders of tumors in patients undergoing elective craniotomy for tumor resection, and to compare the degree of correspondence with MWBNS tracing. METHODS Eleven consecutive patients undergoing elective craniotomy for brain tumor resection were prospectively identified and underwent circumferential tumor border tracing at the time of incision planning by a surgeon wearing HoloLens AR glasses running the commercially available OpenSight application registered to the patient and preoperative MRI. Then, the same patient underwent circumferential tumor border tracing using the StealthStation S8 MWBNS. Postoperatively, both tumor border tracings were compared by two blinded board-certified neurosurgeons and rated as having an excellent, adequate, or poor correspondence degree based on a subjective sense of the overlap. Objective overlap area measurements were also determined. RESULTS Eleven patients undergoing craniotomy were included in the study. Five patient procedures were rated as having an excellent correspondence degree, 5 had an adequate correspondence degree, and 1 had poor correspondence. Both raters agreed on the rating in all cases. AR tracing was possible in all cases. CONCLUSIONS In this small pilot study, the authors found that AR was implementable in the workflow of a neurosurgery OR, and was a feasible method of preoperative tumor border identification for incision planning. Future studies are needed to identify strategies to improve and optimize AR accuracy.
Collapse
Affiliation(s)
- Michael E Ivan
- 1Department of Neurological Surgery, University of Miami Miller School of Medicine; and.,2Sylvester Comprehensive Cancer Center, Miami, Florida
| | - Daniel G Eichberg
- 1Department of Neurological Surgery, University of Miami Miller School of Medicine; and
| | - Long Di
- 1Department of Neurological Surgery, University of Miami Miller School of Medicine; and
| | - Ashish H Shah
- 1Department of Neurological Surgery, University of Miami Miller School of Medicine; and
| | - Evan M Luther
- 1Department of Neurological Surgery, University of Miami Miller School of Medicine; and
| | - Victor M Lu
- 1Department of Neurological Surgery, University of Miami Miller School of Medicine; and
| | - Ricardo J Komotar
- 1Department of Neurological Surgery, University of Miami Miller School of Medicine; and.,2Sylvester Comprehensive Cancer Center, Miami, Florida
| | | |
Collapse
|
25
|
Luther E, Kaur G, Komotar R, Ivan ME. Commentary: Early Experience With Virtual and Synchronized Augmented Reality Platform for Preoperative Planning and Intraoperative Navigation: A Case Series. Oper Neurosurg (Hagerstown) 2021; 21:E300-E301. [PMID: 34171918 DOI: 10.1093/ons/opab201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Accepted: 05/02/2021] [Indexed: 11/12/2022] Open
Affiliation(s)
- Evan Luther
- Department of Neurological Surgery, Miller School of Medicine, University of Miami, Miami, Florida, USA
| | - Gurvinder Kaur
- Department of Neurological Surgery, Miller School of Medicine, University of Miami, Miami, Florida, USA
| | - Ricardo Komotar
- Department of Neurological Surgery, Miller School of Medicine, University of Miami, Miami, Florida, USA.,Sylvester Comprehensive Cancer Center, Miami, Florida, USA
| | - Michael E Ivan
- Department of Neurological Surgery, Miller School of Medicine, University of Miami, Miami, Florida, USA.,Sylvester Comprehensive Cancer Center, Miami, Florida, USA
| |
Collapse
|
26
|
Lak AM, Zaidi HA. Commentary: Minimally Invasive Posterior Cervical Foraminotomy Using 3-Dimensional Total Navigation: 2-Dimensional Operative Video. Oper Neurosurg (Hagerstown) 2021; 20:E139-E140. [PMID: 33294921 DOI: 10.1093/ons/opaa358] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2020] [Accepted: 09/01/2020] [Indexed: 11/14/2022] Open
Affiliation(s)
- Asad M Lak
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts
| | - Hasan A Zaidi
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
27
|
Sakai D, Joyce K, Sugimoto M, Horikita N, Hiyama A, Sato M, Devitt A, Watanabe M. Augmented, virtual and mixed reality in spinal surgery: A real-world experience. J Orthop Surg (Hong Kong) 2021; 28:2309499020952698. [PMID: 32909902 DOI: 10.1177/2309499020952698] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/16/2022] Open
Abstract
This review aims to identify the role of augmented, virtual or mixed reality (AR, VR or MR) technologies in setting of spinal surgery. The authors address the challenges surrounding the implementation of this technology in the operating room. A technical standpoint addresses the efficacy of these imaging modalities based on the current literature in the field. Ultimately, these technologies must be cost-effective to ensure widespread adoption. This may be achieved through reduced surgical times and decreased incidence of post-operative complications and revisions while maintaining equivalent safety profile to alternative surgical approaches. While current studies focus mainly on the successful placement of pedicle screws via AR-guided instrumentation, a wider scope of procedures may be assisted using AR, VR or MR technology once efficacy and safety have been validated. These emerging technologies offer a significant advantage in the guidance of complex procedures that require high precision and accuracy using minimally invasive interventions.
Collapse
Affiliation(s)
- Daisuke Sakai
- Department of Orthopaedic Surgery, Surgical Science, Tokai University School of Medicine, Isehara, Kanagawa, Japan
| | - Kieran Joyce
- SFI Research Centre for Medical Devices, National University of Ireland, Galway, Ireland.,Department of Orthopaedic Surgery, School of Medicine, National University of Ireland, Galway, Ireland
| | - Maki Sugimoto
- Innovation Lab, Teikyo University Okinaga Research Institute, Tokyo, Japan
| | - Natsumi Horikita
- Department of Orthopaedic Surgery, Surgical Science, Tokai University School of Medicine, Isehara, Kanagawa, Japan
| | - Akihiko Hiyama
- Department of Orthopaedic Surgery, Surgical Science, Tokai University School of Medicine, Isehara, Kanagawa, Japan
| | - Masato Sato
- Department of Orthopaedic Surgery, Surgical Science, Tokai University School of Medicine, Isehara, Kanagawa, Japan
| | - Aiden Devitt
- Department of Orthopaedic Surgery, School of Medicine, National University of Ireland, Galway, Ireland
| | - Masahiko Watanabe
- Department of Orthopaedic Surgery, Surgical Science, Tokai University School of Medicine, Isehara, Kanagawa, Japan
| |
Collapse
|
28
|
Burström G, Persson O, Edström E, Elmi-Terander A. Augmented reality navigation in spine surgery: a systematic review. Acta Neurochir (Wien) 2021; 163:843-852. [PMID: 33506289 PMCID: PMC7886712 DOI: 10.1007/s00701-021-04708-3] [Citation(s) in RCA: 39] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2020] [Accepted: 01/06/2021] [Indexed: 02/07/2023]
Abstract
BACKGROUND Conventional spinal navigation solutions have been criticized for having a negative impact on time in the operating room and workflow. AR navigation could potentially alleviate some of these concerns while retaining the benefits of navigated spine surgery. The objective of this study is to summarize the current evidence for using augmented reality (AR) navigation in spine surgery. METHODS We performed a systematic review to explore the current evidence for using AR navigation in spine surgery. PubMed and Web of Science were searched from database inception to November 27, 2020, for data on the AR navigation solutions; the reported efficacy of the systems; and their impact on workflow, radiation, and cost-benefit relationships. RESULTS In this systematic review, 28 studies were included in the final analysis. The main findings were superior workflow and non-inferior accuracy when comparing AR to free-hand (FH) or conventional surgical navigation techniques. A limited number of studies indicated decreased use of radiation. There were no studies reporting mortality, morbidity, or cost-benefit relationships. CONCLUSIONS AR provides a meaningful addition to FH surgery and traditional navigation methods for spine surgery. However, the current evidence base is limited and prospective studies on clinical outcomes and cost-benefit relationships are needed.
Collapse
|
29
|
Yuk FJ, Maragkos GA, Sato K, Steinberger J. Current innovation in virtual and augmented reality in spine surgery. ANNALS OF TRANSLATIONAL MEDICINE 2021; 9:94. [PMID: 33553387 PMCID: PMC7859743 DOI: 10.21037/atm-20-1132] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
Abstract
In spinal surgery, outcomes are directly related both to patient and procedure selection, as well as the accuracy and precision of instrumentation placed. Poorly placed instrumentation can lead to spinal cord, nerve root or vascular injury. Traditionally, spine surgery was performed by open methods and placement of instrumentation under direct visualization. However, minimally invasive surgery (MIS) has seen substantial advances in spine, with an ever-increasing range of indications and procedures. For these reasons, novel methods to visualize anatomy and precisely guide surgery, such as intraoperative navigation, are extremely useful in this field. In this review, we present the recent advances and innovations utilizing simulation methods in spine surgery. The application of these techniques is still relatively new, however quickly being integrated in and outside the operating room. These include virtual reality (VR) (where the entire simulation is virtual), mixed reality (MR) (a combination of virtual and physical components), and augmented reality (AR) (the superimposition of a virtual component onto physical reality). VR and MR have primarily found applications in a teaching and preparatory role, while AR is mainly applied in hands-on surgical settings. The present review attempts to provide an overview of the latest advances and applications of these methods in the neurosurgical spine setting.
Collapse
Affiliation(s)
- Frank J Yuk
- Department of Neurosurgery, Mount Sinai Hospital, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Georgios A Maragkos
- Department of Neurosurgery, Mount Sinai Hospital, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Kosuke Sato
- Hospital for Special Surgery, New York, NY, USA
| | - Jeremy Steinberger
- Department of Neurosurgery, Mount Sinai Hospital, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| |
Collapse
|
30
|
Augmented Reality-assisted Pedicle Instrumentation: Versatility Across Major Instrumentation Sets. Spine (Phila Pa 1976) 2020; 45:E1622-E1626. [PMID: 32890298 DOI: 10.1097/brs.0000000000003669] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
STUDY DESIGN Laboratory investigation with phantom spine models. OBJECTIVES The aim of this study was to demonstrate the ability of Augmented Reality system to track instruments from different companies without major modifications. SUMMARY OF BACKGROUND DATA Augmented Reality is an emergent technology with applications in industrial, military, gaming, and medical fields. AR applications in Spine surgery are actively being developed. Features of headpiece ergonomics, digital processing power, intuitive interface, and reliable accuracy are being optimized for successful adaptation of technology into the field. System versatility across various instrumentation sets is important for cost-effectiveness and efficiency in application. METHODS In this project, five phantom spine models were instrumented L1-S1 with pedicle screws from five major companies. AR assistance was used for all. Each screwdriver was equipped with a generic 3D printed navigation marker for tracking. RESULTS Every instrumentation set was successfully paired with AR navigation imaging. Sixty pedicle screws were inserted with an average time of 1.6 min/screw. There was an evidence of learning curve with fastest time achieved of 1 min/screw. All five systems had equivocal radiographic outcomes. There were two breached screws (3%). CONCLUSION Any currently available instrumentation set can readily pair for tracking with Augmented Reality system. Active tracking of the drivers allowed for improved accuracy making AR system very attractive as an adjunct to the current instrumentation techniques. LEVEL OF EVIDENCE 3.
Collapse
|
31
|
Kothari EA, Urakov TM. Spine surgery is kyphosing to spine surgeon. Acta Neurochir (Wien) 2020; 162:967-971. [PMID: 32043183 DOI: 10.1007/s00701-020-04258-0] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2019] [Accepted: 01/30/2020] [Indexed: 11/28/2022]
Abstract
BACKGROUND Spine surgery is a demanding surgical specialty which requires surgeons to operate for hours on end, often compromising good posture. Sustained poor posture in the operating room (OR) can be the source of many adverse health effects on spine surgeons. This study will analyze posture of a spine surgeon in different types of spine surgery cases. METHODS Posture of a surgeon was measured using the UPRIGHT Posture Training Device. The device was worn by the surgeon in the OR through a wide variety of spine surgery cases. RESULTS The percent time spent slouched while performing cervical, adult deformity, and lumbar spine surgeries is 39.9, 58.9, and 38.6, respectively. For all surgeries recorded, the percent time slouched is 41.6. The average procedure time was 145.3 min, with adult deformity cases on average being the longest (245.6 min) followed by cervical (152.9 min) and then lumbar (122.5 min). CONCLUSION Poor posture while operating is very likely to occur for many spine surgeons regardless of case type. This poor posture is maintained for long periods of time given the average spine surgery procedure recorded in the study was roughly 2.5 h long. Spine surgeons should be aware of the tendency for poor posture while operating, and they should try using posture-improving techniques to maintain good spine health.
Collapse
Affiliation(s)
- Ezan A Kothari
- University of Central Florida College of Medicine, 6850 Lake Nona Blvd., Orlando, FL, 32827, USA.
| | - Timur M Urakov
- Department of Neurological Surgery, University of Miami Miller School of Medicine, Jackson Memorial Hospital, Miami, FL, USA
| |
Collapse
|
32
|
Hussain I, Cosar M, Kirnaz S, Schmidt FA, Wipplinger C, Wong T, Härtl R. Evolving Navigation, Robotics, and Augmented Reality in Minimally Invasive Spine Surgery. Global Spine J 2020; 10:22S-33S. [PMID: 32528803 PMCID: PMC7263339 DOI: 10.1177/2192568220907896] [Citation(s) in RCA: 34] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Innovative technology and techniques have revolutionized minimally invasive spine surgery (MIS) within the past decade. The introduction of navigation and image-guided surgery has greatly affected spinal surgery and will continue to make surgery safer and more efficient. Eventually, it is conceivable that fluoroscopy will be completely replaced with image guidance. These advancements, among others such as robotics and virtual and augmented reality technology, will continue to drive the value of 3-dimensional navigation in MIS. In this review, we cover pertinent features of navigation in MIS and explore their evolution over time. Moreover, we aim to discuss the key features germane to surgical advancement, including technique and technology development, accuracy, overall health care costs, operating room time efficiency, and radiation exposure.
Collapse
Affiliation(s)
- Ibrahim Hussain
- Weill Cornell Medical College, New York–Presbyterian Hospital, New York, NY, USA
- Ibrahim Hussain and Murat Cosar are equal contributors to this study
| | - Murat Cosar
- Weill Cornell Medical College, New York–Presbyterian Hospital, New York, NY, USA
- Ibrahim Hussain and Murat Cosar are equal contributors to this study
| | - Sertac Kirnaz
- Weill Cornell Medical College, New York–Presbyterian Hospital, New York, NY, USA
| | - Franziska A. Schmidt
- Weill Cornell Medical College, New York–Presbyterian Hospital, New York, NY, USA
| | - Christoph Wipplinger
- Weill Cornell Medical College, New York–Presbyterian Hospital, New York, NY, USA
| | - Taylor Wong
- Weill Cornell Medical College, New York–Presbyterian Hospital, New York, NY, USA
| | - Roger Härtl
- Weill Cornell Medical College, New York–Presbyterian Hospital, New York, NY, USA
| |
Collapse
|
33
|
Müller F, Roner S, Liebmann F, Spirig JM, Fürnstahl P, Farshad M. Augmented reality navigation for spinal pedicle screw instrumentation using intraoperative 3D imaging. Spine J 2020; 20:621-628. [PMID: 31669611 DOI: 10.1016/j.spinee.2019.10.012] [Citation(s) in RCA: 51] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/06/2019] [Revised: 10/19/2019] [Accepted: 10/21/2019] [Indexed: 02/03/2023]
Abstract
BACKGROUND CONTEXT Due to recent developments in augmented reality with head-mounted devices, holograms of a surgical plan can be displayed directly in the surgeon's field of view. To the best of our knowledge, three dimensional (3D) intraoperative fluoroscopy has not been explored for the use with holographic navigation by head-mounted devices in spine surgery. PURPOSE To evaluate the surgical accuracy of holographic pedicle screw navigation by head-mounted device using 3D intraoperative fluoroscopy. STUDY DESIGN In this experimental cadaver study, the accuracy of surgical navigation using a head-mounted device was compared with navigation with a state-of-the-art pose-tracking system. METHODS Three lumbar cadaver spines were embedded in nontransparent agar gel, leaving only commonly visible anatomy in sight. Intraoperative registration of preoperative planning was achieved by 3D fluoroscopy and fiducial markers attached to lumbar vertebrae. Trackable custom-made drill sleeve guides enabled real-time navigation. In total, 20 K-wires were navigated into lumbar pedicles using AR-navigation, 10 K-wires by the state-of-the-art pose-tracking system. 3D models obtained from postexperimental CT scans were used to measure surgical accuracy. MF is the founder and shareholder of Incremed AG, a Balgrist University Hospital start-up focusing on the development of innovative techniques for surgical executions. The other authors declare no conflict of interest concerning the contents of this study. No external funding was received for this study. RESULTS No significant difference in accuracy was measured between AR-navigated drillings and the gold standard with pose-tracking system with mean translational errors between entry points (3D vector distance; p=.85) of 3.4±1.6 mm compared with 3.2±2.0 mm, and mean angular errors between trajectories (3D angle; p=.30) of 4.3°±2.3° compared with 3.5°±1.4°. CONCLUSIONS In conclusion, holographic navigation by use of a head-mounted device achieve accuracy comparable to the gold standard of high-end pose-tracking systems. CLINICAL SIGNIFICANCE These promising results could result in a new way of surgical navigation with minimal infrastructural requirements but now have to be confirmed in clinical studies.
Collapse
Affiliation(s)
- Fabio Müller
- Department of Orthopedics, Balgrist University Hospital, University of Zurich, Forchstrasse 340, 8008 Zurich, Switzerland.
| | - Simon Roner
- Department of Orthopedics, Balgrist University Hospital, University of Zurich, Forchstrasse 340, 8008 Zurich, Switzerland
| | - Florentin Liebmann
- Computer Assisted Research and Development Group, Balgrist University Hospital, University of Zurich, Lengghalde 5, 8008 Zurich, Switzerland; Laboratory for Orthopedic Biomechanics, ETH Zurich, Forchstrasse 328, 8008 Zurich, Switzerland
| | - José M Spirig
- Department of Orthopedics, Balgrist University Hospital, University of Zurich, Forchstrasse 340, 8008 Zurich, Switzerland
| | - Philipp Fürnstahl
- Computer Assisted Research and Development Group, Balgrist University Hospital, University of Zurich, Lengghalde 5, 8008 Zurich, Switzerland
| | - Mazda Farshad
- Department of Orthopedics, Balgrist University Hospital, University of Zurich, Forchstrasse 340, 8008 Zurich, Switzerland
| |
Collapse
|
34
|
Vadalà G, De Salvatore S, Ambrosio L, Russo F, Papalia R, Denaro V. Robotic Spine Surgery and Augmented Reality Systems: A State of the Art. Neurospine 2020; 17:88-100. [PMID: 32252158 PMCID: PMC7136092 DOI: 10.14245/ns.2040060.030] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2020] [Accepted: 02/24/2020] [Indexed: 12/26/2022] Open
Abstract
Instrumented spine procedures have been performed for decades to treat a wide variety of spinal disorders. New technologies have been employed to obtain a high degree of precision, to minimize risks of damage to neurovascular structures and to diminish harmful exposure of patients and the operative team to ionizing radiations. Robotic spine surgery comprehends 3 major categories: telesurgical robotic systems, robotic-assisted navigation (RAN) and virtual augmented reality (AR) systems, including AR and virtual reality. Telesurgical systems encompass devices that can be operated from a remote command station, allowing to perform surgery via instruments being manipulated by the robot. On the other hand, RAN technologies are characterized by the robotic guidance of surgeon-operated instruments based on real-time imaging. Virtual AR systems are able to show images directly on special visors and screens allowing the surgeon to visualize information about the patient and the procedure (i.e., anatomical landmarks, screw direction and inclination, distance from neurological and vascular structures etc.). The aim of this review is to focus on the current state of the art of robotics and AR in spine surgery and perspectives of these emerging technologies that hold promises for future applications.
Collapse
Affiliation(s)
- Gianluca Vadalà
- Department of Orthopaedic and Trauma Surgery, Campus Bio-Medico University of Rome, Rome, Italy
| | - Sergio De Salvatore
- Department of Orthopaedic and Trauma Surgery, Campus Bio-Medico University of Rome, Rome, Italy
| | - Luca Ambrosio
- Department of Orthopaedic and Trauma Surgery, Campus Bio-Medico University of Rome, Rome, Italy
| | - Fabrizio Russo
- Department of Orthopaedic and Trauma Surgery, Campus Bio-Medico University of Rome, Rome, Italy
| | - Rocco Papalia
- Department of Orthopaedic and Trauma Surgery, Campus Bio-Medico University of Rome, Rome, Italy
| | - Vincenzo Denaro
- Department of Orthopaedic and Trauma Surgery, Campus Bio-Medico University of Rome, Rome, Italy
| |
Collapse
|
35
|
Chen L, Zhang F, Zhan W, Gan M, Sun L. Optimization of virtual and real registration technology based on augmented reality in a surgical navigation system. Biomed Eng Online 2020; 19:1. [PMID: 31915014 PMCID: PMC6950982 DOI: 10.1186/s12938-019-0745-z] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2019] [Accepted: 12/30/2019] [Indexed: 12/19/2022] Open
Abstract
Background The traditional navigation interface was intended only for two-dimensional observation by doctors; thus, this interface does not display the total spatial information for the lesion area. Surgical navigation systems have become essential tools that enable for doctors to accurately and safely perform complex operations. The image navigation interface is separated from the operating area, and the doctor needs to switch the field of vision between the screen and the patient’s lesion area. In this paper, augmented reality (AR) technology was applied to spinal surgery to provide more intuitive information to surgeons. The accuracy of virtual and real registration was improved via research on AR technology. During the operation, the doctor could observe the AR image and the true shape of the internal spine through the skin. Methods To improve the accuracy of virtual and real registration, a virtual and real registration technique based on an improved identification method and robot-assisted method was proposed. The experimental method was optimized by using the improved identification method. X-ray images were used to verify the effectiveness of the puncture performed by the robot. Results The final experimental results show that the average accuracy of the virtual and real registration based on the general identification method was 9.73 ± 0.46 mm (range 8.90–10.23 mm). The average accuracy of the virtual and real registration based on the improved identification method was 3.54 ± 0.13 mm (range 3.36–3.73 mm). Compared with the virtual and real registration based on the general identification method, the accuracy was improved by approximately 65%. The highest accuracy of the virtual and real registration based on the robot-assisted method was 2.39 mm. The accuracy was improved by approximately 28.5% based on the improved identification method. Conclusion The experimental results show that the two optimized methods are highly very effective. The proposed AR navigation system has high accuracy and stability. This system may have value in future spinal surgeries.
Collapse
Affiliation(s)
- Long Chen
- School of Mechanical and Electrical Engineering, Soochow University, Suzhou, 215006, China
| | - Fengfeng Zhang
- School of Mechanical and Electrical Engineering, Soochow University, Suzhou, 215006, China. .,Collaborative Innovation Center of Suzhou Nano Science and Technology, Soochow University, Suzhou, 215123, China.
| | - Wei Zhan
- Department of Radiation Oncology, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Minfeng Gan
- Department of Radiation Oncology, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Lining Sun
- School of Mechanical and Electrical Engineering, Soochow University, Suzhou, 215006, China.,Collaborative Innovation Center of Suzhou Nano Science and Technology, Soochow University, Suzhou, 215123, China
| |
Collapse
|