1
|
Higa J, Nkatha S, Ramirez Herrera R, Marcus H, Yoo S, Blandford A, Opie J. Augmented reality for endoscopic transsphenoidal surgery: evaluating design factors with neurosurgeons. Int J Comput Assist Radiol Surg 2024:10.1007/s11548-024-03225-9. [PMID: 39060888 DOI: 10.1007/s11548-024-03225-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2024] [Accepted: 06/24/2024] [Indexed: 07/28/2024]
Abstract
PURPOSE This study investigates the potential utility of augmented reality (AR) in the endoscopic transsphenoidal approach (TSA). While previous research has addressed technical challenges in AR for TSA, this paper explores how design factors can improve AR for neurosurgeons from a human-centred design perspective. METHODS Preliminary qualitative research involved observations of TSA procedures ( n = 2 ) and semi-structured interviews with neurosurgeons ( n = 4 ). These informed the design of an AR mockup, which was evaluated with neurosurgeons ( n = 3 ). An interactive low-fidelity prototype-the "AR-assisted Navigation for the TransSphenoidal Approach (ANTSA)"-was then developed in Unity 3D. A user study ( n = 4 ) evaluated the low-fidelity prototype of ANTSA through contextual interviews, providing feedback on design factors. RESULTS AR visualisations may be beneficial in streamlining the sellar phase and reducing intraoperative errors such as excessive or inadequate exposure. Key design recommendations include a lean mesh rendering, an intuitive colour palette, and optional structure highlighting. CONCLUSION This research presents user-centred design guidelines to improve sensemaking and surgical workflow in the sellar phase of TSA, with the goal of improving clinical outcomes. The specific improvements that AR could bring to the workflow are discussed along with surgeons' reservations and its possible application towards training less experienced physicians.
Collapse
Affiliation(s)
- Jennifer Higa
- UCLIC, University College London, London, WC1E 6BT, UK
| | - Sonia Nkatha
- UCLIC, University College London, London, WC1E 6BT, UK
| | - Roxana Ramirez Herrera
- UCLIC, University College London, London, WC1E 6BT, UK.
- WEISS, University College London, London, W1W 7TY, UK.
| | - Hani Marcus
- WEISS, University College London, London, W1W 7TY, UK
| | - Soojeong Yoo
- UCLIC, University College London, London, WC1E 6BT, UK
- WEISS, University College London, London, W1W 7TY, UK
| | - Ann Blandford
- UCLIC, University College London, London, WC1E 6BT, UK
- WEISS, University College London, London, W1W 7TY, UK
| | - Jeremy Opie
- UCLIC, University College London, London, WC1E 6BT, UK
- WEISS, University College London, London, W1W 7TY, UK
| |
Collapse
|
2
|
Hults CM, Ding Y, Xie GG, Raja R, Johnson W, Lee A, Simons DJ. Inattentional blindness in medicine. Cogn Res Princ Implic 2024; 9:18. [PMID: 38536589 PMCID: PMC10973299 DOI: 10.1186/s41235-024-00537-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Accepted: 02/09/2024] [Indexed: 05/15/2024] Open
Abstract
People often fail to notice unexpected stimuli when their attention is directed elsewhere. Most studies of this "inattentional blindness" have been conducted using laboratory tasks with little connection to real-world performance. Medical case reports document examples of missed findings in radiographs and CT images, unintentionally retained guidewires following surgery, and additional conditions being overlooked after making initial diagnoses. These cases suggest that inattentional blindness might contribute to medical errors, but relatively few studies have directly examined inattentional blindness in realistic medical contexts. We review the existing literature, much of which focuses on the use of augmented reality aids or inspection of medical images. Although these studies suggest a role for inattentional blindness in errors, most of the studies do not provide clear evidence that these errors result from inattentional blindness as opposed to other mechanisms. We discuss the design, analysis, and reporting practices that can make the contributions of inattentional blindness unclear, and we describe guidelines for future research in medicine and similar contexts that could provide clearer evidence for the role of inattentional blindness.
Collapse
Affiliation(s)
- Connor M Hults
- University of Illinois at Champaign-Urbana, Champaign, USA
| | - Yifan Ding
- University of Illinois at Champaign-Urbana, Champaign, USA
| | - Geneva G Xie
- University of Illinois at Champaign-Urbana, Champaign, USA
| | - Rishi Raja
- University of Illinois at Champaign-Urbana, Champaign, USA
| | | | - Alexis Lee
- University of Illinois at Champaign-Urbana, Champaign, USA
| | | |
Collapse
|
3
|
Abstract
BACKGROUND In recent years, numerous innovative yet challenging surgeries, such as minimally invasive procedures, have introduced an overwhelming amount of new technologies, increasing the cognitive load for surgeons and potentially diluting their attention. Cognitive support technologies (CSTs) have been in development to reduce surgeons' cognitive load and minimize errors. Despite its huge demands, it still lacks a systematic review. METHODS Literature was searched up until May 21st, 2021. Pubmed, Web of Science, and IEEExplore. Studies that aimed at reducing the cognitive load of surgeons were included. Additionally, studies that contained an experimental trial with real patients and real surgeons were prioritized, although phantom and animal studies were also included. Major outcomes that were assessed included surgical error, anatomical localization accuracy, total procedural time, and patient outcome. RESULTS A total of 37 studies were included. Overall, the implementation of CSTs had better surgical performance than the traditional methods. Most studies reported decreased error rate and increased efficiency. In terms of accuracy, most CSTs had over 90% accuracy in identifying anatomical markers with an error margin below 5 mm. Most studies reported a decrease in surgical time, although some were statistically insignificant. DISCUSSION CSTs have been shown to reduce the mental workload of surgeons. However, the limited ergonomic design of current CSTs has hindered their widespread use in the clinical setting. Overall, more clinical data on actual patients is needed to provide concrete evidence before the ubiquitous implementation of CSTs.
Collapse
Affiliation(s)
- Zhong Shi Zhang
- Department of Surgery, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada
| | - Yun Wu
- Department of Surgery, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada
| | - Bin Zheng
- Department of Surgery, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada
| |
Collapse
|
4
|
Enkaoua A, Islam M, Ramalhinho J, Dowrick T, Booker J, Khan DZ, Marcus HJ, Clarkson MJ. Image-guidance in endoscopic pituitary surgery: an in-silico study of errors involved in tracker-based techniques. Front Surg 2023; 10:1222859. [PMID: 37780914 PMCID: PMC10540627 DOI: 10.3389/fsurg.2023.1222859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Accepted: 08/11/2023] [Indexed: 10/03/2023] Open
Abstract
Background Endoscopic endonasal surgery is an established minimally invasive technique for resecting pituitary adenomas. However, understanding orientation and identifying critical neurovascular structures in this anatomically dense region can be challenging. In clinical practice, commercial navigation systems use a tracked pointer for guidance. Augmented Reality (AR) is an emerging technology used for surgical guidance. It can be tracker based or vision based, but neither is widely used in pituitary surgery. Methods This pre-clinical study aims to assess the accuracy of tracker-based navigation systems, including those that allow for AR. Two setups were used to conduct simulations: (1) the standard pointer setup, tracked by an infrared camera; and (2) the endoscope setup that allows for AR, using reflective markers on the end of the endoscope, tracked by infrared cameras. The error sources were estimated by calculating the Euclidean distance between a point's true location and the point's location after passing it through the noisy system. A phantom study was then conducted to verify the in-silico simulation results and show a working example of image-based navigation errors in current methodologies. Results The errors of the tracked pointer and tracked endoscope simulations were 1.7 and 2.5 mm respectively. The phantom study showed errors of 2.14 and 3.21 mm for the tracked pointer and tracked endoscope setups respectively. Discussion In pituitary surgery, precise neighboring structure identification is crucial for success. However, our simulations reveal that the errors of tracked approaches were too large to meet the fine error margins required for pituitary surgery. In order to achieve the required accuracy, we would need much more accurate tracking, better calibration and improved registration techniques.
Collapse
Affiliation(s)
- Aure Enkaoua
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
| | - Mobarakol Islam
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
| | - João Ramalhinho
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
| | - Thomas Dowrick
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
| | - James Booker
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
- Division of Neurosurgery, National Hospital for Neurology and Neurosurgery, London, UK
| | - Danyal Z. Khan
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
- Division of Neurosurgery, National Hospital for Neurology and Neurosurgery, London, UK
| | - Hani J. Marcus
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
- Division of Neurosurgery, National Hospital for Neurology and Neurosurgery, London, UK
| | - Matthew J. Clarkson
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
| |
Collapse
|
5
|
Suresh D, Aydin A, James S, Ahmed K, Dasgupta P. The Role of Augmented Reality in Surgical Training: A Systematic Review. Surg Innov 2023; 30:366-382. [PMID: 36412148 PMCID: PMC10331622 DOI: 10.1177/15533506221140506] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/20/2023]
Abstract
This review aims to provide an update on the role of augmented reality (AR) in surgical training and investigate whether the use of AR improves performance measures compared to traditional approaches in surgical trainees. PUBMED, EMBASE, Google Scholar, Cochrane Library, British Library and Science Direct were searched following PRIMSA guidelines. All English language original studies pertaining to AR in surgical training were eligible for inclusion. Qualitative analysis was performed and results were categorised according to simulator models, subsequently being evaluated using Messick's framework for validity and McGaghie's translational outcomes for simulation-based learning. Of the 1132 results retrieved, 45 were included in the study. 29 platforms were identified, with the highest 'level of effectiveness' recorded as 3. In terms of validity parameters, 10 AR models received a strong 'content validity' score of 2.15 models had a 'response processes' score ≥ 1. 'Internal structure' and 'consequences' were largely not discussed. 'Relations to other variables' was the best assessed criterion, with 9 platforms achieving a high score of 2. Overall, the Microsoft HoloLens received the highest level of recommendation for both validity and level of effectiveness. Augmented reality in surgical education is feasible and effective as an adjunct to traditional training. The Microsoft HoloLens has shown the most promising results across all parameters and produced improved performance measures in surgical trainees. In terms of the other simulator models, further research is required with stronger study designs, in order to validate the use of AR in surgical training.
Collapse
Affiliation(s)
- Dhivya Suresh
- Guy’s, King’s and St Thomas’ School of Medical Education, King’s College London, London, UK
| | - Abdullatif Aydin
- MRC Centre for Transplantation, Guy’s Hospital, King’s College London, London, UK
| | - Stuart James
- Department of General Surgery, Princess Royal University Hospital, London, UK
| | - Kamran Ahmed
- MRC Centre for Transplantation, Guy’s Hospital, King’s College London, London, UK
| | - Prokar Dasgupta
- MRC Centre for Transplantation, Guy’s Hospital, King’s College London, London, UK
| |
Collapse
|
6
|
Kögl FV, Léger É, Haouchine N, Torio E, Juvekar P, Navab N, Kapur T, Pieper S, Golby A, Frisken S. A Tool-free Neuronavigation Method based on Single-view Hand Tracking. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING. IMAGING & VISUALIZATION 2022; 11:1307-1315. [PMID: 37457380 PMCID: PMC10348700 DOI: 10.1080/21681163.2022.2163428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Accepted: 11/19/2022] [Indexed: 12/30/2022]
Abstract
This work presents a novel tool-free neuronavigation method that can be used with a single RGB commodity camera. Compared with freehand craniotomy placement methods, the proposed system is more intuitive and less error prone. The proposed method also has several advantages over standard neuronavigation platforms. First, it has a much lower cost, since it doesn't require the use of an optical tracking camera or electromagnetic field generator, which are typically the most expensive parts of a neuronavigation system, making it much more accessible. Second, it requires minimal setup, meaning that it can be performed at the bedside and in circumstances where using a standard neuronavigation system is impractical. Our system relies on machine-learning-based hand pose estimation that acts as a proxy for optical tool tracking, enabling a 3D-3D pre-operative to intra-operative registration. Qualitative assessment from clinical users showed that the concept is clinically relevant. Quantitative assessment showed that on average a target registration error (TRE) of 1.3cm can be achieved. Furthermore, the system is framework-agnostic, meaning that future improvements to hand-tracking frameworks would directly translate to a higher accuracy.
Collapse
Affiliation(s)
- Fryderyk Victor Kögl
- Harvard Medical School, Brigham and Women’s Hospital, Boston, MA, USA
- Computer Aided Medical Procedures, Technische Universität München, Munich, Germany
| | - Étienne Léger
- Harvard Medical School, Brigham and Women’s Hospital, Boston, MA, USA
| | - Nazim Haouchine
- Harvard Medical School, Brigham and Women’s Hospital, Boston, MA, USA
| | - Erickson Torio
- Harvard Medical School, Brigham and Women’s Hospital, Boston, MA, USA
| | - Parikshit Juvekar
- Harvard Medical School, Brigham and Women’s Hospital, Boston, MA, USA
| | - Nassir Navab
- Computer Aided Medical Procedures, Technische Universität München, Munich, Germany
- Whiting School of Engineering, Johns Hopkins University, Baltimore, USA
| | - Tina Kapur
- Harvard Medical School, Brigham and Women’s Hospital, Boston, MA, USA
| | - Steve Pieper
- Harvard Medical School, Brigham and Women’s Hospital, Boston, MA, USA
- Isomics, Inc., Cambridge, MA, USA
| | - Alexandra Golby
- Harvard Medical School, Brigham and Women’s Hospital, Boston, MA, USA
| | - Sarah Frisken
- Harvard Medical School, Brigham and Women’s Hospital, Boston, MA, USA
| |
Collapse
|
7
|
Chahine J, Mascarenhas L, George SA, Bartos J, Yannopoulos D, Raveendran G, Gurevich S. Effects of a Mixed-Reality Headset on Procedural Outcomes in the Cardiac Catheterization Laboratory. CARDIOVASCULAR REVASCULARIZATION MEDICINE 2022; 45:3-8. [PMID: 35995656 DOI: 10.1016/j.carrev.2022.08.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2022] [Revised: 07/02/2022] [Accepted: 08/05/2022] [Indexed: 01/04/2023]
Abstract
BACKGROUND Mixed reality head-mounted displays (MR-HMD) are a novel and emerging tool in healthcare. There is a paucity of data on the safety and efficacy of the use of MR-HMD in the cardiac catheterization laboratory (CCL). We sought to analyze and compare fluoroscopy time, procedure time, and complication rates with right heart catheterizations (RHCs) and coronary angiographies (CAs) performed with MR-HMD versus standard LCD medical displays. METHODS This is a non-randomized trial that included patients who underwent RHC and CA with MR-HMD between August 2019 and January 2020. Their outcomes were compared to a control group during the same time period. The primary endpoints were procedure time, fluoroscopy time, and dose area product (DAP). The secondary endpoints were contrast volume and intra and postprocedural complications rate. RESULTS 50 patients were enrolled in the trial, 33 had a RHC done, and 29 had a diagnostic CA performed. They were compared to 232 patients in the control group. The use of MR-HMD was associated with a significantly lower procedure time (20 min (IQR 14-30) vs. 25 min (IQR 18-36), p = 0.038). There were no significant differences in median fluoroscopy time (1.5 min (IQR 0.7-4.9) in the study group vs. 1.3 min (IQR 0.8-3.1), p = 0.84) or median DAP (165.4 mGy·cm2 (IQR 13-15,583) in the study group vs. 913 mGy·cm2 (IQR 24-6291), p = 0.17). There was no significant increase in intra- or post-procedure complications. CONCLUSION MR-HMD use is safe and feasible and may decrease procedure time in the CCL.
Collapse
Affiliation(s)
- Johnny Chahine
- Department of Medicine, University of Minnesota, Minneapolis, MN, United States of America
| | - Lorraine Mascarenhas
- Department of Medicine, University of Minnesota, Minneapolis, MN, United States of America
| | | | - Jason Bartos
- Department of Medicine, University of Minnesota, Minneapolis, MN, United States of America
| | - Demetris Yannopoulos
- Department of Medicine, University of Minnesota, Minneapolis, MN, United States of America
| | - Ganesh Raveendran
- Department of Medicine, University of Minnesota, Minneapolis, MN, United States of America
| | - Sergey Gurevich
- Department of Medicine, University of Minnesota, Minneapolis, MN, United States of America.
| |
Collapse
|
8
|
The Role of Augmented Reality in the Next Phase of Surgical Education. Plast Reconstr Surg Glob Open 2022; 10:e4656. [PMID: 36348749 PMCID: PMC9633082 DOI: 10.1097/gox.0000000000004656] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Accepted: 09/20/2022] [Indexed: 01/24/2023]
Abstract
Concomitant with such a shift toward competency-based curricula, there has been increasing adoption of surgical simulation coupled with virtual, mixed, and augmented reality. These technologies have become more commonplace across multiple surgical disciplines, in domains such as preoperative planning, surgical education, and intraoperative navigation. However, there is a relative paucity of literature pertaining to the application of this technology to plastic surgery education. This review outlines the advantages of mixed and augmented reality in the pursuit of an ideal simulation environment, their benefits for the education of plastic surgery trainees, and their role in standardized assessments. In addition, we offer practical solutions to commonly encountered problems with this technology. Augmented reality has tremendous untapped potential in the next phase of plastic surgery education, and we outline steps toward broader implementation to enhance the learning environment for our trainees and to improve patient outcomes.
Collapse
|
9
|
Léger É, Horvath S, Fillion-Robin JC, Allemang D, Gerber S, Juvekar P, Torio E, Kapur T, Pieper S, Pujol S, Bardsley R, Frisken S, Golby A. NousNav: A low-cost neuronavigation system for deployment in lower-resource settings. Int J Comput Assist Radiol Surg 2022; 17:1745-1750. [PMID: 35511395 DOI: 10.1007/s11548-022-02644-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Accepted: 04/14/2022] [Indexed: 11/30/2022]
Abstract
PURPOSE NousNav is a complete low-cost neuronavigation system that aims to democratize access to higher-quality healthcare in lower-resource settings. NousNav's goal is to provide a model for local actors to be able to reproduce, build and operate a fully functional neuronavigation system at an affordable cost. METHODS NousNav is entirely open source and relies on low-cost off-the-shelf components, which makes it easy to reproduce and deploy in any region. NousNav's software is also specifically devised with the low-resource setting in mind. RESULTS It offers means for intuitive intraoperative control. The designed interface is also clean and simple. This allows for easy intraoperative use by either the practicing clinician or a nurse. It thus alleviates the need for a dedicated technician for operation. CONCLUSION A prototype implementation of the design was built. Hardware and algorithms were designed for robustness, ruggedness, modularity, to be standalone and data-agnostic. The built prototype demonstrates feasibility of the objectives.
Collapse
Affiliation(s)
- Étienne Léger
- Brigham and Women's Hospital, Boston, MA, USA. .,Harvard Medical School, Boston, MA, USA.
| | | | | | | | | | - Parikshit Juvekar
- Brigham and Women's Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| | - Erickson Torio
- Brigham and Women's Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| | - Tina Kapur
- Brigham and Women's Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| | | | - Sonia Pujol
- Brigham and Women's Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| | | | - Sarah Frisken
- Brigham and Women's Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| | - Alexandra Golby
- Brigham and Women's Hospital, Boston, MA, USA.,Harvard Medical School, Boston, MA, USA
| |
Collapse
|
10
|
Thavarajasingam SG, Vardanyan R, Arjomandi Rad A, Thavarajasingam A, Khachikyan A, Mendoza N, Nair R, Vajkoczy P. The use of augmented reality in transsphenoidal surgery: A systematic review. Br J Neurosurg 2022; 36:457-471. [PMID: 35393900 DOI: 10.1080/02688697.2022.2057435] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Abstract
BACKGROUND Augmented reality (AR) has become a promising tool in neurosurgery. It can minimise the anatomical challenges faced by conventional endoscopic or microscopic transsphenoidal reoperations and can assist in intraoperative guidance, preoperative planning, and surgical training. OBJECTIVES The aims of this systematic review are to describe, compare, and evaluate the use of AR in endoscopic and microscopic transsphenoidal surgery, incorporating the latest primary research. METHODS A systematic review was performed to explore and evaluate existing primary evidence for using AR in transsphenoidal surgery. A comprehensive search of MEDLINE and EMBASE was conducted from database inception to 11th August 2021 for primary data on the use of AR in microscopic and endoscopic endonasal skull base surgery. Additional articles were identified through searches on PubMed, Google Scholar, JSTOR, SCOPUS, Web of Science, Engineering Village, IEEE transactions, and HDAS. A synthesis without meta-analysis (SWiM) analysis was employed quantitatively and qualitatively on the impact of AR on landmark identification, intraoperative navigation, accuracy, time, surgeon experience, and patient outcomes. RESULTS In this systematic review, 17 studies were included in the final analysis. The main findings were that AR provides a convincing improvement to landmark identification, intraoperative navigation, and surgeon experience in transsphenoidal surgery, with a further positive effect on accuracy and time. It did not demonstrate a convincing positive effect on patient outcomes. No studies reported comparative mortalities, morbidities, or cost-benefit indications. CONCLUSION AR-guided transsphenoidal surgery, both endoscopic and microscopic, is associated with an overall improvement in the areas of intraoperative guidance and surgeon experience as compared with their conventional counterparts. However, literature on this area, particularly comparative data and evidence, is very limited. More studies with similar methodologies and quantitative outcomes are required to perform appropriate meta-analyses and to draw significant conclusions.
Collapse
Affiliation(s)
| | - Robert Vardanyan
- Faculty of Medicine, Imperial College London, London, United Kingdom
| | | | | | - Artur Khachikyan
- Department of Neurology and Neurosurgery, National Institute of Health, Yerevan, Armenia
| | - Nigel Mendoza
- Department of Neurosurgery, Imperial College NHS Healthcare Trust, London, United Kingdom
| | - Ramesh Nair
- Department of Neurosurgery, Imperial College NHS Healthcare Trust, London, United Kingdom
| | - Peter Vajkoczy
- Department of Neurosurgery, Charité - Universitätsmedizin Berlin, Berlin, Germany
| |
Collapse
|
11
|
Salgado-Lopez L, Oemke H, Feng R, Matsoukas S, Mocco J, Shrivastava R, Bederson J. Intraoperative use of heads-up display in skull base surgery. NEUROSURGICAL FOCUS: VIDEO 2022; 6:V2. [PMID: 36284591 PMCID: PMC9557332 DOI: 10.3171/2021.10.focvid21177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 08/30/2021] [Accepted: 10/21/2021] [Indexed: 11/08/2022]
Abstract
In this video, the authors highlight the applications of virtual reality and heads-up display in skull base surgery by presenting the case of a 45-year-old woman with an incidental large clinoid meningioma extending into the posterior fossa. The patient underwent preoperative endovascular tumor embolization to facilitate tumor resection and reduce blood loss, followed by a right pterional craniotomy. The use of intraoperative Doppler, intraoperative neurophysiological monitoring, and endoscope-assisted microsurgery is also featured. A subtotal resection was planned given tumor encasement of the posterior communicating and anterior choroidal arteries. No new neurological deficits were noted after the surgical procedure. The video can be found here: https://stream.cadmore.media/r10.3171/2021.10.FOCVID21177
Collapse
Affiliation(s)
| | - Holly Oemke
- Department of Neurosurgery, Mount Sinai Hospital, New York, New York
| | - Rui Feng
- Department of Neurosurgery, Mount Sinai Hospital, New York, New York
| | - Stavros Matsoukas
- Department of Neurosurgery, Mount Sinai Hospital, New York, New York
| | - J Mocco
- Department of Neurosurgery, Mount Sinai Hospital, New York, New York
| | - Raj Shrivastava
- Department of Neurosurgery, Mount Sinai Hospital, New York, New York
| | - Joshua Bederson
- Department of Neurosurgery, Mount Sinai Hospital, New York, New York
| |
Collapse
|
12
|
Matias J, Belletier C, Izaute M, Lutz M, Silvert L. The role of perceptual and cognitive load on inattentional blindness: A systematic review and three meta-analyses. Q J Exp Psychol (Hove) 2021; 75:1844-1875. [PMID: 34802311 DOI: 10.1177/17470218211064903] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
The inattentional blindness phenomenon refers to situations in which a visible but unexpected stimulus remains consciously unnoticed by observers. This phenomenon is classically explained as the consequence of insufficient attention, because attentional resources are already engaged elsewhere or vary between individuals. However, this attentional-resources view is broad and often imprecise regarding the variety of attentional models, the different pools of resources that can be involved in attentional tasks, and the heterogeneity of the experimental paradigms. Our aim was to investigate whether a classic theoretical model of attention, namely the Load Theory, could account for a large range of empirical findings in this field by distinguishing the role of perceptual and cognitive resources in attentional selection and attentional capture by irrelevant stimuli. As this model has been mostly built on implicit measures of distractor interference, it is unclear whether its predictions also hold when explicit and subjective awareness of an unexpected stimulus is concerned. Therefore, we conducted a systematic review and meta-analyses of inattentional blindness studies investigating the role of perceptual and/or cognitive resources. The results reveal that, in line with the perceptual account of the Load Theory, inattentional blindness significantly increases with the perceptual load of the task. However, the cognitive account of this theory is not clearly supported by the empirical findings analysed here. Furthermore, the interaction between perceptual and cognitive load on inattentional blindness remains understudied. Theoretical implications for the Load Theory are discussed, notably regarding the difference between attentional capture and subjective awareness paradigms, and further research directions are provided.
Collapse
Affiliation(s)
- Jérémy Matias
- Laboratoire de Psychologie Sociale et Cognitive (LAPSCO), Université Clermont Auvergne-CNRS, Clermont-Ferrand, France
| | - Clément Belletier
- Laboratoire de Psychologie Sociale et Cognitive (LAPSCO), Université Clermont Auvergne-CNRS, Clermont-Ferrand, France
| | - Marie Izaute
- Laboratoire de Psychologie Sociale et Cognitive (LAPSCO), Université Clermont Auvergne-CNRS, Clermont-Ferrand, France
| | - Matthieu Lutz
- Innovation Procédés Industriels, Michelin Recherche et Développement, Clermont-Ferrand, France
| | - Laetitia Silvert
- Laboratoire de Psychologie Sociale et Cognitive (LAPSCO), Université Clermont Auvergne-CNRS, Clermont-Ferrand, France
| |
Collapse
|
13
|
Davids J, Manivannan S, Darzi A, Giannarou S, Ashrafian H, Marcus HJ. Simulation for skills training in neurosurgery: a systematic review, meta-analysis, and analysis of progressive scholarly acceptance. Neurosurg Rev 2021; 44:1853-1867. [PMID: 32944808 PMCID: PMC8338820 DOI: 10.1007/s10143-020-01378-0] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Revised: 07/17/2020] [Accepted: 08/21/2020] [Indexed: 02/07/2023]
Abstract
At a time of significant global unrest and uncertainty surrounding how the delivery of clinical training will unfold over the coming years, we offer a systematic review, meta-analysis, and bibliometric analysis of global studies showing the crucial role simulation will play in training. Our aim was to determine the types of simulators in use, their effectiveness in improving clinical skills, and whether we have reached a point of global acceptance. A PRISMA-guided global systematic review of the neurosurgical simulators available, a meta-analysis of their effectiveness, and an extended analysis of their progressive scholarly acceptance on studies meeting our inclusion criteria of simulation in neurosurgical education were performed. Improvement in procedural knowledge and technical skills was evaluated. Of the identified 7405 studies, 56 studies met the inclusion criteria, collectively reporting 50 simulator types ranging from cadaveric, low-fidelity, and part-task to virtual reality (VR) simulators. In all, 32 studies were included in the meta-analysis, including 7 randomised controlled trials. A random effects, ratio of means effects measure quantified statistically significant improvement in procedural knowledge by 50.2% (ES 0.502; CI 0.355; 0.649, p < 0.001), technical skill including accuracy by 32.5% (ES 0.325; CI - 0.482; - 0.167, p < 0.001), and speed by 25% (ES - 0.25, CI - 0.399; - 0.107, p < 0.001). The initial number of VR studies (n = 91) was approximately double the number of refining studies (n = 45) indicating it is yet to reach progressive scholarly acceptance. There is strong evidence for a beneficial impact of adopting simulation in the improvement of procedural knowledge and technical skill. We show a growing trend towards the adoption of neurosurgical simulators, although we have not fully gained progressive scholarly acceptance for VR-based simulation technologies in neurosurgical education.
Collapse
Affiliation(s)
- Joseph Davids
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, Queen Square, Holborn, London, WC1N 3BG, UK.
- Imperial College Healthcare NHS Trust, St Mary's Praed St, Paddington, London, W2 1NY, UK.
| | - Susruta Manivannan
- Department of Neurosurgery, Southampton University NHS Trust, Tremona Road, Southampton, SO16 6YD, UK
| | - Ara Darzi
- Imperial College Healthcare NHS Trust, St Mary's Praed St, Paddington, London, W2 1NY, UK
| | - Stamatia Giannarou
- Imperial College Healthcare NHS Trust, St Mary's Praed St, Paddington, London, W2 1NY, UK
| | - Hutan Ashrafian
- Imperial College Healthcare NHS Trust, St Mary's Praed St, Paddington, London, W2 1NY, UK
| | - Hani J Marcus
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, Queen Square, Holborn, London, WC1N 3BG, UK
- Imperial College Healthcare NHS Trust, St Mary's Praed St, Paddington, London, W2 1NY, UK
| |
Collapse
|
14
|
Bari H, Wadhwani S, Dasari BVM. Role of artificial intelligence in hepatobiliary and pancreatic surgery. World J Gastrointest Surg 2021; 13:7-18. [PMID: 33552391 PMCID: PMC7830072 DOI: 10.4240/wjgs.v13.i1.7] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/28/2020] [Revised: 12/08/2020] [Accepted: 12/17/2020] [Indexed: 02/06/2023] Open
Abstract
Over the past decade, enhanced preoperative imaging and visualization, improved delineation of the complex anatomical structures of the liver and pancreas, and intra-operative technological advances have helped deliver the liver and pancreatic surgery with increased safety and better postoperative outcomes. Artificial intelligence (AI) has a major role to play in 3D visualization, virtual simulation, augmented reality that helps in the training of surgeons and the future delivery of conventional, laparoscopic, and robotic hepatobiliary and pancreatic (HPB) surgery; artificial neural networks and machine learning has the potential to revolutionize individualized patient care during the preoperative imaging, and postoperative surveillance. In this paper, we reviewed the existing evidence and outlined the potential for applying AI in the perioperative care of patients undergoing HPB surgery.
Collapse
Affiliation(s)
- Hassaan Bari
- Department of HPB and Liver Transplantation Surgery, Queen Elizabeth Hospital, Birmingham B15 2TH, United Kingdom
| | - Sharan Wadhwani
- Department of Radiology, Queen Elizabeth Hospital, Birmingham B15 2TH, United Kingdom
| | - Bobby V M Dasari
- Department of HPB and Liver Transplantation Surgery, Queen Elizabeth Hospital, Birmingham B15 2TH, United Kingdom
| |
Collapse
|
15
|
Virtual Reality Simulation and Augmented Reality-Guided Surgery for Total Maxillectomy: A Case Report. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10186288] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
With the improvement in computer graphics and sensors, technologies like virtual reality (VR) and augmented reality (AR) have created new possibilities for developing diagnostic and surgical techniques in the field of surgery. VR and AR are the latest technological modalities that have been integrated into clinical practice and medical education, and are rapidly emerging as powerful tools in the field of maxillofacial surgery. In this report, we describe a case of total maxillectomy and orbital floor reconstruction in a patient with malignant fibrous histiocytoma of the maxilla, with preoperative planning via VR simulation and AR-guided surgery. Future developments in VR and AR technologies will increase their utility and effectiveness in the field of surgery.
Collapse
|
16
|
Augmented Reality Interface for Complex Anatomy Learning in the Central Nervous System: A Systematic Review. JOURNAL OF HEALTHCARE ENGINEERING 2020; 2020:8835544. [PMID: 32963749 PMCID: PMC7501559 DOI: 10.1155/2020/8835544] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/22/2020] [Revised: 08/14/2020] [Accepted: 08/21/2020] [Indexed: 01/17/2023]
Abstract
The medical system is facing the transformations with augmentation in the use of medical information systems, electronic records, smart, wearable devices, and handheld. The central nervous system function is to control the activities of the mind and the human body. Modern speedy development in medical and computational growth in the field of the central nervous system enables practitioners and researchers to extract and visualize insight from these systems. The function of augmented reality is to incorporate virtual and real objects, interactively running in a real-time and real environment. The role of augmented reality in the central nervous system becomes a thought-provoking task. Gesture interaction approach-based augmented reality in the central nervous system has enormous impending for reducing the care cost, quality refining of care, and waste and error reducing. To make this process smooth, it would be effective to present a comprehensive study report of the available state-of-the-art-work for enabling doctors and practitioners to easily use it in the decision making process. This comprehensive study will finally summarise the outputs of the published materials associate to gesture interaction-based augmented reality approach in the central nervous system. This research uses the protocol of systematic literature which systematically collects, analyses, and derives facts from the collected papers. The data collected range from the published materials for 10 years. 78 papers were selected and included papers based on the predefined inclusion, exclusion, and quality criteria. The study supports to identify the studies related to augmented reality in the nervous system, application of augmented reality in the nervous system, technique of augmented reality in the nervous system, and the gesture interaction approaches in the nervous system. The derivations from the studies show that there is certain amount of rise-up in yearly wise articles, and numerous studies exist, related to augmented reality and gestures interaction approaches to different systems of the human body, specifically to the nervous system. This research organises and summarises the existing associated work, which is in the form of published materials, and are related to augmented reality. This research will help the practitioners and researchers to sight most of the existing studies subjected to augmented reality-based gestures interaction approaches for the nervous system and then can eventually be followed as support in future for complex anatomy learning.
Collapse
|
17
|
Liu T, Tai Y, Zhao C, Wei L, Zhang J, Pan J, Shi J. Augmented reality in neurosurgical navigation: a survey. Int J Med Robot 2020; 16:e2160. [PMID: 32890440 DOI: 10.1002/rcs.2160] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2020] [Revised: 08/19/2020] [Accepted: 08/29/2020] [Indexed: 11/12/2022]
Abstract
BACKGROUND Neurosurgery has exceptionally high requirements for minimally invasive and safety. This survey attempts to analyze the practical application of AR in neurosurgical navigation. Also, this survey describes future trends in augmented reality neurosurgical navigation systems. METHODS In this survey, we searched related keywords "augmented reality", "virtual reality", "neurosurgery", "surgical simulation", "brain tumor surgery", "neurovascular surgery", "temporal bone surgery", and "spinal surgery" through Google Scholar, World Neurosurgery, PubMed and Science Direct. We collected 85 articles published over the past five years in areas related to this survey. RESULTS Detailed study has been conducted on the application of AR in neurosurgery and found that AR is constantly improving the overall efficiency of doctor training and treatment, which can help neurosurgeons learn and practice surgical procedures with zero risks. CONCLUSIONS Neurosurgical navigation is essential in neurosurgery. Despite certain technical limitations, it is still a necessary tool for the pursuit of maximum security and minimal intrusiveness. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Tao Liu
- Yunnan Key Lab of Opto-electronic Information Technology, Yunnan Normal University, Kunming, China
| | - Yonghang Tai
- Yunnan Key Lab of Opto-electronic Information Technology, Yunnan Normal University, Kunming, China
| | - Chengming Zhao
- Yunnan Key Lab of Opto-electronic Information Technology, Yunnan Normal University, Kunming, China
| | - Lei Wei
- Institute for Intelligent Systems Research and Innovation, Deakin University, Geelong, VIC, Australia
| | - Jun Zhang
- Yunnan Key Lab of Opto-electronic Information Technology, Yunnan Normal University, Kunming, China
| | - Junjun Pan
- State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China
| | - Junsheng Shi
- Yunnan Key Lab of Opto-electronic Information Technology, Yunnan Normal University, Kunming, China
| |
Collapse
|
18
|
Wang S, Frisbie J, Keepers Z, Bolten Z, Hevaganinge A, Boctor E, Leonard S, Tokuda J, Krieger A, Siddiqui MM. The Use of Three-dimensional Visualization Techniques for Prostate Procedures: A Systematic Review. Eur Urol Focus 2020; 7:1274-1286. [PMID: 32873515 DOI: 10.1016/j.euf.2020.08.002] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2020] [Revised: 07/14/2020] [Accepted: 08/11/2020] [Indexed: 12/29/2022]
Abstract
CONTEXT As an emerging technique, three-dimensional (3D) visualization has become more popular and can facilitate education, training, surgical planning, and intraoperative guidance for prostate cancer surgery. OBJECTIVE In this review, we aim to present the impact of 3D printing, virtual reality (VR), and augmented reality (AR) techniques for prostate cancer procedures, specifically prostate biopsy and radical prostatectomy (RP). EVIDENCE ACQUISITION A systematic review was performed by two investigators according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) criteria. EVIDENCE SYNTHESIS A total of 541 papers were identified in PubMed, Scopus, and Embase. Of these, 53 studies were identified for detailed review and 25 were qualified. Two more studies were identified from the references; thus, 27 studies were finally included in this systematic review. Nine papers reported on the use of 3D reconstructed models, mainly in education/training and intraoperative guidance; nine reported on VR, focusing on simulation training model and intraoperative guidance; and nine reported on AR technique with its best indication for surgical guidance in robotic RP. CONCLUSIONS Three-dimensional visualization techniques have gradually been introduced and developed in prostate procedures, and demonstrate potential utility not only for education/training, but also for surgical planning and intraoperative guidance. Prospective studies are needed to demonstrate clinical utility and validation of these technologies. PATIENT SUMMARY Despite low-quality evidence, promising signals were identified to demonstrate that three-dimensional visualization could help facilitate prostate procedures, in terms of education/training, surgical planning, and intraoperative guidance. It is still in a very early stage, and more studies need to be conducted to justify its widespread use.
Collapse
Affiliation(s)
- Shu Wang
- Division of Urology, Department of Surgery, University of Maryland School of Medicine, Baltimore, MD, USA
| | - James Frisbie
- Division of Urology, Department of Surgery, University of Maryland School of Medicine, Baltimore, MD, USA
| | - Zachery Keepers
- Division of Urology, Department of Surgery, University of Maryland School of Medicine, Baltimore, MD, USA
| | - Zachary Bolten
- Division of Urology, Department of Surgery, University of Maryland School of Medicine, Baltimore, MD, USA
| | - Anjana Hevaganinge
- Bio-Imaging and Machine Vision Lab, Fischell Department of Bioengineering, University of Maryland, College Park, MD, USA
| | - Emad Boctor
- Department of Computer Science, The Johns Hopkins University, Baltimore, MD, USA; Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, USA
| | - Simon Leonard
- Laboratory for Computational Sensing and Robotics, The Johns Hopkins University, Baltimore, MD, USA
| | - Junichi Tokuda
- Radiology, Brigham and Women's Hospital, Boston, MA, USA
| | - Axel Krieger
- Department of Mechanical Engineering, University of Maryland, College Park, MD, USA
| | - Mohummad Minhaj Siddiqui
- Division of Urology, Department of Surgery, University of Maryland School of Medicine, Baltimore, MD, USA; Veterans Affairs Maryland Healthcare System, Baltimore, MD, USA.
| |
Collapse
|
19
|
Lavé A, Meling TR, Schaller K, Corniola MV. Augmented reality in intracranial meningioma surgery: report of a case and systematic review. J Neurosurg Sci 2020; 64:369-376. [DOI: 10.23736/s0390-5616.20.04945-0] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
20
|
Gribaudo M, Piazzolla P, Porpiglia F, Vezzetti E, Violante MG. 3D augmentation of the surgical video stream: Toward a modular approach. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 191:105505. [PMID: 32387863 DOI: 10.1016/j.cmpb.2020.105505] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/04/2019] [Revised: 03/29/2020] [Accepted: 04/08/2020] [Indexed: 06/11/2023]
Abstract
BACKGROUND AND OBJECTIVE We present an original approach to the development of augmented reality (AR) real-time solutions for robotic surgery navigation. The surgeon operating the robotic system through a console and a visor experiences reduced awareness of the operatory scene. In order to improve the surgeon's spatial perception during robot-assisted minimally invasive procedures, we provide him/her with a solid automatic software system to position, rotate and scale in real-time the 3D virtual model of a patient's organ aligned over its image captured by the endoscope. METHODS We observed that the surgeon may benefit differently from the 3D augmentation during each stage of the surgical procedure; moreover, each stage may present different visual elements that provide specific challenges and opportunities to exploit for organ detection strategies implementation. Hence we integrate different solutions, each dedicated to a specific stage of the surgical procedure, into a single software system. RESULTS We present a formal model that generalizes our approach, describing a system composed of integrated solutions for AR in robot-assisted surgery. Following the proposed framework, and application has been developed which is currently used during in vivo surgery, for extensive testing, by the Urology unity of the San Luigi Hospital, in Orbassano (To), Italy. CONCLUSIONS The main contribution of this paper is in presenting a modular approach to the tracking problem during in-vivo robotic surgery, whose efficacy from a medical point of view has been assessed in cited works. The segmentation of the whole procedure in a set of stages allows associating the best tracking strategy to each of them, as well as to re-utilize implemented software mechanisms in stages with similar features.
Collapse
Affiliation(s)
- Marco Gribaudo
- Dept. of Electronics, Information and Bioengineering, Politecnico di Milano, Milano, Italy
| | - Pietro Piazzolla
- Dept. of Management and Production Engineering, Politecnico di Torino, Torino, Italy.
| | - Francesco Porpiglia
- Division of Urology, Department of Oncology, School of Medicine, University of Turin, Italy
| | - Enrico Vezzetti
- Dept. of Management and Production Engineering, Politecnico di Torino, Torino, Italy
| | - Maria Grazia Violante
- Dept. of Management and Production Engineering, Politecnico di Torino, Torino, Italy
| |
Collapse
|
21
|
Williams MA, McVeigh J, Handa AI, Lee R. Augmented reality in surgical training: a systematic review. Postgrad Med J 2020; 96:537-542. [DOI: 10.1136/postgradmedj-2020-137600] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2020] [Revised: 02/27/2020] [Accepted: 03/21/2020] [Indexed: 11/03/2022]
Abstract
The aim of this systematic review is to provide an update on the current state of augmented reality (AR) in surgical training and to further report on any described benefits compared with traditional techniques. A PICO (Population, Intervention, Comparison, Outcome) strategy was adopted to formulate an appropriate research question and define strict search terms to be entered into MEDLINE, CENTRAL and Google Scholar. The search was returned on 12/09/2019. All returned results were screened first by title and then abstract. The systematic search returned a total of 236 results, of which 18 were selected for final inclusion. Studies covered the full range of surgical disciplines and reported on outcomes including operative duration, accuracy and postoperative complication rates. Due to the heterogeneity of the collected data, no meta-analysis was possible. Outcome measures of competency, surgical opinion and postoperative complication rate were in favour of AR technology while operative duration appears to increase.
Collapse
|
22
|
Perfect Registration Leads to Imperfect Performance: A Randomized Trial of Multimodal Intraoperative Image Guidance. Ann Surg 2019; 269:236-242. [PMID: 29727330 DOI: 10.1097/sla.0000000000002793] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
OBJECTIVE To compare surgical safety and efficiency of 2 image guidance modalities, perfect augmented reality (AR) and side-by-side unregistered image guidance (IG), against a no guidance control (NG), when performing a simulated laparoscopic cholecystectomy (LC). BACKGROUND Image guidance using AR offers the potential to improve understanding of subsurface anatomy, with positive ramifications for surgical safety and efficiency. No intra-abdominal study has demonstrated any advantage for the technology. Perfect AR cannot be provided in the operative setting in a patient; however, it can be generated in the simulated setting. METHODS Thirty-six experienced surgeons performed a baseline LC using the LapMentor simulator before randomization to 1 of 3 study arms: AR, IG, or NG. Each performed 3 further LC. Safety and efficiency-related simulator metrics, and task workload (SURG-TLX) were collected. RESULTS The IG group had a shorter total instrument path length and fewer movements than NG and AR groups. Both IG and NG took a significantly shorter time than AR to complete dissection of Calot triangle. Use of IG and AR resulted in significantly fewer perforations and serious complications than the NG group. IG had significantly fewer perforations and serious complications than the AR group. Compared with IG, AR guidance was found to be significantly more distracting. CONCLUSION Side-by-side unregistered image guidance (IG) improved safety and surgical efficiency in a simulated setting when compared with AR or NG. IG provides a more tangible opportunity for integrating image guidance into existing surgical workflow as well as delivering the safety and efficiency benefits desired.
Collapse
|
23
|
|
24
|
Kwon D, Iloreta A, Miles B, Inman J. Open Anterior Skull Base Reconstruction: A Contemporary Review. Semin Plast Surg 2017; 31:189-196. [PMID: 29075157 DOI: 10.1055/s-0037-1607273] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
Abstract
Skull base extirpative and reconstructive surgery has undergone significant changes due to technological and operative advances. While endoscopic resection and reconstruction will continue to advance skull base surgery for the foreseeable future, traditional open surgical approaches and reconstructive techniques are still contemporarily employed as best practices in certain tumors or patient-specific anatomical cases. Skull base surgeons should strive to maintain a working knowledge and technical skill set to manage these challenging cases where endoscopic techniques have previously failed, are insufficient from anatomical constraints, or tumor biology with margin control supersedes the more minimally invasive approach. This review focuses on the reconstructive techniques available to the open skull base surgeon as an adjunct to the endoscopic reconstructive options. Anatomic considerations, factors relating to the defect or patient, reconstructive options of nonvascular grafts, local and regional flaps, and free tissue transfer are outlined using the literature and author's experience. Future directions in virtual surgical planning and emerging technologies will continue to enhance open and endoscopic skull base surgeon's preparation, performance, and outcomes in this continually developing interdisciplinary field.
Collapse
Affiliation(s)
- Daniel Kwon
- Department of Otolaryngology-Head and Neck Surgery, Loma Linda University Health, Loma Linda, California
| | - Alfred Iloreta
- Division of Rhinology and Skull Base Surgery, Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York
| | - Brett Miles
- Division of Head and Neck Oncology and Microvascular Reconstructive Surgery, Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, New York
| | - Jared Inman
- Department of Otolaryngology-Head and Neck Surgery, Loma Linda University Health, Loma Linda, California
| |
Collapse
|
25
|
Recent Development of Augmented Reality in Surgery: A Review. JOURNAL OF HEALTHCARE ENGINEERING 2017; 2017:4574172. [PMID: 29065604 PMCID: PMC5585624 DOI: 10.1155/2017/4574172] [Citation(s) in RCA: 138] [Impact Index Per Article: 19.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/12/2017] [Accepted: 07/03/2017] [Indexed: 12/11/2022]
Abstract
Introduction The development augmented reality devices allow physicians to incorporate data visualization into diagnostic and treatment procedures to improve work efficiency, safety, and cost and to enhance surgical training. However, the awareness of possibilities of augmented reality is generally low. This review evaluates whether augmented reality can presently improve the results of surgical procedures. Methods We performed a review of available literature dating from 2010 to November 2016 by searching PubMed and Scopus using the terms “augmented reality” and “surgery.” Results. The initial search yielded 808 studies. After removing duplicates and including only journal articles, a total of 417 studies were identified. By reading of abstracts, 91 relevant studies were chosen to be included. 11 references were gathered by cross-referencing. A total of 102 studies were included in this review. Conclusions The present literature suggest an increasing interest of surgeons regarding employing augmented reality into surgery leading to improved safety and efficacy of surgical procedures. Many studies showed that the performance of newly devised augmented reality systems is comparable to traditional techniques. However, several problems need to be addressed before augmented reality is implemented into the routine practice.
Collapse
|
26
|
Black D, Hettig J, Luz M, Hansen C, Kikinis R, Hahn H. Auditory feedback to support image-guided medical needle placement. Int J Comput Assist Radiol Surg 2017; 12:1655-1663. [PMID: 28213646 DOI: 10.1007/s11548-017-1537-1] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2016] [Accepted: 02/01/2017] [Indexed: 11/27/2022]
Abstract
PURPOSE During medical needle placement using image-guided navigation systems, the clinician must concentrate on a screen. To reduce the clinician's visual reliance on the screen, this work proposes an auditory feedback method as a stand-alone method or to support visual feedback for placing the navigated medical instrument, in this case a needle. METHODS An auditory synthesis model using pitch comparison and stereo panning parameter mapping was developed to augment or replace visual feedback for navigated needle placement. In contrast to existing approaches which augment but still require a visual display, this method allows view-free needle placement. An evaluation with 12 novice participants compared both auditory and combined audiovisual feedback against existing visual methods. RESULTS Using combined audiovisual display, participants show similar task completion times and report similar subjective workload and accuracy while viewing the screen less compared to using the conventional visual method. The auditory feedback leads to higher task completion times and subjective workload compared to both combined and visual feedback. CONCLUSION Audiovisual feedback shows promising results and establishes a basis for applying auditory feedback as a supplement to visual information to other navigated interventions, especially those for which viewing a patient is beneficial or necessary.
Collapse
Affiliation(s)
- David Black
- Jacobs University, Bremen, Germany.
- Medical Image Computing, University of Bremen, Bremen, Germany.
- Fraunhofer MEVIS, Bremen, Germany.
| | - Julian Hettig
- Faculty of Computer Science, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
| | - Maria Luz
- Faculty of Computer Science, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
| | - Christian Hansen
- Faculty of Computer Science, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
| | - Ron Kikinis
- Medical Image Computing, University of Bremen, Bremen, Germany
- Fraunhofer MEVIS, Bremen, Germany
- Surgical Planning Laboratory, Brigham and Women's Hospital, Boston, MA, USA
| | - Horst Hahn
- Jacobs University, Bremen, Germany
- Fraunhofer MEVIS, Bremen, Germany
| |
Collapse
|