1
|
Trout RM, Viehland C, Li JD, Raynor W, Dhalla AH, Vajzovic L, Kuo AN, Toth CA, Izatt JA. Methods for real-time feature-guided image fusion of intrasurgical volumetric optical coherence tomography with digital microscopy. BIOMEDICAL OPTICS EXPRESS 2023; 14:3308-3326. [PMID: 37497493 PMCID: PMC10368056 DOI: 10.1364/boe.488975] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 06/01/2023] [Accepted: 06/01/2023] [Indexed: 07/28/2023]
Abstract
4D-microscope-integrated optical coherence tomography (4D-MIOCT) is an emergent multimodal imaging technology in which live volumetric OCT (4D-OCT) is implemented in tandem with standard stereo color microscopy. 4D-OCT provides ophthalmic surgeons with many useful visual cues not available in standard microscopy; however it is challenging for the surgeon to effectively integrate cues from simultaneous-but-separate imaging in real-time. In this work, we demonstrate progress towards solving this challenge via the fusion of data from each modality guided by segmented 3D features. In this way, a more readily interpretable visualization that combines and registers important cues from both modalities is presented to the surgeon.
Collapse
Affiliation(s)
- Robert M Trout
- Department of Biomedical Engineering, Duke University, 101 Science Drive, Durham, NC 27708, USA
| | - Christian Viehland
- Department of Biomedical Engineering, Duke University, 101 Science Drive, Durham, NC 27708, USA
| | - Jianwei D Li
- Department of Biomedical Engineering, Duke University, 101 Science Drive, Durham, NC 27708, USA
| | - William Raynor
- Department of Ophthalmology, Duker University Medical Center, 2351 Erwin Road, Durham, NC 27705, USA
| | - Al-Hafeez Dhalla
- Department of Biomedical Engineering, Duke University, 101 Science Drive, Durham, NC 27708, USA
| | - Lejla Vajzovic
- Department of Ophthalmology, Duker University Medical Center, 2351 Erwin Road, Durham, NC 27705, USA
| | - Anthony N Kuo
- Department of Biomedical Engineering, Duke University, 101 Science Drive, Durham, NC 27708, USA
- Department of Ophthalmology, Duker University Medical Center, 2351 Erwin Road, Durham, NC 27705, USA
| | - Cynthia A Toth
- Department of Biomedical Engineering, Duke University, 101 Science Drive, Durham, NC 27708, USA
- Department of Ophthalmology, Duker University Medical Center, 2351 Erwin Road, Durham, NC 27705, USA
| | - Joseph A Izatt
- Department of Biomedical Engineering, Duke University, 101 Science Drive, Durham, NC 27708, USA
| |
Collapse
|
2
|
Muijzer MB, Schellekens PA, Beckers HJM, de Boer JH, Imhof SM, Wisse RPL. Clinical applications for intraoperative optical coherence tomography: a systematic review. Eye (Lond) 2022; 36:379-391. [PMID: 34272509 PMCID: PMC8807841 DOI: 10.1038/s41433-021-01686-9] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2021] [Revised: 06/17/2021] [Accepted: 07/01/2021] [Indexed: 02/06/2023] Open
Abstract
In this systematic review, we provide an overview of the current state of intraoperative optical coherence tomography (iOCT). As iOCT technology is increasingly utilized, its current clinical applications and potential uses warrant attention. Here, we categorize the findings of various studies by their respective fields, including the use of iOCT in vitreoretinal surgery, corneal surgery, glaucoma surgery, cataract surgery, and pediatric ophthalmology. The trend observed in recent decades towards performing minimally invasive ophthalmic surgery has caused practitioners to recognize the limitations of using a conventional surgical microscope for intraoperative visualization. Thus, the superior visualization provided by iOCT can improve the safety of these surgical techniques and promote the development of new minimally invasive ophthalmic surgeries. Landmark prospective studies found that iOCT can significantly affect surgical decision making and can cause a subsequent change in surgical strategy, and the use of iOCT has potential to improve surgical outcome. Despite these advantages, however, iOCT is still a relatively new technique, and beginning users of iOCT can encounter limitations that can preclude their reaching the full potential of iOCT and in this respect several improvements are needed.
Collapse
Affiliation(s)
- Marc B. Muijzer
- grid.7692.a0000000090126352Department of Ophthalmology, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Peter A.W.J. Schellekens
- grid.7692.a0000000090126352Department of Ophthalmology, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Henny J. M. Beckers
- grid.412966.e0000 0004 0480 1382University Eye Clinic, Maastricht University Medical Center, Maastricht, The Netherlands
| | - Joke H. de Boer
- grid.7692.a0000000090126352Department of Ophthalmology, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Saskia M. Imhof
- grid.7692.a0000000090126352Department of Ophthalmology, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Robert P. L. Wisse
- grid.7692.a0000000090126352Department of Ophthalmology, University Medical Center Utrecht, Utrecht, The Netherlands
| |
Collapse
|
3
|
Ahronovich EZ, Simaan N, Joos KM. A Review of Robotic and OCT-Aided Systems for Vitreoretinal Surgery. Adv Ther 2021; 38:2114-2129. [PMID: 33813718 PMCID: PMC8107166 DOI: 10.1007/s12325-021-01692-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Accepted: 02/27/2021] [Indexed: 02/08/2023]
Abstract
The introduction of the intraocular vitrectomy instrument by Machemer et al. has led to remarkable advancements in vitreoretinal surgery enabling the limitations of human physiologic capabilities to be reached. To overcome the barriers of perception, tremor, and dexterity, robotic technologies have been investigated with current advancements nearing the feasibility for clinical use. There are four categories of robotic systems that have emerged through the research: (1) handheld instruments with intrinsic robotic assistance, (2) hand-on-hand robotic systems, (3) teleoperated robotic systems, and (4) magnetic guidance robots. This review covers the improvements and the remaining needs for safe, cost-effective clinical deployment of robotic systems in vitreoretinal surgery.
Collapse
Affiliation(s)
- Elan Z. Ahronovich
- Advanced Robotics and Mechanism Applications (ARMA) Laboratory, Department of Mechanical Engineering, Vanderbilt University, Nashville, TN 37235 USA
| | - Nabil Simaan
- Advanced Robotics and Mechanism Applications (ARMA) Laboratory, Department of Mechanical Engineering, Department of Computer Science, Vanderbilt University, Nashville, TN 37235 USA
| | - Karen M. Joos
- Vanderbilt Eye Institute, Vanderbilt University Medical Center, Nashville, TN 37232 USA
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37235 USA
| |
Collapse
|
4
|
Evaluation of Three-Dimensional Heads up Ophthalmic Surgery Demonstration From the Perspective of Surgeons and Postgraduate Trainees. J Craniofac Surg 2021; 32:2285-2291. [PMID: 33770023 DOI: 10.1097/scs.0000000000007645] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
BACKGROUND To evaluate the satisfaction of surgeons and trainees with three-dimensional (3D) ophthalmic surgery during a demonstration compared to traditional surgery. METHODS This validated questionnaire-based study was conducted over 1-month during which Ngenuity 3D surgery was demonstrated. All surgeons and trainees exposed were recruited to complete a questionnaire comprising visualization, physical, ease of use, teaching and learning, and overall satisfaction. RESULTS All 7 surgeons and 33 postgraduate students responded. Surgeons reported no significant difference except overall (P = 0.047, paired t-test). Postgraduate trainees reported significantly better experience with 3D for illumination (P = 0.008), manoeuvrability (P = 0.01), glare (P = 0.037), eye strain (P = 0.008), neck and upper back strain (P = 0.000), lower back pain (P = 0.019), communication (P = 0.002), comfortable environment (P = 0.001), sharing of knowledge (P = 0.000), and overall (P = 0.009). CONCLUSIONS During early experience, surgeons and trainees reported better satisfaction with 3D overall. Trainees had better satisfaction with 3D in various subcomponents of visualization, physical, ease of use, and education.
Collapse
|
5
|
Ma L, Fei B. Comprehensive review of surgical microscopes: technology development and medical applications. JOURNAL OF BIOMEDICAL OPTICS 2021; 26:JBO-200292VRR. [PMID: 33398948 PMCID: PMC7780882 DOI: 10.1117/1.jbo.26.1.010901] [Citation(s) in RCA: 45] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/10/2020] [Accepted: 12/04/2020] [Indexed: 05/06/2023]
Abstract
SIGNIFICANCE Surgical microscopes provide adjustable magnification, bright illumination, and clear visualization of the surgical field and have been increasingly used in operating rooms. State-of-the-art surgical microscopes are integrated with various imaging modalities, such as optical coherence tomography (OCT), fluorescence imaging, and augmented reality (AR) for image-guided surgery. AIM This comprehensive review is based on the literature of over 500 papers that cover the technology development and applications of surgical microscopy over the past century. The aim of this review is threefold: (i) providing a comprehensive technical overview of surgical microscopes, (ii) providing critical references for microscope selection and system development, and (iii) providing an overview of various medical applications. APPROACH More than 500 references were collected and reviewed. A timeline of important milestones during the evolution of surgical microscope is provided in this study. An in-depth technical overview of the optical system, mechanical system, illumination, visualization, and integration with advanced imaging modalities is provided. Various medical applications of surgical microscopes in neurosurgery and spine surgery, ophthalmic surgery, ear-nose-throat (ENT) surgery, endodontics, and plastic and reconstructive surgery are described. RESULTS Surgical microscopy has been significantly advanced in the technical aspects of high-end optics, bright and shadow-free illumination, stable and flexible mechanical design, and versatile visualization. New imaging modalities, such as hyperspectral imaging, OCT, fluorescence imaging, photoacoustic microscopy, and laser speckle contrast imaging, are being integrated with surgical microscopes. Advanced visualization and AR are being added to surgical microscopes as new features that are changing clinical practices in the operating room. CONCLUSIONS The combination of new imaging technologies and surgical microscopy will enable surgeons to perform challenging procedures and improve surgical outcomes. With advanced visualization and improved ergonomics, the surgical microscope has become a powerful tool in neurosurgery, spinal, ENT, ophthalmic, plastic and reconstructive surgeries.
Collapse
Affiliation(s)
- Ling Ma
- University of Texas at Dallas, Department of Bioengineering, Richardson, Texas, United States
| | - Baowei Fei
- University of Texas at Dallas, Department of Bioengineering, Richardson, Texas, United States
- University of Texas Southwestern Medical Center, Department of Radiology, Dallas, Texas, United States
| |
Collapse
|
6
|
Szurman P. [Value of Intraoperative OCT in Retinal Surgery. Part 2: Contra]. Klin Monbl Augenheilkd 2020; 237:1225-1229. [PMID: 33059379 DOI: 10.1055/a-1153-4288] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
One of the most controversial discussions in retinal surgery is currently being held about the importance of intraoperative OCT (iOCT). The background is the desire to combine the 2-dimensional fundus view of the surgeon with the layered depth information of OCT to achieve a 4-dimensional "augmented reality" (3-D plus change over time). This should help to visualise fine structures, which have been hidden from the surgeon's view. Therefore, retinal surgery seems to be predestined for the use of iOCT. The great hope is that a dynamic live 3-D image with real-time feedback will provide the surgeon with additional information and improve safety. Although fascinating at the first glance, in the surgical routine, however, iOCT technology is disappointing, especially in macular surgery. It rarely provides substantial information that would not be obtainable without iOCT or that would not be available in much better quality through preoperative diagnostic testing. Only some special indications remain, particularly related to subretinal surgery.
Collapse
Affiliation(s)
- Peter Szurman
- Augenklinik Sulzbach, Knappschaftsklinikum Saar, Sulzbach/Saar
| |
Collapse
|
7
|
Titiyal JS, Kaur M, Nair S, Sharma N. Intraoperative optical coherence tomography in anterior segment surgery. Surv Ophthalmol 2020; 66:308-326. [PMID: 32710893 DOI: 10.1016/j.survophthal.2020.07.001] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2020] [Revised: 07/16/2020] [Accepted: 07/20/2020] [Indexed: 12/20/2022]
Abstract
Intraoperative optical coherence tomography (iOCT) enables real-time visualization of ocular structures during surgery and enhances our understanding of intraoperative dynamics. iOCT aids in decision-making during various anterior segment surgeries, and its efficacy and feasibility in anterior lamellar keratoplasty and endothelial keratoplasty is well established. The landmark DISCOVER study observed that iOCT altered the surgeon decision in 38% of cases undergoing lamellar keratoplasty and provided guidance regarding the need for secondary surgical intervention. iOCT also finds an application in phacoemulsification wherein it helps to assess corneal incisions, intralenticular pressure, and posterior capsule integrity during nuclear emulsification. iOCT aids in the visualization of angle structures during placement of tubes and shunts in glaucoma surgeries and allows precise creation of partial thickness scleral flaps. In addition, iOCT helps in establishing a diagnosis, as well as provide intraoperative guidance, in pediatric patients who are not cooperative for examination. The role of iOCT in refractive surgeries and ocular surface disorders is increasingly being evaluated. The limitations of present-day iOCT systems are related to instrument compatibility, automated tracking of the surgical field, and on-table volumetric analysis of the real-time images. Technological advances may facilitate complete integration of OCT in the surgical microscopes for all surgical procedures.
Collapse
Affiliation(s)
- Jeewan S Titiyal
- Dr. Rajendra Prasad Centre for Ophthalmic Sciences, All India Institute of Medical Sciences, New Delhi, India.
| | - Manpreet Kaur
- Dr. Rajendra Prasad Centre for Ophthalmic Sciences, All India Institute of Medical Sciences, New Delhi, India
| | - Sridevi Nair
- Dr. Rajendra Prasad Centre for Ophthalmic Sciences, All India Institute of Medical Sciences, New Delhi, India
| | - Namrata Sharma
- Dr. Rajendra Prasad Centre for Ophthalmic Sciences, All India Institute of Medical Sciences, New Delhi, India
| |
Collapse
|
8
|
Posarelli C, Sartini F, Casini G, Passani A, Toro MD, Vella G, Figus M. What Is the Impact of Intraoperative Microscope-Integrated OCT in Ophthalmic Surgery? Relevant Applications and Outcomes. A Systematic Review. J Clin Med 2020; 9:jcm9061682. [PMID: 32498222 PMCID: PMC7356858 DOI: 10.3390/jcm9061682] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2020] [Revised: 05/28/2020] [Accepted: 05/28/2020] [Indexed: 12/12/2022] Open
Abstract
Background: Optical coherence tomography (OCT) has recently been introduced in the operating theatre. The aim of this review is to present the actual role of microscope-integrated optical coherence tomography (MI-OCT) in ophthalmology. Method: A total of 314 studies were identified, following a literature search adhering to the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines. After full-text evaluation, 81 studies discussing MI-OCT applications in ophthalmology were included. Results: At present, three microscope-integrated optical coherence tomography systems are commercially available. MI-OCT can help anterior and posterior segment surgeons in the decision-making process, providing direct visualization of anatomic planes before and after surgical manoeuvres, assisting in complex cases, and detecting or confirming intraoperative complications. Applications range from corneal transplant to macular surgery, including cataract surgery, glaucoma surgery, paediatric examination, proliferative diabetic retinopathy surgery, and retinal detachment surgery. Conclusion: The use of MI-OCT in ophthalmic surgery is becoming increasingly prevalent and has been applied in almost all procedures. However, there are still limitations to be overcome and the technology involved remains difficult to access and use.
Collapse
Affiliation(s)
- Chiara Posarelli
- Ophthalmology, Department of Surgical, Medical, Molecular Pathology and of the Critical Area, University of Pisa, 56126 Pisa, Italy; (C.P.); (G.C.); (A.P.); (G.V.); (M.F.)
| | - Francesco Sartini
- Ophthalmology, Department of Surgical, Medical, Molecular Pathology and of the Critical Area, University of Pisa, 56126 Pisa, Italy; (C.P.); (G.C.); (A.P.); (G.V.); (M.F.)
- Correspondence: ; Tel.: +39-050-997-675
| | - Giamberto Casini
- Ophthalmology, Department of Surgical, Medical, Molecular Pathology and of the Critical Area, University of Pisa, 56126 Pisa, Italy; (C.P.); (G.C.); (A.P.); (G.V.); (M.F.)
| | - Andrea Passani
- Ophthalmology, Department of Surgical, Medical, Molecular Pathology and of the Critical Area, University of Pisa, 56126 Pisa, Italy; (C.P.); (G.C.); (A.P.); (G.V.); (M.F.)
| | - Mario Damiano Toro
- Department of General Ophthalmology, Medical University of Lublin, 20079 Lublin, Poland;
- Faculty of Medical Sciences, Collegium Medicum Cardinal Stefan Wyszyński University, 01815 Warsaw, Poland
| | - Giovanna Vella
- Ophthalmology, Department of Surgical, Medical, Molecular Pathology and of the Critical Area, University of Pisa, 56126 Pisa, Italy; (C.P.); (G.C.); (A.P.); (G.V.); (M.F.)
| | - Michele Figus
- Ophthalmology, Department of Surgical, Medical, Molecular Pathology and of the Critical Area, University of Pisa, 56126 Pisa, Italy; (C.P.); (G.C.); (A.P.); (G.V.); (M.F.)
| |
Collapse
|
9
|
Solarana K, Ye M, Gao YR, Rafi H, Hammer DX. Longitudinal multimodal assessment of neurodegeneration and vascular remodeling correlated with signal degradation in chronic cortical silicon microelectrodes. NEUROPHOTONICS 2020; 7:015004. [PMID: 32042853 PMCID: PMC6991888 DOI: 10.1117/1.nph.7.1.015004] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/06/2019] [Accepted: 01/14/2020] [Indexed: 05/19/2023]
Abstract
Significance: Cortically implanted microelectrode arrays provide a direct interface with neuronal populations and are used to restore movement capabilities and provide sensory feedback to patients with paralysis or amputation. Penetrating electrodes experience high rates of signal degradation within the first year that limit effectiveness and lead to eventual device failure. Aim: To assess vascular and neuronal changes over time in mice with implanted electrodes and examine the contribution of the brain tissue response to electrode performance. Approach: We used a multimodal approach combining in vivo electrophysiology and subcellular-level optical imaging. Results: At acute timescales, we observed structural damage from the mechanical trauma of electrode insertion, evidenced by severed dendrites in the electrode path and local hypofluorescence. Superficial vessel growth and remodeling occurred within the first few weeks in both electrode-implanted and window-only animals, but the deeper capillary growth evident in window-only animals was suppressed in electrode-implanted animals. After longer implantation periods, there was evidence of degeneration of transected dendrites superficial to the electrode path and localized neuronal cell body loss, along with deep vascular velocity changes near the electrode. Total spike rate (SR) across all animals reached a peak between 3 and 9 months postimplantation, then decreased. The local field potential signal remained relatively constant for up to 6 months, particularly in the high-gamma band, indicating long-term electrode viability and neuronal functioning at further distances from the electrode, but it showed a reduction in some animals at later time points. Most importantly, we found that progressive high-gamma and SR reductions both correlate positively with localized cell loss and decreasing capillary density within 100 μ m of the electrode. Conclusions: This multifaceted approach provided a more comprehensive picture of the ongoing biological response at the brain-electrode interface than can be achieved with postmortem histology alone and established a real-time relationship between electrophysiology and tissue damage.
Collapse
Affiliation(s)
- Krystyna Solarana
- Food and Drug Administration, Center for Radiological Devices, Office of Science and Engineering Laboratories, Division of Biomedical Physics, Silver Spring, Maryland, United States
| | - Meijun Ye
- Food and Drug Administration, Center for Radiological Devices, Office of Science and Engineering Laboratories, Division of Biomedical Physics, Silver Spring, Maryland, United States
| | - Yu-Rong Gao
- Food and Drug Administration, Center for Radiological Devices, Office of Science and Engineering Laboratories, Division of Biomedical Physics, Silver Spring, Maryland, United States
| | - Harmain Rafi
- Food and Drug Administration, Center for Radiological Devices, Office of Science and Engineering Laboratories, Division of Biomedical Physics, Silver Spring, Maryland, United States
| | - Daniel X. Hammer
- Food and Drug Administration, Center for Radiological Devices, Office of Science and Engineering Laboratories, Division of Biomedical Physics, Silver Spring, Maryland, United States
- Address all correspondence to Daniel X. Hammer, E-mail:
| |
Collapse
|
10
|
Echtzeit-optische Kohärenztomographie-assistierte Hochpräzisionsvitreoretinalchirurgie in der klinischen Routine. Ophthalmologe 2019; 117:158-165. [DOI: 10.1007/s00347-019-01007-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
11
|
Cao C, Cerfolio RJ. Virtual or Augmented Reality to Enhance Surgical Education and Surgical Planning. Thorac Surg Clin 2019; 29:329-337. [PMID: 31235302 DOI: 10.1016/j.thorsurg.2019.03.010] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
Virtual reality and augmented reality technologies have evolved with a growing presence in both clinical care and surgical training.
Collapse
Affiliation(s)
- Christopher Cao
- Department of Cardiothoracic Surgery, New York University Langone Health, 530 1st Avenue, 9V, New York, NY 10016, USA
| | - Robert J Cerfolio
- Department of Cardiothoracic Surgery, New York University Langone Health, 550 1st Avenue, 15th Floor, New York, NY 10016, USA.
| |
Collapse
|
12
|
Rahman R, Wood ME, Qian L, Price CL, Johnson AA, Osgood GM. Head-Mounted Display Use in Surgery: A Systematic Review. Surg Innov 2019; 27:88-100. [DOI: 10.1177/1553350619871787] [Citation(s) in RCA: 48] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Purpose. We analyzed the literature to determine (1) the surgically relevant applications for which head-mounted display (HMD) use is reported; (2) the types of HMD most commonly reported; and (3) the surgical specialties in which HMD use is reported. Methods. The PubMed, Embase, Cochrane Library, and Web of Science databases were searched through August 27, 2017, for publications describing HMD use during surgically relevant applications. We identified 120 relevant English-language, non-opinion publications for inclusion. HMD types were categorized as “heads-up” (nontransparent HMD display and direct visualization of the real environment), “see-through” (visualization of the HMD display overlaid on the real environment), or “non–see-through” (visualization of only the nontransparent HMD display). Results. HMDs were used for image guidance and augmented reality (70 publications), data display (63 publications), communication (34 publications), and education/training (18 publications). See-through HMDs were described in 55 publications, heads-up HMDs in 41 publications, and non–see-through HMDs in 27 publications. Google Glass, a see-through HMD, was the most frequently used model, reported in 32 publications. The specialties with the highest frequency of published HMD use were urology (20 publications), neurosurgery (17 publications), and unspecified surgical specialty (20 publications). Conclusion. Image guidance and augmented reality were the most commonly reported applications for which HMDs were used. See-through HMDs were the most commonly reported type used in surgically relevant applications. Urology and neurosurgery were the specialties with greatest published HMD use.
Collapse
Affiliation(s)
- Rafa Rahman
- The Johns Hopkins University, Baltimore, MD, USA
| | | | - Long Qian
- The Johns Hopkins University, Baltimore, MD, USA
| | | | | | | |
Collapse
|
13
|
Gu L, Cheng D, Wang Q, Hou Q, Wang S, Yang T, Wang Y. Design of a uniform-illumination two-dimensional waveguide head-up display with thin plate compensator. OPTICS EXPRESS 2019; 27:12692-12709. [PMID: 31052807 DOI: 10.1364/oe.27.012692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/04/2019] [Accepted: 04/11/2019] [Indexed: 06/09/2023]
Abstract
Nonuniform illumination is one of the factors in degrading image performance of geometrical waveguide-based head-up display. The two-dimensional (2-D) waveguide expanding the exit pupil along two orthogonal directions makes illumination uniformization more intractable. To solve this problem, the reasons for nonuniform illumination in 2-D geometrical waveguide were probed and a novel waveguide structure incorporating illumination compensator was proposed. A bilayer illumination compensator was first presented to change the period of rays propagating in waveguide to improve the inter-pupil illumination uniformity and inter-field illumination uniformity. Then optimized coating design for different partially reflective mirrors in horizontal waveguide and the vertical one allowed further improvement of these two kinds of illumination uniformity, raising both up to 70%. A matched catadioptric projection optics using freeform surface was designed and integrated with the resultant 2-D geometrical waveguide, achieving a head-up display with an eye relief of 400 mm, an eyebox of 80 mm × 80 mm and a field of 24° × 15°. A prototype of the proposed 2-D geometrical waveguide display was developed and demonstrated.
Collapse
|
14
|
Kolb JP, Draxinger W, Klee J, Pfeiffer T, Eibl M, Klein T, Wieser W, Huber R. Live video rate volumetric OCT imaging of the retina with multi-MHz A-scan rates. PLoS One 2019; 14:e0213144. [PMID: 30921342 PMCID: PMC6438632 DOI: 10.1371/journal.pone.0213144] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2018] [Accepted: 02/18/2019] [Indexed: 12/17/2022] Open
Abstract
Surgical microscopes are vital tools for ophthalmic surgeons. The recent development of an integrated OCT system for the first time allows to look at tissue features below the surface. Hence, these systems can drastically improve the quality and reduce the risk of surgical interventions. However, current commercial OCT-enhanced ophthalmic surgical microscopes provide only one additional cross sectional view to the standard microscope image and feature a low update rate. To present volumetric data at a high update rate, much faster OCT systems than the ones applied in today's surgical microscopes need to be developed. We demonstrate live volumetric retinal OCT imaging, which may provide a sufficiently large volume size (330x330x595 Voxel) and high update frequency (24.2 Hz) such that the surgeon may even purely rely on the OCT for certain surgical maneuvers. It represents a major technological step towards the possible application of OCT-only surgical microscopes in the future which would be much more compact thus enabling many additional minimal invasive applications. We show that multi-MHz A-scan rates are essential for such a device. Additionally, advanced phase-based OCT techniques require 3D OCT volumes to be detected with a stable optical phase. These techniques can provide additional functional information of the retina. Up to now, classical OCT was to slow for this, so our system can pave the way to holographic OCT with a traditional confocal flying spot approach. For the first time, we present point scanning volumetric OCT imaging of the posterior eye with up to 191.2 Hz volume rate. We show that this volume rate is high enough to enable a sufficiently stable optical phase to a level, where remaining phase errors can be corrected. Applying advanced post processing concepts for numerical refocusing or computational adaptive optics should be possible in future with such a system.
Collapse
Affiliation(s)
- Jan Philip Kolb
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Wolfgang Draxinger
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Julian Klee
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Tom Pfeiffer
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Matthias Eibl
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | | | | | - Robert Huber
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
- * E-mail:
| |
Collapse
|
15
|
Kolb JP, Draxinger W, Klee J, Pfeiffer T, Eibl M, Klein T, Wieser W, Huber R. Live video rate volumetric OCT imaging of the retina with multi-MHz A-scan rates. PLoS One 2019; 14:e0213144. [PMID: 30921342 DOI: 10.1371/journals.phone.0213144] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2018] [Accepted: 02/18/2019] [Indexed: 05/25/2023] Open
Abstract
Surgical microscopes are vital tools for ophthalmic surgeons. The recent development of an integrated OCT system for the first time allows to look at tissue features below the surface. Hence, these systems can drastically improve the quality and reduce the risk of surgical interventions. However, current commercial OCT-enhanced ophthalmic surgical microscopes provide only one additional cross sectional view to the standard microscope image and feature a low update rate. To present volumetric data at a high update rate, much faster OCT systems than the ones applied in today's surgical microscopes need to be developed. We demonstrate live volumetric retinal OCT imaging, which may provide a sufficiently large volume size (330x330x595 Voxel) and high update frequency (24.2 Hz) such that the surgeon may even purely rely on the OCT for certain surgical maneuvers. It represents a major technological step towards the possible application of OCT-only surgical microscopes in the future which would be much more compact thus enabling many additional minimal invasive applications. We show that multi-MHz A-scan rates are essential for such a device. Additionally, advanced phase-based OCT techniques require 3D OCT volumes to be detected with a stable optical phase. These techniques can provide additional functional information of the retina. Up to now, classical OCT was to slow for this, so our system can pave the way to holographic OCT with a traditional confocal flying spot approach. For the first time, we present point scanning volumetric OCT imaging of the posterior eye with up to 191.2 Hz volume rate. We show that this volume rate is high enough to enable a sufficiently stable optical phase to a level, where remaining phase errors can be corrected. Applying advanced post processing concepts for numerical refocusing or computational adaptive optics should be possible in future with such a system.
Collapse
Affiliation(s)
- Jan Philip Kolb
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Wolfgang Draxinger
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Julian Klee
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Tom Pfeiffer
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | - Matthias Eibl
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| | | | | | - Robert Huber
- Institut für Biomedizinische Optik, Universität zu Lübeck, Lübeck, Germany
| |
Collapse
|
16
|
Lee J, Wijesinghe RE, Jeon D, Kim P, Choung YH, Jang JH, Jeon M, Kim J. Clinical Utility of Intraoperative Tympanomastoidectomy Assessment Using a Surgical Microscope Integrated with an Optical Coherence Tomography. Sci Rep 2018; 8:17432. [PMID: 30479360 PMCID: PMC6258704 DOI: 10.1038/s41598-018-35563-5] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2018] [Accepted: 10/29/2018] [Indexed: 12/15/2022] Open
Abstract
Significant technical and optical advances are required for intraoperative optical coherence tomography (OCT) to be utilized during otological surgeries. Integrating OCT with surgical microscopy makes it possible to evaluate soft tissue in real-time and at a high resolution. Herein, we describe an augmented-reality, intraoperative OCT/microscope system with an extended working distance of 280 mm, providing more space for surgical manipulation than conventional techniques. We initially performed ex vivo experiments to evaluate system performance. In addition, we validated the system by performing preliminary clinical assessments of tympanomastoidectomy outcomes in six patients with chronic otitis media. The system evaluated residual inflammation in the region-of-interest of the mastoid bone. Most importantly, the system intraoperatively revealed the connection between the graft and the remnant tympanic membrane. The extended working distance allows otological surgeons to evaluate the status of both the mastoid bone and tympanic membrane during manipulation, affording full intraoperative imaging.
Collapse
Affiliation(s)
- Jaeyul Lee
- School of Electronics Engineering, College of IT Engineering, Kyungpook National University, 80 Daehak-ro, Buk-gu, Daegu, 41566, Republic of Korea
| | - Ruchire Eranga Wijesinghe
- Department of Biomedical Engineering, College of Engineering, Kyungil University, 50, Gamasil-gil, Hayang-eup, Gyeongsan-si, Gyeongsangbuk-do, 38428, Republic of Korea
| | - Deokmin Jeon
- School of Electronics Engineering, College of IT Engineering, Kyungpook National University, 80 Daehak-ro, Buk-gu, Daegu, 41566, Republic of Korea
| | - Pilun Kim
- School of Electronics Engineering, College of IT Engineering, Kyungpook National University, 80 Daehak-ro, Buk-gu, Daegu, 41566, Republic of Korea
| | - Yun-Hoon Choung
- Department of Otolaryngology, School of Medicine, Ajou University, 164 World cup-ro, Yeongtong-gu, Suwon, Gyeunggi-do, 16499, Republic of Korea
| | - Jeong Hun Jang
- Department of Otolaryngology, School of Medicine, Ajou University, 164 World cup-ro, Yeongtong-gu, Suwon, Gyeunggi-do, 16499, Republic of Korea.
| | - Mansik Jeon
- School of Electronics Engineering, College of IT Engineering, Kyungpook National University, 80 Daehak-ro, Buk-gu, Daegu, 41566, Republic of Korea
| | - Jeehyun Kim
- School of Electronics Engineering, College of IT Engineering, Kyungpook National University, 80 Daehak-ro, Buk-gu, Daegu, 41566, Republic of Korea.
| |
Collapse
|
17
|
Gu L, Cheng D, Wang Q, Hou Q, Wang Y. Design of a two-dimensional stray-light-free geometrical waveguide head-up display. APPLIED OPTICS 2018; 57:9246-9256. [PMID: 30461965 DOI: 10.1364/ao.57.009246] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/01/2018] [Accepted: 10/01/2018] [Indexed: 06/09/2023]
Abstract
Stray light is one of the factors exerting negative influences on the image quality of the head-up display based on the geometrical waveguide. Particularly, compared with the architecture used to expand a one-dimensional pupil, the geometrical waveguide expanding the two-dimensional pupil makes it difficult to remove the stray light due to the combined effect from two orthogonal directions. To overcome it, causes of stray light in the two-dimensional geometrical waveguide are analyzed based on the detailed calculation of the parameters that determine the geometry; the corresponding approach is put forward to decrease the percentage of the stray light across the eye box to below 0.1%. The relationship between the resultant combined waveguide and the projection optics is also clarified to obtain the pupil matching. The head-up display integrating the combined waveguide and the designed projection optics achieves the field of 24°×15° and the eye box of 80 mm×80 mm.
Collapse
|
18
|
Bleicher ID, Jackson-Atogi M, Viehland C, Gabr H, Izatt JA, Toth CA. Depth-Based, Motion-Stabilized Colorization of Microscope-Integrated Optical Coherence Tomography Volumes for Microscope-Independent Microsurgery. Transl Vis Sci Technol 2018; 7:1. [PMID: 30405965 PMCID: PMC6218157 DOI: 10.1167/tvst.7.6.1] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2018] [Accepted: 08/29/2018] [Indexed: 01/20/2023] Open
Abstract
Purpose We develop and assess the impact of depth-based, motion-stabilized colorization (color) of microscope-integrated optical coherence tomography (MIOCT) volumes on microsurgical performance and ability to interpret surgical volumes. Methods Color was applied in real-time as gradients indicating axial position and stabilized based on calculated center of mass. In a test comparing colorization versus grayscale visualizations of prerecorded intraoperative volumes from human surgery, ophthalmologists (N = 7) were asked to identify retinal membranes, the presence of an instrument, its contact with tissue, and associated deformation of the retina. In a separate controlled trial, trainees (N = 15) performed microsurgical skills without conventional optical visualization and compared colorized versus grayscale MIOCT visualization on a stereoptic screen. Skills included thickness identification, instrument placement, and object manipulation, and were assessed based on time, performance metrics, and confidence. Results In intraoperative volume testing, colorization improved ability to differentiate membrane from retina (P < 0.01), correctly identify instrument contact with membrane (P = 0.03), and retinal deformation (P = 0.01). In model microsurgical skills testing, trainees working with colorized volumes were faster (P < 0.01) and more correct (P < 0.01) in assessments of thickness for recessed and elevated objects, were less likely to inadvertently contact a surface when approaching with an instrument (P < 0.01), and uniformly more confident (P < 0.01 for each) in conducting each skill. Conclusions Depth-based colorization enables effective identification of retinal membranes and tissue deformation. In microsurgical skill testing, it improves user efficiency, and confidence in microscope-independent, OCT-guided model surgical maneuvers. Translational Relevance Novel depth-based colorization and stabilization technology improves the use of intraoperative MIOCT.
Collapse
Affiliation(s)
- Isaac D Bleicher
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC, USA
| | | | | | - Hesham Gabr
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC, USA.,Department of Ophthalmology, Ain-Shams University, Cairo, Egypt
| | - Joseph A Izatt
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC, USA.,Department of Biomedical Engineering, Duke University, Durham, NC, USA
| | - Cynthia A Toth
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC, USA.,Department of Biomedical Engineering, Duke University, Durham, NC, USA
| |
Collapse
|
19
|
VISUALIZATION FROM INTRAOPERATIVE SWEPT-SOURCE MICROSCOPE-INTEGRATED OPTICAL COHERENCE TOMOGRAPHY IN VITRECTOMY FOR COMPLICATIONS OF PROLIFERATIVE DIABETIC RETINOPATHY. Retina 2018; 38 Suppl 1:S110-S120. [PMID: 29324591 DOI: 10.1097/iae.0000000000002021] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
PURPOSE To evaluate the use of live volumetric (4D) intraoperative swept-source microscope-integrated optical coherence tomography in vitrectomy for proliferative diabetic retinopathy complications. METHODS In this prospective study, we analyzed a subgroup of patients with proliferative diabetic retinopathy complications who required vitrectomy and who were imaged by the research swept-source microscope-integrated optical coherence tomography system. In near real time, images were displayed in stereo heads-up display facilitating intraoperative surgeon feedback. Postoperative review included scoring image quality, identifying different diabetic retinopathy-associated pathologies and reviewing the intraoperatively documented surgeon feedback. RESULTS Twenty eyes were included. Indications for vitrectomy were tractional retinal detachment (16 eyes), combined tractional-rhegmatogenous retinal detachment (2 eyes), and vitreous hemorrhage (2 eyes). Useful, good-quality 2D (B-scans) and 4D images were obtained in 16/20 eyes (80%). In these eyes, multiple diabetic retinopathy complications could be imaged. Swept-source microscope-integrated optical coherence tomography provided surgical guidance, e.g., in identifying dissection planes under fibrovascular membranes, and in determining residual membranes and traction that would benefit from additional peeling. In 4/20 eyes (20%), acceptable images were captured, but they were not useful due to high tractional retinal detachment elevation which was challenging for imaging. CONCLUSION Swept-source microscope-integrated optical coherence tomography can provide important guidance during surgery for proliferative diabetic retinopathy complications through intraoperative identification of different complications and facilitation of intraoperative decision making.
Collapse
|
20
|
Draelos M, Keller B, Viehland C, Carrasco-Zevallos OM, Kuo A, Izatt J. Real-time visualization and interaction with static and live optical coherence tomography volumes in immersive virtual reality. BIOMEDICAL OPTICS EXPRESS 2018; 9:2825-2843. [PMID: 30258693 PMCID: PMC6154207 DOI: 10.1364/boe.9.002825] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2018] [Revised: 05/20/2018] [Accepted: 05/22/2018] [Indexed: 05/24/2023]
Abstract
Virtual reality (VR) head-mounted displays are an attractive technology for viewing intrasurgical optical coherence tomography (OCT) volumes because they liberate surgeons from microscope oculars. We demonstrate real-time, interactive viewing of OCT volumes in a commercial HTC Vive immersive VR system using previously reported ray casting techniques. Furthermore, we show interactive manipulation and sectioning of volumes using handheld controllers and guidance of mock surgical procedures in porcine eyes exclusively within VR. To the best of our knowledge, we report the first immersive VR-OCT viewer with stereo ray casting volumetric renders, arbitrary sectioning planes, and live acquisition support. We believe VR-OCT volume displays will advance ophthalmic surgery towards VR-integrated surgery.
Collapse
Affiliation(s)
- Mark Draelos
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
| | - Brenton Keller
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
| | - Christian Viehland
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
| | | | - Anthony Kuo
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
- Department of Ophthalmology, Duke University Medical Center, Durham, NC 27710,
USA
| | - Joseph Izatt
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
- Department of Ophthalmology, Duke University Medical Center, Durham, NC 27710,
USA
| |
Collapse
|
21
|
Keller B, Draelos M, Tang G, Farsiu S, Kuo AN, Hauser K, Izatt JA. Real-time corneal segmentation and 3D needle tracking in intrasurgical OCT. BIOMEDICAL OPTICS EXPRESS 2018; 9:2716-2732. [PMID: 30258685 PMCID: PMC6154196 DOI: 10.1364/boe.9.002716] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/04/2018] [Revised: 05/08/2018] [Accepted: 05/10/2018] [Indexed: 05/09/2023]
Abstract
Ophthalmic procedures demand precise surgical instrument control in depth, yet standard operating microscopes supply limited depth perception. Current commercial microscope-integrated optical coherence tomography partially meets this need with manually-positioned cross-sectional images that offer qualitative estimates of depth. In this work, we present methods for automatic quantitative depth measurement using real-time, two-surface corneal segmentation and needle tracking in OCT volumes. We then demonstrate these methods for guidance of ex vivo deep anterior lamellar keratoplasty (DALK) needle insertions. Surgeons using the output of these methods improved their ability to reach a target depth, and decreased their incidence of corneal perforations, both with statistical significance. We believe these methods could increase the success rate of DALK and thereby improve patient outcomes.
Collapse
Affiliation(s)
- Brenton Keller
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
| | - Mark Draelos
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
| | - Gao Tang
- Department of Mechanical Engineering, Duke University, Durham, NC 27708,
USA
| | - Sina Farsiu
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
- Department of Ophthalmology, Duke University Medical Center, Durham NC 27710,
USA
| | - Anthony N. Kuo
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
- Department of Ophthalmology, Duke University Medical Center, Durham NC 27710,
USA
| | - Kris Hauser
- Department of Electrical and Computer Engineering, Duke University, Durham, NC 27701,
USA
| | - Joseph A. Izatt
- Department of Ophthalmology, Duke University Medical Center, Durham NC 27710,
USA
| |
Collapse
|
22
|
Real-Time Volumetric Imaging of Vitreoretinal Surgery with a Prototype Microscope-Integrated Swept-Source OCT Device. ACTA ACUST UNITED AC 2018; 2:401-410. [DOI: 10.1016/j.oret.2017.08.023] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2017] [Revised: 08/24/2017] [Accepted: 08/28/2017] [Indexed: 11/21/2022]
|
23
|
Yoon JW, Chen RE, Kim EJ, Akinduro OO, Kerezoudis P, Han PK, Si P, Freeman WD, Diaz RJ, Komotar RJ, Pirris SM, Brown BL, Bydon M, Wang MY, Wharen RE, Quinones-Hinojosa A. Augmented reality for the surgeon: Systematic review. Int J Med Robot 2018; 14:e1914. [DOI: 10.1002/rcs.1914] [Citation(s) in RCA: 88] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2017] [Revised: 03/19/2018] [Accepted: 03/20/2018] [Indexed: 11/06/2022]
Affiliation(s)
- Jang W. Yoon
- Department of Neurological Surgery; Mayo Clinic; Jacksonville Florida USA
| | - Robert E. Chen
- Emory University School of Medicine; Atlanta Georgia USA
- Georgia Institute of Technology; Atlanta Georgia USA
| | | | | | | | | | - Phong Si
- Georgia Institute of Technology; Atlanta Georgia USA
| | | | - Roberto J. Diaz
- Department of Neurosurgery and Neurology; Montreal Neurological Institute and Hospital, McGill University; Montreal Quebec Canada
| | - Ricardo J. Komotar
- Department of Neurological Surgery; University of Miami Miller School of Medicine, University of Miami Hospital, University of Miami Brain Tumor Initiative; Miami Florida USA
| | - Stephen M. Pirris
- Department of Neurological Surgery; Mayo Clinic; Jacksonville Florida USA
- St. Vincent's Spine and Brain Institute; Jacksonville Florida USA
| | - Benjamin L. Brown
- Department of Neurological Surgery; Mayo Clinic; Jacksonville Florida USA
| | - Mohamad Bydon
- Department of Neurological Surgery; Mayo Clinic; Rochester Minnesota USA
| | - Michael Y. Wang
- Department of Neurological Surgery; University of Miami Miller School of Medicine, University of Miami Hospital, University of Miami Brain Tumor Initiative; Miami Florida USA
| | - Robert E. Wharen
- Department of Neurological Surgery; Mayo Clinic; Jacksonville Florida USA
| | | |
Collapse
|
24
|
Cernichiaro-Espinosa LA, Tran KD, Berrocal AM. Imaging Modalities in Pediatric Vitreoretinal Disorders. CURRENT OPHTHALMOLOGY REPORTS 2018. [DOI: 10.1007/s40135-018-0159-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
25
|
Uchida A, Srivastava SK, Ehlers JP. Update on the Intraoperative OCT: Where Do We Stand? CURRENT OPHTHALMOLOGY REPORTS 2018. [DOI: 10.1007/s40135-018-0160-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
|
26
|
El-Haddad MT, Tao YK. Advances in intraoperative optical coherence tomography for surgical guidance. CURRENT OPINION IN BIOMEDICAL ENGINEERING 2017. [DOI: 10.1016/j.cobme.2017.09.007] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
|
27
|
Bhullar PK, Carrasco-Zevallos OM, Dandridge A, Pasricha ND, Keller B, Shen L, Izatt JA, Toth CA, Kuo AN. Intraocular Pressure and Big Bubble Diameter in Deep Anterior Lamellar Keratoplasty: An Ex-Vivo Microscope-Integrated OCT With Heads-Up Display Study. Asia Pac J Ophthalmol (Phila) 2017; 6:412-417. [PMID: 28930381 PMCID: PMC5658009 DOI: 10.22608/apo.2017265] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2017] [Accepted: 09/06/2017] [Indexed: 11/08/2022] Open
Abstract
PURPOSE To investigate the relationship between intraocular pressure (IOP) and big bubble (BB) formation in a model of deep anterior lamellar keratoplasty (DALK). DESIGN Ex-vivo. METHODS Corneoscleral buttons from human donors were loaded onto an artificial anterior chamber connected to a column of balanced salt solution. A surgeon-in-training learned to perform DALK via the BB technique using swept-source microscope-integrated optical coherence tomography (SS-MIOCT) with heads-up display (HUD). DALK procedures were performed at 6 different IOPs (5, 10, 15, 20, 30, or 40 mm Hg; n = 6 per group) in a randomized fashion, with the surgeon-in-training masked to the pressure and guided by SS-MIOCT with HUD. For a subset of corneas within each pressure group, DALK was performed on matching donor tissue at a control IOP. BB diameter was recorded, and a diameter exceeding the trephine diameter was considered optimal. RESULTS Wilcoxon rank sum test showed a difference in BB diameter among the different pressure groups (mean ± SD of 7.75 ± 1.60, 8.33 ± 1.99, 10.9 ± 0.92, 9.08 ± 1.07, 6.67 ± 3.33, and 3.42 ± 3.77 mm in the 5, 10, 15, 20, 30, and 40 mm Hg groups, respectively; P = 0.0014). Per Tukey test, this difference was attributable to comparisons between the 40 mm Hg group and the 5, 10, 15, or 20 mm Hg groups (P = 0.04, 0.02, 0.0001, 0.004, respectively). CONCLUSIONS In this ex-vivo model of DALK, the BB technique guided by SS-MIOCT with HUD yielded bubbles of optimal diameters only at physiologic pressures (10‒20 mm Hg). Extremely high IOP (40 mm Hg) resulted in BBs of significantly smaller diameter than BBs obtained at physiologic and low (5 mm Hg) IOPs.
Collapse
Affiliation(s)
- Paramjit K Bhullar
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC
| | | | | | - Neel D Pasricha
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC
| | - Brenton Keller
- Department of Biomedical Engineering, Duke University, Durham, NC
| | - Liangbo Shen
- Department of Biomedical Engineering, Duke University, Durham, NC
| | - Joseph A Izatt
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC
- Department of Biomedical Engineering, Duke University, Durham, NC
| | - Cynthia A Toth
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC
- Department of Biomedical Engineering, Duke University, Durham, NC
| | - Anthony N Kuo
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC
- Department of Biomedical Engineering, Duke University, Durham, NC
| |
Collapse
|
28
|
Carrasco-Zevallos OM, Keller B, Viehland C, Shen L, Seider MI, Izatt JA, Toth CA. Optical Coherence Tomography for Retinal Surgery: Perioperative Analysis to Real-Time Four-Dimensional Image-Guided Surgery. Invest Ophthalmol Vis Sci 2017; 57:OCT37-50. [PMID: 27409495 PMCID: PMC4968921 DOI: 10.1167/iovs.16-19277] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023] Open
Abstract
Magnification of the surgical field using the operating microscope facilitated profound innovations in retinal surgery in the 1970s, such as pars plana vitrectomy. Although surgical instrumentation and illumination techniques are continually developing, the operating microscope for vitreoretinal procedures has remained essentially unchanged and currently limits the surgeon's depth perception and assessment of subtle microanatomy. Optical coherence tomography (OCT) has revolutionized clinical management of retinal pathology, and its introduction into the operating suite may have a similar impact on surgical visualization and treatment. In this article, we review the evolution of OCT for retinal surgery, from perioperative analysis to live volumetric (four-dimensional, 4D) image-guided surgery. We begin by briefly addressing the benefits and limitations of the operating microscope, the progression of OCT technology, and OCT applications in clinical/perioperative retinal imaging. Next, we review intraoperative OCT (iOCT) applications using handheld probes during surgical pauses, two-dimensional (2D) microscope-integrated OCT (MIOCT) of live surgery, and volumetric MIOCT of live surgery. The iOCT discussion focuses on technological advancements, applications during human retinal surgery, translational difficulties and limitations, and future directions.
Collapse
Affiliation(s)
| | - Brenton Keller
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, United States
| | - Christian Viehland
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, United States
| | - Liangbo Shen
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, United States
| | - Michael I Seider
- Department of Ophthalmology, Duke University Medical Center, Durham, North Carolina, United States
| | - Joseph A Izatt
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, United States 2Department of Ophthalmology, Duke University Medical Center, Durham, North Carolina, United States
| | - Cynthia A Toth
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, United States 2Department of Ophthalmology, Duke University Medical Center, Durham, North Carolina, United States
| |
Collapse
|
29
|
Carrasco-Zevallos OM, Viehland C, Keller B, Draelos M, Kuo AN, Toth CA, Izatt JA. Review of intraoperative optical coherence tomography: technology and applications [Invited]. BIOMEDICAL OPTICS EXPRESS 2017; 8:1607-1637. [PMID: 28663853 PMCID: PMC5480568 DOI: 10.1364/boe.8.001607] [Citation(s) in RCA: 89] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2016] [Revised: 02/09/2017] [Accepted: 02/09/2017] [Indexed: 05/19/2023]
Abstract
During microsurgery, en face imaging of the surgical field through the operating microscope limits the surgeon's depth perception and visualization of instruments and sub-surface anatomy. Surgical procedures outside microsurgery, such as breast tumor resections, may also benefit from visualization of the sub-surface tissue structures. The widespread clinical adoption of optical coherence tomography (OCT) in ophthalmology and its growing prominence in other fields, such as cancer imaging, has motivated the development of intraoperative OCT for real-time tomographic visualization of surgical interventions. This article reviews key technological developments in intraoperative OCT and their applications in human surgery. We focus on handheld OCT probes, microscope-integrated OCT systems, and OCT-guided laser treatment platforms designed for intraoperative use. Moreover, we discuss intraoperative OCT adjuncts and processing techniques currently under development to optimize the surgical feedback derivable from OCT data. Lastly, we survey salient clinical studies of intraoperative OCT for human surgery.
Collapse
Affiliation(s)
| | - Christian Viehland
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Brenton Keller
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Mark Draelos
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Anthony N. Kuo
- Department of Ophthalmology, Duke University Medical Center, NC 27710, USA
| | - Cynthia A. Toth
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
- Department of Ophthalmology, Duke University Medical Center, NC 27710, USA
| | - Joseph A. Izatt
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
- Department of Ophthalmology, Duke University Medical Center, NC 27710, USA
| |
Collapse
|
30
|
Pasricha ND, Bhullar PK, Shieh C, Carrasco-Zevallos OM, Keller B, Izatt JA, Toth CA, Freedman SF, Kuo AN. Four-dimensional Microscope-Integrated Optical Coherence Tomography to Visualize Suture Depth in Strabismus Surgery. J Pediatr Ophthalmol Strabismus 2017; 54:e1-e5. [PMID: 28196266 PMCID: PMC5963505 DOI: 10.3928/01913913-20170201-01] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/27/2016] [Accepted: 08/29/2016] [Indexed: 11/20/2022]
Abstract
The authors report the use of swept-source microscope-integrated optical coherence tomography (SS-MIOCT), capable of live four-dimensional (three-dimensional across time) intraoperative imaging, to directly visualize suture depth during lateral rectus resection. Key surgical steps visualized in this report included needle depth during partial and full-thickness muscle passes along with scleral passes. [J Pediatr Ophthalmol Strabismus. 2017;54:e1-e5.].
Collapse
Affiliation(s)
- Neel D. Pasricha
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC, USA
| | - Paramjit K. Bhullar
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC, USA
| | - Christine Shieh
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC, USA
| | | | - Brenton Keller
- Department of Biomedical Engineering, Duke University, Durham, NC, USA
| | - Joseph A. Izatt
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC, USA
- Department of Biomedical Engineering, Duke University, Durham, NC, USA
| | - Cynthia A. Toth
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC, USA
- Department of Biomedical Engineering, Duke University, Durham, NC, USA
| | - Sharon F. Freedman
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC, USA
| | - Anthony N. Kuo
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC, USA
| |
Collapse
|
31
|
Abstract
PURPOSE OF REVIEW To explore the clinical utility of intraoperative optical coherence tomography (iOCT) for the management of vitreoretinal conditions. RECENT FINDINGS The role of iOCT in guiding surgical decision-making and surgical manipulations during vitreoretinal procedures has been evaluated by multiple studies. This imaging modality is emerging as a valuable asset during procedures for vitreoretinal interface disorders, retinal detachments, submacular surgeries and therapeutics, and in pediatric conditions such as retinopathy of prematurity. iOCT allows the surgeon to assess completion of surgical goals and to directly monitor the architectural impact of instrument-tissue interactions that may correlate with eventual prognosis. The technology has gone through numerous iterations with the eventual goal being the development of a user-friendly, efficient, and integrated system that provides surgeons with 'real-time' feedback during ophthalmic surgeries to allow for a comprehensive image-assisted vitreoretinal surgery platform. SUMMARY The role of iOCT in ophthalmic surgery has been evolving with the help of ongoing research to define its utility in the operating room and to develop integrative technologies. Advancements in OCT-friendly surgical instrumentation and in integrative capabilities of this technology may help achieve more widespread adoption of this technology in the vitreoretinal surgical theater. Although the evidence appears clear that this technology impacts surgical decision-making, additional research is needed. However, further research is needed to determine the influence of this technology on overall patient outcomes.
Collapse
|
32
|
Live volumetric (4D) visualization and guidance of in vivo human ophthalmic surgery with intraoperative optical coherence tomography. Sci Rep 2016; 6:31689. [PMID: 27538478 PMCID: PMC4990849 DOI: 10.1038/srep31689] [Citation(s) in RCA: 77] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2016] [Accepted: 07/25/2016] [Indexed: 02/07/2023] Open
Abstract
Minimally-invasive microsurgery has resulted in improved outcomes for patients. However, operating through a microscope limits depth perception and fixes the visual perspective, which result in a steep learning curve to achieve microsurgical proficiency. We introduce a surgical imaging system employing four-dimensional (live volumetric imaging through time) microscope-integrated optical coherence tomography (4D MIOCT) capable of imaging at up to 10 volumes per second to visualize human microsurgery. A custom stereoscopic heads-up display provides real-time interactive volumetric feedback to the surgeon. We report that 4D MIOCT enhanced suturing accuracy and control of instrument positioning in mock surgical trials involving 17 ophthalmic surgeons. Additionally, 4D MIOCT imaging was performed in 48 human eye surgeries and was demonstrated to successfully visualize the pathology of interest in concordance with preoperative diagnosis in 93% of retinal surgeries and the surgical site of interest in 100% of anterior segment surgeries. In vivo 4D MIOCT imaging revealed sub-surface pathologic structures and instrument-induced lesions that were invisible through the operating microscope during standard surgical maneuvers. In select cases, 4D MIOCT guidance was necessary to resolve such lesions and prevent post-operative complications. Our novel surgical visualization platform achieves surgeon-interactive 4D visualization of live surgery which could expand the surgeon’s capabilities.
Collapse
|
33
|
Viehland C, Keller B, Carrasco-Zevallos OM, Nankivil D, Shen L, Mangalesh S, Viet DT, Kuo AN, Toth CA, Izatt JA. Enhanced volumetric visualization for real time 4D intraoperative ophthalmic swept-source OCT. BIOMEDICAL OPTICS EXPRESS 2016; 7:1815-29. [PMID: 27231623 PMCID: PMC4871083 DOI: 10.1364/boe.7.001815] [Citation(s) in RCA: 39] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/09/2016] [Revised: 03/30/2016] [Accepted: 03/31/2016] [Indexed: 05/22/2023]
Abstract
Current-generation software for rendering volumetric OCT data sets based on ray casting results in volume visualizations with indistinct tissue features and sub-optimal depth perception. Recent developments in hand-held and microscope-integrated intrasurgical OCT designed for real-time volumetric imaging motivate development of rendering algorithms which are both visually appealing and fast enough to support real time rendering, potentially from multiple viewpoints for stereoscopic visualization. We report on an enhanced, real time, integrated volumetric rendering pipeline which incorporates high performance volumetric median and Gaussian filtering, boundary and feature enhancement, depth encoding, and lighting into a ray casting volume rendering model. We demonstrate this improved model implemented on graphics processing unit (GPU) hardware for real-time volumetric rendering of OCT data during tissue phantom and live human surgical imaging. We show that this rendering produces enhanced 3D visualizations of pathology and intraoperative maneuvers compared to standard ray casting.
Collapse
Affiliation(s)
- Christian Viehland
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Brenton Keller
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | | | - Derek Nankivil
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Liangbo Shen
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Shwetha Mangalesh
- Deparment of Ophthalmology, Duke University Medical Center, Durham NC 27710, USA
| | - Du Tran Viet
- Deparment of Ophthalmology, Duke University Medical Center, Durham NC 27710, USA
| | - Anthony N. Kuo
- Deparment of Ophthalmology, Duke University Medical Center, Durham NC 27710, USA
| | - Cynthia A. Toth
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
- Deparment of Ophthalmology, Duke University Medical Center, Durham NC 27710, USA
| | - Joseph A. Izatt
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
- Deparment of Ophthalmology, Duke University Medical Center, Durham NC 27710, USA
| |
Collapse
|