|
1
|
Draelos M, Keller B, Viehland C, Carrasco-Zevallos OM, Kuo A, Izatt J. Real-time visualization and interaction with static and live optical coherence tomography volumes in immersive virtual reality. BIOMEDICAL OPTICS EXPRESS 2018; 9:2825-2843. [PMID: 30258693 PMCID: PMC6154207 DOI: 10.1364/boe.9.002825] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2018] [Revised: 05/20/2018] [Accepted: 05/22/2018] [Indexed: 05/24/2023]
Abstract
Virtual reality (VR) head-mounted displays are an attractive technology for viewing intrasurgical optical coherence tomography (OCT) volumes because they liberate surgeons from microscope oculars. We demonstrate real-time, interactive viewing of OCT volumes in a commercial HTC Vive immersive VR system using previously reported ray casting techniques. Furthermore, we show interactive manipulation and sectioning of volumes using handheld controllers and guidance of mock surgical procedures in porcine eyes exclusively within VR. To the best of our knowledge, we report the first immersive VR-OCT viewer with stereo ray casting volumetric renders, arbitrary sectioning planes, and live acquisition support. We believe VR-OCT volume displays will advance ophthalmic surgery towards VR-integrated surgery.
Collapse
Affiliation(s)
- Mark Draelos
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
| | - Brenton Keller
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
| | - Christian Viehland
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
| | | | - Anthony Kuo
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
- Department of Ophthalmology, Duke University Medical Center, Durham, NC 27710,
USA
| | - Joseph Izatt
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
- Department of Ophthalmology, Duke University Medical Center, Durham, NC 27710,
USA
| |
Collapse
|
|
2
|
Viehland C, Keller B, Carrasco-Zevallos OM, Nankivil D, Shen L, Mangalesh S, Viet DT, Kuo AN, Toth CA, Izatt JA. Enhanced volumetric visualization for real time 4D intraoperative ophthalmic swept-source OCT. BIOMEDICAL OPTICS EXPRESS 2016; 7:1815-29. [PMID: 27231623 PMCID: PMC4871083 DOI: 10.1364/boe.7.001815] [Citation(s) in RCA: 39] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/09/2016] [Revised: 03/30/2016] [Accepted: 03/31/2016] [Indexed: 05/22/2023]
Abstract
Current-generation software for rendering volumetric OCT data sets based on ray casting results in volume visualizations with indistinct tissue features and sub-optimal depth perception. Recent developments in hand-held and microscope-integrated intrasurgical OCT designed for real-time volumetric imaging motivate development of rendering algorithms which are both visually appealing and fast enough to support real time rendering, potentially from multiple viewpoints for stereoscopic visualization. We report on an enhanced, real time, integrated volumetric rendering pipeline which incorporates high performance volumetric median and Gaussian filtering, boundary and feature enhancement, depth encoding, and lighting into a ray casting volume rendering model. We demonstrate this improved model implemented on graphics processing unit (GPU) hardware for real-time volumetric rendering of OCT data during tissue phantom and live human surgical imaging. We show that this rendering produces enhanced 3D visualizations of pathology and intraoperative maneuvers compared to standard ray casting.
Collapse
Affiliation(s)
- Christian Viehland
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Brenton Keller
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | | | - Derek Nankivil
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Liangbo Shen
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Shwetha Mangalesh
- Deparment of Ophthalmology, Duke University Medical Center, Durham NC 27710, USA
| | - Du Tran Viet
- Deparment of Ophthalmology, Duke University Medical Center, Durham NC 27710, USA
| | - Anthony N. Kuo
- Deparment of Ophthalmology, Duke University Medical Center, Durham NC 27710, USA
| | - Cynthia A. Toth
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
- Deparment of Ophthalmology, Duke University Medical Center, Durham NC 27710, USA
| | - Joseph A. Izatt
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
- Deparment of Ophthalmology, Duke University Medical Center, Durham NC 27710, USA
| |
Collapse
|