1
|
Chen X, Ma Z, Wang C, Cui J, Fan F, Gao X, Zhu J. Motion Artifact Correction for OCT Microvascular Images Based on Image Feature Matching. JOURNAL OF BIOPHOTONICS 2024:e202400198. [PMID: 39198156 DOI: 10.1002/jbio.202400198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/06/2024] [Revised: 06/11/2024] [Accepted: 07/27/2024] [Indexed: 09/01/2024]
Abstract
Optical coherence tomography angiography (OCTA), a functional extension of optical coherence tomography (OCT), is widely employed for high-resolution imaging of microvascular networks. However, due to the relatively low scan rate of OCT, the artifacts caused by the involuntary bulk motion of tissues severely impact the visualization of microvascular networks. This study proposes a fast motion correction method based on image feature matching for OCT microvascular images. First, the rigid motion-related mismatch between B-scans is compensated through the image feature matching based on the improved oriented FAST and rotated BRIEF algorithm. Then, the axial motion within A-scan lines in each B-scan image is corrected according to the displacement deviation between the detected boundaries achieved by the Scharr operator in a non-rigid transformation manner. Finally, an optimized intensity-based Doppler variance algorithm is developed to enhance the robustness of the OCTA imaging. The experimental results demonstrate the effectiveness of the method.
Collapse
Affiliation(s)
- Xudong Chen
- Key Laboratory of the Ministry of Education for Optoelectronic Measurement Technology and Instrument, Beijing Information Science and Technology University, Beijing, China
| | - Zongqing Ma
- Key Laboratory of the Ministry of Education for Optoelectronic Measurement Technology and Instrument, Beijing Information Science and Technology University, Beijing, China
| | - Chongyang Wang
- Key Laboratory of the Ministry of Education for Optoelectronic Measurement Technology and Instrument, Beijing Information Science and Technology University, Beijing, China
| | - Jiaqi Cui
- Key Laboratory of the Ministry of Education for Optoelectronic Measurement Technology and Instrument, Beijing Information Science and Technology University, Beijing, China
| | - Fan Fan
- Key Laboratory of the Ministry of Education for Optoelectronic Measurement Technology and Instrument, Beijing Information Science and Technology University, Beijing, China
| | - Xinxiao Gao
- Beijing Anzhen Hospital, Capital Medical University, Beijing, China
| | - Jiang Zhu
- Key Laboratory of the Ministry of Education for Optoelectronic Measurement Technology and Instrument, Beijing Information Science and Technology University, Beijing, China
| |
Collapse
|
2
|
Zhang X, Zhong H, Wang S, He B, Cao L, Li M, Jiang M, Li Q. Subpixel motion artifacts correction and motion estimation for 3D-OCT. JOURNAL OF BIOPHOTONICS 2024:e202400104. [PMID: 38955360 DOI: 10.1002/jbio.202400104] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Revised: 04/26/2024] [Accepted: 05/14/2024] [Indexed: 07/04/2024]
Abstract
A number of hardware-based and software-based strategies have been suggested to eliminate motion artifacts for improvement of 3D-optical coherence tomography (OCT) image quality. However, the hardware-based strategies have to employ additional hardware to record motion compensation information. Many software-based strategies have to need additional scanning for motion correction at the expense of longer acquisition time. To address this issue, we propose a motion artifacts correction and motion estimation method for OCT volumetric imaging of anterior segment, without requirements of additional hardware and redundant scanning. The motion correction effect with subpixel accuracy for in vivo 3D-OCT has been demonstrated in experiments. Moreover, the physiological information of imaging object, including respiratory curve and respiratory rate, has been experimentally extracted using the proposed method. The proposed method offers a powerful tool for scientific research and clinical diagnosis in ophthalmology and may be further extended for other biomedical volumetric imaging applications.
Collapse
Affiliation(s)
- Xiao Zhang
- School of Medical Technology, Beijing Institute of Technology, Beijing, China
| | - Haozhe Zhong
- School of Medical Technology, Beijing Institute of Technology, Beijing, China
| | - Sainan Wang
- Department of Anesthesiology, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Bin He
- State Key Laboratory of Low-dimensional Quantum Physics and Center for Atomic and Molecular Nanoscience, Department of Physics, Tsinghua University and Collaborative Innovation Center of Quantum Matter, Beijing, China
| | - Liangqi Cao
- School of Medical Technology, Beijing Institute of Technology, Beijing, China
| | - Ming Li
- China-America Institute of Neuroscience and Beijing Institute of Geriatrics, Xuanwu Hospital, Capital Medical University, Beijing, China
| | - Miaowen Jiang
- Beijing Institute for Brain Disorders, Capital Medical University, Beijing, China
| | - Qin Li
- School of Medical Technology, Beijing Institute of Technology, Beijing, China
| |
Collapse
|
3
|
Wijesingha N, Tsai WS, Keskin AM, Holmes C, Kazantzis D, Chandak S, Kubravi H, Sivaprasad S. Optical Coherence Tomography Angiography as a Diagnostic Tool for Diabetic Retinopathy. Diagnostics (Basel) 2024; 14:326. [PMID: 38337841 PMCID: PMC10855126 DOI: 10.3390/diagnostics14030326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2024] [Revised: 01/29/2024] [Accepted: 01/29/2024] [Indexed: 02/12/2024] Open
Abstract
Diabetic retinopathy (DR) is the most common microvascular complication of diabetes mellitus, leading to visual impairment if left untreated. This review discusses the use of optical coherence tomography angiography (OCTA) as a diagnostic tool for the early detection and management of DR. OCTA is a fast, non-invasive, non-contact test that enables the detailed visualisation of the macular microvasculature in different plexuses. OCTA offers several advantages over fundus fluorescein angiography (FFA), notably offering quantitative data. OCTA is not without limitations, including the requirement for careful interpretation of artefacts and the limited region of interest that can be captured currently. We explore how OCTA has been instrumental in detecting early microvascular changes that precede clinical signs of DR. We also discuss the application of OCTA in the diagnosis and management of various stages of DR, including non-proliferative diabetic retinopathy (NPDR), proliferative diabetic retinopathy (PDR), diabetic macular oedema (DMO), diabetic macular ischaemia (DMI), and pre-diabetes. Finally, we discuss the future role of OCTA and how it may be used to enhance the clinical outcomes of DR.
Collapse
Affiliation(s)
- Naomi Wijesingha
- UCL Institute of Ophthalmology, London EC1V 9EL, UK;
- Moorfields Eye Hospital, London EC1V 2PD, UK; (W.-S.T.); (A.M.K.); (C.H.); (D.K.); (S.C.); (H.K.)
| | - Wei-Shan Tsai
- Moorfields Eye Hospital, London EC1V 2PD, UK; (W.-S.T.); (A.M.K.); (C.H.); (D.K.); (S.C.); (H.K.)
| | - Ayse Merve Keskin
- Moorfields Eye Hospital, London EC1V 2PD, UK; (W.-S.T.); (A.M.K.); (C.H.); (D.K.); (S.C.); (H.K.)
| | - Christopher Holmes
- Moorfields Eye Hospital, London EC1V 2PD, UK; (W.-S.T.); (A.M.K.); (C.H.); (D.K.); (S.C.); (H.K.)
| | - Dimitrios Kazantzis
- Moorfields Eye Hospital, London EC1V 2PD, UK; (W.-S.T.); (A.M.K.); (C.H.); (D.K.); (S.C.); (H.K.)
| | - Swati Chandak
- Moorfields Eye Hospital, London EC1V 2PD, UK; (W.-S.T.); (A.M.K.); (C.H.); (D.K.); (S.C.); (H.K.)
| | - Heena Kubravi
- Moorfields Eye Hospital, London EC1V 2PD, UK; (W.-S.T.); (A.M.K.); (C.H.); (D.K.); (S.C.); (H.K.)
| | - Sobha Sivaprasad
- UCL Institute of Ophthalmology, London EC1V 9EL, UK;
- Moorfields Eye Hospital, London EC1V 2PD, UK; (W.-S.T.); (A.M.K.); (C.H.); (D.K.); (S.C.); (H.K.)
| |
Collapse
|
4
|
Liu R, Wang X, Hoshi S, Zhang Y. Substrip-based registration and automatic montaging of adaptive optics retinal images. BIOMEDICAL OPTICS EXPRESS 2024; 15:1311-1330. [PMID: 38404341 PMCID: PMC10890855 DOI: 10.1364/boe.514447] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Revised: 01/22/2024] [Accepted: 01/24/2024] [Indexed: 02/27/2024]
Abstract
Precise registration and montage are critical for high-resolution adaptive optics retinal image analysis but are challenged by rapid eye movement. We present a substrip-based method to improve image registration and facilitate the automatic montaging of adaptive optics scanning laser ophthalmoscopy (AOSLO). The program first batches the consecutive images into groups based on a translation threshold and selects an image with minimal distortion within each group as the reference. Within each group, the software divides each image into multiple strips and calculates the Normalized Cross-Correlation with the reference frame using two substrips at both ends of the whole strip to estimate the strip translation, producing a registered image. Then, the software aligns the registered images of all groups also using a substrip based registration, thereby generating a montage with cell-for-cell precision in the overlapping areas of adjacent frames. The algorithm was evaluated with AOSLO images acquired in human subjects with normal macular health and patients with age-related macular degeneration (AMD). Images with a motion amplitude of up to 448 pixels in the fast scanner direction over a frame of 512 × 512 pixels can be precisely registered. Automatic montage spanning up to 22.6 degrees on the retina was achieved on a cell-to-cell precision with a low misplacement rate of 0.07% (11/16,501 frames) in normal eyes and 0.51% (149/29,051 frames) in eyes with AMD. Substrip based registration significantly improved AOSLO registration accuracy.
Collapse
Affiliation(s)
- Ruixue Liu
- Doheny Eye Institute, Pasadena, CA 91103, USA
| | | | - Sujin Hoshi
- Doheny Eye Institute, Pasadena, CA 91103, USA
- Department of Ophthalmology, University of California - Los Angeles, Los Angeles, CA 90024, USA
- Department of Ophthalmology, University of Tsukuba, Ibaraki, Japan
| | - Yuhua Zhang
- Doheny Eye Institute, Pasadena, CA 91103, USA
- Department of Ophthalmology, University of California - Los Angeles, Los Angeles, CA 90024, USA
| |
Collapse
|
5
|
Ebrahimi SM, Tuunanen J, Saarela V, Honkamo M, Huotari N, Raitamaa L, Korhonen V, Helakari H, Järvelä M, Kaakinen M, Eklund L, Kiviniemi V. Synchronous functional magnetic resonance eye imaging, video ophthalmoscopy, and eye surface imaging reveal the human brain and eye pulsation mechanisms. Sci Rep 2024; 14:2250. [PMID: 38278832 PMCID: PMC10817967 DOI: 10.1038/s41598-023-51069-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Accepted: 12/30/2023] [Indexed: 01/28/2024] Open
Abstract
The eye possesses a paravascular solute transport pathway that is driven by physiological pulsations, resembling the brain glymphatic pathway. We developed synchronous multimodal imaging tools aimed at measuring the driving pulsations of the human eye, using an eye-tracking functional eye camera (FEC) compatible with magnetic resonance imaging (MRI) for measuring eye surface pulsations. Special optics enabled integration of the FEC with MRI-compatible video ophthalmoscopy (MRcVO) for simultaneous retinal imaging along with functional eye MRI imaging (fMREye) of the BOLD (blood oxygen level dependent) contrast. Upon optimizing the fMREye parameters, we measured the power of the physiological (vasomotor, respiratory, and cardiac) eye and brain pulsations by fast Fourier transform (FFT) power analysis. The human eye pulsated in all three physiological pulse bands, most prominently in the respiratory band. The FFT power means of physiological pulsation for two adjacent slices was significantly higher than in one-slice scans (RESP1 vs. RESP2; df = 5, p = 0.045). FEC and MRcVO confirmed the respiratory pulsations at the eye surface and retina. We conclude that in addition to the known cardiovascular pulsation, the human eye also has respiratory and vasomotor pulsation mechanisms, which are now amenable to study using non-invasive multimodal imaging of eye fluidics.
Collapse
Affiliation(s)
- Seyed-Mohsen Ebrahimi
- Oulu Functional NeuroImaging (OFNI), Diagnostic Imaging, Medical Research Center (MRC), Finland Oulu University Hospital, 90029, Oulu, Finland.
- Research Unit of Health Sciences and Technology (HST), Faculty of Medicine, University of Oulu, 90220, Oulu, Finland.
| | - Johanna Tuunanen
- Oulu Functional NeuroImaging (OFNI), Diagnostic Imaging, Medical Research Center (MRC), Finland Oulu University Hospital, 90029, Oulu, Finland
- Research Unit of Health Sciences and Technology (HST), Faculty of Medicine, University of Oulu, 90220, Oulu, Finland
| | - Ville Saarela
- Department of Ophthalmology and Medical Research Center, Oulu University Hospital and Research Unit of Clinical Medicine, University of Oulu, Oulu, Finland
| | - Marja Honkamo
- Department of Ophthalmology and Medical Research Center, Oulu University Hospital and Research Unit of Clinical Medicine, University of Oulu, Oulu, Finland
| | - Niko Huotari
- Oulu Functional NeuroImaging (OFNI), Diagnostic Imaging, Medical Research Center (MRC), Finland Oulu University Hospital, 90029, Oulu, Finland
- Research Unit of Health Sciences and Technology (HST), Faculty of Medicine, University of Oulu, 90220, Oulu, Finland
| | - Lauri Raitamaa
- Oulu Functional NeuroImaging (OFNI), Diagnostic Imaging, Medical Research Center (MRC), Finland Oulu University Hospital, 90029, Oulu, Finland
- Research Unit of Health Sciences and Technology (HST), Faculty of Medicine, University of Oulu, 90220, Oulu, Finland
| | - Vesa Korhonen
- Oulu Functional NeuroImaging (OFNI), Diagnostic Imaging, Medical Research Center (MRC), Finland Oulu University Hospital, 90029, Oulu, Finland
- Research Unit of Health Sciences and Technology (HST), Faculty of Medicine, University of Oulu, 90220, Oulu, Finland
| | - Heta Helakari
- Oulu Functional NeuroImaging (OFNI), Diagnostic Imaging, Medical Research Center (MRC), Finland Oulu University Hospital, 90029, Oulu, Finland
- Research Unit of Health Sciences and Technology (HST), Faculty of Medicine, University of Oulu, 90220, Oulu, Finland
| | - Matti Järvelä
- Oulu Functional NeuroImaging (OFNI), Diagnostic Imaging, Medical Research Center (MRC), Finland Oulu University Hospital, 90029, Oulu, Finland
- Research Unit of Health Sciences and Technology (HST), Faculty of Medicine, University of Oulu, 90220, Oulu, Finland
| | - Mika Kaakinen
- Oulu Center for Cell-Matrix Research, Faculty of Biochemistry and Molecular Medicine, Biocenter Oulu, University of Oulu, Oulu, Finland
| | - Lauri Eklund
- Oulu Center for Cell-Matrix Research, Faculty of Biochemistry and Molecular Medicine, Biocenter Oulu, University of Oulu, Oulu, Finland
| | - Vesa Kiviniemi
- Oulu Functional NeuroImaging (OFNI), Diagnostic Imaging, Medical Research Center (MRC), Finland Oulu University Hospital, 90029, Oulu, Finland.
- Research Unit of Health Sciences and Technology (HST), Faculty of Medicine, University of Oulu, 90220, Oulu, Finland.
- Oulu Center for Cell-Matrix Research, Faculty of Biochemistry and Molecular Medicine, Biocenter Oulu, University of Oulu, Oulu, Finland.
| |
Collapse
|
6
|
Liu H, Wei D, Lu D, Tang X, Wang L, Zheng Y. Simultaneous alignment and surface regression using hybrid 2D-3D networks for 3D coherent layer segmentation of retinal OCT images with full and sparse annotations. Med Image Anal 2024; 91:103019. [PMID: 37944431 DOI: 10.1016/j.media.2023.103019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 08/28/2023] [Accepted: 10/31/2023] [Indexed: 11/12/2023]
Abstract
Layer segmentation is important to quantitative analysis of retinal optical coherence tomography (OCT). Recently, deep learning based methods have been developed to automate this task and yield remarkable performance. However, due to the large spatial gap and potential mismatch between the B-scans of an OCT volume, all of them were based on 2D segmentation of individual B-scans, which may lose the continuity and diagnostic information of the retinal layers in 3D space. Besides, most of these methods required dense annotation of the OCT volumes, which is labor-intensive and expertise-demanding. This work presents a novel framework based on hybrid 2D-3D convolutional neural networks (CNNs) to obtain continuous 3D retinal layer surfaces from OCT volumes, which works well with both full and sparse annotations. The 2D features of individual B-scans are extracted by an encoder consisting of 2D convolutions. These 2D features are then used to produce the alignment displacement vectors and layer segmentation by two 3D decoders coupled via a spatial transformer module. Two losses are proposed to utilize the retinal layers' natural property of being smooth for B-scan alignment and layer segmentation, respectively, and are the key to the semi-supervised learning with sparse annotation. The entire framework is trained end-to-end. To the best of our knowledge, this is the first work that attempts 3D retinal layer segmentation in volumetric OCT images based on CNNs. Experiments on a synthetic dataset and three public clinical datasets show that our framework can effectively align the B-scans for potential motion correction, and achieves superior performance to state-of-the-art 2D deep learning methods in terms of both layer segmentation accuracy and cross-B-scan 3D continuity in both fully and semi-supervised settings, thus offering more clinical values than previous works.
Collapse
Affiliation(s)
- Hong Liu
- School of Informatics, Xiamen University, Xiamen 361005, China; National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen 361005, China; Jarvis Research Center, Tencent YouTu Lab, Shenzhen 518075, China
| | - Dong Wei
- Jarvis Research Center, Tencent YouTu Lab, Shenzhen 518075, China
| | - Donghuan Lu
- Jarvis Research Center, Tencent YouTu Lab, Shenzhen 518075, China
| | - Xiaoying Tang
- Department of Electronic and Electrical Engineering, Southern University of Science and Technology, Shenzhen 518055, China
| | - Liansheng Wang
- School of Informatics, Xiamen University, Xiamen 361005, China.
| | - Yefeng Zheng
- Jarvis Research Center, Tencent YouTu Lab, Shenzhen 518075, China
| |
Collapse
|
7
|
Hao S, Amaral MM, Zhou C. High dynamic range 3D motion tracking using circular scans with optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2023; 14:3881-3898. [PMID: 37799687 PMCID: PMC10549755 DOI: 10.1364/boe.493725] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Revised: 06/21/2023] [Accepted: 06/21/2023] [Indexed: 10/07/2023]
Abstract
Motion artifacts, from such sources as heartbeats, respiration, or peristalsis, often degrade microscopic images or videos of live subjects. We have developed a method using circular optical coherence tomography (OCT) scans to track the transverse and axial motion of biological samples at speeds ranging from several micrometers per second to several centimeters per second. We achieve fast and high-precision measurements of the magnitude and direction of the sample's motion by adaptively controlling the circular scan pattern settings and applying interframe and intraframe analyses. These measurements are the basis of active motion compensation via feedback control for future in vivo microscopic and macroscopic imaging applications.
Collapse
Affiliation(s)
- Senyue Hao
- Department of Electrical & Systems Engineering,
Washington University in Saint Louis, USA
| | - Marcello Magri Amaral
- Department of Biomedical Engineering, Washington University in Saint Louis, USA
- Biomedical Engineering, Universidade Brasil, Brazil
| | - Chao Zhou
- Department of Electrical & Systems Engineering,
Washington University in Saint Louis, USA
- Department of Biomedical Engineering, Washington University in Saint Louis, USA
| |
Collapse
|
8
|
Mozaffari S, Feroldi F, LaRocca F, Tiruveedhula P, Gregory PD, Park BH, Roorda A. Retinal imaging using adaptive optics optical coherence tomography with fast and accurate real-time tracking. BIOMEDICAL OPTICS EXPRESS 2022; 13:5909-5925. [PMID: 36733754 PMCID: PMC9872892 DOI: 10.1364/boe.467634] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 08/11/2022] [Accepted: 10/04/2022] [Indexed: 05/02/2023]
Abstract
One of the main obstacles in high-resolution 3-D retinal imaging is eye motion, which causes blur and distortion artifacts that require extensive post-processing to be corrected. Here, an adaptive optics optical coherence tomography (AOOCT) system with real-time active eye motion correction is presented. Correction of ocular aberrations and of retinal motion is provided by an adaptive optics scanning laser ophthalmoscope (AOSLO) that is optically and electronically combined with the AOOCT system. We describe the system design and quantify its performance. The AOOCT system features an independent focus adjustment that allows focusing on different retinal layers while maintaining the AOSLO focus on the photoreceptor mosaic for high fidelity active motion correction. The use of a high-quality reference frame for eye tracking increases revisitation accuracy between successive imaging sessions, allowing to collect several volumes from the same area. This system enables spatially targeted retinal imaging as well as volume averaging over multiple imaging sessions with minimal correction of motion in post processing.
Collapse
Affiliation(s)
- Sanam Mozaffari
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Fabio Feroldi
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Francesco LaRocca
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Pavan Tiruveedhula
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Patrick D. Gregory
- Department of Bioengineering, University of California, Riverside, CA 92521, USA
| | - B. Hyle Park
- Department of Bioengineering, University of California, Riverside, CA 92521, USA
| | - Austin Roorda
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, Berkeley, CA 94720, USA
| |
Collapse
|
9
|
Alexopoulos P, Madu C, Wollstein G, Schuman JS. The Development and Clinical Application of Innovative Optical Ophthalmic Imaging Techniques. Front Med (Lausanne) 2022; 9:891369. [PMID: 35847772 PMCID: PMC9279625 DOI: 10.3389/fmed.2022.891369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Accepted: 05/23/2022] [Indexed: 11/22/2022] Open
Abstract
The field of ophthalmic imaging has grown substantially over the last years. Massive improvements in image processing and computer hardware have allowed the emergence of multiple imaging techniques of the eye that can transform patient care. The purpose of this review is to describe the most recent advances in eye imaging and explain how new technologies and imaging methods can be utilized in a clinical setting. The introduction of optical coherence tomography (OCT) was a revolution in eye imaging and has since become the standard of care for a plethora of conditions. Its most recent iterations, OCT angiography, and visible light OCT, as well as imaging modalities, such as fluorescent lifetime imaging ophthalmoscopy, would allow a more thorough evaluation of patients and provide additional information on disease processes. Toward that goal, the application of adaptive optics (AO) and full-field scanning to a variety of eye imaging techniques has further allowed the histologic study of single cells in the retina and anterior segment. Toward the goal of remote eye care and more accessible eye imaging, methods such as handheld OCT devices and imaging through smartphones, have emerged. Finally, incorporating artificial intelligence (AI) in eye images has the potential to become a new milestone for eye imaging while also contributing in social aspects of eye care.
Collapse
Affiliation(s)
- Palaiologos Alexopoulos
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
| | - Chisom Madu
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
| | - Gadi Wollstein
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
- Department of Biomedical Engineering, NYU Tandon School of Engineering, Brooklyn, NY, United States
- Center for Neural Science, College of Arts & Science, New York University, New York, NY, United States
| | - Joel S. Schuman
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
- Department of Biomedical Engineering, NYU Tandon School of Engineering, Brooklyn, NY, United States
- Center for Neural Science, College of Arts & Science, New York University, New York, NY, United States
- Department of Electrical and Computer Engineering, NYU Tandon School of Engineering, Brooklyn, NY, United States
| |
Collapse
|
10
|
Multi-modal and multi-scale clinical retinal imaging system with pupil and retinal tracking. Sci Rep 2022; 12:9577. [PMID: 35688890 PMCID: PMC9187716 DOI: 10.1038/s41598-022-13631-1] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2021] [Accepted: 05/17/2022] [Indexed: 11/08/2022] Open
Abstract
We present a compact multi-modal and multi-scale retinal imaging instrument with an angiographic functional extension for clinical use. The system integrates scanning laser ophthalmoscopy (SLO), optical coherence tomography (OCT) and OCT angiography (OCTA) imaging modalities and provides multi-scale fields of view. For high resolution, and high lateral resolution in particular, cellular imaging correction of aberrations by adaptive optics (AO) is employed. The entire instrument has a compact design and the scanning head is mounted on motorized translation stages that enable 3D self-alignment with respect to the subject's eye by tracking the pupil position. Retinal tracking, based on the information provided by SLO, is incorporated in the instrument to compensate for retinal motion during OCT imaging. The imaging capabilities of the multi-modal and multi-scale instrument were tested by imaging healthy volunteers and patients.
Collapse
|
11
|
Zuo R, Irsch K, Kang JU. Higher-order regression three-dimensional motion-compensation method for real-time optical coherence tomography volumetric imaging of the cornea. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:JBO-210383GRR. [PMID: 35751143 PMCID: PMC9232272 DOI: 10.1117/1.jbo.27.6.066006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Accepted: 06/08/2022] [Indexed: 06/15/2023]
Abstract
SIGNIFICANCE Optical coherence tomography (OCT) allows high-resolution volumetric three-dimensional (3D) imaging of biological tissues in vivo. However, 3D-image acquisition can be time-consuming and often suffers from motion artifacts due to involuntary and physiological movements of the tissue, limiting the reproducibility of quantitative measurements. AIM To achieve real-time 3D motion compensation for corneal tissue with high accuracy. APPROACH We propose an OCT system for volumetric imaging of the cornea, capable of compensating both axial and lateral motion with micron-scale accuracy and millisecond-scale time consumption based on higher-order regression. Specifically, the system first scans three reference B-mode images along the C-axis before acquiring a standard C-mode image. The difference between the reference and volumetric images is compared using a surface-detection algorithm and higher-order polynomials to deduce 3D motion and remove motion-related artifacts. RESULTS System parameters are optimized, and performance is evaluated using both phantom and corneal (ex vivo) samples. An overall motion-artifact error of <4.61 microns and processing time of about 3.40 ms for each B-scan was achieved. CONCLUSIONS Higher-order regression achieved effective and real-time compensation of 3D motion artifacts during corneal imaging. The approach can be expanded to 3D imaging of other ocular tissues. Implementing such motion-compensation strategies has the potential to improve the reliability of objective and quantitative information that can be extracted from volumetric OCT measurements.
Collapse
Affiliation(s)
- Ruizhi Zuo
- Johns Hopkins University, Whiting School of Engineering, Baltimore, Maryland, United States
| | - Kristina Irsch
- Vision Institute, CNRS, Paris, France
- Johns Hopkins University, School of Medicine, Baltimore, Maryland, United States
| | - Jin U. Kang
- Johns Hopkins University, Whiting School of Engineering, Baltimore, Maryland, United States
- Johns Hopkins University, School of Medicine, Baltimore, Maryland, United States
| |
Collapse
|
12
|
Mazlin V, Xiao P, Irsch K, Scholler J, Groux K, Grieve K, Fink M, Boccara AC. Optical phase modulation by natural eye movements: application to time-domain FF-OCT image retrieval. BIOMEDICAL OPTICS EXPRESS 2022; 13:902-920. [PMID: 35284184 PMCID: PMC8884228 DOI: 10.1364/boe.445393] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/07/2021] [Revised: 12/10/2021] [Accepted: 12/10/2021] [Indexed: 05/24/2023]
Abstract
Eye movements are commonly seen as an obstacle to high-resolution ophthalmic imaging. In this context we study the natural axial movements of the in vivo human eye and show that they can be used to modulate the optical phase and retrieve tomographic images via time-domain full-field optical coherence tomography (TD-FF-OCT). This approach opens a path to a simplified ophthalmic TD-FF-OCT device, operating without the usual piezo motor-camera synchronization. The device demonstrates in vivo human corneal images under the different image retrieval schemes (2-phase and 4-phase) and different exposure times (3.5 ms, 10 ms, 20 ms). Data on eye movements, acquired with a spectral-domain OCT with axial eye tracking (180 B-scans/s), are used to study the influence of ocular motion on the probability of capturing high-signal tomographic images without phase washout. The optimal combinations of camera acquisition speed and amplitude of piezo modulation are proposed and discussed.
Collapse
Affiliation(s)
- Viacheslav Mazlin
- ESPCI Paris, PSL University, CNRS, Langevin Institute, 1 Rue Jussieu, 75005 Paris, France
| | - Peng Xiao
- ESPCI Paris, PSL University, CNRS, Langevin Institute, 1 Rue Jussieu, 75005 Paris, France
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, 510060, Guangzhou, China
| | - Kristina Irsch
- Vision Institute, Sorbonne University, CNRS, INSERM, 17 Rue Moreau, 75012 Paris, France
- Quinze-Vingts National Ophthalmology Hospital, 28 Rue de Charenton, 75012 Paris, France
| | - Jules Scholler
- ESPCI Paris, PSL University, CNRS, Langevin Institute, 1 Rue Jussieu, 75005 Paris, France
- Wyss Center for Bio and Neuroengineering, Chem. des Mines 9, 1202 Geneva, Switzerland
| | - Kassandra Groux
- ESPCI Paris, PSL University, CNRS, Langevin Institute, 1 Rue Jussieu, 75005 Paris, France
| | - Kate Grieve
- Vision Institute, Sorbonne University, CNRS, INSERM, 17 Rue Moreau, 75012 Paris, France
- Quinze-Vingts National Ophthalmology Hospital, 28 Rue de Charenton, 75012 Paris, France
| | - Mathias Fink
- ESPCI Paris, PSL University, CNRS, Langevin Institute, 1 Rue Jussieu, 75005 Paris, France
| | - A. Claude Boccara
- ESPCI Paris, PSL University, CNRS, Langevin Institute, 1 Rue Jussieu, 75005 Paris, France
| |
Collapse
|
13
|
Hohberger B, Mardin CY. OCT Angiography as an Interdisciplinary Diagnostic Tool for Systemic Diseases. Klin Monbl Augenheilkd 2021; 238:1294-1298. [PMID: 34879428 DOI: 10.1055/a-1654-0504] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
In recent years, OCT angiography (OCT-A) has emerged as a well established imaging modality of the retina. This allows non-invasive visualisation of the retinal circulation at a micrometre scale in eye disorders and systemic diseases with potential ocular involvement. This review summarises the current state of this topic.
Collapse
|
14
|
Hormel TT, Hwang TS, Bailey ST, Wilson DJ, Huang D, Jia Y. Artificial intelligence in OCT angiography. Prog Retin Eye Res 2021; 85:100965. [PMID: 33766775 PMCID: PMC8455727 DOI: 10.1016/j.preteyeres.2021.100965] [Citation(s) in RCA: 45] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 03/09/2021] [Accepted: 03/15/2021] [Indexed: 12/21/2022]
Abstract
Optical coherence tomographic angiography (OCTA) is a non-invasive imaging modality that provides three-dimensional, information-rich vascular images. With numerous studies demonstrating unique capabilities in biomarker quantification, diagnosis, and monitoring, OCTA technology has seen rapid adoption in research and clinical settings. The value of OCTA imaging is significantly enhanced by image analysis tools that provide rapid and accurate quantification of vascular features and pathology. Today, the most powerful image analysis methods are based on artificial intelligence (AI). While AI encompasses a large variety of techniques, machine-learning-based, and especially deep-learning-based, image analysis provides accurate measurements in a variety of contexts, including different diseases and regions of the eye. Here, we discuss the principles of both OCTA and AI that make their combination capable of answering new questions. We also review contemporary applications of AI in OCTA, which include accurate detection of pathologies such as choroidal neovascularization, precise quantification of retinal perfusion, and reliable disease diagnosis.
Collapse
Affiliation(s)
- Tristan T Hormel
- Casey Eye Institute, Oregon Health & Science University, Portland, OR, 97239, USA
| | - Thomas S Hwang
- Casey Eye Institute, Oregon Health & Science University, Portland, OR, 97239, USA
| | - Steven T Bailey
- Casey Eye Institute, Oregon Health & Science University, Portland, OR, 97239, USA
| | - David J Wilson
- Casey Eye Institute, Oregon Health & Science University, Portland, OR, 97239, USA
| | - David Huang
- Casey Eye Institute, Oregon Health & Science University, Portland, OR, 97239, USA
| | - Yali Jia
- Casey Eye Institute, Oregon Health & Science University, Portland, OR, 97239, USA; Department of Biomedical Engineering, Oregon Health & Science University, Portland, OR, 97239, USA.
| |
Collapse
|
15
|
Kim U, Kwon M, Jung G, Kim Y, Lee Y, Im S, Cense B, Lee H, Ohm WS, Joo C. Optical dosimeter for selective retinal therapy based on multi-port fiber-optic interferometry. BIOMEDICAL OPTICS EXPRESS 2021; 12:4920-4933. [PMID: 34513233 PMCID: PMC8407823 DOI: 10.1364/boe.434812] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/25/2021] [Accepted: 07/07/2021] [Indexed: 06/13/2023]
Abstract
Selective retinal therapy (SRT) employs a micro-second short-pulse lasers to induce localized destruction of the targeted retinal structures with a pulse duration and power aimed at minimal damage to other healthy retinal cells. SRT has demonstrated a great promise in the treatment of retinal diseases, but pulse energy thresholds for effective SRT procedures should be determined precisely and in real time, as the thresholds could vary with disease status and patients. In this study, we present the use of a multi-port fiber-based interferometer (MFI) for highly sensitive real-time SRT monitoring. We exploit distinct phase differences among the fiber ports in the MFI to quantitatively measure localized fluctuations of complex-valued information during the SRT procedure. We evaluate several metrics that can be computed from the full complex-valued information and demonstrate that the complex contour integration is highly sensitive and most correlative to pulse energies, acoustic outputs, and cell deaths. The validity of our method was demonstrated on excised porcine retinas, with a sensitivity and specificity of 0.92 and 0.88, respectively, as compared with the results from a cell viability assay.
Collapse
Affiliation(s)
- Uihan Kim
- Department of Mechanical Engineering, Yonsei University, 50 Yonsei-ro, Seodaemun-gu, Seoul, 03722, Republic of Korea
- These authors contributed equally to this work
| | - Minsung Kwon
- Department of Mechanical Engineering, Yonsei University, 50 Yonsei-ro, Seodaemun-gu, Seoul, 03722, Republic of Korea
- These authors contributed equally to this work
| | - Gyeongyeon Jung
- Department of Research, Lutronic Corporation, 219 Sowon-ro, Goyang, 10534, Republic of Korea
| | - Youngnam Kim
- Department of Research, Lutronic Corporation, 219 Sowon-ro, Goyang, 10534, Republic of Korea
| | - Yunam Lee
- Department of Mechanical Engineering, Yonsei University, 50 Yonsei-ro, Seodaemun-gu, Seoul, 03722, Republic of Korea
| | - Seonghun Im
- Department of Mechanical Engineering, Yonsei University, 50 Yonsei-ro, Seodaemun-gu, Seoul, 03722, Republic of Korea
| | - Barry Cense
- Department of Mechanical Engineering, Yonsei University, 50 Yonsei-ro, Seodaemun-gu, Seoul, 03722, Republic of Korea
- Optical and Biomedical Engineering Laboratory, Department of Electrical, Electronic & Computer Engineering, The University of Western Australia, Perth, WA 6009, Australia
| | - Hyungsuk Lee
- Department of Mechanical Engineering, Yonsei University, 50 Yonsei-ro, Seodaemun-gu, Seoul, 03722, Republic of Korea
| | - Won-Suk Ohm
- Department of Mechanical Engineering, Yonsei University, 50 Yonsei-ro, Seodaemun-gu, Seoul, 03722, Republic of Korea
| | - Chulmin Joo
- Department of Mechanical Engineering, Yonsei University, 50 Yonsei-ro, Seodaemun-gu, Seoul, 03722, Republic of Korea
| |
Collapse
|
16
|
Abstract
The high power of the eye and optical components used to image it result in "static" distortion, remaining constant across acquired retinal images. In addition, raster-based systems sample points or lines of the image over time, suffering from "dynamic" distortion due to the constant motion of the eye. We recently described an algorithm which corrects for the latter problem but is entirely blind to the former. Here, we describe a new procedure termed "DIOS" (Dewarp Image by Oblique Shift) to remove static distortion of arbitrary type. Much like the dynamic correction method, it relies on locating the same tissue in multiple frames acquired as the eye moves through different gaze positions. Here, the resultant maps of pixel displacement are used to form a sparse system of simultaneous linear equations whose solution gives the common warp seen by all frames. We show that the method successfully handles torsional movement of the eye. We also show that the output of the previously described dynamic correction procedure may be used as input for this new procedure, recovering an image of the tissue that is, in principle, a faithful replica free of any type of distortion. The method could be extended beyond ocular imaging, to any kind of imaging system in which the image can move or be made to move across the detector.
Collapse
Affiliation(s)
- Phillip Bedggood
- Department of Optometry and Vision Sciences, The University of Melbourne, Melbourne, Australia
| | - Andrew Metha
- Department of Optometry and Vision Sciences, The University of Melbourne, Melbourne, Australia
| |
Collapse
|
17
|
Qian R, McNabb RP, Zhou KC, Mousa HM, Saban DR, Perez VL, Kuo AN, Izatt JA. In vivo quantitative analysis of anterior chamber white blood cell mixture composition using spectroscopic optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2021; 12:2134-2148. [PMID: 33996220 PMCID: PMC8086441 DOI: 10.1364/boe.419063] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/06/2021] [Revised: 03/09/2021] [Accepted: 03/10/2021] [Indexed: 06/12/2023]
Abstract
Anterior uveitis is the most common form of intraocular inflammation, and one of its main signs is the presence of white blood cells (WBCs) in the anterior chamber (AC). Clinically, the true composition of cells can currently only be obtained using AC paracentesis, an invasive procedure to obtain AC fluid requiring needle insertion into the AC. We previously developed a spectroscopic optical coherence tomography (SOCT) analysis method to differentiate between populations of RBCs and subtypes of WBCs, including granulocytes, lymphocytes and monocytes, both in vitro and in ACs of excised porcine eyes. We have shown that different types of WBCs have distinct characteristic size distributions, extracted from the backscattered reflectance spectrum of individual cells using Mie theory. Here, we further develop our method to estimate the composition of blood cell mixtures, both in vitro and in vivo. To do so, we estimate the size distribution of unknown cell mixtures by fitting the distribution observed using SOCT with a weighted combination of reference size distributions of each WBC type calculated using kernel density estimation. We validate the accuracy of our estimation in an in vitro study, by comparing our results for a given WBC sample mixture with the cellular concentrations measured by a hemocytometer and SOCT images before mixing. We also conducted a small in vivo quantitative cell mixture validation pilot study which demonstrates congruence between our method and AC paracentesis in two patients with uveitis. The SOCT based method appears promising to provide quantitative diagnostic information of cellular responses in the ACs of patients with uveitis.
Collapse
Affiliation(s)
- Ruobing Qian
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Ryan P. McNabb
- Department of Ophthalmology, Duke University Medical Center, NC 27710, USA
| | - Kevin C. Zhou
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Hazem M. Mousa
- Department of Ophthalmology, Duke University Medical Center, NC 27710, USA
| | - Daniel R. Saban
- Department of Ophthalmology, Duke University Medical Center, NC 27710, USA
| | - Victor L. Perez
- Department of Ophthalmology, Duke University Medical Center, NC 27710, USA
| | - Anthony N. Kuo
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
- Department of Ophthalmology, Duke University Medical Center, NC 27710, USA
| | - Joseph A. Izatt
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
- Department of Ophthalmology, Duke University Medical Center, NC 27710, USA
| |
Collapse
|
18
|
Ringel MJ, Tang EM, Tao YK. Advances in multimodal imaging in ophthalmology. Ther Adv Ophthalmol 2021; 13:25158414211002400. [PMID: 35187398 PMCID: PMC8855415 DOI: 10.1177/25158414211002400] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Accepted: 02/23/2021] [Indexed: 12/12/2022] Open
Abstract
Multimodality ophthalmic imaging systems aim to enhance the contrast, resolution, and functionality of existing technologies to improve disease diagnostics and therapeutic guidance. These systems include advanced acquisition and post-processing methods using optical coherence tomography (OCT), combined scanning laser ophthalmoscopy and OCT systems, adaptive optics, surgical guidance, and photoacoustic technologies. Here, we provide an overview of these ophthalmic imaging systems and their clinical and basic science applications.
Collapse
Affiliation(s)
- Morgan J. Ringel
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Eric M. Tang
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Yuankai K. Tao
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37235, USA
| |
Collapse
|
19
|
Hormel TT, Huang D, Jia Y. Artifacts and artifact removal in optical coherence tomographic angiography. Quant Imaging Med Surg 2021; 11:1120-1133. [PMID: 33654681 PMCID: PMC7829161 DOI: 10.21037/qims-20-730] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2020] [Accepted: 07/29/2020] [Indexed: 02/04/2023]
Abstract
Optical coherence tomographic angiography (OCTA) enables rapid imaging of retinal vasculature in three dimensions. While the technique has provided quantification of healthy vessels as well as pathology in several diseases, it is not unusual for OCTA data to contain artifacts that may influence measurement outcomes or defy image interpretation. In this review, we discuss the sources of several OCTA artifacts-including projection, motion, and signal reduction-as well as strategies for their removal. Artifact compensation can improve the accuracy of OCTA measurements, and the most effective use of the technology will incorporate hardware and software that can perform such correction.
Collapse
Affiliation(s)
- Tristan T. Hormel
- Casey Eye Institute, Oregon Health & Science University, Portland, OR, USA
| | - David Huang
- Casey Eye Institute, Oregon Health & Science University, Portland, OR, USA
| | - Yali Jia
- Casey Eye Institute, Oregon Health & Science University, Portland, OR, USA
- Department of Biomedical Engineering, Oregon Health & Science University, Portland, OR, USA
| |
Collapse
|
20
|
Ploner SB, Kraus MF, Moult EM, Husvogt L, Schottenhamml J, Yasin Alibhai A, Waheed NK, Duker JS, Fujimoto JG, Maier AK. Efficient and high accuracy 3-D OCT angiography motion correction in pathology. BIOMEDICAL OPTICS EXPRESS 2021; 12:125-146. [PMID: 33520381 PMCID: PMC7818965 DOI: 10.1364/boe.411117] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/29/2020] [Revised: 11/12/2020] [Accepted: 11/13/2020] [Indexed: 05/27/2023]
Abstract
We describe a novel method for non-rigid 3-D motion correction of orthogonally raster-scanned optical coherence tomography angiography volumes. This is the first approach that aligns predominantly axial structural features such as retinal layers as well as transverse angiographic vascular features in a joint optimization. Combined with orthogonal scanning and favorization of kinematically more plausible displacements, subpixel alignment and micrometer-scale distortion correction is achieved in all 3 dimensions. As no specific structures are segmented, the method is by design robust to pathologic changes. Furthermore, the method is designed for highly parallel implementation and short runtime, allowing its integration into clinical workflow even for high density or wide-field scans. We evaluated the algorithm with metrics related to clinically relevant features in an extensive quantitative evaluation based on 204 volumetric scans of 17 subjects, including patients with diverse pathologies and healthy controls. Using this method, we achieve state-of-the-art axial motion correction and show significant advances in both transverse co-alignment and distortion correction, especially in the subgroup with pathology.
Collapse
Affiliation(s)
- Stefan B. Ploner
- Pattern Recognition Lab,
Friedrich-Alexander-Universität Erlangen-Nürnberg,
Martensstr. 3, Erlangen, 91058, Germany
- Department of Electrical Engineering and
Computer Science and Research Laboratory of Electronics, Massachusetts
Institute of Technology, 77 Massachusetts Ave, Cambridge, MA 02139,
USA
| | - Martin F. Kraus
- Pattern Recognition Lab,
Friedrich-Alexander-Universität Erlangen-Nürnberg,
Martensstr. 3, Erlangen, 91058, Germany
| | - Eric M. Moult
- Department of Electrical Engineering and
Computer Science and Research Laboratory of Electronics, Massachusetts
Institute of Technology, 77 Massachusetts Ave, Cambridge, MA 02139,
USA
| | - Lennart Husvogt
- Pattern Recognition Lab,
Friedrich-Alexander-Universität Erlangen-Nürnberg,
Martensstr. 3, Erlangen, 91058, Germany
- Department of Electrical Engineering and
Computer Science and Research Laboratory of Electronics, Massachusetts
Institute of Technology, 77 Massachusetts Ave, Cambridge, MA 02139,
USA
| | - Julia Schottenhamml
- Pattern Recognition Lab,
Friedrich-Alexander-Universität Erlangen-Nürnberg,
Martensstr. 3, Erlangen, 91058, Germany
| | - A. Yasin Alibhai
- New England Eye Center, Tufts Medical
Center, 800 Washington St. Box 450, Boston, MA 02111, USA
| | - Nadia K. Waheed
- New England Eye Center, Tufts Medical
Center, 800 Washington St. Box 450, Boston, MA 02111, USA
| | - Jay S. Duker
- New England Eye Center, Tufts Medical
Center, 800 Washington St. Box 450, Boston, MA 02111, USA
| | - James G. Fujimoto
- Department of Electrical Engineering and
Computer Science and Research Laboratory of Electronics, Massachusetts
Institute of Technology, 77 Massachusetts Ave, Cambridge, MA 02139,
USA
| | - Andreas K. Maier
- Pattern Recognition Lab,
Friedrich-Alexander-Universität Erlangen-Nürnberg,
Martensstr. 3, Erlangen, 91058, Germany
| |
Collapse
|
21
|
Kurokawa K, Crowell JA, Do N, Lee JJ, Miller DT. Multi-reference global registration of individual A-lines in adaptive optics optical coherence tomography retinal images. JOURNAL OF BIOMEDICAL OPTICS 2021; 26:JBO-200266R. [PMID: 33410310 PMCID: PMC7787477 DOI: 10.1117/1.jbo.26.1.016001] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Accepted: 12/10/2020] [Indexed: 05/18/2023]
Abstract
SIGNIFICANCE Adaptive optics optical coherence tomography (AO-OCT) technology enables non-invasive, high-resolution three-dimensional (3D) imaging of the retina and promises earlier detection of ocular disease. However, AO-OCT data are corrupted by eye-movement artifacts that must be removed in post-processing, a process rendered time-consuming by the immense quantity of data. AIM To efficiently remove eye-movement artifacts at the level of individual A-lines, including those present in any individual reference volume. APPROACH We developed a registration method that cascades (1) a 3D B-scan registration algorithm with (2) a global A-line registration algorithm for correcting torsional eye movements and image scaling and generating global motion-free coordinates. The first algorithm corrects 3D translational eye movements to a single reference volume, accelerated using parallel computing. The second algorithm combines outputs of multiple runs of the first algorithm using different reference volumes followed by an affine transformation, permitting registration of all images to a global coordinate system at the level of individual A-lines. RESULTS The 3D B-scan algorithm estimates and corrects 3D translational motions with high registration accuracy and robustness, even for volumes containing microsaccades. Averaging registered volumes improves our image quality metrics up to 22 dB. Implementation in CUDA™ on a graphics processing unit registers a 512 × 512 × 512 volume in only 10.6 s, 150 times faster than MATLAB™ on a central processing unit. The global A-line algorithm minimizes image distortion, improves regularity of the cone photoreceptor mosaic, and supports enhanced visualization of low-contrast retinal cellular features. Averaging registered volumes improves our image quality up to 9.4 dB. It also permits extending the imaging field of view (∼2.1 × ) and depth of focus (∼5.6 × ) beyond what is attainable with single-reference registration. CONCLUSIONS We can efficiently correct eye motion in all 3D at the level of individual A-lines using a global coordinate system.
Collapse
Affiliation(s)
- Kazuhiro Kurokawa
- Indiana University, School of Optometry, Bloomington, Indiana, United States
| | - James A. Crowell
- Indiana University, School of Optometry, Bloomington, Indiana, United States
| | - Nhan Do
- Purdue School of Engineering and Technology, Indiana University-Purdue University Indianapolis, Indianapolis, Indiana, United States
- Google, Mountain View, California, United States
| | - John J. Lee
- Purdue School of Engineering and Technology, Indiana University-Purdue University Indianapolis, Indianapolis, Indiana, United States
| | - Donald T. Miller
- Indiana University, School of Optometry, Bloomington, Indiana, United States
| |
Collapse
|
22
|
Athwal A, Balaratnasingam C, Yu DY, Heisler M, Sarunic MV, Ju MJ. Optimizing 3D retinal vasculature imaging in diabetic retinopathy using registration and averaging of OCT-A. BIOMEDICAL OPTICS EXPRESS 2021; 12:553-570. [PMID: 33659089 PMCID: PMC7899521 DOI: 10.1364/boe.408590] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/31/2020] [Revised: 11/06/2020] [Accepted: 12/07/2020] [Indexed: 05/29/2023]
Abstract
High resolution visualization of optical coherence tomography (OCT) and OCT angiography (OCT-A) data is required to fully take advantage of the imaging modality's three-dimensional nature. However, artifacts induced by patient motion often degrade OCT-A data quality. This is especially true for patients with deteriorated focal vision, such as those with diabetic retinopathy (DR). We propose a novel methodology for software-based OCT-A motion correction achieved through serial acquisition, volumetric registration, and averaging. Motion artifacts are removed via a multi-step 3D registration process, and visibility is significantly enhanced through volumetric averaging. We demonstrate that this method permits clear 3D visualization of retinal pathologies and their surrounding features, 3D visualization of inner retinal capillary connections, as well as reliable visualization of the choriocapillaris layer.
Collapse
Affiliation(s)
- Arman Athwal
- School of Engineering Science, Simon Fraser University, 8888 University Drive, Burnaby, BC, V5A 1S6, Canada
| | - Chandrakumar Balaratnasingam
- Centre for Ophthalmology and Visual Science, University of Western Australia, Perth, Australia
- Lions Eye Institute, Nedlands, Western Australia, Australia
| | - Dao-Yi Yu
- Centre for Ophthalmology and Visual Science, University of Western Australia, Perth, Australia
- Lions Eye Institute, Nedlands, Western Australia, Australia
| | - Morgan Heisler
- School of Engineering Science, Simon Fraser University, 8888 University Drive, Burnaby, BC, V5A 1S6, Canada
| | - Marinko V. Sarunic
- School of Engineering Science, Simon Fraser University, 8888 University Drive, Burnaby, BC, V5A 1S6, Canada
| | - Myeong Jin Ju
- School of Engineering Science, Simon Fraser University, 8888 University Drive, Burnaby, BC, V5A 1S6, Canada
- University of British Columbia, Department of Ophthalmology and Visual Sciences, 2550 Willow Street, Vancouver, BC, V5Z 3N9, Canada
- University of British Columbia, School of Biomedical Engineering, 251–2222 Health Sciences Mall, Vancouver, BC, V6 T 1Z3, Canada
| |
Collapse
|
23
|
Makita S, Miura M, Azuma S, Mino T, Yamaguchi T, Yasuno Y. Accurately motion-corrected Lissajous OCT with multi-type image registration. BIOMEDICAL OPTICS EXPRESS 2021; 12:637-653. [PMID: 33659092 PMCID: PMC7899516 DOI: 10.1364/boe.409004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/01/2020] [Revised: 12/02/2020] [Accepted: 12/15/2020] [Indexed: 05/06/2023]
Abstract
Passive motion correction methods for optical coherence tomography (OCT) use image registration to estimate eye movements. To improve motion correction, a multi-image cross-correlation that employs spatial features in different image types is introduced. Lateral motion correction using en face OCT and OCT-A projections on Lissajous-scanned OCT data is applied. Motion correction using OCT-A projection of whole depth and OCT amplitude, OCT logarithmic intensity, and OCT maximum intensity projections were evaluated in retinal imaging with 76 patients. The proposed method was compared with motion correction using OCT-A projection of whole depth. The comparison shows improvements in the image quality of motion-corrected superficial OCT-A images and image registration.
Collapse
Affiliation(s)
- Shuichi Makita
- Computation Optics Group, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8573, Japan
- Computational Optics and Ophthalmology Group, Ibaraki, Japan
| | - Masahiro Miura
- Computational Optics and Ophthalmology Group, Ibaraki, Japan
- Department of Ophthalmology, Tokyo Medical University Ibaraki Medical Center, 3-20-1 Chuo, Ami, Ibaraki 300-0395, Japan
| | - Shinnosuke Azuma
- Topcon Corporation, 75-1 Hasunumacho, Itabashi, Tokyo 174-8580, Japan
| | - Toshihiro Mino
- Topcon Corporation, 75-1 Hasunumacho, Itabashi, Tokyo 174-8580, Japan
| | - Tatsuo Yamaguchi
- Topcon Corporation, 75-1 Hasunumacho, Itabashi, Tokyo 174-8580, Japan
| | - Yoshiaki Yasuno
- Computation Optics Group, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8573, Japan
- Computational Optics and Ophthalmology Group, Ibaraki, Japan
| |
Collapse
|
24
|
Li Z, Pandiyan VP, Maloney-Bertelli A, Jiang X, Li X, Sabesan R. Correcting intra-volume distortion for AO-OCT using 3D correlation based registration. OPTICS EXPRESS 2020; 28:38390-38409. [PMID: 33379652 PMCID: PMC7771894 DOI: 10.1364/oe.410374] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/17/2020] [Revised: 11/15/2020] [Accepted: 11/19/2020] [Indexed: 05/18/2023]
Abstract
Adaptive optics (AO) based ophthalmic imagers, such as scanning laser ophthalmoscopes (SLO) and optical coherence tomography (OCT), are used to evaluate the structure and function of the retina with high contrast and resolution. Fixational eye movements during a raster-scanned image acquisition lead to intra-frame and intra-volume distortion, resulting in an inaccurate reproduction of the underlying retinal structure. For three-dimensional (3D) AO-OCT, segmentation-based and 3D correlation based registration methods have been applied to correct eye motion and achieve a high signal-to-noise ratio registered volume. This involves first selecting a reference volume, either manually or automatically, and registering the image/volume stream against the reference using correlation methods. However, even within the chosen reference volume, involuntary eye motion persists and affects the accuracy with which the 3D retinal structure is finally rendered. In this article, we introduced reference volume distortion correction for AO-OCT using 3D correlation based registration and demonstrate a significant improvement in registration performance via a few metrics. Conceptually, the general paradigm follows that developed previously for intra-frame distortion correction for 2D raster-scanned images, as in an AOSLO, but extended here across all three spatial dimensions via 3D correlation analyses. We performed a frequency analysis of eye motion traces before and after intra-volume correction and revealed how periodic artifacts in eye motion estimates are effectively reduced upon correction. Further, we quantified how the intra-volume distortions and periodic artifacts in the eye motion traces, in general, decrease with increasing AO-OCT acquisition speed. Overall, 3D correlation based registration with intra-volume correction significantly improved the visualization of retinal structure and estimation of fixational eye movements.
Collapse
Affiliation(s)
- Zhenghan Li
- Key Laboratory on Adaptive Optics, Chinese Academy of Sciences, Chengdu, Sichuan 610209, China
- Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, Sichuan 610209, China
- University of Chinese Academy of Sciences, Beijing 100049, China
- Department of Ophthalmology, University of Washington, Seattle, Washington 98109, USA
- These authors contributed equally to this work
| | - Vimal Prabhu Pandiyan
- Department of Ophthalmology, University of Washington, Seattle, Washington 98109, USA
- These authors contributed equally to this work
| | | | - Xiaoyun Jiang
- Department of Ophthalmology, University of Washington, Seattle, Washington 98109, USA
| | - Xinyang Li
- Key Laboratory on Adaptive Optics, Chinese Academy of Sciences, Chengdu, Sichuan 610209, China
- Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, Sichuan 610209, China
| | - Ramkumar Sabesan
- Department of Ophthalmology, University of Washington, Seattle, Washington 98109, USA
| |
Collapse
|
25
|
Schwarzhans F, Desissaire S, Steiner S, Pircher M, Hitzenberger CK, Resch H, Vass C, Fischer G. Generating large field of view en-face projection images from intra-acquisition motion compensated volumetric optical coherence tomography data. BIOMEDICAL OPTICS EXPRESS 2020; 11:6881-6904. [PMID: 33408968 PMCID: PMC7747913 DOI: 10.1364/boe.404738] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/10/2020] [Revised: 10/16/2020] [Accepted: 10/21/2020] [Indexed: 05/21/2023]
Abstract
A technique to generate large field of view projection maps of arbitrary optical coherence tomography (OCT) data is described. The technique is divided into two stages - an image acquisition stage that features a simple to use fast and robust retinal tracker to get motion free retinal OCT volume scans - and a stitching stage where OCT data from different retinal locations is first registered against a reference image using a custom pyramid-based approach and finally stitched together into one seamless large field of view (FOV) image. The method is applied to data recorded with a polarization sensitive OCT instrument in healthy subjects and glaucoma patients. The tracking and stitching accuracies are quantified, and finally, large FOV images of retinal nerve fiber layer retardation that contain the arcuate nerve fiber bundles from the optic nerve head to the raphe are demonstrated.
Collapse
Affiliation(s)
- Florian Schwarzhans
- Center for Medical Statistics, Informatics and Intelligent Systems, Medical University of Vienna, Vienna, 1090, Austria
| | - Sylvia Desissaire
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, 1090, Austria
| | - Stefan Steiner
- Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, 1090, Austria
| | - Michael Pircher
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, 1090, Austria
| | - Christoph K. Hitzenberger
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, 1090, Austria
| | - Hemma Resch
- Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, 1090, Austria
| | - Clemens Vass
- Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, 1090, Austria
| | - Georg Fischer
- Center for Medical Statistics, Informatics and Intelligent Systems, Medical University of Vienna, Vienna, 1090, Austria
| |
Collapse
|
26
|
Greig EC, Duker JS, Waheed NK. A practical guide to optical coherence tomography angiography interpretation. Int J Retina Vitreous 2020; 6:55. [PMID: 33292740 PMCID: PMC7666474 DOI: 10.1186/s40942-020-00262-9] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2020] [Accepted: 11/05/2020] [Indexed: 12/16/2022] Open
Abstract
Background Optical coherence tomography angiography (OCTA) can image the retinal vasculature in vivo, without the need for contrast dye. This technology has been commercially available since 2014, however, much of its use has been limited to the research setting. Over time, more clinical practices have adopted OCTA imaging. While countless publications detail OCTA’s use for the study of retinal microvasculature, few studies outline OCTA’s clinical utility. Body This review provides an overview of OCTA imaging and details tips for successful interpretation. The review begins with a summary of OCTA technology and artifacts that arise from image acquisition. New methods and best practices to prevent image artifacts are discussed. OCTA has the unique ability among retinovascular imaging modalities to individually visualize each retinal plexus. Slabs offered in standard OCTA devices are reviewed, and clinical uses for each slab are outlined. Lastly, the use of OCTA for the clinical interpretation of retinal pathology, such as diabetic retinopathy and age-related macular degeneration, is discussed. Conclusion OCTA is evolving from a scientific tool to a clinical imaging device. This review provides a toolkit for successful image interpretation in a clinical setting.
Collapse
Affiliation(s)
- Eugenia Custo Greig
- New England Eye Center, Tufts Medical Center, 800 Washington Street, Box 450, Boston, MA, 02111, USA.,Yale School of Medicine, New Haven, CT, USA
| | - Jay S Duker
- New England Eye Center, Tufts Medical Center, 800 Washington Street, Box 450, Boston, MA, 02111, USA
| | - Nadia K Waheed
- New England Eye Center, Tufts Medical Center, 800 Washington Street, Box 450, Boston, MA, 02111, USA.
| |
Collapse
|
27
|
Kim HJ, Song BJ, Choi Y, Kim BM. Cross-scanning optical coherence tomography angiography for eye motion correction. JOURNAL OF BIOPHOTONICS 2020; 13:e202000170. [PMID: 32475032 DOI: 10.1002/jbio.202000170] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Revised: 05/26/2020] [Accepted: 05/27/2020] [Indexed: 05/10/2023]
Abstract
We propose a cross-scanning optical coherence tomography (CS-OCT) system to correct eye motion artifacts in OCT angiography images. This system employs a dual-illumination configuration with two orthogonally polarized beams, each of which simultaneously perform raster scanning in perpendicular direction with each other over the same area. In the reference arm, a polarization delay unit is used to acquire the two orthogonally polarized interferograms with a single photo detector by introducing different optical delay lines. The two cross-scanned volume data are affected by the same eye motion but in two orthogonal directions. We developed a motion correction algorithm, which removes artifacts in the slow axis of each angiogram using the other and merges them through a nonrigid registration algorithm. In this manner, we obtained a motion-corrected angiogram within a single volume scanning time without additional eye-tracking devices.
Collapse
Affiliation(s)
- Hyung-Jin Kim
- Institute of Global Health Technology, Korea University, Seoul, South Korea
| | - Byeong Joo Song
- Department of Bioengineering, Korea University, Seoul, South Korea
| | - Youngwoon Choi
- Department of Bioengineering, Korea University, Seoul, South Korea
| | - Beop-Min Kim
- Department of Bioengineering, Korea University, Seoul, South Korea
| |
Collapse
|
28
|
Serra R, Coscas F, Pinna A, Peri M, Zucca I, Sellam A, Giancipoli E, Boscia F. Detection of serum uric acid in primary open angle glaucoma: A pilot study. Eur J Ophthalmol 2020; 31:1857-1861. [PMID: 32698611 DOI: 10.1177/1120672120944012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
PURPOSE To assess the association between the serum levels of uric acid (UA) and primary open-angle glaucoma (POAG). METHODS In this pilot study, 46 eyes of 23 patients with a clinical history of POAG and 30 eyes of 15 healthy subjects were included. All patients underwent a complete ophthalmological examination, including best corrected visual acuity (BCVA), intraocular pressure (IOP), and gonioscopy. Visual field parameters, such as mean deviation (MD) and pattern standard deviation (PSD), and optical coherence tomography (OCT) values of the optic nerve head, including retinal nerve fiber layer (RNFL) thickness and vertical cup/disc ratio (VCDR), were noted. A blood sample was collected from each subject for serum UA measurement. RESULTS IOP, MD, PSD, RNFL thickness, and VCDR resulted significantly different in POAG patients, when compared with controls (p < 0.05). POAG patients showed significantly lower levels of mean serum UA than healthy controls (4.00 ± 0.66 mg/dL vs 4.95 ± 0.86 mg/dL, respectively, p < 0.0001). Furthermore, severe POAG patients showed mean serum levels of UA lower than mild POAG patients (3.36 ± 0.70 mg/dL vs 4.22 ± 0.51 mg/dL, respectively, p = 0.01). Visual field and OCT parameters were statistically correlated with the mean serum levels of UA in POAG eyes (p < 0.05). CONCLUSION Results suggest that in POAG patients, serum UA levels may be decreased and correlated with visual field and OCT parameters worsening. Further larger multi-center prospective studies are necessary to confirm our findings and establish the role of UA in glaucoma.
Collapse
Affiliation(s)
- Rita Serra
- Department of Biomedical Sciences, University of Sassari, Sassari, Italy.,Istituto di Ricerca Genetica e Biomedica, CNR, Cittadella Universitaria di Cagliari, Monserrato (CA), Italy
| | - Florence Coscas
- Department of Ophthalmology, Centre Hospitalier Intercommunal de Creteil, University Paris Est Creteil, Creteil, France
| | - Antonio Pinna
- Department of Medical, Surgical, and Experimental Sciences, Ophthalmology Unit, University of Sassari, Sassari, Italy
| | - Marcella Peri
- Department of Surgical Sciences, Eye Clinic, University of Cagliari, Cagliari, Italy
| | - Ignazio Zucca
- Department of Surgical Sciences, Eye Clinic, University of Cagliari, Cagliari, Italy
| | | | - Ermete Giancipoli
- Department of Biomedical Sciences, University of Sassari, Sassari, Italy
| | - Francesco Boscia
- Department of Medical, Surgical, and Experimental Sciences, Ophthalmology Unit, University of Sassari, Sassari, Italy
| |
Collapse
|
29
|
Lee B, Chen S, Moult EM, Yu Y, Alibhai AY, Mehta N, Baumal CR, Waheed NK, Fujimoto JG. High-Speed, Ultrahigh-Resolution Spectral-Domain OCT with Extended Imaging Range Using Reference Arm Length Matching. Transl Vis Sci Technol 2020; 9:12. [PMID: 32832219 PMCID: PMC7414734 DOI: 10.1167/tvst.9.7.12] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2019] [Accepted: 04/02/2020] [Indexed: 11/24/2022] Open
Abstract
Purpose To develop high-speed, extended-range, ultrahigh-resolution spectral-domain optical coherence tomography (UHR SD-OCT) and demonstrate scan protocols for clinical retinal imaging. Methods A UHR SD-OCT operating at 840-nm with 150-nm bandwidths was developed. The axial imaging range was extended by dynamically matching reference arm length to the retinal contour during acquisition. Two scan protocols were demonstrated for imaging healthy participants and patients with dry age-related macular degeneration. A high-definition raster protocol with intra–B-scan reference arm length matching (ReALM) was used for high-quality cross-sectional imaging. A cube volume scan using horizontal and vertical rasters with inter–B-scan ReALM and software motion correction was used for en face and cross-sectional imaging. Linear OCT signal display enhanced visualization of outer retinal features. Results UHR SD-OCT was demonstrated at 128- and 250-kHz A-scan rates with 2.7 µm axial resolution and a 1.2-mm, 6-dB imaging range in the eye. Dynamic ReALM was used to maintain the retina within the 6-dB imaging range over wider fields of view. Outer retinal features, including the rod and cone interdigitation zones, retinal pigment epithelium, and Bruch's membrane were visualized and alterations observed in age-related macular degeneration eyes. Conclusions Technological advances and dynamic ReALM improve the imaging performance and clinical usability of UHR SD-OCT. Translational Relevance These advances should simplify clinical imaging workflow, reduce imaging session times, and improve yield of high quality images. Improved visualization of photoreceptors, retinal pigment epithelium, and Bruch's membrane may facilitate diagnosis and monitoring of age-related macular degeneration and other retinal diseases.
Collapse
Affiliation(s)
- ByungKun Lee
- Department of Electrical Engineering and Computer Science, Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Siyu Chen
- Department of Electrical Engineering and Computer Science, Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Eric M Moult
- Department of Electrical Engineering and Computer Science, Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Yue Yu
- Department of Electrical Engineering and Computer Science, Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - A Yasin Alibhai
- New England Eye Center, Tufts University School of Medicine, Boston, MA, USA
| | - Nihaal Mehta
- New England Eye Center, Tufts University School of Medicine, Boston, MA, USA
| | - Caroline R Baumal
- New England Eye Center, Tufts University School of Medicine, Boston, MA, USA
| | - Nadia K Waheed
- New England Eye Center, Tufts University School of Medicine, Boston, MA, USA
| | - James G Fujimoto
- Department of Electrical Engineering and Computer Science, Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
| |
Collapse
|
30
|
Bartuzel MM, Wróbel K, Tamborski S, Meina M, Nowakowski M, Dalasiński K, Szkulmowska A, Szkulmowski M. High-resolution, ultrafast, wide-field retinal eye-tracking for enhanced quantification of fixational and saccadic motion. BIOMEDICAL OPTICS EXPRESS 2020; 11:3164-3180. [PMID: 32637248 PMCID: PMC7316009 DOI: 10.1364/boe.392849] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/18/2020] [Revised: 04/30/2020] [Accepted: 05/07/2020] [Indexed: 05/23/2023]
Abstract
We introduce a novel, noninvasive retinal eye-tracking system capable of detecting eye displacements with an angular resolution of 0.039 arcmin and a maximum velocity of 300°/s across an 8° span. Our system is designed based on a confocal retinal imaging module similar to a scanning laser ophthalmoscope. It utilizes a 2D MEMS scanner ensuring high image frame acquisition frequencies up to 1.24 kHz. In contrast with leading eye-tracking technology, we measure the eye displacements via the collection of the observed spatial excursions for all the times corresponding a full acquisition cycle, thus obviating the need for both a baseline reference frame and absolute spatial calibration. Using this approach, we demonstrate the precise measurement of eye movements with magnitudes exceeding the spatial extent of a single frame, which is not possible using existing image-based retinal trackers. We describe our retinal tracker, tracking algorithms and assess the performance of our system by using programmed artificial eye movements. We also demonstrate the clinical capabilities of our system with in vivo subjects by detecting microsaccades with angular extents as small as 0.028°. The rich kinematic ocular data provided by our system with its exquisite degree of accuracy and extended dynamic range opens new and exciting avenues in retinal imaging and clinical neuroscience. Several subtle features of ocular motion such as saccadic dysfunction, fixation instability and abnormal smooth pursuit can be readily extracted and inferred from the measured retinal trajectories thus offering a promising tool for identifying biomarkers of neurodegenerative diseases associated with these ocular symptoms.
Collapse
Affiliation(s)
- Maciej M. Bartuzel
- Institute of Physics, Faculty of Physics, Astronomy and Informatics, Nicolaus Copernicus University in Toruń, Grudziądzka 5, Toruń 87-100, Poland
- Faculty of Fundamental Problems of Technology, Wroclaw University of Science and Technology, Wyb. Wyspiańskiego 27, Wrocław 50-370, Poland
| | - Krystian Wróbel
- Institute of Physics, Faculty of Physics, Astronomy and Informatics, Nicolaus Copernicus University in Toruń, Grudziądzka 5, Toruń 87-100, Poland
| | - Szymon Tamborski
- Institute of Physics, Faculty of Physics, Astronomy and Informatics, Nicolaus Copernicus University in Toruń, Grudziądzka 5, Toruń 87-100, Poland
| | - Michał Meina
- Institute of Physics, Faculty of Physics, Astronomy and Informatics, Nicolaus Copernicus University in Toruń, Grudziądzka 5, Toruń 87-100, Poland
- AM2M Ltd. L.P., Mickiewicza 7/17, Toruń 87-100, Poland
| | | | | | | | - Maciej Szkulmowski
- Institute of Physics, Faculty of Physics, Astronomy and Informatics, Nicolaus Copernicus University in Toruń, Grudziądzka 5, Toruń 87-100, Poland
| |
Collapse
|
31
|
Wei X, Hormel TT, Guo Y, Hwang TS, Jia Y. High-resolution wide-field OCT angiography with a self-navigation method to correct microsaccades and blinks. BIOMEDICAL OPTICS EXPRESS 2020; 11:3234-3245. [PMID: 32637251 PMCID: PMC7316026 DOI: 10.1364/boe.390430] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Revised: 05/11/2020] [Accepted: 05/14/2020] [Indexed: 05/18/2023]
Abstract
In this study, we demonstrate a novel self-navigated motion correction method that suppresses eye motion and blinking artifacts on wide-field optical coherence tomographic angiography (OCTA) without requiring any hardware modification. Highly efficient GPU-based, real-time OCTA image acquisition and processing software was developed to detect eye motion artifacts. The algorithm includes an instantaneous motion index that evaluates the strength of motion artifact on en face OCTA images. Areas with suprathreshold motion and eye blinking artifacts are automatically rescanned in real-time. Both healthy eyes and eyes with diabetic retinopathy were imaged, and the self-navigated motion correction performance was demonstrated.
Collapse
Affiliation(s)
- Xiang Wei
- Casey Eye Institute, Oregon Health and Science University, Portland, Oregon 97239, USA
- Department of Biomedical Engineer, Oregon Health and Science University, Portland, Oregon 97239, USA
| | - Tristan T. Hormel
- Casey Eye Institute, Oregon Health and Science University, Portland, Oregon 97239, USA
| | - Yukun Guo
- Casey Eye Institute, Oregon Health and Science University, Portland, Oregon 97239, USA
| | - Thomas S. Hwang
- Casey Eye Institute, Oregon Health and Science University, Portland, Oregon 97239, USA
| | - Yali Jia
- Casey Eye Institute, Oregon Health and Science University, Portland, Oregon 97239, USA
- Department of Biomedical Engineer, Oregon Health and Science University, Portland, Oregon 97239, USA
| |
Collapse
|
32
|
Spatio-temporal deep learning methods for motion estimation using 4D OCT image data. Int J Comput Assist Radiol Surg 2020; 15:943-952. [PMID: 32445128 PMCID: PMC7303100 DOI: 10.1007/s11548-020-02178-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2020] [Accepted: 04/21/2020] [Indexed: 11/27/2022]
Abstract
PURPOSE Localizing structures and estimating the motion of a specific target region are common problems for navigation during surgical interventions. Optical coherence tomography (OCT) is an imaging modality with a high spatial and temporal resolution that has been used for intraoperative imaging and also for motion estimation, for example, in the context of ophthalmic surgery or cochleostomy. Recently, motion estimation between a template and a moving OCT image has been studied with deep learning methods to overcome the shortcomings of conventional, feature-based methods. METHODS We investigate whether using a temporal stream of OCT image volumes can improve deep learning-based motion estimation performance. For this purpose, we design and evaluate several 3D and 4D deep learning methods and we propose a new deep learning approach. Also, we propose a temporal regularization strategy at the model output. RESULTS Using a tissue dataset without additional markers, our deep learning methods using 4D data outperform previous approaches. The best performing 4D architecture achieves an correlation coefficient (aCC) of 98.58% compared to 85.0% of a previous 3D deep learning method. Also, our temporal regularization strategy at the output further improves 4D model performance to an aCC of 99.06%. In particular, our 4D method works well for larger motion and is robust toward image rotations and motion distortions. CONCLUSIONS We propose 4D spatio-temporal deep learning for OCT-based motion estimation. On a tissue dataset, we find that using 4D information for the model input improves performance while maintaining reasonable inference times. Our regularization strategy demonstrates that additional temporal information is also beneficial at the model output.
Collapse
|
33
|
Zhang J, Qiao Y, Sarabi MS, Khansari MM, Gahm JK, Kashani AH, Shi Y. 3D Shape Modeling and Analysis of Retinal Microvasculature in OCT-Angiography Images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:1335-1346. [PMID: 31647423 PMCID: PMC7174137 DOI: 10.1109/tmi.2019.2948867] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/02/2023]
Abstract
3D optical coherence tomography angiography (OCT-A) is a novel and non-invasive imaging modality for analyzing retinal diseases. The studies of microvasculature in 2D en face projection images have been widely implemented, but comprehensive 3D analysis of OCT-A images with rich depth-resolved microvascular information is rarely considered. In this paper, we propose a robust, effective, and automatic 3D shape modeling framework to provide a high-quality 3D vessel representation and to preserve valuable 3D geometric and topological information for vessel analysis. Effective vessel enhancement and extraction steps by means of curvelet denoising and optimally oriented flux (OOF) filtering are first designed to produce 3D microvascular networks. Afterwards, a novel 3D data representation of OCT-A microvasculature is reconstructed via advanced mesh reconstruction techniques. Based on the 3D surfaces, shape analysis is established to extract novel shape-based microvascular area distortion via the Laplace-Beltrami eigen-projection. The extracted feature is integrated into a graph-cut segmentation system to categorize large vessels and small capillaries for more precise shape analysis. The proposed framework is validated on a dedicated repeated scan dataset including 260 volume images and shows high repeatability. Statistical analysis using the surface area biomarker is performed on small capillaries to avoid the effect of tailing artifact from large vessels. It shows significant differences ( ) between DR stages on 100 subjects in a OCTA-DR dataset. The proposed shape modeling and analysis framework opens the possibility for further investigating OCT-A microvasculature in a new perspective.
Collapse
Affiliation(s)
- Jiong Zhang
- Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA; USC Roski Eye Institute, Keck School of Medicine of University of Southern California, Los Angeles, CA 90033, USA
| | - Yuchuan Qiao
- Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA
| | - Mona Sharifi Sarabi
- Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA
| | - Maziyar M. Khansari
- Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA; USC Roski Eye Institute, Keck School of Medicine of University of Southern California, Los Angeles, CA 90033, USA
| | - Jin K. Gahm
- Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA
| | - Amir H. Kashani
- USC Roski Eye Institute, Keck School of Medicine of University of Southern California, Los Angeles, CA 90033, USA
| | | |
Collapse
|
34
|
Jerwick J, Huang Y, Dong Z, Slaudades A, Brucker AJ, Zhou C. Wide-field Ophthalmic Space-Division Multiplexing Optical Coherence Tomography. PHOTONICS RESEARCH 2020; 8:539-547. [PMID: 34222553 PMCID: PMC8248931 DOI: 10.1364/prj.383034] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/02/2023]
Abstract
High-speed ophthalmic optical coherence tomography systems are of interest because they allow rapid, motion-free, and wide-field retinal imaging. Space-division multiplexing optical coherence tomography (SDM-OCT) is a high-speed imaging technology which takes advantage of the long coherence length of microelectromechanical vertical cavity surface emitting laser (MEMs VCSEL) sources to multiplex multiple images along a single imaging depth. We demonstrate wide-field retinal OCT imaging, acquired at an effective A-scan rate of 800,000 A-scans/sec with volumetric images covering up to 12.5 mm × 7.4 mm on the retina acquired in less than 1 second. A clinical feasibility study was conducted to compare the ophthalmic SDM-OCT with commercial OCT systems, illustrating the high-speed capability of SDM-OCT in a clinical setting.
Collapse
Affiliation(s)
- Jason Jerwick
- Department of Electrical and Computer Engineering, Lehigh University, Bethlehem, PA 18015, USA
- Department of Biomedical Engineering, Washington University in St Louis, St Louis, MO, 63130
| | - Yongyang Huang
- Department of Electrical and Computer Engineering, Lehigh University, Bethlehem, PA 18015, USA
| | - Zhao Dong
- Department of Electrical and Computer Engineering, Lehigh University, Bethlehem, PA 18015, USA
- Department of Biomedical Engineering, Washington University in St Louis, St Louis, MO, 63130
| | - Adrienne Slaudades
- Scheie Eye Institute, Penn Presbyterian Medical Center, University of Pennsylvania, Philadelphia PA, 19104
| | - Alexander J. Brucker
- Scheie Eye Institute, Penn Presbyterian Medical Center, University of Pennsylvania, Philadelphia PA, 19104
| | - Chao Zhou
- Department of Electrical and Computer Engineering, Lehigh University, Bethlehem, PA 18015, USA
- Department of Biomedical Engineering, Washington University in St Louis, St Louis, MO, 63130
- Department of Bioengineering, Lehigh University, Bethlehem, PA 18015, USA
- Corresponding author:
| |
Collapse
|
35
|
Ecclestone BR, Abbasi S, Bell K, Dinakaran D, Bigras G, Mackey JR, Haji Reza P. Towards virtual biopsies of gastrointestinal tissues using photoacoustic remote sensing microscopy. Quant Imaging Med Surg 2020; 11:1070-1077. [PMID: 33654678 DOI: 10.21037/qims-20-722] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Gastrointestinal (GI) tissue biopsies provide critical diagnostic information for a wide variety of conditions such as neoplastic diseases (colorectal, small bowel and stomach cancers) and non-neoplastic diseases (inflammatory disorders, infection, celiac disease). Endoscopic biopsies collect small tissue samples that require resource intensive processing to permit histopathological analysis. Unfortunately, the sparsely collected biopsy samples may fail to capture the pathologic condition because selection of biopsy sites relies on macroscopic superficial tissue features and clinician judgement. Here, we present the first all-optical non-contact label-free non-interferometric photoacoustic microscopy system capable of performing "virtual biopsies". A modular photoacoustic remote sensing (PARS™) architecture is used facilitating imaging of unprocessed tissues providing information similar to conventional histopathological staining techniques. Prospectively this would allow gastroenterologists to assess subcellular tissue morphology in situ when selecting biopsy location. Tested on preserved unstained human and freshly resected murine tissues, the presented PARS microscope rapidly retrieves images of similar area to current biopsies, while maintaining comparable quality to the current standard for histopathological analysis. Additionally, results show the first label free assessment of subsurface cellular morphology in FFPE GI tissue blocks. Clinically relevant features are recovered including cellular details such as lamina propria within colon tissue and cell nuclear structure in resected smooth muscle. Constructed with a modular architecture, this system facilitates the future development of compact imaging heads. The modular PARS system overcomes many of the challenges with imaging unstained thick tissue in situ, representing a significant milestone in the development of a clinical microscope providing virtual biopsy capabilities.
Collapse
Affiliation(s)
- Benjamin R Ecclestone
- PhotoMedicine Labs, Department of Systems Design Engineering, University of Waterloo, Waterloo, Canada
| | - Saad Abbasi
- PhotoMedicine Labs, Department of Systems Design Engineering, University of Waterloo, Waterloo, Canada
| | - Kevan Bell
- PhotoMedicine Labs, Department of Systems Design Engineering, University of Waterloo, Waterloo, Canada.,illumiSonics Inc., Department of Systems Design Engineering, University of Waterloo, Waterloo, Canada
| | - Deepak Dinakaran
- illumiSonics Inc., Department of Systems Design Engineering, University of Waterloo, Waterloo, Canada.,Department of Oncology, University of Alberta, Edmonton, Canada
| | - Gilbert Bigras
- Department of Laboratory Medicine and Pathology, University of Alberta, Edmonton, Canada
| | - John R Mackey
- Department of Oncology, University of Alberta, Edmonton, Canada
| | - Parsin Haji Reza
- PhotoMedicine Labs, Department of Systems Design Engineering, University of Waterloo, Waterloo, Canada
| |
Collapse
|
36
|
Meadway A, Sincich LC. Light reflectivity and interference in cone photoreceptors. BIOMEDICAL OPTICS EXPRESS 2019; 10:6531-6554. [PMID: 31853415 PMCID: PMC6913404 DOI: 10.1364/boe.10.006531] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/05/2019] [Revised: 10/31/2019] [Accepted: 11/03/2019] [Indexed: 05/04/2023]
Abstract
In several modes of retinal imaging, the primary means of visualizing cone photoreceptors is from reflected light. Understanding how such images are formed, particularly when adaptive optics techniques are used, will help to guide their interpretation. Toward this end, we used finite difference beam propagation to model reflections from cone photoreceptors. We investigated the formation of cone images in adaptive optics scanning laser ophthalmoscopy (AOSLO) and optical coherence tomography (AOOCT). Three cone models were tested, one made up of three segments of varying refractive index, the other two having additional boundaries at the inner/outer segment junction and outer segment tip. Images formed by the first model did not correspond to AOOCT observations in the literature, while the latter two did. The predicted distributions of reflected light intensity from the latter cone models were compared to the distribution from AOSLO images, both studied with light sources of varied coherence length. The cone model with the most reflections at the inner/outer segment junction best fit the data measured in vivo. These results show that variance in cone reflection can originate from light interfering from reflectors much more closely spaced than the outer segment length. We also show that subtracting images taken with different coherence length sources highlights these changes in interference. Differential coherence images of cones occasionally revealed an annular reflection profile, which modeling showed to be very sensitive to cone size and the gaps bracketing the outer segment, suggesting that such imaging may be useful for probing photoreceptor morphology.
Collapse
Affiliation(s)
- Alexander Meadway
- Department of Optometry and Vision Science, University of Alabama at Birmingham, Birmingham, AL 35294, USA
| | - Lawrence C. Sincich
- Department of Optometry and Vision Science, University of Alabama at Birmingham, Birmingham, AL 35294, USA
| |
Collapse
|
37
|
Li Y, Chen J, Chen Z. Advances in Doppler optical coherence tomography and angiography. TRANSLATIONAL BIOPHOTONICS 2019; 1:e201900005. [PMID: 33005888 PMCID: PMC7523705 DOI: 10.1002/tbio.201900005] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2019] [Accepted: 11/14/2019] [Indexed: 12/22/2022] Open
Abstract
Since the first demonstration of Doppler optical coherence tomography (OCT) in 1997, several functional extensions of Doppler OCT have been developed, including velocimetry, angiogram, and optical coherence elastography. These functional techniques have been widely used in research and clinical applications, particularly in ophthalmology. Here, we review the principles, representative methods, and applications of different Doppler OCT techniques, followed by discussion on the innovations, limitations, and future directions of each of these techniques.
Collapse
Affiliation(s)
- Yan Li
- Beckman Laser Institute, University of California, Irvine, California
- Department of Biomedical Engineering, University of California, Irvine, California
| | - Jason Chen
- Beckman Laser Institute, University of California, Irvine, California
- Department of Biomedical Engineering, University of California, Irvine, California
| | - Zhongping Chen
- Beckman Laser Institute, University of California, Irvine, California
- Department of Biomedical Engineering, University of California, Irvine, California
| |
Collapse
|
38
|
Review on Retrospective Procedures to Correct Retinal Motion Artefacts in OCT Imaging. APPLIED SCIENCES-BASEL 2019. [DOI: 10.3390/app9132700] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Abstract
Motion artefacts from involuntary changes in eye fixation remain a major imaging issue in optical coherence tomography (OCT). This paper reviews the state-of-the-art of retrospective procedures to correct retinal motion and axial eye motion artefacts in OCT imaging. Following an overview of motion induced artefacts and correction strategies, a chronological survey of retrospective approaches since the introduction of OCT until the current days is presented. Pre-processing, registration, and validation techniques are described. The review finishes by discussing the limitations of the current techniques and the challenges to be tackled in future developments.
Collapse
|
39
|
Qian R, Huang WF, McNabb RP, Zhou KC, Liu QH, Kuo AN, Izatt JA. Ocular anterior chamber blood cell population differentiation using spectroscopic optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2019; 10:3281-3300. [PMID: 31467779 PMCID: PMC6706034 DOI: 10.1364/boe.10.003281] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/25/2019] [Revised: 05/22/2019] [Accepted: 05/29/2019] [Indexed: 05/24/2023]
Abstract
There is potential clinical significance in identifying cellular responses in the anterior chamber (AC) of the eye, which can indicate hyphema (an accumulation of red blood cells [RBCs]) or aberrant intraocular inflammation (an accumulation of white blood cells [WBCs]). In this work, we developed a spectroscopic OCT analysis method to differentiate between populations of RBCs and subtypes of WBCs, including granulocytes, lymphocytes and monocytes, both in vitro and in ACs of porcine eyes. We developed an algorithm to track single cells within OCT data sets, and extracted the backscatter reflectance spectrum of each single cell from the detected interferograms using the short-time Fourier transform (STFT). A look-up table of Mie back-scattering spectra was generated and used to correlate the backscatter spectral features of single cells to their characteristic sizes. The extracted size distributions based on the best Mie spectra fit were significantly different between each cell type. We also studied theoretical backscattering models of single RBCs to further validate our experimental results. The described work is a promising step towards clinically differentiating and quantifying AC blood cell types.
Collapse
Affiliation(s)
- Ruobing Qian
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Wei-feng Huang
- Department of Electrical and Computer Engineering, Duke University, Durham, NC 27708, USA
| | - Ryan P. McNabb
- Department of Ophthalmology, Duke University Medical Center, NC 27710, USA
| | - Kevin C. Zhou
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Qing H. Liu
- Department of Electrical and Computer Engineering, Duke University, Durham, NC 27708, USA
| | - Anthony N. Kuo
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
- Department of Ophthalmology, Duke University Medical Center, NC 27710, USA
| | - Joseph A. Izatt
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
- Department of Ophthalmology, Duke University Medical Center, NC 27710, USA
| |
Collapse
|
40
|
Scholler J, Mazlin V, Thouvenin O, Groux K, Xiao P, Sahel JA, Fink M, Boccara C, Grieve K. Probing dynamic processes in the eye at multiple spatial and temporal scales with multimodal full field OCT. BIOMEDICAL OPTICS EXPRESS 2019; 10:731-746. [PMID: 30800511 PMCID: PMC6377896 DOI: 10.1364/boe.10.000731] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/17/2018] [Revised: 01/07/2019] [Accepted: 01/07/2019] [Indexed: 05/08/2023]
Abstract
We describe recent technological progress in multimodal en face full-field optical coherence tomography that has allowed detection of slow and fast dynamic processes in the eye. We show that by combining static, dynamic and fluorescence contrasts we can achieve label-free high-resolution imaging of the retina and anterior eye with temporal resolution from milliseconds to several hours, allowing us to probe biological activity at subcellular scales inside 3D bulk tissue. Our setups combine high lateral resolution over a large field of view with acquisition at several hundreds of frames per second which make it a promising tool for clinical applications and biomedical studies. Its contactless and non-destructive nature is shown to be effective for both following in vitro sample evolution over long periods of time and for imaging of the human eye in vivo.
Collapse
Affiliation(s)
- Jules Scholler
- Institut Langevin, ESPCI Paris, CNRS, PSL University, 1 rue Jussieu, 75005 Paris,
France
| | - Viacheslav Mazlin
- Institut Langevin, ESPCI Paris, CNRS, PSL University, 1 rue Jussieu, 75005 Paris,
France
| | - Olivier Thouvenin
- Institut Langevin, ESPCI Paris, CNRS, PSL University, 1 rue Jussieu, 75005 Paris,
France
| | - Kassandra Groux
- Institut Langevin, ESPCI Paris, CNRS, PSL University, 1 rue Jussieu, 75005 Paris,
France
- LLTech SAS, 29 Rue du Faubourg Saint Jacques, Paris, 75014,
France
| | - Peng Xiao
- Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou,
China
| | - José-Alain Sahel
- Vision Institute/CIC 1423, UPMC-Sorbonne Universities, UMR_S 968/INSERM, U968/CNRS, UMR_7210, 17 Rue Moreau, Paris, 75012,
France
- Quinze-Vingts National Eye Hospital, 28 Rue de Charenton, Paris, 75012,
France
- Department of Ophthalmology, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213,
USA
| | - Mathias Fink
- Institut Langevin, ESPCI Paris, CNRS, PSL University, 1 rue Jussieu, 75005 Paris,
France
| | - Claude Boccara
- Institut Langevin, ESPCI Paris, CNRS, PSL University, 1 rue Jussieu, 75005 Paris,
France
- LLTech SAS, 29 Rue du Faubourg Saint Jacques, Paris, 75014,
France
| | - Kate Grieve
- Vision Institute/CIC 1423, UPMC-Sorbonne Universities, UMR_S 968/INSERM, U968/CNRS, UMR_7210, 17 Rue Moreau, Paris, 75012,
France
- Quinze-Vingts National Eye Hospital, 28 Rue de Charenton, Paris, 75012,
France
| |
Collapse
|
41
|
Migacz JV, Gorczynska I, Azimipour M, Jonnal R, Zawadzki RJ, Werner JS. Megahertz-rate optical coherence tomography angiography improves the contrast of the choriocapillaris and choroid in human retinal imaging. BIOMEDICAL OPTICS EXPRESS 2019; 10:50-65. [PMID: 30775082 PMCID: PMC6363198 DOI: 10.1364/boe.10.000050] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/10/2018] [Revised: 11/25/2018] [Accepted: 11/27/2018] [Indexed: 05/03/2023]
Abstract
Angiographic imaging of the human eye with optical coherence tomography (OCT) is becoming an increasingly important tool in the scientific investigation and clinical management of several blinding diseases, including age-related macular degeneration and diabetic retinopathy. We have observed that OCT angiography (OCTA) of the human choriocapillaris and choroid with a 1.64 MHz A-scan rate swept-source laser yields higher contrast images as compared to a slower rate system operating at 100 kHz. This result is unexpected because signal sensitivity is reduced when acquisition rates are increased, and the incident illumination power is kept constant. The contrast of angiography images generated by acquiring multiple sequential frames and calculating the variation caused by blood flow, however, appears to be improved significantly when lower-contrast images are taken more rapidly. To demonstrate that the acquisition rate plays a role in the quality improvement, we have imaged five healthy subjects with a narrow field of view (1.2 mm) OCTA imaging system using two separate swept-source lasers of different A-line rates and compared the results quantitatively using the radially-averaged power spectrum. The average improvement in the contrast is 23.0% (+/-7.6%). Although the underlying cause of this enhancement is not explicitly determined here, we speculate that the higher-speed system suppresses the noise contribution from eye motion in subjects and operates with an inter-scan time that better discriminates the flow velocities present in the choroid and choriocapillaris. Our result informs OCT system developers on the merits of ultrahigh-speed acquisition in functional imaging applications.
Collapse
Affiliation(s)
- Justin V. Migacz
- Vison Science and Advanced Retinal Imaging Laboratory, Department of Ophthalmology & Vision Science, University of California Davis, Sacramento, CA 95817, USA
| | - Iwona Gorczynska
- Vison Science and Advanced Retinal Imaging Laboratory, Department of Ophthalmology & Vision Science, University of California Davis, Sacramento, CA 95817, USA
- Institute of Physics, Faculty of Physics, Astronomy, and Informatics, Nicolaus Copernicus University in Torun, Grudziadzka 5, 87-100 Torun, Poland
| | - Mehdi Azimipour
- Vison Science and Advanced Retinal Imaging Laboratory, Department of Ophthalmology & Vision Science, University of California Davis, Sacramento, CA 95817, USA
| | - Ravi Jonnal
- Vison Science and Advanced Retinal Imaging Laboratory, Department of Ophthalmology & Vision Science, University of California Davis, Sacramento, CA 95817, USA
| | - Robert J. Zawadzki
- Vison Science and Advanced Retinal Imaging Laboratory, Department of Ophthalmology & Vision Science, University of California Davis, Sacramento, CA 95817, USA
| | - John S. Werner
- Vison Science and Advanced Retinal Imaging Laboratory, Department of Ophthalmology & Vision Science, University of California Davis, Sacramento, CA 95817, USA
| |
Collapse
|
42
|
Spaide RF, Fujimoto JG, Waheed NK, Sadda SR, Staurenghi G. Optical coherence tomography angiography. Prog Retin Eye Res 2018; 64:1-55. [PMID: 29229445 PMCID: PMC6404988 DOI: 10.1016/j.preteyeres.2017.11.003] [Citation(s) in RCA: 992] [Impact Index Per Article: 165.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2017] [Revised: 11/20/2017] [Accepted: 11/22/2017] [Indexed: 02/07/2023]
Abstract
Optical coherence tomography (OCT) was one of the biggest advances in ophthalmic imaging. Building on that platform, OCT angiography (OCTA) provides depth resolved images of blood flow in the retina and choroid with levels of detail far exceeding that obtained with older forms of imaging. This new modality is challenging because of the need for new equipment and processing techniques, current limitations of imaging capability, and rapid advancements in both imaging and in our understanding of the imaging and applicable pathophysiology of the retina and choroid. These factors lead to a steep learning curve, even for those with a working understanding dye-based ocular angiography. All for a method of imaging that is a little more than 10 years old. This review begins with a historical account of the development of OCTA, and the methods used in OCTA, including signal processing, image generation, and display techniques. This forms the basis to understand what OCTA images show as well as how image artifacts arise. The anatomy and imaging of specific vascular layers of the eye are reviewed. The integration of OCTA in multimodal imaging in the evaluation of retinal vascular occlusive diseases, diabetic retinopathy, uveitis, inherited diseases, age-related macular degeneration, and disorders of the optic nerve is presented. OCTA is an exciting, disruptive technology. Its use is rapidly expanding in clinical practice as well as for research into the pathophysiology of diseases of the posterior pole.
Collapse
Affiliation(s)
- Richard F Spaide
- Vitreous, Retina, Macula Consultants of New York, New York, NY, United States.
| | - James G Fujimoto
- Department of Electrical Engineering & Computer Science and Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge MA, United States
| | - Nadia K Waheed
- The Department of Ophthalmology, Tufts University School of Medicine, Boston MA, United States
| | - Srinivas R Sadda
- Doheny Eye Institute, University of California - Los Angeles, Los Angeles, CA, United States
| | - Giovanni Staurenghi
- Eye Clinic, Department of Biomedical and Clinical Sciences "Luigi Sacco", Luigi Sacco Hospital, University of Milan, Milan, Italy
| |
Collapse
|
43
|
Chen Y, Hong YJ, Makita S, Yasuno Y. Eye-motion-corrected optical coherence tomography angiography using Lissajous scanning. BIOMEDICAL OPTICS EXPRESS 2018; 9:1111-1129. [PMID: 29541507 PMCID: PMC5846517 DOI: 10.1364/boe.9.001111] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/22/2017] [Revised: 02/01/2018] [Accepted: 02/02/2018] [Indexed: 05/20/2023]
Abstract
To correct eye motion artifacts in en face optical coherence tomography angiography (OCT-A) images, a Lissajous scanning method with subsequent software-based motion correction is proposed. The standard Lissajous scanning pattern is modified to be compatible with OCT-A and a corresponding motion correction algorithm is designed. The effectiveness of our method was demonstrated by comparing en face OCT-A images with and without motion correction. The method was further validated by comparing motion-corrected images with scanning laser ophthalmoscopy images, and the repeatability of the method was evaluated using a checkerboard image. A motion-corrected en face OCT-A image from a blinking case is presented to demonstrate the ability of the method to deal with eye blinking. Results show that the method can produce accurate motion-free en face OCT-A images of the posterior segment of the eye in vivo.
Collapse
Affiliation(s)
- Yiwei Chen
- Computational Optics Group, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8573,
Japan
- Computational Optics and Ophthalmology Group, Tsukuba, Ibaraki 305-8531,
Japan
| | - Young-Joo Hong
- Computational Optics Group, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8573,
Japan
- Computational Optics and Ophthalmology Group, Tsukuba, Ibaraki 305-8531,
Japan
| | - Shuichi Makita
- Computational Optics Group, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8573,
Japan
- Computational Optics and Ophthalmology Group, Tsukuba, Ibaraki 305-8531,
Japan
| | - Yoshiaki Yasuno
- Computational Optics Group, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki 305-8573,
Japan
- Computational Optics and Ophthalmology Group, Tsukuba, Ibaraki 305-8531,
Japan
| |
Collapse
|
44
|
Vienola KV, Damodaran M, Braaf B, Vermeer KA, de Boer JF. In vivo retinal imaging for fixational eye motion detection using a high-speed digital micromirror device (DMD)-based ophthalmoscope. BIOMEDICAL OPTICS EXPRESS 2018; 9:591-602. [PMID: 29552396 PMCID: PMC5854061 DOI: 10.1364/boe.9.000591] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/17/2017] [Revised: 12/14/2017] [Accepted: 12/19/2017] [Indexed: 05/04/2023]
Abstract
Retinal motion detection with an accuracy of 0.77 arcmin corresponding to 3.7 µm on the retina is demonstrated with a novel digital micromirror device based ophthalmoscope. By generating a confocal image as a reference, eye motion could be measured from consecutively measured subsampled frames. The subsampled frames provide 7.7 millisecond snapshots of the retina without motion artifacts between the image points of the subsampled frame, distributed over the full field of view. An ophthalmoscope pattern projection speed of 130 Hz enabled a motion detection bandwidth of 65 Hz. A model eye with a scanning mirror was built to test the performance of the motion detection algorithm. Furthermore, an in vivo motion trace was obtained from a healthy volunteer. The obtained eye motion trace clearly shows the three main types of fixational eye movements. Lastly, the obtained eye motion trace was used to correct for the eye motion in consecutively obtained subsampled frames to produce an averaged confocal image correct for motion artefacts.
Collapse
Affiliation(s)
- Kari V. Vienola
- LaserLaB, Department of Physics and Astronomy, Vrije Universiteit Amsterdam, De Boelelaan 1081, HV Amsterdam, The Netherlands
| | - Mathi Damodaran
- LaserLaB, Department of Physics and Astronomy, Vrije Universiteit Amsterdam, De Boelelaan 1081, HV Amsterdam, The Netherlands
| | - Boy Braaf
- LaserLaB, Department of Physics and Astronomy, Vrije Universiteit Amsterdam, De Boelelaan 1081, HV Amsterdam, The Netherlands
| | - Koenraad A. Vermeer
- Rotterdam Ophthalmic Institute, Schiedamse Vest 160D, 3011 BH Rotterdam, The Netherlands
| | - Johannes F. de Boer
- LaserLaB, Department of Physics and Astronomy, Vrije Universiteit Amsterdam, De Boelelaan 1081, HV Amsterdam, The Netherlands
| |
Collapse
|
45
|
Kaya A, Keçeli AS, Can AB, Çakmak HB. Cyclotorsion measurement using scleral blood vessels. Comput Biol Med 2017; 87:152-161. [PMID: 28595130 DOI: 10.1016/j.compbiomed.2017.05.030] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2017] [Revised: 05/29/2017] [Accepted: 05/29/2017] [Indexed: 10/19/2022]
Abstract
BACKGROUND AND OBJECTIVES Measurements of the cyclotorsional movement of the eye are crucial in refractive surgery procedures. The planned surgery pattern may vary substantially during an operation because of the position and eye movements of the patient. Since these factors affect the outcome of an operation, eye registration methods are applied in order to compensate for errors. While the majority of applications are based on features of the iris, we propose a registration method which uses scleral blood vessels. Unlike previous offline techniques, the proposed method is applicable during surgery. METHODS The sensitivity of the proposed registration method is tested on an artificial benchmark dataset involving five eye models and 46,305 instances of eye images. The cyclotorsion angles of the dataset vary between -10° and +10° at 1° intervals. Repeated measurements and ANOVA and Cochran's Q tests are applied in order to determine the significance of the proposed method. Additionally, a pilot study is carried out using data obtained from a commercially available device. The real data are validated using manual marking by an expert. RESULTS AND CONCLUSIONS The results confirm that the proposed method produces a smaller error rate (mean = 0.44 ± 0.41) compared to the existing method in [1] (mean = 0.64 ± 0.58). A further conclusion is that feature extraction algorithms affect the results of the proposed method. The SIFT (mean = 0.74 ± 0.78), SURF64 (mean = 0.56 ± 0.46), SURF128 (mean = 0.57 ± 0.48) and ASIFT (mean = 0.29 ± 0.25) feature extraction algorithms were examined; the ASIFT method was the most successful of these algorithms. Scleral blood vessels are observed to be useful as a feature extraction region due to their textural properties.
Collapse
Affiliation(s)
- Aydın Kaya
- Hacettepe University, Faculty of Engineering, Department of Computer Engineering, 06800, Ankara, Turkey.
| | - Ali Seydi Keçeli
- Hacettepe University, Faculty of Engineering, Department of Computer Engineering, 06800, Ankara, Turkey.
| | - Ahmet Burak Can
- Hacettepe University, Faculty of Engineering, Department of Computer Engineering, 06800, Ankara, Turkey.
| | - Hasan Basri Çakmak
- Hitit University, Faculty of Medicine, Department of Ophthalmology, 19030, Çorum, Turkey.
| |
Collapse
|
46
|
Carrasco-Zevallos OM, Keller B, Viehland C, Shen L, Seider MI, Izatt JA, Toth CA. Optical Coherence Tomography for Retinal Surgery: Perioperative Analysis to Real-Time Four-Dimensional Image-Guided Surgery. Invest Ophthalmol Vis Sci 2017; 57:OCT37-50. [PMID: 27409495 PMCID: PMC4968921 DOI: 10.1167/iovs.16-19277] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023] Open
Abstract
Magnification of the surgical field using the operating microscope facilitated profound innovations in retinal surgery in the 1970s, such as pars plana vitrectomy. Although surgical instrumentation and illumination techniques are continually developing, the operating microscope for vitreoretinal procedures has remained essentially unchanged and currently limits the surgeon's depth perception and assessment of subtle microanatomy. Optical coherence tomography (OCT) has revolutionized clinical management of retinal pathology, and its introduction into the operating suite may have a similar impact on surgical visualization and treatment. In this article, we review the evolution of OCT for retinal surgery, from perioperative analysis to live volumetric (four-dimensional, 4D) image-guided surgery. We begin by briefly addressing the benefits and limitations of the operating microscope, the progression of OCT technology, and OCT applications in clinical/perioperative retinal imaging. Next, we review intraoperative OCT (iOCT) applications using handheld probes during surgical pauses, two-dimensional (2D) microscope-integrated OCT (MIOCT) of live surgery, and volumetric MIOCT of live surgery. The iOCT discussion focuses on technological advancements, applications during human retinal surgery, translational difficulties and limitations, and future directions.
Collapse
Affiliation(s)
| | - Brenton Keller
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, United States
| | - Christian Viehland
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, United States
| | - Liangbo Shen
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, United States
| | - Michael I Seider
- Department of Ophthalmology, Duke University Medical Center, Durham, North Carolina, United States
| | - Joseph A Izatt
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, United States 2Department of Ophthalmology, Duke University Medical Center, Durham, North Carolina, United States
| | - Cynthia A Toth
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, United States 2Department of Ophthalmology, Duke University Medical Center, Durham, North Carolina, United States
| |
Collapse
|
47
|
Camino A, Jia Y, Liu G, Wang J, Huang D. Regression-based algorithm for bulk motion subtraction in optical coherence tomography angiography. BIOMEDICAL OPTICS EXPRESS 2017; 8:3053-3066. [PMID: 28663926 PMCID: PMC5480449 DOI: 10.1364/boe.8.003053] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2017] [Revised: 05/09/2017] [Accepted: 05/09/2017] [Indexed: 05/05/2023]
Abstract
We developed an algorithm to remove decorrelation noise due to bulk motion in optical coherence tomography angiography (OCTA) of the posterior eye. In this algorithm, OCTA B-frames were divided into segments within which the bulk motion velocity could be assumed to be constant. This velocity was recovered using linear regression of decorrelation versus the logarithm of reflectance in axial lines (A-lines) identified as bulk tissue by percentile analysis. The fitting parameters were used to calculate a reflectance-adjusted upper bound threshold for bulk motion decorrelation. Below this threshold, voxels are identified as non-flow tissue, their flow values are set to zeros. Above this threshold, the voxels are identified as flow voxels and bulk motion velocity is subtracted from each using a nonlinear decorrelation-velocity relationship previously established in laboratory flow phantoms. Compared to the simpler median-subtraction method, the regression-based bulk motion subtraction improved angiogram signal-to-noise ratio, contrast, vessel density repeatability, and bulk motion noise cleanup in the foveal avascular zone, while preserving the connectivity of the vascular networks in the angiogram.
Collapse
|
48
|
Damodaran M, Vienola KV, Braaf B, Vermeer KA, de Boer JF. Digital micromirror device based ophthalmoscope with concentric circle scanning. BIOMEDICAL OPTICS EXPRESS 2017; 8:2766-2780. [PMID: 28663905 PMCID: PMC5480512 DOI: 10.1364/boe.8.002766] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/21/2017] [Revised: 04/22/2017] [Accepted: 04/24/2017] [Indexed: 05/04/2023]
Abstract
Retinal imaging is demonstrated using a novel scanning light ophthalmoscope based on a digital micromirror device with 810 nm illumination. Concentric circles were used as scan patterns, which facilitated fixation by a human subject for imaging. An annular illumination was implemented in the system to reduce the background caused by corneal reflections and thereby to enhance the signal-to-noise ratio. A 1.9-fold increase in the signal-to-noise ratio was found by using an annular illumination aperture compared to a circular illumination aperture, resulting in a 5-fold increase in imaging speed and a better signal-to-noise ratio compared to our previous system. We tested the imaging performance of our system by performing non-mydriatic imaging on two subjects at a speed of 7 Hz with a maximum 20° (diameter) field of view. The images were shot noise limited and clearly show various anatomical features of the retina with high contrast.
Collapse
Affiliation(s)
- Mathi Damodaran
- LaserLaB, Department of Physics and Astronomy, Vrije Universiteit Amsterdam, De Boelelaan 1081, 1081 HV Amsterdam,
The Netherlands
| | - Kari V. Vienola
- LaserLaB, Department of Physics and Astronomy, Vrije Universiteit Amsterdam, De Boelelaan 1081, 1081 HV Amsterdam,
The Netherlands
| | - Boy Braaf
- LaserLaB, Department of Physics and Astronomy, Vrije Universiteit Amsterdam, De Boelelaan 1081, 1081 HV Amsterdam,
The Netherlands
| | - Koenraad A. Vermeer
- Rotterdam Ophthalmic Institute, Schiedamse Vest 160D, 3011 BH Rotterdam,
The Netherlands
| | - Johannes F. de Boer
- LaserLaB, Department of Physics and Astronomy, Vrije Universiteit Amsterdam, De Boelelaan 1081, 1081 HV Amsterdam,
The Netherlands
| |
Collapse
|
49
|
Bedggood P, Metha A. De-warping of images and improved eye tracking for the scanning laser ophthalmoscope. PLoS One 2017; 12:e0174617. [PMID: 28369065 PMCID: PMC5378343 DOI: 10.1371/journal.pone.0174617] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2016] [Accepted: 03/12/2017] [Indexed: 11/18/2022] Open
Abstract
A limitation of scanning laser ophthalmoscopy (SLO) is that eye movements during the capture of each frame distort the retinal image. Various sophisticated strategies have been devised to ensure that each acquired frame can be mapped quickly and accurately onto a chosen reference frame, but such methods are blind to distortions in the reference frame itself. Here we explore a method to address this limitation in software, and demonstrate its accuracy. We used high-speed (200 fps), high-resolution (~1 μm), flood-based imaging of the human retina with adaptive optics to obtain “ground truth” information on the retinal image and motion of the eye. This information was used to simulate SLO video sequences at 20 fps, allowing us to compare various methods for eye-motion recovery and subsequent minimization of intra-frame distortion. We show that a) a single frame can be near-perfectly recovered with perfect knowledge of intra-frame eye motion; b) eye motion at a given time point within a frame can be accurately recovered by tracking the same strip of tissue across many frames, due to the stochastic symmetry of fixational eye movements. This approach is similar to, and easily adapted from, previously suggested strip-registration approaches; c) quality of frame recovery decreases with amplitude of eye movements, however, the proposed method is affected less by this than other state-of-the-art methods and so offers even greater advantages when fixation is poor. The new method could easily be integrated into existing image processing software, and we provide an example implementation written in Matlab.
Collapse
Affiliation(s)
- Phillip Bedggood
- Department of Optometry and Vision Sciences, University of Melbourne, Parkville, Victoria, Australia
- * E-mail:
| | - Andrew Metha
- Department of Optometry and Vision Sciences, University of Melbourne, Parkville, Victoria, Australia
| |
Collapse
|
50
|
Chen Y, Hong YJ, Makita S, Yasuno Y. Three-dimensional eye motion correction by Lissajous scan optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2017; 8:1783-1802. [PMID: 28663866 PMCID: PMC5480581 DOI: 10.1364/boe.8.001783] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/27/2016] [Revised: 02/17/2017] [Accepted: 02/17/2017] [Indexed: 05/18/2023]
Abstract
A three-dimensional optical coherence tomography imaging method based on Lissajous scanning is presented. This method was designed to correct eye motion in OCT images. A Lissajous scanning pattern, which has a trajectory that frequently overlaps with itself, is adopted as the OCT scanning protocol to obtain measurement data. Eye motion artifacts are then corrected automatically by software. By comparing the images without and with motion correction, we show the effectiveness of our method. We performed an experiment and compared the results obtained by our method with the ground truths to verify its validity. The experimental results showed that our method effectively corrects eye motion artifacts. Furthermore, the sufficient repeatability of our method was confirmed.
Collapse
Affiliation(s)
- Yiwei Chen
- Computational Optics Group, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki, 305-8573,
Japan
- Computational Optics and Ophthalmology Group, Tsukuba, Ibaraki,
Japan
| | - Young-Joo Hong
- Computational Optics Group, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki, 305-8573,
Japan
- Computational Optics and Ophthalmology Group, Tsukuba, Ibaraki,
Japan
| | - Shuichi Makita
- Computational Optics Group, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki, 305-8573,
Japan
- Computational Optics and Ophthalmology Group, Tsukuba, Ibaraki,
Japan
| | - Yoshiaki Yasuno
- Computational Optics Group, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, Ibaraki, 305-8573,
Japan
- Computational Optics and Ophthalmology Group, Tsukuba, Ibaraki,
Japan
| |
Collapse
|