1
|
Hormel TT, Jia Y, Jian Y, Hwang TS, Bailey ST, Pennesi ME, Wilson DJ, Morrison JC, Huang D. Plexus-specific retinal vascular anatomy and pathologies as seen by projection-resolved optical coherence tomographic angiography. Prog Retin Eye Res 2021; 80:100878. [PMID: 32712135 PMCID: PMC7855241 DOI: 10.1016/j.preteyeres.2020.100878] [Citation(s) in RCA: 81] [Impact Index Per Article: 20.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2019] [Revised: 05/13/2020] [Accepted: 05/18/2020] [Indexed: 12/22/2022]
Abstract
Optical coherence tomographic angiography (OCTA) is a novel technology capable of imaging retinal vasculature three-dimensionally at capillary scale without the need to inject any extrinsic dye contrast. However, projection artifacts cause superficial retinal vascular patterns to be duplicated in deeper layers, thus interfering with the clean visualization of some retinal plexuses and vascular pathologies. Projection-resolved OCTA (PR-OCTA) uses post-processing algorithms to reduce projection artifacts. With PR-OCTA, it is now possible to resolve up to 4 distinct retinal vascular plexuses in the living human eye. The technology also allows us to detect and distinguish between various retinal and optic nerve diseases. For example, optic nerve diseases such as glaucoma primarily reduces the capillary density in the superficial vascular complex, which comprises the nerve fiber layer plexus and the ganglion cell layer plexus. Outer retinal diseases such as retinitis pigmentosa primarily reduce the capillary density in the deep vascular complex, which comprises the intermediate capillary plexus and the deep capillary plexus. Retinal vascular diseases such as diabetic retinopathy and vein occlusion affect all plexuses, but with different patterns of capillary loss and vascular malformations. PR-OCTA is also useful in distinguishing various types of choroidal neovascularization and monitoring their response to anti-angiogenic medications. In retinal angiomatous proliferation and macular telangiectasia type 2, PR-OCTA can trace the pathologic vascular extension into deeper layers as the disease progress through stages. Plexus-specific visualization and measurement of retinal vascular changes are improving our ability to diagnose, stage, monitor, and assess treatment response in a wide variety of optic nerve and retinal diseases. These applications will be further enhanced with the continuing improvement of the speed and resolution of the OCT platforms, as well as the development of software algorithms to reduce artifacts, improve image quality, and make quantitative measurements.
Collapse
|
Research Support, N.I.H., Extramural |
4 |
81 |
2
|
Hormel TT, Kurihara SQ, Brennan MK, Wozniak MC, Parthasarathy R. Measuring lipid membrane viscosity using rotational and translational probe diffusion. PHYSICAL REVIEW LETTERS 2014; 112:188101. [PMID: 24856725 DOI: 10.1103/physrevlett.112.188101] [Citation(s) in RCA: 63] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/02/2013] [Indexed: 05/23/2023]
Abstract
The two-dimensional fluidity of lipid bilayers enables the motion of membrane-bound macromolecules and is therefore crucial to biological function. Microrheological methods that measure fluid viscosity via the translational diffusion of tracer particles are challenging to apply and interpret for membranes, due to uncertainty about the local environment of the tracers. Here, we demonstrate a new technique in which determination of both the rotational and translational diffusion coefficients of membrane-linked particles enables quantification of viscosity, measurement of the effective radii of the tracers, and assessment of theoretical models of membrane hydrodynamics. Surprisingly, we find a wide distribution of effective tracer radii, presumably due to a variable number of lipids linked to each tracer particle. Furthermore, we show for the first time that a protein involved in generating membrane curvature, the vesicle trafficking protein Sar1p, dramatically increases membrane viscosity. Using the rheological method presented here, therefore, we are able to reveal a class of previously unknown couplings between protein activity and membrane mechanics.
Collapse
|
|
11 |
63 |
3
|
Hormel TT, Hwang TS, Bailey ST, Wilson DJ, Huang D, Jia Y. Artificial intelligence in OCT angiography. Prog Retin Eye Res 2021; 85:100965. [PMID: 33766775 PMCID: PMC8455727 DOI: 10.1016/j.preteyeres.2021.100965] [Citation(s) in RCA: 45] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 03/09/2021] [Accepted: 03/15/2021] [Indexed: 12/21/2022]
Abstract
Optical coherence tomographic angiography (OCTA) is a non-invasive imaging modality that provides three-dimensional, information-rich vascular images. With numerous studies demonstrating unique capabilities in biomarker quantification, diagnosis, and monitoring, OCTA technology has seen rapid adoption in research and clinical settings. The value of OCTA imaging is significantly enhanced by image analysis tools that provide rapid and accurate quantification of vascular features and pathology. Today, the most powerful image analysis methods are based on artificial intelligence (AI). While AI encompasses a large variety of techniques, machine-learning-based, and especially deep-learning-based, image analysis provides accurate measurements in a variety of contexts, including different diseases and regions of the eye. Here, we discuss the principles of both OCTA and AI that make their combination capable of answering new questions. We also review contemporary applications of AI in OCTA, which include accurate detection of pathologies such as choroidal neovascularization, precise quantification of retinal perfusion, and reliable disease diagnosis.
Collapse
|
Research Support, N.I.H., Extramural |
4 |
45 |
4
|
Wang J, Hormel TT, Gao L, Zang P, Guo Y, Wang X, Bailey ST, Jia Y. Automated diagnosis and segmentation of choroidal neovascularization in OCT angiography using deep learning. BIOMEDICAL OPTICS EXPRESS 2020; 11:927-944. [PMID: 32133230 PMCID: PMC7041469 DOI: 10.1364/boe.379977] [Citation(s) in RCA: 40] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/08/2019] [Revised: 01/02/2020] [Accepted: 01/03/2020] [Indexed: 05/06/2023]
Abstract
Accurate identification and segmentation of choroidal neovascularization (CNV) is essential for the diagnosis and management of exudative age-related macular degeneration (AMD). Projection-resolved optical coherence tomographic angiography (PR-OCTA) enables both cross-sectional and en face visualization of CNV. However, CNV identification and segmentation remains difficult even with PR-OCTA due to the presence of residual artifacts. In this paper, a fully automated CNV diagnosis and segmentation algorithm using convolutional neural networks (CNNs) is described. This study used a clinical dataset, including both scans with and without CNV, and scans of eyes with different pathologies. Furthermore, no scans were excluded due to image quality. In testing, all CNV cases were diagnosed from non-CNV controls with 100% sensitivity and 95% specificity. The mean intersection over union of CNV membrane segmentation was as high as 0.88. By enabling fully automated categorization and segmentation, the proposed algorithm should offer benefits for CNV diagnosis, visualization monitoring.
Collapse
|
research-article |
5 |
40 |
5
|
Guo Y, Hormel TT, Xiong H, Wang B, Camino A, Wang J, Huang D, Hwang TS, Jia Y. Development and validation of a deep learning algorithm for distinguishing the nonperfusion area from signal reduction artifacts on OCT angiography. BIOMEDICAL OPTICS EXPRESS 2019; 10:3257-3268. [PMID: 31360599 PMCID: PMC6640834 DOI: 10.1364/boe.10.003257] [Citation(s) in RCA: 37] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/26/2019] [Revised: 05/24/2019] [Accepted: 05/28/2019] [Indexed: 05/06/2023]
Abstract
The capillary nonperfusion area (NPA) is a key quantifiable biomarker in the evaluation of diabetic retinopathy (DR) using optical coherence tomography angiography (OCTA). However, signal reduction artifacts caused by vitreous floaters, pupil vignetting, or defocus present significant obstacles to accurate quantification. We have developed a convolutional neural network, MEDnet-V2, to distinguish NPA from signal reduction artifacts in 6×6 mm2 OCTA. The network achieves strong specificity and sensitivity for NPA detection across a wide range of DR severity and scan quality.
Collapse
|
research-article |
6 |
37 |
6
|
Hormel TT, Huang D, Jia Y. Artifacts and artifact removal in optical coherence tomographic angiography. Quant Imaging Med Surg 2021; 11:1120-1133. [PMID: 33654681 PMCID: PMC7829161 DOI: 10.21037/qims-20-730] [Citation(s) in RCA: 37] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2020] [Accepted: 07/29/2020] [Indexed: 02/04/2023]
Abstract
Optical coherence tomographic angiography (OCTA) enables rapid imaging of retinal vasculature in three dimensions. While the technique has provided quantification of healthy vessels as well as pathology in several diseases, it is not unusual for OCTA data to contain artifacts that may influence measurement outcomes or defy image interpretation. In this review, we discuss the sources of several OCTA artifacts-including projection, motion, and signal reduction-as well as strategies for their removal. Artifact compensation can improve the accuracy of OCTA measurements, and the most effective use of the technology will incorporate hardware and software that can perform such correction.
Collapse
|
Review |
4 |
37 |
7
|
Guo Y, Hormel TT, Xiong H, Wang J, Hwang TS, Jia Y. Automated Segmentation of Retinal Fluid Volumes From Structural and Angiographic Optical Coherence Tomography Using Deep Learning. Transl Vis Sci Technol 2020; 9:54. [PMID: 33110708 PMCID: PMC7552937 DOI: 10.1167/tvst.9.2.54] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2020] [Accepted: 09/07/2020] [Indexed: 01/08/2023] Open
Abstract
Purpose We proposed a deep convolutional neural network (CNN), named Retinal Fluid Segmentation Network (ReF-Net), to segment retinal fluid in diabetic macular edema (DME) in optical coherence tomography (OCT) volumes. Methods The 3- × 3-mm OCT scans were acquired on one eye by a 70-kHz OCT commercial AngioVue system (RTVue-XR; Optovue, Inc., Fremont, CA, USA) from 51 participants in a clinical diabetic retinopathy (DR) study (45 with retinal edema and six healthy controls, age 61.3 ± 10.1 (mean ± SD), 33% female, and all DR cases were diagnosed as severe NPDR or PDR). A CNN with U-Net-like architecture was constructed to detect and segment the retinal fluid. Cross-sectional OCT and angiography (OCTA) scans were used for training and testing ReF-Net. The effect of including OCTA data for retinal fluid segmentation was investigated in this study. Volumetric retinal fluid can be constructed using the output of ReF-Net. Area-under-receiver-operating-characteristic-curve, intersection-over-union (IoU), and F1-score were calculated to evaluate the performance of ReF-Net. Results ReF-Net shows high accuracy (F1 = 0.864 ± 0.084) in retinal fluid segmentation. The performance can be further improved (F1 = 0.892 ± 0.038) by including information from both OCTA and structural OCT. ReF-Net also shows strong robustness to shadow artifacts. Volumetric retinal fluid can provide more comprehensive information than the two-dimensional (2D) area, whether cross-sectional or en face projections. Conclusions A deep-learning-based method can accurately segment retinal fluid volumetrically on OCT/OCTA scans with strong robustness to shadow artifacts. OCTA data can improve retinal fluid segmentation. Volumetric representations of retinal fluid are superior to 2D projections. Translational Relevance Using a deep learning method to segment retinal fluid volumetrically has the potential to improve the diagnostic accuracy of diabetic macular edema by OCT systems.
Collapse
|
Research Support, Non-U.S. Gov't |
5 |
33 |
8
|
Gao M, Guo Y, Hormel TT, Sun J, Hwang TS, Jia Y. Reconstruction of high-resolution 6×6-mm OCT angiograms using deep learning. BIOMEDICAL OPTICS EXPRESS 2020; 11:3585-3600. [PMID: 33014553 PMCID: PMC7510902 DOI: 10.1364/boe.394301] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/02/2020] [Revised: 05/20/2020] [Accepted: 05/23/2020] [Indexed: 05/06/2023]
Abstract
Typical optical coherence tomographic angiography (OCTA) acquisition areas on commercial devices are 3×3- or 6×6-mm. Compared to 3×3-mm angiograms with proper sampling density, 6×6-mm angiograms have significantly lower scan quality, with reduced signal-to-noise ratio and worse shadow artifacts due to undersampling. Here, we propose a deep-learning-based high-resolution angiogram reconstruction network (HARNet) to generate enhanced 6×6-mm superficial vascular complex (SVC) angiograms. The network was trained on data from 3×3-mm and 6×6-mm angiograms from the same eyes. The reconstructed 6×6-mm angiograms have significantly lower noise intensity, stronger contrast and better vascular connectivity than the original images. The algorithm did not generate false flow signal at the noise level presented by the original angiograms. The image enhancement produced by our algorithm may improve biomarker measurements and qualitative clinical assessment of 6×6-mm OCTA.
Collapse
|
research-article |
5 |
33 |
9
|
Hormel TT, Wang J, Bailey ST, Hwang TS, Huang D, Jia Y. Maximum value projection produces better en face OCT angiograms than mean value projection. BIOMEDICAL OPTICS EXPRESS 2018; 9:6412-6424. [PMID: 31065439 PMCID: PMC6491019 DOI: 10.1364/boe.9.006412] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/27/2018] [Revised: 11/13/2018] [Accepted: 11/14/2018] [Indexed: 05/18/2023]
Abstract
Optical coherence tomography angiography (OCTA) images rely on en face data projections for both qualitative and quantitative interpretation. Both maximum value and mean value projections are commonly used, and many researchers consider them essentially interchangeable approaches. On the contrary, we find that maximum value projection achieves a consistently higher signal-to-noise ratio and higher image contrast across multiple vascular layers, in both healthy eyes and for each disease examined.
Collapse
|
research-article |
7 |
29 |
10
|
Pitenis AA, Urueña JM, Hormel TT, Bhattacharjee T, Niemi SR, Marshall SL, Hart SM, Schulze KD, Angelini TE, Sawyer WG. Corneal cell friction: Survival, lubricity, tear films, and mucin production over extended duration in vitro studies. ACTA ACUST UNITED AC 2017. [DOI: 10.1016/j.biotri.2017.04.003] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
|
8 |
27 |
11
|
Wang J, Hormel TT, You Q, Guo Y, Wang X, Chen L, Hwang TS, Jia Y. Robust non-perfusion area detection in three retinal plexuses using convolutional neural network in OCT angiography. BIOMEDICAL OPTICS EXPRESS 2020; 11:330-345. [PMID: 32010520 PMCID: PMC6968759 DOI: 10.1364/boe.11.000330] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/02/2019] [Revised: 11/27/2019] [Accepted: 12/01/2019] [Indexed: 05/22/2023]
Abstract
Non-perfusion area (NPA) is a quantitative biomarker useful for characterizing ischemia in diabetic retinopathy (DR). Projection-resolved optical coherence tomographic angiography (PR-OCTA) allows visualization of retinal capillaries and quantify NPA in individual plexuses. However, poor scan quality can make current NPA detection algorithms unreliable and inaccurate. In this work, we present a robust NPA detection algorithm using convolutional neural network (CNN). By merging information from OCT angiograms and OCT reflectance images, the CNN could exclude signal reduction and motion artifacts and detect the avascular features from local to global with the resolution preserved. Across a wide range of signal strength indices, and on both healthy and DR eyes, the algorithm achieved high accuracy and repeatability.
Collapse
|
research-article |
5 |
27 |
12
|
Zang P, Gao L, Hormel TT, Wang J, You Q, Hwang TS, Jia Y. DcardNet: Diabetic Retinopathy Classification at Multiple Levels Based on Structural and Angiographic Optical Coherence Tomography. IEEE Trans Biomed Eng 2021; 68:1859-1870. [PMID: 32986541 PMCID: PMC8191487 DOI: 10.1109/tbme.2020.3027231] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
OBJECTIVE Optical coherence tomography (OCT) and its angiography (OCTA) have several advantages for the early detection and diagnosis of diabetic retinopathy (DR). However, automated, complete DR classification frameworks based on both OCT and OCTA data have not been proposed. In this study, a convolutional neural network (CNN) based method is proposed to fulfill a DR classification framework using en face OCT and OCTA. METHODS A densely and continuously connected neural network with adaptive rate dropout (DcardNet) is designed for the DR classification. In addition, adaptive label smoothing was proposed and used to suppress overfitting. Three separate classification levels are generated for each case based on the International Clinical Diabetic Retinopathy scale. At the highest level the network classifies scans as referable or non-referable for DR. The second level classifies the eye as non-DR, non-proliferative DR (NPDR), or proliferative DR (PDR). The last level classifies the case as no DR, mild and moderate NPDR, severe NPDR, and PDR. RESULTS We used 10-fold cross-validation with 10% of the data to assess the network's performance. The overall classification accuracies of the three levels were 95.7%, 85.0%, and 71.0% respectively. CONCLUSION/SIGNIFICANCE A reliable, sensitive and specific automated classification framework for referral to an ophthalmologist can be a key technology for reducing vision loss related to DR.
Collapse
|
Research Support, N.I.H., Extramural |
4 |
26 |
13
|
Wei X, Hormel TT, Guo Y, Hwang TS, Jia Y. High-resolution wide-field OCT angiography with a self-navigation method to correct microsaccades and blinks. BIOMEDICAL OPTICS EXPRESS 2020; 11:3234-3245. [PMID: 32637251 PMCID: PMC7316026 DOI: 10.1364/boe.390430] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Revised: 05/11/2020] [Accepted: 05/14/2020] [Indexed: 05/18/2023]
Abstract
In this study, we demonstrate a novel self-navigated motion correction method that suppresses eye motion and blinking artifacts on wide-field optical coherence tomographic angiography (OCTA) without requiring any hardware modification. Highly efficient GPU-based, real-time OCTA image acquisition and processing software was developed to detect eye motion artifacts. The algorithm includes an instantaneous motion index that evaluates the strength of motion artifact on en face OCTA images. Areas with suprathreshold motion and eye blinking artifacts are automatically rescanned in real-time. Both healthy eyes and eyes with diabetic retinopathy were imaged, and the self-navigated motion correction performance was demonstrated.
Collapse
|
research-article |
5 |
24 |
14
|
Zang P, Wang J, Hormel TT, Liu L, Huang D, Jia Y. Automated segmentation of peripapillary retinal boundaries in OCT combining a convolutional neural network and a multi-weights graph search. BIOMEDICAL OPTICS EXPRESS 2019; 10:4340-4352. [PMID: 31453015 PMCID: PMC6701529 DOI: 10.1364/boe.10.004340] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/29/2019] [Revised: 07/05/2019] [Accepted: 07/10/2019] [Indexed: 05/16/2023]
Abstract
Quantitative analysis of the peripapillary retinal layers and capillary plexuses from optical coherence tomography (OCT) and OCT angiography images depend on two segmentation tasks - delineating the boundary of the optic disc and delineating the boundaries between retinal layers. Here, we present a method combining a neural network and graph search to perform these two tasks. A comparison of this novel method's segmentation of the disc boundary showed good agreement with the ground truth, achieving an overall Dice similarity coefficient of 0.91 ± 0.04 in healthy and glaucomatous eyes. The absolute error of retinal layer boundaries segmentation in the same cases was 4.10 ± 1.25 µm.
Collapse
|
research-article |
6 |
19 |
15
|
Wei X, Hormel TT, Guo Y, Jia Y. 75-degree non-mydriatic single-volume optical coherence tomographic angiography. BIOMEDICAL OPTICS EXPRESS 2019; 10:6286-6295. [PMID: 31853400 PMCID: PMC6913399 DOI: 10.1364/boe.10.006286] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/17/2019] [Revised: 11/11/2019] [Accepted: 11/11/2019] [Indexed: 05/25/2023]
Abstract
Optical coherence tomography (OCT) and OCT angiography (OCTA) enable three-dimensional, high-resolution imaging of the eye. Yet, while they provide unprecedented structural and angiographic imaging detail, both have only limited fields of view in comparison to other imaging modalities like fundus photography. In this paper, we present a high-speed, high-sensitivity, swept source laser-based system that can acquire non-mydriatic 75-degree field of view OCT and OCTA images in a single complete scan without resorting to montaging techniques. The system uses an optimized scanning protocol and achieves capillary-level image quality. Such data may improve early detection of pathology and provide valuable information during disease monitoring.
Collapse
|
research-article |
6 |
17 |
16
|
Gao M, Hormel TT, Wang J, Guo Y, Bailey ST, Hwang TS, Jia Y. An Open-Source Deep Learning Network for Reconstruction of High-Resolution OCT Angiograms of Retinal Intermediate and Deep Capillary Plexuses. Transl Vis Sci Technol 2021; 10:13. [PMID: 34757393 PMCID: PMC8590160 DOI: 10.1167/tvst.10.13.13] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2021] [Accepted: 10/06/2021] [Indexed: 01/27/2023] Open
Abstract
Purpose We propose a deep learning-based image reconstruction algorithm to produce high-resolution optical coherence tomographic angiograms (OCTA) of the intermediate capillary plexus (ICP) and deep capillary plexus (DCP). Methods In this study, 6-mm × 6-mm macular scans with a 400 × 400 A-line sampling density and 3-mm × 3-mm scans with a 304 × 304 A-line sampling density were acquired on one or both eyes of 180 participants (including 230 eyes with diabetic retinopathy and 44 healthy controls) using a 70-kHz commercial OCT system (RTVue-XR; Optovue, Inc., Fremont, California, USA). Projection-resolved OCTA algorithm removed projection artifacts in voxel. ICP and DCP angiograms were generated by maximum projection of the OCTA signal within the respective plexus. We proposed a deep learning-based method, which receives inputs from registered 3-mm × 3-mm ICP and DCP angiograms with proper sampling density as the ground truth reference to reconstruct 6-mm × 6-mm high-resolution ICP and DCP en face OCTA. We applied the same network on 3-mm × 3-mm angiograms to enhance these images further. We evaluated the reconstructed 3-mm × 3-mm and 6-mm × 6-mm angiograms based on vascular connectivity, Weber contrast, false flow signal (flow signal erroneously generated from background), and the noise intensity in the foveal avascular zone. Results Compared to the originals, the Deep Capillary Angiogram Reconstruction Network (DCARnet)-enhanced 6-mm × 6-mm angiograms had significantly reduced noise intensity (ICP, 7.38 ± 25.22, P < 0.001; DCP, 11.20 ± 22.52, P < 0.001), improved vascular connectivity (ICP, 0.95 ± 0.01, P < 0.001; DCP, 0.96 ± 0.01, P < 0.001), and enhanced Weber contrast (ICP, 4.25 ± 0.10, P < 0.001; DCP, 3.84 ± 0.84, P < 0.001), without generating false flow signal when noise intensity lower than 650. The DCARnet-enhanced 3-mm × 3-mm angiograms also reduced noise, improved connectivity, and enhanced Weber contrast in 3-mm × 3-mm ICP and DCP angiograms from 101 eyes. In addition, DCARnet preserved the appearance of the dilated vessels in the reconstructed angiograms in diabetic eyes. Conclusions DCARnet can enhance 3-mm × 3-mm and 6-mm × 6-mm ICP and DCP angiogram image quality without introducing artifacts. Translational Relevance The enhanced 6-mm × 6-mm angiograms may be easier for clinicians to interpret qualitatively.
Collapse
|
Research Support, N.I.H., Extramural |
4 |
15 |
17
|
Hormel TT, Reyer MA, Parthasarathy R. Two-Point Microrheology of Phase-Separated Domains in Lipid Bilayers. Biophys J 2015; 109:732-6. [PMID: 26287625 PMCID: PMC4547336 DOI: 10.1016/j.bpj.2015.07.017] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2014] [Revised: 07/01/2015] [Accepted: 07/07/2015] [Indexed: 12/15/2022] Open
Abstract
Though the importance of membrane fluidity for cellular function has been well established for decades, methods for measuring lipid bilayer viscosity remain challenging to devise and implement. Recently, approaches based on characterizing the Brownian dynamics of individual tracers such as colloidal particles or lipid domains have provided insights into bilayer viscosity. For fluids in general, however, methods based on single-particle trajectories provide a limited view of hydrodynamic response. The technique of two-point microrheology, in which correlations between the Brownian dynamics of pairs of tracers report on the properties of the intervening medium, characterizes viscosity at length-scales that are larger than that of individual tracers and has less sensitivity to tracer-induced distortions, but has never been applied to lipid membranes. We present, to our knowledge, the first two-point microrheological study of lipid bilayers, examining the correlated motion of domains in phase-separated lipid vesicles and comparing one- and two-point results. We measure two-point correlation functions in excellent agreement with the forms predicted by two-dimensional hydrodynamic models, analysis of which reveals a viscosity intermediate between those of the two lipid phases, indicative of global fluid properties rather than the viscosity of the local neighborhood of the tracer.
Collapse
|
research-article |
10 |
15 |
18
|
Zang P, Hormel TT, Wang X, Tsuboi K, Huang D, Hwang TS, Jia Y. A Diabetic Retinopathy Classification Framework Based on Deep-Learning Analysis of OCT Angiography. Transl Vis Sci Technol 2022; 11:10. [PMID: 35822949 PMCID: PMC9288155 DOI: 10.1167/tvst.11.7.10] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Purpose Reliable classification of referable and vision threatening diabetic retinopathy (DR) is essential for patients with diabetes to prevent blindness. Optical coherence tomography (OCT) and its angiography (OCTA) have several advantages over fundus photographs. We evaluated a deep-learning-aided DR classification framework using volumetric OCT and OCTA. Methods Four hundred fifty-six OCT and OCTA volumes were scanned from eyes of 50 healthy participants and 305 patients with diabetes. Retina specialists labeled the eyes as non-referable (nrDR), referable (rDR), or vision threatening DR (vtDR). Each eye underwent a 3 × 3-mm scan using a commercial 70 kHz spectral-domain OCT system. We developed a DR classification framework and trained it using volumetric OCT and OCTA to classify eyes into rDR and vtDR. For the scans identified as rDR or vtDR, 3D class activation maps were generated to highlight the subregions which were considered important by the framework for DR classification. Results For rDR classification, the framework achieved a 0.96 ± 0.01 area under the receiver operating characteristic curve (AUC) and 0.83 ± 0.04 quadratic-weighted kappa. For vtDR classification, the framework achieved a 0.92 ± 0.02 AUC and 0.73 ± 0.04 quadratic-weighted kappa. In addition, the multiple DR classification (non-rDR, rDR but non-vtDR, or vtDR) achieved a 0.83 ± 0.03 quadratic-weighted kappa. Conclusions A deep learning framework only based on OCT and OCTA can provide specialist-level DR classification using only a single imaging modality. Translational Relevance The proposed framework can be used to develop clinically valuable automated DR diagnosis system because of the specialist-level performance showed in this study.
Collapse
|
|
3 |
13 |
19
|
Zang P, Hormel TT, Hwang TS, Bailey ST, Huang D, Jia Y. Deep-Learning-Aided Diagnosis of Diabetic Retinopathy, Age-Related Macular Degeneration, and Glaucoma Based on Structural and Angiographic OCT. OPHTHALMOLOGY SCIENCE 2022; 3:100245. [PMID: 36579336 PMCID: PMC9791595 DOI: 10.1016/j.xops.2022.100245] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Revised: 10/21/2022] [Accepted: 10/28/2022] [Indexed: 11/11/2022]
Abstract
Purpose Timely diagnosis of eye diseases is paramount to obtaining the best treatment outcomes. OCT and OCT angiography (OCTA) have several advantages that lend themselves to early detection of ocular pathology; furthermore, the techniques produce large, feature-rich data volumes. However, the full clinical potential of both OCT and OCTA is stymied when complex data acquired using the techniques must be manually processed. Here, we propose an automated diagnostic framework based on structural OCT and OCTA data volumes that could substantially support the clinical application of these technologies. Design Cross sectional study. Participants Five hundred twenty-six OCT and OCTA volumes were scanned from the eyes of 91 healthy participants, 161 patients with diabetic retinopathy (DR), 95 patients with age-related macular degeneration (AMD), and 108 patients with glaucoma. Methods The diagnosis framework was constructed based on semisequential 3-dimensional (3D) convolutional neural networks. The trained framework classifies combined structural OCT and OCTA scans as normal, DR, AMD, or glaucoma. Fivefold cross-validation was performed, with 60% of the data reserved for training, 20% for validation, and 20% for testing. The training, validation, and test data sets were independent, with no shared patients. For scans diagnosed as DR, AMD, or glaucoma, 3D class activation maps were generated to highlight subregions that were considered important by the framework for automated diagnosis. Main Outcome Measures The area under the curve (AUC) of the receiver operating characteristic curve and quadratic-weighted kappa were used to quantify the diagnostic performance of the framework. Results For the diagnosis of DR, the framework achieved an AUC of 0.95 ± 0.01. For the diagnosis of AMD, the framework achieved an AUC of 0.98 ± 0.01. For the diagnosis of glaucoma, the framework achieved an AUC of 0.91 ± 0.02. Conclusions Deep learning frameworks can provide reliable, sensitive, interpretable, and fully automated diagnosis of eye diseases. Financial Disclosures Proprietary or commercial disclosure may be found after the references.
Collapse
|
research-article |
3 |
13 |
20
|
Pi S, Hormel TT, Wei X, Cepurna W, Morrison JC, Jia Y. Imaging retinal structures at cellular-level resolution by visible-light optical coherence tomography. OPTICS LETTERS 2020; 45:2107-2110. [PMID: 32236080 PMCID: PMC8575555 DOI: 10.1364/ol.386454] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/20/2019] [Accepted: 03/05/2020] [Indexed: 05/10/2023]
Abstract
In vivo high-resolution images are the most direct way to understand retinal function and diseases. Here we report the use of visible-light optical coherence tomography with volumetric registration and averaging to achieve cellular-level retinal structural imaging in a rat eye, covering the entire depth of the retina. Vitreous fibers, nerve fiber bundles, and vasculature were clearly revealed, as well as at least three laminar sublayers in the inner plexiform layer. We also successfully visualized ganglion cell somas in the ganglion cell layer, cells in the inner nuclear layer, and photoreceptors in the outer nuclear layer and ellipsoid zone. This technique provides, to the best of our knowledge, a new means to visualize the retina in vivo at a cellular resolution and may enable detection or discovery of cellular neuronal biomarkers to help better diagnose ocular disease.
Collapse
|
research-article |
5 |
12 |
21
|
Guo Y, Hormel TT, Pi S, Wei X, Gao M, Morrison JC, Jia Y. An end-to-end network for segmenting the vasculature of three retinal capillary plexuses from OCT angiographic volumes. BIOMEDICAL OPTICS EXPRESS 2021; 12:4889-4900. [PMID: 34513231 PMCID: PMC8407822 DOI: 10.1364/boe.431888] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Revised: 06/28/2021] [Accepted: 07/06/2021] [Indexed: 06/13/2023]
Abstract
The segmentation of en face retinal capillary angiograms from volumetric optical coherence tomographic angiography (OCTA) usually relies on retinal layer segmentation, which is time-consuming and error-prone. In this study, we developed a deep-learning-based method to segment vessels in the superficial vascular plexus (SVP), intermediate capillary plexus (ICP), and deep capillary plexus (DCP) directly from volumetric OCTA data. The method contains a three-dimensional convolutional neural network (CNN) for extracting distinct retinal layers, a custom projection module to generate three vascular plexuses from OCTA data, and three parallel CNNs to segment vasculature. Experimental results on OCTA data from rat eyes demonstrated the feasibility of the proposed method. This end-to-end network has the potential to simplify OCTA data processing on retinal vasculature segmentation. The main contribution of this study is that we propose a custom projection module to connect retinal layer segmentation and vasculature segmentation modules and automatically convert data from three to two dimensions, thus establishing an end-to-end method to segment three retinal capillary plexuses from volumetric OCTA without any human intervention.
Collapse
|
research-article |
4 |
12 |
22
|
Wang J, Hormel TT, Bailey ST, Hwang TS, Huang D, Jia Y. Signal attenuation-compensated projection-resolved OCT angiography. BIOMEDICAL OPTICS EXPRESS 2023; 14:2040-2054. [PMID: 37206138 PMCID: PMC10191650 DOI: 10.1364/boe.483835] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Revised: 03/30/2023] [Accepted: 04/05/2023] [Indexed: 05/21/2023]
Abstract
Projection artifacts are a significant limitation of optical coherence tomographic angiography (OCTA). Existing techniques to suppress these artifacts are sensitive to image quality, becoming less reliable on low-quality images. In this study, we propose a novel signal attenuation-compensated projection-resolved OCTA (sacPR-OCTA) algorithm. In addition to removing projection artifacts, our method compensates for shadows beneath large vessels. The proposed sacPR-OCTA algorithm improves vascular continuity, reduces the similarity of vascular patterns in different plexuses, and removes more residual artifacts compared to existing methods. In addition, the sacPR-OCTA algorithm better preserves flow signal in choroidal neovascular lesions and shadow-affected areas. Because sacPR-OCTA processes the data along normalized A-lines, it provides a general solution for removing projection artifacts agnostic to the platform.
Collapse
|
research-article |
2 |
11 |
23
|
Gao M, Guo Y, Hormel TT, Tsuboi K, Pacheco G, Poole D, Bailey ST, Flaxel CJ, Huang D, Hwang TS, Jia Y. A Deep Learning Network for Classifying Arteries and Veins in Montaged Widefield OCT Angiograms. OPHTHALMOLOGY SCIENCE 2022; 2:100149. [PMID: 36278031 PMCID: PMC9562370 DOI: 10.1016/j.xops.2022.100149] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Revised: 03/16/2022] [Accepted: 03/28/2022] [Indexed: 01/18/2023]
Abstract
Purpose To propose a deep-learning-based method to differentiate arteries from veins in montaged widefield OCT angiography (OCTA). Design Cross-sectional study. Participants A total of 232 participants, including 109 participants with diabetic retinopathy (DR), 64 participants with branch retinal vein occlusion (BRVO), 27 participants with diabetes but without DR, and 32 healthy participants. Methods We propose a convolutional neural network (CAVnet) to classify retinal blood vessels on montaged widefield OCTA en face images as arteries and veins. A total of 240 retinal angiograms from 88 eyes were used to train CAVnet, and 302 retinal angiograms from 144 eyes were used for testing. This method takes the OCTA images as input and outputs the segmentation results with arteries and veins down to the level of precapillary arterioles and postcapillary venules. The network also identifies their intersections. We evaluated the agreement (in pixels) between segmentation results and the manually graded ground truth using sensitivity, specificity, F1-score, and Intersection over Union (IoU). Measurements of arterial and venous caliber or tortuosity are made on our algorithm's output of healthy and diseased eyes. Main Outcome Measures Classification of arteries and veins, arterial and venous caliber, and arterial and venous tortuosity. Results For classification and identification of arteries, the algorithm achieved average sensitivity of 95.3%, specificity of 99.6%, F1 score of 94.2%, and IoU of 89.3%. For veins, the algorithm achieved average sensitivity of 94.4%, specificity of 99.7%, F1 score of 94.1%, and IoU of 89.2%. We also achieved an average sensitivity of 76.3% in identifying intersection points. The results show CAVnet has high accuracy on differentiating arteries and veins in DR and BRVO cases. These classification results are robust across 2 instruments and multiple scan volume sizes. Outputs of CAVnet were used to measure arterial and venous caliber or tortuosity, and pixel-wise caliber and tortuosity maps were generated. Differences between healthy and diseased eyes were demonstrated, indicating potential clinical utility. Conclusions The CAVnet can classify arteries and veins and their branches with high accuracy and is potentially useful in the analysis of vessel type-specific features on diseases such as branch retinal artery occlusion and BRVO.
Collapse
|
research-article |
3 |
11 |
24
|
Pi S, Hormel TT, Wei X, Cepurna W, Camino A, Guo Y, Huang D, Morrison J, Jia Y. Monitoring retinal responses to acute intraocular pressure elevation in rats with visible light optical coherence tomography. NEUROPHOTONICS 2019; 6:041104. [PMID: 31312671 PMCID: PMC6624745 DOI: 10.1117/1.nph.6.4.041104] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/08/2019] [Accepted: 06/21/2019] [Indexed: 05/08/2023]
Abstract
Elevated intraocular pressure (IOP) is an important risk factor for glaucoma. However, the role of IOP in glaucoma progression, as well as retinal physiology in general, remains incompletely understood. We demonstrate the use of visible light optical coherence tomography to measure retinal responses to acute IOP elevation in Brown Norway rats. We monitored retinal responses in reflectivity, angiography, blood flow, oxygen saturation ( sO 2 ), and oxygen metabolism over a range of IOP from 10 to 100 mmHg. As IOP was elevated, nerve fiber layer reflectivity was found to decrease. Vascular perfusion in the three retinal capillary plexuses remained steady until IOP exceeded 70 mmHg and arterial flow was noted to reverse periodically at high IOPs. However, a significant drop in total retinal blood flow was observed first at 40 mmHg. As IOP increased, the venous sO 2 demonstrated a gradual decrease despite steady arterial sO 2 , which is consistent with increased arterial-venous oxygen extraction across the retinal capillary beds. Calculated total retinal oxygen metabolism was steady, reflecting balanced responses of blood flow and oxygen extraction, until IOP exceeded 40 mmHg, and fell to 0 at 70 and 80 mmHg. Above this, measurements were unattainable. All measurements reverted to baseline when the IOP was returned to 10 mmHg, indicating good recovery following acute pressure challenge. These results demonstrate the ability of this system to monitor retinal oxygen metabolism noninvasively and how it can help us understand retinal responses to elevated IOP.
Collapse
|
research-article |
6 |
10 |
25
|
Hormel TT, Jia Y. OCT angiography and its retinal biomarkers [Invited]. BIOMEDICAL OPTICS EXPRESS 2023; 14:4542-4566. [PMID: 37791289 PMCID: PMC10545210 DOI: 10.1364/boe.495627] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 07/13/2023] [Accepted: 07/13/2023] [Indexed: 10/05/2023]
Abstract
Optical coherence tomography angiography (OCTA) is a high-resolution, depth-resolved imaging modality with important applications in ophthalmic practice. An extension of structural OCT, OCTA enables non-invasive, high-contrast imaging of retinal and choroidal vasculature that are amenable to quantification. As such, OCTA offers the capability to identify and characterize biomarkers important for clinical practice and therapeutic research. Here, we review new methods for analyzing biomarkers and discuss new insights provided by OCTA.
Collapse
|
Review |
2 |
9 |