1
|
Gong P, Tang X, Chen J, You H, Wang Y, Yu PK, Yu DY, Cense B. Deep learning-based label-free imaging of lymphatics and aqueous veins in the eye using optical coherence tomography. Sci Rep 2024; 14:6126. [PMID: 38480842 PMCID: PMC10937663 DOI: 10.1038/s41598-024-56273-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Accepted: 03/04/2024] [Indexed: 03/17/2024] Open
Abstract
We demonstrate an adaptation of deep learning for label-free imaging of the micro-scale lymphatic vessels and aqueous veins in the eye using optical coherence tomography (OCT). The proposed deep learning-based OCT lymphangiography (DL-OCTL) method was trained, validated and tested, using OCT scans (23 volumetric scans comprising 19,736 B-scans) from 11 fresh ex vivo porcine eyes with the corresponding vessel labels generated by a conventional OCT lymphangiography (OCTL) method based on thresholding with attenuation compensation. Compared to conventional OCTL, the DL-OCTL method demonstrates comparable results for imaging lymphatics and aqueous veins in the eye, with an Intersection over Union value of 0.79 ± 0.071 (mean ± standard deviation). In addition, DL-OCTL mitigates the imaging artifacts in conventional OCTL where the OCT signal modelling was corrupted by the tissue heterogeneity, provides ~ 10 times faster processing based on a rough comparison and does not require OCT-related knowledge for correct implementation as in conventional OCTL. With these favorable features, DL-OCTL promises to improve the practicality of OCTL for label-free imaging of lymphatics and aqueous veins for preclinical and clinical imaging applications.
Collapse
Affiliation(s)
- Peijun Gong
- Key Laboratory for Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou, 310027, China.
- Department of Electrical, Electronic and Computer Engineering, School of Engineering, The University of Western Australia, Perth, WA, 6009, Australia.
| | - Xiaolan Tang
- School of Software Engineering, South China University of Technology, Guangzhou, 510006, China
- Key Laboratory of Big Data and Intelligent Robot (SCUT), Ministry of Education, Guangzhou, 510006, China
| | - Junying Chen
- School of Software Engineering, South China University of Technology, Guangzhou, 510006, China.
- Key Laboratory of Big Data and Intelligent Robot (SCUT), Ministry of Education, Guangzhou, 510006, China.
| | - Haijun You
- School of Software Engineering, South China University of Technology, Guangzhou, 510006, China
- Key Laboratory of Big Data and Intelligent Robot (SCUT), Ministry of Education, Guangzhou, 510006, China
| | - Yuxing Wang
- Key Laboratory for Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou, 310027, China
| | - Paula K Yu
- Centre for Ophthalmology and Visual Science, The University of Western Australia, Perth, WA, 6009, Australia
- Lions Eye Institute, Nedlands, WA, 6009, Australia
| | - Dao-Yi Yu
- Centre for Ophthalmology and Visual Science, The University of Western Australia, Perth, WA, 6009, Australia
- Lions Eye Institute, Nedlands, WA, 6009, Australia
| | - Barry Cense
- Department of Electrical, Electronic and Computer Engineering, School of Engineering, The University of Western Australia, Perth, WA, 6009, Australia
- Department of Mechanical Engineering, Yonsei University, Seoul, 03722, Republic of Korea
| |
Collapse
|
2
|
Pan M, Wang Y, Gong P, Wang Q, Cense B. Feasibility of deep learning-based polarization-sensitive optical coherence tomography angiography for imaging cutaneous microvasculature. BIOMEDICAL OPTICS EXPRESS 2023; 14:3856-3870. [PMID: 37799704 PMCID: PMC10549757 DOI: 10.1364/boe.488822] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 05/09/2023] [Accepted: 06/05/2023] [Indexed: 10/07/2023]
Abstract
Polarization-sensitive optical coherence tomography (PS-OCT) measures the polarization states of the backscattered light from tissue that can improve angiography based on conventional optical coherence tomography (OCT). We present a feasibility study on PS-OCT integrated with deep learning for PS-OCT angiography (PS-OCTA) imaging of human cutaneous microvasculature. Two neural networks were assessed for PS-OCTA, including the residual dense network (RDN), which previously showed superior performance for angiography with conventional OCT and the upgraded grouped RDN (GRDN). We also investigated different protocols to process the multiple signal channels provided by the Jones matrices from the PS-OCT system to achieve optimal PS-OCTA performance. The training and testing of the deep learning-based PS-OCTA were performed using PS-OCT scans collected from 18 skin locations comprising 16,600 B-scan pairs. The results demonstrated a moderately improved performance of GRDN over RDN, and of the use of the combined signal from the Jones matrix elements over the separate use of the elements, as well as a similar image quality to that provided by speckle decorrelation angiography. GRDN-based PS-OCTA also showed ∼2-3 times faster processing and improved mitigation of tissue motion as compared to speckle decorrelation angiography, and enabled fully automatic processing. Deep learning-based PS-OCTA can be used for imaging cutaneous microvasculature, which may enable easy adoption of PS-OCTA for preclinical and clinical applications.
Collapse
Affiliation(s)
- Moning Pan
- Key Laboratory for Biomedical Engineering of Ministry of Education, Embedded System Engineering Research Center of Ministry of Education and Zhejiang Provincial Key Laboratory for Network Multimedia Technologies, Zhejiang University, Hangzhou, 310027, China
| | - Yuxing Wang
- Key Laboratory for Biomedical Engineering of Ministry of Education, Embedded System Engineering Research Center of Ministry of Education and Zhejiang Provincial Key Laboratory for Network Multimedia Technologies, Zhejiang University, Hangzhou, 310027, China
| | - Peijun Gong
- Key Laboratory for Biomedical Engineering of Ministry of Education, Embedded System Engineering Research Center of Ministry of Education and Zhejiang Provincial Key Laboratory for Network Multimedia Technologies, Zhejiang University, Hangzhou, 310027, China
- BRITElab, Harry Perkins Institute of Medical Research, QEII Medical Centre, Nedlands and Centre for Medical Research,
The University of Western Australia, Perth, WA 6009, Australia
- Department of Electrical, Electronic & Computer Engineering, School of Engineering, The University of Western Australia, Perth, WA 6009, Australia
| | - Qiang Wang
- Department of Electrical, Electronic & Computer Engineering, School of Engineering, The University of Western Australia, Perth, WA 6009, Australia
| | - Barry Cense
- Department of Electrical, Electronic & Computer Engineering, School of Engineering, The University of Western Australia, Perth, WA 6009, Australia
- Department of Mechanical Engineering, Yonsei University, Seoul, 03722, Republic of Korea
| |
Collapse
|
3
|
Chen G, Wang W, Li Y. Comparative study of OCTA algorithms with a high-sensitivity multi-contrast Jones matrix OCT system for human skin imaging. BIOMEDICAL OPTICS EXPRESS 2022; 13:4718-4736. [PMID: 36187265 PMCID: PMC9484425 DOI: 10.1364/boe.462941] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 07/21/2022] [Accepted: 07/28/2022] [Indexed: 06/16/2023]
Abstract
The multi-contrast Jones matrix OCT (JMT) system can not only improve the tissue-specific contrast but also enhance the sensitivity of detecting flow, which is gaining increasing attention. However, for the JMT system, there is currently a lack of studies evaluating and guiding the selection of suitable angiography algorithms to map the most appealing quality of angiograms for clinical use. In this paper, by a homemade high-sensitivity multi-contrast JMT system based 200 kHz swept source, the performance of two complex-signal-based OCTA methods that are insensitive to phase instability and one amplitude-signal-based OCTA method are compared for in-vivo imaging of human skin qualitatively and quantitatively. Six metrics, including vascular connectivity, image contrast-to-noise ratio, image signal-to-noise ratio, vessel diameter index, blood vessel density, and processing time, are assessed. The results show that the vascular networks processed by all OCTA methods and the texture of skin could be visualized simultaneously and markedly. Additionally, the complex-signal-based OCTA methods successfully suppress phase instabilities and even outperform the amplitude-signal-based OCTA algorithm in some indicators. This paper has a certain guiding significance for selecting an appropriate angiography algorithm and expanding the application field with this system.
Collapse
Affiliation(s)
- Guoqiang Chen
- Key Laboratory of Photoelectronic Imaging Technology and System of Ministry of Education of China, School of Optics and Photonics, Beijing Institute of Technology, 5 South Zhongguancun Street, Beijing 100081, China
| | - Wen’ai Wang
- Key Laboratory of Photoelectronic Imaging Technology and System of Ministry of Education of China, School of Optics and Photonics, Beijing Institute of Technology, 5 South Zhongguancun Street, Beijing 100081, China
- Institute of Engineering Medicine, Beijing Institute of Technology, 5 South Zhongguancun Street, Beijing 100081, China
| | - Yanqiu Li
- Key Laboratory of Photoelectronic Imaging Technology and System of Ministry of Education of China, School of Optics and Photonics, Beijing Institute of Technology, 5 South Zhongguancun Street, Beijing 100081, China
- Institute of Engineering Medicine, Beijing Institute of Technology, 5 South Zhongguancun Street, Beijing 100081, China
| |
Collapse
|
4
|
Alexopoulos P, Madu C, Wollstein G, Schuman JS. The Development and Clinical Application of Innovative Optical Ophthalmic Imaging Techniques. Front Med (Lausanne) 2022; 9:891369. [PMID: 35847772 PMCID: PMC9279625 DOI: 10.3389/fmed.2022.891369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Accepted: 05/23/2022] [Indexed: 11/22/2022] Open
Abstract
The field of ophthalmic imaging has grown substantially over the last years. Massive improvements in image processing and computer hardware have allowed the emergence of multiple imaging techniques of the eye that can transform patient care. The purpose of this review is to describe the most recent advances in eye imaging and explain how new technologies and imaging methods can be utilized in a clinical setting. The introduction of optical coherence tomography (OCT) was a revolution in eye imaging and has since become the standard of care for a plethora of conditions. Its most recent iterations, OCT angiography, and visible light OCT, as well as imaging modalities, such as fluorescent lifetime imaging ophthalmoscopy, would allow a more thorough evaluation of patients and provide additional information on disease processes. Toward that goal, the application of adaptive optics (AO) and full-field scanning to a variety of eye imaging techniques has further allowed the histologic study of single cells in the retina and anterior segment. Toward the goal of remote eye care and more accessible eye imaging, methods such as handheld OCT devices and imaging through smartphones, have emerged. Finally, incorporating artificial intelligence (AI) in eye images has the potential to become a new milestone for eye imaging while also contributing in social aspects of eye care.
Collapse
Affiliation(s)
- Palaiologos Alexopoulos
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
| | - Chisom Madu
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
| | - Gadi Wollstein
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
- Department of Biomedical Engineering, NYU Tandon School of Engineering, Brooklyn, NY, United States
- Center for Neural Science, College of Arts & Science, New York University, New York, NY, United States
| | - Joel S. Schuman
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, United States
- Department of Biomedical Engineering, NYU Tandon School of Engineering, Brooklyn, NY, United States
- Center for Neural Science, College of Arts & Science, New York University, New York, NY, United States
- Department of Electrical and Computer Engineering, NYU Tandon School of Engineering, Brooklyn, NY, United States
| |
Collapse
|
5
|
Untracht GR, Matos RS, Dikaios N, Bapir M, Durrani AK, Butsabong T, Campagnolo P, Sampson DD, Heiss C, Sampson DM. OCTAVA: An open-source toolbox for quantitative analysis of optical coherence tomography angiography images. PLoS One 2021; 16:e0261052. [PMID: 34882760 PMCID: PMC8659314 DOI: 10.1371/journal.pone.0261052] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2021] [Accepted: 11/24/2021] [Indexed: 12/15/2022] Open
Abstract
Optical coherence tomography angiography (OCTA) performs non-invasive visualization and characterization of microvasculature in research and clinical applications mainly in ophthalmology and dermatology. A wide variety of instruments, imaging protocols, processing methods and metrics have been used to describe the microvasculature, such that comparing different study outcomes is currently not feasible. With the goal of contributing to standardization of OCTA data analysis, we report a user-friendly, open-source toolbox, OCTAVA (OCTA Vascular Analyzer), to automate the pre-processing, segmentation, and quantitative analysis of en face OCTA maximum intensity projection images in a standardized workflow. We present each analysis step, including optimization of filtering and choice of segmentation algorithm, and definition of metrics. We perform quantitative analysis of OCTA images from different commercial and non-commercial instruments and samples and show OCTAVA can accurately and reproducibly determine metrics for characterization of microvasculature. Wide adoption could enable studies and aggregation of data on a scale sufficient to develop reliable microvascular biomarkers for early detection, and to guide treatment, of microvascular disease.
Collapse
Affiliation(s)
- Gavrielle R. Untracht
- Optical+Biomedical Engineering Laboratory, School of Electrical, Electronic and Computer Engineering, The University of Western Australia, Perth, Western Australia, Australia
- Surrey Biophotonics, Advanced Technology Institute, School of Physics and School of Biosciences and Medicine, University of Surrey, Guildford, Surrey, United Kingdom
- * E-mail:
| | - Rolando S. Matos
- Department of Biochemical Sciences and Department of Clinical and Experimental Medicine, School of Biosciences and Medicine, University of Surrey, Guildford, Surrey, United Kingdom
| | | | - Mariam Bapir
- Department of Biochemical Sciences and Department of Clinical and Experimental Medicine, School of Biosciences and Medicine, University of Surrey, Guildford, Surrey, United Kingdom
| | - Abdullah K. Durrani
- Surrey Biophotonics, Advanced Technology Institute, School of Physics and School of Biosciences and Medicine, University of Surrey, Guildford, Surrey, United Kingdom
| | - Teemapron Butsabong
- Department of Biochemical Sciences and Department of Clinical and Experimental Medicine, School of Biosciences and Medicine, University of Surrey, Guildford, Surrey, United Kingdom
| | - Paola Campagnolo
- Department of Biochemical Sciences and Department of Clinical and Experimental Medicine, School of Biosciences and Medicine, University of Surrey, Guildford, Surrey, United Kingdom
| | - David D. Sampson
- Surrey Biophotonics, Advanced Technology Institute, School of Physics and School of Biosciences and Medicine, University of Surrey, Guildford, Surrey, United Kingdom
| | - Christian Heiss
- Department of Biochemical Sciences and Department of Clinical and Experimental Medicine, School of Biosciences and Medicine, University of Surrey, Guildford, Surrey, United Kingdom
- Surrey and Sussex Healthcare NHS Trust, East Surrey Hospital, Redhill, Surrey, United Kingdom
| | - Danuta M. Sampson
- Department of Biochemical Sciences and Department of Clinical and Experimental Medicine, School of Biosciences and Medicine, University of Surrey, Guildford, Surrey, United Kingdom
- Surrey Biophotonics, Centre for Vision, Speech and Signal Processing and School of Biosciences and Medicine, The University of Surrey, Guildford, United Kingdom
| |
Collapse
|
6
|
Wei W, Cogliati A, Canavesi C. Model-based optical coherence tomography angiography enables motion-insensitive vascular imaging. BIOMEDICAL OPTICS EXPRESS 2021; 12:2149-2170. [PMID: 33996221 PMCID: PMC8086452 DOI: 10.1364/boe.420091] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/19/2021] [Revised: 02/23/2021] [Accepted: 03/10/2021] [Indexed: 06/12/2023]
Abstract
We present a significant step toward ultrahigh-resolution, motion-insensitive characterization of vascular dynamics. Optical coherence tomography angiography (OCTA) is an invaluable diagnostic technology for non-invasive, label-free vascular imaging in vivo. However, since it relies on detecting moving cells from consecutive scans, high-resolution OCTA is susceptible to tissue motion, which imposes challenges in resolving and quantifying small vessels. We developed a novel OCTA technique named ultrahigh-resolution factor angiography (URFA) by modeling repeated scans as generative latent variables, with a common variance representing shared features and a unique variance representing motion. By iteratively maximizing the combined log-likelihood probability of these variances, the unique variance is largely separated. Meanwhile, features in the common variance are decoupled, in which vessels with dynamic flow are extracted from tissue structure by integrating high-order factors. Combined with Gabor-domain optical coherence microscopy, URFA successfully extracted high-resolution cutaneous vasculature despite severe involuntary tissue motion and scanner oscillation, significantly improving the visualization and characterization of micro-capillaries in vivo. Compared with the conventional approach, URFA reduces motion artifacts by nearly 50% on average, evaluated on local differences.
Collapse
Affiliation(s)
- Wei Wei
- LighTopTech Corp., 150 Lucius Gordon Drive, Suite 201, West Henrietta, NY 14586, USA
| | - Andrea Cogliati
- LighTopTech Corp., 150 Lucius Gordon Drive, Suite 201, West Henrietta, NY 14586, USA
| | - Cristina Canavesi
- LighTopTech Corp., 150 Lucius Gordon Drive, Suite 201, West Henrietta, NY 14586, USA
| |
Collapse
|
7
|
Ringel MJ, Tang EM, Tao YK. Advances in multimodal imaging in ophthalmology. Ther Adv Ophthalmol 2021; 13:25158414211002400. [PMID: 35187398 PMCID: PMC8855415 DOI: 10.1177/25158414211002400] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Accepted: 02/23/2021] [Indexed: 12/12/2022] Open
Abstract
Multimodality ophthalmic imaging systems aim to enhance the contrast, resolution, and functionality of existing technologies to improve disease diagnostics and therapeutic guidance. These systems include advanced acquisition and post-processing methods using optical coherence tomography (OCT), combined scanning laser ophthalmoscopy and OCT systems, adaptive optics, surgical guidance, and photoacoustic technologies. Here, we provide an overview of these ophthalmic imaging systems and their clinical and basic science applications.
Collapse
Affiliation(s)
- Morgan J. Ringel
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Eric M. Tang
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Yuankai K. Tao
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37235, USA
| |
Collapse
|
8
|
Tang P, Wang RK. Polarization sensitive optical coherence tomography for imaging microvascular information within living tissue without polarization-induced artifacts. BIOMEDICAL OPTICS EXPRESS 2020; 11:6379-6388. [PMID: 33282496 PMCID: PMC7687965 DOI: 10.1364/boe.403933] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/29/2020] [Revised: 09/20/2020] [Accepted: 10/09/2020] [Indexed: 05/02/2023]
Abstract
When imaging birefringent samples using optical coherence tomography angiography (OCTA), the phase retardation may appear opposite to the phase change due to the blood flow in the orthogonal signals, for which a cancellation effect can occur when deriving OCTA signals. This effect can diminish the ability of OCTA to detect vascular information, leading to an erroneous interpretation of the final OCTA images. To mitigate this issue, we demonstrate polarization-sensitive optical coherence tomography (PS-OCT) to image microvascular information within a living sample without polarization induced artifacts. The system is furnished with a swept source OCT (SS-OCT) that incorporates two imaging modes: OCTA imaging and polarization-sensitive imaging. PS-OCT is used to provide birefringent contrast where the color-encoded Stokes parameters are used to obtain high contrast polarization-state images. OCTA is used to acquire high-resolution images of functional microvascular networks permeating the scanned tissue volume. Taking the advantages of the dual-channel PS-OCT configuration, the polarization induced artifacts are eliminated from OCTA vascular imaging. The proposed PS-OCTA system is employed to visualize the birefringent components and the vascular networks of the human skin in vivo. It is expected that the proposed system setup would have useful and practical applications in the investigations of the vasculature in the birefringent tissue samples both pre-clinically and clinically.
Collapse
|