1
|
Badhon RH, Thompson AC, Lim JI, Leng T, Alam MN. Quantitative characterization of retinal features in translated OCTA. Exp Biol Med (Maywood) 2024; 249:10333. [PMID: 39507240 PMCID: PMC11537946 DOI: 10.3389/ebm.2024.10333] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2024] [Accepted: 10/07/2024] [Indexed: 11/08/2024] Open
Abstract
This study explores the feasibility of quantitative Optical Coherence Tomography Angiography (OCTA) features translated from OCT using generative machine learning (ML) for characterizing vascular changes in retina. A generative adversarial network framework was employed alongside a 2D vascular segmentation and a 2D OCTA image translation model, trained on the OCT-500 public dataset and validated with data from the University of Illinois at Chicago (UIC) retina clinic. Datasets are categorized by scanning range (Field of view) and disease status. Validation involved quality and quantitative metrics, comparing translated OCTA (TR-OCTA) with ground truth OCTAs (GT-OCTA) to assess the feasibility for objective disease diagnosis. In our study, TR-OCTAs showed high image quality in both 3 and 6 mm datasets (high-resolution and contrast quality, moderate structural similarity compared to GT-OCTAs). Vascular features like tortuosity and vessel perimeter index exhibits more consistent trends compared to density features which are affected by local vascular distortions. For the validation dataset (UIC), the metrics show similar trend with a slightly decreased performance since the model training was blind on UIC data, to evaluate inference performance. Overall, this study presents a promising solution to the limitations of OCTA adoption in clinical practice by using vascular features from TR-OCTA for disease detection. By making detailed vascular imaging more widely accessible and reducing reliance on expensive OCTA equipment, this research has the potential to significantly enhance the diagnostic process for retinal diseases.
Collapse
Affiliation(s)
- Rashadul Hasan Badhon
- Department of Electrical and Computer Engineering, University of North Carolina at Charlotte, Charlotte, NC, United States
| | - Atalie Carina Thompson
- Department of Surgical Ophthalmology, Atrium-Health Wake Forest Baptist, Winston-Salem, NC, United States
| | - Jennifer I. Lim
- Department of Ophthalmology and Visual Science, University of Illinois at Chicago, Chicago, IL, United States
| | - Theodore Leng
- Department of Ophthalmology, Stanford University School of Medicine, Stanford, CA, United States
| | - Minhaj Nur Alam
- Department of Electrical and Computer Engineering, University of North Carolina at Charlotte, Charlotte, NC, United States
| |
Collapse
|
2
|
Rashidi M, Kalenkov G, Green DJ, Mclaughlin RA. Improved microvascular imaging with optical coherence tomography using 3D neural networks and a channel attention mechanism. Sci Rep 2024; 14:17809. [PMID: 39090263 PMCID: PMC11294560 DOI: 10.1038/s41598-024-68296-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2024] [Accepted: 07/22/2024] [Indexed: 08/04/2024] Open
Abstract
Skin microvasculature is vital for human cardiovascular health and thermoregulation, but its imaging and analysis presents significant challenges. Statistical methods such as speckle decorrelation in optical coherence tomography angiography (OCTA) often require multiple co-located B-scans, leading to lengthy acquisitions prone to motion artefacts. Deep learning has shown promise in enhancing accuracy and reducing measurement time by leveraging local information. However, both statistical and deep learning methods typically focus solely on processing individual 2D B-scans, neglecting contextual information from neighbouring B-scans. This limitation compromises spatial context and disregards the 3D features within tissue, potentially affecting OCTA image accuracy. In this study, we propose a novel approach utilising 3D convolutional neural networks (CNNs) to address this limitation. By considering the 3D spatial context, these 3D CNNs mitigate information loss, preserving fine details and boundaries in OCTA images. Our method reduces the required number of B-scans while enhancing accuracy, thereby increasing clinical applicability. This advancement holds promise for improving clinical practices and understanding skin microvascular dynamics crucial for cardiovascular health and thermoregulation.
Collapse
Affiliation(s)
- Mohammad Rashidi
- Faculty of Health and Medical Sciences, The University of Adelaide, Adelaide, SA, 5005, Australia.
- Institute for Photonics and Advanced Sensing, The University of Adelaide, Adelaide, SA, 5005, Australia.
| | - Georgy Kalenkov
- Faculty of Health and Medical Sciences, The University of Adelaide, Adelaide, SA, 5005, Australia
- Institute for Photonics and Advanced Sensing, The University of Adelaide, Adelaide, SA, 5005, Australia
| | - Daniel J Green
- School of Human Sciences (Exercise and Sport Sciences), The University of Western Australia, Crawley, WA, 6009, Australia
| | - Robert A Mclaughlin
- Faculty of Health and Medical Sciences, The University of Adelaide, Adelaide, SA, 5005, Australia
- Institute for Photonics and Advanced Sensing, The University of Adelaide, Adelaide, SA, 5005, Australia
- School of Engineering, The University of Western Australia, Crawley, WA, 6009, Australia
| |
Collapse
|
3
|
Badhon RH, Thompson AC, Lim JI, Leng T, Alam MN. Quantitative Characterization of Retinal Features in Translated OCTA. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.02.23.24303275. [PMID: 38464168 PMCID: PMC10925340 DOI: 10.1101/2024.02.23.24303275] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/12/2024]
Abstract
Purpose This study explores the feasibility of using generative machine learning (ML) to translate Optical Coherence Tomography (OCT) images into Optical Coherence Tomography Angiography (OCTA) images, potentially bypassing the need for specialized OCTA hardware. Methods The method involved implementing a generative adversarial network framework that includes a 2D vascular segmentation model and a 2D OCTA image translation model. The study utilizes a public dataset of 500 patients, divided into subsets based on resolution and disease status, to validate the quality of TR-OCTA images. The validation employs several quality and quantitative metrics to compare the translated images with ground truth OCTAs (GT-OCTA). We then quantitatively characterize vascular features generated in TR-OCTAs with GT-OCTAs to assess the feasibility of using TR-OCTA for objective disease diagnosis. Result TR-OCTAs showed high image quality in both 3 and 6 mm datasets (high-resolution, moderate structural similarity and contrast quality compared to GT-OCTAs). There were slight discrepancies in vascular metrics, especially in diseased patients. Blood vessel features like tortuosity and vessel perimeter index showed a better trend compared to density features which are affected by local vascular distortions. Conclusion This study presents a promising solution to the limitations of OCTA adoption in clinical practice by using vascular features from TR-OCTA for disease detection. Translation relevance This study has the potential to significantly enhance the diagnostic process for retinal diseases by making detailed vascular imaging more widely available and reducing dependency on costly OCTA equipment.
Collapse
Affiliation(s)
- Rashadul Hasan Badhon
- Department of Electrical and Computer Engineering, University of North Carolina at Charlotte, Charlotte, NC, United States
| | - Atalie Carina Thompson
- Department of Surgical Ophthalmology, Atrium-Health Wake Forest Baptist, Winston-Salem, NC, United States
| | - Jennifer I. Lim
- Department of Ophthalmology and Visual Science, University of Illinois at Chicago, Chicago, IL, United States
| | - Theodore Leng
- Department of Ophthalmology, Stanford University School of Medicine, Stanford, CA, United States
| | - Minhaj Nur Alam
- Department of Electrical and Computer Engineering, University of North Carolina at Charlotte, Charlotte, NC, United States
| |
Collapse
|
4
|
Liao J, Yang S, Zhang T, Li C, Huang Z. A hand-held optical coherence tomography angiography scanner based on angiography reconstruction transformer networks. JOURNAL OF BIOPHOTONICS 2023; 16:e202300100. [PMID: 37264544 DOI: 10.1002/jbio.202300100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Revised: 05/18/2023] [Accepted: 05/24/2023] [Indexed: 06/03/2023]
Abstract
Optical coherence tomography angiography (OCTA) has successfully demonstrated its viability for clinical applications in dermatology. Due to the high optical scattering property of skin, extracting high-quality OCTA images from skin tissues requires at least six-repeated scans. While the motion artifacts from the patient and the free hand-held probe can lead to a low-quality OCTA image. Our deep-learning-based scan pipeline enables fast and high-quality OCTA imaging with 0.3-s data acquisition. We utilize a fast scanning protocol with a 60 μm/pixel spatial interval rate and introduce angiography-reconstruction-transformer (ART) for 4× super-resolution of low transverse resolution OCTA images. The ART outperforms state-of-the-art networks in OCTA image super-resolution and provides a lighter network size. ART can restore microvessels while reducing the processing time by 85%, and maintaining improvements in structural similarity and peak-signal-to-noise ratio. This study represents that ART can achieve fast and flexible skin OCTA imaging while maintaining image quality.
Collapse
Affiliation(s)
- Jinpeng Liao
- School of Science and Engineering, University of Dundee, Scotland, UK
| | - Shufan Yang
- School of Computing, Engineering and Built Environment, Edinburgh Napier University, Edinburgh, UK
- Research Department of Orthopaedics and Musculoskeletal Science, University College London, UK
| | - Tianyu Zhang
- School of Science and Engineering, University of Dundee, Scotland, UK
| | - Chunhui Li
- School of Science and Engineering, University of Dundee, Scotland, UK
| | - Zhihong Huang
- School of Science and Engineering, University of Dundee, Scotland, UK
| |
Collapse
|
5
|
Arnould L, Meriaudeau F, Guenancia C, Germanese C, Delcourt C, Kawasaki R, Cheung CY, Creuzot-Garcher C, Grzybowski A. Using Artificial Intelligence to Analyse the Retinal Vascular Network: The Future of Cardiovascular Risk Assessment Based on Oculomics? A Narrative Review. Ophthalmol Ther 2023; 12:657-674. [PMID: 36562928 PMCID: PMC10011267 DOI: 10.1007/s40123-022-00641-5] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2022] [Accepted: 12/09/2022] [Indexed: 12/24/2022] Open
Abstract
The healthcare burden of cardiovascular diseases remains a major issue worldwide. Understanding the underlying mechanisms and improving identification of people with a higher risk profile of systemic vascular disease through noninvasive examinations is crucial. In ophthalmology, retinal vascular network imaging is simple and noninvasive and can provide in vivo information of the microstructure and vascular health. For more than 10 years, different research teams have been working on developing software to enable automatic analysis of the retinal vascular network from different imaging techniques (retinal fundus photographs, OCT angiography, adaptive optics, etc.) and to provide a description of the geometric characteristics of its arterial and venous components. Thus, the structure of retinal vessels could be considered a witness of the systemic vascular status. A new approach called "oculomics" using retinal image datasets and artificial intelligence algorithms recently increased the interest in retinal microvascular biomarkers. Despite the large volume of associated research, the role of retinal biomarkers in the screening, monitoring, or prediction of systemic vascular disease remains uncertain. A PubMed search was conducted until August 2022 and yielded relevant peer-reviewed articles based on a set of inclusion criteria. This literature review is intended to summarize the state of the art in oculomics and cardiovascular disease research.
Collapse
Affiliation(s)
- Louis Arnould
- Ophthalmology Department, Dijon University Hospital, 14 Rue Paul Gaffarel, 21079, Dijon CEDEX, France. .,University of Bordeaux, Inserm, Bordeaux Population Health Research Center, UMR U1219, 33000, Bordeaux, France.
| | - Fabrice Meriaudeau
- Laboratory ImViA, IFTIM, Université Bourgogne Franche-Comté, 21078, Dijon, France
| | - Charles Guenancia
- Pathophysiology and Epidemiology of Cerebro-Cardiovascular Diseases, (EA 7460), Faculty of Health Sciences, Université de Bourgogne Franche-Comté, Dijon, France.,Cardiology Department, Dijon University Hospital, Dijon, France
| | - Clément Germanese
- Ophthalmology Department, Dijon University Hospital, 14 Rue Paul Gaffarel, 21079, Dijon CEDEX, France
| | - Cécile Delcourt
- University of Bordeaux, Inserm, Bordeaux Population Health Research Center, UMR U1219, 33000, Bordeaux, France
| | - Ryo Kawasaki
- Artificial Intelligence Center for Medical Research and Application, Osaka University Hospital, Osaka, Japan
| | - Carol Y Cheung
- Department of Ophthalmology and Visual Sciences, The Chinese University of Hong Kong, Hong Kong, China
| | - Catherine Creuzot-Garcher
- Ophthalmology Department, Dijon University Hospital, 14 Rue Paul Gaffarel, 21079, Dijon CEDEX, France.,Centre des Sciences du Goût et de l'Alimentation, AgroSup Dijon, CNRS, INRAE, Université Bourgogne Franche-Comté, Dijon, France
| | - Andrzej Grzybowski
- Department of Ophthalmology, University of Warmia and Mazury, Olsztyn, Poland.,Institute for Research in Ophthalmology, Poznan, Poland
| |
Collapse
|
6
|
Pan Y, Park K, Ren J, Volkow ND, Ling H, Koretsky AP, Du C. Dynamic 3D imaging of cerebral blood flow in awake mice using self-supervised-learning-enhanced optical coherence Doppler tomography. Commun Biol 2023; 6:298. [PMID: 36944712 PMCID: PMC10030663 DOI: 10.1038/s42003-023-04656-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Accepted: 03/03/2023] [Indexed: 03/23/2023] Open
Abstract
Cerebral blood flow (CBF) is widely used to assess brain function. However, most preclinical CBF studies have been performed under anesthesia, which confounds findings. High spatiotemporal-resolution CBF imaging of awake animals is challenging due to motion artifacts and background noise, particularly for Doppler-based flow imaging. Here, we report ultrahigh-resolution optical coherence Doppler tomography (µODT) for 3D imaging of CBF velocity (CBFv) dynamics in awake mice by developing self-supervised deep-learning for effective image denoising and motion-artifact removal. We compare cortical CBFv in awake vs. anesthetized mice and their dynamic responses in arteriolar, venular and capillary networks to acute cocaine (1 mg/kg, i.v.), a highly addictive drug associated with neurovascular toxicity. Compared with awake, isoflurane (2-2.5%) induces vasodilation and increases CBFv within 2-4 min, whereas dexmedetomidine (0.025 mg/kg, i.p.) does not change vessel diameters nor flow. Acute cocaine decreases CBFv to the same extent in dexmedetomidine and awake states, whereas decreases are larger under isoflurane, suggesting that isoflurane-induced vasodilation might have facilitated detection of cocaine-induced vasoconstriction. Awake mice after chronic cocaine show severe vasoconstriction, CBFv decreases and vascular adaptations with extended diving arteriolar/venular vessels that prioritize blood supply to deeper cortical capillaries. The 3D imaging platform we present provides a powerful tool to study dynamic changes in vessel diameters and morphology alongside CBFv networks in the brain of awake animals that can advance our understanding of the effects of drugs and disease conditions (ischemia, tumors, wound healing).
Collapse
Affiliation(s)
- Yingtian Pan
- Department of Biomedical Engineering, Stony Brook University, Stony Brook, NY, 11794, USA.
| | - Kicheon Park
- Department of Biomedical Engineering, Stony Brook University, Stony Brook, NY, 11794, USA
| | - Jiaxiang Ren
- Department of Computer Science, Stony Brook University, Stony Brook, NY, 11794, USA
| | - Nora D Volkow
- National Institute on Alcohol Abuse and Alcoholism, National Institutes of Health, Bethesda, MD, 20857, USA
| | - Haibin Ling
- Department of Computer Science, Stony Brook University, Stony Brook, NY, 11794, USA
| | - Alan P Koretsky
- National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, 20892, USA
| | - Congwu Du
- Department of Biomedical Engineering, Stony Brook University, Stony Brook, NY, 11794, USA
| |
Collapse
|
7
|
Optical Coherence Tomography Angiography of the Intestine: How to Prevent Motion Artifacts in Open and Laparoscopic Surgery? Life (Basel) 2023; 13:life13030705. [PMID: 36983861 PMCID: PMC10055682 DOI: 10.3390/life13030705] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Revised: 02/25/2023] [Accepted: 02/28/2023] [Indexed: 03/08/2023] Open
Abstract
(1) Introduction. The problem that limits the intraoperative use of OCTA for the intestinal circulation diagnostics is the low informative value of OCTA images containing too many motion artifacts. The aim of this study is to evaluate the efficiency and safety of the developed unit for the prevention of the appearance of motion artifacts in the OCTA images of the intestine in both open and laparoscopic surgery in the experiment; (2) Methods. A high-speed spectral-domain multimodal optical coherence tomograph (IAP RAS, Russia) operating at a wavelength of 1310 nm with a spectral width of 100 μm and a power of 2 mW was used. The developed unit was tested in two groups of experimental animals—on minipigs (group I, n = 10, open abdomen) and on rabbits (group II, n = 10, laparoscopy). Acute mesenteric ischemia was modeled and then 1 h later the small intestine underwent OCTA evaluation. A total of 400 OCTA images of the intact and ischemic small intestine were obtained and analyzed. The quality of the obtained OCTA images was evaluated based on the score proposed in 2020 by the group of Magnin M. (3) Results. Without stabilization, OCTA images of the intestine tissues were informative only in 32–44% of cases in open surgery and in 14–22% of cases in laparoscopic surgery. A vacuum bowel stabilizer with a pressure deficit of 22–25 mm Hg significantly reduced the number of motion artifacts. As a result, the proportion of informative OCTA images in open surgery increased up to 86.5% (Χ2 = 200.2, p = 0.001), and in laparoscopy up to 60% (Χ2 = 148.3, p = 0.001). (4) Conclusions. The used vacuum tissue stabilizer enabled a significant increase in the proportion of informative OCTA images by significantly reducing the motion artifacts.
Collapse
|
8
|
Schottenhamml J, Hohberger B, Mardin CY. Applications of Artificial Intelligence in Optical Coherence Tomography Angiography Imaging. Klin Monbl Augenheilkd 2022; 239:1412-1426. [PMID: 36493762 DOI: 10.1055/a-1961-7137] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Optical coherence tomography angiography (OCTA) and artificial intelligence (AI) are two emerging fields that complement each other. OCTA enables the noninvasive, in vivo, 3D visualization of retinal blood flow with a micrometer resolution, which has been impossible with other imaging modalities. As it does not need dye-based injections, it is also a safer procedure for patients. AI has excited great interest in many fields of daily life, by enabling automatic processing of huge amounts of data with a performance that greatly surpasses previous algorithms. It has been used in many breakthrough studies in recent years, such as the finding that AlphaGo can beat humans in the strategic board game of Go. This paper will give a short introduction into both fields and will then explore the manifold applications of AI in OCTA imaging that have been presented in the recent years. These range from signal generation over signal enhancement to interpretation tasks like segmentation and classification. In all these areas, AI-based algorithms have achieved state-of-the-art performance that has the potential to improve standard care in ophthalmology when integrated into the daily clinical routine.
Collapse
Affiliation(s)
- Julia Schottenhamml
- Augenklinik, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Bettina Hohberger
- Augenklinik, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | | |
Collapse
|
9
|
Efficient Computer-Generated Holography Based on Mixed Linear Convolutional Neural Networks. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12094177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
Imaging based on computer-generated holography using traditional methods has the problems of poor quality and long calculation cycles. However, recently, the development of deep learning has provided new ideas for this problem. Here, an efficient computer-generated holography (ECGH) method is proposed for computational holographic imaging. This method can be used for computational holographic imaging based on mixed linear convolutional neural networks (MLCNN). By introducing fully connected layers in the network, the suggested design is more powerful and efficient at information mining and information exchange. Using the ECGH, the pure phase image required can be obtained after calculating the custom light field. Compared with traditional computed holography based on deep learning, the method used here can reduce the number of network parameters needed for network training by about two-thirds while obtaining a high-quality image in the reconstruction, and the network structure has the potential to solve various image-reconstruction problems.
Collapse
|