1
|
Driban M, Yan A, Selvam A, Ong J, Vupparaboina KK, Chhablani J. Artificial intelligence in chorioretinal pathology through fundoscopy: a comprehensive review. Int J Retina Vitreous 2024; 10:36. [PMID: 38654344 PMCID: PMC11036694 DOI: 10.1186/s40942-024-00554-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Accepted: 04/02/2024] [Indexed: 04/25/2024] Open
Abstract
BACKGROUND Applications for artificial intelligence (AI) in ophthalmology are continually evolving. Fundoscopy is one of the oldest ocular imaging techniques but remains a mainstay in posterior segment imaging due to its prevalence, ease of use, and ongoing technological advancement. AI has been leveraged for fundoscopy to accomplish core tasks including segmentation, classification, and prediction. MAIN BODY In this article we provide a review of AI in fundoscopy applied to representative chorioretinal pathologies, including diabetic retinopathy and age-related macular degeneration, among others. We conclude with a discussion of future directions and current limitations. SHORT CONCLUSION As AI evolves, it will become increasingly essential for the modern ophthalmologist to understand its applications and limitations to improve patient outcomes and continue to innovate.
Collapse
Affiliation(s)
- Matthew Driban
- Department of Ophthalmology, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Audrey Yan
- Department of Medicine, West Virginia School of Osteopathic Medicine, Lewisburg, WV, USA
| | - Amrish Selvam
- Department of Ophthalmology, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Joshua Ong
- Michigan Medicine, University of Michigan, Ann Arbor, USA
| | | | - Jay Chhablani
- Department of Ophthalmology, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA.
| |
Collapse
|
2
|
Hemanth SV, Alagarsamy S, Rajkumar TD. A novel deep learning model for diabetic retinopathy detection in retinal fundus images using pre-trained CNN and HWBLSTM. J Biomol Struct Dyn 2024:1-19. [PMID: 38373067 DOI: 10.1080/07391102.2024.2314269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Accepted: 01/30/2024] [Indexed: 02/21/2024]
Abstract
Diabetic retinopathy (DR) is a global visual indicator of diabetes that leads to blindness and loss of vision. Manual testing presents a more difficult task when attempting to detect DR due to the complexity and variances of DR. Early detection and treatment prevent the diabetic patients from visual loss. Also classifying the intensity and levels of DR is crucial to provide necessary treatment. This study develops a novel deep learning (DL) approach called He Weighted Bi-directional Long Short-term Memory (HWBLSTM) with an effective transfer learning technique for detecting DR from the RFI. The collected fundus images initially undergo preprocessing to improve their quality, which includes noise removal and contrast enhancement using a Hybrid Gaussian Filter and probability density Function-based Gamma Correction (HGFPDFGC) technique. The segmentation procedure divides the image into subgroups and is crucial for accurate detection and classification. The segmentation of the study initially removes the optical disk (OD) and blood vessels (BVs) from the preprocessed images using mathematical morphological operations. Next, it segments the retinal lesions from the OD and BV removed images using the Enhanced Grasshopper Optimization-based Region Growing Algorithm (EGORGA). Then, the features from the segmented retinal lesions are learned using a Squeeze Net (SQN), and the dimensionality reduction of the extracted features is done using the Modified Singular Value Decomposition (MSVD) approach. Finally, the classification is performed by employing the HWBLSTM approach, which classifies the DR abnormalities in datasets as non-DR (NDR), non-proliferative DR (NPDR), moderate NPDR (MDNPDR), and severe DR, also known as proliferative DR (PDR). The proposed approach is implemented on APTOS as well as MESSIDOR datasets. The outcomes proved that the proposed technique accurately identifies the DR with minimal computation overhead compared to the existing approaches.Communicated by Ramaswamy H. Sarma.
Collapse
Affiliation(s)
- S V Hemanth
- Department of Computer Science and Engineering, Hyderabad Institute of Technology and Management, Hyderabad, India
| | - Saravanan Alagarsamy
- Department of Information Technology, Sri Sivasubramaniya Nadar College of Engineering, Rajiv Gandhi Salai (OMR), Kalavakkam, India
| | - T Dhiliphan Rajkumar
- Department of Computer Science and Engineering, Kalasalingam Academy of Research and Education, Krishnankoil, India
| |
Collapse
|
3
|
Bahr T, Vu TA, Tuttle JJ, Iezzi R. Deep Learning and Machine Learning Algorithms for Retinal Image Analysis in Neurodegenerative Disease: Systematic Review of Datasets and Models. Transl Vis Sci Technol 2024; 13:16. [PMID: 38381447 PMCID: PMC10893898 DOI: 10.1167/tvst.13.2.16] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 11/26/2023] [Indexed: 02/22/2024] Open
Abstract
Purpose Retinal images contain rich biomarker information for neurodegenerative disease. Recently, deep learning models have been used for automated neurodegenerative disease diagnosis and risk prediction using retinal images with good results. Methods In this review, we systematically report studies with datasets of retinal images from patients with neurodegenerative diseases, including Alzheimer's disease, Huntington's disease, Parkinson's disease, amyotrophic lateral sclerosis, and others. We also review and characterize the models in the current literature which have been used for classification, regression, or segmentation problems using retinal images in patients with neurodegenerative diseases. Results Our review found several existing datasets and models with various imaging modalities primarily in patients with Alzheimer's disease, with most datasets on the order of tens to a few hundred images. We found limited data available for the other neurodegenerative diseases. Although cross-sectional imaging data for Alzheimer's disease is becoming more abundant, datasets with longitudinal imaging of any disease are lacking. Conclusions The use of bilateral and multimodal imaging together with metadata seems to improve model performance, thus multimodal bilateral image datasets with patient metadata are needed. We identified several deep learning tools that have been useful in this context including feature extraction algorithms specifically for retinal images, retinal image preprocessing techniques, transfer learning, feature fusion, and attention mapping. Importantly, we also consider the limitations common to these models in real-world clinical applications. Translational Relevance This systematic review evaluates the deep learning models and retinal features relevant in the evaluation of retinal images of patients with neurodegenerative disease.
Collapse
Affiliation(s)
- Tyler Bahr
- Mayo Clinic, Department of Ophthalmology, Rochester, MN, USA
| | - Truong A. Vu
- University of the Incarnate Word, School of Osteopathic Medicine, San Antonio, TX, USA
| | - Jared J. Tuttle
- University of Texas Health Science Center at San Antonio, Joe R. and Teresa Lozano Long School of Medicine, San Antonio, TX, USA
| | - Raymond Iezzi
- Mayo Clinic, Department of Ophthalmology, Rochester, MN, USA
| |
Collapse
|
4
|
Chikumba S, Hu Y, Luo J. Deep learning-based fundus image analysis for cardiovascular disease: a review. Ther Adv Chronic Dis 2023; 14:20406223231209895. [PMID: 38028950 PMCID: PMC10657535 DOI: 10.1177/20406223231209895] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Accepted: 10/03/2023] [Indexed: 12/01/2023] Open
Abstract
It is well established that the retina provides insights beyond the eye. Through observation of retinal microvascular changes, studies have shown that the retina contains information related to cardiovascular disease. Despite the tremendous efforts toward reducing the effects of cardiovascular diseases, they remain a global challenge and a significant public health concern. Conventionally, predicting the risk of cardiovascular disease involves the assessment of preclinical features, risk factors, or biomarkers. However, they are associated with cost implications, and tests to acquire predictive parameters are invasive. Artificial intelligence systems, particularly deep learning (DL) methods applied to fundus images have been generating significant interest as an adjunct assessment tool with the potential of enhancing efforts to prevent cardiovascular disease mortality. Risk factors such as age, gender, smoking status, hypertension, and diabetes can be predicted from fundus images using DL applications with comparable performance to human beings. A clinical change to incorporate DL systems for the analysis of fundus images as an equally good test over more expensive and invasive procedures may require conducting prospective clinical trials to mitigate all the possible ethical challenges and medicolegal implications. This review presents current evidence regarding the use of DL applications on fundus images to predict cardiovascular disease.
Collapse
Affiliation(s)
- Symon Chikumba
- Department of Ophthalmology, The Second Xiangya Hospital of Central South University, Changsha, Hunan, China
- Department of Optometry, Faculty of Healthy Sciences, Mzuzu University, Luwinga, Mzuzu, Malawi
| | - Yuqian Hu
- Department of Ophthalmology, The Second Xiangya Hospital of Central South University, Changsha, Hunan, China
| | - Jing Luo
- Department of Ophthalmology, The Second Xiangya Hospital of Central South University, 139 Middle Renmin RD, Changsha, Hunan, China
| |
Collapse
|
5
|
Bdeer N, Hadar N, Raveh D, Obied B, Richard S, Zahavi A, Goldenberg-Cohen N. Ocular Torsion in Children with Horizontal Strabismus or Orthophoria. CHILDREN (BASEL, SWITZERLAND) 2023; 10:1536. [PMID: 37761497 PMCID: PMC10527918 DOI: 10.3390/children10091536] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Revised: 09/01/2023] [Accepted: 09/06/2023] [Indexed: 09/29/2023]
Abstract
PURPOSE To report the rate of ocular torsion in children with horizontal strabismus or orthophoria. METHODS A retrospective study design was used. Nineteen children were included in the study, including seven girls, aged 4-16 years. All patients were examined for strabismus and 12 were scheduled for surgical intervention. All participants had digital fundus photos (DRSplus, Padova, Italy) of both eyes at presentation, and 5 of 12 also had fundus photos following the strabismus operation. Patient files were reviewed for age, demographic data, type of strabismus, clinical symptoms and signs, orthoptic exams, subjective and objective reports of torsion, inferior oblique overaction, and V pattern. Fundus photos were analyzed for torsion by ImageJ software [ImageJ 1.54f, National Institute of Health, USA]. The disc-foveal angle was calculated for ocular torsion. Disc-foveal angle was defined as the angle formed between a line passing through the center of the optic disc to the fovea and another horizontal line passing through the center of the optic disc, using fundus photographs. RESULTS Of the 19 children, 18 had horizontal strabismus: 9 with exotropia and 9 with esotropia. One child was orthophoric with torsional strabismus. Inferior oblique overaction was detected in all but 3 children, while V pattern was documented in 10. Visual acuity was reduced (under 6/12) in four eyes of four children. None were symptomatic for ocular torsion. Although extorsion was documented clinically in 3 of 19 children, it was measurable on fundus photos in all patients before surgery with a mean of 8.7 ± 8.5 degrees and 8.5 ± 9.7 degrees in the right and left eyes, respectively. The mean extorsion in both eyes was 19.7 ± 10.1 degrees and improved to a mean of 15.3 ± 7.9 degrees in the children who were operated on and had documented postoperative fundus photographs. CONCLUSIONS Extorsion was detected on fundus photos at a significantly higher rate than in clinical examination. Notably, inferior oblique overaction was mainly associated with torsion. This study demonstrated that torsion is underdiagnosed in clinical examinations, as the children are often asymptomatic, but fundus photos which are easily obtained can improve its detection.
Collapse
Affiliation(s)
- Nayrouz Bdeer
- Faculty of Medicine, Hadassah Hebrew University, Jerusalem 91120, Israel;
| | - Noa Hadar
- Bnai-Zion Medical Center, Ophthalmology Department, Haifa 3339419, Israel; (N.H.); (D.R.)
| | - Doris Raveh
- Bnai-Zion Medical Center, Ophthalmology Department, Haifa 3339419, Israel; (N.H.); (D.R.)
| | - Basel Obied
- The Krieger Eye Research Laboratory, Bruce and Ruth Faculty of Medicine, Technion Institute of Technology, Haifa 3200003, Israel; (B.O.); (S.R.)
| | - Stephen Richard
- The Krieger Eye Research Laboratory, Bruce and Ruth Faculty of Medicine, Technion Institute of Technology, Haifa 3200003, Israel; (B.O.); (S.R.)
| | - Alon Zahavi
- Ophthalmology Department and Laboratory of Eye Research, Felsenstein Medical Research Center, Rabin Medical Center, Petach Tikva 4917002, Israel;
- Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv 69978, Israel
| | - Nitza Goldenberg-Cohen
- Bnai-Zion Medical Center, Ophthalmology Department, Haifa 3339419, Israel; (N.H.); (D.R.)
- The Krieger Eye Research Laboratory, Bruce and Ruth Faculty of Medicine, Technion Institute of Technology, Haifa 3200003, Israel; (B.O.); (S.R.)
| |
Collapse
|
6
|
Ji Y, Ji Y, Liu Y, Zhao Y, Zhang L. Research progress on diagnosing retinal vascular diseases based on artificial intelligence and fundus images. Front Cell Dev Biol 2023; 11:1168327. [PMID: 37056999 PMCID: PMC10086262 DOI: 10.3389/fcell.2023.1168327] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Accepted: 03/20/2023] [Indexed: 03/30/2023] Open
Abstract
As the only blood vessels that can directly be seen in the whole body, pathological changes in retinal vessels are related to the metabolic state of the whole body and many systems, which seriously affect the vision and quality of life of patients. Timely diagnosis and treatment are key to improving vision prognosis. In recent years, with the rapid development of artificial intelligence, the application of artificial intelligence in ophthalmology has become increasingly extensive and in-depth, especially in the field of retinal vascular diseases. Research study results based on artificial intelligence and fundus images are remarkable and provides a great possibility for early diagnosis and treatment. This paper reviews the recent research progress on artificial intelligence in retinal vascular diseases (including diabetic retinopathy, hypertensive retinopathy, retinal vein occlusion, retinopathy of prematurity, and age-related macular degeneration). The limitations and challenges of the research process are also discussed.
Collapse
Affiliation(s)
- Yuke Ji
- The Laboratory of Artificial Intelligence and Bigdata in Ophthalmology, Affiliated Eye Hospital of Nanjing Medical University, Nanjing, China
| | - Yun Ji
- Affiliated Hospital of Shandong University of traditional Chinese Medicine, Jinan, Shandong, China
| | - Yunfang Liu
- Department of Ophthalmology, The First People’s Hospital of Huzhou, Huzhou, Zhejiang, China
| | - Ying Zhao
- Affiliated Hospital of Shandong University of traditional Chinese Medicine, Jinan, Shandong, China
- *Correspondence: Liya Zhang, ; Ying Zhao,
| | - Liya Zhang
- Department of Ophthalmology, The First People’s Hospital of Huzhou, Huzhou, Zhejiang, China
- *Correspondence: Liya Zhang, ; Ying Zhao,
| |
Collapse
|
7
|
Horie S, Ohno-Matsui K. Progress of Imaging in Diabetic Retinopathy-From the Past to the Present. Diagnostics (Basel) 2022; 12:diagnostics12071684. [PMID: 35885588 PMCID: PMC9319818 DOI: 10.3390/diagnostics12071684] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 06/24/2022] [Accepted: 07/06/2022] [Indexed: 02/05/2023] Open
Abstract
Advancement of imaging technology in retinal diseases provides us more precise understanding and new insights into the diseases' pathologies. Diabetic retinopathy (DR) is one of the leading causes of sight-threatening retinal diseases worldwide. Colour fundus photography and fluorescein angiography have long been golden standard methods in detecting retinal vascular pathology in this disease. One of the major advancements is macular observation given by optical coherence tomography (OCT). OCT dramatically improves the diagnostic quality in macular edema in DR. The technology of OCT is also applied to angiography (OCT angiograph: OCTA), which enables retinal vascular imaging without venous dye injection. Similar to OCTA, in terms of their low invasiveness, single blue color SLO image could be an alternative method in detecting non-perfused areas. Conventional optical photography has been gradually replaced to scanning laser ophthalmoscopy (SLO), which also make it possible to produce spectacular ultra-widefield (UWF) images. Since retinal vascular changes of DR are found in the whole retina up to periphery, it would be one of the best targets in UWF imaging. Additionally, evolvement of artificial intelligence (AI) has been applied to automated diagnosis of DR, and AI-based DR management is one of the major topics in this field. This review is trying to look back on the progress of imaging of DR comprehensively from the past to the present.
Collapse
Affiliation(s)
- Shintaro Horie
- Department of Advanced Ophthalmic Imaging, Tokyo Medical and Dental University, Tokyo 113-8519, Japan;
| | - Kyoko Ohno-Matsui
- Department of Ophthalmology and Visual Science, Tokyo Medical and Dental University, Tokyo 113-8519, Japan
- Correspondence: ; Tel.: +81-3-5803-5302
| |
Collapse
|
8
|
Zhu HY, Liu XQ, Yuan YZ, Wang DH. Measurement of the Lid Margin Thickness in Meibomian Gland Dysfunction with Vernier Micrometer. Ophthalmol Ther 2021; 11:177-186. [PMID: 34762260 PMCID: PMC8770731 DOI: 10.1007/s40123-021-00421-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Accepted: 10/29/2021] [Indexed: 11/25/2022] Open
Abstract
Introduction To investigate the lid margin thickness (LMT) from the posterior lash line to the mucocutaneous junction at the middle position in adults with and without meibomian gland dysfunction (MGD) by vernier micrometer (VM). Methods This is a cross-sectional, observational study. A hundred eyes from 100 volunteers aged 20 to 79, including 56 normal participants and 44 participants with MGD, were recruited. Measurements of the LMT by VM were performed by the same person. Results The mean age of 56 normal subjects (24 males and 32 females) and 44 MGD subjects (16 males and 28 females) was 40.0 ± 13.2 years and 42.7 ± 17.1 years, respectively. There was a significant difference in the upper LMT between normal and MGD subjects (1.36 ± 0.25 vs. 1.60 ± 0.27 mm, P < 0.001), but not in the lower LMT (1.0 ± 0.23 vs. 1.10 ± 0.28 mm, P = 0.07). In both normal and MGD subjects, the upper or lower LMT was significantly positively correlated with age (P < 0.05), and the upper LMT was greater than the lower LMT (P < 0.001). In addition, the lower LMT in MGD subjects was significantly positively correlated with meibum expressibility (rs = 0.35, P = 0.02). Conclusions The LMT was closely related to age and could be an important indicator for detecting MGD. Furthermore, we found that the upper LMT was greater than the lower LMT, and the lower LMT in MGD subjects seemed to be related to meibum expressibility.
Collapse
Affiliation(s)
- Hua-Ying Zhu
- Department of Ophthalmology, Longhua Hospital Affiliated to Shanghai University of Traditional Chinese Medicine, No.725 South Wanping Road, Xuhui District, Shanghai, 200032, China
| | - Xin-Quan Liu
- Department of Ophthalmology, Longhua Hospital Affiliated to Shanghai University of Traditional Chinese Medicine, No.725 South Wanping Road, Xuhui District, Shanghai, 200032, China
| | - Yuan-Zhi Yuan
- Department of Ophthalmology, Zhongshan Hospital Affiliated to Fudan University, Shanghai, China.,Centre for Evidence-Based Medicine, Fudan University, Shanghai, China
| | - Da-Hu Wang
- Department of Ophthalmology, Longhua Hospital Affiliated to Shanghai University of Traditional Chinese Medicine, No.725 South Wanping Road, Xuhui District, Shanghai, 200032, China.
| |
Collapse
|