1
|
Târcoveanu F, Leon F, Lisa C, Curteanu S, Feraru A, Ali K, Anton N. The use of artificial neural networks in studying the progression of glaucoma. Sci Rep 2024; 14:19597. [PMID: 39179625 PMCID: PMC11344130 DOI: 10.1038/s41598-024-70748-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2024] [Accepted: 08/20/2024] [Indexed: 08/26/2024] Open
Abstract
In ophthalmology, artificial intelligence methods show great promise due to their potential to enhance clinical observations with predictive capabilities and support physicians in diagnosing and treating patients. This paper focuses on modelling glaucoma evolution because it requires early diagnosis, individualized treatment, and lifelong monitoring. Glaucoma is a chronic, progressive, irreversible, multifactorial optic neuropathy that primarily affects elderly individuals. It is important to emphasize that the processed data are taken from medical records, unlike other studies in the literature that rely on image acquisition and processing. Although more challenging to handle, this approach has the advantage of including a wide range of parameters in large numbers, which can highlight their potential influence. Artificial neural networks are used to study glaucoma progression, designed through successive trials for near-optimal configurations using the NeuroSolutions and PyTorch frameworks. Furthermore, different problems are formulated to demonstrate the influence of various structural and functional parameters on the study of glaucoma progression. Optimal neural networks were obtained using a program written in Python using the PyTorch deep learning framework. For various tasks, very small errors in training and validation, under 5%, were obtained. It has been demonstrated that very good results can be achieved, making them credible and useful for medical practice.
Collapse
Affiliation(s)
- Filip Târcoveanu
- Ophthalmology Department, Faculty of Medicine, University of Medicine and Pharmacy "Gr. T. Popa" Iasi, University Street No 16, 700115, Iasi, Romania
| | - Florin Leon
- Faculty of Automatic Control and Computer Engineering, "Gheorghe Asachi" Technical University of Iasi, 27 Mangeron Street, 700050, Iasi, Romania
| | - Cătălin Lisa
- Department of Chemical Engineering, Faculty of Chemical Engineering and Environmental Protection "Cristofor Simionescu", "Gheorghe Asachi" Technical University of Iasi, 73 Mangeron Street, 700050, Iasi, Romania
| | - Silvia Curteanu
- Department of Chemical Engineering, Faculty of Chemical Engineering and Environmental Protection "Cristofor Simionescu", "Gheorghe Asachi" Technical University of Iasi, 73 Mangeron Street, 700050, Iasi, Romania.
| | - Andreea Feraru
- Faculty of Economic Science, "Vasile Alecsandri" University of Bacau, Calea Marasesti 156, 600115, Bacau, Romania
| | - Kashif Ali
- Countess of Chester Hospital, Liverpool Rd, Chester, CH21UL, UK
| | - Nicoleta Anton
- Ophthalmology Department, Faculty of Medicine, University of Medicine and Pharmacy "Gr. T. Popa" Iasi, University Street No 16, 700115, Iasi, Romania.
| |
Collapse
|
2
|
Tran L, Kandel H, Sari D, Chiu CH, Watson SL. Artificial Intelligence and Ophthalmic Clinical Registries. Am J Ophthalmol 2024; 268:263-274. [PMID: 39111520 DOI: 10.1016/j.ajo.2024.07.039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2024] [Revised: 07/30/2024] [Accepted: 07/31/2024] [Indexed: 09/03/2024]
Abstract
PURPOSE The recent advances in artificial intelligence (AI) represent a promising solution to increasing clinical demand and ever limited health resources. Whilst powerful, AI models require vast amounts of representative training data to output meaningful predictions in the clinical environment. Clinical registries represent a promising source of large volume real-world data which could be used to train more accurate and widely applicable AI models. This review aims to provide an overview of the current applications of AI to ophthalmic clinical registry data. DESIGN AND METHODS A systematic search of EMBASE, Medline, PubMed, Scopus and Web of Science for primary research articles that applied AI to ophthalmic clinical registry data was conducted in July 2024. RESULTS Twenty-three primary research articles applying AI to ophthalmic clinic registries (n = 14) were found. Registries were primarily defined by the condition captured and the most common conditions where AI was applied were glaucoma (n = 3) and neovascular age-related macular degeneration (n = 3). Tabular clinical data was the most common form of input into AI algorithms and outputs were primarily classifiers (n = 8, 40%) and risk quantifier models (n = 7, 35%). The AI algorithms applied were almost exclusively supervised conventional machine learning models (n = 39, 85%) such as decision tree classifiers and logistic regression, with only 7 applications of deep learning or natural language processing algorithms. Significant heterogeneity was found with regards to model validation methodology and measures of performance. CONCLUSIONS Limited applications of deep learning algorithms to clinical registry data have been reported. The lack of standardized validation methodology and heterogeneity of performance outcome reporting suggests that the application of AI to clinical registries is still in its infancy constrained by the poor accessibility of registry data and reflecting the need for a standardization of methodology and greater involvement of domain experts in the future development of clinically deployable AI.
Collapse
Affiliation(s)
- Luke Tran
- From the Faculty of Medicine and Health, Save Sight Institute, The University of Sydney, (L.T., H.K., D.S., C.H.C., S.L.W.) Sydney, New South Wales, Australia.
| | - Himal Kandel
- From the Faculty of Medicine and Health, Save Sight Institute, The University of Sydney, (L.T., H.K., D.S., C.H.C., S.L.W.) Sydney, New South Wales, Australia
| | - Daliya Sari
- From the Faculty of Medicine and Health, Save Sight Institute, The University of Sydney, (L.T., H.K., D.S., C.H.C., S.L.W.) Sydney, New South Wales, Australia
| | - Christopher Hy Chiu
- From the Faculty of Medicine and Health, Save Sight Institute, The University of Sydney, (L.T., H.K., D.S., C.H.C., S.L.W.) Sydney, New South Wales, Australia
| | - Stephanie L Watson
- From the Faculty of Medicine and Health, Save Sight Institute, The University of Sydney, (L.T., H.K., D.S., C.H.C., S.L.W.) Sydney, New South Wales, Australia
| |
Collapse
|
3
|
Jan C, He M, Vingrys A, Zhu Z, Stafford RS. Diagnosing glaucoma in primary eye care and the role of Artificial Intelligence applications for reducing the prevalence of undetected glaucoma in Australia. Eye (Lond) 2024; 38:2003-2013. [PMID: 38514852 PMCID: PMC11269618 DOI: 10.1038/s41433-024-03026-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 02/05/2024] [Accepted: 03/08/2024] [Indexed: 03/23/2024] Open
Abstract
Glaucoma is the commonest cause of irreversible blindness worldwide, with over 70% of people affected remaining undiagnosed. Early detection is crucial for halting progressive visual impairment in glaucoma patients, as there is no cure available. This narrative review aims to: identify reasons for the significant under-diagnosis of glaucoma globally, particularly in Australia, elucidate the role of primary healthcare in glaucoma diagnosis using Australian healthcare as an example, and discuss how recent advances in artificial intelligence (AI) can be implemented to improve diagnostic outcomes. Glaucoma is a prevalent disease in ageing populations and can have improved visual outcomes through appropriate treatment, making it essential for general medical practice. In countries such as Australia, New Zealand, Canada, USA, and the UK, optometrists serve as the gatekeepers for primary eye care, and glaucoma detection often falls on their shoulders. However, there is significant variation in the capacity for glaucoma diagnosis among eye professionals. Automation with Artificial Intelligence (AI) analysis of optic nerve photos can help optometrists identify high-risk changes and mitigate the challenges of image interpretation rapidly and consistently. Despite its potential, there are significant barriers and challenges to address before AI can be deployed in primary healthcare settings, including external validation, high quality real-world implementation, protection of privacy and cybersecurity, and medico-legal implications. Overall, the incorporation of AI technology in primary healthcare has the potential to reduce the global prevalence of undiagnosed glaucoma cases by improving diagnostic accuracy and efficiency.
Collapse
Affiliation(s)
- Catherine Jan
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, VIC, Australia.
- Ophthalmology, Department of Surgery, Faculty of Medicine, Dentistry & Health Sciences, University of Melbourne, Melbourne, VIC, Australia.
- Lost Child's Vision Project, Sydney, NSW, Australia.
| | - Mingguang He
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, VIC, Australia
- Ophthalmology, Department of Surgery, Faculty of Medicine, Dentistry & Health Sciences, University of Melbourne, Melbourne, VIC, Australia
- Centre for Eye and Vision Research, The Hong Kong Polytechnic University, Kowloon, TU428, Hong Kong SAR
| | - Algis Vingrys
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, VIC, Australia
- Ophthalmology, Department of Surgery, Faculty of Medicine, Dentistry & Health Sciences, University of Melbourne, Melbourne, VIC, Australia
- Department of Optometry and Vision Sciences, The University of Melbourne, Melbourne, VIC, Australia
| | - Zhuoting Zhu
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, VIC, Australia
- Ophthalmology, Department of Surgery, Faculty of Medicine, Dentistry & Health Sciences, University of Melbourne, Melbourne, VIC, Australia
| | - Randall S Stafford
- Stanford Prevention Research Center, Stanford University School of Medicine, Stanford, CA, USA
| |
Collapse
|
4
|
Kaarniranta K, Pawlikowska-Łagód K, Jääskeläinen JE, Grzybowski AE. Acta Ophthalmologica 100 years-Overview of selected articles during Acta Ophthalmologica history. Acta Ophthalmol 2024; 102:367-373. [PMID: 38233882 DOI: 10.1111/aos.16628] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Accepted: 01/05/2024] [Indexed: 01/19/2024]
Abstract
We selected and discussed 10 articles in Acta Ophthalmologica since 1923 that changed clinical ophthalmology and treatment protocols, or provided novel findings and perspectives. We are aware that the selection of articles may be debatable and we invite readers to suggest other significant Acta articles. For historians, the article archive of Acta Ophthalmologica is located in Copenhagen.
Collapse
Affiliation(s)
- Kai Kaarniranta
- Department of Ophthalmology, University of Eastern Finland, Kuopio, Finland
- Department of Ophthalmology, Kuopio University Hospital, Kuopio, Finland
- Department of Molecular Genetics, University of Lodz, Lodz, Poland
| | | | - Juha E Jääskeläinen
- Department of Ophthalmology, Kuopio University Hospital, Kuopio, Finland
- Department of Neurosurgery, University of Eastern Finland, Kuopio, Finland
| | - Andrzej E Grzybowski
- Institute for Research in Ophthalmology, Foundation for Ophthalmology Development, Poznań, Poland
| |
Collapse
|
5
|
Huang X, Islam MR, Akter S, Ahmed F, Kazami E, Serhan HA, Abd-Alrazaq A, Yousefi S. Artificial intelligence in glaucoma: opportunities, challenges, and future directions. Biomed Eng Online 2023; 22:126. [PMID: 38102597 PMCID: PMC10725017 DOI: 10.1186/s12938-023-01187-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Accepted: 12/01/2023] [Indexed: 12/17/2023] Open
Abstract
Artificial intelligence (AI) has shown excellent diagnostic performance in detecting various complex problems related to many areas of healthcare including ophthalmology. AI diagnostic systems developed from fundus images have become state-of-the-art tools in diagnosing retinal conditions and glaucoma as well as other ocular diseases. However, designing and implementing AI models using large imaging data is challenging. In this study, we review different machine learning (ML) and deep learning (DL) techniques applied to multiple modalities of retinal data, such as fundus images and visual fields for glaucoma detection, progression assessment, staging and so on. We summarize findings and provide several taxonomies to help the reader understand the evolution of conventional and emerging AI models in glaucoma. We discuss opportunities and challenges facing AI application in glaucoma and highlight some key themes from the existing literature that may help to explore future studies. Our goal in this systematic review is to help readers and researchers to understand critical aspects of AI related to glaucoma as well as determine the necessary steps and requirements for the successful development of AI models in glaucoma.
Collapse
Affiliation(s)
- Xiaoqin Huang
- Department of Ophthalmology, University of Tennessee Health Science Center, Memphis, USA
| | - Md Rafiqul Islam
- Business Information Systems, Australian Institute of Higher Education, Sydney, Australia
| | - Shanjita Akter
- School of Computer Science, Taylors University, Subang Jaya, Malaysia
| | - Fuad Ahmed
- Department of Computer Science & Engineering, Islamic University of Technology (IUT), Gazipur, Bangladesh
| | - Ehsan Kazami
- Ophthalmology, General Hospital of Mahabad, Urmia University of Medical Sciences, Urmia, Iran
| | - Hashem Abu Serhan
- Department of Ophthalmology, Hamad Medical Corporations, Doha, Qatar
| | - Alaa Abd-Alrazaq
- AI Center for Precision Health, Weill Cornell Medicine-Qatar, Doha, Qatar
| | - Siamak Yousefi
- Department of Ophthalmology, University of Tennessee Health Science Center, Memphis, USA.
- Department of Genetics, Genomics, and Informatics, University of Tennessee Health Science Center, Memphis, USA.
| |
Collapse
|
6
|
Tarcoveanu F, Leon F, Curteanu S, Chiselita D, Bogdanici CM, Anton N. Classification Algorithms Used in Predicting Glaucoma Progression. Healthcare (Basel) 2022; 10:1831. [PMID: 36292278 PMCID: PMC9601916 DOI: 10.3390/healthcare10101831] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Revised: 09/18/2022] [Accepted: 09/19/2022] [Indexed: 07/25/2023] Open
Abstract
In this paper, various machine learning algorithms were used in order to predict the evolution of open-angle glaucoma (POAG). The datasets were built containing clinical observations and objective measurements made at the Countess of Chester Hospital in the UK and at the "St. Spiridon" Hospital of Iași, Romania. Using these datasets, different classification problems were proposed. The evaluation of glaucoma progression was conducted based on parameters such as VFI (Visual field index), MD (Mean Deviation), PSD (Pattern standard deviation), and RNFL (Retinal Nerve Fiber Layer). As classification tools, the following algorithms were used: Multilayer Perceptron, Random Forest, Random Tree, C4.5, k-Nearest Neighbors, Support Vector Machine, and Non-Nested Generalized Exemplars. The best results, with an accuracy of over 90%, were obtained with Multilayer Perceptron and Random Forest algorithms. The NNGE algorithm also proved very useful in creating a hierarchy of the input values according to their influence (weight) on the considered outputs. On the other hand, the decision tree algorithms gave us insight into the logic used in their classification, which is of practical importance in obtaining additional information regarding the rationale behind a certain rule or decision.
Collapse
Affiliation(s)
- Filip Tarcoveanu
- Ophthalmology Department, Faculty of Medicine, University of Medicine and Pharmacy “Gr. T. Popa” Iasi, University Street No 16, 700115 Iasi, Romania
| | - Florin Leon
- Faculty of Automatic Control and Computer Engineering, “Gheorghe Asachi” Technical University of Iasi, 27 Mangeron Street, 700050 Iasi, Romania
| | - Silvia Curteanu
- Department of Chemical Engineering, Faculty of Chemical Engineering and Environmental Protection “Cristofor Simionescu”, “Gheorghe Asachi” Technical University of Iasi, 73 Mangeron Street, 700050 Iasi, Romania
| | - Dorin Chiselita
- Ophthalmology Department, Faculty of Medicine, University of Medicine and Pharmacy “Gr. T. Popa” Iasi, University Street No 16, 700115 Iasi, Romania
| | - Camelia Margareta Bogdanici
- Ophthalmology Department, Faculty of Medicine, University of Medicine and Pharmacy “Gr. T. Popa” Iasi, University Street No 16, 700115 Iasi, Romania
| | - Nicoleta Anton
- Ophthalmology Department, Faculty of Medicine, University of Medicine and Pharmacy “Gr. T. Popa” Iasi, University Street No 16, 700115 Iasi, Romania
| |
Collapse
|
7
|
Betzler BK, Rim TH, Sabanayagam C, Cheng CY. Artificial Intelligence in Predicting Systemic Parameters and Diseases From Ophthalmic Imaging. Front Digit Health 2022; 4:889445. [PMID: 35706971 PMCID: PMC9190759 DOI: 10.3389/fdgth.2022.889445] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Accepted: 05/06/2022] [Indexed: 12/14/2022] Open
Abstract
Artificial Intelligence (AI) analytics has been used to predict, classify, and aid clinical management of multiple eye diseases. Its robust performances have prompted researchers to expand the use of AI into predicting systemic, non-ocular diseases and parameters based on ocular images. Herein, we discuss the reasons why the eye is well-suited for systemic applications, and review the applications of deep learning on ophthalmic images in the prediction of demographic parameters, body composition factors, and diseases of the cardiovascular, hematological, neurodegenerative, metabolic, renal, and hepatobiliary systems. Three main imaging modalities are included—retinal fundus photographs, optical coherence tomographs and external ophthalmic images. We examine the range of systemic factors studied from ophthalmic imaging in current literature and discuss areas of future research, while acknowledging current limitations of AI systems based on ophthalmic images.
Collapse
Affiliation(s)
- Bjorn Kaijun Betzler
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
- Singapore National Eye Centre, Singapore Eye Research Institute, Singapore, Singapore
| | - Tyler Hyungtaek Rim
- Singapore National Eye Centre, Singapore Eye Research Institute, Singapore, Singapore
- Ophthalmology and Visual Sciences Academic Clinical Program (Eye ACP), Duke-NUS Medical School, Singapore, Singapore
| | - Charumathi Sabanayagam
- Singapore National Eye Centre, Singapore Eye Research Institute, Singapore, Singapore
- Ophthalmology and Visual Sciences Academic Clinical Program (Eye ACP), Duke-NUS Medical School, Singapore, Singapore
| | - Ching-Yu Cheng
- Singapore National Eye Centre, Singapore Eye Research Institute, Singapore, Singapore
- Ophthalmology and Visual Sciences Academic Clinical Program (Eye ACP), Duke-NUS Medical School, Singapore, Singapore
| |
Collapse
|
8
|
WU JOHSUAN, NISHIDA TAKASHI, WEINREB ROBERTN, LIN JOUWEI. Performances of Machine Learning in Detecting Glaucoma Using Fundus and Retinal Optical Coherence Tomography Images: A Meta-Analysis. Am J Ophthalmol 2022; 237:1-12. [PMID: 34942113 DOI: 10.1016/j.ajo.2021.12.008] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Revised: 11/24/2021] [Accepted: 12/03/2021] [Indexed: 11/01/2022]
Abstract
PURPOSE To evaluate the performance of machine learning (ML) in detecting glaucoma using fundus and retinal optical coherence tomography (OCT) images. DESIGN Meta-analysis. METHODS PubMed and EMBASE were searched on August 11, 2021. A bivariate random-effects model was used to pool ML's diagnostic sensitivity, specificity, and area under the curve (AUC). Subgroup analyses were performed based on ML classifier categories and dataset types. RESULTS One hundred and five studies (3.3%) were retrieved. Seventy-three (69.5%), 30 (28.6%), and 2 (1.9%) studies tested ML using fundus, OCT, and both image types, respectively. Total testing data numbers were 197,174 for fundus and 16,039 for OCT. Overall, ML showed excellent performances for both fundus (pooled sensitivity = 0.92 [95% CI, 0.91-0.93]; specificity = 0.93 [95% CI, 0.91-0.94]; and AUC = 0.97 [95% CI, 0.95-0.98]) and OCT (pooled sensitivity = 0.90 [95% CI, 0.86-0.92]; specificity = 0.91 [95% CI, 0.89-0.92]; and AUC = 0.96 [95% CI, 0.93-0.97]). ML performed similarly using all data and external data for fundus and the external test result of OCT was less robust (AUC = 0.87). When comparing different classifier categories, although support vector machine showed the highest performance (pooled sensitivity, specificity, and AUC ranges, 0.92-0.96, 0.95-0.97, and 0.96-0.99, respectively), results by neural network and others were still good (pooled sensitivity, specificity, and AUC ranges, 0.88-0.93, 0.90-0.93, 0.95-0.97, respectively). When analyzed based on dataset types, ML demonstrated consistent performances on clinical datasets (fundus AUC = 0.98 [95% CI, 0.97-0.99] and OCT AUC = 0.95 [95% 0.93-0.97]). CONCLUSIONS Performance of ML in detecting glaucoma compares favorably to that of experts and is promising for clinical application. Future prospective studies are needed to better evaluate its real-world utility.
Collapse
|
9
|
Zhu S, Lu B, Wang C, Wu M, Zheng B, Jiang Q, Wei R, Cao Q, Yang W. Screening of Common Retinal Diseases Using Six-Category Models Based on EfficientNet. Front Med (Lausanne) 2022; 9:808402. [PMID: 35280876 PMCID: PMC8904395 DOI: 10.3389/fmed.2022.808402] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2021] [Accepted: 01/12/2022] [Indexed: 11/21/2022] Open
Abstract
Purpose A six-category model of common retinal diseases is proposed to help primary medical institutions in the preliminary screening of the five common retinal diseases. Methods A total of 2,400 fundus images of normal and five common retinal diseases were provided by a cooperative hospital. Two six-category deep learning models of common retinal diseases based on the EfficientNet-B4 and ResNet50 models were trained. The results from the six-category models in this study and the results from a five-category model in our previous study based on ResNet50 were compared. A total of 1,315 fundus images were used to test the models, the clinical diagnosis results and the diagnosis results of the two six-category models were compared. The main evaluation indicators were sensitivity, specificity, F1-score, area under the curve (AUC), 95% confidence interval, kappa and accuracy, and the receiver operator characteristic curves of the two six-category models were compared in the study. Results The diagnostic accuracy rate of EfficientNet-B4 model was 95.59%, the kappa value was 94.61%, and there was high diagnostic consistency. The AUC of the normal diagnosis and the five retinal diseases were all above 0.95. The sensitivity, specificity, and F1-score for the diagnosis of normal fundus images were 100, 99.9, and 99.83%, respectively. The specificity and F1-score for RVO diagnosis were 95.68, 98.61, and 93.09%, respectively. The sensitivity, specificity, and F1-score for high myopia diagnosis were 96.1, 99.6, and 97.37%, respectively. The sensitivity, specificity, and F1-score for glaucoma diagnosis were 97.62, 99.07, and 94.62%, respectively. The sensitivity, specificity, and F1-score for DR diagnosis were 90.76, 99.16, and 93.3%, respectively. The sensitivity, specificity, and F1-score for MD diagnosis were 92.27, 98.5, and 91.51%, respectively. Conclusion The EfficientNet-B4 model was used to design a six-category model of common retinal diseases. It can be used to diagnose the normal fundus and five common retinal diseases based on fundus images. It can help primary doctors in the screening for common retinal diseases, and give suitable suggestions and recommendations. Timely referral can improve the efficiency of diagnosis of eye diseases in rural areas and avoid delaying treatment.
Collapse
Affiliation(s)
- Shaojun Zhu
- School of Information Engineering, Huzhou University, Huzhou, China.,Zhejiang Province Key Laboratory of Smart Management and Application of Modern Agricultural Resources, Huzhou University, Huzhou, China
| | - Bing Lu
- School of Information Engineering, Huzhou University, Huzhou, China
| | - Chenghu Wang
- The Affiliated Eye Hospital of Nanjing Medical University, Nanjing, China
| | - Maonian Wu
- School of Information Engineering, Huzhou University, Huzhou, China.,Zhejiang Province Key Laboratory of Smart Management and Application of Modern Agricultural Resources, Huzhou University, Huzhou, China
| | - Bo Zheng
- School of Information Engineering, Huzhou University, Huzhou, China.,Zhejiang Province Key Laboratory of Smart Management and Application of Modern Agricultural Resources, Huzhou University, Huzhou, China
| | - Qin Jiang
- The Affiliated Eye Hospital of Nanjing Medical University, Nanjing, China
| | - Ruili Wei
- Department of Ophthalmology, Shanghai Changzheng Hospital, Huangpu, China
| | - Qixin Cao
- Huzhou Traditional Chinese Medicine Hospital Affiliated to Zhejiang University of Traditional Chinese Medicine, Huzhou, China
| | - Weihua Yang
- The Affiliated Eye Hospital of Nanjing Medical University, Nanjing, China
| |
Collapse
|
10
|
Wu CW, Chen HY, Chen JY, Lee CH. Glaucoma Detection Using Support Vector Machine Method Based on Spectralis OCT. Diagnostics (Basel) 2022; 12:diagnostics12020391. [PMID: 35204482 PMCID: PMC8871188 DOI: 10.3390/diagnostics12020391] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2021] [Revised: 01/17/2022] [Accepted: 01/30/2022] [Indexed: 02/01/2023] Open
Abstract
Spectralis optical coherence tomography (OCT) provided more detailed parameters in the peripapillary and macular areas among the OCT machines, but it is not easy to understand the enormous information (114 features) generated from Spectralis OCT in glaucoma assessment. Machine learning methodology has been well-applied in glaucoma detection in recent years and has the ability to process a large amount of information at once. Here we aimed to analyze the diagnostic capability of Spectralis OCT parameters on glaucoma detection using Support Vector Machine (SVM) classification method in our population. Our results showed that applying all OCT features with the SVM method had good capability in the detection of glaucomatous eyes (area under curve (AUC) = 0.82), as well as discriminating normal eyes from early, moderate, or severe glaucomatous eyes (AUC = 0.78, 0.89, and 0.93, respectively). Apart from using all OCT features, the minimum rim width (MRW) may be good feature groups to discriminate early glaucomatous from normal eyes (AUC = 0.78). The combination of peripapillary and macular parameters, including MRW_temporal inferior (TI), MRW_global (G), ganglion cell layer (GCL)_outer temporal (T2), GCL_inner inferior (I1), peripapillary nerve fiber layer thickness (ppNFLT)_temporal superior (TS), and GCL_inner temporal (T1), provided better results (AUC = 0.84). This study showed promise in glaucoma management in the Taiwanese population. However, further validation study is needed to test the performance of our proposed model in the real world.
Collapse
Affiliation(s)
- Chao-Wei Wu
- Graduate Institute of Medicine, College of Medicine, Kaohsiung Medical University, Kaohsiung City 807378, Taiwan;
- Department of Ophthalmology, Kaohsiung Medical University Hospital, Kaohsiung Medical University, Kaohsiung City 807378, Taiwan
| | - Hsin-Yi Chen
- Department of Ophthalmology, Fu Jen Catholic University Hospital, New Taipei City 24352, Taiwan
- School of Medicine, College of Medicine, Fu Jen Catholic University, New Taipei City 242062, Taiwan
- Correspondence: (H.-Y.C.); (C.-H.L.)
| | - Jui-Yu Chen
- Institute of Electrical and Control Engineering, National Yang Ming Chiao Tung University, Hsinchu City 30010, Taiwan;
| | - Ching-Hung Lee
- Department of Electrical and Computer Engineering, National Yang Ming Chiao Tung University, Hsinchu City 30010, Taiwan
- Correspondence: (H.-Y.C.); (C.-H.L.)
| |
Collapse
|
11
|
Bunod R, Augstburger E, Brasnu E, Labbe A, Baudouin C. [Artificial intelligence and glaucoma: A literature review]. J Fr Ophtalmol 2022; 45:216-232. [PMID: 34991909 DOI: 10.1016/j.jfo.2021.11.002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Accepted: 11/18/2021] [Indexed: 11/26/2022]
Abstract
In recent years, research in artificial intelligence (AI) has experienced an unprecedented surge in the field of ophthalmology, in particular glaucoma. The diagnosis and follow-up of glaucoma is complex and relies on a body of clinical evidence and ancillary tests. This large amount of information from structural and functional testing of the optic nerve and macula makes glaucoma a particularly appropriate field for the application of AI. In this paper, we will review work using AI in the field of glaucoma, whether for screening, diagnosis or detection of progression. Many AI strategies have shown promising results for glaucoma detection using fundus photography, optical coherence tomography, or automated perimetry. The combination of these imaging modalities increases the performance of AI algorithms, with results comparable to those of humans. We will discuss potential applications as well as obstacles and limitations to the deployment and validation of such models. While there is no doubt that AI has the potential to revolutionize glaucoma management and screening, research in the coming years will need to address unavoidable questions regarding the clinical significance of such results and the explicability of the predictions.
Collapse
Affiliation(s)
- R Bunod
- Service d'ophtalmologie 3, IHU FOReSIGHT, centre hospitalier national des Quinze-Vingts, 28, rue de Charenton, 75012 Paris, France.
| | - E Augstburger
- Service d'ophtalmologie 3, IHU FOReSIGHT, centre hospitalier national des Quinze-Vingts, 28, rue de Charenton, 75012 Paris, France
| | - E Brasnu
- Service d'ophtalmologie 3, IHU FOReSIGHT, centre hospitalier national des Quinze-Vingts, 28, rue de Charenton, 75012 Paris, France; CHNO des Quinze-Vingts, IHU FOReSIGHT, INSERM-DGOS CIC 1423, 17, rue Moreau, 75012 Paris, France; Sorbonne universités, INSERM, CNRS, institut de la Vision, 17, rue Moreau, 75012 Paris, France
| | - A Labbe
- Service d'ophtalmologie 3, IHU FOReSIGHT, centre hospitalier national des Quinze-Vingts, 28, rue de Charenton, 75012 Paris, France; CHNO des Quinze-Vingts, IHU FOReSIGHT, INSERM-DGOS CIC 1423, 17, rue Moreau, 75012 Paris, France; Sorbonne universités, INSERM, CNRS, institut de la Vision, 17, rue Moreau, 75012 Paris, France; Service d'ophtalmologie, hôpital Ambroise-Paré, AP-HP, université de Paris Saclay, 9, avenue Charles-de-Gaulle, 92100 Boulogne-Billancourt, France
| | - C Baudouin
- Service d'ophtalmologie 3, IHU FOReSIGHT, centre hospitalier national des Quinze-Vingts, 28, rue de Charenton, 75012 Paris, France; CHNO des Quinze-Vingts, IHU FOReSIGHT, INSERM-DGOS CIC 1423, 17, rue Moreau, 75012 Paris, France; Sorbonne universités, INSERM, CNRS, institut de la Vision, 17, rue Moreau, 75012 Paris, France; Service d'ophtalmologie, hôpital Ambroise-Paré, AP-HP, université de Paris Saclay, 9, avenue Charles-de-Gaulle, 92100 Boulogne-Billancourt, France
| |
Collapse
|
12
|
Comparison of Different Machine Learning Classifiers for Glaucoma Diagnosis Based on Spectralis OCT. Diagnostics (Basel) 2021; 11:diagnostics11091718. [PMID: 34574059 PMCID: PMC8471622 DOI: 10.3390/diagnostics11091718] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2021] [Revised: 09/17/2021] [Accepted: 09/18/2021] [Indexed: 11/17/2022] Open
Abstract
Early detection is important in glaucoma management. By using optical coherence tomography (OCT), the subtle structural changes caused by glaucoma can be detected. Though OCT provided abundant parameters for comprehensive information, clinicians may be confused once the results conflict. Machine learning classifiers (MLCs) are good tools for considering numerous parameters and generating reliable diagnoses in glaucoma practice. Here we aim to compare different MLCs based on Spectralis OCT parameters, including circumpapillary retinal nerve fiber layer (cRNFL) thickness, Bruch’s membrane opening-minimum rim width (BMO-MRW), Early Treatment Diabetes Retinopathy Study (ETDRS) macular thickness, and posterior pole asymmetry analysis (PPAA), in discriminating normal from glaucomatous eyes. Five MLCs were proposed, namely conditional inference trees (CIT), logistic model tree (LMT), C5.0 decision tree, random forest (RF), and extreme gradient boosting (XGBoost). Logistic regression (LGR) was used as a benchmark for comparison. RF was shown to be the best model. Ganglion cell layer measurements were the most important predictors in early glaucoma detection and cRNFL measurements were more important as the glaucoma severity increased. The global, temporal, inferior, superotemporal, and inferotemporal sites were relatively influential locations among all parameters. Clinicians should cautiously integrate the Spectralis OCT results into the entire clinical picture when diagnosing glaucoma.
Collapse
|
13
|
Abstract
Early detection and monitoring are critical to the diagnosis and management of glaucoma, a progressive optic neuropathy that causes irreversible blindness. Optical coherence tomography (OCT) has become a commonly utilized imaging modality that aids in the detection and monitoring of structural glaucomatous damage. Since its inception in 1991, OCT has progressed through multiple iterations, from time-domain OCT, to spectral-domain OCT, to swept-source OCT, all of which have progressively improved the resolution and speed of scans. Even newer technological advancements and OCT applications, such as adaptive optics, visible-light OCT, and OCT-angiography, have enriched the use of OCT in the evaluation of glaucoma. This article reviews current commercial and state-of-the-art OCT technologies and analytic techniques in the context of their utility for glaucoma diagnosis and management, as well as promising future directions.
Collapse
Affiliation(s)
- Alexi Geevarghese
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY 10016, USA;
| | - Gadi Wollstein
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY 10016, USA;
- Department of Biomedical Engineering, NYU Tandon School of Engineering, Brooklyn, New York 11201, USA
- Center for Neural Science, NYU College of Arts and Sciences, New York, NY 10003, USA
| | - Hiroshi Ishikawa
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY 10016, USA;
- Department of Biomedical Engineering, NYU Tandon School of Engineering, Brooklyn, New York 11201, USA
| | - Joel S Schuman
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY 10016, USA;
- Department of Biomedical Engineering, NYU Tandon School of Engineering, Brooklyn, New York 11201, USA
- Center for Neural Science, NYU College of Arts and Sciences, New York, NY 10003, USA
- Department of Physiology and Neuroscience, NYU Langone Health, NYU Grossman School of Medicine, New York, NY 10016, USA
| |
Collapse
|
14
|
P. S, J. R, R. P. An automatic recognition of glaucoma in fundus images using deep learning and random forest classifier. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107512] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
|
15
|
Duwairi RM, Al-Zboon SA, Al-Dwairi RA, Obaidi A. A Deep Learning Model and a Dataset for Diagnosing Ophthalmology Diseases. JOURNAL OF INFORMATION & KNOWLEDGE MANAGEMENT 2021. [DOI: 10.1142/s0219649221500362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The rapid development of artificial neural network techniques, especially convolutional neural networks, encouraged the researchers to adapt such techniques in the medical domain. Specifically, to provide assist tools to help the professionals in patients’ diagnosis. The main problem faced by the researchers in the medical domain is the lack of available annotated datasets which can be used to train and evaluate large and complex deep neural networks. In this paper, to assist researchers who are interested in applying deep learning techniques to aid the ophthalmologists in diagnosing eye-related diseases, we provide an optical coherence tomography dataset with collaboration with ophthalmologists from the King Abdullah University Hospital, Irbid, Jordan. This dataset consists of 21,991 OCT images distributed over seven eye diseases in addition to normal images (no disease), namely, Choroidal Neovascularisation, Full Macular Hole (Full Thickness), Partial Macular Hole, Central Serous Retinopathy, Geographic atrophy, Macular Retinal Oedema, and Vitreomacular Traction. To the best of our knowledge, this dataset is the largest of its kind, where images belong to actual patients from Jordan and the annotation was carried out by ophthalmologists. Two classification tasks were applied to this dataset; a binary classification to distinguish between images which belong to healthy eyes (normal) and images which belong to diseased eyes (abnormal). The second classification task is a multi-class classification, where the deep neural network is trained to distinguish between the seven diseases listed above in addition to the normal case. In both classification tasks, the U-Net neural network was modified and subsequently utilised. This modification adds an additional block of layers to the original U-Net model to become capable of handling classification as the original network is used for image segmentation. The results of the binary classification were equal to 84.90% and 69.50% as accuracy and quadratic weighted kappa, respectively. The results of the multi-class classification, by contrast, were equal to 63.68% and 66.06% as accuracy and quadratic weighted kappa, respectively.
Collapse
Affiliation(s)
- Rehab M. Duwairi
- Department of Computer Information Systems, Jordan University of Science and Technology, Irbid, Jordan
| | - Saad A. Al-Zboon
- Department of Computer Science, Jordan University of Science and Technology, Irbid, Jordan
| | - Rami A. Al-Dwairi
- Division of Ophthalmology, Department of Special Surgery, Faculty of Medicine, Jordan University of Science and Technology, Irbid, Jordan
| | - Ahmad Obaidi
- King Abdullah University Hospital, Irbid, Jordan
| |
Collapse
|
16
|
García G, Del Amor R, Colomer A, Verdú-Monedero R, Morales-Sánchez J, Naranjo V. Circumpapillary OCT-focused hybrid learning for glaucoma grading using tailored prototypical neural networks. Artif Intell Med 2021; 118:102132. [PMID: 34412848 DOI: 10.1016/j.artmed.2021.102132] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2021] [Revised: 06/21/2021] [Accepted: 06/23/2021] [Indexed: 12/22/2022]
Abstract
Glaucoma is one of the leading causes of blindness worldwide and Optical Coherence Tomography (OCT) is the quintessential imaging technique for its detection. Unlike most of the state-of-the-art studies focused on glaucoma detection, in this paper, we propose, for the first time, a novel framework for glaucoma grading using raw circumpapillary B-scans. In particular, we set out a new OCT-based hybrid network which combines hand-driven and deep learning algorithms. An OCT-specific descriptor is proposed to extract hand-crafted features related to the retinal nerve fibre layer (RNFL). In parallel, an innovative CNN is developed using skip-connections to include tailored residual and attention modules to refine the automatic features of the latent space. The proposed architecture is used as a backbone to conduct a novel few-shot learning based on static and dynamic prototypical networks. The k-shot paradigm is redefined giving rise to a supervised end-to-end system which provides substantial improvements discriminating between healthy, early and advanced glaucoma samples. The training and evaluation processes of the dynamic prototypical network are addressed from two fused databases acquired via Heidelberg Spectralis system. Validation and testing results reach a categorical accuracy of 0.9459 and 0.8788 for glaucoma grading, respectively. Besides, the high performance reported by the proposed model for glaucoma detection deserves a special mention. The findings from the class activation maps are directly in line with the clinicians' opinion since the heatmaps pointed out the RNFL as the most relevant structure for glaucoma diagnosis.
Collapse
Affiliation(s)
- Gabriel García
- Instituto de Investigación e Innovación en Bioingeniería, Universitat Politècnica de València, 46022 Valencia, Spain.
| | - Rocío Del Amor
- Instituto de Investigación e Innovación en Bioingeniería, Universitat Politècnica de València, 46022 Valencia, Spain
| | - Adrián Colomer
- Instituto de Investigación e Innovación en Bioingeniería, Universitat Politècnica de València, 46022 Valencia, Spain
| | - Rafael Verdú-Monedero
- Departamento de Tecnologías de la Información y las Comunicaciones, Universidad Politécnica de Cartagena, 30202 Cartagena, Spain
| | - Juan Morales-Sánchez
- Departamento de Tecnologías de la Información y las Comunicaciones, Universidad Politécnica de Cartagena, 30202 Cartagena, Spain
| | - Valery Naranjo
- Instituto de Investigación e Innovación en Bioingeniería, Universitat Politècnica de València, 46022 Valencia, Spain
| |
Collapse
|
17
|
Fernandez Escamez CS, Martin Giral E, Perucho Martinez S, Toledano Fernandez N. High interpretable machine learning classifier for early glaucoma diagnosis. Int J Ophthalmol 2021; 14:393-398. [PMID: 33747815 DOI: 10.18240/ijo.2021.03.10] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2020] [Accepted: 05/08/2020] [Indexed: 01/09/2023] Open
Abstract
AIM To develop a classifier for differentiating between healthy and early stage glaucoma eyes based on peripapillary retinal nerve fiber layer (RNFL) thicknesses measured with optical coherence tomography (OCT), using machine learning algorithms with a high interpretability. METHODS Ninety patients with early glaucoma and 85 healthy eyes were included. Early glaucoma eyes showed a visual field (VF) defect with mean deviation >-6.00 dB and characteristic glaucomatous morphology. RNFL thickness in every quadrant, clock-hour and average thickness were used to feed machine learning algorithms. Cluster analysis was conducted to detect and exclude outliers. Tree gradient boosting algorithms were used to calculate the importance of parameters on the classifier and to check the relation between their values and its impact on the classifier. Parameters with the lowest importance were excluded and a weighted decision tree analysis was applied to obtain an interpretable classifier. Area under the ROC curve (AUC), accuracy and generalization ability of the model were estimated using cross validation techniques. RESULTS Average and 7 clock-hour RNFL thicknesses were the parameters with the highest importance. Correlation between parameter values and impact on classification displayed a stepped pattern for average thickness. Decision tree model revealed that average thickness lower than 82 µm was a high predictor for early glaucoma. Model scores had AUC of 0.953 (95%CI: 0.903-0998), with an accuracy of 89%. CONCLUSION Gradient boosting methods provide accurate and highly interpretable classifiers to discriminate between early glaucoma and healthy eyes. Average and 7-hour RNFL thicknesses have the best discriminant power.
Collapse
Affiliation(s)
- Carlos Salvador Fernandez Escamez
- Ophthalmology Department, Hospital de Fuenlabrada, Madrid 28942, Spain.,Doctorate Program in Health Sciences, Universidad Rey Juan Carlos, Alcorcon 28922, Madrid, Spain
| | | | | | | |
Collapse
|
18
|
García G, Colomer A, Naranjo V. Glaucoma Detection from Raw SD-OCT Volumes: A Novel Approach Focused on Spatial Dependencies. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 200:105855. [PMID: 33303289 DOI: 10.1016/j.cmpb.2020.105855] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Accepted: 11/16/2020] [Indexed: 06/12/2023]
Abstract
BACKGROUND AND OBJECTIVE Glaucoma is the leading cause of blindness worldwide. Many studies based on fundus image and optical coherence tomography (OCT) imaging have been developed in the literature to help ophthalmologists through artificial-intelligence techniques. Currently, 3D spectral-domain optical coherence tomography (SD-OCT) samples have become more important since they could enclose promising information for glaucoma detection. To analyse the hidden knowledge of the 3D scans for glaucoma detection, we have proposed, for the first time, a deep-learning methodology based on leveraging the spatial dependencies of the features extracted from the B-scans. METHODS The experiments were performed on a database composed of 176 healthy and 144 glaucomatous SD-OCT volumes centred on the optic nerve head (ONH). The proposed methodology consists of two well-differentiated training stages: a slide-level feature extractor and a volume-based predictive model. The slide-level discriminator is characterised by two new, residual and attention, convolutional modules which are combined via skip-connections with other fine-tuned architectures. Regarding the second stage, we first carried out a data-volume conditioning before extracting the features from the slides of the SD-OCT volumes. Then, Long Short-Term Memory (LSTM) networks were used to combine the recurrent dependencies embedded in the latent space to provide a holistic feature vector, which was generated by the proposed sequential-weighting module (SWM). RESULTS The feature extractor reports AUC values higher than 0.93 both in the primary and external test sets. Otherwise, the proposed end-to-end system based on a combination of CNN and LSTM networks achieves an AUC of 0.8847 in the prediction stage, which outperforms other state-of-the-art approaches intended for glaucoma detection. Additionally, Class Activation Maps (CAMs) were computed to highlight the most interesting regions per B-scan when discerning between healthy and glaucomatous eyes from raw SD-OCT volumes. CONCLUSIONS The proposed model is able to extract the features from the B-scans of the volumes and combine the information of the latent space to perform a volume-level glaucoma prediction. Our model, which combines residual and attention blocks with a sequential weighting module to refine the LSTM outputs, surpass the results achieved from current state-of-the-art methods focused on 3D deep-learning architectures.
Collapse
Affiliation(s)
- Gabriel García
- Instituto de Investigación e Innovación en Bioingeniería (I3B), Universitat Politécnica de Valéncia (UPV), Valencia 46022, Spain.
| | - Adrián Colomer
- Instituto de Investigación e Innovación en Bioingeniería (I3B), Universitat Politécnica de Valéncia (UPV), Valencia 46022, Spain
| | - Valery Naranjo
- Instituto de Investigación e Innovación en Bioingeniería (I3B), Universitat Politécnica de Valéncia (UPV), Valencia 46022, Spain
| |
Collapse
|
19
|
Panda BB, Thakur S, Mohapatra S, Parida S. Artificial intelligence in ophthalmology: A new era is beginning. Artif Intell Med Imaging 2021; 2:5-12. [DOI: 10.35711/aimi.v2.i1.5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/28/2020] [Revised: 12/31/2020] [Accepted: 02/12/2021] [Indexed: 02/06/2023] Open
Abstract
The use of artificial intelligence (AI) in ophthalmology is not very new and its use is expanding into various subspecialties of the eye like retina and glaucoma, thereby helping ophthalmologists to diagnose and treat diseases better than before. Incorporating “deep learning” (a subfield of AI) into image-based systems such as optical coherence tomography has dramatically improved the machine's ability to screen and identify stages of diabetic retinopathy accurately. Similar applications have been tried in the field of retinopathy of prematurity and age-related macular degeneration, a silent retinal condition that needs to be diagnosed early to prevent progression. The advent of AI into glaucoma diagnostics in analyzing visual fields and assessing disease progression also holds a promising role. The ability of the software to detect even a subtle defect that the human eye can miss has led to a revolution in the management of certain ocular conditions. However, there are few significant challenges in the AI systems, such as the incorporation of quality images, training sets and the black box dilemma. Nevertheless, despite the existing differences, there is always a chance of improving the machines/software to potentiate their efficacy and standards. This review article shall discuss the current applications of AI in ophthalmology, significant challenges and the prospects as to how both science and medicine can work together.
Collapse
Affiliation(s)
- Bijnya Birajita Panda
- Department ofOphthalmology, S.C.B Medical College and Hospital, Cuttack 753007, Odisha, India
| | - Subhodeep Thakur
- Department ofOphthalmology, S.C.B Medical College and Hospital, Cuttack 753007, Odisha, India
| | - Sumita Mohapatra
- Department ofOphthalmology, S.C.B Medical College and Hospital, Cuttack 753007, Odisha, India
| | - Subhabrata Parida
- Department ofOphthalmology, S.C.B Medical College and Hospital, Cuttack 753007, Odisha, India
| |
Collapse
|
20
|
Mursch-Edlmayr AS, Ng WS, Diniz-Filho A, Sousa DC, Arnold L, Schlenker MB, Duenas-Angeles K, Keane PA, Crowston JG, Jayaram H. Artificial Intelligence Algorithms to Diagnose Glaucoma and Detect Glaucoma Progression: Translation to Clinical Practice. Transl Vis Sci Technol 2020; 9:55. [PMID: 33117612 PMCID: PMC7571273 DOI: 10.1167/tvst.9.2.55] [Citation(s) in RCA: 47] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2019] [Accepted: 09/18/2020] [Indexed: 12/11/2022] Open
Abstract
Purpose This concise review aims to explore the potential for the clinical implementation of artificial intelligence (AI) strategies for detecting glaucoma and monitoring glaucoma progression. Methods Nonsystematic literature review using the search combinations “Artificial Intelligence,” “Deep Learning,” “Machine Learning,” “Neural Networks,” “Bayesian Networks,” “Glaucoma Diagnosis,” and “Glaucoma Progression.” Information on sensitivity and specificity regarding glaucoma diagnosis and progression analysis as well as methodological details were extracted. Results Numerous AI strategies provide promising levels of specificity and sensitivity for structural (e.g. optical coherence tomography [OCT] imaging, fundus photography) and functional (visual field [VF] testing) test modalities used for the detection of glaucoma. Area under receiver operating curve (AROC) values of > 0.90 were achieved with every modality. Combining structural and functional inputs has been shown to even more improve the diagnostic ability. Regarding glaucoma progression, AI strategies can detect progression earlier than conventional methods or potentially from one single VF test. Conclusions AI algorithms applied to fundus photographs for screening purposes may provide good results using a simple and widely accessible test. However, for patients who are likely to have glaucoma more sophisticated methods should be used including data from OCT and perimetry. Outputs may serve as an adjunct to assist clinical decision making, whereas also enhancing the efficiency, productivity, and quality of the delivery of glaucoma care. Patients with diagnosed glaucoma may benefit from future algorithms to evaluate their risk of progression. Challenges are yet to be overcome, including the external validity of AI strategies, a move from a “black box” toward “explainable AI,” and likely regulatory hurdles. However, it is clear that AI can enhance the role of specialist clinicians and will inevitably shape the future of the delivery of glaucoma care to the next generation. Translational Relevance The promising levels of diagnostic accuracy reported by AI strategies across the modalities used in clinical practice for glaucoma detection can pave the way for the development of reliable models appropriate for their translation into clinical practice. Future incorporation of AI into healthcare models may help address the current limitations of access and timely management of patients with glaucoma across the world.
Collapse
Affiliation(s)
| | - Wai Siene Ng
- Cardiff Eye Unit, University Hospital of Wales, Cardiff, UK
| | - Alberto Diniz-Filho
- Department of Ophthalmology and Otorhinolaryngology, Federal University of Minas Gerais, Belo Horizonte, Brazil
| | - David C Sousa
- Department of Ophthalmology, Hospital de Santa Maria, Lisbon, Portugal
| | - Louis Arnold
- Department of Ophthalmology, University Hospital, Dijon, France
| | - Matthew B Schlenker
- Department of Ophthalmology and Vision Sciences, University of Toronto, Toronto, Canada
| | - Karla Duenas-Angeles
- Department of Ophthalmology, Universidad Nacional Autónoma de Mexico, Mexico City, Mexico
| | - Pearse A Keane
- NIHR Biomedical Research Centre for Ophthalmology, UCL Institute of Ophthalmology & Moorfields Eye Hospital, London, UK
| | - Jonathan G Crowston
- Centre for Vision Research, Duke-NUS Medical School, Singapore.,Singapore Eye Research Institute, Singapore National Eye Centre, Singapore
| | - Hari Jayaram
- NIHR Biomedical Research Centre for Ophthalmology, UCL Institute of Ophthalmology & Moorfields Eye Hospital, London, UK
| |
Collapse
|
21
|
Sun S, Ha A, Kim YK, Yoo BW, Kim HC, Park KH. Dual-input convolutional neural network for glaucoma diagnosis using spectral-domain optical coherence tomography. Br J Ophthalmol 2020; 105:1555-1560. [PMID: 32920530 DOI: 10.1136/bjophthalmol-2020-316274] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2020] [Revised: 07/15/2020] [Accepted: 08/25/2020] [Indexed: 12/24/2022]
Abstract
BACKGROUND/AIMS To evaluate, with spectral-domain optical coherence tomography (SD-OCT), the glaucoma-diagnostic ability of a deep-learning classifier. METHODS A total of 777 Cirrus high-definition SD-OCT image sets of the retinal nerve fibre layer (RNFL) and ganglion cell-inner plexiform layer (GCIPL) of 315 normal subjects, 219 patients with early-stage primary open-angle glaucoma (POAG) and 243 patients with moderate-to-severe-stage POAG were aggregated. The image sets were divided into a training data set (252 normal, 174 early POAG and 195 moderate-to-severe POAG) and a test data set (63 normal, 45 early POAG and 48 moderate-to-severe POAG). The visual geometry group (VGG16)-based dual-input convolutional neural network (DICNN) was adopted for the glaucoma diagnoses. Unlike other networks, the DICNN structure takes two images (both RNFL and GCIPL) as inputs. The glaucoma-diagnostic ability was computed according to both accuracy and area under the receiver operating characteristic curve (AUC). RESULTS For the test data set, DICNN could distinguish between patients with glaucoma and normal subjects accurately (accuracy=92.793%, AUC=0.957 (95% CI 0.943 to 0.966), sensitivity=0.896 (95% CI 0.896 to 0.917), specificity=0.952 (95% CI 0.921 to 0.952)). For distinguishing between patients with early-stage glaucoma and normal subjects, DICNN's diagnostic ability (accuracy=85.185%, AUC=0.869 (95% CI 0.825 to 0.879), sensitivity=0.921 (95% CI 0.813 to 0.905), specificity=0.756 (95% CI 0.610 to 0.790)]) was higher than convolutional neural network algorithms that trained with RNFL or GCIPL separately. CONCLUSION The deep-learning algorithm using SD-OCT can distinguish normal subjects not only from established patients with glaucoma but also from patients with early-stage glaucoma. The deep-learning model with DICNN, as trained by both RNFL and GCIPL thickness map data, showed a high diagnostic ability for discriminatingpatients with early-stage glaucoma from normal subjects.
Collapse
Affiliation(s)
- Sukkyu Sun
- Interdisciplinary Program in Bioengineering, Graduate school, Seoul National University, Seoul, South Korea
| | - Ahnul Ha
- Department of Ophthalmology, Seoul National University College of Medicine, Seoul, South Korea.,Department of Ophthalmology, Jeju National University Hospital, Jeju-si, South Korea
| | - Young Kook Kim
- Department of Ophthalmology, Seoul National University College of Medicine, Seoul, South Korea.,Department of Ophthalmology, Seoul National University Hospital, Seoul, South Korea
| | | | - Hee Chan Kim
- Interdisciplinary Program in Bioengineering, Graduate school, Seoul National University, Seoul, South Korea .,Institute of Medical and Biological Engineering, Medical Research Center, Seoul National University, Seoul, South Korea.,Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, South Korea
| | - Ki Ho Park
- Department of Ophthalmology, Seoul National University College of Medicine, Seoul, South Korea.,Department of Ophthalmology, Seoul National University Hospital, Seoul, South Korea
| |
Collapse
|
22
|
Anterior Segment Optical Coherence Tomography: Is There a Clinical Role in the Management of Primary Angle Closure Disease? J Glaucoma 2020; 29:60-66. [PMID: 31490798 DOI: 10.1097/ijg.0000000000001355] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Primary angle closure disease (PACD) covers a spectrum that includes primary angle closure suspect, primary angle closure, primary angle closure glaucoma, and acute primary angle closure. Accumulating evidence suggests that the pathogenesis of PACD is complex, with multiple contributory factors including variations in the anatomic or biometric characteristics of the angle segment structures. Advances in anterior segment optical coherence tomography technology have further enhanced our understanding of the risk factors and mechanisms involved in the disease process. This review discusses the potential clinical role of the anterior segment optical coherence tomography in the diagnosis, mechanistic evaluation, and as a predictor for future clinical outcomes of patients with PACD.
Collapse
|
23
|
Girard MJA, Schmetterer L. Artificial intelligence and deep learning in glaucoma: Current state and future prospects. PROGRESS IN BRAIN RESEARCH 2020; 257:37-64. [PMID: 32988472 DOI: 10.1016/bs.pbr.2020.07.002] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Over the past few years, there has been an unprecedented and tremendous excitement for artificial intelligence (AI) research in the field of Ophthalmology; this has naturally been translated to glaucoma-a progressive optic neuropathy characterized by retinal ganglion cell axon loss and associated visual field defects. In this review, we aim to discuss how AI may have a unique opportunity to tackle the many challenges faced in the glaucoma clinic. This is because glaucoma remains poorly understood with difficulties in providing early diagnosis and prognosis accurately and in a timely fashion. In the short term, AI could also become a game changer by paving the way for the first cost-effective glaucoma screening campaigns. While there are undeniable technical and clinical challenges ahead, and more so than for other ophthalmic disorders whereby AI is already booming, we strongly believe that glaucoma specialists should embrace AI as a companion to their practice. Finally, this review will also remind ourselves that glaucoma is a complex group of disorders with a multitude of physiological manifestations that cannot yet be observed clinically. AI in glaucoma is here to stay, but it will not be the only tool to solve glaucoma.
Collapse
Affiliation(s)
- Michaël J A Girard
- Ophthalmic Engineering & Innovation Laboratory (OEIL), Singapore Eye Research Institute, Singapore National Eye Centre, Singapore, Singapore.
| | - Leopold Schmetterer
- Ocular Imaging, Singapore Eye Research Institute, Singapore National Eye Centre, Singapore, Singapore; School of Chemical and Biomedical Engineering, Nanyang Technological University, Singapore, Singapore; SERI-NTU Advanced Ocular Engineering (STANCE), Singapore, Singapore; Ophthalmology and Visual Sciences Academic Clinical Program, Duke-NUS Medical School, Singapore, Singapore; Department of Clinical Pharmacology, Medical University of Vienna, Vienna, Austria; Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria; Institute of Clinical and Experimental Ophthalmology, Basel, Switzerland.
| |
Collapse
|
24
|
Tong Y, Lu W, Yu Y, Shen Y. Application of machine learning in ophthalmic imaging modalities. EYE AND VISION 2020; 7:22. [PMID: 32322599 PMCID: PMC7160952 DOI: 10.1186/s40662-020-00183-6] [Citation(s) in RCA: 40] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/16/2019] [Accepted: 03/10/2020] [Indexed: 12/27/2022]
Abstract
In clinical ophthalmology, a variety of image-related diagnostic techniques have begun to offer unprecedented insights into eye diseases based on morphological datasets with millions of data points. Artificial intelligence (AI), inspired by the human multilayered neuronal system, has shown astonishing success within some visual and auditory recognition tasks. In these tasks, AI can analyze digital data in a comprehensive, rapid and non-invasive manner. Bioinformatics has become a focus particularly in the field of medical imaging, where it is driven by enhanced computing power and cloud storage, as well as utilization of novel algorithms and generation of data in massive quantities. Machine learning (ML) is an important branch in the field of AI. The overall potential of ML to automatically pinpoint, identify and grade pathological features in ocular diseases will empower ophthalmologists to provide high-quality diagnosis and facilitate personalized health care in the near future. This review offers perspectives on the origin, development, and applications of ML technology, particularly regarding its applications in ophthalmic imaging modalities.
Collapse
Affiliation(s)
- Yan Tong
- 1Eye Center, Renmin Hospital of Wuhan University, Wuhan, 430060 Hubei China
| | - Wei Lu
- 1Eye Center, Renmin Hospital of Wuhan University, Wuhan, 430060 Hubei China
| | - Yue Yu
- 1Eye Center, Renmin Hospital of Wuhan University, Wuhan, 430060 Hubei China
| | - Yin Shen
- 1Eye Center, Renmin Hospital of Wuhan University, Wuhan, 430060 Hubei China.,2Medical Research Institute, Wuhan University, Wuhan, Hubei China
| |
Collapse
|
25
|
Murtagh P, Greene G, O'Brien C. Current applications of machine learning in the screening and diagnosis of glaucoma: a systematic review and Meta-analysis. Int J Ophthalmol 2020; 13:149-162. [PMID: 31956584 DOI: 10.18240/ijo.2020.01.22] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2019] [Accepted: 09/23/2019] [Indexed: 12/22/2022] Open
Abstract
AIM To compare the effectiveness of two well described machine learning modalities, ocular coherence tomography (OCT) and fundal photography, in terms of diagnostic accuracy in the screening and diagnosis of glaucoma. METHODS A systematic search of Embase and PubMed databases was undertaken up to 1st of February 2019. Articles were identified alongside their reference lists and relevant studies were aggregated. A Meta-analysis of diagnostic accuracy in terms of area under the receiver operating curve (AUROC) was performed. For the studies which did not report an AUROC, reported sensitivity and specificity values were combined to create a summary ROC curve which was included in the Meta-analysis. RESULTS A total of 23 studies were deemed suitable for inclusion in the Meta-analysis. This included 10 papers from the OCT cohort and 13 from the fundal photos cohort. Random effects Meta-analysis gave a pooled AUROC of 0.957 (95%CI=0.917 to 0.997) for fundal photos and 0.923 (95%CI=0.889 to 0.957) for the OCT cohort. The slightly higher accuracy of fundal photos methods is likely attributable to the much larger database of images used to train the models (59 788 vs 1743). CONCLUSION No demonstrable difference is shown between the diagnostic accuracy of the two modalities. The ease of access and lower cost associated with fundal photo acquisition make that the more appealing option in terms of screening on a global scale, however further studies need to be undertaken, owing largely to the poor study quality associated with the fundal photography cohort.
Collapse
Affiliation(s)
- Patrick Murtagh
- Department of Ophthalmology, Mater Misericordiae University Hospital, Eccles Street, Dublin D07 R2WY, Ireland
| | - Garrett Greene
- RCSI Education and Research Centre, Beaumont Hospital, Dublin D05 AT88, Ireland
| | - Colm O'Brien
- Department of Ophthalmology, Mater Misericordiae University Hospital, Eccles Street, Dublin D07 R2WY, Ireland
| |
Collapse
|
26
|
Wang P, Shen J, Chang R, Moloney M, Torres M, Burkemper B, Jiang X, Rodger D, Varma R, Richter GM. Machine Learning Models for Diagnosing Glaucoma from Retinal Nerve Fiber Layer Thickness Maps. Ophthalmol Glaucoma 2019; 2:422-428. [PMID: 32672575 PMCID: PMC7368087 DOI: 10.1016/j.ogla.2019.08.004] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2019] [Revised: 07/16/2019] [Accepted: 08/14/2019] [Indexed: 01/30/2023]
Abstract
PURPOSE To assess the diagnostic accuracy of multiple machine learning models using full retinal nerve fiber layer (RNFL) thickness maps in detecting glaucoma. DESIGN Case-control study. PARTICIPANTS A total of 93 eyes from 69 patients with glaucoma and 128 eyes from 128 age- and sex-matched healthy controls from the Los Angeles Latino Eye Study (LALES), a large population-based, longitudinal cohort study consisting of Latino participants aged ≥40 years residing in El Puente, California. METHODS The 6×6-mm RNFL thickness maps centered on the optic nerve head (Cirrus 4000; Zeiss, Dublin, CA) were supplied to 4 different machine learning algorithms. These models included 2 conventional machine learning algorithms, Support Vector Machine (SVM) and K-Nearest Neighbor (KNN), and 2 convolutional neural nets, ResNet-18 and GlaucomaNet, which was a custom-made deep learning network. All models were tested with 5-fold cross validation. MAIN OUTCOME MEASURES Area under the curve (AUC) statistics to assess diagnostic accuracy of each model compared with conventional average circumpapillary RNFL thickness. RESULTS All 4 models achieved similarly high diagnostic accuracies, with AUC values ranging from 0.91 to 0.92. These values were significantly higher than those for average circumpapillary RNFL thickness, which had an AUC of 0.76 in the same patient population. CONCLUSIONS Superior diagnostic performance was achieved with both conventional machine learning and convolutional neural net models compared with circumpapillary RNFL thickness. This supports the importance of the spatial structure of RNFL thickness map data in diagnosing glaucoma and further efforts to optimize our use of this data.
Collapse
Affiliation(s)
- Peiyu Wang
- Department of Biomedical Engineering, University of Southern California, Los Angeles, California
| | - Jian Shen
- Department of Biomedical Engineering, University of Southern California, Los Angeles, California
| | - Ryuna Chang
- USC Roski Eye Institute, Keck School of Medicine, University of Southern California, Los Angeles, California
| | - Maemae Moloney
- Department of Neuroscience, University of Southern California, Los Angeles, California
| | - Mina Torres
- Southern California Eyecare and Vision Research Institute, CHA Hollywood Presbyterian Medical Center, Los Angeles, California
| | - Bruce Burkemper
- USC Roski Eye Institute, Keck School of Medicine, University of Southern California, Los Angeles, California
| | - Xuejuan Jiang
- USC Roski Eye Institute, Keck School of Medicine, University of Southern California, Los Angeles, California
| | - Damien Rodger
- USC Roski Eye Institute, Keck School of Medicine, University of Southern California, Los Angeles, California
| | - Rohit Varma
- Southern California Eyecare and Vision Research Institute, CHA Hollywood Presbyterian Medical Center, Los Angeles, California
| | - Grace M Richter
- USC Roski Eye Institute, Keck School of Medicine, University of Southern California, Los Angeles, California.
| |
Collapse
|
27
|
The Role of Artificial Intelligence in the Diagnosis and Management of Glaucoma. CURRENT OPHTHALMOLOGY REPORTS 2019. [DOI: 10.1007/s40135-019-00209-w] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
28
|
Wang J, Wang Z, Li F, Qu G, Qiao Y, Lv H, Zhang X. Joint retina segmentation and classification for early glaucoma diagnosis. BIOMEDICAL OPTICS EXPRESS 2019; 10:2639-2656. [PMID: 31149385 PMCID: PMC6524599 DOI: 10.1364/boe.10.002639] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/29/2018] [Revised: 02/22/2019] [Accepted: 02/23/2019] [Indexed: 05/17/2023]
Abstract
We propose a joint segmentation and classification deep model for early glaucoma diagnosis using retina imaging with optical coherence tomography (OCT). Our motivation roots in the observation that ophthalmologists make the clinical decision by analyzing the retinal nerve fiber layer (RNFL) from OCT images. To simulate this process, we propose a novel deep model that joins the retinal layer segmentation and glaucoma classification. Our model consists of three parts. First, the segmentation network simultaneously predicts both six retinal layers and five boundaries between them. Then, we introduce a post processing algorithm to fuse the two results while enforcing the topology correctness. Finally, the classification network takes the RNFL thickness vector as input and outputs the probability of being glaucoma. In the classification network, we propose a carefully designed module to implement the clinical strategy to diagnose glaucoma. We validate our method both in a collected dataset of 1004 circular OCT B-Scans from 234 subjects and in a public dataset of 110 B-Scans from 10 patients with diabetic macular edema. Experimental results demonstrate that our method achieves superior segmentation performance than other state-of-the-art methods both in our collected dataset and in public dataset with severe retina pathology. For glaucoma classification, our model achieves diagnostic accuracy of 81.4% with AUC of 0.864, which clearly outperforms baseline methods.
Collapse
Affiliation(s)
- Jie Wang
- Department of Automation, Tsinghua University, Beijing,
China
| | - Zhe Wang
- SenseTime Group Limited, Beijing,
China
| | - Fei Li
- Zhongshan Ophthalmic Center, State Key Laboratory of Ophthalmology, Sun Yat-Sen University, Guangzhou,
China
| | - Guoxiang Qu
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen,
China
| | - Yu Qiao
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen,
China
| | - Hairong Lv
- Department of Automation, Tsinghua University, Beijing,
China
| | - Xiulan Zhang
- Zhongshan Ophthalmic Center, State Key Laboratory of Ophthalmology, Sun Yat-Sen University, Guangzhou,
China
| |
Collapse
|
29
|
Unsupervised feature extraction of anterior chamber OCT images for ordering and classification. Sci Rep 2019; 9:1157. [PMID: 30718688 PMCID: PMC6362085 DOI: 10.1038/s41598-018-38136-8] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2018] [Accepted: 12/19/2018] [Indexed: 11/24/2022] Open
Abstract
We propose an image processing method for ordering anterior chamber optical coherence tomography (OCT) images in a fully unsupervised manner. The method consists of three steps: Firstly we preprocess the images (filtering the noise, aligning and normalizing the resolution); secondly, a distance measure between images is computed for every pair of images; thirdly we apply a machine learning algorithm that exploits the distance measure to order the images in a two-dimensional plane. The method is applied to a large (~1000) database of anterior chamber OCT images of healthy subjects and patients with angle-closure and the resulting unsupervised ordering and classification is validated by two ophthalmologists.
Collapse
|
30
|
Abstract
PURPOSE OF REVIEW The use of computers has become increasingly relevant to medical decision-making, and artificial intelligence methods have recently demonstrated significant advances in medicine. We therefore provide an overview of current artificial intelligence methods and their applications, to help the practicing ophthalmologist understand their potential impact on glaucoma care. RECENT FINDINGS Techniques used in artificial intelligence can successfully analyze and categorize data from visual fields, optic nerve structure [e.g., optical coherence tomography (OCT) and fundus photography], ocular biomechanical properties, and a combination thereof to identify disease severity, determine disease progression, and/or recommend referral for specialized care. Algorithms have become increasingly complex in recent years, utilizing both supervised and unsupervised methods of artificial intelligence. Impressive performance of these algorithms on previously unseen data has been reported, often outperforming standard global indices and expert observers. However, there remains no clearly defined gold standard for determining the presence and severity of glaucoma, which undermines the training of these algorithms. To improve upon existing methodologies, future work must employ more robust definitions of disease, optimize data inputs for artificial intelligence analysis, and improve methods of extracting knowledge from learned results. SUMMARY Artificial intelligence has the potential to revolutionize the screening, diagnosis, and classification of glaucoma, both through the automated processing of large data sets, and by earlier detection of new disease patterns. In addition, artificial intelligence holds promise for fundamentally changing research aimed at understanding the development, progression, and treatment of glaucoma, by identifying novel risk factors and by evaluating the importance of existing ones.
Collapse
|
31
|
Akkara J, Kuriakose A. Role of artificial intelligence and machine learning in ophthalmology. KERALA JOURNAL OF OPHTHALMOLOGY 2019. [DOI: 10.4103/kjo.kjo_54_19] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
|
32
|
Ly A, Phu J, Katalinic P, Kalloniatis M. An evidence-based approach to the routine use of optical coherence tomography. Clin Exp Optom 2018; 102:242-259. [PMID: 30560558 PMCID: PMC6590481 DOI: 10.1111/cxo.12847] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2018] [Revised: 09/13/2018] [Accepted: 10/05/2018] [Indexed: 02/06/2023] Open
Abstract
Optical coherence tomography is an imaging technology that has revolutionised the detection, assessment and management of ocular disease. It is now a mainstream technology in clinical practice and is performed by non-specialised personnel in some settings. This article provides a clinical perspective on the implications of that movement and describes best practice using multimodal imaging and an evidence-based approach. Practical, illustrative guides on the interpretation of optical coherence tomography are provided for three major diseases of the ocular fundus, in which optical coherence tomography is often crucial to management: age-related macular degeneration, diabetic retinopathy and glaucoma. Topics discussed include: cross-sectional and longitudinal signs in ocular disease, so-called 'red-green' disease whereby clinicians rely on machine/statistical comparisons for diagnosis in managing treatment-naïve patients, and the utility of optical coherence tomography angiography and machine learning.
Collapse
Affiliation(s)
- Angelica Ly
- Centre for Eye Health, The University of New South Wales, Sydney, New South Wales, Australia.,Faculty of Science, School of Optometry and Vision Science, The University of New South Wales, Sydney, New South Wales, Australia
| | - Jack Phu
- Centre for Eye Health, The University of New South Wales, Sydney, New South Wales, Australia.,Faculty of Science, School of Optometry and Vision Science, The University of New South Wales, Sydney, New South Wales, Australia
| | - Paula Katalinic
- Centre for Eye Health, The University of New South Wales, Sydney, New South Wales, Australia.,Faculty of Science, School of Optometry and Vision Science, The University of New South Wales, Sydney, New South Wales, Australia
| | - Michael Kalloniatis
- Centre for Eye Health, The University of New South Wales, Sydney, New South Wales, Australia.,Faculty of Science, School of Optometry and Vision Science, The University of New South Wales, Sydney, New South Wales, Australia
| |
Collapse
|
33
|
Ahn JM, Kim S, Ahn KS, Cho SH, Lee KB, Kim US. A deep learning model for the detection of both advanced and early glaucoma using fundus photography. PLoS One 2018; 13:e0207982. [PMID: 30481205 PMCID: PMC6258525 DOI: 10.1371/journal.pone.0207982] [Citation(s) in RCA: 76] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2018] [Accepted: 11/11/2018] [Indexed: 01/30/2023] Open
Abstract
Purpose To build a deep learning model to diagnose glaucoma using fundus photography. Design Cross sectional case study Subjects, Participants and Controls: A total of 1,542 photos (786 normal controls, 467 advanced glaucoma and 289 early glaucoma patients) were obtained by fundus photography. Method The whole dataset of 1,542 images were split into 754 training, 324 validation and 464 test datasets. These datasets were used to construct simple logistic classification and convolutional neural network using Tensorflow. The same datasets were used to fine tune pre-trained GoogleNet Inception v3 model. Results The simple logistic classification model showed a training accuracy of 82.9%, validation accuracy of 79.9% and test accuracy of 77.2%. Convolutional neural network achieved accuracy and area under the receiver operating characteristic curve (AUROC) of 92.2% and 0.98 on the training data, 88.6% and 0.95 on the validation data, and 87.9% and 0.94 on the test data. Transfer-learned GoogleNet Inception v3 model achieved accuracy and AUROC of 99.7% and 0.99 on training data, 87.7% and 0.95 on validation data, and 84.5% and 0.93 on test data. Conclusion Both advanced and early glaucoma could be correctly detected via machine learning, using only fundus photographs. Our new model that is trained using convolutional neural network is more efficient for the diagnosis of early glaucoma than previously published models.
Collapse
Affiliation(s)
- Jin Mo Ahn
- Department of Bioinformatics and Life Science, Soongsil University, Seoul, Korea
| | - Sangsoo Kim
- Department of Bioinformatics and Life Science, Soongsil University, Seoul, Korea
| | - Kwang-Sung Ahn
- Functional Genome Institute, PDXen Biosystems Inc., Seoul, Korea
| | - Sung-Hoon Cho
- Functional Genome Institute, PDXen Biosystems Inc., Seoul, Korea
| | | | - Ungsoo Samuel Kim
- Kim’s Eye Hospital, Seoul, Korea
- Department of Ophthalmology, Konyang University College of Medicine, Daejeon, Korea
- * E-mail:
| |
Collapse
|
34
|
Applications of Artificial Intelligence in Ophthalmology: General Overview. J Ophthalmol 2018; 2018:5278196. [PMID: 30581604 PMCID: PMC6276430 DOI: 10.1155/2018/5278196] [Citation(s) in RCA: 50] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2018] [Revised: 10/06/2018] [Accepted: 10/17/2018] [Indexed: 12/26/2022] Open
Abstract
With the emergence of unmanned plane, autonomous vehicles, face recognition, and language processing, the artificial intelligence (AI) has remarkably revolutionized our lifestyle. Recent studies indicate that AI has astounding potential to perform much better than human beings in some tasks, especially in the image recognition field. As the amount of image data in imaging center of ophthalmology is increasing dramatically, analyzing and processing these data is in urgent need. AI has been tried to apply to decipher medical data and has made extraordinary progress in intelligent diagnosis. In this paper, we presented the basic workflow for building an AI model and systematically reviewed applications of AI in the diagnosis of eye diseases. Future work should focus on setting up systematic AI platforms to diagnose general eye diseases based on multimodal data in the real world.
Collapse
|
35
|
Saba T, Bokhari STF, Sharif M, Yasmin M, Raza M. Fundus image classification methods for the detection of glaucoma: A review. Microsc Res Tech 2018; 81:1105-1121. [DOI: 10.1002/jemt.23094] [Citation(s) in RCA: 42] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2018] [Revised: 06/07/2018] [Accepted: 06/19/2018] [Indexed: 01/31/2023]
Affiliation(s)
- Tanzila Saba
- College of Computer and Information SciencesPrince Sultan University Riyadh Saudi Arabia
| | | | - Muhammad Sharif
- Department of Computer ScienceCOMSATS University Islamabad Wah Campus Pakistan
| | - Mussarat Yasmin
- Department of Computer ScienceCOMSATS University Islamabad Wah Campus Pakistan
| | - Mudassar Raza
- Department of Computer ScienceCOMSATS University Islamabad Wah Campus Pakistan
| |
Collapse
|
36
|
Comparison of Machine-Learning Classification Models for Glaucoma Management. JOURNAL OF HEALTHCARE ENGINEERING 2018; 2018:6874765. [PMID: 30018755 PMCID: PMC6029465 DOI: 10.1155/2018/6874765] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/27/2017] [Revised: 04/06/2018] [Accepted: 04/18/2018] [Indexed: 11/17/2022]
Abstract
This study develops an objective machine-learning classification model for classifying glaucomatous optic discs and reveals the classificatory criteria to assist in clinical glaucoma management. In this study, 163 glaucoma eyes were labelled with four optic disc types by three glaucoma specialists and then randomly separated into training and test data. All the images of these eyes were captured using optical coherence tomography and laser speckle flowgraphy to quantify the ocular structure and blood-flow-related parameters. A total of 91 parameters were extracted from each eye along with the patients' background information. Machine-learning classifiers, including the neural network (NN), naïve Bayes (NB), support vector machine (SVM), and gradient boosted decision trees (GBDT), were trained to build the classification models, and a hybrid feature selection method that combines minimum redundancy maximum relevance and genetic-algorithm-based feature selection was applied to find the most valid and relevant features for NN, NB, and SVM. A comparison of the performance of the three machine-learning classification models showed that the NN had the best classification performance with a validated accuracy of 87.8% using only nine ocular parameters. These selected quantified parameters enabled the trained NN to classify glaucomatous optic discs with relatively high performance without requiring color fundus images.
Collapse
|
37
|
Hybrid Deep Learning on Single Wide-field Optical Coherence tomography Scans Accurately Classifies Glaucoma Suspects. J Glaucoma 2017; 26:1086-1094. [PMID: 29045329 DOI: 10.1097/ijg.0000000000000765] [Citation(s) in RCA: 127] [Impact Index Per Article: 18.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
PURPOSE Existing summary statistics based upon optical coherence tomographic (OCT) scans and/or visual fields (VFs) are suboptimal for distinguishing between healthy and glaucomatous eyes in the clinic. This study evaluates the extent to which a hybrid deep learning method (HDLM), combined with a single wide-field OCT protocol, can distinguish eyes previously classified as either healthy suspects or mild glaucoma. METHODS In total, 102 eyes from 102 patients, with or suspected open-angle glaucoma, had previously been classified by 2 glaucoma experts as either glaucomatous (57 eyes) or healthy/suspects (45 eyes). The HDLM had access only to information from a single, wide-field (9×12 mm) swept-source OCT scan per patient. Convolutional neural networks were used to extract rich features from maps derived from these scans. Random forest classifier was used to train a model based on these features to predict the existence of glaucomatous damage. The algorithm was compared against traditional OCT and VF metrics. RESULTS The accuracy of the HDLM ranged from 63.7% to 93.1% depending upon the input map. The retinal nerve fiber layer probability map had the best accuracy (93.1%), with 4 false positives, and 3 false negatives. In comparison, the accuracy of the OCT and 24-2 and 10-2 VF metrics ranged from 66.7% to 87.3%. The OCT quadrants analysis had the best accuracy (87.3%) of the metrics, with 4 false positives and 9 false negatives. CONCLUSIONS The HDLM protocol outperforms standard OCT and VF clinical metrics in distinguishing healthy suspect eyes from eyes with early glaucoma. It should be possible to further improve this algorithm and with improvement it might be useful for screening.
Collapse
|
38
|
Urbizu A, Martin BA, Moncho D, Rovira A, Poca MA, Sahuquillo J, Macaya A, Español MI. Machine learning applied to neuroimaging for diagnosis of adult classic Chiari malformation: role of the basion as a key morphometric indicator. J Neurosurg 2017; 129:779-791. [PMID: 29053075 DOI: 10.3171/2017.3.jns162479] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVE The current diagnostic criterion for Chiari malformation Type I (CM-I), based on tonsillar herniation (TH), includes a diversity of patients with amygdalar descent that may be caused by a variety of factors. In contrast, patients presenting with an overcrowded posterior cranial fossa, a key characteristic of the disease, may remain misdiagnosed if they have little or no TH. The objective of the present study was to use machine-learning classification methods to identify morphometric measures that help discern patients with classic CM-I to improve diagnosis and treatment and provide insight into the etiology of the disease. METHODS Fifteen morphometric measurements of the posterior cranial fossa were performed on midsagittal T1-weighted MR images obtained in 195 adult patients diagnosed with CM. Seven different machine-learning classification methods were applied to images from 117 patients with classic CM-I and 50 controls matched by age and sex to identify the best classifiers discriminating the 2 cohorts with the minimum number of parameters. These classifiers were then tested using independent CM cohorts representing different entities of the disease. RESULTS Machine learning identified combinations of 2 and 3 morphometric measurements that were able to discern not only classic CM-I (with more than 5 mm TH) but also other entities such as classic CM-I with moderate TH and CM Type 1.5 (CM-1.5), with high accuracy (> 87%) and independent of the TH criterion. In contrast, lower accuracy was obtained in patients with CM Type 0. The distances from the lower aspect of the corpus callosum, pons, and fastigium to the foramen magnum and the basal and Wackenheim angles were identified as the most relevant morphometric traits to differentiate these patients. The stronger significance (p < 0.01) of the correlations with the clivus length, compared with the supraoccipital length, suggests that these 5 relevant traits would be affected more by the relative position of the basion than the opisthion. CONCLUSIONS Tonsillar herniation as a unique criterion is insufficient for radiographic diagnosis of CM-I, which can be improved by considering the basion position. The position of the basion was altered in different entities of CM, including classic CM-I, classic CM-I with moderate TH, and CM-1.5. The authors propose a predictive model based on 3 parameters, all related to the basion location, to discern classic CM-I with 90% accuracy and suggest considering the anterior alterations in the evaluation of surgical procedures and outcomes.
Collapse
Affiliation(s)
- Aintzane Urbizu
- 1Conquer Chiari Research Center and.,2Pediatric Neurology Research Group
| | - Bryn A Martin
- 3Department of Biological Engineering, University of Idaho, Moscow, Idaho; and
| | - Dulce Moncho
- 4Department of Clinical Neurophysiology.,5Neurotraumatology and Neurosurgery Research Unit
| | - Alex Rovira
- 6Magnetic Resonance Unit (IDI), Department of Radiology, and
| | - Maria A Poca
- 5Neurotraumatology and Neurosurgery Research Unit.,7Department of Neurosurgery, Vall d'Hebron Research Institute, Vall d'Hebron University Hospital, Universitat Autònoma de Barcelona, Spain
| | - Juan Sahuquillo
- 5Neurotraumatology and Neurosurgery Research Unit.,7Department of Neurosurgery, Vall d'Hebron Research Institute, Vall d'Hebron University Hospital, Universitat Autònoma de Barcelona, Spain
| | | | | |
Collapse
|
39
|
Kim SJ, Cho KJ, Oh S. Development of machine learning models for diagnosis of glaucoma. PLoS One 2017; 12:e0177726. [PMID: 28542342 PMCID: PMC5441603 DOI: 10.1371/journal.pone.0177726] [Citation(s) in RCA: 127] [Impact Index Per Article: 18.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2017] [Accepted: 05/02/2017] [Indexed: 02/04/2023] Open
Abstract
The study aimed to develop machine learning models that have strong prediction power and interpretability for diagnosis of glaucoma based on retinal nerve fiber layer (RNFL) thickness and visual field (VF). We collected various candidate features from the examination of retinal nerve fiber layer (RNFL) thickness and visual field (VF). We also developed synthesized features from original features. We then selected the best features proper for classification (diagnosis) through feature evaluation. We used 100 cases of data as a test dataset and 399 cases of data as a training and validation dataset. To develop the glaucoma prediction model, we considered four machine learning algorithms: C5.0, random forest (RF), support vector machine (SVM), and k-nearest neighbor (KNN). We repeatedly composed a learning model using the training dataset and evaluated it by using the validation dataset. Finally, we got the best learning model that produces the highest validation accuracy. We analyzed quality of the models using several measures. The random forest model shows best performance and C5.0, SVM, and KNN models show similar accuracy. In the random forest model, the classification accuracy is 0.98, sensitivity is 0.983, specificity is 0.975, and AUC is 0.979. The developed prediction models show high accuracy, sensitivity, specificity, and AUC in classifying among glaucoma and healthy eyes. It will be used for predicting glaucoma against unknown examination records. Clinicians may reference the prediction results and be able to make better decisions. We may combine multiple learning models to increase prediction accuracy. The C5.0 model includes decision rules for prediction. It can be used to explain the reasons for specific predictions.
Collapse
Affiliation(s)
- Seong Jae Kim
- Department of Ophthalmology, Gyeongsang National University College of Medicine, Jinju, Korea
| | - Kyong Jin Cho
- Department of Ophthalmology, Dankook University College of Medicine, Cheonan, Korea
| | - Sejong Oh
- Department of Software Science, Dankook university, Yongin, Korea
| |
Collapse
|
40
|
Neural Network Analysis of Different Segmentation Strategies of Nerve Fiber Layer Assessment for Glaucoma Diagnosis. J Glaucoma 2016; 24:672-8. [PMID: 25055209 DOI: 10.1097/ijg.0000000000000071] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Abstract
PURPOSE To compare the diagnostic performance of different segmentations of the nerve fiber layer (NFL) thickness measurements using an artificial neural network and to define the optimal number of sectors with best diagnostic ability for glaucoma diagnosis. METHODS A total of 117 glaucoma patients and 123 normal subjects were included in the study. NFL thickness measurements were performed using the Spectralis-OCT (Heidelberg Engineering) to obtain the NFL thickness average; measurements from 2 semicircles, 4 quadrants, and 6, 8, 12, 16, 24, 32, and 64 sectors; and 768 uniformly divided locations around the peripapillary NFL. An artificial neural network evaluation was performed to compare the influence of sector analysis on the diagnostic performance of optical coherence tomography. Receiver operating characteristic curves were used to compare the diagnostic ability of the different segmentation analyses. RESULTS The 6 sectors divided by the horizontal division of the nasal and temporal quadrants were better than the 6 sectors divided by the vertical line through the superior and inferior quadrants [areas under curve, 0.778; 95% confidence interval (CI), 0.720-0.829 and 0.814; 95% CI, 0.759-0.861, respectively]. In the case of quadrants, clock quadrants (area under curve 0.770; 95% CI, 0.712-0.822) were better than the ISNT (inferior-superior-nasal-temporal) quadrants (area under curve, 0.770; 95% CI, 0.712-0.822; P=0.003). The first segmentation strategy that improved the diagnostic value of 4 ISNT quadrants was the 12-sector analysis (area under curve, 0.845; 95% CI, 0.793-0.889; P=0.001). CONCLUSIONS The 2 best candidate strategies for the OCT report were the 12-sector analysis and the 4 planimetric quadrant (alternatively, the 4 clock quadrants) analysis.
Collapse
|
41
|
Belghith A, Bowd C, Weinreb RN, Zangwill LM. A hierarchical framework for estimating neuroretinal rim area using 3D spectral domain optical coherence tomography (SD-OCT) optic nerve head (ONH) images of healthy and glaucoma eyes. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2015; 2014:3869-72. [PMID: 25570836 DOI: 10.1109/embc.2014.6944468] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Glaucoma is a chronic neurodegenerative disease characterized by loss of retinal ganglion cells, resulting in distinctive changes in the optic nerve head (ONH) and retinal nerve fiber layer (RNFL). Important advances in technology for non-invasive imaging of the eye have been made providing quantitative tools to measure structural changes in ONH topography, a crucial step in diagnosing and monitoring glaucoma. 3D spectral domain optical coherence tomography (SD-OCT), an optical imaging technique, has been commonly used to discriminate glaucomatous from healthy subjects. In this paper, we present a new approach for locating the Bruch's membrane opening BMO and then estimating the optic disc size and rim area of 3D Spectralis SD-OCT images. To deal with the overlapping of the Bruch's membrane BM layer and the border tissue of Elschnig due to the poor image resolution, we propose the use of image deconvolution approach to separate these layers. To estimate the optic disc size and rim area, we propose the use of a new regression method based on the artificial neural network principal component analysis (ANN-PCA), which allows us to model irregularity in the BMO estimation due to scan shifts and/or poor image quality. The diagnostic accuracy of rim area, and rim to disc area ratio is compared to the diagnostic accuracy of global RNFL thickness measurements provided by two commercially available SD-OCT devices using receiver operating characteristic curve analyses.
Collapse
|
42
|
Belghith A, Bowd C, Medeiros FA, Balasubramanian M, Weinreb RN, Zangwill LM. Learning from healthy and stable eyes: A new approach for detection of glaucomatous progression. Artif Intell Med 2015; 64:105-15. [PMID: 25940856 DOI: 10.1016/j.artmed.2015.04.002] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2014] [Revised: 04/14/2015] [Accepted: 04/15/2015] [Indexed: 11/28/2022]
Abstract
UNLABELLED Glaucoma is a chronic neurodegenerative disease characterized by loss of retinal ganglion cells, resulting in distinctive changes in the optic nerve head (ONH) and retinal nerve fiber layer. Important advances in technology for non-invasive imaging of the eye have been made providing quantitative tools to measure structural changes in ONH topography, a crucial step in diagnosing and monitoring glaucoma. Three dimensional (3D) spectral domain optical coherence tomography (SD-OCT), an optical imaging technique, is now the standard of care for diagnosing and monitoring progression of numerous eye diseases. METHOD This paper aims to detect changes in multi-temporal 3D SD-OCT ONH images using a hierarchical fully Bayesian framework and then to differentiate between changes reflecting random variations or true changes due to glaucoma progression. To this end, we propose the use of kernel-based support vector data description (SVDD) classifier. SVDD is a well-known one-class classifier that allows us to map the data into a high-dimensional feature space where a hypersphere encloses most patterns belonging to the target class. RESULTS The proposed glaucoma progression detection scheme using the whole 3D SD-OCT images detected glaucoma progression in a significant number of cases showing progression by conventional methods (78%), with high specificity in normal and non-progressing eyes (93% and 94% respectively). CONCLUSION The use of the dependency measurement in the SVDD framework increased the robustness of the proposed change-detection scheme with comparison to the classical support vector machine and SVDD methods. The validation using clinical data of the proposed approach has shown that the use of only healthy and non-progressing eyes to train the algorithm led to a high diagnostic accuracy for detecting glaucoma progression compared to other methods.
Collapse
Affiliation(s)
- Akram Belghith
- University of California San Diego, Hamilton Glaucoma Center, 9500 Gilman Drive, La Jolla, CA 92093-0946, United States.
| | - Christopher Bowd
- University of California San Diego, Hamilton Glaucoma Center, 9500 Gilman Drive, La Jolla, CA 92093-0946, United States.
| | - Felipe A Medeiros
- University of California San Diego, Hamilton Glaucoma Center, 9500 Gilman Drive, La Jolla, CA 92093-0946, United States.
| | - Madhusudhanan Balasubramanian
- University of Memphis, Department of Electrical and Computer Engineering, 3815 Central Avenue, Memphis, TN 38152, United States.
| | - Robert N Weinreb
- University of California San Diego, Hamilton Glaucoma Center, 9500 Gilman Drive, La Jolla, CA 92093-0946, United States.
| | - Linda M Zangwill
- University of California San Diego, Hamilton Glaucoma Center, 9500 Gilman Drive, La Jolla, CA 92093-0946, United States.
| |
Collapse
|
43
|
Liu S, Datta A, Ho D, Dwelle J, Wang D, Milner TE, Rylander HG, Markey MK. Effect of image registration on longitudinal analysis of retinal nerve fiber layer thickness of non-human primates using Optical Coherence Tomography (OCT). EYE AND VISION (LONDON, ENGLAND) 2015; 2:3. [PMID: 26605359 PMCID: PMC4657366 DOI: 10.1186/s40662-015-0013-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/13/2014] [Accepted: 01/27/2015] [Indexed: 11/18/2022]
Abstract
BACKGROUND In this paper we determined the benefits of image registration on estimating longitudinal retinal nerve fiber layer thickness (RNFLT) changes. METHODS RNFLT maps around the optic nerve head (ONH) of healthy primate eyes were measured using Optical Coherence Tomography (OCT) weekly for 30 weeks. One automatic algorithm based on mutual information (MI) and the other semi-automatic algorithm based on log-polar transform cross-correlation using manually segmented blood vessels (LPCC_MSBV), were used to register retinal maps longitudinally. We compared the precision and recall between manually segmented image pairs for the two algorithms using a linear mixed effects model. RESULTS We found that the precision calculated between manually segmented image pairs following registration by LPCC_MSBV algorithm is significantly better than the one following registration by MI algorithm (p < <0.0001). Trend of the all-rings and temporal, superior, nasal and inferior (TSNI) quadrants average of RNFLT over time in healthy primate eyes are not affected by registration. RNFLT of clock hours 1, 2, and 10 showed significant change over 30 weeks (p = 0.0058, 0.0054, and 0.0298 for clock hours 1, 2 and 10 respectively) without registration, but stayed constant over time with registration. CONCLUSIONS The LPCC_MSBV provides better registration of RNFLT maps recorded on different dates than the automatic MI algorithm. Registration of RNFLT maps can improve clinical analysis of glaucoma progression.
Collapse
Affiliation(s)
- Shuang Liu
- />Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX 78712 USA
- />Present address: Clinical Neuroscience Imaging Center (CNIC), Department of Neurology, Yale School of Medicine, New Haven, CT 06510 USA
| | - Anjali Datta
- />Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX 78712 USA
| | - Derek Ho
- />Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX 78712 USA
| | - Jordan Dwelle
- />Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX 78712 USA
| | - Daifeng Wang
- />Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX 78712 USA
| | - Thomas E Milner
- />Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX 78712 USA
| | - Henry Grady Rylander
- />Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX 78712 USA
| | - Mia K Markey
- />Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX 78712 USA
- />Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030 USA
| |
Collapse
|
44
|
Belghith A, Bowd C, Medeiros FA, Balasubramanian M, Weinreb RN, Zangwill LM. Glaucoma progression detection using nonlocal Markov random field prior. J Med Imaging (Bellingham) 2014; 1:034504. [PMID: 26158069 PMCID: PMC4478777 DOI: 10.1117/1.jmi.1.3.034504] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2014] [Accepted: 11/20/2014] [Indexed: 11/14/2022] Open
Abstract
Glaucoma is neurodegenerative disease characterized by distinctive changes in the optic nerve head and visual field. Without treatment, glaucoma can lead to permanent blindness. Therefore, monitoring glaucoma progression is important to detect uncontrolled disease and the possible need for therapy advancement. In this context, three-dimensional (3-D) spectral domain optical coherence tomography (SD-OCT) has been commonly used in the diagnosis and management of glaucoma patients. We present a new framework for detection of glaucoma progression using 3-D SD-OCT images. In contrast to previous works that use the retinal nerve fiber layer thickness measurement provided by commercially available instruments, we consider the whole 3-D volume for change detection. To account for the spatial voxel dependency, we propose the use of the Markov random field (MRF) model as a prior for the change detection map. In order to improve the robustness of the proposed approach, a nonlocal strategy was adopted to define the MRF energy function. To accommodate the presence of false-positive detection, we used a fuzzy logic approach to classify a 3-D SD-OCT image into a "non-progressing" or "progressing" glaucoma class. We compared the diagnostic performance of the proposed framework to the existing methods of progression detection.
Collapse
Affiliation(s)
- Akram Belghith
- University of California San Diego, Hamilton Glaucoma Center, 9500 Gilman Drive, La Jolla, California 92093-0946, United States
| | - Christopher Bowd
- University of California San Diego, Hamilton Glaucoma Center, 9500 Gilman Drive, La Jolla, California 92093-0946, United States
| | - Felipe A. Medeiros
- University of California San Diego, Hamilton Glaucoma Center, 9500 Gilman Drive, La Jolla, California 92093-0946, United States
| | - Madhusudhanan Balasubramanian
- University of Memphis, Department of Electrical and Computer Engineering, 3815 Central Avenue, Memphis, Tennessee 38152 United States
- University of Memphis, Department of Biomedical Engineering, 920 Madison Avenue, Memphis, Tennessee 38103 United States
- University of Tennessee Health Science Center, Department of Biomedical Engineering, 920 Madison Avenue, Memphis, Tennessee 38103 United States
| | - Robert N. Weinreb
- University of California San Diego, Hamilton Glaucoma Center, 9500 Gilman Drive, La Jolla, California 92093-0946, United States
| | - Linda M. Zangwill
- University of California San Diego, Hamilton Glaucoma Center, 9500 Gilman Drive, La Jolla, California 92093-0946, United States
| |
Collapse
|
45
|
Combining information from 3 anatomic regions in the diagnosis of glaucoma with time-domain optical coherence tomography. J Glaucoma 2014; 23:129-35. [PMID: 22828002 DOI: 10.1097/ijg.0b013e318264b941] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
PURPOSE To improve the diagnosis of glaucoma by combining time-domain optical coherence tomography (TD-OCT) measurements of the optic disc, circumpapillary retinal nerve fiber layer (RNFL), and macular retinal thickness. PATIENTS AND METHODS Ninety-six age-matched normal and 96 perimetric glaucoma participants were included in this observational, cross-sectional study. Or-logic, support vector machine, relevance vector machine, and linear discrimination function were used to analyze the performances of combined TD-OCT diagnostic variables. RESULTS The area under the receiver-operating curve (AROC) was used to evaluate the diagnostic accuracy and to compare the diagnostic performance of single and combined anatomic variables. The best RNFL thickness variables were the inferior (AROC=0.900), overall (AROC=0.892), and superior quadrants (AROC=0.850). The best optic disc variables were horizontal integrated rim width (AROC=0.909), vertical integrated rim area (AROC=0.908), and cup/disc vertical ratio (AROC=0.890). All macular retinal thickness variables had AROCs of 0.829 or less. Combining the top 3 RNFL and optic disc variables in optimizing glaucoma diagnosis, support vector machine had the highest AROC, 0.954, followed by or-logic (AROC=0.946), linear discrimination function (AROC=0.946), and relevance vector machine (AROC=0.943). All combination diagnostic variables had significantly larger AROCs than any single diagnostic variable. There are no significant differences among the combination diagnostic indices. CONCLUSIONS With TD-OCT, RNFL and optic disc variables had better diagnostic accuracy than macular retinal variables. Combining top RNFL and optic disc variables significantly improved diagnostic performance. Clinically, or-logic classification was the most practical analytical tool with sufficient accuracy to diagnose early glaucoma.
Collapse
|
46
|
Belghith A, Bowd C, Weinreb RN, Zangwill LM. A joint estimation detection of Glaucoma progression in 3D spectral domain optical coherence tomography optic nerve head images. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2014; 9035:90350O. [PMID: 25606299 DOI: 10.1117/12.2041980] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Glaucoma is an ocular disease characterized by distinctive changes in the optic nerve head (ONH) and visual field. Glaucoma can strike without symptoms and causes blindness if it remains without treatment. Therefore, early disease detection is important so that treatment can be initiated and blindness prevented. In this context, important advances in technology for non-invasive imaging of the eye have been made providing quantitative tools to measure structural changes in ONH topography, an essential element for glaucoma detection and monitoring. 3D spectral domain optical coherence tomography (SD-OCT), an optical imaging technique, has been commonly used to discriminate glaucomatous from healthy subjects. In this paper, we present a new framework for detection of glaucoma progression using 3D SD-OCT images. In contrast to previous works that the retinal nerve fiber layer (RNFL) thickness measurement provided by commercially available spectral-domain optical coherence tomograph, we consider the whole 3D volume for change detection. To integrate a priori knowledge and in particular the spatial voxel dependency in the change detection map, we propose the use of the Markov Random Field to handle a such dependency. To accommodate the presence of false positive detection, the estimated change detection map is then used to classify a 3D SDOCT image into the "non-progressing" and "progressing" glaucoma classes, based on a fuzzy logic classifier. We compared the diagnostic performance of the proposed framework to existing methods of progression detection.
Collapse
Affiliation(s)
- Akram Belghith
- Hamilton Glaucoma Center, University of California San Diego, La Jolla, California
| | - Christopher Bowd
- Hamilton Glaucoma Center, University of California San Diego, La Jolla, California
| | - Robert N Weinreb
- Hamilton Glaucoma Center, University of California San Diego, La Jolla, California
| | - Linda M Zangwill
- Hamilton Glaucoma Center, University of California San Diego, La Jolla, California
| |
Collapse
|
47
|
Srinivasan PP, Heflin SJ, Izatt JA, Arshavsky VY, Farsiu S. Automatic segmentation of up to ten layer boundaries in SD-OCT images of the mouse retina with and without missing layers due to pathology. BIOMEDICAL OPTICS EXPRESS 2014; 5:348-65. [PMID: 24575332 PMCID: PMC3920868 DOI: 10.1364/boe.5.000348] [Citation(s) in RCA: 47] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/23/2013] [Revised: 12/13/2013] [Accepted: 12/17/2013] [Indexed: 05/03/2023]
Abstract
Accurate quantification of retinal layer thicknesses in mice as seen on optical coherence tomography (OCT) is crucial for the study of numerous ocular and neurological diseases. However, manual segmentation is time-consuming and subjective. Previous attempts to automate this process were limited to high-quality scans from mice with no missing layers or visible pathology. This paper presents an automatic approach for segmenting retinal layers in spectral domain OCT images using sparsity based denoising, support vector machines, graph theory, and dynamic programming (S-GTDP). Results show that this method accurately segments all present retinal layer boundaries, which can range from seven to ten, in wild-type and rhodopsin knockout mice as compared to manual segmentation and has a more accurate performance as compared to the commercial automated Diver segmentation software.
Collapse
Affiliation(s)
- Pratul P. Srinivasan
- Department of Biomedical Engineering, Duke University, Durham 27708, USA
- Department of Computer Science, Duke University, Durham 27708, USA
| | - Stephanie J. Heflin
- Department of Ophthalmology, Duke University Medical Center, Durham 27710, USA
| | - Joseph A. Izatt
- Department of Biomedical Engineering, Duke University, Durham 27708, USA
- Department of Ophthalmology, Duke University Medical Center, Durham 27710, USA
| | - Vadim Y. Arshavsky
- Department of Ophthalmology, Duke University Medical Center, Durham 27710, USA
- Department of Pharmacology and Cancer Biology, Duke University Medical Center, Durham 27710, USA
| | - Sina Farsiu
- Department of Biomedical Engineering, Duke University, Durham 27708, USA
- Department of Ophthalmology, Duke University Medical Center, Durham 27710, USA
- Department of Electrical and Computer Engineering, Duke University, Durham 27708, USA
- Department of Computer Science, Duke University, Durham 27708, USA
| |
Collapse
|
48
|
Glaucoma Diagnostic Accuracy of Machine Learning Classifiers Using Retinal Nerve Fiber Layer and Optic Nerve Data from SD-OCT. J Ophthalmol 2013; 2013:789129. [PMID: 24369495 PMCID: PMC3863536 DOI: 10.1155/2013/789129] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2013] [Accepted: 10/13/2013] [Indexed: 12/15/2022] Open
Abstract
Purpose. To investigate the diagnostic accuracy of machine learning classifiers (MLCs) using retinal nerve fiber layer (RNFL) and optic nerve (ON) parameters obtained with spectral domain optical coherence tomography (SD-OCT). Methods. Fifty-seven patients with early to moderate primary open angle glaucoma and 46 healthy patients were recruited. All 103 patients underwent a complete ophthalmological examination, achromatic standard automated perimetry, and imaging with SD-OCT. Receiver operating characteristic (ROC) curves were built for RNFL and ON parameters. Ten MLCs were tested. Areas under ROC curves (aROCs) obtained for each SD-OCT parameter and MLC were compared. Results. The mean age was 56.5 ± 8.9 years for healthy individuals and 59.9 ± 9.0 years for glaucoma patients (P = 0.054). Mean deviation values were −1.4 dB for healthy individuals and −4.0 dB for glaucoma patients (P < 0.001). SD-OCT parameters with the greatest aROCs were cup/disc area ratio (0.846) and average cup/disc (0.843). aROCs obtained with classifiers varied from 0.687 (CTREE) to 0.877 (RAN). The aROC obtained with RAN (0.877) was not significantly different from the aROC obtained with the best single SD-OCT parameter (0.846) (P = 0.542). Conclusion. MLCs showed good accuracy but did not improve the sensitivity and specificity of SD-OCT for the diagnosis of glaucoma.
Collapse
|
49
|
Theeraworn C, Kongprawechnon W, Kondo T, Bunnun P, Nishihara A, Manassakorn A. Automatic screening of narrow anterior chamber angle and angle-closure glaucoma based on slit-lamp image analysis by using support vector machine. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2013; 2013:5887-90. [PMID: 24111078 DOI: 10.1109/embc.2013.6610891] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
At present, Van Herick's method is a standard technique used to screen a Narrow Anterior Chamber Angle (NACA) and Angle-Closure Glaucoma (ACG). It can identify a patient who suffers from NACA and ACG by considering the width of peripheral anterior chamber depth (PACD) and corneal thickness. However, the screening result of this method often varies among ophthalmologists. So, an automatic screening of NACA and ACG based on slit-lamp image analysis by using Support Vector Machine (SVM) is proposed. SVM can automatically generate the classification model, which is used to classify the result as an angle-closure likely or an angle-closure unlikely. It shows that it can improve the accuracy of the screening result. To develop the classification model, the width of PACD and corneal thickness from many positions are measured and selected to be features. A statistic analysis is also used in the PACD and corneal thickness estimation in order to reduce the error from reflection on the cornea. In this study, it is found that the generated models are evaluated by using 5-fold cross validation and give a better result than the result classified by Van Herick's method.
Collapse
|
50
|
Garcia-Martin E, Herrero R, Bambo MP, Ara JR, Martin J, Polo V, Larrosa JM, Garcia-Feijoo J, Pablo LE. Artificial Neural Network Techniques to Improve the Ability of Optical Coherence Tomography to Detect Optic Neuritis. Semin Ophthalmol 2013; 30:11-9. [DOI: 10.3109/08820538.2013.810277] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|