1
|
Beniz LAF, Campos VP, Medeiros FA. Optical Coherence Tomography Versus Optic Disc Photo Assessment in Glaucoma Screening. J Glaucoma 2024; 33:S21-S25. [PMID: 38546240 DOI: 10.1097/ijg.0000000000002392] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Accepted: 03/17/2024] [Indexed: 04/18/2024]
Abstract
PRCIS Optical coherence tomography (OCT) and optic disc photography present valuable but distinct capabilities for glaucoma screening. OBJECTIVE This review article examines the strengths and limitations of OCT and optic disc photography in glaucoma screening. METHODS A comprehensive literature review was conducted, focusing on the accuracy, feasibility, cost-effectiveness, and technological advancements in OCT and optic disc photography for glaucoma screening. RESULTS OCT is highly accurate and reproducible but faces limitations due to its cost and less portable nature, making widespread screening challenging. In contrast, optic disc photos are more accessible and cost-effective but are hindered by subjective interpretation and inconsistent grading reliability. A critical challenge in glaucoma screening is achieving a high PPV, particularly given the low prevalence of the disease, which can lead to a significant number of false positives. The advent of artificial intelligence (AI) and deep learning models shows potential in improving the diagnostic accuracy of optic disc photos by automating the detection of glaucomatous optic neuropathy and reducing subjectivity. However, the effectiveness of these AI models hinges on the quality of training data. Using subjective gradings as training data, will carry the limitations of human assessment into the AI system, leading to potential inaccuracies. Conversely, training AI models using objective data from OCT, such as retinal nerve fiber layer thickness, may offer a promising direction. CONCLUSION Both OCT and optic disc photography present valuable but distinct capabilities for glaucoma screening. An approach integrating AI technology might be key in optimizing these methods for effective, large-scale screening programs.
Collapse
Affiliation(s)
- Luiz Arthur F Beniz
- Department of Ophthalmology, Bascom Palmer Eye Institute, Miller School of Medicine, University of Miami, Miami, FL
| | | | | |
Collapse
|
2
|
Medeiros FA, Lee T, Jammal AA, Al-Aswad LA, Eydelman MB, Schuman JS. The Definition of Glaucomatous Optic Neuropathy in Artificial Intelligence Research and Clinical Applications. Ophthalmol Glaucoma 2023; 6:432-438. [PMID: 36731747 PMCID: PMC10387499 DOI: 10.1016/j.ogla.2023.01.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Revised: 01/19/2023] [Accepted: 01/23/2023] [Indexed: 06/11/2023]
Abstract
OBJECTIVE Although artificial intelligence (AI) models may offer innovative and powerful ways to use the wealth of data generated by diagnostic tools, there are important challenges related to their development and validation. Most notable is the lack of a perfect reference standard for glaucomatous optic neuropathy (GON). Because AI models are trained to predict presence of glaucoma or its progression, they generally rely on a reference standard that is used to train the model and assess its validity. If an improper reference standard is used, the model may be trained to detect or predict something that has little or no clinical value. This article summarizes the issues and discussions related to the definition of GON in AI applications as presented by the Glaucoma Workgroup from the Collaborative Community for Ophthalmic Imaging (CCOI) US Food and Drug Administration Virtual Workshop, on September 3 and 4, 2020, and on January 28, 2022. DESIGN Review and conference proceedings. SUBJECTS No human or animal subjects or data therefrom were used in the production of this article. METHODS A summary of the Workshop was produced with input and approval from all participants. MAIN OUTCOME MEASURES Consensus position of the CCOI Workgroup on the challenges in defining GON and possible solutions. RESULTS The Workshop reviewed existing challenges that arise from the use of subjective definitions of GON and highlighted the need for a more objective approach to characterize GON that could facilitate replication and comparability of AI studies and allow for better clinical validation of proposed AI tools. Different tests and combination of parameters for defining a reference standard for GON have been proposed. Different reference standards may need to be considered depending on the scenario in which the AI models are going to be applied, such as community-based or opportunistic screening versus detection or monitoring of glaucoma in tertiary care. CONCLUSIONS The development and validation of new AI-based diagnostic tests should be based on rigorous methodology with clear determination of how the reference standards for glaucomatous damage are constructed and the settings where the tests are going to be applied. FINANCIAL DISCLOSURE(S) Proprietary or commercial disclosure may be found after the references.
Collapse
Affiliation(s)
- Felipe A Medeiros
- Department of Ophthalmology, Duke University School of Medicine, Durham, North Carolina; Department of Electrical and Computer Engineering, Pratt School of Engineering, Duke University, Durham, North Carolina.
| | - Terry Lee
- Department of Ophthalmology, Duke University School of Medicine, Durham, North Carolina
| | - Alessandro A Jammal
- Department of Ophthalmology, Duke University School of Medicine, Durham, North Carolina
| | - Lama A Al-Aswad
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, New York; Department of Population Health, NYU Langone Health, NYU Grossman School of Medicine, New York, New York
| | | | - Joel S Schuman
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, New York; Department of Biomedical Engineering, New York University Tandon School of Engineering, Brooklyn, New York; Department of Electrical and Computer Engineering, New York University Tandon School of Engineering, Brooklyn, New York; Center for Neural Science, NYU, New York, New York; Neuroscience Institute, NYU Langone Health, New York, New York
| |
Collapse
|
3
|
Gu B, Sidhu S, Weinreb RN, Christopher M, Zangwill LM, Baxter SL. Review of Visualization Approaches in Deep Learning Models of Glaucoma. Asia Pac J Ophthalmol (Phila) 2023; 12:392-401. [PMID: 37523431 DOI: 10.1097/apo.0000000000000619] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Accepted: 05/11/2023] [Indexed: 08/02/2023] Open
Abstract
Glaucoma is a major cause of irreversible blindness worldwide. As glaucoma often presents without symptoms, early detection and intervention are important in delaying progression. Deep learning (DL) has emerged as a rapidly advancing tool to help achieve these objectives. In this narrative review, data types and visualization approaches for presenting model predictions, including models based on tabular data, functional data, and/or structural data, are summarized, and the importance of data source diversity for improving the utility and generalizability of DL models is explored. Examples of innovative approaches to understanding predictions of artificial intelligence (AI) models and alignment with clinicians are provided. In addition, methods to enhance the interpretability of clinical features from tabular data used to train AI models are investigated. Examples of published DL models that include interfaces to facilitate end-user engagement and minimize cognitive and time burdens are highlighted. The stages of integrating AI models into existing clinical workflows are reviewed, and challenges are discussed. Reviewing these approaches may help inform the generation of user-friendly interfaces that are successfully integrated into clinical information systems. This review details key principles regarding visualization approaches in DL models of glaucoma. The articles reviewed here focused on usability, explainability, and promotion of clinician trust to encourage wider adoption for clinical use. These studies demonstrate important progress in addressing visualization and explainability issues required for successful real-world implementation of DL models in glaucoma.
Collapse
Affiliation(s)
- Byoungyoung Gu
- Division of Ophthalmology Informatics and Data Science and Hamilton Glaucoma Center, Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, La Jolla, CA, US
- Division of Biomedical Informatics, Department of Medicine, University of California San Diego, La Jolla, CA, US
| | - Sophia Sidhu
- Division of Ophthalmology Informatics and Data Science and Hamilton Glaucoma Center, Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, La Jolla, CA, US
- Division of Biomedical Informatics, Department of Medicine, University of California San Diego, La Jolla, CA, US
| | - Robert N Weinreb
- Division of Ophthalmology Informatics and Data Science and Hamilton Glaucoma Center, Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, La Jolla, CA, US
| | - Mark Christopher
- Division of Ophthalmology Informatics and Data Science and Hamilton Glaucoma Center, Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, La Jolla, CA, US
| | - Linda M Zangwill
- Division of Ophthalmology Informatics and Data Science and Hamilton Glaucoma Center, Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, La Jolla, CA, US
| | - Sally L Baxter
- Division of Ophthalmology Informatics and Data Science and Hamilton Glaucoma Center, Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, La Jolla, CA, US
- Division of Biomedical Informatics, Department of Medicine, University of California San Diego, La Jolla, CA, US
| |
Collapse
|
4
|
Miller S, Blackburn NB, Johnson M, Laston S, Subedi J, Charlesworth JC, Blangero J, Towne B, Thapa SS, Williams-Blangero S. The Prevalence of Glaucoma in the Jirel Ethnic Group of Nepal. FRONTIERS IN OPHTHALMOLOGY 2022; 2:824904. [PMID: 38983520 PMCID: PMC11182084 DOI: 10.3389/fopht.2022.824904] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Accepted: 05/09/2022] [Indexed: 07/11/2024]
Abstract
Glaucoma is one of the leading causes of blindness worldwide with individuals in Asia disproportionately affected. Using a cross-sectional study design as part of the Jiri Eye Study, we assessed the prevalence of glaucoma in the Jirel population of Nepal and provide new information on the occurrence of glaucoma in south central Asia. Over a four-year period, 2,042 members of the Jirel population, aged 18 years and older, underwent a detailed ocular examination. Glaucoma was diagnosed using the International Society of Geographical and Epidemiological Ophthalmology criteria. The mean (SD) age at exam was 42.3 (16.7) years and 54.1% of the sample was female. In the total sample, the mean (SD) intraocular pressure (IOP) and vertical cup-to-disc ratio (VCDR) was 14.55 (2.42) mmHg and 0.31 (0.15), respectively. The 97.5th and 99.5th percentile for IOP and VCDR was 20 mmHg and 22 mmHg, and 0.7 and 0.8, respectively. The overall prevalence of glaucoma in the population was 2.30% (n = 47). Of these 47 individuals, 37 (78.7%) had primary open angle glaucoma, 6 (12.8%) had primary angle closure glaucoma, and 4 (8.5%) had secondary glaucoma. There was a significant (p = 5.86×10-6) increase in the prevalence of glaucoma with increasing age overall and across glaucoma subtypes. Six individuals with glaucoma (12.8%) were blind in at least one eye. Of the individuals with glaucoma, 93.6% were previously undiagnosed. In individuals aged 40 years or older (n = 1057, 51.4% female), the mean (SD) IOP and VCDR was 14.39 (2.63) mmHg and 0.34 (0.16), respectively, and glaucoma prevalence was 4.16% (n = 44). The prevalence of glaucoma and undiagnosed disease is high in the Jirel population of Nepal. This study will inform strategies to minimize glaucoma-associated burden in Nepal.
Collapse
Affiliation(s)
- Sarah Miller
- Department of Family Medicine, School of Medicine, University of California Davis, Sacramento, CA, United States
| | - Nicholas B Blackburn
- Menzies Institute for Medical Research, University of Tasmania, Hobart, TAS, Australia
- South Texas Diabetes and Obesity Institute, University of Texas Rio Grande Valley, Brownsville, TX, United States
- Department of Human Genetics, School of Medicine, University of Texas Rio Grande Valley, Brownsville, TX, United States
| | - Matthew Johnson
- South Texas Diabetes and Obesity Institute, University of Texas Rio Grande Valley, Brownsville, TX, United States
- Department of Human Genetics, School of Medicine, University of Texas Rio Grande Valley, Brownsville, TX, United States
| | - Sandra Laston
- South Texas Diabetes and Obesity Institute, University of Texas Rio Grande Valley, Brownsville, TX, United States
- Department of Human Genetics, School of Medicine, University of Texas Rio Grande Valley, Brownsville, TX, United States
| | - Janardan Subedi
- Department of Sociology and Gerontology, College of Arts and Sciences, Miami University, Oxford, OH, United States
| | - Jac C Charlesworth
- Menzies Institute for Medical Research, University of Tasmania, Hobart, TAS, Australia
| | - John Blangero
- South Texas Diabetes and Obesity Institute, University of Texas Rio Grande Valley, Brownsville, TX, United States
- Department of Human Genetics, School of Medicine, University of Texas Rio Grande Valley, Brownsville, TX, United States
| | - Bradford Towne
- Department of Community Health, School of Medicine, Wright State University, Dayton, OH, United States
| | - Suman S Thapa
- Tilganga Institute of Ophthalmology, Kathmandu, Nepal
| | - Sarah Williams-Blangero
- South Texas Diabetes and Obesity Institute, University of Texas Rio Grande Valley, Brownsville, TX, United States
- Department of Human Genetics, School of Medicine, University of Texas Rio Grande Valley, Brownsville, TX, United States
| |
Collapse
|
5
|
WU JOHSUAN, NISHIDA TAKASHI, WEINREB ROBERTN, LIN JOUWEI. Performances of Machine Learning in Detecting Glaucoma Using Fundus and Retinal Optical Coherence Tomography Images: A Meta-Analysis. Am J Ophthalmol 2022; 237:1-12. [PMID: 34942113 DOI: 10.1016/j.ajo.2021.12.008] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Revised: 11/24/2021] [Accepted: 12/03/2021] [Indexed: 11/01/2022]
Abstract
PURPOSE To evaluate the performance of machine learning (ML) in detecting glaucoma using fundus and retinal optical coherence tomography (OCT) images. DESIGN Meta-analysis. METHODS PubMed and EMBASE were searched on August 11, 2021. A bivariate random-effects model was used to pool ML's diagnostic sensitivity, specificity, and area under the curve (AUC). Subgroup analyses were performed based on ML classifier categories and dataset types. RESULTS One hundred and five studies (3.3%) were retrieved. Seventy-three (69.5%), 30 (28.6%), and 2 (1.9%) studies tested ML using fundus, OCT, and both image types, respectively. Total testing data numbers were 197,174 for fundus and 16,039 for OCT. Overall, ML showed excellent performances for both fundus (pooled sensitivity = 0.92 [95% CI, 0.91-0.93]; specificity = 0.93 [95% CI, 0.91-0.94]; and AUC = 0.97 [95% CI, 0.95-0.98]) and OCT (pooled sensitivity = 0.90 [95% CI, 0.86-0.92]; specificity = 0.91 [95% CI, 0.89-0.92]; and AUC = 0.96 [95% CI, 0.93-0.97]). ML performed similarly using all data and external data for fundus and the external test result of OCT was less robust (AUC = 0.87). When comparing different classifier categories, although support vector machine showed the highest performance (pooled sensitivity, specificity, and AUC ranges, 0.92-0.96, 0.95-0.97, and 0.96-0.99, respectively), results by neural network and others were still good (pooled sensitivity, specificity, and AUC ranges, 0.88-0.93, 0.90-0.93, 0.95-0.97, respectively). When analyzed based on dataset types, ML demonstrated consistent performances on clinical datasets (fundus AUC = 0.98 [95% CI, 0.97-0.99] and OCT AUC = 0.95 [95% 0.93-0.97]). CONCLUSIONS Performance of ML in detecting glaucoma compares favorably to that of experts and is promising for clinical application. Future prospective studies are needed to better evaluate its real-world utility.
Collapse
|
6
|
A Comprehensive Review of Methods and Equipment for Aiding Automatic Glaucoma Tracking. Diagnostics (Basel) 2022; 12:diagnostics12040935. [PMID: 35453985 PMCID: PMC9031684 DOI: 10.3390/diagnostics12040935] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Revised: 04/05/2022] [Accepted: 04/07/2022] [Indexed: 02/01/2023] Open
Abstract
Glaucoma is a chronic optic neuropathy characterized by irreversible damage to the retinal nerve fiber layer (RNFL), resulting in changes in the visual field (VC). Glaucoma screening is performed through a complete ophthalmological examination, using images of the optic papilla obtained in vivo for the evaluation of glaucomatous characteristics, eye pressure, and visual field. Identifying the glaucomatous papilla is quite important, as optical papillary images are considered the gold standard for tracking. Therefore, this article presents a review of the diagnostic methods used to identify the glaucomatous papilla through technology over the last five years. Based on the analyzed works, the current state-of-the-art methods are identified, the current challenges are analyzed, and the shortcomings of these methods are investigated, especially from the point of view of automation and independence in performing these measurements. Finally, the topics for future work and the challenges that need to be solved are proposed.
Collapse
|
7
|
Camara J, Neto A, Pires IM, Villasana MV, Zdravevski E, Cunha A. Literature Review on Artificial Intelligence Methods for Glaucoma Screening, Segmentation, and Classification. J Imaging 2022; 8:jimaging8020019. [PMID: 35200722 PMCID: PMC8878383 DOI: 10.3390/jimaging8020019] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Revised: 01/11/2022] [Accepted: 01/17/2022] [Indexed: 12/20/2022] Open
Abstract
Artificial intelligence techniques are now being applied in different medical solutions ranging from disease screening to activity recognition and computer-aided diagnosis. The combination of computer science methods and medical knowledge facilitates and improves the accuracy of the different processes and tools. Inspired by these advances, this paper performs a literature review focused on state-of-the-art glaucoma screening, segmentation, and classification based on images of the papilla and excavation using deep learning techniques. These techniques have been shown to have high sensitivity and specificity in glaucoma screening based on papilla and excavation images. The automatic segmentation of the contours of the optic disc and the excavation then allows the identification and assessment of the glaucomatous disease’s progression. As a result, we verified whether deep learning techniques may be helpful in performing accurate and low-cost measurements related to glaucoma, which may promote patient empowerment and help medical doctors better monitor patients.
Collapse
Affiliation(s)
- José Camara
- R. Escola Politécnica, Universidade Aberta, 1250-100 Lisboa, Portugal;
- Instituto de Engenharia de Sistemas e Computadores, Tecnologia e Ciência, 3200-465 Porto, Portugal;
| | - Alexandre Neto
- Instituto de Engenharia de Sistemas e Computadores, Tecnologia e Ciência, 3200-465 Porto, Portugal;
- Escola de Ciências e Tecnologia, University of Trás-os-Montes e Alto Douro, Quinta de Prados, 5001-801 Vila Real, Portugal;
| | - Ivan Miguel Pires
- Escola de Ciências e Tecnologia, University of Trás-os-Montes e Alto Douro, Quinta de Prados, 5001-801 Vila Real, Portugal;
- Instituto de Telecomunicações, Universidade da Beira Interior, 6200-001 Covilhã, Portugal
| | - María Vanessa Villasana
- Centro Hospitalar Universitário Cova da Beira, 6200-251 Covilhã, Portugal;
- UICISA:E Research Centre, School of Health, Polytechnic Institute of Viseu, 3504-510 Viseu, Portugal
| | - Eftim Zdravevski
- Faculty of Computer Science and Engineering, University Ss Cyril and Methodius, 1000 Skopje, North Macedonia;
| | - António Cunha
- Instituto de Engenharia de Sistemas e Computadores, Tecnologia e Ciência, 3200-465 Porto, Portugal;
- Escola de Ciências e Tecnologia, University of Trás-os-Montes e Alto Douro, Quinta de Prados, 5001-801 Vila Real, Portugal;
- Correspondence: ; Tel.: +351-931-636-373
| |
Collapse
|
8
|
Bunod R, Augstburger E, Brasnu E, Labbe A, Baudouin C. [Artificial intelligence and glaucoma: A literature review]. J Fr Ophtalmol 2022; 45:216-232. [PMID: 34991909 DOI: 10.1016/j.jfo.2021.11.002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Accepted: 11/18/2021] [Indexed: 11/26/2022]
Abstract
In recent years, research in artificial intelligence (AI) has experienced an unprecedented surge in the field of ophthalmology, in particular glaucoma. The diagnosis and follow-up of glaucoma is complex and relies on a body of clinical evidence and ancillary tests. This large amount of information from structural and functional testing of the optic nerve and macula makes glaucoma a particularly appropriate field for the application of AI. In this paper, we will review work using AI in the field of glaucoma, whether for screening, diagnosis or detection of progression. Many AI strategies have shown promising results for glaucoma detection using fundus photography, optical coherence tomography, or automated perimetry. The combination of these imaging modalities increases the performance of AI algorithms, with results comparable to those of humans. We will discuss potential applications as well as obstacles and limitations to the deployment and validation of such models. While there is no doubt that AI has the potential to revolutionize glaucoma management and screening, research in the coming years will need to address unavoidable questions regarding the clinical significance of such results and the explicability of the predictions.
Collapse
Affiliation(s)
- R Bunod
- Service d'ophtalmologie 3, IHU FOReSIGHT, centre hospitalier national des Quinze-Vingts, 28, rue de Charenton, 75012 Paris, France.
| | - E Augstburger
- Service d'ophtalmologie 3, IHU FOReSIGHT, centre hospitalier national des Quinze-Vingts, 28, rue de Charenton, 75012 Paris, France
| | - E Brasnu
- Service d'ophtalmologie 3, IHU FOReSIGHT, centre hospitalier national des Quinze-Vingts, 28, rue de Charenton, 75012 Paris, France; CHNO des Quinze-Vingts, IHU FOReSIGHT, INSERM-DGOS CIC 1423, 17, rue Moreau, 75012 Paris, France; Sorbonne universités, INSERM, CNRS, institut de la Vision, 17, rue Moreau, 75012 Paris, France
| | - A Labbe
- Service d'ophtalmologie 3, IHU FOReSIGHT, centre hospitalier national des Quinze-Vingts, 28, rue de Charenton, 75012 Paris, France; CHNO des Quinze-Vingts, IHU FOReSIGHT, INSERM-DGOS CIC 1423, 17, rue Moreau, 75012 Paris, France; Sorbonne universités, INSERM, CNRS, institut de la Vision, 17, rue Moreau, 75012 Paris, France; Service d'ophtalmologie, hôpital Ambroise-Paré, AP-HP, université de Paris Saclay, 9, avenue Charles-de-Gaulle, 92100 Boulogne-Billancourt, France
| | - C Baudouin
- Service d'ophtalmologie 3, IHU FOReSIGHT, centre hospitalier national des Quinze-Vingts, 28, rue de Charenton, 75012 Paris, France; CHNO des Quinze-Vingts, IHU FOReSIGHT, INSERM-DGOS CIC 1423, 17, rue Moreau, 75012 Paris, France; Sorbonne universités, INSERM, CNRS, institut de la Vision, 17, rue Moreau, 75012 Paris, France; Service d'ophtalmologie, hôpital Ambroise-Paré, AP-HP, université de Paris Saclay, 9, avenue Charles-de-Gaulle, 92100 Boulogne-Billancourt, France
| |
Collapse
|
9
|
Thiel C, Schuman JS, Robin AL. Severe Acute Respiratory Syndrome Coronavirus Disease 2019: More Safety at the Expense of More Medical Waste. Ophthalmol Glaucoma 2022; 5:1-4. [PMID: 34090848 PMCID: PMC8172035 DOI: 10.1016/j.ogla.2021.05.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Revised: 05/04/2021] [Accepted: 05/05/2021] [Indexed: 11/20/2022]
|
10
|
Schuman JS, Angeles Ramos Cadena MDL, McGee R, Al-Aswad LA, Medeiros FA. A Case for The Use of Artificial Intelligence in Glaucoma Assessment. Ophthalmol Glaucoma 2021; 5:e3-e13. [PMID: 34954220 PMCID: PMC9133028 DOI: 10.1016/j.ogla.2021.12.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Revised: 12/15/2021] [Accepted: 12/16/2021] [Indexed: 12/23/2022]
Abstract
We hypothesize that artificial intelligence applied to relevant clinical testing in glaucoma has the potential to enhance the ability to detect glaucoma. This premise was discussed at the recent Collaborative Community for Ophthalmic Imaging meeting, "The Future of Artificial Intelligence-Enabled Ophthalmic Image Interpretation: Accelerating Innovation and Implementation Pathways," held virtually September 3-4, 2020. The Collaborative Community in Ophthalmic Imaging (CCOI) is an independent self-governing consortium of stakeholders with broad international representation from academic institutions, government agencies, and the private sector whose mission is to act as a forum for the purpose of helping speed innovation in healthcare technology. It was one of the first two such organizations officially designated by the FDA in September 2019 in response to their announcement of the collaborative community program as a strategic priority for 2018-2020. Further information on the CCOI can be found online at their website (https://www.cc-oi.org/about). Artificial intelligence for glaucoma diagnosis would have high utility globally, as access to care is limited in many parts of the world and half of all people with glaucoma are unaware of their illness. The application of artificial intelligence technology to glaucoma diagnosis has the potential to broadly increase access to care worldwide, in essence flattening the Earth by providing expert level evaluation to individuals even in the most remote regions of the planet.
Collapse
Affiliation(s)
- Joel S Schuman
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, USA; Departments of Biomedical Engineering and Electrical and Computer Engineering, New York University Tandon School of Engineering, Brooklyn, NY, USA; Center for Neural Science, NYU, New York, NY, USA; Neuroscience Institute, NYU Langone Health, New York, NY, USA.
| | | | - Rebecca McGee
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, USA
| | - Lama A Al-Aswad
- Department of Ophthalmology, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, USA; Department of Population Health, NYU Langone Health, NYU Grossman School of Medicine, New York, NY, USA
| | - Felipe A Medeiros
- Department of Ophthalmology, Duke University School of Medicine, Durham, NC, USA; Department of Electrical and Computer Engineering, Pratt School of Engineering, Duke University, Durham, NC, USA
| | | |
Collapse
|
11
|
Varshney T, Parthasarathy DR, Gupta V. Artificial intelligence integrated smartphone fundus camera for screening the glaucomatous optic disc. Indian J Ophthalmol 2021; 69:3787-3789. [PMID: 34827055 PMCID: PMC8837288 DOI: 10.4103/ijo.ijo_1831_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Affiliation(s)
- Toshit Varshney
- Dr. Rajendra Prasad Centre for Ophthalmic Sciences, All India Institute of Medical Sciences, New Delhi, India
| | | | - Viney Gupta
- Dr. Rajendra Prasad Centre for Ophthalmic Sciences, All India Institute of Medical Sciences, New Delhi, India
| |
Collapse
|
12
|
Schehlein EM, Yadalla D, Hutton D, Stein JD, Venkatesh R, Ehrlich JR. Detection of Posterior Segment Eye Disease in Rural Eye Camps in South India: A Nonrandomized Cluster Trial. Ophthalmol Retina 2021; 5:1107-1114. [PMID: 33476855 PMCID: PMC9744216 DOI: 10.1016/j.oret.2021.01.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2020] [Revised: 01/11/2021] [Accepted: 01/12/2021] [Indexed: 12/14/2022]
Abstract
PURPOSE Rural screening camps in India historically have focused on detection of cataract and uncorrected refractive error. This study aimed to increase detection, referral, and follow-up for posterior segment diseases (PSDs) in rural eye camps using a novel technology-driven eye camp model. DESIGN A clustered nonrandomized trial in the catchment area of Aravind Eye Care System (AECS) Pondicherry, to compare 2 eye camp models: the traditional AECS eye camp model and the novel, technology-driven, eye camp model. PARTICIPANTS Patients 40 to 75 years of age who attended free camps conducted by AECS Pondicherry. Those with corneal pathologic features were excluded because this precluded an adequate view of the posterior segment to screen for PSD. METHODS The clinical protocols in the 2 arms were standardized and the same study team was used in both study arms. The unit of allocation to the 2 study arms was at the level of the eye camp, rather than the level of the individual study participant. MAIN OUTCOME MEASURES The primary study outcome was detection of suspected PSD (glaucoma, diabetic retinopathy, age-related macular degeneration, other PSDs). Secondary outcomes included: (1) the proportion of referred participants who underwent an examination at the base hospital and (2) the proportion with confirmed PSD on examination at the base hospital. RESULTS The study included 11 traditional and 18 novel eye camps with a total of 3048 participants (50% in each study arm). The mean age of all participants was 58.4 ± 9.1 years and 1434 participants (47%) were men. The proportion receiving a referral for PSD was significantly greater in the novel (8.3%) compared with the traditional (3.6%) eye camp (P < 0.001; risk ratio, 2.31; 95% confidence interval, 2.30-2.34). Among the 183 participants referred from the camps for PSD, 73 (39.9%) followed up for further evaluation at the base hospital. CONCLUSIONS In a resource-constrained setting, use of digital fundus photography in novel eye camps resulted in increased detection of and referral for PSD. Further research is needed to determine whether this intervention is cost effective and may contribute to prevention of avoidable blindness and visual impairment in South India. Further research also is needed to improve follow-up of patients referred from camps for suspicion of PSD.
Collapse
Affiliation(s)
- Emily M. Schehlein
- Department of Ophthalmology and Visual Sciences, University of Michigan, Ann Arbor, Michigan
| | | | - David Hutton
- Department of Health Policy and Management, School of Public Health, University of Michigan, Ann Arbor, Michigan
| | - Joshua D. Stein
- Department of Ophthalmology and Visual Sciences, University of Michigan, Ann Arbor, Michigan,Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor, Michigan
| | | | - Joshua R. Ehrlich
- Department of Ophthalmology and Visual Sciences, University of Michigan, Ann Arbor, Michigan,Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor, Michigan
| |
Collapse
|
13
|
Li JPO, Liu H, Ting DSJ, Jeon S, Chan RVP, Kim JE, Sim DA, Thomas PBM, Lin H, Chen Y, Sakomoto T, Loewenstein A, Lam DSC, Pasquale LR, Wong TY, Lam LA, Ting DSW. Digital technology, tele-medicine and artificial intelligence in ophthalmology: A global perspective. Prog Retin Eye Res 2021; 82:100900. [PMID: 32898686 PMCID: PMC7474840 DOI: 10.1016/j.preteyeres.2020.100900] [Citation(s) in RCA: 201] [Impact Index Per Article: 67.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2020] [Revised: 08/25/2020] [Accepted: 08/31/2020] [Indexed: 12/29/2022]
Abstract
The simultaneous maturation of multiple digital and telecommunications technologies in 2020 has created an unprecedented opportunity for ophthalmology to adapt to new models of care using tele-health supported by digital innovations. These digital innovations include artificial intelligence (AI), 5th generation (5G) telecommunication networks and the Internet of Things (IoT), creating an inter-dependent ecosystem offering opportunities to develop new models of eye care addressing the challenges of COVID-19 and beyond. Ophthalmology has thrived in some of these areas partly due to its many image-based investigations. Tele-health and AI provide synchronous solutions to challenges facing ophthalmologists and healthcare providers worldwide. This article reviews how countries across the world have utilised these digital innovations to tackle diabetic retinopathy, retinopathy of prematurity, age-related macular degeneration, glaucoma, refractive error correction, cataract and other anterior segment disorders. The review summarises the digital strategies that countries are developing and discusses technologies that may increasingly enter the clinical workflow and processes of ophthalmologists. Furthermore as countries around the world have initiated a series of escalating containment and mitigation measures during the COVID-19 pandemic, the delivery of eye care services globally has been significantly impacted. As ophthalmic services adapt and form a "new normal", the rapid adoption of some of telehealth and digital innovation during the pandemic is also discussed. Finally, challenges for validation and clinical implementation are considered, as well as recommendations on future directions.
Collapse
Affiliation(s)
- Ji-Peng Olivia Li
- Moorfields Eye Hospital NHS Foundation Trust, London, United Kingdom
| | - Hanruo Liu
- Beijing Tongren Hospital; Capital Medical University; Beijing Institute of Ophthalmology; Beijing, China
| | - Darren S J Ting
- Academic Ophthalmology, University of Nottingham, United Kingdom
| | - Sohee Jeon
- Keye Eye Center, Seoul, Republic of Korea
| | | | - Judy E Kim
- Medical College of Wisconsin, Milwaukee, WI, USA
| | - Dawn A Sim
- NIHR Biomedical Research Centre for Ophthalmology, Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, London, United Kingdom
| | - Peter B M Thomas
- NIHR Biomedical Research Centre for Ophthalmology, Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, London, United Kingdom
| | - Haotian Lin
- Zhongshan Ophthalmic Center, State Key Laboratory of Ophthalmology, Guangzhou, China
| | - Youxin Chen
- Peking Union Medical College Hospital, Beijing, China
| | - Taiji Sakomoto
- Department of Ophthalmology, Kagoshima University Graduate School of Medical and Dental Sciences, Japan
| | | | - Dennis S C Lam
- C-MER Dennis Lam Eye Center, C-Mer International Eye Care Group Limited, Hong Kong, Hong Kong; International Eye Research Institute of the Chinese University of Hong Kong (Shenzhen), Shenzhen, China
| | - Louis R Pasquale
- Department of Ophthalmology, Icahn School of Medicine at Mount Sinai, New York, USA
| | - Tien Y Wong
- Singapore National Eye Center, Duke-NUS Medical School Singapore, Singapore
| | - Linda A Lam
- USC Roski Eye Institute, University of Southern California (USC) Keck School of Medicine, Los Angeles, CA, USA
| | - Daniel S W Ting
- Singapore National Eye Center, Duke-NUS Medical School Singapore, Singapore.
| |
Collapse
|
14
|
Upadhyaya S, Agarwal A, Rengaraj V, Srinivasan K, Newman Casey PA, Schehlein E. Validation of a portable, non-mydriatic fundus camera compared to gold standard dilated fundus examination using slit lamp biomicroscopy for assessing the optic disc for glaucoma. Eye (Lond) 2021; 36:441-447. [PMID: 33707762 PMCID: PMC7947938 DOI: 10.1038/s41433-021-01485-2] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2020] [Revised: 01/28/2021] [Accepted: 02/19/2021] [Indexed: 11/16/2022] Open
Abstract
Purpose To evaluate the sensitivity and specificity of a portable non-mydriatic fundus camera to assess the optic disc for glaucoma. Methods We conducted a single-site, cross-sectional, observational, instrument validation study. Non-mydriatic fundus photographs centred at the optic disc were obtained from 276 eyes of 68 glaucoma and 70 normal patients, using a portable fundus camera (Smartscope, Optomed, Oulu, Finland). A senior Glaucoma consultant, masked to the patient’s study participation, performed a gold standard dilated fundus examination to make the diagnosis of glaucoma. Following this, a mydriatic photograph was taken by a standard table-top fundus camera. All the images were digitalized and de-identified by an independent investigator and presented to two remote graders, masked to the patients, their diagnoses, and photographic modality. Based on individual disc characteristics, a diagnosis of screening positive or negative for glaucoma was made. In the end, the independent investigator re-identified the images. Sensitivity and specificity to detect glaucoma with the undilated Smartscope camera was calculated compared to dilated fundus examination. Results Grading remote images taken with the portable non-mydriatic fundus camera showed a sensitivity of 96.3% (95% confidence interval (CI): 91.6–98.8%) and 94.8% (95% CI: 89.7–97.9%) and a specificity of 98.5% (95% CI: 94.9–99.8%) and 97.8% (95% CI: 93.9–99.6%) for the two graders respectively as compared to gold standard dilated fundus examination. Conclusion The non-mydriatic Smartscope fundus images have high sensitivity and specificity for diagnosing glaucoma remotely and thus may be an effective tool for use in community outreach programs.
Collapse
Affiliation(s)
- Swati Upadhyaya
- Aravind Eye Hospital and Post Graduate Institute of Ophthalmology, Pondicherry, India.
| | - Anushri Agarwal
- Aravind Eye Hospital and Post Graduate Institute of Ophthalmology, Pondicherry, India
| | - Venkatesh Rengaraj
- Aravind Eye Hospital and Post Graduate Institute of Ophthalmology, Pondicherry, India
| | - Kavitha Srinivasan
- Aravind Eye Hospital and Post Graduate Institute of Ophthalmology, Pondicherry, India
| | | | - Emily Schehlein
- Kellogg Eye Center, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
15
|
Comparison of vertical cup-to-disc ratio estimates using stereoscopic and monoscopic cameras. Eye (Lond) 2021; 35:3318-3324. [PMID: 33514892 DOI: 10.1038/s41433-021-01395-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2020] [Revised: 12/09/2020] [Accepted: 01/06/2021] [Indexed: 11/08/2022] Open
Abstract
BACKGROUND The use of monoscopic cameras for glaucoma screening is increasing due to their portability, lower cost, and non-mydriatic capabilities. However, it is important to compare the accuracy of such devices with stereoscopic cameras that are used clinically and are considered the gold standard in optic disc assessment. The aim of this study is to compare vertical cup-to-disc ratio (VCDR) estimates obtained using images taken with a monoscopic and stereoscopic camera. METHODS Participants were selected from the Tema Eye Survey. Eligible subjects had images of at least one eye taken with two cameras. They were classified as meeting the glaucoma threshold if an eye had a VCDR estimate >97.5th percentile, corresponding to >0.725 for this population. Hence, we used 0.725 as the cutoff to group eyes into two categories: positive and negative. We calculated sensitivity, specificity, and predictive values of VCDR assessed by expert readers at a reading center for monoscopic photos using stereoscopic photos as the gold standard. RESULTS Three hundred and seventy-nine eyes of 206 participants were included in the study. Most participants were female (60.2%) and the most common age group was 50-59 years (36.4%). Sixteen eyes met the glaucoma threshold (VCDR > 0.725). Of these, the VCDR estimates of 14 eyes (87.5%) disagreed on the glaucoma threshold from the two cameras. The sensitivity to detect glaucoma with the monoscopic camera was 14.3% (95% CI: 4.0, 40.3). CONCLUSIONS The low sensitivity of monoscopic photos suggests that stereoscopic photos are more useful in the diagnosis of glaucoma.
Collapse
|
16
|
Mirzania D, Thompson AC, Muir KW. Applications of deep learning in detection of glaucoma: A systematic review. Eur J Ophthalmol 2020; 31:1618-1642. [PMID: 33274641 DOI: 10.1177/1120672120977346] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
Glaucoma is the leading cause of irreversible blindness and disability worldwide. Nevertheless, the majority of patients do not know they have the disease and detection of glaucoma progression using standard technology remains a challenge in clinical practice. Artificial intelligence (AI) is an expanding field that offers the potential to improve diagnosis and screening for glaucoma with minimal reliance on human input. Deep learning (DL) algorithms have risen to the forefront of AI by providing nearly human-level performance, at times exceeding the performance of humans for detection of glaucoma on structural and functional tests. A succinct summary of present studies and challenges to be addressed in this field is needed. Following PRISMA guidelines, we conducted a systematic review of studies that applied DL methods for detection of glaucoma using color fundus photographs, optical coherence tomography (OCT), or standard automated perimetry (SAP). In this review article we describe recent advances in DL as applied to the diagnosis of glaucoma and glaucoma progression for application in screening and clinical settings, as well as the challenges that remain when applying this novel technique in glaucoma.
Collapse
Affiliation(s)
| | - Atalie C Thompson
- Duke University School of Medicine, Durham, NC, USA.,Durham VA Medical Center, Durham, NC, USA
| | - Kelly W Muir
- Duke University School of Medicine, Durham, NC, USA.,Durham VA Medical Center, Durham, NC, USA
| |
Collapse
|
17
|
A Review on the optic disc and optic cup segmentation and classification approaches over retinal fundus images for detection of glaucoma. SN APPLIED SCIENCES 2020. [DOI: 10.1007/s42452-020-03221-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023] Open
|
18
|
Thompson AC, Jammal AA, Medeiros FA. A Review of Deep Learning for Screening, Diagnosis, and Detection of Glaucoma Progression. Transl Vis Sci Technol 2020; 9:42. [PMID: 32855846 PMCID: PMC7424906 DOI: 10.1167/tvst.9.2.42] [Citation(s) in RCA: 64] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2020] [Accepted: 05/21/2020] [Indexed: 12/23/2022] Open
Abstract
Because of recent advances in computing technology and the availability of large datasets, deep learning has risen to the forefront of artificial intelligence, with performances that often equal, or sometimes even exceed, those of human subjects on a variety of tasks, especially those related to image classification and pattern recognition. As one of the medical fields that is highly dependent on ancillary imaging tests, ophthalmology has been in a prime position to witness the application of deep learning algorithms that can help analyze the vast amount of data coming from those tests. In particular, glaucoma stands as one of the conditions where application of deep learning algorithms could potentially lead to better use of the vast amount of information coming from structural and functional tests evaluating the optic nerve and macula. The purpose of this article is to critically review recent applications of deep learning models in glaucoma, discussing their advantages but also focusing on the challenges inherent to the development of such models for screening, diagnosis and detection of progression. After a brief general overview of deep learning and how it compares to traditional machine learning classifiers, we discuss issues related to the training and validation of deep learning models and how they specifically apply to glaucoma. We then discuss specific scenarios where deep learning has been proposed for use in glaucoma, such as screening with fundus photography, and diagnosis and detection of glaucoma progression with optical coherence tomography and standard automated perimetry. Translational Relevance Deep learning algorithms have the potential to significantly improve diagnostic capabilities in glaucoma, but their application in clinical practice requires careful validation, with consideration of the target population, the reference standards used to build the models, and potential sources of bias.
Collapse
Affiliation(s)
- Atalie C Thompson
- Vision, Imaging and Performance Laboratory (VIP), Duke Eye Center, Duke University, Durham, NC, USA
| | - Alessandro A Jammal
- Vision, Imaging and Performance Laboratory (VIP), Duke Eye Center, Duke University, Durham, NC, USA
| | - Felipe A Medeiros
- Vision, Imaging and Performance Laboratory (VIP), Duke Eye Center, Duke University, Durham, NC, USA
| |
Collapse
|
19
|
|
20
|
Li F, Yan L, Wang Y, Shi J, Chen H, Zhang X, Jiang M, Wu Z, Zhou K. Deep learning-based automated detection of glaucomatous optic neuropathy on color fundus photographs. Graefes Arch Clin Exp Ophthalmol 2020; 258:851-867. [PMID: 31989285 DOI: 10.1007/s00417-020-04609-8] [Citation(s) in RCA: 34] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2019] [Revised: 12/09/2019] [Accepted: 01/20/2020] [Indexed: 01/08/2023] Open
Abstract
PURPOSE To develop a deep learning approach based on deep residual neural network (ResNet101) for the automated detection of glaucomatous optic neuropathy (GON) using color fundus images, understand the process by which the model makes predictions, and explore the effect of the integration of fundus images and the medical history data from patients. METHODS A total of 34,279 fundus images and the corresponding medical history data were retrospectively collected from cohorts of 2371 adult patients, and these images were labeled by 8 glaucoma experts, in which 26,585 fundus images (12,618 images with GON-confirmed eyes, 1114 images with GON-suspected eyes, and 12,853 NORMAL eye images) were included. We adopted 10-fold cross-validation strategy to train and optimize our model. This model was tested in an independent testing dataset consisting of 3481 images (1524 images from NORMAL eyes, 1442 images from GON-confirmed eyes, and 515 images from GON-suspected eyes) from 249 patients. Moreover, the performance of the best model was compared with results obtained by two experts. Accuracy, sensitivity, specificity, kappa value, and area under receiver operating characteristic (AUC) were calculated. Further, we performed qualitative evaluation of model predictions and occlusion testing. Finally, we assessed the effect of integrating medical history data in the final classification. RESULTS In a multiclass comparison between GON-confirmed eyes, GON-suspected eyes and NORMAL eyes, our model achieved 0.941 (95% confidence interval [CI], 0.936-0.946) accuracy, 0.957 (95% CI, 0.953-0.961) sensitivity, and 0.929 (95% CI, 0.923-0.935) specificity. The AUC distinguishing referrals (GON-confirmed and GON-suspected eyes) from observation was 0.992 (95% CI, 0.991-0.993). Our best model had a kappa value of 0.927, while the two experts' kappa values were 0.928 and 0.925 independently. The best 2 binary classifiers distinguishing GON-confirmed/GON-suspected eyes from NORMAL eyes obtained 0.955, 0.965 accuracy, 0.977, 0.998 sensitivity, and 0.929, 0.954 specificity, while the AUC was 0.992, 0.999 respectively. Additionally, the occlusion testing showed that our model identified the neuroretinal rim region, retinal nerve fiber layer (RNFL) defect areas (superior or inferior) as the most important parts for the discrimination of GON, which evaluated fundus images in a way similar to clinicians. Finally, the results of integration of fundus images with medical history data showed a slight improvement in sensitivity and specificity with similar AUCs. CONCLUSIONS This approach could discriminate GON with high accuracy, sensitivity, specificity, and AUC using color fundus photographs. It may provide a second opinion on the diagnosis of glaucoma to the specialist quickly, efficiently and at low cost, and assist doctors and the public in large-scale screening for glaucoma.
Collapse
Affiliation(s)
- Feng Li
- School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Lei Yan
- School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Yuguang Wang
- School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Jianxun Shi
- School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Hua Chen
- School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Xuedian Zhang
- School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Minshan Jiang
- School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China.
| | - Zhizheng Wu
- Department of Precision Mechanical Engineering, Shanghai University, Shanghai, 200072, China
| | - Kaiqian Zhou
- Liver Cancer Institute, Zhongshan Hospital, Shanghai, 200032, China
| |
Collapse
|
21
|
Thompson AC, Jammal AA, Medeiros FA. A Deep Learning Algorithm to Quantify Neuroretinal Rim Loss From Optic Disc Photographs. Am J Ophthalmol 2019; 201:9-18. [PMID: 30689990 DOI: 10.1016/j.ajo.2019.01.011] [Citation(s) in RCA: 49] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2018] [Revised: 01/11/2019] [Accepted: 01/17/2019] [Indexed: 01/29/2023]
Abstract
PURPOSE To train a deep learning (DL) algorithm that quantifies glaucomatous neuroretinal damage on fundus photographs using the minimum rim width relative to Bruch membrane opening (BMO-MRW) from spectral-domain optical coherence tomography (SDOCT). DESIGN Cross-sectional study. METHODS A total of 9282 pairs of optic disc photographs and SDOCT optic nerve head scans from 927 eyes of 490 subjects were randomly divided into the validation plus training (80%) and test sets (20%). A DL convolutional neural network was trained to predict the SDOCT BMO-MRW global and sector values when evaluating optic disc photographs. The predictions of the DL network were compared to the actual SDOCT measurements. The area under the receiver operating curve (AUC) was used to evaluate the ability of the network to discriminate glaucomatous visual field loss from normal eyes. RESULTS The DL predictions of global BMO-MRW from all optic disc photographs in the test set (mean ± standard deviation [SD]: 228.8 ± 63.1 μm) were highly correlated with the observed values from SDOCT (mean ± SD: 226.0 ± 73.8 μm) (Pearson's r = 0.88; R2 = 77%; P < .001), with mean absolute error of the predictions of 27.8 μm. The AUCs for discriminating glaucomatous from healthy eyes with the DL predictions and actual SDOCT global BMO-MRW measurements were 0.945 (95% confidence interval [CI]: 0.874-0.980) and 0.933 (95% CI: 0.856-0.975), respectively (P = .587). CONCLUSIONS A DL network can be trained to quantify the amount of neuroretinal damage on optic disc photographs using SDOCT BMO-MRW as a reference. This algorithm showed high accuracy for glaucoma detection, and may potentially eliminate the need for human gradings of disc photographs.
Collapse
|
22
|
MacCormick IJC, Williams BM, Zheng Y, Li K, Al-Bander B, Czanner S, Cheeseman R, Willoughby CE, Brown EN, Spaeth GL, Czanner G. Accurate, fast, data efficient and interpretable glaucoma diagnosis with automated spatial analysis of the whole cup to disc profile. PLoS One 2019; 14:e0209409. [PMID: 30629635 PMCID: PMC6328156 DOI: 10.1371/journal.pone.0209409] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2018] [Accepted: 12/05/2018] [Indexed: 11/25/2022] Open
Abstract
Background Glaucoma is the leading cause of irreversible blindness worldwide. It is a heterogeneous group of conditions with a common optic neuropathy and associated loss of peripheral vision. Both over and under-diagnosis carry high costs in terms of healthcare spending and preventable blindness. The characteristic clinical feature of glaucoma is asymmetrical optic nerve rim narrowing, which is difficult for humans to quantify reliably. Strategies to improve and automate optic disc assessment are therefore needed to prevent sight loss. Methods We developed a novel glaucoma detection algorithm that segments and analyses colour photographs to quantify optic nerve rim consistency around the whole disc at 15-degree intervals. This provides a profile of the cup/disc ratio, in contrast to the vertical cup/disc ratio in common use. We introduce a spatial probabilistic model, to account for the optic nerve shape, we then use this model to derive a disc deformation index and a decision rule for glaucoma. We tested our algorithm on two separate image datasets (ORIGA and RIM-ONE). Results The spatial algorithm accurately distinguished glaucomatous and healthy discs on internal and external validation (AUROC 99.6% and 91.0% respectively). It achieves this using a dataset 100-times smaller than that required for deep learning algorithms, is flexible to the type of cup and disc segmentation (automated or semi-automated), utilises images with missing data, and is correlated with the disc size (p = 0.02) and the rim-to-disc at the narrowest rim (p<0.001, in external validation). Discussion The spatial probabilistic algorithm is highly accurate, highly data efficient and it extends to any imaging hardware in which the boundaries of cup and disc can be segmented, thus making the algorithm particularly applicable to research into disease mechanisms, and also glaucoma screening in low resource settings.
Collapse
Affiliation(s)
- Ian J. C. MacCormick
- Department of Eye & Vision Science, Institute of Ageing and Chronic Disease, University of Liverpool, Liverpool, United Kingdom
- Centre for Clinical Brain Sciences, University of Edinburgh, Chancellor's Building, Edinburgh, United Kingdom
| | - Bryan M. Williams
- Department of Eye & Vision Science, Institute of Ageing and Chronic Disease, University of Liverpool, Liverpool, United Kingdom
| | - Yalin Zheng
- Department of Eye & Vision Science, Institute of Ageing and Chronic Disease, University of Liverpool, Liverpool, United Kingdom
- St Paul’s Eye Unit, Royal Liverpool University Hospitals NHS Trust, Liverpool, United Kingdom
| | - Kun Li
- Medical Information Engineering Department, Taishan Medical School, TaiAn City, ShanDong Province, China
| | - Baidaa Al-Bander
- Department of Electrical Engineering and Electronics, University of Liverpool, Brownlow Hill, Liverpool, United Kingdom
| | - Silvester Czanner
- School of Computing, Mathematics and Digital Technology, Faculty of Science and Engineering, Manchester Metropolitan University, Manchester, Manchester, United Kingdom
| | - Rob Cheeseman
- St Paul’s Eye Unit, Royal Liverpool University Hospitals NHS Trust, Liverpool, United Kingdom
| | - Colin E. Willoughby
- Biomedical Sciences Research Institute, Faculty of Life & Health Sciences, Ulster University, Coleraine, Northern Ireland
- Department of Ophthalmology, Royal Victoria Hospital, Belfast, Northern Ireland
| | - Emery N. Brown
- Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America
- Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, United States of America
| | - George L. Spaeth
- Glaucoma Research Center, Wills Eye Hospital, Philadelphia, Pennsylvania, United States of America
| | - Gabriela Czanner
- Department of Eye & Vision Science, Institute of Ageing and Chronic Disease, University of Liverpool, Liverpool, United Kingdom
- St Paul’s Eye Unit, Royal Liverpool University Hospitals NHS Trust, Liverpool, United Kingdom
- Department of Applied Mathematics, Faculty of Engineering and Technology, Liverpool John Moores University, Liverpool, United Kingdom
- * E-mail:
| |
Collapse
|
23
|
Christopher M, Belghith A, Bowd C, Proudfoot JA, Goldbaum MH, Weinreb RN, Girkin CA, Liebmann JM, Zangwill LM. Performance of Deep Learning Architectures and Transfer Learning for Detecting Glaucomatous Optic Neuropathy in Fundus Photographs. Sci Rep 2018; 8:16685. [PMID: 30420630 PMCID: PMC6232132 DOI: 10.1038/s41598-018-35044-9] [Citation(s) in RCA: 146] [Impact Index Per Article: 24.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2018] [Accepted: 10/29/2018] [Indexed: 12/27/2022] Open
Abstract
The ability of deep learning architectures to identify glaucomatous optic neuropathy (GON) in fundus photographs was evaluated. A large database of fundus photographs (n = 14,822) from a racially and ethnically diverse group of individuals (over 33% of African descent) was evaluated by expert reviewers and classified as GON or healthy. Several deep learning architectures and the impact of transfer learning were evaluated. The best performing model achieved an overall area under receiver operating characteristic (AUC) of 0.91 in distinguishing GON eyes from healthy eyes. It also achieved an AUC of 0.97 for identifying GON eyes with moderate-to-severe functional loss and 0.89 for GON eyes with mild functional loss. A sensitivity of 88% at a set 95% specificity was achieved in detecting moderate-to-severe GON. In all cases, transfer improved performance and reduced training time. Model visualizations indicate that these deep learning models relied on, in part, anatomical features in the inferior and superior regions of the optic disc, areas commonly used by clinicians to diagnose GON. The results suggest that deep learning-based assessment of fundus images could be useful in clinical decision support systems and in the automation of large-scale glaucoma detection and screening programs.
Collapse
Affiliation(s)
- Mark Christopher
- Hamilton Glaucoma Center, Shiley Eye Institute, Department of Ophthalmology, UC San Diego, La Jolla, CA, United States
| | - Akram Belghith
- Hamilton Glaucoma Center, Shiley Eye Institute, Department of Ophthalmology, UC San Diego, La Jolla, CA, United States
| | - Christopher Bowd
- Hamilton Glaucoma Center, Shiley Eye Institute, Department of Ophthalmology, UC San Diego, La Jolla, CA, United States
| | - James A Proudfoot
- Hamilton Glaucoma Center, Shiley Eye Institute, Department of Ophthalmology, UC San Diego, La Jolla, CA, United States
| | - Michael H Goldbaum
- Hamilton Glaucoma Center, Shiley Eye Institute, Department of Ophthalmology, UC San Diego, La Jolla, CA, United States
| | - Robert N Weinreb
- Hamilton Glaucoma Center, Shiley Eye Institute, Department of Ophthalmology, UC San Diego, La Jolla, CA, United States
| | - Christopher A Girkin
- School of Medicine, University of Alabama-Birmingham, Birmingham, AL, United States
| | - Jeffrey M Liebmann
- Bernard and Shirlee Brown Glaucoma Research Laboratory, Edward S. Harkness Eye Institute, Department of Ophthalmology, Columbia University Medical Center, New York, NY, United States
| | - Linda M Zangwill
- Hamilton Glaucoma Center, Shiley Eye Institute, Department of Ophthalmology, UC San Diego, La Jolla, CA, United States.
| |
Collapse
|
24
|
Li Z, He Y, Keel S, Meng W, Chang RT, He M. Efficacy of a Deep Learning System for Detecting Glaucomatous Optic Neuropathy Based on Color Fundus Photographs. Ophthalmology 2018; 125:1199-1206. [PMID: 29506863 DOI: 10.1016/j.ophtha.2018.01.023] [Citation(s) in RCA: 399] [Impact Index Per Article: 66.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2017] [Revised: 01/10/2018] [Accepted: 01/18/2018] [Indexed: 12/15/2022] Open
Abstract
PURPOSE To assess the performance of a deep learning algorithm for detecting referable glaucomatous optic neuropathy (GON) based on color fundus photographs. DESIGN A deep learning system for the classification of GON was developed for automated classification of GON on color fundus photographs. PARTICIPANTS We retrospectively included 48 116 fundus photographs for the development and validation of a deep learning algorithm. METHODS This study recruited 21 trained ophthalmologists to classify the photographs. Referable GON was defined as vertical cup-to-disc ratio of 0.7 or more and other typical changes of GON. The reference standard was made until 3 graders achieved agreement. A separate validation dataset of 8000 fully gradable fundus photographs was used to assess the performance of this algorithm. MAIN OUTCOME MEASURES The area under receiver operator characteristic curve (AUC) with sensitivity and specificity was applied to evaluate the efficacy of the deep learning algorithm detecting referable GON. RESULTS In the validation dataset, this deep learning system achieved an AUC of 0.986 with sensitivity of 95.6% and specificity of 92.0%. The most common reasons for false-negative grading (n = 87) were GON with coexisting eye conditions (n = 44 [50.6%]), including pathologic or high myopia (n = 37 [42.6%]), diabetic retinopathy (n = 4 [4.6%]), and age-related macular degeneration (n = 3 [3.4%]). The leading reason for false-positive results (n = 480) was having other eye conditions (n = 458 [95.4%]), mainly including physiologic cupping (n = 267 [55.6%]). Misclassification as false-positive results amidst a normal-appearing fundus occurred in only 22 eyes (4.6%). CONCLUSIONS A deep learning system can detect referable GON with high sensitivity and specificity. Coexistence of high or pathologic myopia is the most common cause resulting in false-negative results. Physiologic cupping and pathologic myopia were the most common reasons for false-positive results.
Collapse
Affiliation(s)
- Zhixi Li
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou 510060, China
| | - Yifan He
- Guangzhou Healgoo Interactive Medical Technology Co. Ltd., Guangzhou, China
| | - Stuart Keel
- Centre for Eye Research Australia; Departments of Ophthalmology and Surgery, University of Melbourne, Melbourne, Australia
| | - Wei Meng
- Guangzhou Healgoo Interactive Medical Technology Co. Ltd., Guangzhou, China
| | - Robert T Chang
- Department of Ophthalmology, Byers Eye Institute, Stanford University, Palo Alto, California
| | - Mingguang He
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou 510060, China; Centre for Eye Research Australia; Departments of Ophthalmology and Surgery, University of Melbourne, Melbourne, Australia.
| |
Collapse
|
25
|
Myers JS, Fudemberg SJ, Lee D. Evolution of optic nerve photography for glaucoma screening: a review. Clin Exp Ophthalmol 2018; 46:169-176. [PMID: 29280542 DOI: 10.1111/ceo.13138] [Citation(s) in RCA: 33] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2017] [Revised: 11/27/2017] [Accepted: 12/20/2017] [Indexed: 11/29/2022]
Abstract
Visual evaluation of the optic nerve has been one of the earliest and most widely used methods to evaluate patients for glaucoma. Photography has proven very useful for documentation of the nerve's appearance at a given time, allowing more detailed scrutiny then, and later comparison for change. Photography serves as the basis for real-time or non-simultaneous review in telemedicine and screening events allowing fundus and optic nerve evaluation by experts elsewhere. Expert evaluation of disc photographs has shown diagnostic performance similar to other methods of optic nerve evaluation for glaucoma. Newer technology has made optic nerve photography simpler, cheaper and more portable creating opportunities for broader utilization in screening in underserved populations by non-physicians. Recent investigations suggest that non-physicians or software algorithms for disc photograph evaluation have promise to allow more screening to be done with fewer experts.
Collapse
Affiliation(s)
- Jonathan S Myers
- Glaucoma Service, Wills Eye Hospital, Philadelphia, Pennsylvania, USA
| | - Scott J Fudemberg
- Glaucoma Service, Wills Eye Hospital, Philadelphia, Pennsylvania, USA
| | - Daniel Lee
- Glaucoma Service, Wills Eye Hospital, Philadelphia, Pennsylvania, USA
| |
Collapse
|