1
|
Yang Z, Wang D, Zhou F, Song D, Zhang Y, Jiang J, Kong K, Liu X, Qiao Y, Chang RT, Han Y, Li F, Tham CC, Zhang X. Understanding Natural Language: Potential Application of Large Language Models to Ophthalmology. Asia Pac J Ophthalmol (Phila) 2024:100085. [PMID: 39059558 DOI: 10.1016/j.apjo.2024.100085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2024] [Revised: 06/19/2024] [Accepted: 07/19/2024] [Indexed: 07/28/2024] Open
Abstract
Large language models (LLMs), a natural language processing technology based on deep learning, are currently in the spotlight. These models closely mimic natural language comprehension and generation. Their evolution has undergone several waves of innovation similar to convolutional neural networks. The transformer architecture advancement in generative artificial intelligence marks a monumental leap beyond early-stage pattern recognition via supervised learning. With the expansion of parameters and training data (terabytes), LLMs unveil remarkable human interactivity, encompassing capabilities such as memory retention and comprehension. These advances make LLMs particularly well-suited for roles in healthcare communication between medical practitioners and patients. In this comprehensive review we discuss the trajectory of LLMs and potential implications for clinicians and patients. For clinicians, LLMs can be used for automated medical documentation, and given better inputs and extensive validation, LLMs may be able to autonomously diagnose and treat in the future. For patient care, LLMs can be used for triage suggestions, summarization of medical documents, explanation of a patient's condition, and customizing patient education materials tailored to their comprehension level. The limitations of LLM and possible solutions for real world use are also presented. Given the rapid advancements in this area, this review attempts to briefly cover many roles that LLMs may play in the ophthalmic space, with a focus on improving the quality of healthcare delivery.
Collapse
Affiliation(s)
- Zefeng Yang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-Sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China
| | - Deming Wang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-Sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China
| | - Fengqi Zhou
- Ophthalmology, Mayo Clinic Health System, Eau Claire, Wisconsin, USA
| | - Diping Song
- Shanghai Artificial Intelligence Laboratory, Shanghai, China; ShenZhen Key Lab of Computer Vision and Pattern Recognition, Shenzhen Institutes of Advanced Technology, The Chinese Academy of Sciences, Shenzhen, China
| | - Yinhang Zhang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-Sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China
| | - Jiaxuan Jiang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-Sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China
| | - Kangjie Kong
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-Sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China
| | - Xiaoyi Liu
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-Sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China
| | - Yu Qiao
- Shanghai Artificial Intelligence Laboratory, Shanghai, China; ShenZhen Key Lab of Computer Vision and Pattern Recognition, Shenzhen Institutes of Advanced Technology, The Chinese Academy of Sciences, Shenzhen, China
| | - Robert T Chang
- Department of Ophthalmology, Byers Eye Institute at Stanford University, Palo Alto, CA, USA
| | - Ying Han
- Department of Ophthalmology, University of California, San Francisco, San Francisco, CA, USA
| | - Fei Li
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-Sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China.
| | - Clement C Tham
- Department of Ophthalmology and Visual Sciences, The Chinese University of Hong Kong, Hong Kong SAR, China; Hong Kong Eye Hospital, Kowloon, Hong Kong SAR, China; Department of Ophthalmology and Visual Sciences, Prince of Wales Hospital, Shatin, Hong Kong SAR, China.
| | - Xiulan Zhang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-Sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China.
| |
Collapse
|
2
|
Rambabu L, Smith BG, Tumpa S, Kohler K, Kolias AG, Hutchinson PJ, Bashford T. Artificial intelligence-enabled ophthalmoscopy for papilledema: a systematic review protocol. Int J Surg Protoc 2024; 28:27-30. [PMID: 38433865 PMCID: PMC10905490 DOI: 10.1097/sp9.0000000000000016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Accepted: 06/24/2023] [Indexed: 03/05/2024] Open
Abstract
Papilledema is a pathology delineated by the swelling of the optic disc secondary to raised intracranial pressure (ICP). Diagnosis by ophthalmoscopy can be useful in the timely stratification of further investigations, such as magnetic resonance imaging or computed tomography to rule out pathologies associated with raised ICP. In resource-limited settings, in particular, access to trained specialists or radiological imaging may not always be readily available, and accurate fundoscopy-based identification of papilledema could be a useful tool for triage and escalation to tertiary care centres. Artificial intelligence (AI) has seen a rise in neuro-ophthalmology research in recent years, but there are many barriers to the translation of AI to clinical practice. The objective of this systematic review is to garner and present a comprehensive overview of the existing evidence on the application of AI in ophthalmoscopy for papilledema, and to provide a valuable perspective on this emerging field that sits at the intersection of clinical medicine and computer science, highlighting possible avenues for future research in this domain.
Collapse
Affiliation(s)
- Lekaashree Rambabu
- University of Leicester, Leicester
- NIHR Global Health Research Group on Acquired Brain and Spine Injury
| | - Brandon G. Smith
- NIHR Global Health Research Group on Acquired Brain and Spine Injury
- Engineering Design Centre, Department of Engineering, University of Cambridge, Cambridge
| | - Stasa Tumpa
- NIHR Global Health Research Group on Acquired Brain and Spine Injury
- West Suffolk NHS Foundation Trust, Bury Saint Edmunds, Suffolk
| | - Katharina Kohler
- NIHR Global Health Research Group on Acquired Brain and Spine Injury
- Engineering Design Centre, Department of Engineering, University of Cambridge, Cambridge
- Division of Anaesthesia, Addenbrooke’s Hospital, Cambridge
| | - Angelos G. Kolias
- NIHR Global Health Research Group on Acquired Brain and Spine Injury
- Division of Academic Neurosurgery, Addenbrooke’s Hospital, Cambridge, UK
| | - Peter J. Hutchinson
- NIHR Global Health Research Group on Acquired Brain and Spine Injury
- Division of Academic Neurosurgery, Addenbrooke’s Hospital, Cambridge, UK
| | - Tom Bashford
- NIHR Global Health Research Group on Acquired Brain and Spine Injury
- Engineering Design Centre, Department of Engineering, University of Cambridge, Cambridge
- Division of Anaesthesia, Addenbrooke’s Hospital, Cambridge
| |
Collapse
|
3
|
Costello F, Hamann S. Advantages and Pitfalls of the Use of Optical Coherence Tomography for Papilledema. Curr Neurol Neurosci Rep 2024; 24:55-64. [PMID: 38261144 DOI: 10.1007/s11910-023-01327-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/11/2023] [Indexed: 01/24/2024]
Abstract
PURPOSE OF REVIEW Papilledema refers to optic disc swelling caused by raised intracranial pressure. This syndrome arises from numerous potential causes, which may pose varying degrees of threat to patients. Manifestations of papilledema range from mild to severe, and early diagnosis is important to prevent vision loss and other deleterious outcomes. The purpose of this review is to highlight the role of optical coherence tomography (OCT) in the diagnosis and management of syndromes of raised intracranial pressure associated with papilledema. RECENT FINDINGS Ophthalmoscopy is an unreliable skill for many clinicians. Optical coherence tomography is a non-invasive ocular imaging technique which may fill a current care gap, by facilitating detection of papilledema for those who cannot perform a detailed fundus examination. Optical coherence tomography may help confirm the presence of papilledema, by detecting subclinical peripapillary retinal nerve fiber layer (pRNFL) thickening that might otherwise be missed with ophthalmoscopy. Enhanced depth imaging (EDI) and swept source OCT techniques may identify optic disc drusen as cause of pseudo-papilledema. Macular ganglion cell inner plexiform layer (mGCIPL) values may provide early signs of neuroaxonal injury in patients with papilledema and inform management for patients with syndromes of raised intracranial pressure. There are well-established advantages and disadvantages of OCT that need to be fully understood to best utilize this method for the detection of papilledema. Overall, OCT may complement other existing tools by facilitating detection of papilledema and tracking response to therapies. Moving forward, OCT findings may be included in deep learning models to diagnose papilledema.
Collapse
Affiliation(s)
- Fiona Costello
- Department of Clinical Neurosciences, Cumming School of Medicine, University of Calgary, Alberta, Canada.
- Department of Surgery, Cumming School of Medicine, University of Calgary, Alberta, Canada.
| | - Steffen Hamann
- Department of Ophthalmology, Rigshospitalet, University of Copenhagen, Glostrup, Denmark
| |
Collapse
|
4
|
Zhang X, Jiang J, Kong K, Li F, Chen S, Wang P, Song Y, Lin F, Lin TPH, Zangwill LM, Ohno-Matsui K, Jonas JB, Weinreb RN, Lam DSC. Optic neuropathy in high myopia: Glaucoma or high myopia or both? Prog Retin Eye Res 2024; 99:101246. [PMID: 38262557 DOI: 10.1016/j.preteyeres.2024.101246] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Revised: 01/17/2024] [Accepted: 01/19/2024] [Indexed: 01/25/2024]
Abstract
Due to the increasing prevalence of high myopia around the world, structural and functional damages to the optic nerve in high myopia has recently attracted much attention. Evidence has shown that high myopia is related to the development of glaucomatous or glaucoma-like optic neuropathy, and that both have many common features. These similarities often pose a diagnostic challenge that will affect the future management of glaucoma suspects in high myopia. In this review, we summarize similarities and differences in optic neuropathy arising from non-pathologic high myopia and glaucoma by considering their respective structural and functional characteristics on fundus photography, optical coherence tomography scanning, and visual field tests. These features may also help to distinguish the underlying mechanisms of the optic neuropathies and to determine management strategies for patients with high myopia and glaucoma.
Collapse
Affiliation(s)
- Xiulan Zhang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, 510060, China.
| | - Jingwen Jiang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, 510060, China.
| | - Kangjie Kong
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, 510060, China.
| | - Fei Li
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, 510060, China.
| | - Shida Chen
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, 510060, China.
| | - Peiyuan Wang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, 510060, China.
| | - Yunhe Song
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, 510060, China.
| | - Fengbin Lin
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, 510060, China.
| | - Timothy P H Lin
- Department of Ophthalmology and Visual Sciences, The Chinese University of Hong Kong, Hong Kong, China.
| | - Linda M Zangwill
- Hamilton Glaucoma Center, Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, La Jolla, CA, USA.
| | - Kyoko Ohno-Matsui
- Department of Ophthalmology and Visual Science, Tokyo Medical and Dental University, Tokyo, Japan.
| | - Jost B Jonas
- Department of Ophthalmology, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany; Institute of Molecular and Clinical Ophthalmology, Basel, Switzerland.
| | - Robert N Weinreb
- Hamilton Glaucoma Center, Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, La Jolla, CA, USA.
| | - Dennis S C Lam
- The International Eye Research Institute of the Chinese University of Hong Kong (Shenzhen), Shenzhen, China; The C-MER Dennis Lam & Partners Eye Center, C-MER International Eye Care Group, Hong Kong, China.
| |
Collapse
|
5
|
Wang JK(R, Linton EF, Johnson BA, Kupersmith MJ, Garvin MK, Kardon RH. Visualization of Optic Nerve Structural Patterns in Papilledema Using Deep Learning Variational Autoencoders. Transl Vis Sci Technol 2024; 13:13. [PMID: 38231498 PMCID: PMC10795546 DOI: 10.1167/tvst.13.1.13] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Accepted: 11/27/2023] [Indexed: 01/18/2024] Open
Abstract
Purpose To visualize and quantify structural patterns of optic nerve edema encountered in papilledema during treatment. Methods A novel bi-channel deep-learning variational autoencoder (biVAE) model was trained using 1498 optical coherence tomography (OCT) scans of 125 subjects over time from the Idiopathic Intracranial Hypertension Treatment Trial (IIHTT) and 791 OCT scans of 96 control subjects from the University of Iowa. An independent test dataset of 70 eyes from 70 papilledema subjects was used to evaluate the ability of the biVAE model to quantify and reconstruct the papilledema spatial patterns from input OCT scans using only two variables. Results The montage color maps of the retinal nerve fiber layer (RNFL) and total retinal thickness (TRT) produced by the biVAE model provided an organized visualization of the variety of morphological patterns of optic disc edema (including differing patterns at similar thickness levels). Treatment effects of acetazolamide versus placebo in the IIHTT were also demonstrated in the latent space. In image reconstruction, the mean signed peripapillary retinal nerve fiber layer thickness (pRNFLT) difference ± SD was -0.12 ± 17.34 µm, the absolute pRNFLT difference was 13.68 ± 10.65 µm, and the RNFL structural similarity index reached 0.91 ± 0.05. Conclusions A wide array of structural patterns of papilledema, integrating the magnitude of disc edema with underlying disc and retinal morphology, can be quantified by just two latent variables. Translational Relevance A biVAE model encodes structural patterns, as well as the correlation between channels, and may be applied to visualize individuals or populations with papilledema throughout treatment.
Collapse
Affiliation(s)
- Jui-Kai (Ray) Wang
- Center for the Prevention and Treatment of Visual Loss, Iowa City VA Health Care System, Iowa City, IA, USA
- Department of Ophthalmology and Visual Sciences, The University of Iowa Hospitals & Clinics, Iowa City, IA, USA
- Department of Electrical and Computer Engineering, The University of Iowa, Iowa City, IA, USA
| | - Edward F. Linton
- Center for the Prevention and Treatment of Visual Loss, Iowa City VA Health Care System, Iowa City, IA, USA
- Department of Ophthalmology and Visual Sciences, The University of Iowa Hospitals & Clinics, Iowa City, IA, USA
| | - Brett A. Johnson
- Department of Ophthalmology and Visual Sciences, The University of Iowa Hospitals & Clinics, Iowa City, IA, USA
| | - Mark J. Kupersmith
- Departments of Neurology, Neurosurgery and Ophthalmology, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Mona K. Garvin
- Center for the Prevention and Treatment of Visual Loss, Iowa City VA Health Care System, Iowa City, IA, USA
- Department of Electrical and Computer Engineering, The University of Iowa, Iowa City, IA, USA
| | - Randy H. Kardon
- Center for the Prevention and Treatment of Visual Loss, Iowa City VA Health Care System, Iowa City, IA, USA
- Department of Ophthalmology and Visual Sciences, The University of Iowa Hospitals & Clinics, Iowa City, IA, USA
| |
Collapse
|
6
|
Lapka M, Straňák Z. The Current State of Artificial Intelligence in Neuro-Ophthalmology. A Review. CESKA A SLOVENSKA OFTALMOLOGIE : CASOPIS CESKE OFTALMOLOGICKE SPOLECNOSTI A SLOVENSKE OFTALMOLOGICKE SPOLECNOSTI 2024; 80:179-186. [PMID: 38538291 DOI: 10.31348/2023/33] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/25/2023]
Abstract
This article presents a summary of recent advances in the development and use of complex systems using artificial intelligence (AI) in neuro-ophthalmology. The aim of the following article is to present the principles of AI and algorithms that are currently being used or are still in the stage of evaluation or validation within the neuro-ophthalmology environment. For the purpose of this text, a literature search was conducted using specific keywords in available scientific databases, cumulatively up to April 2023. The AI systems developed across neuro-ophthalmology mostly achieve high sensitivity, specificity and accuracy. Individual AI systems and algorithms are subsequently selected, simply described and compared in the article. The results of the individual studies differ significantly, depending on the chosen methodology, the set goals, the size of the test, evaluated set, and the evaluated parameters. It has been demonstrated that the evaluation of various diseases will be greatly speeded up with the help of AI and make the diagnosis more efficient in the future, thus showing a high potential to be a useful tool in clinical practice even with a significant increase in the number of patients.
Collapse
|
7
|
Smith BG, Rambabu L, Kolias AG, Hutchinson PJ, Bashford T. The EyeVu Consortium for global neurosurgery. Lancet Neurol 2023; 22:883-884. [PMID: 37739569 DOI: 10.1016/s1474-4422(23)00328-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Accepted: 08/23/2023] [Indexed: 09/24/2023]
Affiliation(s)
- Brandon G Smith
- NIHR Global Health Research Group on Acquired Brain and Spine Injury, University of Cambridge, Cambridge, CB21PZ, UK; Engineering Design Centre, Department of Engineering, University of Cambridge, Cambridge, CB21PZ, UK.
| | - Lekaashree Rambabu
- NIHR Global Health Research Group on Acquired Brain and Spine Injury, University of Cambridge, Cambridge, CB21PZ, UK; Department of Cardiovascular Sciences, University of Leicester, Leicester, UK
| | - Angelos G Kolias
- NIHR Global Health Research Group on Acquired Brain and Spine Injury, University of Cambridge, Cambridge, CB21PZ, UK; Division of Neurosurgery, Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - Peter J Hutchinson
- NIHR Global Health Research Group on Acquired Brain and Spine Injury, University of Cambridge, Cambridge, CB21PZ, UK; Division of Neurosurgery, Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - Tom Bashford
- NIHR Global Health Research Group on Acquired Brain and Spine Injury, University of Cambridge, Cambridge, CB21PZ, UK; Engineering Design Centre, Department of Engineering, University of Cambridge, Cambridge, CB21PZ, UK; Division of Anaesthesia, Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| |
Collapse
|
8
|
Sathianvichitr K, Lamoureux O, Nakada S, Tang Z, Schmetterer L, Chen C, Cheung CY, Najjar RP, Milea D. Through the eyes into the brain, using artificial intelligence. ANNALS OF THE ACADEMY OF MEDICINE, SINGAPORE 2023. [DOI: 10.47102/annals-acadmedsg.2022369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/03/2023]
Abstract
Introduction: Detection of neurological conditions is of high importance in the current context of increasingly ageing populations. Imaging of the retina and the optic nerve head represents a unique opportunity to detect brain diseases, but requires specific human expertise. We review the current outcomes of artificial intelligence (AI) methods applied to retinal imaging for the detection of neurological and neuro-ophthalmic conditions.
Method: Current and emerging concepts related to the detection of neurological conditions, using AI-based investigations of the retina in patients with brain disease were examined and summarised.
Results: Papilloedema due to intracranial hypertension can be accurately identified with deep learning on standard retinal imaging at a human expert level. Emerging studies suggest that patients with Alzheimer’s disease can be discriminated from cognitively normal individuals, using AI applied to retinal images.
Conclusion: Recent AI-based systems dedicated to scalable retinal imaging have opened new perspectives for the detection of brain conditions directly or indirectly affecting retinal structures. However, further validation and implementation studies are required to better understand their potential value in clinical practice.
Keywords: Alzheimer’s disease, deep learning, dementia, optic neuropathy, papilloedema
Collapse
Affiliation(s)
| | - Oriana Lamoureux
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore
| | | | - Zhiqun Tang
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore
| | | | - Christopher Chen
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | - Carol Y Cheung
- The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Raymond P Najjar
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore
| | - Dan Milea
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore
| |
Collapse
|
9
|
Chan E, Tang Z, Najjar RP, Narayanaswamy A, Sathianvichitr K, Newman NJ, Biousse V, Milea D. A Deep Learning System for Automated Quality Evaluation of Optic Disc Photographs in Neuro-Ophthalmic Disorders. Diagnostics (Basel) 2023; 13:diagnostics13010160. [PMID: 36611452 PMCID: PMC9818957 DOI: 10.3390/diagnostics13010160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Revised: 12/27/2022] [Accepted: 12/28/2022] [Indexed: 01/05/2023] Open
Abstract
The quality of ocular fundus photographs can affect the accuracy of the morphologic assessment of the optic nerve head (ONH), either by humans or by deep learning systems (DLS). In order to automatically identify ONH photographs of optimal quality, we have developed, trained, and tested a DLS, using an international, multicentre, multi-ethnic dataset of 5015 ocular fundus photographs from 31 centres in 20 countries participating to the Brain and Optic Nerve Study with Artificial Intelligence (BONSAI). The reference standard in image quality was established by three experts who independently classified photographs as of "good", "borderline", or "poor" quality. The DLS was trained on 4208 fundus photographs and tested on an independent external dataset of 807 photographs, using a multi-class model, evaluated with a one-vs-rest classification strategy. In the external-testing dataset, the DLS could identify with excellent performance "good" quality photographs (AUC = 0.93 (95% CI, 0.91-0.95), accuracy = 91.4% (95% CI, 90.0-92.9%), sensitivity = 93.8% (95% CI, 92.5-95.2%), specificity = 75.9% (95% CI, 69.7-82.1%) and "poor" quality photographs (AUC = 1.00 (95% CI, 0.99-1.00), accuracy = 99.1% (95% CI, 98.6-99.6%), sensitivity = 81.5% (95% CI, 70.6-93.8%), specificity = 99.7% (95% CI, 99.6-100.0%). "Borderline" quality images were also accurately classified (AUC = 0.90 (95% CI, 0.88-0.93), accuracy = 90.6% (95% CI, 89.1-92.2%), sensitivity = 65.4% (95% CI, 56.6-72.9%), specificity = 93.4% (95% CI, 92.1-94.8%). The overall accuracy to distinguish among the three classes was 90.6% (95% CI, 89.1-92.1%), suggesting that this DLS could select optimal quality fundus photographs in patients with neuro-ophthalmic and neurological disorders affecting the ONH.
Collapse
Affiliation(s)
- Ebenezer Chan
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore 169856, Singapore
- Duke-NUS School of Medicine, Singapore 169857, Singapore
| | - Zhiqun Tang
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore 169856, Singapore
| | - Raymond P. Najjar
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore 169856, Singapore
- Duke-NUS School of Medicine, Singapore 169857, Singapore
- Department of Ophthalmology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore 117597, Singapore
- Center for Innovation & Precision Eye Health, National University of Singapore, Singapore 119077, Singapore
| | - Arun Narayanaswamy
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore 169856, Singapore
- Glaucoma Department, Singapore National Eye Centre, Singapore 168751, Singapore
| | | | - Nancy J. Newman
- Departments of Ophthalmology and Neurology, Emory University, Atlanta, GA 30322, USA
| | - Valérie Biousse
- Departments of Ophthalmology and Neurology, Emory University, Atlanta, GA 30322, USA
| | - Dan Milea
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore 169856, Singapore
- Duke-NUS School of Medicine, Singapore 169857, Singapore
- Department of Ophthalmology, Rigshospitalet, University of Copenhagen, 2600 Copenhagen, Denmark
- Department of Ophthalmology, Angers University Hospital, 49100 Angers, France
- Neuro-Ophthalmology Department, Singapore National Eye Centre, Singapore 168751, Singapore
- Correspondence:
| | | |
Collapse
|
10
|
Comprehensive Review on the Use of Artificial Intelligence in Ophthalmology and Future Research Directions. Diagnostics (Basel) 2022; 13:diagnostics13010100. [PMID: 36611392 PMCID: PMC9818832 DOI: 10.3390/diagnostics13010100] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Revised: 12/12/2022] [Accepted: 12/26/2022] [Indexed: 12/31/2022] Open
Abstract
BACKGROUND Having several applications in medicine, and in ophthalmology in particular, artificial intelligence (AI) tools have been used to detect visual function deficits, thus playing a key role in diagnosing eye diseases and in predicting the evolution of these common and disabling diseases. AI tools, i.e., artificial neural networks (ANNs), are progressively involved in detecting and customized control of ophthalmic diseases. The studies that refer to the efficiency of AI in medicine and especially in ophthalmology were analyzed in this review. MATERIALS AND METHODS We conducted a comprehensive review in order to collect all accounts published between 2015 and 2022 that refer to these applications of AI in medicine and especially in ophthalmology. Neural networks have a major role in establishing the demand to initiate preliminary anti-glaucoma therapy to stop the advance of the disease. RESULTS Different surveys in the literature review show the remarkable benefit of these AI tools in ophthalmology in evaluating the visual field, optic nerve, and retinal nerve fiber layer, thus ensuring a higher precision in detecting advances in glaucoma and retinal shifts in diabetes. We thus identified 1762 applications of artificial intelligence in ophthalmology: review articles and research articles (301 pub med, 144 scopus, 445 web of science, 872 science direct). Of these, we analyzed 70 articles and review papers (diabetic retinopathy (N = 24), glaucoma (N = 24), DMLV (N = 15), other pathologies (N = 7)) after applying the inclusion and exclusion criteria. CONCLUSION In medicine, AI tools are used in surgery, radiology, gynecology, oncology, etc., in making a diagnosis, predicting the evolution of a disease, and assessing the prognosis in patients with oncological pathologies. In ophthalmology, AI potentially increases the patient's access to screening/clinical diagnosis and decreases healthcare costs, mainly when there is a high risk of disease or communities face financial shortages. AI/DL (deep learning) algorithms using both OCT and FO images will change image analysis techniques and methodologies. Optimizing these (combined) technologies will accelerate progress in this area.
Collapse
|
11
|
Mortensen PW, Wong TY, Milea D, Lee AG. The Eye Is a Window to Systemic and Neuro-Ophthalmic Diseases. Asia Pac J Ophthalmol (Phila) 2022; 11:91-93. [PMID: 35533329 DOI: 10.1097/apo.0000000000000531] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022] Open
Affiliation(s)
- Peter W Mortensen
- Department of Ophthalmology, Blanton Eye Institute, Houston Methodist Hospital, Houston, TX, US
| | - Tien Y Wong
- Singapore Eye Research Institute, Singapore National Eye Centre, Duke-NUS Medical School, Singapore
- Tsinghua Medicine, Tsinghua University, Beijing, China
| | - Dan Milea
- Singapore Eye Research Institute, Singapore National Eye Centre, Duke-NUS Medical School, Singapore
- Copenhagen University, Denmark
| | - Andrew G Lee
- Department of Ophthalmology, Blanton Eye Institute, Houston Methodist Hospital, Houston, TX, US
- Departments of Ophthalmology, Neurology, and Neurosurgery, Weill Cornell Medicine, New York, NY, US
- Department of Ophthalmology, University of Texas Medical Branch, Galveston, Texas, US
- University of Texas MD Anderson Cancer Center, Houston, Texas, US
- Texas A and M College of Medicine, Bryan, Texas, US
- Department of Ophthalmology, The University of Iowa Hospitals and Clinics, Iowa City, Iowa, US
| |
Collapse
|