1
|
Larsen TJ, Pettersen MB, Nygaard Jensen H, Lynge Pedersen M, Lund-Andersen H, Jørgensen ME, Byberg S. The use of artificial intelligence to assess diabetic eye disease among the Greenlandic population. Int J Circumpolar Health 2024; 83:2314802. [PMID: 38359160 PMCID: PMC10877649 DOI: 10.1080/22423982.2024.2314802] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Accepted: 02/01/2024] [Indexed: 02/17/2024] Open
Abstract
Background: Retina fundus images conducted in Greenland are telemedically assessed for diabetic retinopathy by ophthalmological nurses in Denmark. Applying an AI grading solution, in a Greenlandic setting, could potentially improve the efficiency and cost-effectiveness of DR screening.Method: We developed an AI model using retina fundus photos, performed on persons registered with diabetes in Greenland and Denmark, using Optos® ultra wide-field scanning laser ophthalmoscope, graded according to ICDR.Using the ResNet50 network we compared the model's ability to distinguish between different images of ICDR severity levels in a confusion matrix.Results: Comparing images with ICDR level 0 to images of ICDR level 4 resulted in an accuracy of 0.9655, AUC of 0.9905, sensitivity and specificity of 96.6%.Comparing ICDR levels 0,1,2 with ICDR levels 3,4, we achieved a performance with an accuracy of 0.8077, an AUC of 0.8728, a sensitivity of 84.6% and a specificity of 78.8%. For the other comparisons, we achieved a modest performance.Conclusion: We developed an AI model using Greenlandic data, to automatically detect DR on Optos retina fundus images. The sensitivity and specificity were too low for our model to be applied directly in a clinical setting, thus optimising the model should be prioritised.
Collapse
Affiliation(s)
- Trine Jul Larsen
- Greenland Center of Health Research, Institute of Nursing and Health Science, University of Greenland, Nuuk, Greenland
| | | | | | - Michael Lynge Pedersen
- Greenland Center of Health Research, Institute of Nursing and Health Science, University of Greenland, Nuuk, Greenland
- Rigshospitalet-Glostrup University Hospital, Glostrup, Denmark
| | - Henrik Lund-Andersen
- Clinical Epidemiology, Steno Diabetes Center Copenhagen, Copenhagen, Denmark
- Rigshospitalet-Glostrup University Hospital, Glostrup, Denmark
| | | | - Stine Byberg
- Clinical Epidemiology, Steno Diabetes Center Copenhagen, Copenhagen, Denmark
| |
Collapse
|
2
|
Antaki F, Hammana I, Tessier MC, Boucher A, David Jetté ML, Beauchemin C, Hammamji K, Ong AY, Rhéaume MA, Gauthier D, Harissi-Dagher M, Keane PA, Pomp A. Implementation of Artificial Intelligence-Based Diabetic Retinopathy Screening in a Tertiary Care Hospital in Quebec: Prospective Validation Study. JMIR Diabetes 2024; 9:e59867. [PMID: 39226095 DOI: 10.2196/59867] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2024] [Revised: 06/28/2024] [Accepted: 07/06/2024] [Indexed: 09/04/2024] Open
Abstract
BACKGROUND Diabetic retinopathy (DR) affects about 25% of people with diabetes in Canada. Early detection of DR is essential for preventing vision loss. OBJECTIVE We evaluated the real-world performance of an artificial intelligence (AI) system that analyzes fundus images for DR screening in a Quebec tertiary care center. METHODS We prospectively recruited adult patients with diabetes at the Centre hospitalier de l'Université de Montréal (CHUM) in Montreal, Quebec, Canada. Patients underwent dual-pathway screening: first by the Computer Assisted Retinal Analysis (CARA) AI system (index test), then by standard ophthalmological examination (reference standard). We measured the AI system's sensitivity and specificity for detecting referable disease at the patient level, along with its performance for detecting any retinopathy and diabetic macular edema (DME) at the eye level, and potential cost savings. RESULTS This study included 115 patients. CARA demonstrated a sensitivity of 87.5% (95% CI 71.9-95.0) and specificity of 66.2% (95% CI 54.3-76.3) for detecting referable disease at the patient level. For any retinopathy detection at the eye level, CARA showed 88.2% sensitivity (95% CI 76.6-94.5) and 71.4% specificity (95% CI 63.7-78.1). For DME detection, CARA had 100% sensitivity (95% CI 64.6-100) and 81.9% specificity (95% CI 75.6-86.8). Potential yearly savings from implementing CARA at the CHUM were estimated at CAD $245,635 (US $177,643.23, as of July 26, 2024) considering 5000 patients with diabetes. CONCLUSIONS Our study indicates that integrating a semiautomated AI system for DR screening demonstrates high sensitivity for detecting referable disease in a real-world setting. This system has the potential to improve screening efficiency and reduce costs at the CHUM, but more work is needed to validate it.
Collapse
Affiliation(s)
- Fares Antaki
- Institute of Ophthalmology, University College London, London, United Kingdom
- Department of Ophthalmology, Centre Hospitalier de l'Université de Montréal, Montreal, QC, Canada
- Department of Ophthalmology, Université de Montréal, Montreal, QC, Canada
- The CHUM School of Artificial Intelligence in Healthcare, Centre Hospitalier de l'Université de Montréal, Montreal, QC, Canada
- Moorfields Eye Hospital NHS Foundation Trust, London, United Kingdom
| | - Imane Hammana
- Health Technology Assessment Unit, Centre Hospitalier de l'Université de Montréal, Montreal, QC, Canada
| | - Marie-Catherine Tessier
- Department of Ophthalmology, Centre Hospitalier de l'Université de Montréal, Montreal, QC, Canada
| | - Andrée Boucher
- Division of Endocrinology, Department of Medicine, Centre Hospitalier de l'Université de Montréal, Montreal, QC, Canada
| | - Maud Laurence David Jetté
- Direction du soutien à la transformation, Centre Hospitalier de l'Université de Montréal, Montreal, QC, Canada
| | | | - Karim Hammamji
- Department of Ophthalmology, Centre Hospitalier de l'Université de Montréal, Montreal, QC, Canada
- Department of Ophthalmology, Université de Montréal, Montreal, QC, Canada
| | - Ariel Yuhan Ong
- Institute of Ophthalmology, University College London, London, United Kingdom
- Moorfields Eye Hospital NHS Foundation Trust, London, United Kingdom
- Oxford Eye Hospital, Oxford University Hospitals NHS Foundation Trust, Oxford, United Kingdom
| | - Marc-André Rhéaume
- Department of Ophthalmology, Centre Hospitalier de l'Université de Montréal, Montreal, QC, Canada
- Department of Ophthalmology, Université de Montréal, Montreal, QC, Canada
| | - Danny Gauthier
- Department of Ophthalmology, Centre Hospitalier de l'Université de Montréal, Montreal, QC, Canada
- Department of Ophthalmology, Université de Montréal, Montreal, QC, Canada
| | - Mona Harissi-Dagher
- Department of Ophthalmology, Centre Hospitalier de l'Université de Montréal, Montreal, QC, Canada
- Department of Ophthalmology, Université de Montréal, Montreal, QC, Canada
| | - Pearse A Keane
- Institute of Ophthalmology, University College London, London, United Kingdom
- Moorfields Eye Hospital NHS Foundation Trust, London, United Kingdom
- NIHR Moorfields Biomedical Research Centre, London, United Kingdom
| | - Alfons Pomp
- Health Technology Assessment Unit, Centre Hospitalier de l'Université de Montréal, Montreal, QC, Canada
- Department of Surgery, University of Montréal, Montreal, QC, Canada
| |
Collapse
|
3
|
Krogh M, Jensen MB, Sig Ager Jensen M, Hentze Hansen M, Germund Nielsen M, Vorum H, Kristensen JK. Exploring general practice staff perspectives on a teaching concept based on instruction videos for diabetic retinopathy screening - an interview study. Scand J Prim Health Care 2024:1-10. [PMID: 39225788 DOI: 10.1080/02813432.2024.2396873] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Accepted: 08/20/2024] [Indexed: 09/04/2024] Open
Abstract
OBJECTIVE The aim of this study is to explore general practice staff perspectives regarding a teaching concept based on instructional videos for conducting DR screenings. Furthermore, this study aims to investigate the competencies acquired by the staff through this teaching concept. DESIGN AND SETTING Qualitative cross-sectional study conducted in general practice clinics in the North Denmark Region. METHOD A teaching concept was developed based on instruction videos to teach general practice staff to conduct diabetic retinopathy screenings with automated grading through artificial intelligence. Semi-structured interviews were performed with 16 staff members to investigate their perspectives on the concept and acquired competencies. RESULTS This study found no substantial resistance to the teaching concept from staff; however, participants' satisfaction with the methods employed in the instruction session, the progression of learning curves, screening competencies, and their acceptance of a known knowledge gap during screenings varied slightly among the participants. CONCLUSION This study showed that the teaching concept can be used to teach general practice staff to conduct diabetic retinopathy screenings. Staffs' perspectives on the teaching concept and acquired competencies varied, and this study suggest few adjustments to the concept to accommodate staff's preferences and establish more consistent competencies.
Collapse
Affiliation(s)
- Malene Krogh
- Center for General Practice, Aalborg University, Aalborg, Denmark
| | | | | | - Malene Hentze Hansen
- Department of Otorhinolaryngology, Head and Neck Surgery, Aalborg University Hospital, Aalborg, Denmark
| | - Marie Germund Nielsen
- The Clinical Nursing Research Unit, Aalborg University Hospital, Aalborg, Denmark
- Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - Henrik Vorum
- Department of Ophthalmology, Aalborg University Hospital, Aalborg, Denmark
| | | |
Collapse
|
4
|
Scott IA, Miller T, Crock C. Using conversant artificial intelligence to improve diagnostic reasoning: ready for prime time? Med J Aust 2024; 221:240-243. [PMID: 39086025 DOI: 10.5694/mja2.52401] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2024] [Accepted: 04/22/2024] [Indexed: 08/02/2024]
Affiliation(s)
- Ian A Scott
- University of Queensland, Brisbane, QLD
- Princess Alexandra Hospital, Brisbane, QLD
| | | | - Carmel Crock
- Royal Victorian Eye and Ear Hospital, Melbourne, VIC
| |
Collapse
|
5
|
Abramoff MD, Char D. What Do We Do with Physicians When Autonomous AI-Enabled Workflow is Better for Patient Outcomes? THE AMERICAN JOURNAL OF BIOETHICS : AJOB 2024; 24:93-96. [PMID: 39225989 DOI: 10.1080/15265161.2024.2377111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/04/2024]
|
6
|
Dos Reis MA, Künas CA, da Silva Araújo T, Schneiders J, de Azevedo PB, Nakayama LF, Rados DRV, Umpierre RN, Berwanger O, Lavinsky D, Malerbi FK, Navaux POA, Schaan BD. Advancing healthcare with artificial intelligence: diagnostic accuracy of machine learning algorithm in diagnosis of diabetic retinopathy in the Brazilian population. Diabetol Metab Syndr 2024; 16:209. [PMID: 39210394 PMCID: PMC11360296 DOI: 10.1186/s13098-024-01447-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/20/2024] [Accepted: 08/12/2024] [Indexed: 09/04/2024] Open
Abstract
BACKGROUND In healthcare systems in general, access to diabetic retinopathy (DR) screening is limited. Artificial intelligence has the potential to increase care delivery. Therefore, we trained and evaluated the diagnostic accuracy of a machine learning algorithm for automated detection of DR. METHODS We included color fundus photographs from individuals from 4 databases (primary and specialized care settings), excluding uninterpretable images. The datasets consist of images from Brazilian patients, which differs from previous work. This modification allows for a more tailored application of the model to Brazilian patients, ensuring that the nuances and characteristics of this specific population are adequately captured. The sample was fractionated in training (70%) and testing (30%) samples. A convolutional neural network was trained for image classification. The reference test was the combined decision from three ophthalmologists. The sensitivity, specificity, and area under the ROC curve of the algorithm for detecting referable DR (moderate non-proliferative DR; severe non-proliferative DR; proliferative DR and/or clinically significant macular edema) were estimated. RESULTS A total of 15,816 images (4590 patients) were included. The overall prevalence of any degree of DR was 26.5%. Compared with human evaluators (manual method of diagnosing DR performed by an ophthalmologist), the deep learning algorithm achieved an area under the ROC curve of 0.98 (95% CI 0.97-0.98), with a specificity of 94.6% (95% CI 93.8-95.3) and a sensitivity of 93.5% (95% CI 92.2-94.9) at the point of greatest efficiency to detect referable DR. CONCLUSIONS A large database showed that this deep learning algorithm was accurate in detecting referable DR. This finding aids to universal healthcare systems like Brazil, optimizing screening processes and can serve as a tool for improving DR screening, making it more agile and expanding care access.
Collapse
Affiliation(s)
- Mateus A Dos Reis
- Graduate Program in Medical Sciences: Endocrinology, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil.
- Universidade Feevale, Novo Hamburgo, RS, Brazil.
| | - Cristiano A Künas
- Institute of Informatics, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Thiago da Silva Araújo
- Institute of Informatics, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Josiane Schneiders
- Graduate Program in Medical Sciences: Endocrinology, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | | | - Luis F Nakayama
- Department of Ophthalmology and Visual Sciences, Universidade Federal de São Paulo, São Paulo, Brazil
- Laboratory for Computational Physiology, Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Dimitris R V Rados
- Graduate Program in Medical Sciences: Endocrinology, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
- TelessaúdeRS Project, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Roberto N Umpierre
- TelessaúdeRS Project, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
- Department of Social Medicine, Universidade Federal do Rio Grande do Sul, Porto Alegre, Brazil
| | - Otávio Berwanger
- The George Institute for Global Health, Imperial College London, London, UK
| | - Daniel Lavinsky
- Graduate Program in Medical Sciences: Endocrinology, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
- Department of Ophthalmology, Universidade Federal do Rio Grande do Sul, Porto Alegre, Brazil
| | - Fernando K Malerbi
- Department of Ophthalmology and Visual Sciences, Universidade Federal de São Paulo, São Paulo, Brazil
| | - Philippe O A Navaux
- Institute of Informatics, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Beatriz D Schaan
- Graduate Program in Medical Sciences: Endocrinology, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
- Institute for Health Technology Assessment (IATS) - CNPq, Porto Alegre, Brazil
- Endocrinology Unit, Hospital de Clínicas de Porto Alegre, Porto Alegre, RS, Brazil
| |
Collapse
|
7
|
Ong J, Jang KJ, Baek SJ, Hu D, Lin V, Jang S, Thaler A, Sabbagh N, Saeed A, Kwon M, Kim JH, Lee S, Han YS, Zhao M, Sokolsky O, Lee I, Al-Aswad LA. Development of oculomics artificial intelligence for cardiovascular risk factors: A case study in fundus oculomics for HbA1c assessment and clinically relevant considerations for clinicians. Asia Pac J Ophthalmol (Phila) 2024:100095. [PMID: 39209216 DOI: 10.1016/j.apjo.2024.100095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2024] [Revised: 08/19/2024] [Accepted: 08/19/2024] [Indexed: 09/04/2024] Open
Abstract
Artificial Intelligence (AI) is transforming healthcare, notably in ophthalmology, where its ability to interpret images and data can significantly enhance disease diagnosis and patient care. Recent developments in oculomics, the integration of ophthalmic features to develop biomarkers for systemic diseases, have demonstrated the potential for providing rapid, non-invasive methods of screening leading to enhance in early detection and improve healthcare quality, particularly in underserved areas. However, the widespread adoption of such AI-based technologies faces challenges primarily related to the trustworthiness of the system. We demonstrate the potential and considerations needed to develop trustworthy AI in oculomics through a pilot study for HbA1c assessment using an AI-based approach. We then discuss various challenges, considerations, and solutions that have been developed for powerful AI technologies in the past in healthcare and subsequently apply these considerations to the oculomics pilot study. Building upon the observations in the study we highlight the challenges and opportunities for advancing trustworthy AI in oculomics. Ultimately, oculomics presents as a powerful and emerging technology in ophthalmology and understanding how to optimize transparency prior to clinical adoption is of utmost importance.
Collapse
Affiliation(s)
- Joshua Ong
- Department of Ophthalmology and Visual Sciences, University of Michigan Kellogg Eye Center, Ann Arbor, MI, United States
| | - Kuk Jin Jang
- School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, United States
| | - Seung Ju Baek
- Department of AI Convergence Engineering, Republic of Korea
| | - Dongyin Hu
- School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, United States
| | - Vivian Lin
- School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, United States
| | - Sooyong Jang
- School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, United States
| | - Alexandra Thaler
- Department of Ophthalmology, Scheie Eye Institute, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
| | - Nouran Sabbagh
- Department of Ophthalmology, Scheie Eye Institute, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States
| | - Almiqdad Saeed
- Department of Ophthalmology, Scheie Eye Institute, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States; St John Eye Hospital-Jerusalem, Department of Ophthalmology, Israel
| | - Minwook Kwon
- Department of AI Convergence Engineering, Republic of Korea
| | - Jin Hyun Kim
- Department of Intelligence and Communication Engineering, Republic of Korea
| | - Seongjin Lee
- Department of AI Convergence Engineering, Republic of Korea
| | - Yong Seop Han
- Department of Ophthalmology, Gyeongsang National University College of Medicine, Institute of Health Sciences, Republic of Korea
| | - Mingmin Zhao
- School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, United States
| | - Oleg Sokolsky
- School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, United States
| | - Insup Lee
- School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, United States.
| | - Lama A Al-Aswad
- School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, United States; Department of Ophthalmology, Scheie Eye Institute, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, United States.
| |
Collapse
|
8
|
Lim JI, Rachitskaya AV, Hallak JA, Gholami S, Alam MN. Artificial intelligence for retinal diseases. Asia Pac J Ophthalmol (Phila) 2024:100096. [PMID: 39209215 DOI: 10.1016/j.apjo.2024.100096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2024] [Revised: 08/02/2024] [Accepted: 08/20/2024] [Indexed: 09/04/2024] Open
Abstract
PURPOSE To discuss the worldwide applications and potential impact of artificial intelligence (AI) for the diagnosis, management and analysis of treatment outcomes of common retinal diseases. METHODS We performed an online literature review, using PubMed Central (PMC), of AI applications to evaluate and manage retinal diseases. Search terms included AI for screening, diagnosis, monitoring, management, and treatment outcomes for age-related macular degeneration (AMD), diabetic retinopathy (DR), retinal surgery, retinal vascular disease, retinopathy of prematurity (ROP) and sickle cell retinopathy (SCR). Additional search terms included AI and color fundus photographs, optical coherence tomography (OCT), and OCT angiography (OCTA). We included original research articles and review articles. RESULTS Research studies have investigated and shown the utility of AI for screening for diseases such as DR, AMD, ROP, and SCR. Research studies using validated and labeled datasets confirmed AI algorithms could predict disease progression and response to treatment. Studies showed AI facilitated rapid and quantitative interpretation of retinal biomarkers seen on OCT and OCTA imaging. Research articles suggest AI may be useful for planning and performing robotic surgery. Studies suggest AI holds the potential to help lessen the impact of socioeconomic disparities on the outcomes of retinal diseases. CONCLUSIONS AI applications for retinal diseases can assist the clinician, not only by disease screening and monitoring for disease recurrence but also in quantitative analysis of treatment outcomes and prediction of treatment response. The public health impact on the prevention of blindness from DR, AMD, and other retinal vascular diseases remains to be determined.
Collapse
Affiliation(s)
- Jennifer I Lim
- University of Illinois at Chicago, College of Medicine, Department of Ophthalmology and Visual Sciences, Chicago, IL, United States.
| | - Aleksandra V Rachitskaya
- Department of Ophthalmology at Case Western Reserve University, Cleveland Clinic Lerner College of Medicine, Cleveland Clinic Cole Eye Institute, United States
| | - Joelle A Hallak
- University of Illinois at Chicago, College of Medicine, Department of Ophthalmology and Visual Sciences, Chicago, IL, United States; Department of Ophthalmology and Visual Sciences, College of Medicine, University of Illinois at Chicago, Chicago, IL, United States
| | - Sina Gholami
- University of North Carolina at Charlotte, United States
| | - Minhaj N Alam
- University of North Carolina at Charlotte, United States
| |
Collapse
|
9
|
Liu Z, Han X, Gao L, Chen S, Huang W, Li P, Wu Z, Wang M, Zheng Y. Cost-effectiveness of incorporating self-imaging optical coherence tomography into fundus photography-based diabetic retinopathy screening. NPJ Digit Med 2024; 7:225. [PMID: 39181938 PMCID: PMC11344775 DOI: 10.1038/s41746-024-01222-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2023] [Accepted: 08/13/2024] [Indexed: 08/27/2024] Open
Abstract
Diabetic macular edema (DME) has emerged as the foremost cause of vision loss in the population with diabetes. Early detection of DME is paramount, yet the prevailing screening, relying on two-dimensional and labor-intensive fundus photography (FP), results in frequent unwarranted referrals and overlooked diagnoses. Self-imaging optical coherence tomography (SI-OCT), offering fully automated, three-dimensional macular imaging, holds the potential to enhance DR screening. We conducted an observational study within a cohort of 1822 participants with diabetes, who received comprehensive assessments, including visual acuity testing, FP, and SI-OCT examinations. We compared the performance of three screening strategies: the conventional FP-based strategy, a combination strategy of FP and SI-OCT, and a simulated combination strategy of FP and manual SD-OCT. Additionally, we undertook a cost-effectiveness analysis utilizing Markov models to evaluate the costs and benefits of the three strategies for referable DR. We found that the FP + SI-OCT strategy demonstrated superior sensitivity (87.69% vs 61.53%) and specificity (98.29% vs 92.47%) in detecting DME when compared to the FP-based strategy. Importantly, the FP + SI-OCT strategy outperformed the FP-based strategy, with an incremental cost-effectiveness ratio (ICER) of $8016 per quality-adjusted life year (QALY), while the FP + SD-OCT strategy was less cost-effective, with an ICER of $45,754/QALY. Our results were robust to extensive sensitivity analyses, with the FP + SI-OCT strategy standing as the dominant choice in 69.36% of simulations conducted at the current willingness-to-pay threshold. In summary, incorporating SI-OCT into FP-based screening offers substantial enhancements in sensitivity, specificity for detecting DME, and most notably, cost-effectiveness for DR screening.
Collapse
Affiliation(s)
- Zitian Liu
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China.
| | - Xiaotong Han
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
| | - Le Gao
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
| | - Shida Chen
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
| | - Wenyong Huang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
| | - Peng Li
- MOPTIM Imaging Technique Co. Ltd, Shenzhen, China
| | - Zhiyan Wu
- Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou, China
| | - Mengchi Wang
- Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou, China
| | - Yingfeng Zheng
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
| |
Collapse
|
10
|
Li F, Wang D, Yang Z, Zhang Y, Jiang J, Liu X, Kong K, Zhou F, Tham CC, Medeiros F, Han Y, Grzybowski A, Zangwill LM, Lam DSC, Zhang X. The AI Revolution in Glaucoma: Bridging Challenges with Opportunities. Prog Retin Eye Res 2024:101291. [PMID: 39186968 DOI: 10.1016/j.preteyeres.2024.101291] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2024] [Revised: 08/19/2024] [Accepted: 08/19/2024] [Indexed: 08/28/2024]
Abstract
Recent advancements in artificial intelligence (AI) herald transformative potentials for reshaping glaucoma clinical management, improving screening efficacy, sharpening diagnosis precision, and refining the detection of disease progression. However, incorporating AI into healthcare usages faces significant hurdles in terms of developing algorithms and putting them into practice. When creating algorithms, issues arise due to the intensive effort required to label data, inconsistent diagnostic standards, and a lack of thorough testing, which often limits the algorithms' widespread applicability. Additionally, the "black box" nature of AI algorithms may cause doctors to be wary or skeptical. When it comes to using these tools, challenges include dealing with lower-quality images in real situations and the systems' limited ability to work well with diverse ethnic groups and different diagnostic equipment. Looking ahead, new developments aim to protect data privacy through federated learning paradigms, improving algorithm generalizability by diversifying input data modalities, and augmenting datasets with synthetic imagery. The integration of smartphones appears promising for using AI algorithms in both clinical and non-clinical settings. Furthermore, bringing in large language models (LLMs) to act as interactive tool in medicine may signify a significant change in how healthcare will be delivered in the future. By navigating through these challenges and leveraging on these as opportunities, the field of glaucoma AI will not only have improved algorithmic accuracy and optimized data integration but also a paradigmatic shift towards enhanced clinical acceptance and a transformative improvement in glaucoma care.
Collapse
Affiliation(s)
- Fei Li
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China.
| | - Deming Wang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China.
| | - Zefeng Yang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China.
| | - Yinhang Zhang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China.
| | - Jiaxuan Jiang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China.
| | - Xiaoyi Liu
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China.
| | - Kangjie Kong
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China.
| | - Fengqi Zhou
- Ophthalmology, Mayo Clinic Health System, Eau Claire, Wisconsin, USA.
| | - Clement C Tham
- Department of Ophthalmology and Visual Sciences, The Chinese University of Hong Kong, Hong Kong SAR, China.
| | - Felipe Medeiros
- Bascom Palmer Eye Institute, University of Miami Miller School of Medicine, Miami, Florida, USA.
| | - Ying Han
- University of California, San Francisco, Department of Ophthalmology, San Francisco, CA, USA; The Francis I. Proctor Foundation for Research in Ophthalmology, University of California, San Francisco, California, USA.
| | - Andrzej Grzybowski
- Institute for Research in Ophthalmology, Foundation for Ophthalmology Development, Poznan, Poland.
| | - Linda M Zangwill
- Hamilton Glaucoma Center, Viterbi Family Department of Ophthalmology, Shiley Eye Institute, University of California, San Diego, CA, USA.
| | - Dennis S C Lam
- The International Eye Research Institute of The Chinese University of Hong Kong (Shenzhen), Shenzhen, China; The C-MER Dennis Lam & Partners Eye Center, C-MER International Eye Care Group, Hong Kong, China.
| | - Xiulan Zhang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou 510060, China.
| |
Collapse
|
11
|
Riotto E, Gasser S, Potic J, Sherif M, Stappler T, Schlingemann R, Wolfensberger T, Konstantinidis L. Accuracy of Autonomous Artificial Intelligence-Based Diabetic Retinopathy Screening in Real-Life Clinical Practice. J Clin Med 2024; 13:4776. [PMID: 39200918 PMCID: PMC11355215 DOI: 10.3390/jcm13164776] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2024] [Revised: 07/24/2024] [Accepted: 08/08/2024] [Indexed: 09/02/2024] Open
Abstract
Background: In diabetic retinopathy, early detection and intervention are crucial in preventing vision loss and improving patient outcomes. In the era of artificial intelligence (AI) and machine learning, new promising diagnostic tools have emerged. The IDX-DR machine (Digital Diagnostics, Coralville, IA, USA) represents a diagnostic tool that combines advanced imaging techniques, AI algorithms, and deep learning methodologies to identify and classify diabetic retinopathy. Methods: All patients that participated in our AI-based DR screening were considered for this study. For this study, all retinal images were additionally reviewed retrospectively by two experienced retinal specialists. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and accuracy were calculated for the IDX-DR machine compared to the graders' responses. Results: We included a total of 2282 images from 1141 patients who were screened between January 2021 and January 2023 at the Jules Gonin Eye Hospital in Lausanne, Switzerland. Sensitivity was calculated to be 100% for 'no DR', 'mild DR', and 'moderate DR'. Specificity for no DR', 'mild DR', 'moderate DR', and 'severe DR' was calculated to be, respectively, 78.4%, 81.2%, 93.4%, and 97.6%. PPV was calculated to be, respectively, 36.7%, 24.6%, 1.4%, and 0%. NPV was calculated to be 100% for each category. Accuracy was calculated to be higher than 80% for 'no DR', 'mild DR', and 'moderate DR'. Conclusions: In this study, based in Jules Gonin Eye Hospital in Lausanne, we compared the autonomous diagnostic AI system of the IDX-DR machine detecting diabetic retinopathy to human gradings established by two experienced retinal specialists. Our results showed that the ID-x DR machine constantly overestimates the DR stages, thus permitting the clinicians to fully trust negative results delivered by the screening software. Nevertheless, all fundus images classified as 'mild DR' or greater should always be controlled by a specialist in order to assert whether the predicted stage is truly present.
Collapse
|
12
|
Wang Y, Han X, Li C, Luo L, Yin Q, Zhang J, Peng G, Shi D, He M. Impact of Gold-Standard Label Errors on Evaluating Performance of Deep Learning Models in Diabetic Retinopathy Screening: Nationwide Real-World Validation Study. J Med Internet Res 2024; 26:e52506. [PMID: 39141915 PMCID: PMC11358665 DOI: 10.2196/52506] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 12/30/2023] [Accepted: 03/22/2024] [Indexed: 08/16/2024] Open
Abstract
BACKGROUND For medical artificial intelligence (AI) training and validation, human expert labels are considered the gold standard that represents the correct answers or desired outputs for a given data set. These labels serve as a reference or benchmark against which the model's predictions are compared. OBJECTIVE This study aimed to assess the accuracy of a custom deep learning (DL) algorithm on classifying diabetic retinopathy (DR) and further demonstrate how label errors may contribute to this assessment in a nationwide DR-screening program. METHODS Fundus photographs from the Lifeline Express, a nationwide DR-screening program, were analyzed to identify the presence of referable DR using both (1) manual grading by National Health Service England-certificated graders and (2) a DL-based DR-screening algorithm with validated good lab performance. To assess the accuracy of labels, a random sample of images with disagreement between the DL algorithm and the labels was adjudicated by ophthalmologists who were masked to the previous grading results. The error rates of labels in this sample were then used to correct the number of negative and positive cases in the entire data set, serving as postcorrection labels. The DL algorithm's performance was evaluated against both pre- and postcorrection labels. RESULTS The analysis included 736,083 images from 237,824 participants. The DL algorithm exhibited a gap between the real-world performance and the lab-reported performance in this nationwide data set, with a sensitivity increase of 12.5% (from 79.6% to 92.5%, P<.001) and a specificity increase of 6.9% (from 91.6% to 98.5%, P<.001). In the random sample, 63.6% (560/880) of negative images and 5.2% (140/2710) of positive images were misclassified in the precorrection human labels. High myopia was the primary reason for misclassifying non-DR images as referable DR images, while laser spots were predominantly responsible for misclassified referable cases. The estimated label error rate for the entire data set was 1.2%. The label correction was estimated to bring about a 12.5% enhancement in the estimated sensitivity of the DL algorithm (P<.001). CONCLUSIONS Label errors based on human image grading, although in a small percentage, can significantly affect the performance evaluation of DL algorithms in real-world DR screening.
Collapse
Affiliation(s)
- Yueye Wang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
- School of Optometry, The Hong Kong Polytechnic University, Kowloon, China (Hong Kong)
| | - Xiaotong Han
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
| | - Cong Li
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
| | - Lixia Luo
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
| | - Qiuxia Yin
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
| | - Jian Zhang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
| | - Guankai Peng
- Guangzhou Vision Tech Medical Technology Co, Ltd, Guangzhou, China
| | - Danli Shi
- School of Optometry, The Hong Kong Polytechnic University, Kowloon, China (Hong Kong)
- Research Centre for SHARP Vision, The Hong Kong Polytechnic University, Kowloon, China (Hong Kong)
| | - Mingguang He
- School of Optometry, The Hong Kong Polytechnic University, Kowloon, China (Hong Kong)
- Research Centre for SHARP Vision, The Hong Kong Polytechnic University, Kowloon, China (Hong Kong)
- Centre for Eye and Vision Research, Hong Kong, China (Hong Kong)
| |
Collapse
|
13
|
Oualikene-Gonin W, Jaulent MC, Thierry JP, Oliveira-Martins S, Belgodère L, Maison P, Ankri J. Artificial intelligence integration in the drug lifecycle and in regulatory science: policy implications, challenges and opportunities. Front Pharmacol 2024; 15:1437167. [PMID: 39156111 PMCID: PMC11327028 DOI: 10.3389/fphar.2024.1437167] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2024] [Accepted: 07/18/2024] [Indexed: 08/20/2024] Open
Abstract
Artificial intelligence tools promise transformative impacts in drug development. Regulatory agencies face challenges in integrating AI while ensuring reliability and safety in clinical trial approvals, drug marketing authorizations, and post-market surveillance. Incorporating these technologies into the existing regulatory framework and agency practices poses notable challenges, particularly in evaluating the data and models employed for these purposes. Rapid adaptation of regulations and internal processes is essential for agencies to keep pace with innovation, though achieving this requires collective stakeholder collaboration. This article thus delves into the need for adaptations of regulations throughout the drug development lifecycle, as well as the utilization of AI within internal processes of medicine agencies.
Collapse
Affiliation(s)
- Wahiba Oualikene-Gonin
- Agence Nationale de Sécurité des Médicaments et des Produits de Santé (ANSM) Saint-Denis, Saint-Denis, France
| | - Marie-Christine Jaulent
- INSERM, Laboratoire d'Informatique Médicale et d'Ingénierie des Connaissances en e-Santé, LIMICS, Sorbonne Université, Paris, France
| | | | - Sofia Oliveira-Martins
- Faculty of Pharmacy of Lisbon University, Lisbon, Portugal
- CHRC – Comprehensive Health Research Center, Evora, Portugal
| | - Laetitia Belgodère
- Agence Nationale de Sécurité des Médicaments et des Produits de Santé (ANSM) Saint-Denis, Saint-Denis, France
| | - Patrick Maison
- Agence Nationale de Sécurité des Médicaments et des Produits de Santé (ANSM) Saint-Denis, Saint-Denis, France
- EA 7379, Faculté de Santé, Université Paris-Est Créteil, Créteil, France
- CHI Créteil, Créteil, France
| | - Joël Ankri
- Université de Versailles St Quentin-Paris Saclay, Inserm U1018, Guyancourt, France
| | | |
Collapse
|
14
|
Christopher M, Hallaj S, Jiravarnsirikul A, Baxter SL, Zangwill LM. Novel Technologies in Artificial Intelligence and Telemedicine for Glaucoma Screening. J Glaucoma 2024; 33:S26-S32. [PMID: 38506792 DOI: 10.1097/ijg.0000000000002367] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2024] [Accepted: 01/22/2024] [Indexed: 03/21/2024]
Abstract
PURPOSE To provide an overview of novel technologies in telemedicine and artificial intelligence (AI) approaches for cost-effective glaucoma screening. METHODS/RESULTS A narrative review was performed by summarizing research results, recent developments in glaucoma detection and care, and considerations related to telemedicine and AI in glaucoma screening. Telemedicine and AI approaches provide the opportunity for novel glaucoma screening programs in primary care, optometry, portable, and home-based settings. These approaches offer several advantages for glaucoma screening, including increasing access to care, lowering costs, identifying patients in need of urgent treatment, and enabling timely diagnosis and early intervention. However, challenges remain in implementing these systems, including integration into existing clinical workflows, ensuring equity for patients, and meeting ethical and regulatory requirements. Leveraging recent work towards standardized data acquisition as well as tools and techniques developed for automated diabetic retinopathy screening programs may provide a model for a cost-effective approach to glaucoma screening. CONCLUSION Leveraging novel technologies and advances in telemedicine and AI-based approaches to glaucoma detection show promise for improving our ability to detect moderate and advanced glaucoma in primary care settings and target higher individuals at high risk for having the disease.
Collapse
Affiliation(s)
- Mark Christopher
- Viterbi Family Department of Ophthalmology, Hamilton Glaucoma Center
- Viterbi Family Department of Ophthalmology, Division of Ophthalmology Informatics and Data Science, Shiley Eye Institute
| | - Shahin Hallaj
- Viterbi Family Department of Ophthalmology, Hamilton Glaucoma Center
- Viterbi Family Department of Ophthalmology, Division of Ophthalmology Informatics and Data Science, Shiley Eye Institute
| | - Anuwat Jiravarnsirikul
- Viterbi Family Department of Ophthalmology, Hamilton Glaucoma Center
- Department of Medicine, Division of Biomedical Informatics, University of California San Diego, La Jolla, CA
| | - Sally L Baxter
- Viterbi Family Department of Ophthalmology, Hamilton Glaucoma Center
- Viterbi Family Department of Ophthalmology, Division of Ophthalmology Informatics and Data Science, Shiley Eye Institute
- Department of Medicine, Division of Biomedical Informatics, University of California San Diego, La Jolla, CA
| | - Linda M Zangwill
- Viterbi Family Department of Ophthalmology, Hamilton Glaucoma Center
- Viterbi Family Department of Ophthalmology, Division of Ophthalmology Informatics and Data Science, Shiley Eye Institute
| |
Collapse
|
15
|
Wiens J, Spector-Bagdady K, Mukherjee B. Toward Realizing the Promise of AI in Precision Health Across the Spectrum of Care. Annu Rev Genomics Hum Genet 2024; 25:141-159. [PMID: 38724019 DOI: 10.1146/annurev-genom-010323-010230] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/29/2024]
Abstract
Significant progress has been made in augmenting clinical decision-making using artificial intelligence (AI) in the context of secondary and tertiary care at large academic medical centers. For such innovations to have an impact across the spectrum of care, additional challenges must be addressed, including inconsistent use of preventative care and gaps in chronic care management. The integration of additional data, including genomics and data from wearables, could prove critical in addressing these gaps, but technical, legal, and ethical challenges arise. On the technical side, approaches for integrating complex and messy data are needed. Data and design imperfections like selection bias, missing data, and confounding must be addressed. In terms of legal and ethical challenges, while AI has the potential to aid in leveraging patient data to make clinical care decisions, we also risk exacerbating existing disparities. Organizations implementing AI solutions must carefully consider how they can improve care for all and reduce inequities.
Collapse
Affiliation(s)
- Jenna Wiens
- Division of Computer Science and Engineering, College of Engineering, University of Michigan, Ann Arbor, Michigan, USA;
| | - Kayte Spector-Bagdady
- Department of Obstetrics and Gynecology and Center for Bioethics and Social Sciences in Medicine, University of Michigan Medical School, Ann Arbor, Michigan, USA
| | - Bhramar Mukherjee
- Department of Biostatistics, School of Public Health, University of Michigan, Ann Arbor, Michigan, USA
| |
Collapse
|
16
|
Ashayeri H, Jafarizadeh A, Yousefi M, Farhadi F, Javadzadeh A. Retinal imaging and Alzheimer's disease: a future powered by Artificial Intelligence. Graefes Arch Clin Exp Ophthalmol 2024; 262:2389-2401. [PMID: 38358524 DOI: 10.1007/s00417-024-06394-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 01/22/2024] [Accepted: 01/30/2024] [Indexed: 02/16/2024] Open
Abstract
Alzheimer's disease (AD) is a neurodegenerative condition that primarily affects brain tissue. Because the retina and brain share the same embryonic origin, visual deficits have been reported in AD patients. Artificial Intelligence (AI) has recently received a lot of attention due to its immense power to process and detect image hallmarks and make clinical decisions (like diagnosis) based on images. Since retinal changes have been reported in AD patients, AI is being proposed to process images to predict, diagnose, and prognosis AD. As a result, the purpose of this review was to discuss the use of AI trained on retinal images of AD patients. According to previous research, AD patients experience retinal thickness and retinal vessel density changes, which can occasionally occur before the onset of the disease's clinical symptoms. AI and machine vision can detect and use these changes in the domains of disease prediction, diagnosis, and prognosis. As a result, not only have unique algorithms been developed for this condition, but also databases such as the Retinal OCTA Segmentation dataset (ROSE) have been constructed for this purpose. The achievement of high accuracy, sensitivity, and specificity in the classification of retinal images between AD and healthy groups is one of the major breakthroughs in using AI based on retinal images for AD. It is fascinating that researchers could pinpoint individuals with a positive family history of AD based on the properties of their eyes. In conclusion, the growing application of AI in medicine promises its future position in processing different aspects of patients with AD, but we need cohort studies to determine whether it can help to follow up with healthy persons at risk of AD for a quicker diagnosis or assess the prognosis of patients with AD.
Collapse
Affiliation(s)
- Hamidreza Ashayeri
- Neuroscience Research Center (NSRC), Tabriz University of Medical Sciences, Tabriz, Iran
| | - Ali Jafarizadeh
- Nikookari Eye Center, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Milad Yousefi
- Faculty of Mathematics, Statistics and Computer Sciences, University of Tabriz, Tabriz, Iran
| | - Fereshteh Farhadi
- Nikookari Eye Center, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Alireza Javadzadeh
- Department of Ophthalmology, Nikookari Eye Center, Tabriz University of Medical Sciences, Tabriz, Iran.
| |
Collapse
|
17
|
Sheng B, Pushpanathan K, Guan Z, Lim QH, Lim ZW, Yew SME, Goh JHL, Bee YM, Sabanayagam C, Sevdalis N, Lim CC, Lim CT, Shaw J, Jia W, Ekinci EI, Simó R, Lim LL, Li H, Tham YC. Artificial intelligence for diabetes care: current and future prospects. Lancet Diabetes Endocrinol 2024; 12:569-595. [PMID: 39054035 DOI: 10.1016/s2213-8587(24)00154-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/02/2024] [Revised: 03/28/2024] [Accepted: 05/16/2024] [Indexed: 07/27/2024]
Abstract
Artificial intelligence (AI) use in diabetes care is increasingly being explored to personalise care for people with diabetes and adapt treatments for complex presentations. However, the rapid advancement of AI also introduces challenges such as potential biases, ethical considerations, and implementation challenges in ensuring that its deployment is equitable. Ensuring inclusive and ethical developments of AI technology can empower both health-care providers and people with diabetes in managing the condition. In this Review, we explore and summarise the current and future prospects of AI across the diabetes care continuum, from enhancing screening and diagnosis to optimising treatment and predicting and managing complications.
Collapse
Affiliation(s)
- Bin Sheng
- Shanghai Belt and Road International Joint Laboratory for Intelligent Prevention and Treatment of Metabolic Disorders, Department of Computer Science and Engineering, School of Electronic, Information, and Electrical Engineering, Shanghai Jiao Tong University, Department of Endocrinology and Metabolism, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai Diabetes Institute, Shanghai Clinical Center for Diabetes, Shanghai, China; Key Laboratory of Artificial Intelligence, Ministry of Education, School of Electronic, Information, and Electrical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Krithi Pushpanathan
- Centre of Innovation and Precision Eye Health, Department of Ophthalmology, National University of Singapore, Singapore; Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | - Zhouyu Guan
- Shanghai Belt and Road International Joint Laboratory for Intelligent Prevention and Treatment of Metabolic Disorders, Department of Computer Science and Engineering, School of Electronic, Information, and Electrical Engineering, Shanghai Jiao Tong University, Department of Endocrinology and Metabolism, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai Diabetes Institute, Shanghai Clinical Center for Diabetes, Shanghai, China
| | - Quan Hziung Lim
- Department of Medicine, Faculty of Medicine, University of Malaya, Kuala Lumpur, Malaysia
| | - Zhi Wei Lim
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | - Samantha Min Er Yew
- Centre of Innovation and Precision Eye Health, Department of Ophthalmology, National University of Singapore, Singapore; Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | | | - Yong Mong Bee
- Department of Endocrinology, Singapore General Hospital, Singapore; SingHealth Duke-National University of Singapore Diabetes Centre, Singapore Health Services, Singapore
| | - Charumathi Sabanayagam
- Ophthalmology and Visual Sciences Academic Clinical Program, Duke-National University of Singapore Medical School, Singapore; Singapore Eye Research Institute, Singapore National Eye Centre, Singapore
| | - Nick Sevdalis
- Centre for Behavioural and Implementation Science Interventions, National University of Singapore, Singapore
| | | | - Chwee Teck Lim
- Department of Biomedical Engineering, National University of Singapore, Singapore; Institute for Health Innovation and Technology, National University of Singapore, Singapore; Mechanobiology Institute, National University of Singapore, Singapore
| | - Jonathan Shaw
- Baker Heart and Diabetes Institute, Melbourne, VIC, Australia
| | - Weiping Jia
- Shanghai Belt and Road International Joint Laboratory for Intelligent Prevention and Treatment of Metabolic Disorders, Department of Computer Science and Engineering, School of Electronic, Information, and Electrical Engineering, Shanghai Jiao Tong University, Department of Endocrinology and Metabolism, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai Diabetes Institute, Shanghai Clinical Center for Diabetes, Shanghai, China
| | - Elif Ilhan Ekinci
- Australian Centre for Accelerating Diabetes Innovations, Melbourne Medical School and Department of Medicine, University of Melbourne, Melbourne, VIC, Australia; Department of Endocrinology, Austin Health, Melbourne, VIC, Australia
| | - Rafael Simó
- Diabetes and Metabolism Research Unit, Vall d'Hebron University Hospital and Vall d'Hebron Research Institute, Barcelona, Spain; Centro de Investigación Biomédica en Red de Diabetes y Enfermedades Metabólicas Asociadas, Instituto de Salud Carlos III, Madrid, Spain
| | - Lee-Ling Lim
- Department of Medicine, Faculty of Medicine, University of Malaya, Kuala Lumpur, Malaysia; Department of Medicine and Therapeutics, Chinese University of Hong Kong, Hong Kong Special Administrative Region, China; Asia Diabetes Foundation, Hong Kong Special Administrative Region, China
| | - Huating Li
- Shanghai Belt and Road International Joint Laboratory for Intelligent Prevention and Treatment of Metabolic Disorders, Department of Computer Science and Engineering, School of Electronic, Information, and Electrical Engineering, Shanghai Jiao Tong University, Department of Endocrinology and Metabolism, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai Diabetes Institute, Shanghai Clinical Center for Diabetes, Shanghai, China.
| | - Yih-Chung Tham
- Centre of Innovation and Precision Eye Health, Department of Ophthalmology, National University of Singapore, Singapore; Yong Loo Lin School of Medicine, National University of Singapore, Singapore; Ophthalmology and Visual Sciences Academic Clinical Program, Duke-National University of Singapore Medical School, Singapore; Singapore Eye Research Institute, Singapore National Eye Centre, Singapore.
| |
Collapse
|
18
|
Holm S. Data-driven decisions about individual patients: The case of medical AI. J Eval Clin Pract 2024; 30:735-740. [PMID: 37491780 DOI: 10.1111/jep.13904] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 06/02/2023] [Accepted: 07/12/2023] [Indexed: 07/27/2023]
Abstract
There are high hopes that clinical decisions can be improved by adopting algorithms trained to estimate the likelihood that a patient suffers a condition C. Introducing work on the epistemic value of purely statistical evidence in legal epistemology I show that a certain type of AI devices for making medical decisions about persons rely on purely statistical evidence and that it raises an important question about the appropriateness of relying on such devices for allocating health resources. If the argument I present is sound, then it suggests a radical rethinking of the use of prevalent types of AI devices as well as the use of statistical evidence in medical practice more generally.
Collapse
Affiliation(s)
- Sune Holm
- Department of Food and Resource Economics, University of Copenhagen, Frederiksberg, Denmark
| |
Collapse
|
19
|
Benetz BAM, Shivade VS, Joseph NM, Romig NJ, McCormick JC, Chen J, Titus MS, Sawant OB, Clover JM, Yoganathan N, Menegay HJ, O'Brien RC, Wilson DL, Lass JH. Automatic Determination of Endothelial Cell Density From Donor Cornea Endothelial Cell Images. Transl Vis Sci Technol 2024; 13:40. [PMID: 39177992 PMCID: PMC11346145 DOI: 10.1167/tvst.13.8.40] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2024] [Accepted: 06/21/2024] [Indexed: 08/24/2024] Open
Abstract
Purpose To determine endothelial cell density (ECD) from real-world donor cornea endothelial cell (EC) images using a self-supervised deep learning segmentation model. Methods Two eye banks (Eversight, VisionGift) provided 15,138 single, unique EC images from 8169 donors along with their demographics, tissue characteristics, and ECD. This dataset was utilized for self-supervised training and deep learning inference. The Cornea Image Analysis Reading Center (CIARC) provided a second dataset of 174 donor EC images based on image and tissue quality. These images were used to train a supervised deep learning cell border segmentation model. Evaluation between manual and automated determination of ECD was restricted to the 1939 test EC images with at least 100 cells counted by both methods. Results The ECD measurements from both methods were in excellent agreement with rc of 0.77 (95% confidence interval [CI], 0.75-0.79; P < 0.001) and bias of 123 cells/mm2 (95% CI, 114-131; P < 0.001); 81% of the automated ECD values were within 10% of the manual ECD values. When the analysis was further restricted to the cropped image, the rc was 0.88 (95% CI, 0.87-0.89; P < 0.001), bias was 46 cells/mm2 (95% CI, 39-53; P < 0.001), and 93% of the automated ECD values were within 10% of the manual ECD values. Conclusions Deep learning analysis provides accurate ECDs of donor images, potentially reducing analysis time and training requirements. Translational Relevance The approach of this study, a robust methodology for automatically evaluating donor cornea EC images, could expand the quantitative determination of endothelial health beyond ECD.
Collapse
Affiliation(s)
- Beth Ann M. Benetz
- Department of Ophthalmology and Visual Sciences, Case Western Reserve University, Cleveland, OH, USA
- Cornea Image Analysis Reading Center, University Hospitals Eye Institute, Cleveland, OH, USA
| | - Ved S. Shivade
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA
| | - Naomi M. Joseph
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA
| | - Nathan J. Romig
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA
| | - John C. McCormick
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA
| | - Jiawei Chen
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA
| | | | - Onkar B. Sawant
- Eversight, Ann Arbor, MI, USA
- Center for Vision and Eye Banking Research, Eversight, Cleveland, OH, USA
| | | | | | - Harry J. Menegay
- Department of Ophthalmology and Visual Sciences, Case Western Reserve University, Cleveland, OH, USA
- Cornea Image Analysis Reading Center, University Hospitals Eye Institute, Cleveland, OH, USA
| | | | - David L. Wilson
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA
| | - Jonathan H. Lass
- Department of Ophthalmology and Visual Sciences, Case Western Reserve University, Cleveland, OH, USA
- Cornea Image Analysis Reading Center, University Hospitals Eye Institute, Cleveland, OH, USA
| |
Collapse
|
20
|
Martelli E, Capoccia L, Di Francesco M, Cavallo E, Pezzulla MG, Giudice G, Bauleo A, Coppola G, Panagrosso M. Current Applications and Future Perspectives of Artificial and Biomimetic Intelligence in Vascular Surgery and Peripheral Artery Disease. Biomimetics (Basel) 2024; 9:465. [PMID: 39194444 DOI: 10.3390/biomimetics9080465] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2024] [Revised: 07/05/2024] [Accepted: 07/24/2024] [Indexed: 08/29/2024] Open
Abstract
Artificial Intelligence (AI) made its first appearance in 1956, and since then it has progressively introduced itself in healthcare systems and patients' information and care. AI functions can be grouped under the following headings: Machine Learning (ML), Deep Learning (DL), Artificial Neural Network (ANN), Convolutional Neural Network (CNN), Computer Vision (CV). Biomimetic intelligence (BI) applies the principles of systems of nature to create biological algorithms, such as genetic and neural network, to be used in different scenarios. Chronic limb-threatening ischemia (CLTI) represents the last stage of peripheral artery disease (PAD) and has increased over recent years, together with the rise in prevalence of diabetes and population ageing. Nowadays, AI and BI grant the possibility of developing new diagnostic and treatment solutions in the vascular field, given the possibility of accessing clinical, biological, and imaging data. By assessing the vascular anatomy in every patient, as well as the burden of atherosclerosis, and classifying the level and degree of disease, sizing and planning the best endovascular treatment, defining the perioperative complications risk, integrating experiences and resources between different specialties, identifying latent PAD, thus offering evidence-based solutions and guiding surgeons in the choice of the best surgical technique, AI and BI challenge the role of the physician's experience in PAD treatment.
Collapse
Affiliation(s)
- Eugenio Martelli
- Division of Vascular Surgery, Department of Surgery, S Maria Goretti Hospital, 81100 Latina, Italy
- Department of General and Specialist Surgery, Sapienza University of Rome, 00161 Rome, Italy
- Faculty of Medicine, Saint Camillus International University of Health Sciences, 00131 Rome, Italy
| | - Laura Capoccia
- Division of Vascular and Endovascular Surgery, Department of Cardiovascular Sciences, S. Anna and S. Sebastiano Hospital, 81100 Caserta, Italy
| | - Marco Di Francesco
- Division of Vascular and Endovascular Surgery, Department of Cardiovascular Sciences, S. Anna and S. Sebastiano Hospital, 81100 Caserta, Italy
| | - Eduardo Cavallo
- Division of Vascular and Endovascular Surgery, Department of Cardiovascular Sciences, S. Anna and S. Sebastiano Hospital, 81100 Caserta, Italy
| | - Maria Giulia Pezzulla
- Division of Vascular and Endovascular Surgery, Department of Cardiovascular Sciences, S. Anna and S. Sebastiano Hospital, 81100 Caserta, Italy
| | - Giorgio Giudice
- Division of Vascular and Endovascular Surgery, Department of Cardiovascular Sciences, S. Anna and S. Sebastiano Hospital, 81100 Caserta, Italy
| | - Antonio Bauleo
- Division of Vascular and Endovascular Surgery, Department of Cardiovascular Sciences, S. Anna and S. Sebastiano Hospital, 81100 Caserta, Italy
| | - Giuseppe Coppola
- Division of Vascular and Endovascular Surgery, Department of Cardiovascular Sciences, S. Anna and S. Sebastiano Hospital, 81100 Caserta, Italy
| | - Marco Panagrosso
- Division of Vascular and Endovascular Surgery, Department of Cardiovascular Sciences, S. Anna and S. Sebastiano Hospital, 81100 Caserta, Italy
| |
Collapse
|
21
|
Rodríguez-Miguel A, Arruabarrena C, Allendes G, Olivera M, Zarranz-Ventura J, Teus MA. Hybrid deep learning models for the screening of Diabetic Macular Edema in optical coherence tomography volumes. Sci Rep 2024; 14:17633. [PMID: 39085461 PMCID: PMC11291805 DOI: 10.1038/s41598-024-68489-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2024] [Accepted: 07/24/2024] [Indexed: 08/02/2024] Open
Abstract
Several studies published so far used highly selective image datasets from unclear sources to train computer vision models and that may lead to overestimated results, while those studies conducted in real-life remain scarce. To avoid image selection bias, we stacked convolutional and recurrent neural networks (CNN-RNN) to analyze complete optical coherence tomography (OCT) cubes in a row and predict diabetic macular edema (DME), in a real-world diabetic retinopathy screening program. A retrospective cohort study was carried out. Throughout 4-years, 5314 OCT cubes from 4408 subjects who attended to the diabetic retinopathy (DR) screening program were included. We arranged twenty-two (22) pre-trained CNNs in parallel with a bidirectional RNN layer stacked at the bottom, allowing the model to make a prediction for the whole OCT cube. The staff of retina experts built a ground truth of DME later used to train a set of these CNN-RNN models with different configurations. For each trained CNN-RNN model, we performed threshold tuning to find the optimal cut-off point for binary classification of DME. Finally, the best models were selected according to sensitivity, specificity, and area under the receiver operating characteristics curve (AUROC) with their 95% confidence intervals (95%CI). An ensemble of the best models was also explored. 5188 cubes were non-DME and 126 were DME. Three models achieved an AUROC of 0.94. Among these, sensitivity, and specificity (95%CI) ranged from 84.1-90.5 and 89.7-93.3, respectively, at threshold 1, from 89.7-92.1 and 80-83.1 at threshold 2, and from 80.2-81 and 93.8-97, at threshold 3. The ensemble model improved these results, and lower specificity was observed among subjects with sight-threatening DR. Analysis by age, gender, or grade of DME did not vary the performance of the models. CNN-RNN models showed high diagnostic accuracy for detecting DME in a real-world setting. This engine allowed us to detect extra-foveal DMEs commonly overlooked in other studies, and showed potential for application as the first filter of non-referable patients in an outpatient center within a population-based DR screening program, otherwise ended up in specialized care.
Collapse
Affiliation(s)
| | - Carolina Arruabarrena
- Department of Ophthalmology, Retina Unit, University Hospital "Príncipe de Asturias", 28805, Madrid, Spain
| | - Germán Allendes
- Department of Ophthalmology, Retina Unit, University Hospital "Príncipe de Asturias", 28805, Madrid, Spain
| | | | - Javier Zarranz-Ventura
- Hospital Clínic de Barcelona, University of Barcelona, 08036, Barcelona, Spain
- Institut de Investigacions Biomediques August Pi I Sunyer (IDIBAPS), 08036, Barcelona, Spain
| | - Miguel A Teus
- Department of Surgery, Medical and Social Sciences (Ophthalmology), University of Alcalá, 28871, Madrid, Spain
| |
Collapse
|
22
|
Rojas-Carabali W, Agrawal R, Gutierrez-Sinisterra L, Baxter SL, Cifuentes-González C, Wei YC, Abisheganaden J, Kannapiran P, Wong S, Lee B, de-la-Torre A, Agrawal R. Natural Language Processing in medicine and ophthalmology: A review for the 21st-century clinician. Asia Pac J Ophthalmol (Phila) 2024:100084. [PMID: 39059557 DOI: 10.1016/j.apjo.2024.100084] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2024] [Revised: 07/08/2024] [Accepted: 07/19/2024] [Indexed: 07/28/2024] Open
Abstract
Natural Language Processing (NLP) is a subfield of artificial intelligence that focuses on the interaction between computers and human language, enabling computers to understand, generate, and derive meaning from human language. NLP's potential applications in the medical field are extensive and vary from extracting data from Electronic Health Records -one of its most well-known and frequently exploited uses- to investigating relationships among genetics, biomarkers, drugs, and diseases for the proposal of new medications. NLP can be useful for clinical decision support, patient monitoring, or medical image analysis. Despite its vast potential, the real-world application of NLP is still limited due to various challenges and constraints, meaning that its evolution predominantly continues within the research domain. However, with the increasingly widespread use of NLP, particularly with the availability of large language models, such as ChatGPT, it is crucial for medical professionals to be aware of the status, uses, and limitations of these technologies.
Collapse
Affiliation(s)
- William Rojas-Carabali
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore; Tan Tock Seng Hospital, National Healthcare Group Eye Institute, Singapore
| | - Rajdeep Agrawal
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
| | | | - Sally L Baxter
- Division of Ophthalmology Informatics and Data Science, Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, La Jolla, CA, USA; Division of Biomedical Informatics, Department of Medicine, University of California San Diego, La Jolla, CA, USA
| | - Carlos Cifuentes-González
- Neuroscience Research Group (NEUROS), Neurovitae Center for Neuroscience, Institute of Translational Medicine (IMT), Escuela de Medicina y Ciencias de la Salud, Universidad del Rosario, Bogotá, Colombia
| | - Yap Chun Wei
- Health Services and Outcomes Research, National Healthcare Group, Singapore
| | - John Abisheganaden
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore; Health Services and Outcomes Research, National Healthcare Group, Singapore; Department of Respiratory Medicine, Tan Tock Seng Hospital, Singapore
| | | | - Sunny Wong
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
| | - Bernett Lee
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
| | - Alejandra de-la-Torre
- Neuroscience Research Group (NEUROS), Neurovitae Center for Neuroscience, Institute of Translational Medicine (IMT), Escuela de Medicina y Ciencias de la Salud, Universidad del Rosario, Bogotá, Colombia
| | - Rupesh Agrawal
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore; Tan Tock Seng Hospital, National Healthcare Group Eye Institute, Singapore; Singapore Eye Research Institute, Singapore; Duke NUS Medical School, National University of Singapore, Singapore.
| |
Collapse
|
23
|
Huang JJ, Channa R, Wolf RM, Dong Y, Liang M, Wang J, Abramoff MD, Liu TYA. Autonomous artificial intelligence for diabetic eye disease increases access and health equity in underserved populations. NPJ Digit Med 2024; 7:196. [PMID: 39039218 PMCID: PMC11263546 DOI: 10.1038/s41746-024-01197-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2024] [Accepted: 07/12/2024] [Indexed: 07/24/2024] Open
Abstract
Diabetic eye disease (DED) is a leading cause of blindness in the world. Annual DED testing is recommended for adults with diabetes, but adherence to this guideline has historically been low. In 2020, Johns Hopkins Medicine (JHM) began deploying autonomous AI for DED testing. In this study, we aimed to determine whether autonomous AI implementation was associated with increased adherence to annual DED testing, and how this differed across patient populations. JHM primary care sites were categorized as "non-AI" (no autonomous AI deployment) or "AI-switched" (autonomous AI deployment by 2021). We conducted a propensity score weighting analysis to compare change in adherence rates from 2019 to 2021 between non-AI and AI-switched sites. Our study included all adult patients with diabetes (>17,000) managed within JHM and has three major findings. First, AI-switched sites experienced a 7.6 percentage point greater increase in DED testing than non-AI sites from 2019 to 2021 (p < 0.001). Second, the adherence rate for Black/African Americans increased by 12.2 percentage points within AI-switched sites but decreased by 0.6% points within non-AI sites (p < 0.001), suggesting that autonomous AI deployment improved access to retinal evaluation for historically disadvantaged populations. Third, autonomous AI is associated with improved health equity, e.g. the adherence rate gap between Asian Americans and Black/African Americans shrank from 15.6% in 2019 to 3.5% in 2021. In summary, our results from real-world deployment in a large integrated healthcare system suggest that autonomous AI is associated with improvement in overall DED testing adherence, patient access, and health equity.
Collapse
Affiliation(s)
- Jane J Huang
- Wilmer Eye Institute, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Roomasa Channa
- University of Wisconsin-Madison School of Medicine and Public Health, Madison, WI, USA
| | - Risa M Wolf
- Johns Hopkins Pediatric Diabetes Center, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Yiwen Dong
- Department of Biostatistics, Johns Hopkins University, Baltimore, MD, USA
| | - Mavis Liang
- Department of Biostatistics, Johns Hopkins University, Baltimore, MD, USA
| | - Jiangxia Wang
- Department of Biostatistics, Johns Hopkins University, Baltimore, MD, USA
| | - Michael D Abramoff
- Department of Ophthalmology and Visual Sciences, University of Iowa, Iowa City, IA, USA
- Department of Electrical and Computer Engineering, University of Iowa, Iowa City, IA, USA
| | - T Y Alvin Liu
- Wilmer Eye Institute, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
| |
Collapse
|
24
|
Burlina S, Radin S, Poggiato M, Cioccoloni D, Raimondo D, Romanello G, Tommasi C, Lombardi S. Screening for diabetic retinopathy with artificial intelligence: a real world evaluation. Acta Diabetol 2024:10.1007/s00592-024-02333-x. [PMID: 38995312 DOI: 10.1007/s00592-024-02333-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/08/2024] [Accepted: 07/02/2024] [Indexed: 07/13/2024]
Abstract
AIM Periodic screening for diabetic retinopathy (DR) is effective for preventing blindness. Artificial intelligence (AI) systems could be useful for increasing the screening of DR in diabetic patients. The aim of this study was to compare the performance of the DAIRET system in detecting DR to that of ophthalmologists in a real-world setting. METHODS Fundus photography was performed with a nonmydriatic camera in 958 consecutive patients older than 18 years who were affected by diabetes and who were enrolled in the DR screening in the Diabetes and Endocrinology Unit and in the Eye Unit of ULSS8 Berica (Italy) between June 2022 and June 2023. All retinal images were evaluated by DAIRET, which is a machine learning algorithm based on AI. In addition, all the images obtained were analysed by an ophthalmologist who graded the images. The results obtained by DAIRET were compared with those obtained by the ophthalmologist. RESULTS We included 958 patients, but only 867 (90.5%) patients had retinal images sufficient for evaluation by a human grader. The sensitivity for detecting cases of moderate DR and above was 1 (100%), and the sensitivity for detecting cases of mild DR was 0.84 ± 0.03. The specificity of detecting the absence of DR was lower (0.59 ± 0.04) because of the high number of false-positives. CONCLUSION DAIRET showed an optimal sensitivity in detecting all cases of referable DR (moderate DR or above) compared with that of a human grader. On the other hand, the specificity of DAIRET was low because of the high number of false-positives, which limits its cost-effectiveness.
Collapse
Affiliation(s)
- Silvia Burlina
- Diabetes and Endocrinology Unit, ULSS8 Berica, Arzignano, Veneto, VI, Italy.
| | - Sandra Radin
- Eye Unit, ULSS 8 Berica, Montecchio Maggiore, Veneto, VI, Italy
| | - Marzia Poggiato
- Eye Unit, ULSS 8 Berica, Montecchio Maggiore, Veneto, VI, Italy
| | - Dario Cioccoloni
- Diabetes and Endocrinology Unit, ULSS8 Berica, Arzignano, Veneto, VI, Italy
| | - Daniele Raimondo
- Diabetes and Endocrinology Unit, ULSS8 Berica, Arzignano, Veneto, VI, Italy
| | - Giovanni Romanello
- Diabetes and Endocrinology Unit, ULSS8 Berica, Arzignano, Veneto, VI, Italy
| | - Chiara Tommasi
- Diabetes and Endocrinology Unit, ULSS8 Berica, Arzignano, Veneto, VI, Italy
| | - Simonetta Lombardi
- Diabetes and Endocrinology Unit, ULSS8 Berica, Arzignano, Veneto, VI, Italy
| |
Collapse
|
25
|
Radgoudarzi N, Gregg C, Quackenbush Q, Yiu G, Freeby M, Su G, Baxter S, Thorne C, Willard-Grace R. Implementation Mapping of the Collaborative University of California Teleophthalmology Initiative (CUTI): A Qualitative Study Using the Exploration, Preparation, Implementation, and Sustainment (EPIS) Framework. Cureus 2024; 16:e64179. [PMID: 39119397 PMCID: PMC11309586 DOI: 10.7759/cureus.64179] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/09/2024] [Indexed: 08/10/2024] Open
Abstract
Background This study aimed to investigate the rationale, barriers, and facilitators of teleretinal camera implementation in primary care and endocrinology clinics for diabetic retinopathy (DR) screening across University of California (UC) health systems utilizing the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework. Methodology Institutional representatives from UC Los Angeles, San Diego, San Francisco, and Davis participated in a series of focus group meetings to elicit implementation facilitators and barriers for teleophthalmology programs within their campuses. Site representatives also completed a survey regarding their program's performance over the calendar year 2022 in the following areas: DR screening camera sites, payment sources and coding, screening workflows including clinical, information technology (IT), reading, results, pathologic findings, and follow-up, including patient outreach for abnormal results. Focus group and survey results were mapped to the EPIS framework to gain insights into the implementation process of these programs and identify areas for optimization. Results Four UC campuses with 20 active camera sites screened 7,450 patients in the calendar year 2022. The average DR screening rate across the four campuses was 55%. Variations between sources of payment, turn-around time, image-grading structure, image-report characteristics, IT infrastructure, and patient outreach strategies were identified between sites. Closing gaps in IT integration between data systems, ensuring the financial sustainability of the program, and optimizing patient outreach remain primary challenges across sites and serve as good opportunities for cross-institutional learning. Conclusions Despite the potential for long-term cost savings and improving access to care, numerous obstacles continue to hinder the widespread implementation of teleretinal DR screening. Implementation science approaches can identify strategies for addressing these challenges and optimizing implementation.
Collapse
Affiliation(s)
| | - Chhavi Gregg
- Informatics Services, University of California San Diego Health, San Diego, USA
| | - Quinn Quackenbush
- Family and Community Medicine, University of California San Diego Health, San Diego, USA
| | - Glenn Yiu
- Ophthalmology, University of California Davis Health, Sacramento, USA
| | - Matthew Freeby
- Endocrinology, University of California Los Angeles Health Systems, Los Angeles, USA
| | - George Su
- Pulmonary and Critical Care Medicine, University of California San Francisco Health Systems, San Francisco, USA
| | - Sally Baxter
- Ophthalmology, University of California San Diego Health, San Diego, USA
| | - Christine Thorne
- Primary Care, University of California San Diego Health, San Diego, USA
| | - Rachel Willard-Grace
- Primary Care, University of California San Francisco Health Systems, San Francisco, USA
| |
Collapse
|
26
|
Serikbaeva A, Li Y, Ma S, Yi D, Kazlauskas A. Resilience to diabetic retinopathy. Prog Retin Eye Res 2024; 101:101271. [PMID: 38740254 PMCID: PMC11262066 DOI: 10.1016/j.preteyeres.2024.101271] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Revised: 05/03/2024] [Accepted: 05/10/2024] [Indexed: 05/16/2024]
Abstract
Chronic elevation of blood glucose at first causes relatively minor changes to the neural and vascular components of the retina. As the duration of hyperglycemia persists, the nature and extent of damage increases and becomes readily detectable. While this second, overt manifestation of diabetic retinopathy (DR) has been studied extensively, what prevents maximal damage from the very start of hyperglycemia remains largely unexplored. Recent studies indicate that diabetes (DM) engages mitochondria-based defense during the retinopathy-resistant phase, and thereby enables the retina to remain healthy in the face of hyperglycemia. Such resilience is transient, and its deterioration results in progressive accumulation of retinal damage. The concepts that co-emerge with these discoveries set the stage for novel intellectual and therapeutic opportunities within the DR field. Identification of biomarkers and mediators of protection from DM-mediated damage will enable development of resilience-based therapies that will indefinitely delay the onset of DR.
Collapse
Affiliation(s)
- Anara Serikbaeva
- Department of Physiology and Biophysics, University of Illinois at Chicago, 1905 W Taylor St, Chicago, IL 60612, USA
| | - Yanliang Li
- Department of Ophthalmology and Visual Sciences, University of Illinois at Chicago, 1905 W Taylor St, Chicago, IL 60612, USA
| | - Simon Ma
- Department of Bioengineering, University of Illinois at Chicago, 1905 W Taylor St, Chicago, IL 60612, USA
| | - Darvin Yi
- Department of Ophthalmology and Visual Sciences, University of Illinois at Chicago, 1905 W Taylor St, Chicago, IL 60612, USA; Department of Bioengineering, University of Illinois at Chicago, 1905 W Taylor St, Chicago, IL 60612, USA
| | - Andrius Kazlauskas
- Department of Physiology and Biophysics, University of Illinois at Chicago, 1905 W Taylor St, Chicago, IL 60612, USA; Department of Ophthalmology and Visual Sciences, University of Illinois at Chicago, 1905 W Taylor St, Chicago, IL 60612, USA.
| |
Collapse
|
27
|
Talcott KE, Baxter SL, Chen DK, Korot E, Lee A, Kim JE, Modi Y, Moshfeghi DM, Singh RP. American Society of Retina Specialists Artificial Intelligence Task Force Report. JOURNAL OF VITREORETINAL DISEASES 2024; 8:373-380. [PMID: 39148579 PMCID: PMC11323512 DOI: 10.1177/24741264241247602] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/17/2024]
Abstract
Since the Artificial Intelligence Committee of the American Society of Retina Specialists developed the initial task force report in 2020, the artificial intelligence (AI) field has seen further adoption of US Food and Drug Administration-approved AI platforms and significant development of AI for various retinal conditions. With expansion of this technology comes further areas of challenges, including the data sources used in AI, the democracy of AI, commercialization, bias, and the need for provider education on the technology of AI. The overall focus of this committee report is to explore these recent issues as they relate to the continued development of AI and its integration into ophthalmology and retinal practice.
Collapse
Affiliation(s)
- Katherine E. Talcott
- Center for Ophthalmic Bioinformatics, Cole Eye Institute, Cleveland Clinic Foundation, Cleveland, OH, USA
- Cleveland Clinic Lerner College of Medicine, Cleveland, OH, USA
| | - Sally L. Baxter
- Division of Ophthalmology Informatics and Data Science, Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, La Jolla, CA, USA
- Division of Biomedical Informatics, Department of Medicine, University of California San Diego, La Jolla, CA, USA
| | - Dinah K. Chen
- Department of Ophthalmology, NYU Grossman School of Medicine, New York University, NY, USA
- Genentech/Roche, South San Francisco, CA, USA
| | - Edward Korot
- Retina Specialists of Michigan, Grand Rapids, MI, USA
- Horngren Family Vitreoretinal Center, Byers Eye Institute, Department of Ophthalmology, Stanford University School of Medicine, Palo Alto, CA, USA
| | - Aaron Lee
- Roger and Angie Karalis Johnson Retina Center, Department of Ophthalmology, School of Medicine, University of Washington, Seattle, WA, USA
| | - Judy E. Kim
- Department of Ophthalmology and Visual Sciences, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Yasha Modi
- Department of Ophthalmology, NYU Grossman School of Medicine, New York University, NY, USA
| | - Darius M. Moshfeghi
- Horngren Family Vitreoretinal Center, Byers Eye Institute, Department of Ophthalmology, Stanford University School of Medicine, Palo Alto, CA, USA
| | - Rishi P. Singh
- Center for Ophthalmic Bioinformatics, Cole Eye Institute, Cleveland Clinic Foundation, Cleveland, OH, USA
- Cleveland Clinic Lerner College of Medicine, Cleveland, OH, USA
- Cleveland Clinic Martin Health, Stuart, FL, USA
| |
Collapse
|
28
|
Malerbi FK, Nakayama LF, Melo GB, Stuchi JA, Lencione D, Prado PV, Ribeiro LZ, Dib SA, Regatieri CV. Automated Identification of Different Severity Levels of Diabetic Retinopathy Using a Handheld Fundus Camera and Single-Image Protocol. OPHTHALMOLOGY SCIENCE 2024; 4:100481. [PMID: 38694494 PMCID: PMC11060947 DOI: 10.1016/j.xops.2024.100481] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 01/20/2024] [Accepted: 01/25/2024] [Indexed: 05/04/2024]
Abstract
Purpose To evaluate the performance of artificial intelligence (AI) systems embedded in a mobile, handheld retinal camera, with a single retinal image protocol, in detecting both diabetic retinopathy (DR) and more-than-mild diabetic retinopathy (mtmDR). Design Multicenter cross-sectional diagnostic study, conducted at 3 diabetes care and eye care facilities. Participants A total of 327 individuals with diabetes mellitus (type 1 or type 2) underwent a retinal imaging protocol enabling expert reading and automated analysis. Methods Participants underwent fundus photographs using a portable retinal camera (Phelcom Eyer). The captured images were automatically analyzed by deep learning algorithms retinal alteration score (RAS) and diabetic retinopathy alteration score (DRAS), consisting of convolutional neural networks trained on EyePACS data sets and fine-tuned using data sets of portable device fundus images. The ground truth was the classification of DR corresponding to adjudicated expert reading, performed by 3 certified ophthalmologists. Main Outcome Measures Primary outcome measures included the sensitivity and specificity of the AI system in detecting DR and/or mtmDR using a single-field, macula-centered fundus photograph for each eye, compared with a rigorous clinical reference standard comprising the reading center grading of 2-field imaging protocol using the International Classification of Diabetic Retinopathy severity scale. Results Of 327 analyzed patients (mean age, 57.0 ± 16.8 years; mean diabetes duration, 16.3 ± 9.7 years), 307 completed the study protocol. Sensitivity and specificity of the AI system were high in detecting any DR with DRAS (sensitivity, 90.48% [95% confidence interval (CI), 84.99%-94.46%]; specificity, 90.65% [95% CI, 84.54%-94.93%]) and mtmDR with the combination of RAS and DRAS (sensitivity, 90.23% [95% CI, 83.87%-94.69%]; specificity, 85.06% [95% CI, 78.88%-90.00%]). The area under the receiver operating characteristic curve was 0.95 for any DR and 0.89 for mtmDR. Conclusions This study showed a high accuracy for the detection of DR in different levels of severity with a single retinal photo per eye in an all-in-one solution, composed of a portable retinal camera powered by AI. Such a strategy holds great potential for increasing coverage rates of screening programs, contributing to prevention of avoidable blindness. Financial Disclosures F.K.M. is a medical consultant for Phelcom Technologies. J.A.S. is Chief Executive Officer and proprietary of Phelcom Technologies. D.L. is Chief Technology Officer and proprietary of Phelcom Technologies. P.V.P. is an employee at Phelcom Technologies.
Collapse
|
29
|
Chen D, Geevarghese A, Lee S, Plovnick C, Elgin C, Zhou R, Oermann E, Aphinyonaphongs Y, Al-Aswad LA. Transparency in Artificial Intelligence Reporting in Ophthalmology-A Scoping Review. OPHTHALMOLOGY SCIENCE 2024; 4:100471. [PMID: 38591048 PMCID: PMC11000111 DOI: 10.1016/j.xops.2024.100471] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 11/18/2023] [Accepted: 01/12/2024] [Indexed: 04/10/2024]
Abstract
Topic This scoping review summarizes artificial intelligence (AI) reporting in ophthalmology literature in respect to model development and validation. We characterize the state of transparency in reporting of studies prospectively validating models for disease classification. Clinical Relevance Understanding what elements authors currently describe regarding their AI models may aid in the future standardization of reporting. This review highlights the need for transparency to facilitate the critical appraisal of models prior to clinical implementation, to minimize bias and inappropriate use. Transparent reporting can improve effective and equitable use in clinical settings. Methods Eligible articles (as of January 2022) from PubMed, Embase, Web of Science, and CINAHL were independently screened by 2 reviewers. All observational and clinical trial studies evaluating the performance of an AI model for disease classification of ophthalmic conditions were included. Studies were evaluated for reporting of parameters derived from reporting guidelines (CONSORT-AI, MI-CLAIM) and our previously published editorial on model cards. The reporting of these factors, which included basic model and dataset details (source, demographics), and prospective validation outcomes, were summarized. Results Thirty-seven prospective validation studies were included in the scoping review. Eleven additional associated training and/or retrospective validation studies were included if this information could not be determined from the primary articles. These 37 studies validated 27 unique AI models; multiple studies evaluated the same algorithms (EyeArt, IDx-DR, and Medios AI). Details of model development were variably reported; 18 of 27 models described training dataset annotation and 10 of 27 studies reported training data distribution. Demographic information of training data was rarely reported; 7 of the 27 unique models reported age and gender and only 2 reported race and/or ethnicity. At the level of prospective clinical validation, age and gender of populations was more consistently reported (29 and 28 of 37 studies, respectively), but only 9 studies reported race and/or ethnicity data. Scope of use was difficult to discern for the majority of models. Fifteen studies did not state or imply primary users. Conclusion Our scoping review demonstrates variable reporting of information related to both model development and validation. The intention of our study was not to assess the quality of the factors we examined, but to characterize what information is, and is not, regularly reported. Our results suggest the need for greater transparency in the reporting of information necessary to determine the appropriateness and fairness of these tools prior to clinical use. Financial Disclosures Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
Collapse
Affiliation(s)
- Dinah Chen
- Department of Ophthalmology, NYU Langone Health, New York, New York
| | | | - Samuel Lee
- Department of Neurosurgery, NYU Grossman School of Medicine, New York, New York
| | | | - Cansu Elgin
- Department of Ophthalmology, Istanbul University-Cerrahpasa, Istanbul, Turkey
| | - Raymond Zhou
- Department of Neurosurgery, Vanderbilt School of Medicine, Nashville, Tennessee
| | - Eric Oermann
- Department of Neurosurgery, NYU Grossman School of Medicine, New York, New York
- Department of Neurosurgery, NYU Langone Health, New York, New York
| | - Yindalon Aphinyonaphongs
- Department of Medicine, NYU Langone Health, New York, New York
- Department of Population Health, NYU Grossman School of Medicine, New York, New York
| | - Lama A. Al-Aswad
- Department of Ophthalmology, NYU Langone Health, New York, New York
- Department of Population Health, NYU Grossman School of Medicine, New York, New York
| |
Collapse
|
30
|
Khandelia H, Deora A, Bhattacharyya A, Nangla P, Chawla R, Venkatesh P, Tandon R. Harnessing the medical undergraduate human resource for screening of sight-threatening diabetic retinopathy. Indian J Ophthalmol 2024; 72:983-986. [PMID: 38317298 PMCID: PMC11329833 DOI: 10.4103/ijo.ijo_2361_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2023] [Revised: 11/17/2023] [Accepted: 12/01/2023] [Indexed: 02/07/2024] Open
Abstract
PURPOSE To assess whether medical undergraduates can be trained to effectively screen diabetic retinopathy (DR) by statistical comparison with a retina specialist at a tertiary eye care center in India. METHODS Three final-year undergraduate medical students, having completed ophthalmology department rotation, received training from a retina specialist for grading DR, following which they were asked to grade a set of 50 fundus photographs centered on the macula with a view of 50° as sight-threatening DR (STDR), diabetic macular edema, and grade of DR. Agreement among the undergraduates and retina specialist was determined with the help of Cohen's Kappa coefficient. RESULTS Kappa coefficient between undergraduates for detection of STDR ranged from 0.695 to 0.817 and between each student and the retina specialist ranged from 0.663 to 0.712. The sensitivity and specificity for undergraduates' and retina specialist's detection of STDR were 93.93%-96.96% and 60%, respectively. CONCLUSION There was substantial agreement among the undergraduates as well as between the undergraduates and the retina specialist for the detection of STDR. Undergraduates also detected STDR with a high sensitivity. This study outlines the feasibility of training undergraduate students for screening DR.
Collapse
Affiliation(s)
| | - Aarush Deora
- Dr. Rajendra Prasad Centre for Ophthalmic Sciences, AIIMS, New Delhi, India
| | | | | | - Rohan Chawla
- Dr. Rajendra Prasad Centre for Ophthalmic Sciences, AIIMS, New Delhi, India
| | - Pradeep Venkatesh
- Dr. Rajendra Prasad Centre for Ophthalmic Sciences, AIIMS, New Delhi, India
| | - Radhika Tandon
- Dr. Rajendra Prasad Centre for Ophthalmic Sciences, AIIMS, New Delhi, India
| |
Collapse
|
31
|
Sorrentino FS, Gardini L, Fontana L, Musa M, Gabai A, Maniaci A, Lavalle S, D’Esposito F, Russo A, Longo A, Surico PL, Gagliano C, Zeppieri M. Novel Approaches for Early Detection of Retinal Diseases Using Artificial Intelligence. J Pers Med 2024; 14:690. [PMID: 39063944 PMCID: PMC11278069 DOI: 10.3390/jpm14070690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2024] [Revised: 06/24/2024] [Accepted: 06/25/2024] [Indexed: 07/28/2024] Open
Abstract
BACKGROUND An increasing amount of people are globally affected by retinal diseases, such as diabetes, vascular occlusions, maculopathy, alterations of systemic circulation, and metabolic syndrome. AIM This review will discuss novel technologies in and potential approaches to the detection and diagnosis of retinal diseases with the support of cutting-edge machines and artificial intelligence (AI). METHODS The demand for retinal diagnostic imaging exams has increased, but the number of eye physicians or technicians is too little to meet the request. Thus, algorithms based on AI have been used, representing valid support for early detection and helping doctors to give diagnoses and make differential diagnosis. AI helps patients living far from hub centers to have tests and quick initial diagnosis, allowing them not to waste time in movements and waiting time for medical reply. RESULTS Highly automated systems for screening, early diagnosis, grading and tailored therapy will facilitate the care of people, even in remote lands or countries. CONCLUSION A potential massive and extensive use of AI might optimize the automated detection of tiny retinal alterations, allowing eye doctors to perform their best clinical assistance and to set the best options for the treatment of retinal diseases.
Collapse
Affiliation(s)
| | - Lorenzo Gardini
- Unit of Ophthalmology, Department of Surgical Sciences, Ospedale Maggiore, 40100 Bologna, Italy; (F.S.S.)
| | - Luigi Fontana
- Ophthalmology Unit, Department of Surgical Sciences, Alma Mater Studiorum University of Bologna, IRCCS Azienda Ospedaliero-Universitaria Bologna, 40100 Bologna, Italy
| | - Mutali Musa
- Department of Optometry, University of Benin, Benin City 300238, Edo State, Nigeria
| | - Andrea Gabai
- Department of Ophthalmology, Humanitas-San Pio X, 20159 Milan, Italy
| | - Antonino Maniaci
- Department of Medicine and Surgery, University of Enna “Kore”, Piazza dell’Università, 94100 Enna, Italy
| | - Salvatore Lavalle
- Department of Medicine and Surgery, University of Enna “Kore”, Piazza dell’Università, 94100 Enna, Italy
| | - Fabiana D’Esposito
- Imperial College Ophthalmic Research Group (ICORG) Unit, Imperial College, 153-173 Marylebone Rd, London NW15QH, UK
- Department of Neurosciences, Reproductive Sciences and Dentistry, University of Naples Federico II, Via Pansini 5, 80131 Napoli, Italy
| | - Andrea Russo
- Department of Ophthalmology, University of Catania, 95123 Catania, Italy
| | - Antonio Longo
- Department of Ophthalmology, University of Catania, 95123 Catania, Italy
| | - Pier Luigi Surico
- Schepens Eye Research Institute of Mass Eye and Ear, Harvard Medical School, Boston, MA 02114, USA
- Department of Ophthalmology, Campus Bio-Medico University, 00128 Rome, Italy
| | - Caterina Gagliano
- Department of Medicine and Surgery, University of Enna “Kore”, Piazza dell’Università, 94100 Enna, Italy
- Eye Clinic, Catania University, San Marco Hospital, Viale Carlo Azeglio Ciampi, 95121 Catania, Italy
| | - Marco Zeppieri
- Department of Ophthalmology, University Hospital of Udine, 33100 Udine, Italy
| |
Collapse
|
32
|
Parravano M, Cennamo G, Di Antonio L, Grassi MO, Lupidi M, Rispoli M, Savastano MC, Veritti D, Vujosevic S. Multimodal imaging in diabetic retinopathy and macular edema: An update about biomarkers. Surv Ophthalmol 2024:S0039-6257(24)00075-4. [PMID: 38942124 DOI: 10.1016/j.survophthal.2024.06.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Revised: 06/18/2024] [Accepted: 06/24/2024] [Indexed: 06/30/2024]
Abstract
Diabetic macular edema (DME), defined as retinal thickening near, or involving the fovea caused by fluid accumulation in the retina, can lead to vision impairment and blindness in patients with diabetes. Current knowledge of retina anatomy and function and DME pathophysiology has taken great advantage of the availability of several techniques for visualizing the retina. Combining these techniques in a multimodal imaging approach to DME is recommended to improve diagnosis and to guide treatment decisions. We review the recent literature about the following retinal imaging technologies: optical coherence tomography (OCT), OCT angiography (OCTA), wide-field and ultrawide-field techniques applied to fundus photography, fluorescein angiography, and OCTA. The emphasis will be on characteristic DME features identified by these imaging technologies and their potential or established role as diagnostic, prognostic, or predictive biomarkers. The role of artificial intelligence in the assessment and interpretation of retina images is also discussed.
Collapse
Affiliation(s)
| | - Gilda Cennamo
- Eye Clinic, Public Health Department, University of Naples Federico II, Naples, Italy
| | - Luca Di Antonio
- UOC Ophthalmology and Surgery Department, ASL-1 Avezzano-Sulmona, L'Aquila, Italy
| | - Maria Oliva Grassi
- Eye Clinic, Azienda Ospedaliero-Universitaria Policlinico, University of Bari, Bari, Italy
| | - Marco Lupidi
- Eye Clinic, Department of Experimental and Clinical Medicine, Polytechnic University of Marche, Ancona, Italy
| | | | - Maria Cristina Savastano
- Ophthalmology Unit, Fondazione Policlinico Universitario A. Gemelli, IRCCS, Rome, Italy; Catholic University "Sacro Cuore", Rome, Italy
| | - Daniele Veritti
- Department of Medicine-Ophthalmology, University of Udine, Udine, Italy
| | - Stela Vujosevic
- Department of Biomedical, Surgical and Dental Sciences, University of Milan, Milan, Italy; Eye Clinic, IRCCS MultiMedica, Milan, Italy.
| |
Collapse
|
33
|
Papazafiropoulou AK. Diabetes management in the era of artificial intelligence. Arch Med Sci Atheroscler Dis 2024; 9:e122-e128. [PMID: 39086621 PMCID: PMC11289240 DOI: 10.5114/amsad/183420] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2024] [Accepted: 01/29/2024] [Indexed: 08/02/2024] Open
Abstract
Artificial intelligence is growing quickly, and its application in the global diabetes pandemic has the potential to completely change the way this chronic illness is identified and treated. Machine learning methods have been used to construct algorithms supporting predictive models for the risk of getting diabetes or its complications. Social media and Internet forums also increase patient participation in diabetes care. Diabetes resource usage optimisation has benefited from technological improvements. As a lifestyle therapy intervention, digital therapies have made a name for themselves in the treatment of diabetes. Artificial intelligence will cause a paradigm shift in diabetes care, moving away from current methods and toward the creation of focused, data-driven precision treatment.
Collapse
|
34
|
Zhang Z, Deng C, Paulus YM. Advances in Structural and Functional Retinal Imaging and Biomarkers for Early Detection of Diabetic Retinopathy. Biomedicines 2024; 12:1405. [PMID: 39061979 PMCID: PMC11274328 DOI: 10.3390/biomedicines12071405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2024] [Revised: 05/27/2024] [Accepted: 06/10/2024] [Indexed: 07/28/2024] Open
Abstract
Diabetic retinopathy (DR), a vision-threatening microvascular complication of diabetes mellitus (DM), is a leading cause of blindness worldwide that requires early detection and intervention. However, diagnosing DR early remains challenging due to the subtle nature of initial pathological changes. This review explores developments in multimodal imaging and functional tests for early DR detection. Where conventional color fundus photography is limited in the field of view and resolution, advanced quantitative analysis of retinal vessel traits such as retinal microvascular caliber, tortuosity, and fractal dimension (FD) can provide additional prognostic value. Optical coherence tomography (OCT) has also emerged as a reliable structural imaging tool for assessing retinal and choroidal neurodegenerative changes, which show potential as early DR biomarkers. Optical coherence tomography angiography (OCTA) enables the evaluation of vascular perfusion and the contours of the foveal avascular zone (FAZ), providing valuable insights into early retinal and choroidal vascular changes. Functional tests, including multifocal electroretinography (mfERG), visual evoked potential (VEP), multifocal pupillographic objective perimetry (mfPOP), microperimetry, and contrast sensitivity (CS), offer complementary data on early functional deficits in DR. More importantly, combining structural and functional imaging data may facilitate earlier detection of DR and targeted management strategies based on disease progression. Artificial intelligence (AI) techniques show promise for automated lesion detection, risk stratification, and biomarker discovery from various imaging data. Additionally, hematological parameters, such as neutrophil-lymphocyte ratio (NLR) and neutrophil extracellular traps (NETs), may be useful in predicting DR risk and progression. Although current methods can detect early DR, there is still a need for further research and development of reliable, cost-effective methods for large-scale screening and monitoring of individuals with DM.
Collapse
Affiliation(s)
- Zhengwei Zhang
- Department of Ophthalmology, Jiangnan University Medical Center, Wuxi 214002, China;
- Department of Ophthalmology, Wuxi No.2 People’s Hospital, Wuxi Clinical College, Nantong University, Wuxi 214002, China
- Department of Ophthalmology and Visual Sciences, University of Michigan, Ann Arbor, MI 48105, USA;
| | - Callie Deng
- Department of Ophthalmology and Visual Sciences, University of Michigan, Ann Arbor, MI 48105, USA;
| | - Yannis M. Paulus
- Department of Ophthalmology and Visual Sciences, University of Michigan, Ann Arbor, MI 48105, USA;
- Department of Biomedical Engineering, University of Michigan, 1000 Wall Street, Ann Arbor, MI 48105, USA
| |
Collapse
|
35
|
Chia MA, Antaki F, Zhou Y, Turner AW, Lee AY, Keane PA. Foundation models in ophthalmology. Br J Ophthalmol 2024:bjo-2024-325459. [PMID: 38834291 DOI: 10.1136/bjo-2024-325459] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Accepted: 04/26/2024] [Indexed: 06/06/2024]
Abstract
Foundation models represent a paradigm shift in artificial intelligence (AI), evolving from narrow models designed for specific tasks to versatile, generalisable models adaptable to a myriad of diverse applications. Ophthalmology as a specialty has the potential to act as an exemplar for other medical specialties, offering a blueprint for integrating foundation models broadly into clinical practice. This review hopes to serve as a roadmap for eyecare professionals seeking to better understand foundation models, while equipping readers with the tools to explore the use of foundation models in their own research and practice. We begin by outlining the key concepts and technological advances which have enabled the development of these models, providing an overview of novel training approaches and modern AI architectures. Next, we summarise existing literature on the topic of foundation models in ophthalmology, encompassing progress in vision foundation models, large language models and large multimodal models. Finally, we outline major challenges relating to privacy, bias and clinical validation, and propose key steps forward to maximise the benefit of this powerful technology.
Collapse
Affiliation(s)
- Mark A Chia
- Institute of Ophthalmology, University College London, London, UK
- NIHR Biomedical Research Centre, Moorfields Eye Hospital NHS Foundation Trust, London, UK
| | - Fares Antaki
- Institute of Ophthalmology, University College London, London, UK
- NIHR Biomedical Research Centre, Moorfields Eye Hospital NHS Foundation Trust, London, UK
- The CHUM School of Artificial Intelligence in Healthcare, Montreal, Quebec, Canada
| | - Yukun Zhou
- Institute of Ophthalmology, University College London, London, UK
- NIHR Biomedical Research Centre, Moorfields Eye Hospital NHS Foundation Trust, London, UK
| | - Angus W Turner
- Lions Outback Vision, Lions Eye Institute, Nedlands, Western Australia, Australia
- University of Western Australia, Perth, Western Australia, Australia
| | - Aaron Y Lee
- Department of Ophthalmology, University of Washington, Seattle, Washington, USA
- Roger and Angie Karalis Johnson Retina Center, University of Washington, Seattle, Washington, USA
| | - Pearse A Keane
- Institute of Ophthalmology, University College London, London, UK
- NIHR Biomedical Research Centre, Moorfields Eye Hospital NHS Foundation Trust, London, UK
| |
Collapse
|
36
|
Alami H, Lehoux P, Papoutsi C, Shaw SE, Fleet R, Fortin JP. Understanding the integration of artificial intelligence in healthcare organisations and systems through the NASSS framework: a qualitative study in a leading Canadian academic centre. BMC Health Serv Res 2024; 24:701. [PMID: 38831298 PMCID: PMC11149257 DOI: 10.1186/s12913-024-11112-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Accepted: 05/14/2024] [Indexed: 06/05/2024] Open
Abstract
BACKGROUND Artificial intelligence (AI) technologies are expected to "revolutionise" healthcare. However, despite their promises, their integration within healthcare organisations and systems remains limited. The objective of this study is to explore and understand the systemic challenges and implications of their integration in a leading Canadian academic hospital. METHODS Semi-structured interviews were conducted with 29 stakeholders concerned by the integration of a large set of AI technologies within the organisation (e.g., managers, clinicians, researchers, patients, technology providers). Data were collected and analysed using the Non-Adoption, Abandonment, Scale-up, Spread, Sustainability (NASSS) framework. RESULTS Among enabling factors and conditions, our findings highlight: a supportive organisational culture and leadership leading to a coherent organisational innovation narrative; mutual trust and transparent communication between senior management and frontline teams; the presence of champions, translators, and boundary spanners for AI able to build bridges and trust; and the capacity to attract technical and clinical talents and expertise. Constraints and barriers include: contrasting definitions of the value of AI technologies and ways to measure such value; lack of real-life and context-based evidence; varying patients' digital and health literacy capacities; misalignments between organisational dynamics, clinical and administrative processes, infrastructures, and AI technologies; lack of funding mechanisms covering the implementation, adaptation, and expertise required; challenges arising from practice change, new expertise development, and professional identities; lack of official professional, reimbursement, and insurance guidelines; lack of pre- and post-market approval legal and governance frameworks; diversity of the business and financing models for AI technologies; and misalignments between investors' priorities and the needs and expectations of healthcare organisations and systems. CONCLUSION Thanks to the multidimensional NASSS framework, this study provides original insights and a detailed learning base for analysing AI technologies in healthcare from a thorough socio-technical perspective. Our findings highlight the importance of considering the complexity characterising healthcare organisations and systems in current efforts to introduce AI technologies within clinical routines. This study adds to the existing literature and can inform decision-making towards a judicious, responsible, and sustainable integration of these technologies in healthcare organisations and systems.
Collapse
Affiliation(s)
- Hassane Alami
- Department of Health Management, Evaluation and Policy, School of Public Health, University of Montreal, P.O. Box 6128, Branch Centre-Ville, Montreal, QC, H3C 3J7, Canada.
- Center for Public Health Research of the University of Montreal, Montreal, QC, Canada.
- Institute for Data Valorization (IVADO), Montreal, QC, Canada.
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK.
| | - Pascale Lehoux
- Department of Health Management, Evaluation and Policy, School of Public Health, University of Montreal, P.O. Box 6128, Branch Centre-Ville, Montreal, QC, H3C 3J7, Canada
- Center for Public Health Research of the University of Montreal, Montreal, QC, Canada
| | - Chrysanthi Papoutsi
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Sara E Shaw
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Richard Fleet
- Faculty of Medicine, Laval University, Quebec, QC, Canada
- VITAM Research Centre on Sustainable Health, Faculty of Medicine, Laval University, Quebec, QC, Canada
| | - Jean-Paul Fortin
- Faculty of Medicine, Laval University, Quebec, QC, Canada
- VITAM Research Centre on Sustainable Health, Faculty of Medicine, Laval University, Quebec, QC, Canada
| |
Collapse
|
37
|
Doğan ME, Bilgin AB, Sari R, Bulut M, Akar Y, Aydemir M. Head to head comparison of diagnostic performance of three non-mydriatic cameras for diabetic retinopathy screening with artificial intelligence. Eye (Lond) 2024; 38:1694-1701. [PMID: 38467864 PMCID: PMC11156854 DOI: 10.1038/s41433-024-03000-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2023] [Revised: 01/24/2024] [Accepted: 02/15/2024] [Indexed: 03/13/2024] Open
Abstract
BACKGROUND Diabetic Retinopathy (DR) is a leading cause of blindness worldwide, affecting people with diabetes. The timely diagnosis and treatment of DR are essential in preventing vision loss. Non-mydriatic fundus cameras and artificial intelligence (AI) software have been shown to improve DR screening efficiency. However, few studies have compared the diagnostic performance of different non-mydriatic cameras and AI software. METHODS This clinical study was conducted at the endocrinology clinic of Akdeniz University with 900 volunteer patients that were previously diagnosed with diabetes but not with diabetic retinopathy. Fundus images of each patient were taken using three non-mydriatic fundus cameras and EyeCheckup AI software was used to diagnose more than mild diabetic retinopathy, vision-threatening diabetic retinopathy, and clinically significant diabetic macular oedema using images from all three cameras. Then patients underwent dilation and 4 wide-field fundus photography. Three retina specialists graded the 4 wide-field fundus images according to the diabetic retinopathy treatment preferred practice patterns of the American Academy of Ophthalmology. The study was pre-registered on clinicaltrials.gov with the ClinicalTrials.gov Identifier: NCT04805541. RESULTS The Canon CR2 AF AF camera had a sensitivity and specificity of 95.65% / 95.92% for diagnosing more than mild DR, the Topcon TRC-NW400 had 95.19% / 96.46%, and the Optomed Aurora had 90.48% / 97.21%. For vision threatening diabetic retinopathy, the Canon CR2 AF had a sensitivity and specificity of 96.00% / 96.34%, the Topcon TRC-NW400 had 98.52% / 95.93%, and the Optomed Aurora had 95.12% / 98.82%. For clinically significant diabetic macular oedema, the Canon CR2 AF had a sensitivity and specificity of 95.83% / 96.83%, the Topcon TRC-NW400 had 98.50% / 96.52%, and the Optomed Aurora had 94.93% / 98.95%. CONCLUSION The study demonstrates the potential of using non-mydriatic fundus cameras combined with artificial intelligence software in detecting diabetic retinopathy. Several cameras were tested and, notably, each camera exhibited varying but adequate levels of sensitivity and specificity. The Canon CR2 AF emerged with the highest accuracy in identifying both more than mild diabetic retinopathy and vision-threatening cases, while the Topcon TRC-NW400 excelled in detecting clinically significant diabetic macular oedema. The findings from this study emphasize the importance of considering a non mydriatic camera and artificial intelligence software for diabetic retinopathy screening. However, further research is imperative to explore additional factors influencing the efficiency of diabetic retinopathy screening using AI and non mydriatic cameras such as costs involved and effects of screening using and on an ethnically diverse population.
Collapse
Affiliation(s)
- Mehmet Erkan Doğan
- Department of Ophthalmology, Akdeniz University Faculty of Medicine, Antalya, Turkey.
| | - Ahmet Burak Bilgin
- Department of Ophthalmology, Akdeniz University Faculty of Medicine, Antalya, Turkey
| | - Ramazan Sari
- Endocrinology and Metabolic Department, Akdeniz University Faculty of Medicine, Antalya, Turkey
| | - Mehmet Bulut
- Department of Ophthalmology, Antalya Training and Research Hospital, Antalya, Turkey
| | - Yusuf Akar
- Endocrinology and Metabolic Department, Akdeniz University Faculty of Medicine, Antalya, Turkey
| | - Mustafa Aydemir
- Department of Ophthalmology, Akdeniz University Faculty of Medicine, Antalya, Turkey
| |
Collapse
|
38
|
Lozano AC, Serrano A, Salazar D, Rincón JV, Pardo Bayona M. Telemedicine for Screening and Follow-Up of Glaucoma: A Descriptive Study. Telemed J E Health 2024; 30:1901-1908. [PMID: 38662524 DOI: 10.1089/tmj.2023.0676] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/20/2024] Open
Abstract
Introduction: Glaucoma is a leading cause of irreversible blindness. It is a prevalent disease worldwide, affecting ∼70 million people and expected to reach up to 112 million by 2040. Purpose: The aim of this study is to describe the implementation and initial experience of a telemedicine program to monitor glaucoma and glaucoma suspect patients in a large, integrated health care system during the COVID-19 pandemic. Methods: A retrospective chart review of established glaucoma or glaucoma suspect patients who participated in a telemedicine evaluation at the ophthalmic center of a large, Colombian health care system between June 2020 and April 2023 was conducted. Clinical and sociodemographic variables were analyzed. Generated clinical orders for additional testing, surgical procedures, follow-ups, and referrals, as well as changes in medical treatment, were evaluated. Results: A total of 11,034 telemedicine consults were included. The mean ± standard deviation age of this group was 63 ± 17.2 years and 67% were female. Of the patients who attended teleconsults, 49% were glaucoma suspects and 38.5% were followed with a diagnosis of open-angle glaucoma. After the consult, 25% of patients were referred to a glaucoma specialist, 40% had additional testing ordered, and 8% had a surgical procedure ordered, mainly laser iridotomy (409 cases). Almost a third of patients returned for subsequent telemedicine visits after the initial encounter. Despite some technical difficulties, 99.8% of patients attended and completed their scheduled telemedicine appointments. Conclusions: A telemedicine program aimed to monitor established glaucoma patients can be successfully implemented. Established patients within an integrated health care system have high adherence to the virtual model. Further research by health care institutions and government agencies will be key to expand coverage to additional populations. Clinical Trial Registration Number: CEIFUS 1026-24.
Collapse
Affiliation(s)
- Andrea Caycedo Lozano
- Oftalmosanitas-Clínica Colsanitas (Colsanitas Clinic), Bogotá, Colombia
- Member of Vision Colombia Research Group, Bogota, Colombia
| | - Alejandro Serrano
- Clínica de Oftalmología San Diego (San Diego Ophthalmology Clinic), Medellín, Colombia
| | - Diana Salazar
- Ophthalmic Private Practice, Falls Church, Virginia, USA
| | - Juliana Vanessa Rincón
- Member of Vision Colombia Research Group, Bogota, Colombia
- Research Unit, Fundación Universitaria Sanitas (Unisanitas University), Bogotá, Colombia
| | - Mónica Pardo Bayona
- Member of Vision Colombia Research Group, Bogota, Colombia
- Research Unit, Fundación Universitaria Sanitas (Unisanitas University), Bogotá, Colombia
| |
Collapse
|
39
|
Mhibik B, Kouadio D, Jung C, Bchir C, Toutée A, Maestri F, Gulic K, Miere A, Falcione A, Touati M, Monnet D, Bodaghi B, Touhami S. AUTOMATED DETECTION OF VITRITIS USING ULTRAWIDE-FIELD FUNDUS PHOTOGRAPHS AND DEEP LEARNING. Retina 2024; 44:1034-1044. [PMID: 38261816 DOI: 10.1097/iae.0000000000004049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2024]
Abstract
BACKGROUND/PURPOSE Evaluate the performance of a deep learning algorithm for the automated detection and grading of vitritis on ultrawide-field imaging. METHODS Cross-sectional noninterventional study. Ultrawide-field fundus retinophotographs of uveitis patients were used. Vitreous haze was defined according to the six steps of the Standardization of Uveitis Nomenclature classification. The deep learning framework TensorFlow and the DenseNet121 convolutional neural network were used to perform the classification task. The best fitted model was tested in a validation study. RESULTS One thousand one hundred eighty-one images were included. The performance of the model for the detection of vitritis was good with a sensitivity of 91%, a specificity of 89%, an accuracy of 0.90, and an area under the receiver operating characteristics curve of 0.97. When used on an external set of images, the accuracy for the detection of vitritis was 0.78. The accuracy to classify vitritis in one of the six Standardization of Uveitis Nomenclature grades was limited (0.61) but improved to 0.75 when the grades were grouped into three categories. When accepting an error of one grade, the accuracy for the six-class classification increased to 0.90, suggesting the need for a larger sample to improve the model performances. CONCLUSION A new deep learning model based on ultrawide-field fundus imaging that produces an efficient tool for the detection of vitritis was described. The performance of the model for the grading into three categories of increasing vitritis severity was acceptable. The performance for the six-class grading of vitritis was limited but can probably be improved with a larger set of images.
Collapse
Affiliation(s)
- Bayram Mhibik
- Department of Ophthalmology, Sorbonne Université, Pitié Salpêtrière University Hospital, Paris, France
| | - Desire Kouadio
- Department of Ophthalmology, Centre Hospitalier Intercommunal de Créteil, Créteil, France
| | - Camille Jung
- Department of Ophthalmology, Centre Hospitalier Intercommunal de Créteil, Créteil, France
| | - Chemsedine Bchir
- Department of Mathematics and Engineering Applications, Sorbonne Université, Paris, France ; and
| | - Adelaide Toutée
- Department of Ophthalmology, Sorbonne Université, Pitié Salpêtrière University Hospital, Paris, France
| | - Federico Maestri
- Department of Ophthalmology, Sorbonne Université, Pitié Salpêtrière University Hospital, Paris, France
| | - Karmen Gulic
- Department of Ophthalmology, Sorbonne Université, Pitié Salpêtrière University Hospital, Paris, France
| | - Alexandra Miere
- Department of Ophthalmology, Centre Hospitalier Intercommunal de Créteil, Créteil, France
| | - Alessandro Falcione
- Department of Ophthalmology, Sorbonne Université, Pitié Salpêtrière University Hospital, Paris, France
| | - Myriam Touati
- Department of Ophthalmology, Sorbonne Université, Pitié Salpêtrière University Hospital, Paris, France
| | - Dominique Monnet
- Department of Ophthalmology, Université de Paris, Cochin University Hospital, Paris, France
| | - Bahram Bodaghi
- Department of Ophthalmology, Sorbonne Université, Pitié Salpêtrière University Hospital, Paris, France
| | - Sara Touhami
- Department of Ophthalmology, Sorbonne Université, Pitié Salpêtrière University Hospital, Paris, France
| |
Collapse
|
40
|
Melo GB, Nakayama LF, Cardoso VS, Dos Santos LA, Malerbi FK. Synchronous Diagnosis of Diabetic Retinopathy by a Handheld Retinal Camera, Artificial Intelligence, and Simultaneous Specialist Confirmation. Ophthalmol Retina 2024:S2468-6530(24)00236-7. [PMID: 38750937 DOI: 10.1016/j.oret.2024.05.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Revised: 05/07/2024] [Accepted: 05/07/2024] [Indexed: 06/16/2024]
Abstract
PURPOSE Diabetic retinopathy (DR) is a leading cause of preventable blindness, particularly in underserved regions where access to ophthalmic care is limited. This study presents a proof of concept for utilizing a portable handheld retinal camera with an embedded artificial intelligence (AI) platform, complemented by a synchronous remote confirmation by retina specialists, for DR screening in an underserved rural area. DESIGN Retrospective cohort study. SUBJECTS A total of 1115 individuals with diabetes. METHODS A retrospective analysis of a screening initiative conducted in 4 municipalities in Northeastern Brazil, targeting the diabetic population. A portable handheld retinal camera captured macula-centered and disc-centered images, which were analyzed by the AI system. Immediate push notifications were sent out to retina specialists upon the detection of significant abnormalities, enabling synchronous verification and confirmation, with on-site patient feedback within minutes. Referral criteria were established, and all referred patients underwent a complete ophthalmic work-up and subsequent treatment. MAIN OUTCOME MEASURES Proof-of-concept implementation success. RESULTS Out of 2052 invited individuals, 1115 participated, with a mean age of 60.93 years and diabetes duration of 7.52 years; 66.03% were women. The screening covered 2222 eyes, revealing various retinal conditions. Referable eyes for DR were 11.84%, with an additional 13% for other conditions (diagnoses included various stages of DR, media opacity, nevus, drusen, enlarged cup-to-disc ratio, pigmentary changes, and other). Artificial intelligence performance for overall detection of referable cases (both DR and other conditions) was as follows: sensitivity 84.23% (95% confidence interval (CI), 82.63-85.84), specificity 80.79% (95% CI, 79.05-82.53). When we assessed whether AI matched any clinical diagnosis, be it referable or not, sensitivity was 85.67% (95% CI, 84.12-87.22), specificity was 98.86 (95% CI, 98.39-99.33), and area under the curve was 0.92 (95% CI, 0.91-0.94). CONCLUSIONS The integration of a portable device, AI analysis, and synchronous medical validation has the potential to play a crucial role in preventing blindness from DR, especially in socially unequal scenarios. FINANCIAL DISCLOSURE(S) Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
Collapse
Affiliation(s)
- Gustavo Barreto Melo
- Department of Ophthalmology, Federal University of São Paulo, São Paulo-SP, Brazil; Hospital de Olhos de Sergipe, Aracaju-SE, Brazil; Retina Clinic, São Paulo-SP, Brazil.
| | - Luis Filipe Nakayama
- Department of Ophthalmology, Federal University of São Paulo, São Paulo-SP, Brazil; Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, Massachusetts
| | | | | | | |
Collapse
|
41
|
Martin E, Cook AG, Frost SM, Turner AW, Chen FK, McAllister IL, Nolde JM, Schlaich MP. Ocular biomarkers: useful incidental findings by deep learning algorithms in fundus photographs. Eye (Lond) 2024:10.1038/s41433-024-03085-2. [PMID: 38734746 DOI: 10.1038/s41433-024-03085-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2023] [Revised: 04/03/2024] [Accepted: 04/11/2024] [Indexed: 05/13/2024] Open
Abstract
BACKGROUND/OBJECTIVES Artificial intelligence can assist with ocular image analysis for screening and diagnosis, but it is not yet capable of autonomous full-spectrum screening. Hypothetically, false-positive results may have unrealized screening potential arising from signals persisting despite training and/or ambiguous signals such as from biomarker overlap or high comorbidity. The study aimed to explore the potential to detect clinically useful incidental ocular biomarkers by screening fundus photographs of hypertensive adults using diabetic deep learning algorithms. SUBJECTS/METHODS Patients referred for treatment-resistant hypertension were imaged at a hospital unit in Perth, Australia, between 2016 and 2022. The same 45° colour fundus photograph selected for each of the 433 participants imaged was processed by three deep learning algorithms. Two expert retinal specialists graded all false-positive results for diabetic retinopathy in non-diabetic participants. RESULTS Of the 29 non-diabetic participants misclassified as positive for diabetic retinopathy, 28 (97%) had clinically useful retinal biomarkers. The models designed to screen for fewer diseases captured more incidental disease. All three algorithms showed a positive correlation between severity of hypertensive retinopathy and misclassified diabetic retinopathy. CONCLUSIONS The results suggest that diabetic deep learning models may be responsive to hypertensive and other clinically useful retinal biomarkers within an at-risk, hypertensive cohort. Observing that models trained for fewer diseases captured more incidental pathology increases confidence in signalling hypotheses aligned with using self-supervised learning to develop autonomous comprehensive screening. Meanwhile, non-referable and false-positive outputs of other deep learning screening models could be explored for immediate clinical use in other populations.
Collapse
Affiliation(s)
- Eve Martin
- Commonwealth Scientific and Industrial Research Organisation (CSIRO), Kensington, WA, Australia.
- School of Population and Global Health, The University of Western Australia, Crawley, Australia.
- Dobney Hypertension Centre - Royal Perth Hospital Unit, Medical School, The University of Western Australia, Perth, Australia.
- Australian e-Health Research Centre, Floreat, WA, Australia.
| | - Angus G Cook
- School of Population and Global Health, The University of Western Australia, Crawley, Australia
| | - Shaun M Frost
- Commonwealth Scientific and Industrial Research Organisation (CSIRO), Kensington, WA, Australia
- Australian e-Health Research Centre, Floreat, WA, Australia
| | - Angus W Turner
- Lions Eye Institute, Nedlands, WA, Australia
- Centre for Ophthalmology and Visual Science, The University of Western Australia, Perth, Australia
| | - Fred K Chen
- Lions Eye Institute, Nedlands, WA, Australia
- Centre for Ophthalmology and Visual Science, The University of Western Australia, Perth, Australia
- Centre for Eye Research Australia, The Royal Victorian Eye and Ear Hospital, East Melbourne, VIC, Australia
- Ophthalmology, Department of Surgery, The University of Melbourne, East Melbourne, VIC, Australia
- Ophthalmology Department, Royal Perth Hospital, Perth, Australia
| | - Ian L McAllister
- Lions Eye Institute, Nedlands, WA, Australia
- Centre for Ophthalmology and Visual Science, The University of Western Australia, Perth, Australia
| | - Janis M Nolde
- Dobney Hypertension Centre - Royal Perth Hospital Unit, Medical School, The University of Western Australia, Perth, Australia
- Departments of Cardiology and Nephrology, Royal Perth Hospital, Perth, Australia
| | - Markus P Schlaich
- Dobney Hypertension Centre - Royal Perth Hospital Unit, Medical School, The University of Western Australia, Perth, Australia
- Departments of Cardiology and Nephrology, Royal Perth Hospital, Perth, Australia
| |
Collapse
|
42
|
Yao H, Wu Z, Gao SS, Guymer RH, Steffen V, Chen H, Hejrati M, Zhang M. Deep Learning Approaches for Detecting of Nascent Geographic Atrophy in Age-Related Macular Degeneration. OPHTHALMOLOGY SCIENCE 2024; 4:100428. [PMID: 38284101 PMCID: PMC10818248 DOI: 10.1016/j.xops.2023.100428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 10/31/2023] [Accepted: 11/08/2023] [Indexed: 01/30/2024]
Abstract
Purpose Nascent geographic atrophy (nGA) refers to specific features seen on OCT B-scans, which are strongly associated with the future development of geographic atrophy (GA). This study sought to develop a deep learning model to screen OCT B-scans for nGA that warrant further manual review (an artificial intelligence [AI]-assisted approach), and to determine the extent of reduction in OCT B-scan load requiring manual review while maintaining near-perfect nGA detection performance. Design Development and evaluation of a deep learning model. Participants One thousand eight hundred and eighty four OCT volume scans (49 B-scans per volume) without neovascular age-related macular degeneration from 280 eyes of 140 participants with bilateral large drusen at baseline, seen at 6-monthly intervals up to a 36-month period (from which 40 eyes developed nGA). Methods OCT volume and B-scans were labeled for the presence of nGA. Their presence at the volume scan level provided the ground truth for training a deep learning model to identify OCT B-scans that potentially showed nGA requiring manual review. Using a threshold that provided a sensitivity of 0.99, the B-scans identified were assigned the ground truth label with the AI-assisted approach. The performance of this approach for detecting nGA across all visits, or at the visit of nGA onset, was evaluated using fivefold cross-validation. Main Outcome Measures Sensitivity for detecting nGA, and proportion of OCT B-scans requiring manual review. Results The AI-assisted approach (utilizing outputs from the deep learning model to guide manual review) had a sensitivity of 0.97 (95% confidence interval [CI] = 0.93-1.00) and 0.95 (95% CI = 0.87-1.00) for detecting nGA across all visits and at the visit of nGA onset, respectively, when requiring manual review of only 2.7% and 1.9% of selected OCT B-scans, respectively. Conclusions A deep learning model could be used to enable near-perfect detection of nGA onset while reducing the number of OCT B-scans requiring manual review by over 50-fold. This AI-assisted approach shows promise for substantially reducing the current burden of manual review of OCT B-scans to detect this crucial feature that portends future development of GA. Financial Disclosures Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
Collapse
Affiliation(s)
- Heming Yao
- gRED Computational Science, Genentech, Inc., South San Francisco, California
| | - Zhichao Wu
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, Victoria, Australia
- Ophthalmology Division, Department of Surgery, The University of Melbourne, Melbourne, Victoria, Australia
| | - Simon S. Gao
- gRED Computational Science, Genentech, Inc., South San Francisco, California
| | - Robyn H. Guymer
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, Victoria, Australia
- Ophthalmology Division, Department of Surgery, The University of Melbourne, Melbourne, Victoria, Australia
| | - Verena Steffen
- gRED Computational Science, Genentech, Inc., South San Francisco, California
| | - Hao Chen
- gRED Computational Science, Genentech, Inc., South San Francisco, California
| | - Mohsen Hejrati
- gRED Computational Science, Genentech, Inc., South San Francisco, California
| | - Miao Zhang
- gRED Computational Science, Genentech, Inc., South San Francisco, California
| |
Collapse
|
43
|
Madadi Y, Delsoz M, Khouri AS, Boland M, Grzybowski A, Yousefi S. Applications of artificial intelligence-enabled robots and chatbots in ophthalmology: recent advances and future trends. Curr Opin Ophthalmol 2024; 35:238-243. [PMID: 38277274 PMCID: PMC10959691 DOI: 10.1097/icu.0000000000001035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2024]
Abstract
PURPOSE OF REVIEW Recent advances in artificial intelligence (AI), robotics, and chatbots have brought these technologies to the forefront of medicine, particularly ophthalmology. These technologies have been applied in diagnosis, prognosis, surgical operations, and patient-specific care in ophthalmology. It is thus both timely and pertinent to assess the existing landscape, recent advances, and trajectory of trends of AI, AI-enabled robots, and chatbots in ophthalmology. RECENT FINDINGS Some recent developments have integrated AI enabled robotics with diagnosis, and surgical procedures in ophthalmology. More recently, large language models (LLMs) like ChatGPT have shown promise in augmenting research capabilities and diagnosing ophthalmic diseases. These developments may portend a new era of doctor-patient-machine collaboration. SUMMARY Ophthalmology is undergoing a revolutionary change in research, clinical practice, and surgical interventions. Ophthalmic AI-enabled robotics and chatbot technologies based on LLMs are converging to create a new era of digital ophthalmology. Collectively, these developments portend a future in which conventional ophthalmic knowledge will be seamlessly integrated with AI to improve the patient experience and enhance therapeutic outcomes.
Collapse
Affiliation(s)
- Yeganeh Madadi
- Department of Ophthalmology, University of Tennessee Health Science Center, Memphis, TN, USA
| | - Mohammad Delsoz
- Department of Ophthalmology, University of Tennessee Health Science Center, Memphis, TN, USA
| | - Albert S. Khouri
- Institute of Ophthalmology and Visual Science, University of Medicine and Dentistry of New Jersey, NJ, USA
| | - Michael Boland
- Department of Ophthalmology, Massachusetts Eye and Ear, Boston, MA, USA
| | - Andrzej Grzybowski
- Institute for Research in Ophthalmology, Foundation for Ophthalmology Development, Poznan, Poland
| | - Siamak Yousefi
- Department of Ophthalmology, University of Tennessee Health Science Center, Memphis, TN, USA
- Department of Genetics, Genomics, and Informatics, University of Tennessee Health Science Center, Memphis, TN, USA
| |
Collapse
|
44
|
Salongcay RP, Aquino LAC, Alog GP, Locaylocay KB, Saunar AV, Peto T, Silva PS. Accuracy of Integrated Artificial Intelligence Grading Using Handheld Retinal Imaging in a Community Diabetic Eye Screening Program. OPHTHALMOLOGY SCIENCE 2024; 4:100457. [PMID: 38317871 PMCID: PMC10838904 DOI: 10.1016/j.xops.2023.100457] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Revised: 11/08/2023] [Accepted: 12/11/2023] [Indexed: 02/07/2024]
Abstract
Purpose To evaluate mydriatic handheld retinal imaging performance assessed by point-of-care (POC) artificial intelligence (AI) as compared with retinal image graders at a centralized reading center (RC) in identifying diabetic retinopathy (DR) and diabetic macular edema (DME). Design Prospective, comparative study. Subjects Five thousand five hundred eighty-five eyes from 2793 adult patients with diabetes. Methods Point-of-care AI assessment of disc and macular handheld retinal images was compared with RC evaluation of validated 5-field handheld retinal images (disc, macula, superior, inferior, and temporal) in identifying referable DR (refDR; defined as moderate nonproliferative DR [NPDR], or worse, or any level of DME) and vision-threatening DR (vtDR; defined as severe NPDR or worse, or any level of center-involving DME [ciDME]). Reading center evaluation of the 5-field images followed the international DR/DME classification. Sensitivity (SN) and specificity (SP) for ungradable images, refDR, and vtDR were calculated. Main Outcome Measures Agreement for DR and DME; SN and SP for refDR, vtDR, and ungradable images. Results Diabetic retinopathy severity by RC evaluation: no DR, 67.3%; mild NPDR, 9.7%; moderate NPDR, 8.6%; severe NPDR, 4.8%; proliferative DR, 3.8%; and ungradable, 5.8%. Diabetic macular edema severity by RC evaluation was as follows: no DME (80.4%), non-ciDME (7.7%), ciDME (4.4%), and ungradable (7.5%). Referable DR was present in 25.3% and vtDR was present in 17.5% of eyes. Images were ungradable for DR or DME in 7.5% by RC evaluation and 15.4% by AI. There was substantial agreement between AI and RC for refDR (κ = 0.66) and moderate agreement for vtDR (κ = 0.54). The SN/SP of AI grading compared with RC evaluation was 0.86/0.86 for refDR and 0.92/0.80 for vtDR. Conclusions This study demonstrates that POC AI following a defined handheld retinal imaging protocol at the time of imaging has SN and SP for refDR that meets the current United States Food and Drug Administration thresholds of 85% and 82.5%, but not for vtDR. Integrating AI at the POC could substantially reduce centralized RC burden and speed information delivery to the patient, allowing more prompt eye care referral. Financial Disclosures Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
Collapse
Affiliation(s)
- Recivall P. Salongcay
- Centre for Public Health, Queen’s University Belfast, Belfast, United Kingdom
- Philippine Eye Research Institute, University of the Philippines, Manila, Philippines
- Eye and Vision Institute, The Medical City, Metro Manila, Philippines
| | - Lizzie Anne C. Aquino
- Philippine Eye Research Institute, University of the Philippines, Manila, Philippines
| | - Glenn P. Alog
- Philippine Eye Research Institute, University of the Philippines, Manila, Philippines
- Eye and Vision Institute, The Medical City, Metro Manila, Philippines
| | - Kaye B. Locaylocay
- Philippine Eye Research Institute, University of the Philippines, Manila, Philippines
- Eye and Vision Institute, The Medical City, Metro Manila, Philippines
| | - Aileen V. Saunar
- Philippine Eye Research Institute, University of the Philippines, Manila, Philippines
- Eye and Vision Institute, The Medical City, Metro Manila, Philippines
| | - Tunde Peto
- Centre for Public Health, Queen’s University Belfast, Belfast, United Kingdom
| | - Paolo S. Silva
- Philippine Eye Research Institute, University of the Philippines, Manila, Philippines
- Eye and Vision Institute, The Medical City, Metro Manila, Philippines
- Beetham Eye Institute, Joslin Diabetes Center, Boston, Massachusetts
- Department of Ophthalmology, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
45
|
Mossburg S, Kilany M, Jinnett K, Nguyen C, Soles E, Wood-Palmer D, Aly M. A Rapid Review of Interventions to Improve Care for People Who Are Medically Underserved with Multiple Sclerosis, Diabetic Retinopathy, and Lung Cancer. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2024; 21:529. [PMID: 38791744 PMCID: PMC11121396 DOI: 10.3390/ijerph21050529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Revised: 04/11/2024] [Accepted: 04/19/2024] [Indexed: 05/26/2024]
Abstract
In the United States, patients with chronic conditions experience disparities in health outcomes across the care continuum. Among patients with multiple sclerosis, diabetic retinopathy, and lung cancer, there is a lack of evidence summarizing interventions to improve care and decrease these disparities. The aim of this rapid literature review was to identify interventions among patients with these chronic conditions to improve health and reduce disparities in screening, diagnosis, access to treatment and specialists, adherence, and retention in care. Using structured search terms in PubMed and Web of Science, we completed a rapid review of studies published in the prior five years conducted in the United States on our subject of focus. We screened the retrieved articles for inclusion and extracted data using a standard spreadsheet. The data were synthesized across clinical conditions and summarized. Screening was the most common point in the care continuum with documented interventions. Most studies we identified addressed interventions for patients with lung cancer, with half as many studies identified for patients with diabetic retinopathy, and few studies identified for patients with multiple sclerosis. Almost two-thirds of the studies focused on patients who identify as Black, Indigenous, or people of color. Interventions with evidence evaluating implementation in multiple conditions included telemedicine, mobile clinics, and insurance subsidies, or expansion. Despite documented disparities and a focus on health equity, a paucity of evidence exists on interventions that improve health outcomes among patients who are medically underserved with multiple sclerosis, diabetic retinopathy, and lung cancer.
Collapse
Affiliation(s)
- Sarah Mossburg
- American Institutes for Research, Arlington, VA 22202, USA
| | - Mona Kilany
- American Institutes for Research, Arlington, VA 22202, USA
| | - Kimberly Jinnett
- Department of Social and Behavioral Sciences, UCSF Institute for Health and Aging, San Francisco, CA 94158, USA
| | | | - Elena Soles
- American Institutes for Research, Arlington, VA 22202, USA
| | | | - Marwa Aly
- Department of Applied Health Sciences, School of Public Health, Indiana University Bloomington, Bloomington, IN 47405, USA
| |
Collapse
|
46
|
Musetti D, Cutolo CA, Bonetto M, Giacomini M, Maggi D, Viviani GL, Gandin I, Traverso CE, Nicolò M. Autonomous artificial intelligence versus teleophthalmology for diabetic retinopathy. Eur J Ophthalmol 2024:11206721241248856. [PMID: 38656241 DOI: 10.1177/11206721241248856] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/26/2024]
Abstract
Purpose: To assess the role of artificial intelligence (AI) based automated software for detection of Diabetic Retinopathy (DR) compared with the evaluation of digital retinography by two double masked retina specialists. Methods: Two-hundred one patients (mean age 65 ± 13 years) with type 1 diabetes mellitus or type 2 diabetes mellitus were included. All patients were undergoing a retinography and spectral domain optical coherence tomography (SD-OCT, DRI 3D OCT-2000, Topcon) of the macula. The retinal photographs were graded using two validated AI DR screening software (Eye Art TM and IDx-DR) designed to identify more than mild DR. Results: Retinal images of 201 patients were graded. DR (more than mild DR) was detected by the ophthalmologists in 38 (18.9%) patients and by the AI-algorithms in 36 patients (with 30 eyes diagnosed by both algorithms). Ungradable patients by the AI software were 13 (6.5%) and 16 (8%) for the Eye Art and IDx-DR, respectively. Both AI software strategies showed a high sensitivity and specificity for detecting any more than mild DR without showing any statistically significant difference between them. Conclusions: The comparison between the diagnosis provided by artificial intelligence based automated software and the reference clinical diagnosis showed that they can work at a level of sensitivity that is similar to that achieved by experts.
Collapse
Affiliation(s)
- Donatella Musetti
- Clinica Oculistica DiNOGMI, Università di Genova, Ospedale Policlinico San Martino IRCCS, Genova, Italy
| | - Carlo Alberto Cutolo
- Clinica Oculistica DiNOGMI, Università di Genova, Ospedale Policlinico San Martino IRCCS, Genova, Italy
| | | | | | - Davide Maggi
- Clinica Diabetologica, Università di Genova, Ospedale Policlinico San Martino IRCCS, Genova, Italy
| | - Giorgio Luciano Viviani
- Clinica Diabetologica, Università di Genova, Ospedale Policlinico San Martino IRCCS, Genova, Italy
| | - Ilaria Gandin
- Sciences, Biostatistic Unit, University of Trieste, Italy
| | - Carlo Enrico Traverso
- Clinica Oculistica DiNOGMI, Università di Genova, Ospedale Policlinico San Martino IRCCS, Genova, Italy
| | - Massimo Nicolò
- Clinica Oculistica DiNOGMI, Università di Genova, Ospedale Policlinico San Martino IRCCS, Genova, Italy
- Fondazione per la Macula onlus, Genova, Italy
| |
Collapse
|
47
|
Yap BP, Kelvin LZ, Toh EQ, Low KY, Rani SK, Goh EJH, Hui VYC, Ng BK, Lim TH. Generalizability of Deep Neural Networks for Vertical Cup-to-Disc Ratio Estimation in Ultra-Widefield and Smartphone-Based Fundus Images. Transl Vis Sci Technol 2024; 13:6. [PMID: 38568608 PMCID: PMC10996969 DOI: 10.1167/tvst.13.4.6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Accepted: 02/19/2024] [Indexed: 04/05/2024] Open
Abstract
Purpose To develop and validate a deep learning system (DLS) for estimation of vertical cup-to-disc ratio (vCDR) in ultra-widefield (UWF) and smartphone-based fundus images. Methods A DLS consisting of two sequential convolutional neural networks (CNNs) to delineate optic disc (OD) and optic cup (OC) boundaries was developed using 800 standard fundus images from the public REFUGE data set. The CNNs were tested on 400 test images from the REFUGE data set and 296 UWF and 300 smartphone-based images from a teleophthalmology clinic. vCDRs derived from the delineated OD/OC boundaries were compared with optometrists' annotations using mean absolute error (MAE). Subgroup analysis was conducted to study the impact of peripapillary atrophy (PPA), and correlation study was performed to investigate potential correlations between sectoral CDR (sCDR) and retinal nerve fiber layer (RNFL) thickness. Results The system achieved MAEs of 0.040 (95% CI, 0.037-0.043) in the REFUGE test images, 0.068 (95% CI, 0.061-0.075) in the UWF images, and 0.084 (95% CI, 0.075-0.092) in the smartphone-based images. There was no statistical significance in differences between PPA and non-PPA images. Weak correlation (r = -0.4046, P < 0.05) between sCDR and RNFL thickness was found only in the superior sector. Conclusions We developed a deep learning system that estimates vCDR from standard, UWF, and smartphone-based images. We also described anatomic peripapillary adversarial lesion and its potential impact on OD/OC delineation. Translational Relevance Artificial intelligence can estimate vCDR from different types of fundus images and may be used as a general and interpretable screening tool to improve community reach for diagnosis and management of glaucoma.
Collapse
Affiliation(s)
- Boon Peng Yap
- School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore, Singapore
| | - Li Zhenghao Kelvin
- Department of Ophthalmology, Tan Tock Seng Hospital, Singapore, Singapore
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
- National Healthcare Group Eye Institute, Singapore, Singapore
| | - En Qi Toh
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
| | - Kok Yao Low
- Department of Ophthalmology, Tan Tock Seng Hospital, Singapore, Singapore
- National Healthcare Group Eye Institute, Singapore, Singapore
| | - Sumaya Khan Rani
- Department of Ophthalmology, Tan Tock Seng Hospital, Singapore, Singapore
- National Healthcare Group Eye Institute, Singapore, Singapore
| | - Eunice Jin Hui Goh
- Department of Ophthalmology, Tan Tock Seng Hospital, Singapore, Singapore
- National Healthcare Group Eye Institute, Singapore, Singapore
| | - Vivien Yip Cherng Hui
- Department of Ophthalmology, Tan Tock Seng Hospital, Singapore, Singapore
- National Healthcare Group Eye Institute, Singapore, Singapore
| | - Beng Koon Ng
- School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore, Singapore
| | - Tock Han Lim
- Department of Ophthalmology, Tan Tock Seng Hospital, Singapore, Singapore
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
- National Healthcare Group Eye Institute, Singapore, Singapore
| |
Collapse
|
48
|
Chang C, Shi W, Wang Y, Zhang Z, Huang X, Jiao Y. The path from task-specific to general purpose artificial intelligence for medical diagnostics: A bibliometric analysis. Comput Biol Med 2024; 172:108258. [PMID: 38467093 DOI: 10.1016/j.compbiomed.2024.108258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Revised: 02/08/2024] [Accepted: 03/06/2024] [Indexed: 03/13/2024]
Abstract
Artificial intelligence (AI) has revolutionized many fields, and its potential in healthcare has been increasingly recognized. Based on diverse data sources such as imaging, laboratory tests, medical records, and electrophysiological data, diagnostic AI has witnessed rapid development in recent years. A comprehensive understanding of the development status, contributing factors, and their relationships in the application of AI to medical diagnostics is essential to further promote its use in clinical practice. In this study, we conducted a bibliometric analysis to explore the evolution of task-specific to general-purpose AI for medical diagnostics. We used the Web of Science database to search for relevant articles published between 2010 and 2023, and applied VOSviewer, the R package Bibliometrix, and CiteSpace to analyze collaborative networks and keywords. Our analysis revealed that the field of AI in medical diagnostics has experienced rapid growth in recent years, with a focus on tasks such as image analysis, disease prediction, and decision support. Collaborative networks were observed among researchers and institutions, indicating a trend of global cooperation in this field. Additionally, we identified several key factors contributing to the development of AI in medical diagnostics, including data quality, algorithm design, and computational power. Challenges to progress in the field include model explainability, robustness, and equality, which will require multi-stakeholder, interdisciplinary collaboration to tackle. Our study provides a holistic understanding of the path from task-specific, mono-modal AI toward general-purpose, multimodal AI for medical diagnostics. With the continuous improvement of AI technology and the accumulation of medical data, we believe that AI will play a greater role in medical diagnostics in the future.
Collapse
Affiliation(s)
- Chuheng Chang
- Department of General Practice (General Internal Medicine), Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China; 4+4 Medical Doctor Program, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China.
| | - Wen Shi
- Department of Gastroenterology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China.
| | - Youyang Wang
- Department of General Practice (General Internal Medicine), Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China.
| | - Zhan Zhang
- Department of Computer Science and Technology, Tsinghua University, Beijing, China.
| | - Xiaoming Huang
- Department of General Practice (General Internal Medicine), Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China.
| | - Yang Jiao
- Department of General Practice (General Internal Medicine), Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China.
| |
Collapse
|
49
|
Shamsunder S, Mishra A, Kumar A, Beriwal R, Ahluwalia C, Das S. Diagnostic Efficacy of Enhanced Visual Assessment [Visual Check] for Triaging Cervical Cancer Screen Positive Women. J Midlife Health 2024; 15:69-74. [PMID: 39145263 PMCID: PMC11321519 DOI: 10.4103/jmh.jmh_204_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Revised: 12/04/2023] [Accepted: 12/21/2023] [Indexed: 08/16/2024] Open
Abstract
Introduction Colposcopy is important for triaging any abnormal cervical screening test. Scarcity of trained colposcopists and colposcopy centers is a big hurdle to screening programs in low- and middle-income countries. Objectives of the Study The objective was to assess the performance of the artificial intelligence incorporated into the mobile optical device technologies (ODT) Enhanced Visual Assessment (EVA visual check) against physician colposcopic diagnosis and the gold standard of histopathology. Materials and Methods It was a cross-sectional observational study conducted on women referred to a colposcopy clinic following an abnormal screening test. Colposcopic examination was performed by colposcopists using the MobileODT EVA system. Physician's impression and Visual Check analysis were compared with the final histopathological analysis or cytology. Cases with normal cytology and normal colposcopy did not undergo biopsy, and these were considered normal. Results A total of 2050 women were screened, and 147 screen-positive women were recruited in the study. EVA Visual Check had a sensitivity of 86.8% (75-95), specificity of 28.7% (20-39), positive predictive value (PPV) of 40.7% (32-50), negative predictive value (NPV) of 79.4% (62-91), and diagnostic accuracy of 49.7% (41-58) for diagnosing cervical intraepithelial neoplasia (CIN) 1+ lesions. EVA Visual Check has a sensitivity of 89.3% (72-98), specificity of 26.1% (18-35), PPV of 22.1% (15-31), NPV of 91.2% (76-98), and diagnostic accuracy of 38.1% (30-46) for CIN 2+ lesions. Conclusion MobileODT EVA colposcope with AI has sensitivity comparable to physician's diagnosis, whereas specificity, PPV, and NPV were less than that of physician's diagnosis. It could prove valuable for triage of screen-positive women for further management.
Collapse
Affiliation(s)
- Saritha Shamsunder
- Department of Obstetrics and Gynaecology, Vardhman Mahavir Medical College and Safdarjung Hospital, New Delhi, India
| | - Archana Mishra
- Department of Obstetrics and Gynaecology, Vardhman Mahavir Medical College and Safdarjung Hospital, New Delhi, India
| | - Anita Kumar
- Department of Obstetrics and Gynaecology, Vardhman Mahavir Medical College and Safdarjung Hospital, New Delhi, India
| | - Rajni Beriwal
- Department of Obstetrics and Gynaecology, Vardhman Mahavir Medical College and Safdarjung Hospital, New Delhi, India
| | - Charanjeet Ahluwalia
- Department of Pathology, Vardhman Mahavir Medical College and Safdarjung Hospital, New Delhi, India
| | - Sujata Das
- Department of Obstetrics and Gynaecology, Vardhman Mahavir Medical College and Safdarjung Hospital, New Delhi, India
| |
Collapse
|
50
|
Lu MC, Deng C, Greenwald MF, Farsiu S, Prajna NV, Nallasamy N, Pawar M, Hart JN, S.R. S, Kochar P, Selvaraj S, Levine H, Amescua G, Sepulveda-Beltran PA, Niziol LM, Woodward MA. Automatic Classification of Slit-Lamp Photographs by Imaging Illumination. Cornea 2024; 43:419-424. [PMID: 37267474 PMCID: PMC10689570 DOI: 10.1097/ico.0000000000003318] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Accepted: 04/25/2023] [Indexed: 06/04/2023]
Abstract
PURPOSE The aim of this study was to facilitate deep learning systems in image annotations for diagnosing keratitis type by developing an automated algorithm to classify slit-lamp photographs (SLPs) based on illumination technique. METHODS SLPs were collected from patients with corneal ulcer at Kellogg Eye Center, Bascom Palmer Eye Institute, and Aravind Eye Care Systems. Illumination techniques were slit beam, diffuse white light, diffuse blue light with fluorescein, and sclerotic scatter (ScS). Images were manually labeled for illumination and randomly split into training, validation, and testing data sets (70%:15%:15%). Classification algorithms including MobileNetV2, ResNet50, LeNet, AlexNet, multilayer perceptron, and k-nearest neighborhood were trained to distinguish 4 type of illumination techniques. The algorithm performances on the test data set were evaluated with 95% confidence intervals (CIs) for accuracy, F1 score, and area under the receiver operator characteristics curve (AUC-ROC), overall and by class (one-vs-rest). RESULTS A total of 12,132 images from 409 patients were analyzed, including 41.8% (n = 5069) slit-beam photographs, 21.2% (2571) diffuse white light, 19.5% (2364) diffuse blue light, and 17.5% (2128) ScS. MobileNetV2 achieved the highest overall F1 score of 97.95% (CI, 97.94%-97.97%), AUC-ROC of 99.83% (99.72%-99.9%), and accuracy of 98.98% (98.97%-98.98%). The F1 scores for slit beam, diffuse white light, diffuse blue light, and ScS were 97.82% (97.80%-97.84%), 96.62% (96.58%-96.66%), 99.88% (99.87%-99.89%), and 97.59% (97.55%-97.62%), respectively. Slit beam and ScS were the 2 most frequently misclassified illumination. CONCLUSIONS MobileNetV2 accurately labeled illumination of SLPs using a large data set of corneal images. Effective, automatic classification of SLPs is key to integrating deep learning systems for clinical decision support into practice workflows.
Collapse
Affiliation(s)
- Ming-Chen Lu
- Department of Ophthalmology and Visual Sciences, School of Medicine, University of Michigan, Ann Arbor, MI, USA
| | - Callie Deng
- Department of Ophthalmology and Visual Sciences, School of Medicine, University of Michigan, Ann Arbor, MI, USA
| | - Miles F. Greenwald
- Department of Ophthalmology and Visual Sciences, School of Medicine, University of Michigan, Ann Arbor, MI, USA
| | - Sina Farsiu
- Departments of Biomedical Engineering, Duke University, Durham, NC, USA
- Department of Ophthalmology, Duke University Medical Center, Durham, NC, USA
| | | | - Nambi Nallasamy
- Department of Ophthalmology and Visual Sciences, School of Medicine, University of Michigan, Ann Arbor, MI, USA
- Department of Computational Medicine and Bioinformatics, University of Michigan, Ann Arbor, MI, USA
| | - Mercy Pawar
- Department of Ophthalmology and Visual Sciences, School of Medicine, University of Michigan, Ann Arbor, MI, USA
| | - Jenna N. Hart
- Department of Ophthalmology and Visual Sciences, School of Medicine, University of Michigan, Ann Arbor, MI, USA
| | | | | | | | - Harry Levine
- Bascom Palmer Eye Institute, Department of Ophthalmology, University of Miami Miller School of Medicine, Miami, FL, USA
| | - Guillermo Amescua
- Bascom Palmer Eye Institute, Department of Ophthalmology, University of Miami Miller School of Medicine, Miami, FL, USA
| | - Paula A. Sepulveda-Beltran
- Bascom Palmer Eye Institute, Department of Ophthalmology, University of Miami Miller School of Medicine, Miami, FL, USA
| | - Leslie M. Niziol
- Department of Ophthalmology and Visual Sciences, School of Medicine, University of Michigan, Ann Arbor, MI, USA
| | - Maria A. Woodward
- Department of Ophthalmology and Visual Sciences, School of Medicine, University of Michigan, Ann Arbor, MI, USA
- Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor, MI, USA
| | | |
Collapse
|