Comparison of automated and expert human grading of diabetic retinopathy using smartphone-based retinal photography

Diagnostic Accuracy of Artificial Intelligence-Based Automated Diabetic Retinopathy Screening in Real-World Settings: A Systematic Review and Meta-Analysis

PURPOSE

To evaluate the diagnostic accuracy of artificial intelligence (AI)-based automated diabetic retinopathy (DR) screening in real-world settings.

DESIGN

Systematic review and meta-analysis METHODS: We conducted a systematic review of relevant literature from January 2012 to August 2022 using databases including PubMed, Scopus and Web of Science. The quality of studies was evaluated using Quality Assessment for Diagnostic Accuracy Studies 2 (QUADAS-2) checklist. We calculated pooled accuracy, sensitivity, specificity, and diagnostic odds ratio (DOR) as summary measures. The study protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO - CRD42022367034).

RESULTS

We included 34 studies which utilized AI algorithms for diagnosing DR based on real-world fundus images. Quality assessment of these studies indicated a low risk of bias and low applicability concern. Among gradable images, the overall pooled accuracy, sensitivity, specificity, and DOR were 81%, 94% (95% CI: 92.0-96.0), 89% (95% CI: 85.0-92.0) and 128 (95% CI: 80-204) respectively. Sub-group analysis showed that, when acceptable quality imaging could be obtained, non-mydriatic fundus images had a better DOR of 143 (95% CI: 82-251) and studies using 2 field images had a better DOR of 161 (95% CI 74-347). Our meta-regression analysis revealed a statistically significant association between DOR and variables such as the income status, and the type of fundus camera.

CONCLUSION

Our findings indicate that AI algorithms have acceptable performance in screening for DR using fundus images compared to human graders. Implementing a fundus camera with AI-based software has the potential to assist ophthalmologists in reducing their workload and improving the accuracy of DR diagnosis.

Advances in Structural and Functional Retinal Imaging and Biomarkers for Early Detection of Diabetic Retinopathy

Diabetic retinopathy (DR), a vision-threatening microvascular complication of diabetes mellitus (DM), is a leading cause of blindness worldwide that requires early detection and intervention. However, diagnosing DR early remains challenging due to the subtle nature of initial pathological changes. This review explores developments in multimodal imaging and functional tests for early DR detection. Where conventional color fundus photography is limited in the field of view and resolution, advanced quantitative analysis of retinal vessel traits such as retinal microvascular caliber, tortuosity, and fractal dimension (FD) can provide additional prognostic value. Optical coherence tomography (OCT) has also emerged as a reliable structural imaging tool for assessing retinal and choroidal neurodegenerative changes, which show potential as early DR biomarkers. Optical coherence tomography angiography (OCTA) enables the evaluation of vascular perfusion and the contours of the foveal avascular zone (FAZ), providing valuable insights into early retinal and choroidal vascular changes. Functional tests, including multifocal electroretinography (mfERG), visual evoked potential (VEP), multifocal pupillographic objective perimetry (mfPOP), microperimetry, and contrast sensitivity (CS), offer complementary data on early functional deficits in DR. More importantly, combining structural and functional imaging data may facilitate earlier detection of DR and targeted management strategies based on disease progression. Artificial intelligence (AI) techniques show promise for automated lesion detection, risk stratification, and biomarker discovery from various imaging data. Additionally, hematological parameters, such as neutrophil-lymphocyte ratio (NLR) and neutrophil extracellular traps (NETs), may be useful in predicting DR risk and progression. Although current methods can detect early DR, there is still a need for further research and development of reliable, cost-effective methods for large-scale screening and monitoring of individuals with DM.

Smartphone Eye Examination: Artificial Intelligence and Telemedicine

Background: The current medical scenario is closely linked to recent progress in telecommunications, photodocumentation, and artificial intelligence (AI). Smartphone eye examination may represent a promising tool in the technological spectrum, with special interest for primary health care services. Obtaining fundus imaging with this technique has improved and democratized the teaching of fundoscopy, but in particular, it contributes greatly to screening diseases with high rates of blindness. Eye examination using smartphones essentially represents a cheap and safe method, thus contributing to public policies on population screening. This review aims to provide an update on the use of this resource and its future prospects, especially as a screening and ophthalmic diagnostic tool. Methods: In this review, we surveyed major published advances in retinal and anterior segment analysis using AI. We performed an electronic search on the Medical Literature Analysis and Retrieval System Online (MEDLINE), EMBASE, and Cochrane Library for published literature without a deadline. We included studies that compared the diagnostic accuracy of smartphone ophthalmoscopy for detecting prevalent diseases with an accurate or commonly employed reference standard. Results: There are few databases with complete metadata, providing demographic data, and few databases with sufficient images involving current or new therapies. It should be taken into consideration that these are databases containing images captured using different systems and formats, with information often being excluded without essential detailing of the reasons for exclusion, which further distances them from real-life conditions. The safety, portability, low cost, and reproducibility of smartphone eye images are discussed in several studies, with encouraging results. Conclusions: The high level of agreement between conventional and a smartphone method shows a powerful arsenal for screening and early diagnosis of the main causes of blindness, such as cataract, glaucoma, diabetic retinopathy, and age-related macular degeneration. In addition to streamlining the medical workflow and bringing benefits for public health policies, smartphone eye examination can make safe and quality assessment available to the population.

Evaluation of the Performance of a 3D-Printed Smartphone-Based Retinal Imaging Device as a Screening Tool for Retinal Pathology in Mozambique

Low-income countries carry approximately 90% of the global burden of visual impairment, and up to 80% of this could be prevented or cured. However, there are only a few studies on the prevalence of retinal disease in these countries. Easier access to retinal information would allow differential diagnosis and promote strategies to improve eye health, which are currently scarce. This pilot study aims to evaluate the functionality and usability of a tele-retinography system for the detection of retinal pathology, based on a low-cost portable retinal scanner, manufactured with 3D printing and controlled by a mobile phone with an application designed ad hoc. The study was conducted at the Manhiça Rural Hospital in Mozambique. General practitioners, with no specific knowledge of ophthalmology or previous use of retinography, performed digital retinographies on 104 hospitalized patients. The retinographies were acquired in video format, uploaded to a web platform, and reviewed centrally by two ophthalmologists, analyzing the image quality and the presence of retinal lesions. In our sample there was a high proportion of exudates and hemorrhages-8% and 4%, respectively. In addition, the presence of lesions was studied in patients with known underlying risk factors for retinal disease, such as HIV, diabetes, and/or hypertension. Our tele-retinography system based on a smartphone coupled with a simple and low-cost 3D printed device is easy to use by healthcare personnel without specialized ophthalmological knowledge and could be applied for the screening and initial diagnosis of retinal pathology.

Diabetic Retinopathy Screening Using a Portable Retinal Camera in Vanuatu

Background and Objective

Proof-of-concept study to test the feasibility of using an all-in-one portable retinal camera for the screening of diabetic retinopathy in the Pacific Island of Vanuatu, which has a high rate of diabetes and its associated complications and a dearth of ophthalmologists.

Study Design/Materials and methods

From February 10, 2020, through February 28, 2020, 49 patients with diabetes mellitus from three islands in Vanuatu were recruited to participate in the study. Demographics, basic health data and retinal photography were obtained. A non-mydriatic, handheld camera was used (Volk Pictor Plus).

Results

Eleven participants (24%) had referral-warranted diabetic retinopathy. There was moderately high inter-rater reliability for our dependent variables: referral status (κ = 0.62, 95% CI 0.42-0.83), retinopathy severity (κ = 0.76, 95% CI 0.55-0.96), and clinically significant macular edema (κ = 0.50, 95% CI 0.25-0.74).

Conclusion

Our study confirms that portable handheld cameras can be used to obtain retinal images of sufficient quality for diabetic retinopathy screening even in resource limited environments like Vanuatu. Among this cohort, a relatively high (24%) prevalence of referral-warranted diabetic retinopathy was found in Vanuatu.

Single retinal image for diabetic retinopathy screening: performance of a handheld device with embedded artificial intelligence

BACKGROUND

Diabetic retinopathy (DR) is a leading cause of blindness. Our objective was to evaluate the performance of an artificial intelligence (AI) system integrated into a handheld smartphone-based retinal camera for DR screening using a single retinal image per eye.

METHODS

Images were obtained from individuals with diabetes during a mass screening program for DR in Blumenau, Southern Brazil, conducted by trained operators. Automatic analysis was conducted using an AI system (EyerMaps™, Phelcom Technologies LLC, Boston, USA) with one macula-centered, 45-degree field of view retinal image per eye. The results were compared to the assessment by a retinal specialist, considered as the ground truth, using two images per eye. Patients with ungradable images were excluded from the analysis.

RESULTS

A total of 686 individuals (average age 59.2 ± 13.3 years, 56.7% women, diabetes duration 12.1 ± 9.4 years) were included in the analysis. The rates of insulin use, daily glycemic monitoring, and systemic hypertension treatment were 68.4%, 70.2%, and 70.2%, respectively. Although 97.3% of patients were aware of the risk of blindness associated with diabetes, more than half of them underwent their first retinal examination during the event. The majority (82.5%) relied exclusively on the public health system. Approximately 43.4% of individuals were either illiterate or had not completed elementary school. DR classification based on the ground truth was as follows: absent or nonproliferative mild DR 86.9%, more than mild (mtm) DR 13.1%. The AI system achieved sensitivity, specificity, positive predictive value, and negative predictive value percentages (95% CI) for mtmDR as follows: 93.6% (87.8-97.2), 71.7% (67.8-75.4), 42.7% (39.3-46.2), and 98.0% (96.2-98.9), respectively. The area under the ROC curve was 86.4%.

CONCLUSION

The portable retinal camera combined with AI demonstrated high sensitivity for DR screening using only one image per eye, offering a simpler protocol compared to the traditional approach of two images per eye. Simplifying the DR screening process could enhance adherence rates and overall program coverage.

Deep learning for automated detection of neovascular leakage on ultra-widefield fluorescein angiography in diabetic retinopathy

Diabetic retinopathy is a leading cause of blindness in working-age adults worldwide. Neovascular leakage on fluorescein angiography indicates progression to the proliferative stage of diabetic retinopathy, which is an important distinction that requires timely ophthalmic intervention with laser or intravitreal injection treatment to reduce the risk of severe, permanent vision loss. In this study, we developed a deep learning algorithm to detect neovascular leakage on ultra-widefield fluorescein angiography images obtained from patients with diabetic retinopathy. The algorithm, an ensemble of three convolutional neural networks, was able to accurately classify neovascular leakage and distinguish this disease marker from other angiographic disease features. With additional real-world validation and testing, our algorithm could facilitate identification of neovascular leakage in the clinical setting, allowing timely intervention to reduce the burden of blinding diabetic eye disease.

Development and validation of a risk prediction model for diabetic retinopathy in type 2 diabetic patients

To establish a risk prediction model and make individualized assessment for the susceptible diabetic retinopathy (DR) population in type 2 diabetic mellitus (T2DM) patients. According to the retrieval strategy, inclusion and exclusion criteria, the relevant meta-analyses on DR risk factors were searched and evaluated. The pooled odds ratio (OR) or relative risk (RR) of each risk factor was obtained and calculated for β coefficients using logistic regression (LR) model. Besides, an electronic patient-reported outcome questionnaire was developed and 60 cases of DR and non-DR T2DM patients were investigated to validate the developed model. Receiver operating characteristic curve (ROC) was drawn to verify the prediction accuracy of the model. After retrieving, eight meta-analyses with a total of 15,654 cases and 12 risk factors associated with the onset of DR in T2DM, including weight loss surgery, myopia, lipid-lowing drugs, intensive glucose control, course of T2DM, glycated hemoglobin (HbA1c), fasting plasma glucose, hypertension, gender, insulin treatment, residence, and smoking were included for LR modeling. These factors, followed by the respective β coefficient was bariatric surgery (− 0.942), myopia (− 0.357), lipid-lowering drug follow-up < 3y (− 0.994), lipid-lowering drug follow-up > 3y (− 0.223), course of T2DM (0.174), HbA1c (0.372), fasting plasma glucose (0.223), insulin therapy (0.688), rural residence (0.199), smoking (− 0.083), hypertension (0.405), male (0.548), intensive glycemic control (− 0.400) with constant term α (− 0.949) in the constructed model. The area under receiver operating characteristic curve (AUC) of the model in the external validation was 0.912. An application was presented as an example of use. In conclusion, the risk prediction model of DR is developed, which makes individualized assessment for the susceptible DR population feasible and needs to be further verified with large sample size application.

Artificial Intelligence for Diabetic Retinopathy Screening Using Color Retinal Photographs: From Development to Deployment

Diabetic retinopathy (DR), a leading cause of preventable blindness, is expected to remain a growing health burden worldwide. Screening to detect early sight-threatening lesions of DR can reduce the burden of vision loss; nevertheless, the process requires intensive manual labor and extensive resources to accommodate the increasing number of patients with diabetes. Artificial intelligence (AI) has been shown to be an effective tool which can potentially lower the burden of screening DR and vision loss. In this article, we review the use of AI for DR screening on color retinal photographs in different phases of application, ranging from development to deployment. Early studies of machine learning (ML)-based algorithms using feature extraction to detect DR achieved a high sensitivity but relatively lower specificity. Robust sensitivity and specificity were achieved with the application of deep learning (DL), although ML is still used in some tasks. Public datasets were utilized in retrospective validations of the developmental phases in most algorithms, which require a large number of photographs. Large prospective clinical validation studies led to the approval of DL for autonomous screening of DR although the semi-autonomous approach may be preferable in some real-world settings. There have been few reports on real-world implementations of DL for DR screening. It is possible that AI may improve some real-world indicators for eye care in DR, such as increased screening uptake and referral adherence, but this has not been proven. The challenges in deployment may include workflow issues, such as mydriasis to lower ungradable cases; technical issues, such as integration into electronic health record systems and integration into existing camera systems; ethical issues, such as data privacy and security; acceptance of personnel and patients; and health-economic issues, such as the need to conduct health economic evaluations of using AI in the context of the country. The deployment of AI for DR screening should follow the governance model for AI in healthcare which outlines four main components: fairness, transparency, trustworthiness, and accountability.

A Comparison of Artificial Intelligence and Human Diabetic Retinal Image Interpretation in an Urban Health System

INTRODUCTION

Artificial intelligence (AI) diabetic retinopathy (DR) software has the potential to decrease time spent by clinicians on image interpretation and expand the scope of DR screening. We performed a retrospective review to compare Eyenuk's EyeArt software (Woodland Hills, CA) to Temple Ophthalmology optometry grading using the International Classification of Diabetic Retinopathy scale.

METHODS

Two hundred and sixty consecutive diabetic patients from the Temple Faculty Practice Internal Medicine clinic underwent 2-field retinal imaging. Classifications of the images by the software and optometrist were analyzed using sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and McNemar's test. Ungradable images were analyzed to identify relationships with HbA1c, age, and ethnicity. Disagreements and a sample of 20% of agreements were adjudicated by a retina specialist.

RESULTS

On patient level comparison, sensitivity for the software was 100%, while specificity was 77.78%. PPV was 19.15%, and NPV was 100%. The 38 disagreements between software and optometrist occurred when the optometrist classified a patient's images as non-referable while the software classified them as referable. Of these disagreements, a retina specialist agreed with the optometrist 57.9% the time (22/38). Of the agreements, the retina specialist agreed with both the program and the optometrist 96.7% of the time (28/29). There was a significant difference in numbers of ungradable photos in older patients (≥60) vs younger patients (<60) (p=0.003).

CONCLUSIONS

The AI program showed high sensitivity with acceptable specificity for a screening algorithm. The high NPV indicates that the software is unlikely to miss DR but may refer patients unnecessarily.

Optimized hybrid machine learning approach for smartphone based diabetic retinopathy detection

Diabetic Retinopathy (DR) is defined as the Diabetes Mellitus difficulty that harms the blood vessels in the retina. It is also known as a silent disease and cause mild vision issues or no symptoms. In order to enhance the chances of effective treatment, yearly eye tests are vital for premature discovery. Hence, it uses fundus cameras for capturing retinal images, but due to its size and cost, it is a troublesome for extensive screening. Therefore, the smartphones are utilized for scheming low-power, small-sized, and reasonable retinal imaging schemes to activate automated DR detection and DR screening. In this article, the new DIY (do it yourself) smartphone enabled camera is used for smartphone based DR detection. Initially, the preprocessing like green channel transformation and CLAHE (Contrast Limited Adaptive Histogram Equalization) are performed. Further, the segmentation process starts with optic disc segmentation by WT (watershed transform) and abnormality segmentation (Exudates, microaneurysms, haemorrhages, and IRMA) by Triplet half band filter bank (THFB). Then the different features are extracted by Haralick and ADTCWT (Anisotropic Dual Tree Complex Wavelet Transform) methods. Using life choice-based optimizer (LCBO) algorithm, the optimal features are chosen from the mined features. Then the selected features are applied to the optimized hybrid ML (machine learning) classifier with the combination of NN and DCNN (Deep Convolutional Neural Network) in which the SSD (Social Ski-Driver) is utilized for the best weight values of hybrid classifier to categorize the severity level as mild DR, severe DR, normal, moderate DR, and Proliferative DR. The proposed work is simulated in python environment and to test the efficiency of the proposed scheme the datasets like APTOS-2019-Blindness-Detection, and EyePacs are used. The model has been evaluated using different performance metrics. The simulation results verified that the suggested scheme is provides well accuracy for each dataset than other current approaches.

Clinical Role of Smartphone Fundus Imaging in Diabetic Retinopathy and Other Neuro-retinal Diseases

Purpose: In today's life, many electronic gadgets have the potential to become invaluable health care devices in future. The gadgets in this category include smartphones, smartwatches, and others. Till now, smartphone role has been highlighted on many occasions in different areas, and they continue to possess immense role in clinical documentation, clinical consultation, and digitalization of ocular care. In last one decade, many treatable conditions including diabetic retinopathy, glaucoma, and other pediatric retinal diseases are being imaged using smartphones.Methods: To comprehend this cumulative knowledge, a detailed medical literature search was conducted on PubMed/Medline, Scopus, and Web of Science till February 2021.Results: The included literature revealed a definitive progress in posterior segment imaging. From simple torch light with smartphone examination to present day compact handy devices with artificial intelligence integrated software's have changed the very perspectives of ocular imaging in ophthalmology. The consistently reproducible results, constantly improving imaging techniques, and most importantly their affordable costs have renegotiated their role as effective screening devices in ophthalmology. Moreover, the obtained field of view, ocular safety, and their key utility in non-ophthalmic specialties are also growing.Conclusions: To conclude, smartphone imaging can now be considered as a quick, cost-effective, and digitalized tool for posterior segment screenings, however, their definite role in routine ophthalmic clinics is yet to be established.

Deep learning-based automated detection for diabetic retinopathy and diabetic macular oedema in retinal fundus photographs

OBJECTIVES

To present and validate a deep ensemble algorithm to detect diabetic retinopathy (DR) and diabetic macular oedema (DMO) using retinal fundus images.

METHODS

A total of 8739 retinal fundus images were collected from a retrospective cohort of 3285 patients. For detecting DR and DMO, a multiple improved Inception-v4 ensembling approach was developed. We measured the algorithm's performance and made a comparison with that of human experts on our primary dataset, while its generalization was assessed on the publicly available Messidor-2 dataset. Also, we investigated systematically the impact of the size and number of input images used in training on model's performance, respectively. Further, the time budget of training/inference versus model performance was analyzed.

RESULTS

On our primary test dataset, the model achieved an 0.992 (95% CI, 0.989-0.995) AUC corresponding to 0.925 (95% CI, 0.916-0.936) sensitivity and 0.961 (95% CI, 0.950-0.972) specificity for referable DR, while the sensitivity and specificity for ophthalmologists ranged from 0.845 to 0.936, and from 0.912 to 0.971, respectively. For referable DMO, our model generated an AUC of 0.994 (95% CI, 0.992-0.996) with a 0.930 (95% CI, 0.919-0.941) sensitivity and 0.971 (95% CI, 0.965-0.978) specificity, whereas ophthalmologists obtained sensitivities ranging between 0.852 and 0.946, and specificities ranging between 0.926 and 0.985.

CONCLUSION

This study showed that the deep ensemble model exhibited excellent performance in detecting DR and DMO, and had good robustness and generalization, which could potentially help support and expand DR/DMO screening programs.