Diving Deep into Deep Learning: An Update on Artificial Intelligence in Retina

Artificial intelligence in retinal disease: clinical application, challenges, and future directions

Retinal diseases are a leading cause of blindness in developed countries, accounting for the largest share of visually impaired children, working-age adults (inherited retinal disease), and elderly individuals (age-related macular degeneration). These conditions need specialised clinicians to interpret multimodal retinal imaging, with diagnosis and intervention potentially delayed. With an increasing and ageing population, this is becoming a global health priority. One solution is the development of artificial intelligence (AI) software to facilitate rapid data processing. Herein, we review research offering decision support for the diagnosis, classification, monitoring, and treatment of retinal disease using AI. We have prioritised diabetic retinopathy, age-related macular degeneration, inherited retinal disease, and retinopathy of prematurity. There is cautious optimism that these algorithms will be integrated into routine clinical practice to facilitate access to vision-saving treatments, improve efficiency of healthcare systems, and assist clinicians in processing the ever-increasing volume of multimodal data, thereby also liberating time for doctor-patient interaction and co-development of personalised management plans.

Artificial intelligence to distinguish retinal vein occlusion patients using color fundus photographs

PURPOSE

Our aim is to establish an AI model for distinguishing color fundus photographs (CFP) of RVO patients from normal individuals.

METHODS

The training dataset included 2013 CFP from fellow eyes of RVO patients and 8536 age- and gender-matched normal CFP. Model performance was assessed in two independent testing datasets. We evaluated the performance of the AI model using the area under the receiver operating characteristic curve (AUC), accuracy, precision, specificity, sensitivity, and confusion matrices. We further explained the probable clinical relevance of the AI by extracting and comparing features of the retinal images.

RESULTS

Our model achieved an average AUC was 0.9866 (95% CI: 0.9805-0.9918), accuracy was 0.9534 (95% CI: 0.9421-0.9639), precision was 0.9123 (95% CI: 0.8784-9453), specificity was 0.9810 (95% CI: 0.9729-0.9884), and sensitivity was 0.8367 (95% CI: 0.7953-0.8756) for identifying fundus images of RVO patients in training dataset. In independent external datasets 1, the AUC of the RVO group was 0.8102 (95% CI: 0.7979-0.8226), the accuracy of 0.7752 (95% CI: 0.7633-0.7875), the precision of 0.7041 (95% CI: 0.6873-0.7211), specificity of 0.6499 (95% CI: 0.6305-0.6679) and sensitivity of 0.9124 (95% CI: 0.9004-0.9241) for RVO group. There were significant differences in retinal arteriovenous ratio, optic cup to optic disc ratio, and optic disc tilt angle (p = 0.001, p = 0.0001, and p = 0.0001, respectively) between the two groups in training dataset.

CONCLUSION

We trained an AI model to classify color fundus photographs of RVO patients with stable performance both in internal and external datasets. This may be of great importance for risk prediction in patients with retinal venous occlusion.

Focused Attention in Transformers for interpretable classification of retinal images

Vision Transformers have recently emerged as a competitive architecture in image classification. The tremendous popularity of this model and its variants comes from its high performance and its ability to produce interpretable predictions. However, both of these characteristics remain to be assessed in depth on retinal images. This study proposes a thorough performance evaluation of several Transformers compared to traditional Convolutional Neural Network (CNN) models for retinal disease classification. Special attention is given to multi-modality imaging (fundus and OCT) and generalization to external data. In addition, we propose a novel mechanism to generate interpretable predictions via attribution maps. Existing attribution methods from Transformer models have the disadvantage of producing low-resolution heatmaps. Our contribution, called Focused Attention, uses iterative conditional patch resampling to tackle this issue. By means of a survey involving four retinal specialists, we validated both the superior interpretability of Vision Transformers compared to the attribution maps produced from CNNs and the relevance of Focused Attention as a lesion detector.

[Use of artificial intelligence in screening for diabetic retinopathy at a tertiary diabetes center]

BACKGROUND

In 2018, IDx-DR was approved as a method to determine the degree of diabetic retinopathy (DR) using artificial intelligence (AI) by the FDA.

METHODS

We integrated IDx-DR into the consultation at a diabetology focus clinic and report the agreement between IDx-DR and fundoscopy as well as IDx-DR and ophthalmological image assessment and the influence of different camera systems.

RESULTS

Adequate image quality in miosis was achieved more frequently with the Topcon camera (n = 456; NW400, Topcon Medical Systems, Oakland, NJ, USA) compared with the Zeiss camera (n = 47; Zeiss VISUCAM 500, Carl Zeiss Meditec AG, Jena, Germany). Overall, IDx-DR analysis in miosis was possible in approximately 60% of the patients. All patients in whom IDx-DR analysis in miosis was not possible could be assessed by fundoscopy with dilated pupils. Within the group of images that could be evaluated, there was agreement between IDx-DR and ophthalmic fundoscopy in approximately 55%, overestimation of severity by IDx-DR in approximately 40% and underestimation in approximately 4%. The sensitivity (specificity) for detecting severe retinopathy requiring treatment was 95.7% (89.1%) for cases with fundus images that could be evaluated and 65.2% (66.7%) when all cases were considered (including those without images in miosis which could be evaluated). The kappa coefficient of 0.334 (p < 0.001) shows sufficient agreement between IDx-DR and physician's image analysis based on the fundus photograph, considering all patients with IDx-DR analysis that could be evaluated. The comparison between IDx-DR and the physician's funduscopy under the same conditions shows a low agreement with a kappa value of 0.168 (p < 0.001).

CONCLUSION

The present study shows the possibilities and limitations of AI-assisted DR screening. A major limitation is that sufficient images cannot be obtained in miosis in approximately 40% of patients. When sufficient images were available the IDx-DR and ophthalmological diagnosis matched in more than 50% of cases. Underestimation of severity by IDx-DR occurred only rarely. For integration into an ophthalmologist's practice, this system seems suitable. Without access to an ophthalmologist the high rate of insufficient images in miosis represents an important limitation.

Evaluation of the Effectiveness of Artificial Intelligence Chest CT Lung Nodule Detection Based on Deep Learning

Lung cancer is one of the most malignant tumors. If it can be detected early and treated actively, it can effectively improve a patient's survival rate. Therefore, early diagnosis of lung cancer is very important. Early-stage lung cancer usually appears as a solitary lung nodule on medical imaging. It usually appears as a round or nearly round dense shadow in the chest radiograph. It is difficult to distinguish lung nodules and lung soft tissues with the naked eye. Therefore, this article proposes a deep learning-based artificial intelligence chest CT lung nodule detection performance evaluation study, aiming to evaluate the value of chest CT imaging technology in the detection of noncalcified nodules and provide help for the detection and treatment of lung cancer. In this article, the Lung Medical Imaging Database Consortium (LIDC) was selected to obtain 536 usable cases based on inclusion criteria; 80 cases were selected for examination, artificial intelligence software, radiologists, and thoracic imaging specialists. Using 80 pulmonary nodules detection in each case, the pathological type of pulmonary nodules, nonlime tuberculous test results, detection sensitivity, false negative rate, false positive rate, and CT findings were individually analyzed, and the detection efficiency software of artificial intelligence was evaluated. Experiments have proved that the sensitivity of artificial intelligence software to detect noncalcified nodules in the pleural, peripheral, central, and hilar areas is higher than that of radiologists, indicating that the method proposed in this article has achieved good detection results. It has a better nodule detection sensitivity than a radiologist, reducing the complexity of the detection process.

Next-Generation Sequencing Applications for Inherited Retinal Diseases

Inherited retinal diseases (IRDs) represent a collection of phenotypically and genetically diverse conditions. IRDs phenotype(s) can be isolated to the eye or can involve multiple tissues. These conditions are associated with diverse forms of inheritance, and variants within the same gene often can be associated with multiple distinct phenotypes. Such aspects of the IRDs highlight the difficulty met when establishing a genetic diagnosis in patients. Here we provide an overview of cutting-edge next-generation sequencing techniques and strategies currently in use to maximise the effectivity of IRD gene screening. These techniques have helped researchers globally to find elusive causes of IRDs, including copy number variants, structural variants, new IRD genes and deep intronic variants, among others. Resolving a genetic diagnosis with thorough testing enables a more accurate diagnosis and more informed prognosis and should also provide information on inheritance patterns which may be of particular interest to patients of a child-bearing age. Given that IRDs are heritable conditions, genetic counselling may be offered to help inform family planning, carrier testing and prenatal screening. Additionally, a verified genetic diagnosis may enable access to appropriate clinical trials or approved medications that may be available for the condition.