Medical image classification based on artificial intelligence approaches: A practical study on normal and abnormal confocal corneal images

Development of the AI Pipeline for Corneal Opacity Detection

Ophthalmological services face global inadequacies, especially in low- and middle-income countries, which are marked by a shortage of practitioners and equipment. This study employed a portable slit lamp microscope with video capabilities and cloud storage for more equitable global diagnostic resource distribution. To enhance accessibility and quality of care, this study targets corneal opacity, which is a global cause of blindness. This study has two purposes. The first is to detect corneal opacity from videos in which the anterior segment of the eye is captured. The other is to develop an AI pipeline to detect corneal opacities. First, we extracted image frames from videos and processed them using a convolutional neural network (CNN) model. Second, we manually annotated the images to extract only the corneal margins, adjusted the contrast with CLAHE, and processed them using the CNN model. Finally, we performed semantic segmentation of the cornea using annotated data. The results showed an accuracy of 0.8 for image frames and 0.96 for corneal margins. Dice and IoU achieved a score of 0.94 for semantic segmentation of the corneal margins. Although corneal opacity detection from video frames seemed challenging in the early stages of this study, manual annotation, corneal extraction, and CLAHE contrast adjustment significantly improved accuracy. The incorporation of manual annotation into the AI pipeline, through semantic segmentation, facilitated high accuracy in detecting corneal opacity.

A Deep Learning Approach for Meibomian Gland Appearance Evaluation

Purpose

To develop and evaluate a deep learning algorithm for Meibomian gland characteristics calculation.

Design

Evaluation of diagnostic technology.

Subjects

A total of 1616 meibography images of both the upper (697) and lower (919) eyelids from a total of 282 individuals.

Methods

Images were collected using the LipiView II device. All the provided data were split into 3 sets: the training, validation, and test sets. Data partitions used proportions of 70/10/20% and included data from 2 optometry settings. Each set was separately partitioned with these proportions, resulting in a balanced distribution of data from both settings. The images were divided based on patient identifiers, such that all images collected for one participant could end up only in one set. The labeled images were used to train a deep learning model, which was subsequently used for Meibomian gland segmentation. The model was then applied to calculate individual Meibomian gland metrics. Interreader agreement and agreement between manual and automated methods for Meibomian gland segmentation were also carried out to assess the accuracy of the automated approach.

Main Outcome Measures

Meibomian gland metrics, including length ratio, area, tortuosity, intensity, and width, were measured. Additionally, the performance of the automated algorithms was evaluated using the aggregated Jaccard index.

Results

The proposed semantic segmentation-based approach achieved average aggregated Jaccard index of mean 0.4718 (95% confidence interval [CI], 0.4680-0.4771) for the 'gland' class and a mean of 0.8470 (95% CI, 0.8432-0.8508) for the 'eyelid' class. The result for object detection-based approach was a mean of 0.4476 (95% CI, 0.4426-0.4533). Both artificial intelligence-based algorithms underestimated area, length ratio, tortuosity, widthmean, widthmedian, width10th, and width90th. Meibomian gland intensity was overestimated by both algorithms compared with the manual approach. The object detection-based algorithm seems to be as reliable as the manual approach only for Meibomian gland width10th calculation.

Conclusions

The proposed approach can successfully segment Meibomian glands; however, to overcome problems with gland overlap and lack of image sharpness, the proposed method requires further development. The study presents another approach to utilizing automated, artificial intelligence-based methods in Meibomian gland health assessment that may assist clinicians in the diagnosis, treatment, and management of Meibomian gland dysfunction.

Financial Disclosures

The authors have no proprietary or commercial interest in any materials discussed in this article.

Everything real about unreal artificial intelligence in diabetic retinopathy and in ocular pathologies

Artificial Intelligence is a multidisciplinary field with the aim of building platforms that can make machines act, perceive, reason intelligently and whose goal is to automate activities that presently require human intelligence. From the cornea to the retina, artificial intelligence (AI) is expected to help ophthalmologists diagnose and treat ocular diseases. In ophthalmology, computerized analytics are being viewed as efficient and more objective ways to interpret the series of images and come to a conclusion. AI can be used to diagnose and grade diabetic retinopathy, glaucoma, age-related macular degeneration, cataracts, IOL power calculation, retinopathy of prematurity and keratoconus. This review article intends to discuss various aspects of artificial intelligence in ophthalmology.

Segmentation of endothelial cells of the cornea from the distance map of confocal microscope images

We propose a novel algorithm for segmenting cells of the cornea endothelium layer on confocal microscope images. To get an inter-cellular space with minimum gray-scale value and to enhance cell borders, we apply a difference of Gaussian filter before image binarization by thresholding with the minimum gray-scale value. Removal of segmented noise and artifacts is performed by automatic thresholding (using an image frequency analysis to obtain a global threshold value per image). Final segmentation of cells is achieved by fitting the largest inscribed circles into the centers of cell regions defined by the distance map of the binary images. Parameters of interest such as cell count and density, pleomorphism, polymegathism, and F-measure are computed on a publicly available data-set (Confocal Corneal Endothelial Microscopy Data Set - Rotterdam Ophthalmic Data Repository) and compared against the results of the segmentation methods included with the data set, and the results of state of the art automatic methods. The obtained results achieve higher accuracy compared to the results of the segmentation included with the data set (e.g., -proposed versus dataset in R² and mean relative error-, cell count: 0.823, - 0.241 versus 0.017, 0.534; cell density: 0.933, - 0.067 versus 0.154, 0.639; cell polymegathism: 0.652, - 0.079 versus 0.075, 0.886; cell pleomorphism: 0.242, - 0.128 versus 0.0352, - 0.222, respectively), and are in good agreement with the results of the state of the art method.

A Review On digital image processing techniques for in-Vivo confocal images of the cornea

This work reviews the scientific literature regarding digital image processing for in vivo confocal microscopy images of the cornea. We present and discuss a selection of prominent techniques designed for semi- and automatic analysis of four areas of the cornea (epithelium, sub-basal nerve plexus, stroma and endothelium). The main context is image enhancement, detection of structures of interest, and quantification of clinical information. We have found that the preprocessing stage lacks of quantitative studies regarding the quality of the enhanced image, or its effects in subsequent steps of the image processing. Threshold values are widely used in the reviewed methods, although generally, they are selected empirically and manually. The image processing results are evaluated in many cases through comparison with gold standards not widely accepted. It is necessary to standardize values to be quantified in terms of sensitivity and specificity of methods. Most of the reviewed studies do not show an estimation of the computational cost of the image processing. We conclude that reliable, automatic, computer-assisted image analysis of the cornea is still an open issue, constituting an interesting and worthwhile area of research.

Neuronal-epithelial cell alignment: A determinant of health and disease status of the cornea

PURPOSE

How sensory neurons and epithelial cells interact with one another, and whether this association can be considered an indicator of health or disease is yet to be elucidated.

METHODS

Herein, we used the cornea, Confetti mice, a novel image segmentation algorithm for intraepithelial corneal nerves which was compared to and validated against several other analytical platforms, and three mouse models to delineate this paradigm. For aging, eyes were collected from 2 to 52 week-old normal C57BL/6 mice (n ≥ 4/time-point). For wound-healing and limbal stem cell deficiency, 7 week-old mice received a limbal-sparing or limbal-to-limbal epithelial debridement to their right cornea, respectively. Eyes were collected 2-16 weeks post-injury (n=4/group/time-point), corneas procured, immunolabelled with βIII-tubulin, flat-mounted, imaged by scanning confocal microscopy and analyzed for nerve and epithelial-specific parameters.

RESULTS

Our data indicate that nerve features are dynamic during aging and their curvilinear arrangement align with corneal epithelial migratory tracks. Moderate corneal injury prompted axonal regeneration and recovery of nerve fiber features. Limbal stem cell deficient corneas displayed abnormal nerve morphology, and fibers no longer aligned with corneal epithelial migratory tracks. Mechanistically, we discovered that nerve pattern restoration relies on the number and distribution of stromal-epithelial nerve penetration sites.

CONCLUSIONS

Microstructural changes to innervation may explain corneal complications related to aging and/or disease and facilitate development of new assays for diagnosis and/or classification of ocular and systemic diseases.

Artificial intelligence for anterior segment diseases: Emerging applications in ophthalmology

With the advancement of computational power, refinement of learning algorithms and architectures, and availability of big data, artificial intelligence (AI) technology, particularly with machine learning and deep learning, is paving the way for 'intelligent' healthcare systems. AI-related research in ophthalmology previously focused on the screening and diagnosis of posterior segment diseases, particularly diabetic retinopathy, age-related macular degeneration and glaucoma. There is now emerging evidence demonstrating the application of AI to the diagnosis and management of a variety of anterior segment conditions. In this review, we provide an overview of AI applications to the anterior segment addressing keratoconus, infectious keratitis, refractive surgery, corneal transplant, adult and paediatric cataracts, angle-closure glaucoma and iris tumour, and highlight important clinical considerations for adoption of AI technologies, potential integration with telemedicine and future directions.