An efficient intelligent analysis system for confocal corneal endothelium images

Mobile-CellNet: Automatic Segmentation of Corneal Endothelium Using an Efficient Hybrid Deep Learning Model

PURPOSE

The corneal endothelium, the innermost layer of the human cornea, exhibits a morphology of predominantly hexagonal cells. These endothelial cells are believed to have limited regeneration capacity, and their density decreases over time. Endothelial cell density (ECD) can therefore be used to measure the health of the corneal endothelium and the overall cornea. In clinical settings, specular microscopes are used to image this layer. Owing to the unavailability of reliable automatic tools, technicians often manually mark the cell centers and borders to measure ECD for such images, a process that is time and resource-consuming.

METHODS

In this article, we propose Mobile-CellNet, a novel completely automatic, efficient deep learning-based cell segmentation algorithm to estimate ECD. This uses 2 similar image segmentation models working in parallel along with image postprocessing using classical image processing techniques. We also compare the proposed algorithm with widely used biomedical image segmentation networks U-Net and U-Net++.

RESULTS

The proposed technique achieved a mean absolute error of 4.06% for the ECD on the test set, comparable with the error for U-Net of 3.80% ( P = 0.185 for difference), but requiring almost 31 times fewer floating-point operations (FLOPs) and 34 times fewer parameters.

CONCLUSIONS

Mobile-CellNet accurately segments corneal endothelial cells and reports ECD and cell morphology efficiently. This can be used to develop tools to analyze specular corneal endothelial images in remote settings.

A Retinex-based variational model for noise suppression and nonuniform illumination correction in corneal confocal microscopy images

Objective.Corneal confocal microscopy (CCM) image analysis is a non-invasivein vivoclinical technique that can quantify corneal nerve fiber damage. However, the acquired CCM images are often accompanied by speckle noise and nonuniform illumination, which seriously affects the analysis and diagnosis of the diseases.Approach.In this paper, first we propose a variational Retinex model for the inhomogeneity correction and noise removal of CCM images. In this model, the Beppo Levi space is introduced to constrain the smoothness of the illumination layer for the first time, and the fractional order differential is adopted as the regularization term to constrain reflectance layer. Then, a denoising regularization term is also constructed with Block Matching 3D (BM3D) to suppress noise. Finally, by adjusting the uneven illumination layer, we obtain the final results. Second, an image quality evaluation metric is proposed to evaluate the illumination uniformity of images objectively.Main results.To demonstrate the effectiveness of our method, the proposed method is tested on 628 low-quality CCM images from the CORN-2 dataset. Extensive experiments show the proposed method outperforms the other four related methods in terms of noise removal and uneven illumination suppression.SignificanceThis demonstrates that the proposed method may be helpful for the diagnostics and analysis of eye diseases.

Trainable watershed-based model for cornea endothelial cell segmentation

Segmentation of the medical image plays a significant role when it comes to diagnosis using computer aided system. This article focuses on the human corneal endothelium’s health, which is one of the filed research interests, especially in the human cornea. Various pathological environments fasten the extermination of the endothelial cells, which in turn decreases the cell density in an abnormal manner. Dead cells worsen the hexagonal design. The mutilated endothelial cells can no longer revive back and that gives room for neighbouring cells to migrate and expand so that they can fill in the space. The latter results in cell elongation that is unpredictable as well as increase in size and thinning. Cell density and shape are therefore considered major parameters when it comes to explaining the health condition attributed to corneal endothelium. In this study, medical feature extraction was obtained depending on the segmentation of the endothelial cell boundary, and the task of segmentation of such objects especially the thin, transparent, and unclear cell boundary is considered challenging due to the nature of the image capture during endothelium layer examination by ophthalmologists using confocal or specular microscopy. The resulting image suffers from various issues that affect the quality of the image. Low quality is due to non-uniformity of illumination and the presence of a lot of noise and artefacts resulting from high amounts of distortion, and most of these limitations are present because of the nature of the imaging modality. Usually, images contain certain kind of noise and also continuous shadow. Furthermore, the cells are separated by poor border, thereby leading to great difficulty in the segmentation of the images. The irregular shape of cell and also the contrast of such images seem to be low as they possess blurry boundaries with diverse objects existing in addition to the lack of homogeneity. The main aim of the study is to propose and develop a totally automatic, robust, and real-time model for the segmentation of endothelial cells of the human cornea obtained by in vivo microscopy and computation of different clinical features of endothelial cells. To achieve the aim of this study a new scheme of image enhancement was proposed such as the Contrast-Limited Adaptive Histogram Equalisation (CLAHE) technique to enhance contrast. After that, a new image denoising technique called Wavelet Transform Filter and Butterworth Bandpass for Segmentation is used. Subsequently, brightness level correction is applied by using the moving average filter and the CLAHE to reduce the effects of the non-uniform image lighting produced as a result of the previous step. The main aim of this article is the segmentation of endothelial cells, which involves precise detection of the endothelial contours. So a new segmentation model was proposed such that the shape of the cells will be extracted, and the contours were highlighted. This stage is followed by clinical feature extraction and uses the features for diagnosis. In this stage, several relevant clinical features such as pleomorphism mean cell perimeter, mean cell density, mean cell area, and polymegathism are extracted. The role of these clinical features is crucial for the early detection of corneal pathologies as well as the evaluation of the health of the corneal endothelium layer. The findings of this study were promising.

CellsDeepNet: A Novel Deep Learning-Based Web Application for the Automated Morphometric Analysis of Corneal Endothelial Cells

The quantification of corneal endothelial cell (CEC) morphology using manual and semi-automatic software enables an objective assessment of corneal endothelial pathology. However, the procedure is tedious, subjective, and not widely applied in clinical practice. We have developed the CellsDeepNet system to automatically segment and analyse the CEC morphology. The CellsDeepNet system uses Contrast-Limited Adaptive Histogram Equalization (CLAHE) to improve the contrast of the CEC images and reduce the effects of non-uniform image illumination, 2D Double-Density Dual-Tree Complex Wavelet Transform (2DDD-TCWT) to reduce noise, Butterworth Bandpass filter to enhance the CEC edges, and moving average filter to adjust for brightness level. An improved version of U-Net was used to detect the boundaries of the CECs, regardless of the CEC size. CEC morphology was measured as mean cell density (MCD, cell/mm2), mean cell area (MCA, μm2), mean cell perimeter (MCP, μm), polymegathism (coefficient of CEC size variation), and pleomorphism (percentage of hexagonality coefficient). The CellsDeepNet system correlated highly significantly with the manual estimations for MCD (r = 0.94), MCA (r = 0.99), MCP (r = 0.99), polymegathism (r = 0.92), and pleomorphism (r = 0.86), with p < 0.0001 for all the extracted clinical features. The Bland–Altman plots showed excellent agreement. The percentage difference between the manual and automated estimations was superior for the CellsDeepNet system compared to the CEAS system and other state-of-the-art CEC segmentation systems on three large and challenging corneal endothelium image datasets captured using two different ophthalmic devices.

An automatic approach for cell detection and segmentation of corneal endothelium in specular microscope

PURPOSE

Specular microscopy is an indispensable tool for clinicians seeking to monitor the corneal endothelium. Automated methods of determining endothelial cell density (ECD) are limited in their ability to analyze images of poor quality. We describe and assess an image processing algorithm to analyze corneal endothelial images.

METHODS

A set of corneal endothelial images acquired with a Konan CellChek specular microscope was analyzed using three methods: flex-center, Konan Auto Tracer, and the proposed method. In this technique, the algorithm determines the region of interest, filters the image to differentiate cell boundaries from their interiors, and utilizes stochastic watershed segmentation to draw cell boundaries and assess ECD based on the masked region. We compared ECD measured by the algorithm with manual and automated results from the specular microscope.

RESULTS

We analyzed a total of 303 images manually, using the Auto Tracer, and with the proposed image processing method. Relative to manual analysis across all images, the mean error was 0.04% in the proposed method (p = 0.23 for difference) whereas Auto Tracer demonstrated a bias towards overestimation, with a mean error of 5.7% (p = 2.06× 10^-8). The relative mean absolute errors were 6.9% and 7.9%, respectively, for the proposed and Auto Tracer. The average time for analysis of each image using the proposed method was 2.5 s.

CONCLUSION

We demonstrate a computationally efficient algorithm to analyze corneal endothelial cell density that can be implemented on devices for clinical and research use.

Segmentation of endothelial cells of the cornea from the distance map of confocal microscope images

We propose a novel algorithm for segmenting cells of the cornea endothelium layer on confocal microscope images. To get an inter-cellular space with minimum gray-scale value and to enhance cell borders, we apply a difference of Gaussian filter before image binarization by thresholding with the minimum gray-scale value. Removal of segmented noise and artifacts is performed by automatic thresholding (using an image frequency analysis to obtain a global threshold value per image). Final segmentation of cells is achieved by fitting the largest inscribed circles into the centers of cell regions defined by the distance map of the binary images. Parameters of interest such as cell count and density, pleomorphism, polymegathism, and F-measure are computed on a publicly available data-set (Confocal Corneal Endothelial Microscopy Data Set - Rotterdam Ophthalmic Data Repository) and compared against the results of the segmentation methods included with the data set, and the results of state of the art automatic methods. The obtained results achieve higher accuracy compared to the results of the segmentation included with the data set (e.g., -proposed versus dataset in R² and mean relative error-, cell count: 0.823, - 0.241 versus 0.017, 0.534; cell density: 0.933, - 0.067 versus 0.154, 0.639; cell polymegathism: 0.652, - 0.079 versus 0.075, 0.886; cell pleomorphism: 0.242, - 0.128 versus 0.0352, - 0.222, respectively), and are in good agreement with the results of the state of the art method.

A Review On digital image processing techniques for in-Vivo confocal images of the cornea

This work reviews the scientific literature regarding digital image processing for in vivo confocal microscopy images of the cornea. We present and discuss a selection of prominent techniques designed for semi- and automatic analysis of four areas of the cornea (epithelium, sub-basal nerve plexus, stroma and endothelium). The main context is image enhancement, detection of structures of interest, and quantification of clinical information. We have found that the preprocessing stage lacks of quantitative studies regarding the quality of the enhanced image, or its effects in subsequent steps of the image processing. Threshold values are widely used in the reviewed methods, although generally, they are selected empirically and manually. The image processing results are evaluated in many cases through comparison with gold standards not widely accepted. It is necessary to standardize values to be quantified in terms of sensitivity and specificity of methods. Most of the reviewed studies do not show an estimation of the computational cost of the image processing. We conclude that reliable, automatic, computer-assisted image analysis of the cornea is still an open issue, constituting an interesting and worthwhile area of research.

Artificial intelligence for anterior segment diseases: Emerging applications in ophthalmology

With the advancement of computational power, refinement of learning algorithms and architectures, and availability of big data, artificial intelligence (AI) technology, particularly with machine learning and deep learning, is paving the way for 'intelligent' healthcare systems. AI-related research in ophthalmology previously focused on the screening and diagnosis of posterior segment diseases, particularly diabetic retinopathy, age-related macular degeneration and glaucoma. There is now emerging evidence demonstrating the application of AI to the diagnosis and management of a variety of anterior segment conditions. In this review, we provide an overview of AI applications to the anterior segment addressing keratoconus, infectious keratitis, refractive surgery, corneal transplant, adult and paediatric cataracts, angle-closure glaucoma and iris tumour, and highlight important clinical considerations for adoption of AI technologies, potential integration with telemedicine and future directions.

Novel Immune Microlens Imaging for Detection of Antigen and Antibody

Detection and analysis of antigen-antibody reaction is one of the most critical detection techniques in the fields of medicine, biology, environmental science, and food safety. Traditional and classical methods for detecting antigen and antibody encounter many problems, such as time-consuming, high cost, and low accuracy. A novel immune microsphere imaging technique by the microlens is used to test the changes of refractive index before and after antigen-antibody reaction. It can quickly perform qualitative and quantitative determination for antigen-antibody reaction without any labeling, premodification, postwashing, and expensive enzymes. Here, we feature and discuss its principle and advantages, structure of a microlens immunoassay instrument, and potential in measuring clinical samples. It is promising to be developed for application to diagnosis of clinical diseases.

Fully convolutional architecture vs sliding-window CNN for corneal endothelium cell segmentation

Background

Corneal endothelium (CE) images provide valuable clinical information regarding the health state of the cornea. Computation of the clinical morphometric parameters requires the segmentation of endothelial cell images. Current techniques to image the endothelium in vivo deliver low quality images, which makes automatic segmentation a complicated task. Here, we present two convolutional neural networks (CNN) to segment CE images: a global fully convolutional approach based on U-net, and a local sliding-window network (SW-net). We propose to use probabilistic labels instead of binary, we evaluate a preprocessing method to enhance the contrast of images, and we introduce a postprocessing method based on Fourier analysis and watershed to convert the CNN output images into the final cell segmentation. Both methods are applied to 50 images acquired with an SP-1P Topcon specular microscope. Estimates are compared against a manual delineation made by a trained observer.

Results

U-net (AUC=0.9938) yields slightly sharper, clearer images than SW-net (AUC=0.9921). After postprocessing, U-net obtains a DICE=0.981 and a MHD=0.22 (modified Hausdorff distance), whereas SW-net yields a DICE=0.978 and a MHD=0.30. U-net generates a wrong cell segmentation in only 0.48% of the cells, versus 0.92% for the SW-net. U-net achieves statistically significant better precision and accuracy than both, Topcon and SW-net, for the estimates of three clinical parameters: cell density (ECD), polymegethism (CV), and pleomorphism (HEX). The mean relative error in U-net for the parameters is 0.4% in ECD, 2.8% in CV, and 1.3% in HEX. The computation time to segment an image and estimate the parameters is barely a few seconds.

Conclusions

Both methods presented here provide a statistically significant improvement over the state of the art. U-net has reached the smallest error rate. We suggest a segmentation refinement based on our previous work to further improve the performance.

Corneal Confocal Microscopy detects a Reduction in Corneal Endothelial Cells and Nerve Fibres in Patients with Acute Ischemic Stroke

Endothelial dysfunction and damage underlie cerebrovascular disease and ischemic stroke. We undertook corneal confocal microscopy (CCM) to quantify corneal endothelial cell and nerve morphology in 146 patients with an acute ischemic stroke and 18 age-matched healthy control participants. Corneal endothelial cell density was lower (P < 0.001) and endothelial cell area (P < 0.001) and perimeter (P < 0.001) were higher, whilst corneal nerve fibre density (P < 0.001), corneal nerve branch density (P < 0.001) and corneal nerve fibre length (P = 0.001) were lower in patients with acute ischemic stroke compared to controls. Corneal endothelial cell density, cell area and cell perimeter correlated with corneal nerve fiber density (P = 0.033, P = 0.014, P = 0.011) and length (P = 0.017, P = 0.013, P = 0.008), respectively. Multiple linear regression analysis showed a significant independent association between corneal endothelial cell density, area and perimeter with acute ischemic stroke and triglycerides. CCM is a rapid non-invasive ophthalmic imaging technique, which could be used to identify patients at risk of acute ischemic stroke.

Corneal Endothelial Cell Segmentation by Classifier-Driven Merging of Oversegmented Images

Corneal endothelium images obtained by in vivo specular microscopy provide important information to assess the health status of the cornea. Estimation of clinical parameters, such as cell density, polymegethism, and pleomorphism, requires accurate cell segmentation. State-of-the-art techniques to automatically segment the endothelium are error-prone when applied to images with low contrast and/or large variation in cell size. Here, we propose an automatic method to segment the endothelium. Starting with an oversegmented image comprised of superpixels obtained from a stochastic watershed segmentation, the proposed method uses intensity and shape information of the superpixels to identify and merge those that constitute a cell, using support vector machines. We evaluated the automatic segmentation on a data set of in vivo specular microscopy images (Topcon SP-1P), obtaining 95.8% correctly merged cells and 2.0% undersegmented cells. We also evaluated the parameter estimation against the results of the vendor's built-in software, obtaining a statistically significant better precision in all parameters and a similar or better accuracy. The parameter estimation was also evaluated on three other data sets from different imaging modalities (confocal microscopy, phase-contrast microscopy, and fluorescence confocal microscopy) and tissue types (ex vivo corneal endothelium and retinal pigment epithelium). In comparison with the estimates of the data sets' authors, we achieved statistically significant better accuracy and precision in all parameters except pleomorphism, where a similar accuracy and precision were obtained.

A fully automated cell segmentation and morphometric parameter system for quantifying corneal endothelial cell morphology

BACKGROUND AND OBJECTIVE

Corneal endothelial cell abnormalities may be associated with a number of corneal and systemic diseases. Damage to the endothelial cells can significantly affect corneal transparency by altering hydration of the corneal stroma, which can lead to irreversible endothelial cell pathology requiring corneal transplantation. To date, quantitative analysis of endothelial cell abnormalities has been manually performed by ophthalmologists using time consuming and highly subjective semi-automatic tools, which require an operator interaction. We developed and applied a fully-automated and real-time system, termed the Corneal Endothelium Analysis System (CEAS) for the segmentation and computation of endothelial cells in images of the human cornea obtained by in vivo corneal confocal microscopy.

METHODS

First, a Fast Fourier Transform (FFT) Band-pass filter is applied to reduce noise and enhance the image quality to make the cells more visible. Secondly, endothelial cell boundaries are detected using watershed transformations and Voronoi tessellations to accurately quantify the morphological parameters of the human corneal endothelial cells. The performance of the automated segmentation system was tested against manually traced ground-truth images based on a database consisting of 40 corneal confocal endothelial cell images in terms of segmentation accuracy and obtained clinical features. In addition, the robustness and efficiency of the proposed CEAS system were compared with manually obtained cell densities using a separate database of 40 images from controls (n = 11), obese subjects (n = 16) and patients with diabetes (n = 13).

RESULTS

The Pearson correlation coefficient between automated and manual endothelial cell densities is 0.9 (p < 0.0001) and a Bland-Altman plot shows that 95% of the data are between the 2SD agreement lines.

CONCLUSIONS

We demonstrate the effectiveness and robustness of the CEAS system, and the possibility of utilizing it in a real world clinical setting to enable rapid diagnosis and for patient follow-up, with an execution time of only 6 seconds per image.

Automated morphometric description of human corneal endothelium from in-vivo specular and confocal microscopy

Corneal images acquired by in-vivo specular and confocal microscopy provide clinical information on the cornea endothelium health state. Indeed, the normal hexagonal shape of endothelial cells is usually affected by age and pathologies. At present, the analysis is based on manual or semi-automatic methods and the segmentation of a large number of endothelial cells is required for a meaningful estimation of the clinical parameters. We propose an automated method that detects the centers of endothelial cells by convolving the original image with customized two-dimensional kernels, derives a structure made by connected vertices from the recognized centers using the Euclidean distance, and fine-tunes the derived structure through a genetic algorithm, which combines information about the typical regularity of endothelial cells shape with the pixels intensity of the actual image. The final structure of connected vertices forms a set of polygons that fit the underlying cells contours. From these contours the morphometric parameters of clinical interest can be easily computed. The procedure was applied to 15 images acquired with the SP-3000P (Topcon, Japan) specular microscope and 15 images acquired with the Confoscan4 (Nidek Technologies, Italy) confocal microscope, from both healthy and pathological subjects. Ground truth values for the morphometric parameters were obtained from manually carefully drawn cell contours. Results show that the mean percent absolute difference between the automated and the manual estimate of the clinical parameters is between 2 and 6%, and no statistically significant difference was found between them. The proposed totally automatic method appears capable of detecting contour of hundreds of cells covering a large area, and of obtaining a reliable estimation of the relevant morphometric parameters used in clinical practice.

A fully automatic nerve segmentation and morphometric parameter quantification system for early diagnosis of diabetic neuropathy in corneal images

Diabetic Peripheral Neuropathy (DPN) is one of the most common types of diabetes that can affect the cornea. An accurate analysis of the nerve structures can assist the early diagnosis of this disease. This paper proposes a robust, fast and fully automatic nerve segmentation and morphometric parameter quantification system for corneal confocal microscope images. The segmentation part consists of three main steps. First, a preprocessing step is applied to enhance the visibility of the nerves and remove noise using anisotropic diffusion filtering, specifically a Coherence filter followed by Gaussian filtering. Second, morphological operations are applied to remove unwanted objects in the input image such as epithelial cells and small nerve segments. Finally, an edge detection step is applied to detect all the nerves in the input image. In this step, an efficient algorithm for connecting discontinuous nerves is proposed. In the morphometric parameters quantification part, a number of features are extracted, including thickness, tortuosity and length of nerve, which may be used for the early diagnosis of diabetic polyneuropathy and when planning Laser-Assisted in situ Keratomileusis (LASIK) or Photorefractive keratectomy (PRK). The performance of the proposed segmentation system is evaluated against manually traced ground-truth images based on a database consisting of 498 corneal sub-basal nerve images (238 are normal and 260 are abnormal). In addition, the robustness and efficiency of the proposed system in extracting morphometric features with clinical utility was evaluated in 919 images taken from healthy subjects and diabetic patients with and without neuropathy. We demonstrate rapid (13 seconds/image), robust and effective automated corneal nerve quantification. The proposed system will be deployed as a useful clinical tool to support the expertise of ophthalmologists and save the clinician time in a busy clinical setting.