Open-Source Automatic Biomarker Measurement on Slit-Lamp Photography to Estimate Visual Acuity in Microbial Keratitis

Monitoring the Progression of Clinically Suspected Microbial Keratitis Using Convolutional Neural Networks

Purpose

For this study, we aimed to determine whether a convolutional neural network (CNN)-based method (based on a feature extractor and an identifier) can be applied to monitor the progression of keratitis while managing suspected microbial keratitis (MK).

Methods

This multicenter longitudinal cohort study included patients with suspected MK undergoing serial external eye photography at the 5 branches of Chang Gung Memorial Hospital from August 20, 2000, to August 19, 2020. Data were primarily analyzed from January 1 to March 25, 2022. The CNN-based model was evaluated via F1 score and accuracy. The area under the receiver operating characteristic curve (AUROC) was used to measure the precision-recall trade-off.

Results

The model was trained using 1456 image pairs from 468 patients. In comparing models via only training the identifier, statistically significant higher accuracy (P  < 0.05) in models via training both the identifier and feature extractor (full training) was verified, with 408 image pairs from 117 patients. The full training EfficientNet b3-based model showed 90.2% (getting better) and 82.1% (becoming worse) F1 scores, 87.3% accuracy, and 94.2% AUROC for 505 getting better and 272 becoming worse test image pairs from 452 patients.

Conclusions

A CNN-based approach via deep learning applied in suspected MK can monitor the progress/regress during treatment by comparing external eye image pairs.

Translational Relevance

The study bridges the gap between the investigation of the state-of-the-art CNN-based deep learning algorithm applied in ocular image analysis and the clinical care of suspected patients with MK.

Joint multimodal deep learning-based automatic segmentation of ICGA and OCT images for assessment of PCV biomarkers

Purpose

To develop a fully-automatic hybrid algorithm to jointly segment and quantify biomarkers of polypoidal choroidal vasculopathy (PCV) on indocyanine green angiography (ICGA) and spectral domain-OCT (SD-OCT) images.

Design

Evaluation of diagnostic test or technology.

Participants

Seventy-two participants with PCV enrolled in clinical studies at Singapore National Eye Center.

Methods

The dataset consisted of 2-dimensional (2-D) ICGA and 3-dimensional (3-D) SD-OCT images which were spatially registered and manually segmented by clinicians. A deep learning-based hybrid algorithm called PCV-Net was developed for automatic joint segmentation of biomarkers. The PCV-Net consisted of a 2-D segmentation branch for ICGA and 3-D segmentation branch for SD-OCT. We developed fusion attention modules to connect the 2-D and 3-D branches for effective use of the spatial correspondence between the imaging modalities by sharing learned features. We also used self-supervised pretraining and ensembling to further enhance the performance of the algorithm without the need for additional datasets. We compared the proposed PCV-Net to several alternative model variants.

Main Outcome Measures

The PCV-Net was evaluated based on the Dice similarity coefficient (DSC) of the segmentations and the Pearson's correlation and absolute difference of the clinical measurements obtained from the segmentations. Manual grading was used as the gold standard.

Results

The PCV-Net showed good performance compared to manual grading and alternative model variants based on both quantitative and qualitative analyses. Compared to the baseline variant, PCV-Net improved the DSC by 0.04 to 0.43 across the different biomarkers, increased the correlations, and decreased the absolute differences of clinical measurements of interest. Specifically, the largest average (mean ± standard error) DSC improvement was for intraretinal fluid, from 0.02 ± 0.00 (baseline variant) to 0.45 ± 0.06 (PCV-Net). In general, improving trends were observed across the model variants as more technical specifications were added, demonstrating the importance of each aspect of the proposed method.

Conclusion

The PCV-Net has the potential to aid clinicians in disease assessment and research to improve clinical understanding and management of PCV.

Financial Disclosures

Proprietary or commercial disclosure may be found after the references.

Artificial intelligence and corneal diseases

PURPOSE OF REVIEW

Artificial intelligence has advanced rapidly in recent years and has provided powerful tools to aid with the diagnosis, management, and treatment of ophthalmic diseases. This article aims to review the most current clinical artificial intelligence applications in anterior segment diseases, with an emphasis on microbial keratitis, keratoconus, dry eye syndrome, and Fuchs endothelial dystrophy.

RECENT FINDINGS

Most current artificial intelligence approaches have focused on developing deep learning algorithms based on various imaging modalities. Algorithms have been developed to detect and differentiate microbial keratitis classes and quantify microbial keratitis features. Artificial intelligence may aid with early detection and staging of keratoconus. Many advances have been made to detect, segment, and quantify features of dry eye syndrome and Fuchs. There is significant variability in the reporting of methodology, patient population, and outcome metrics.

SUMMARY

Artificial intelligence shows great promise in detecting, diagnosing, grading, and measuring diseases. There is a need for standardization of reporting to improve the transparency, validity, and comparability of algorithms.