Cellular morphological changes detected by laser scanning in vivo confocal microscopy associated with clinical outcome in fungal keratitis

In-vivo corneal confocal microscopy: Imaging analysis, biological insights and future directions

In-vivo corneal confocal microscopy is a powerful imaging technique which provides clinicians and researcher with the capabilities to observe microstructures at the ocular surfaces in significant detail. In this Mini Review, the optics and image analysis methods with the use of corneal confocal microscopy are discussed. While novel insights of neuroanatomy and biology of the eyes, particularly the ocular surface, have been provided by corneal confocal microscopy, some debatable elements observed using this technique remain and these are explored in this Mini Review. Potential improvements in imaging methodology and instrumentation are also suggested.

Intravital Imaging with Two-Photon Microscopy: A Look into the Kidney

Fluorescence microscopy has represented a crucial technique to explore the cellular and molecular mechanisms in the field of biomedicine. However, the conventional one-photon microscopy exhibits many limitations when living samples are imaged. The new technologies, including two-photon microscopy (2PM), have considerably improved the in vivo study of pathophysiological processes, allowing the investigators to overcome the limits displayed by previous techniques. 2PM enables the real-time intravital imaging of the biological functions in different organs at cellular and subcellular resolution thanks to its improved laser penetration and less phototoxicity. The development of more sensitive detectors and long-wavelength fluorescent dyes as well as the implementation of semi-automatic software for data analysis allowed to gain insights in essential physiological functions, expanding the frontiers of cellular and molecular imaging. The future applications of 2PM are promising to push the intravital microscopy beyond the existing limits. In this review, we provide an overview of the current state-of-the-art methods of intravital microscopy, focusing on the most recent applications of 2PM in kidney physiology.

The use of in vivo confocal microscopy in fungal keratitis - Progress and challenges

Fungal keratitis (FK) is a serious and sight-threatening corneal infection with global reach. The need for prompt diagnosis is paramount, as a delay in initiation of treatment could lead to irreversible vision loss. Current "gold standard" diagnostic methods, namely corneal smear and culture, have limitations due to diagnostic insensitivity and their time-consuming nature. PCR is a newer, complementary method used in the diagnosis of fungal keratitis, whose results are also sample-dependent. In vivo confocal microscopy (IVCM) is a promising complementary diagnostic method of increasing importance as it allows non-invasive real-time direct visualization of potential fungal pathogens and manifesting infection directly in the patient's cornea. In numerous articles and case reports, FK diagnosis by IVCM has been evaluated, and different features, approaches, sensitivity/specificity, and limitations have been noted. Here, we provide an up-to-date, comprehensive review of the current literature and present the authors' combined recommendations for fungal identification in IVCM images, while also looking to the future of FK assessment by IVCM using artificial intelligence methods.

The Clinical Value of Explainable Deep Learning for Diagnosing Fungal Keratitis Using in vivo Confocal Microscopy Images

Background: Artificial intelligence (AI) has great potential to detect fungal keratitis using in vivo confocal microscopy images, but its clinical value remains unclarified. A major limitation of its clinical utility is the lack of explainability and interpretability. Methods: An explainable AI (XAI) system based on Gradient-weighted Class Activation Mapping (Grad-CAM) and Guided Grad-CAM was established. In this randomized controlled trial, nine ophthalmologists (three expert ophthalmologists, three competent ophthalmologists, and three novice ophthalmologists) read images in each of the conditions: unassisted, AI-assisted, or XAI-assisted. In unassisted condition, only the original IVCM images were shown to the readers. AI assistance comprised a histogram of model prediction probability. For XAI assistance, explanatory maps were additionally shown. The accuracy, sensitivity, and specificity were calculated against an adjudicated reference standard. Moreover, the time spent was measured. Results: Both forms of algorithmic assistance increased the accuracy and sensitivity of competent and novice ophthalmologists significantly without reducing specificity. The improvement was more pronounced in XAI-assisted condition than that in AI-assisted condition. Time spent with XAI assistance was not significantly different from that without assistance. Conclusion: AI has shown great promise in improving the accuracy of ophthalmologists. The inexperienced readers are more likely to benefit from the XAI system. With better interpretability and explainability, XAI-assistance can boost ophthalmologist performance beyond what is achievable by the reader alone or with black-box AI assistance.

A deep transfer learning framework for the automated assessment of corneal inflammation on in vivo confocal microscopy images

Purpose

Infiltration of activated dendritic cells and inflammatory cells in cornea represents an important marker for defining corneal inflammation. Deep transfer learning has presented a promising potential and is gaining more importance in computer assisted diagnosis. This study aimed to develop deep transfer learning models for automatic detection of activated dendritic cells and inflammatory cells using in vivo confocal microscopy images.

Methods

A total of 3453 images was used to train the models. External validation was performed on an independent test set of 558 images. A ground-truth label was assigned to each image by a panel of cornea specialists. We constructed a deep transfer learning network that consisted of a pre-trained network and an adaptation layer. In this work, five pre-trained networks were considered, namely VGG-16, ResNet-101, Inception V3, Xception, and Inception-ResNet V2. The performance of each transfer network was evaluated by calculating the area under the curve (AUC) of receiver operating characteristic, accuracy, sensitivity, specificity, and G mean.

Results

The best performance was achieved by Inception-ResNet V2 transfer model. In the validation set, the best transfer system achieved an AUC of 0.9646 (P<0.001) in identifying activated dendritic cells (accuracy, 0.9319; sensitivity, 0.8171; specificity, 0.9517; and G mean, 0.8872), and 0.9901 (P<0.001) in identifying inflammatory cells (accuracy, 0.9767; sensitivity, 0.9174; specificity, 0.9931; and G mean, 0.9545).

Conclusions

The deep transfer learning models provide a completely automated analysis of corneal inflammatory cellular components with high accuracy. The implementation of such models would greatly benefit the management of corneal diseases and reduce workloads for ophthalmologists.