Automatic diagnosis of fungal keratitis using data augmentation and image fusion with deep convolutional neural network

Diagnostic performance of deep learning for infectious keratitis: a systematic review and meta-analysis

Background

Infectious keratitis (IK) is the leading cause of corneal blindness globally. Deep learning (DL) is an emerging tool for medical diagnosis, though its value in IK is unclear. We aimed to assess the diagnostic accuracy of DL for IK and its comparative accuracy with ophthalmologists.

Methods

In this systematic review and meta-analysis, we searched EMBASE, MEDLINE, and clinical registries for studies related to DL for IK published between 1974 and July 16, 2024. We performed meta-analyses using bivariate models to estimate summary sensitivities and specificities. This systematic review was registered with PROSPERO (CRD42022348596).

Findings

Of 963 studies identified, 35 studies (136,401 corneal images from >56,011 patients) were included. Most studies had low risk of bias (68.6%) and low applicability concern (91.4%) in all domains of QUADAS-2, except the index test domain. Against the reference standard of expert consensus and/or microbiological results (seven external validation studies; 10,675 images), the summary estimates (95% CI) for sensitivity and specificity of DL for IK were 86.2% (71.6-93.9) and 96.3% (91.5-98.5). From 28 internal validation studies (16,059 images), summary estimates for sensitivity and specificity were 91.6% (86.8-94.8) and 90.7% (84.8-94.5). Based on seven studies (4007 images), DL and ophthalmologists had comparable summary sensitivity [89.2% (82.2-93.6) versus 82.2% (71.5-89.5); P = 0.20] and specificity [(93.2% (85.5-97.0) versus 89.6% (78.8-95.2); P = 0.45].

Interpretation

DL models may have good diagnostic accuracy for IK and comparable performance to ophthalmologists. These findings should be interpreted with caution due to the image-based analysis that did not account for potential correlation within individuals, relatively homogeneous population studies, lack of pre-specification of DL thresholds, and limited external validation. Future studies should improve their reporting, data diversity, external validation, transparency, and explainability to increase the reliability and generalisability of DL models for clinical deployment.

Funding

NIH, Wellcome Trust, MRC, Fight for Sight, BHP, and ESCRS.

Artificial intelligence in corneal diseases: A narrative review

Corneal diseases represent a growing public health burden, especially in resource-limited settings lacking access to specialized eye care. Artificial intelligence (AI) offers promising solutions for automating the diagnosis and management of corneal conditions. This narrative review examines the application of AI in corneal diseases, focusing on keratoconus, infectious keratitis, pterygium, dry eye disease, Fuchs endothelial corneal dystrophy, and corneal transplantation. AI models integrating diverse imaging modalities (e.g., corneal topography, slit-lamp, and anterior segment OCT images) and clinical data have demonstrated high diagnostic accuracy, often outperforming human experts. Emerging trends include the incorporation of biomechanical data to enhance keratoconus detection, leveraging in vivo confocal microscopy for diagnosing infectious keratitis, and employing multimodal approaches for comprehensive disease analysis. Additionally, AI has shown potential in predicting disease progression, treatment outcomes, and postoperative complications in corneal transplantation. While challenges remain such as population heterogeneity, limited external validation, and the "black box" nature of some models, ongoing advancement in explainable AI, data augmentation, and improved regulatory frameworks can serve to address these limitations.

Two-stage deep neural network for diagnosing fungal keratitis via in vivo confocal microscopy images

Timely and effective diagnosis of fungal keratitis (FK) is necessary for suitable treatment and avoiding irreversible vision loss for patients. In vivo confocal microscopy (IVCM) has been widely adopted to guide the FK diagnosis. We present a deep learning framework for diagnosing fungal keratitis using IVCM images to assist ophthalmologists. Inspired by the real diagnostic process, our method employs a two-stage deep architecture for diagnostic predictions based on both image-level and sequence-level information. To the best of our knowledge, we collected the largest dataset with 96,632 IVCM images in total with expert labeling to train and evaluate our method. The specificity and sensitivity of our method in diagnosing FK on the unseen test set achieved 96.65% and 97.57%, comparable or better than experienced ophthalmologists. The network can provide image-level, sequence-level and patient-level diagnostic suggestions to physicians. The results show great promise for assisting ophthalmologists in FK diagnosis.

Innovative infrastructure to access Brazilian fungal diversity using deep learning

In the present investigation, we employ a novel and meticulously structured database assembled by experts, encompassing macrofungi field-collected in Brazil, featuring upwards of 13,894 photographs representing 505 distinct species. The purpose of utilizing this database is twofold: firstly, to furnish training and validation for convolutional neural networks (CNNs) with the capacity for autonomous identification of macrofungal species; secondly, to develop a sophisticated mobile application replete with an advanced user interface. This interface is specifically crafted to acquire images, and, utilizing the image recognition capabilities afforded by the trained CNN, proffer potential identifications for the macrofungal species depicted therein. Such technological advancements democratize access to the Brazilian Funga, thereby enhancing public engagement and knowledge dissemination, and also facilitating contributions from the populace to the expanding body of knowledge concerning the conservation of macrofungal species of Brazil.

Artificial-Intelligence-Enhanced Analysis of In Vivo Confocal Microscopy in Corneal Diseases: A Review

Artificial intelligence (AI) has seen significant progress in medical diagnostics, particularly in image and video analysis. This review focuses on the application of AI in analyzing in vivo confocal microscopy (IVCM) images for corneal diseases. The cornea, as an exposed and delicate part of the body, necessitates the precise diagnoses of various conditions. Convolutional neural networks (CNNs), a key component of deep learning, are a powerful tool for image data analysis. This review highlights AI applications in diagnosing keratitis, dry eye disease, and diabetic corneal neuropathy. It discusses the potential of AI in detecting infectious agents, analyzing corneal nerve morphology, and identifying the subtle changes in nerve fiber characteristics in diabetic corneal neuropathy. However, challenges still remain, including limited datasets, overfitting, low-quality images, and unrepresentative training datasets. This review explores augmentation techniques and the importance of feature engineering to address these challenges. Despite the progress made, challenges are still present, such as the "black-box" nature of AI models and the need for explainable AI (XAI). Expanding datasets, fostering collaborative efforts, and developing user-friendly AI tools are crucial for enhancing the acceptance and integration of AI into clinical practice.

Updates in Diagnostic Imaging for Infectious Keratitis: A Review

Infectious keratitis (IK) is among the top five leading causes of blindness globally. Early diagnosis is needed to guide appropriate therapy to avoid complications such as vision impairment and blindness. Slit lamp microscopy and culture of corneal scrapes are key to diagnosing IK. Slit lamp photography was transformed when digital cameras and smartphones were invented. The digital camera or smartphone camera sensor's resolution, the resolution of the slit lamp and the focal length of the smartphone camera system are key to a high-quality slit lamp image. Alternative diagnostic tools include imaging, such as optical coherence tomography (OCT) and in vivo confocal microscopy (IVCM). OCT's advantage is its ability to accurately determine the depth and extent of the corneal ulceration, infiltrates and haze, therefore characterizing the severity and progression of the infection. However, OCT is not a preferred choice in the diagnostic tool package for infectious keratitis. Rather, IVCM is a great aid in the diagnosis of fungal and Acanthamoeba keratitis with overall sensitivities of 66-74% and 80-100% and specificity of 78-100% and 84-100%, respectively. Recently, deep learning (DL) models have been shown to be promising aids for the diagnosis of IK via image recognition. Most of the studies that have developed DL models to diagnose the different types of IK have utilised slit lamp photographs. Some studies have used extremely efficient single convolutional neural network algorithms to train their models, and others used ensemble approaches with variable results. Limitations of DL models include the need for large image datasets to train the models, the difficulty in finding special features of the different types of IK, the imbalance of training models, the lack of image protocols and misclassification bias, which need to be overcome to apply these models into real-world settings. Newer artificial intelligence technology that generates synthetic data, such as generative adversarial networks, may assist in overcoming some of these limitations of CNN models.

Artificial Intelligence and Infectious Keratitis: Where Are We Now?

Infectious keratitis (IK), which is one of the most common and catastrophic ophthalmic emergencies, accounts for the leading cause of corneal blindness worldwide. Different pathogens, including bacteria, viruses, fungi, and parasites, can cause IK. The diagnosis and etiology detection of IK pose specific challenges, and delayed or incorrect diagnosis can significantly worsen the outcome. Currently, this process is mainly performed based on slit-lamp findings, corneal smear and culture, tissue biopsy, PCR, and confocal microscopy. However, these diagnostic methods have their drawbacks, including experience dependency, tissue damage, cost, and time consumption. Diagnosis and etiology detection of IK can be especially challenging in rural areas or in countries with limited resources. In recent years, artificial intelligence (AI) has opened new windows in medical fields such as ophthalmology. An increasing number of studies have utilized AI in the diagnosis of anterior segment diseases such as IK. Several studies have demonstrated that AI algorithms can diagnose and detect the etiology of IK accurately and fast, which can be valuable, especially in remote areas and in countries with limited resources. Herein, we provided a comprehensive update on the utility of AI in IK.

A Structure-Aware Convolutional Neural Network for Automatic Diagnosis of Fungal Keratitis with In Vivo Confocal Microscopy Images

Fungal keratitis (FK) is a common and severe corneal disease, which is widely spread in tropical and subtropical areas. Early diagnosis and treatment are vital for patients, with confocal microscopy cornea imaging being one of the most effective methods for the diagnosis of FK. However, most cases are currently diagnosed by the subjective judgment of ophthalmologists, which is time-consuming and heavily depends on the experience of the ophthalmologists. In this paper, we introduce a novel structure-aware automatic diagnosis algorithm based on deep convolutional neural networks for the accurate diagnosis of FK. Specifically, a two-stream convolutional network is deployed, combining GoogLeNet and VGGNet, which are two commonly used networks in computer vision architectures. The main stream is used for feature extraction of the input image, while the auxiliary stream is used for feature discrimination and enhancement of the hyphae structure. Then, the features are combined by concatenating the channel dimension to obtain the final output, i.e., normal or abnormal. The results showed that the proposed method achieved accuracy, sensitivity, and specificity of 97.73%, 97.02%, and 98.54%, respectively. These results suggest that the proposed neural network could be a promising computer-aided FK diagnosis solution.

Segmentation and Classification Approaches of Clinically Relevant Curvilinear Structures: A Review

Detection of curvilinear structures from microscopic images, which help the clinicians to make an unambiguous diagnosis is assuming paramount importance in recent clinical practice. Appearance and size of dermatophytic hyphae, keratitic fungi, corneal and retinal vessels vary widely making their automated detection cumbersome. Automated deep learning methods, endowed with superior self-learning capacity, have superseded the traditional machine learning methods, especially in complex images with challenging background. Automatic feature learning ability using large input data with better generalization and recognition capability, but devoid of human interference and excessive pre-processing, is highly beneficial in the above context. Varied attempts have been made by researchers to overcome challenges such as thin vessels, bifurcations and obstructive lesions in retinal vessel detection as revealed through several publications reviewed here. Revelations of diabetic neuropathic complications such as tortuosity, changes in the density and angles of the corneal fibers have been successfully sorted in many publications reviewed here. Since artifacts complicate the images and affect the quality of analysis, methods addressing these challenges have been described. Traditional and deep learning methods, that have been adapted and published between 2015 and 2021 covering retinal vessels, corneal nerves and filamentous fungi have been summarized in this review. We find several novel and meritorious ideas and techniques being put to use in the case of retinal vessel segmentation and classification, which by way of cross-domain adaptation can be utilized in the case of corneal and filamentous fungi also, making suitable adaptations to the challenges to be addressed.

Classification of deep vein thrombosis stages using convolutional neural network of electromyogram with vibrotactile stimulation toward developing an early diagnostic tool: A preliminary study on a pig model

Deep vein thrombosis (DVT) can lead to life-threatening disorders; however, it can only be recognized after its symptom appear. This study proposed a novel method that can detect the early stage of DVT using electromyography (EMG) signals with vibration stimuli using the convolutional neural networks (CNN) algorithm. The feasibility of the method was tested with eight legs before and after the surgical induction of DVT at nine-time points. Furthermore, perfusion pressure (PP), intracompartmental pressure (IP), and shear elastic modulus (SEM) of the tibialis anterior were also collected. In the proposed method, principal component analysis (PCA) and CNN were used to analyze the EMG data and classify it before and after the DVT stages. The cross-validation was performed in two strategies. One is for each leg and the other is the leave-one-leg-out (LOLO), test without any predicted information, for considering the practical diagnostic tool. The results showed that PCA-CNN can classify before and after DVT stages with an average accuracy of 100% (each leg) and 68.4±20.5% (LOLO). Moreover, all-time points (before induction of DVT and eight-time points after DVT) were classified with an average accuracy of 72.0±11.9% which is substantially higher accuracy than the chance levels (11% for 9-class classification). Based on the experimental results in the pig model, the proposed CNN-based method can classify the before- and after-DVT stages with high accuracy. The experimental results can provide a basis for further developing an early diagnostic tool for DVT using only EMG signals with vibration stimuli.

Automation and artificial intelligence in filamentous fungi-based bioprocesses: A review

By utilizing their powerful metabolic versatility, filamentous fungi can be utilized in bioprocesses aimed at achieving circular economy. With the current digital transformation within the biomanufacturing sector, the interest of automating fungi-based systems has intensified. The purpose of this paper was therefore to review the potentials connected to the use of automation and artificial intelligence in fungi-based systems. Automation is characterized by the substitution of manual tasks with mechanized tools. Artificial intelligence is, on the other hand, a domain within computer science that aims at designing tools and machines with the capacity to execute functions that would usually require human aptitude. Process flexibility, enhanced data reliability and increased productivity are some of the benefits of integrating automation and artificial intelligence in fungi-based bioprocesses. One of the existing gaps that requires further investigation is the use of such data-based technologies in the production of food from fungi.

Big data in corneal diseases and cataract: Current applications and future directions

The accelerated growth in electronic health records (EHR), Internet-of-Things, mHealth, telemedicine, and artificial intelligence (AI) in the recent years have significantly fuelled the interest and development in big data research. Big data refer to complex datasets that are characterized by the attributes of "5 Vs"-variety, volume, velocity, veracity, and value. Big data analytics research has so far benefitted many fields of medicine, including ophthalmology. The availability of these big data not only allow for comprehensive and timely examinations of the epidemiology, trends, characteristics, outcomes, and prognostic factors of many diseases, but also enable the development of highly accurate AI algorithms in diagnosing a wide range of medical diseases as well as discovering new patterns or associations of diseases that are previously unknown to clinicians and researchers. Within the field of ophthalmology, there is a rapidly expanding pool of large clinical registries, epidemiological studies, omics studies, and biobanks through which big data can be accessed. National corneal transplant registries, genome-wide association studies, national cataract databases, and large ophthalmology-related EHR-based registries (e.g., AAO IRIS Registry) are some of the key resources. In this review, we aim to provide a succinct overview of the availability and clinical applicability of big data in ophthalmology, particularly from the perspective of corneal diseases and cataract, the synergistic potential of big data, AI technologies, internet of things, mHealth, and wearable smart devices, and the potential barriers for realizing the clinical and research potential of big data in this field.

An artificial intelligence approach to classify pathogenic fungal genera of fungal keratitis using corneal confocal microscopy images

PURPOSE

Fungal keratitis is a common cause of blindness worldwide. Timely identification of the causative fungal genera is essential for clinical management. In vivo confocal microscopy (IVCM) provides useful information on pathogenic genera. This study attempted to apply deep learning (DL) to establish an automated method to identify pathogenic fungal genera using IVCM images.

METHODS

Deep learning networks were trained, validated, and tested using a data set of 3364 IVCM images that collected from 100 eyes of 100 patients with culture-proven filamentous fungal keratitis. Two transfer learning approaches were investigated: one was a combined framework that extracted features by a DL network and adopted decision tree (DT) as a classifier; another was a complete supervised DL model which used DL-based fully connected layers to implement the classification.

RESULTS

The DL classifier model revealed better performance compared with the DT classifier model in an independent testing set. The DL classifier model showed an area under the receiver operating characteristic curves (AUC) of 0.887 with an accuracy of 0.817, sensitivity of 0.791, specificity of 0.831, G-mean of 0.811, and F1 score of 0.749 in identifying Fusarium, and achieved an AUC of 0.827 with an accuracy of 0.757, sensitivity of 0.756, specificity of 0.759, G-mean of 0.757, and F1 score of 0.716 in identifying Aspergillus.

CONCLUSION

The DL model can classify Fusarium and Aspergillus by learning effective features in IVCM images automatically. The automated IVCM image analysis suggests a noninvasive identification of Fusarium and Aspergillus with clear potential application in early diagnosis and management of fungal keratitis.

Artificial intelligence-assisted diagnosis of ocular surface diseases

With the rapid development of computer technology, the application of artificial intelligence (AI) in ophthalmology research has gained prominence in modern medicine. Artificial intelligence-related research in ophthalmology previously focused on the screening and diagnosis of fundus diseases, particularly diabetic retinopathy, age-related macular degeneration, and glaucoma. Since fundus images are relatively fixed, their standards are easy to unify. Artificial intelligence research related to ocular surface diseases has also increased. The main issue with research on ocular surface diseases is that the images involved are complex, with many modalities. Therefore, this review aims to summarize current artificial intelligence research and technologies used to diagnose ocular surface diseases such as pterygium, keratoconus, infectious keratitis, and dry eye to identify mature artificial intelligence models that are suitable for research of ocular surface diseases and potential algorithms that may be used in the future.

Advances in artificial intelligence applications for ocular surface diseases diagnosis

In recent years, with the rapid development of computer technology, continual optimization of various learning algorithms and architectures, and establishment of numerous large databases, artificial intelligence (AI) has been unprecedentedly developed and applied in the field of ophthalmology. In the past, ophthalmological AI research mainly focused on posterior segment diseases, such as diabetic retinopathy, retinopathy of prematurity, age-related macular degeneration, retinal vein occlusion, and glaucoma optic neuropathy. Meanwhile, an increasing number of studies have employed AI to diagnose ocular surface diseases. In this review, we summarize the research progress of AI in the diagnosis of several ocular surface diseases, namely keratitis, keratoconus, dry eye, and pterygium. We discuss the limitations and challenges of AI in the diagnosis of ocular surface diseases, as well as prospects for the future.

Integration of Artificial Intelligence into the Approach for Diagnosis and Monitoring of Dry Eye Disease

Dry eye disease (DED) is one of the most common diseases worldwide that can lead to a significant impairment of quality of life. The diagnosis and treatment of the disease are often challenging because of the lack of correlation between the signs and symptoms, limited reliability of diagnostic tests, and absence of established consensus on the diagnostic criteria. The advancement of machine learning, particularly deep learning technology, has enabled the application of artificial intelligence (AI) in various anterior segment disorders, including DED. Currently, many studies have reported promising results of AI-based algorithms for the accurate diagnosis of DED and precise and reliable assessment of data obtained by imaging devices for DED. Thus, the integration of AI into clinical approaches for DED can enhance diagnostic and therapeutic performance. In this review, in addition to a brief summary of the application of AI in anterior segment diseases, we will provide an overview of studies regarding the application of AI in DED and discuss the recent advances in the integration of AI into the clinical approach for DED.

Artificial intelligence and corneal diseases

PURPOSE OF REVIEW

Artificial intelligence has advanced rapidly in recent years and has provided powerful tools to aid with the diagnosis, management, and treatment of ophthalmic diseases. This article aims to review the most current clinical artificial intelligence applications in anterior segment diseases, with an emphasis on microbial keratitis, keratoconus, dry eye syndrome, and Fuchs endothelial dystrophy.

RECENT FINDINGS

Most current artificial intelligence approaches have focused on developing deep learning algorithms based on various imaging modalities. Algorithms have been developed to detect and differentiate microbial keratitis classes and quantify microbial keratitis features. Artificial intelligence may aid with early detection and staging of keratoconus. Many advances have been made to detect, segment, and quantify features of dry eye syndrome and Fuchs. There is significant variability in the reporting of methodology, patient population, and outcome metrics.

SUMMARY

Artificial intelligence shows great promise in detecting, diagnosing, grading, and measuring diseases. There is a need for standardization of reporting to improve the transparency, validity, and comparability of algorithms.

A review on multimodal medical image fusion: Compendious analysis of medical modalities, multimodal databases, fusion techniques and quality metrics

BACKGROUND AND OBJECTIVES

Over the past two decades, medical imaging has been extensively apply to diagnose diseases. Medical experts continue to have difficulties for diagnosing diseases with a single modality owing to a lack of information in this domain. Image fusion may be use to merge images of specific organs with diseases from a variety of medical imaging systems. Anatomical and physiological data may be included in multi-modality image fusion, making diagnosis simpler. It is a difficult challenge to find the best multimodal medical database with fusion quality evaluation for assessing recommended image fusion methods. As a result, this article provides a complete overview of multimodal medical image fusion methodologies, databases, and quality measurements.

METHODS

In this article, a compendious review of different medical imaging modalities and evaluation of related multimodal databases along with the statistical results is provided. The medical imaging modalities are organized based on radiation, visible-light imaging, microscopy, and multimodal imaging.

RESULTS

The medical imaging acquisition is categorized into invasive or non-invasive techniques. The fusion techniques are classified into six main categories: frequency fusion, spatial fusion, decision-level fusion, deep learning, hybrid fusion, and sparse representation fusion. In addition, the associated diseases for each modality and fusion approach presented. The quality assessments fusion metrics are also encapsulated in this article.

CONCLUSIONS

This survey provides a baseline guideline to medical experts in this technical domain that may combine preoperative, intraoperative, and postoperative imaging, Multi-sensor fusion for disease detection, etc. The advantages and drawbacks of the current literature are discussed, and future insights are provided accordingly.

Region-Based Split Octonion Networks with Channel Attention Module for Tuna Classification

Tuna fish is a popular food because of its nutritional value and taste. Demand for various species of tuna increases over time, necessitating the development of a system to sort tuna fish into distinct species in export sectors in order to accelerate the process. The work proposes an automated tuna classification system based on split octonion network. The images are initially preprocessed and divided into region images. Each region image is applied to a split octonion network with eleven layers. In addition, a split octonion channel attention module is presented, which is fed to the last two convolutional layers. The features from the three octonion networks are fused and applied to a series of dense layers. In the last layer, a softmax classifier is utilized for final classification. Results show that the proposed region-based split octonion network with attention module gives an accuracy of 98.01% on tuna database. The region-based tuna classification model is fine-tuned for the categorization of six species from QUT-FishBase dataset and Fish-Pak dataset. The system shows accuracies of 97.83% and 98.17% on QUT-FishBase and Fish-Pak datasets, respectively. The proposed methodology is also compared with existing approaches using a variety of evaluation criteria.

The use of in vivo confocal microscopy in fungal keratitis - Progress and challenges

Fungal keratitis (FK) is a serious and sight-threatening corneal infection with global reach. The need for prompt diagnosis is paramount, as a delay in initiation of treatment could lead to irreversible vision loss. Current "gold standard" diagnostic methods, namely corneal smear and culture, have limitations due to diagnostic insensitivity and their time-consuming nature. PCR is a newer, complementary method used in the diagnosis of fungal keratitis, whose results are also sample-dependent. In vivo confocal microscopy (IVCM) is a promising complementary diagnostic method of increasing importance as it allows non-invasive real-time direct visualization of potential fungal pathogens and manifesting infection directly in the patient's cornea. In numerous articles and case reports, FK diagnosis by IVCM has been evaluated, and different features, approaches, sensitivity/specificity, and limitations have been noted. Here, we provide an up-to-date, comprehensive review of the current literature and present the authors' combined recommendations for fungal identification in IVCM images, while also looking to the future of FK assessment by IVCM using artificial intelligence methods.

Evaluation of Machine Learning Algorithms for Early Diagnosis of Deep Venous Thrombosis

Deep venous thrombosis (DVT) is a disease that must be diagnosed quickly, as it can trigger the death of patients. Nowadays, one can find different ways to determine it, including clinical scoring, D-dimer, ultrasonography, etc. Recently, scientists have focused efforts on using machine learning (ML) and neural networks for disease diagnosis, progressively increasing the accuracy and efficacy. Patients with suspected DVT have no apparent symptoms. Using pattern recognition techniques, aiding good timely diagnosis, as well as well-trained ML models help to make good decisions and validation. The aim of this paper is to propose several ML models for a more efficient and reliable DVT diagnosis through its implementation on an edge device for the development of instruments that are smart, portable, reliable, and cost-effective. The dataset was obtained from a state-of-the-art article. It is divided into 85% for training and cross-validation and 15% for testing. The input data in this study are the Wells criteria, the patient’s age, and the patient’s gender. The output data correspond to the patient’s diagnosis. This study includes the evaluation of several classifiers such as Decision Trees (DT), Extra Trees (ET), K-Nearest Neighbor (KNN), Multi-Layer Perceptron Neural Network (MLP-NN), Random Forest (RF), and Support Vector Machine (SVM). Finally, the implementation of these ML models on a high-performance embedded system is proposed to develop an intelligent system for early DVT diagnosis. It is reliable, portable, open source, and low cost. The performance of different ML algorithms was evaluated, where KNN achieved the highest accuracy of 90.4% and specificity of 80.66% implemented on personal computer (PC) and Raspberry Pi 4 (RPi4). The accuracy of all trained models on PC and Raspberry Pi 4 is greater than 85%, while the area under the curve (AUC) values are between 0.81 and 0.86. In conclusion, as compared to traditional methods, the best ML classifiers are effective at predicting DVT in an early and efficient manner.

Diagnostic armamentarium of infectious keratitis: A comprehensive review

Infectious keratitis (IK) represents the leading cause of corneal blindness worldwide, particularly in developing countries. A good outcome of IK is contingent upon timely and accurate diagnosis followed by appropriate interventions. Currently, IK is primarily diagnosed on clinical grounds supplemented by microbiological investigations such as microscopic examination with stains, and culture and sensitivity testing. Although this is the most widely accepted practice adopted in most regions, such an approach is challenged by several factors, including indistinguishable clinical features shared among different causative organisms, polymicrobial infection, long diagnostic turnaround time, and variably low culture positivity rate. In this review, we aim to provide a comprehensive overview of the current diagnostic armamentarium of IK, encompassing conventional microbiological investigations, molecular diagnostics (including polymerase chain reaction and mass spectrometry), and imaging modalities (including anterior segment optical coherence tomography and in vivo confocal microscopy). We also highlight the potential roles of emerging technologies such as next-generation sequencing, artificial intelligence-assisted platforms. and tele-medicine in shaping the future diagnostic landscape of IK.

Feasibility assessment of infectious keratitis depicted on slit-lamp and smartphone photographs using deep learning

BACKGROUND

This study aims to investigate how infectious keratitis depicted on slit-lamp and smartphone photographs can be reliably assessed using deep learning.

MATERIALS AND METHODS

We retrospectively collected a dataset consisting of 5,673 slit-lamp photographs and 400 smartphone photographs acquired on different subjects. Based on multiple clinical tests (e.g., cornea scraping), these photographs were diagnosed and classified into four categories, including normal (i.e., no keratitis), bacterial keratitis (BK), fungal keratitis (FK), and herpes simplex virus stromal keratitis (HSK). We preprocessed these slit-lamp images into two separate subgroups: (1) global images and (2) regional images. The cases in each group were randomly split into training, internal validation, and independent testing sets. Then, we implemented a deep learning network based on the InceptionV3 by fine-tuning its architecture and used the developed network to classify these slit-lamp images. Additionally, we investigated the performance of the InceptionV3 model in classifying infectious keratitis depicted on smartphone images. We, in particular, clarified whether the computer model trained on the global images outperformed the one trained on the regional images. The quadratic weighted kappa (QWK) and the receiver operating characteristic (ROC) analysis were used to assess the performance of the developed models.

RESULTS

Our experiments on the independent testing sets showed that the developed models achieved the QWK of 0.9130 (95% CI: 88.99-93.61%) and 0.8872 (95% CI: 86.13-91.31%), and 0.5379 (95% CI, 48.89-58.69%) for the global images, the regional images, and the smartphone images, respectively. The area under the ROC curves (AUCs) were 0.9588 (95% CI: 94.28-97.48%), 0.9425 (95% CI: 92.35-96.15%), and 0.8529 (95% CI: 81.79-88.79%) for the same test sets, respectively.

CONCLUSION

The deep learning solution demonstrated very promising performance in assessing infectious keratitis depicted on slit-lamp photographs and the images acquired by smartphones. In particular, the model trained on the global images outperformed that trained on the regional images.

Lens Opacities Classification System III-based artificial intelligence program for automatic cataract grading

PURPOSE

To establish and validate an artificial intelligence (AI)-assisted automatic cataract grading program based on the Lens Opacities Classification System III (LOCSIII).

SETTING

Eye and Ear, Nose, and Throat (EENT) Hospital, Fudan University, Shanghai, China.

DESIGN

AI training.

METHODS

Advanced deep-learning algorithms, including Faster R-CNN and ResNet, were applied to the localization and analysis of the region of interest. An internal dataset from the EENT Hospital of Fudan University and an external dataset from the Pujiang Eye Study were used for AI training, validation, and testing. The datasets were automatically labeled on the AI platform in terms of the capture mode and cataract grading based on the LOCSIII system.

RESULTS

The AI program showed reliable capture mode recognition, grading, and referral capability for nuclear and cortical cataract grading. In the internal and external datasets, 99.4% and 100% of automatic nuclear grading, respectively, had an absolute prediction error of ≤ 1.0, with a satisfactory referral capability (area under the curve [AUC]: 0.983 for the internal dataset; 0.977 for the external dataset). 75.0% (internal dataset) and 93.5% (external dataset) of the automatic cortical grades had an absolute prediction error of ≤ 1.0, with AUCs of 0.855 and 0.795 for referral, respectively. Good consistency was observed between automatic and manual grading when both nuclear and cortical cataracts were evaluated. However, automatic grading of posterior subcapsular cataracts was impractical.

CONCLUSIONS

The AI program proposed in this study shows robust grading and diagnostic performance for both nuclear and cortical cataracts, based on LOCSIII.

A Review On digital image processing techniques for in-Vivo confocal images of the cornea

This work reviews the scientific literature regarding digital image processing for in vivo confocal microscopy images of the cornea. We present and discuss a selection of prominent techniques designed for semi- and automatic analysis of four areas of the cornea (epithelium, sub-basal nerve plexus, stroma and endothelium). The main context is image enhancement, detection of structures of interest, and quantification of clinical information. We have found that the preprocessing stage lacks of quantitative studies regarding the quality of the enhanced image, or its effects in subsequent steps of the image processing. Threshold values are widely used in the reviewed methods, although generally, they are selected empirically and manually. The image processing results are evaluated in many cases through comparison with gold standards not widely accepted. It is necessary to standardize values to be quantified in terms of sensitivity and specificity of methods. Most of the reviewed studies do not show an estimation of the computational cost of the image processing. We conclude that reliable, automatic, computer-assisted image analysis of the cornea is still an open issue, constituting an interesting and worthwhile area of research.

Automated Inorganic Pigment Classification in Plastic Material Using Terahertz Spectroscopy

This paper presents an automatic classification of plastic material's inorganic pigment using terahertz spectroscopy and convolutional neural networks (CNN). The plastic materials were placed between the THz transmitter and receiver, and the acquired THz signals were classified using a supervised learning approach. A THz frequency band between 0.1-1.2 THz produced a one-dimensional (1D) vector that is almost impossible to classify directly using supervised learning. This paper proposes a novel pre-processing of 1D THz data that transforms 1D data into 2D data, which are processed efficiently using a convolutional neural network. The proposed pre-processing algorithm consists of four steps: peak detection, envelope extraction, and a down-sampling procedure. The last main step introduces the windowing with spectrum dilatation that reorders 1D data into 2D data that can be considered as an image. The spectrum dilation techniques ensure the classifier's robustness by suppressing measurement bias, reducing the complexity of the THz dataset with negligible loss of accuracy, and speeding up the network classification. The experimental results showed that the proposed approach achieved high accuracy using a CNN classifier, and outperforms 1D classification of THz data using support vector machine, naive Bayes, and other popular classification algorithms.

Artificial Intelligence in Cornea, Refractive Surgery, and Cataract: Basic Principles, Clinical Applications, and Future Directions

ABSTRACT

Corneal diseases, uncorrected refractive errors, and cataract represent the major causes of blindness globally. The number of refractive surgeries, either cornea- or lens-based, is also on the rise as the demand for perfect vision continues to increase. With the recent advancement and potential promises of artificial intelligence (AI) technologies demonstrated in the realm of ophthalmology, particularly retinal diseases and glaucoma, AI researchers and clinicians are now channeling their focus toward the less explored ophthalmic areas related to the anterior segment of the eye. Conditions that rely on anterior segment imaging modalities, including slit-lamp photography, anterior segment optical coherence tomography, corneal tomography, in vivo confocal microscopy and/or optical biometers, are the most commonly explored areas. These include infectious keratitis, keratoconus, corneal grafts, ocular surface pathologies, preoperative screening before refractive surgery, intraocular lens calculation, and automated refraction, among others. In this review, we aimed to provide a comprehensive update on the utilization of AI in anterior segment diseases, with particular emphasis on the recent advancement in the past few years. In addition, we demystify some of the basic principles and terminologies related to AI, particularly machine learning and deep learning, to help improve the understanding, research and clinical implementation of these AI technologies among the ophthalmologists and vision scientists. As we march toward the era of digital health, guidelines such as CONSORT-AI, SPIRIT-AI, and STARD-AI will play crucial roles in guiding and standardizing the conduct and reporting of AI-related trials, ultimately promoting their potential for clinical translation.

Automatic Detection of Coronavirus Disease (COVID-19) in X-ray and CT Images: A Machine Learning Based Approach

The newly identified Coronavirus pneumonia, subsequently termed COVID-19, is highly transmittable and pathogenic with no clinically approved antiviral drug or vaccine available for treatment. The most common symptoms of COVID-19 are dry cough, sore throat, and fever. Symptoms can progress to a severe form of pneumonia with critical complications, including septic shock, pulmonary edema, acute respiratory distress syndrome and multi-organ failure. While medical imaging is not currently recommended in Canada for primary diagnosis of COVID-19, computer-aided diagnosis systems could assist in the early detection of COVID-19 abnormalities and help to monitor the progression of the disease, potentially reduce mortality rates. In this study, we compare popular deep learning-based feature extraction frameworks for automatic COVID-19 classification. To obtain the most accurate feature, which is an essential component of learning, MobileNet, DenseNet, Xception, ResNet, InceptionV3, InceptionResNetV2, VGGNet, NASNet were chosen amongst a pool of deep convolutional neural networks. The extracted features were then fed into several machine learning classifiers to classify subjects as either a case of COVID-19 or a control. This approach avoided task-specific data pre-processing methods to support a better generalization ability for unseen data. The performance of the proposed method was validated on a publicly available COVID-19 dataset of chest X-ray and CT images. The DenseNet121 feature extractor with Bagging tree classifier achieved the best performance with 99% classification accuracy. The second-best learner was a hybrid of the a ResNet50 feature extractor trained by LightGBM with an accuracy of 98.

Anterior Segment and Others in Teleophthalmology: Past, Present, and Future

ABSTRACT

Teleophthalmology, a subfield of telemedicine, has recently been widely applied in ophthalmic disease management, accelerated by ubiquitous connectivity via mobile computing and communication applications. Teleophthalmology has strengths in overcoming geographic barriers and broadening access to medical resources, as a supplement to face-to-face clinical settings. Eyes, especially the anterior segment, are one of the most researched superficial parts of the human body. Therefore, ophthalmic images, easily captured by portable devices, have been widely applied in teleophthalmology, boosted by advancements in software and hardware in recent years. This review aims to revise current teleophthalmology applications in the anterior segment and other diseases from a temporal and spatial perspective, and summarize common scenarios in teleophthalmology, including screening, diagnosis, treatment, monitoring, postoperative follow-up, and tele-education of patients and clinical practitioners. Further, challenges in the current application of teleophthalmology and the future development of teleophthalmology are discussed.

Multi-input convolutional neural network for breast cancer detection using thermal images and clinical data

BACKGROUND AND OBJECTIVE

Breast cancer is the most common cancer in women. While mammography is the most widely used screening technique for the early detection of this disease, it has several disadvantages such as radiation exposure or high economic cost. Recently, multiple authors studied the ability of machine learning algorithms for early diagnosis of breast cancer using thermal images, showing that thermography can be considered as a complementary test to mammography, or even as a primary test under certain circumstances. Moreover, although some personal and clinical data are considered risk factors of breast cancer, none of these works considered that information jointly with thermal images.

METHODS

We propose a novel approach for early detection of breast cancer combining thermal images of different views with personal and clinical data, building a multi-input classification model which exploits the benefits of convolutional neural networks for image analysis. First, we searched for structures using only thermal images. Next, we added the clinical data as a new branch of each of these structures, aiming to improve its performance.

RESULTS

We applied our method to the most widely used public database of breast thermal images, the Database for Mastology Research with Infrared Image. The best model achieves a 97% accuracy and an area under the ROC curve of 0.99, with a specificity of 100% and a sensitivity of 83%.

CONCLUSIONS

After studying the impact of thermal images and personal and clinical data on multi-input convolutional neural networks for breast cancer diagnosis, we conclude that: (1) adding the lateral views to the front view improves the performance of the classification model, and (2) including personal and clinical data helps the model to recognize sick patients.

Update on the management of fungal keratitis

PURPOSE

The aim of this article is to introduce the recent advance on the studies of fungal keratitis published over past 5 years.

METHODS

We performed literature review of articles published on PubMed, Google Scholar, CNKI and Web of Science relevant to the diagnosis, pathogenesis and novel treatment of fungal keratitis.

RESULTS

Excessive inflammation can lead to stromal damage and corneal opacification, hence the research on immune mechanism provides many potential therapeutic targets for fungal keratitis. Many researchers discussed the importance of earlier definitive diagnosis and were trying to find rapid and accurate diagnostic methods of pathogens. Develop new drug delivery systems and new routes of administration with better corneal penetration, prolonged ocular residence time, and better mucoadhesive properties is also one of the research hotspots. Additionally, many novel therapeutic agents and methods have been gradually applied in clinical ophthalmology.

CONCLUSION

The diagnosis and treatment of fungal keratitis are still a challenge for ophthalmologist, and many researches provide new methods to conquer these problems.

A Transfer Residual Neural Network Based on ResNet-34 for Detection of Wood Knot Defects

In recent years, due to the shortage of timber resources, it has become necessary to reduce the excessive consumption of forest resources. Non-destructive testing technology can quickly find wood defects and effectively improve wood utilization. Deep learning has achieved significant results as one of the most commonly used methods in the detection of wood knots. However, compared with convolutional neural networks in other fields, the depth of deep learning models for the detection of wood knots is still very shallow. This is because the number of samples marked in the wood detection is too small, which limits the accuracy of the final prediction of the results. In this paper, ResNet-34 is combined with transfer learning, and a new TL-ResNet34 deep learning model with 35 convolution depths is proposed to detect wood knot defects. Among them, ResNet-34 is used as a feature extractor for wood knot defects. At the same time, a new method TL-ResNet34 is proposed, which combines ResNet-34 with transfer learning. After that, the wood knot defect dataset was applied to TL-ResNet34 for testing. The results show that the detection accuracy of the dataset trained by TL-ResNet34 is significantly higher than that of other methods. This shows that the final prediction accuracy of the detection of wood knot defects can be improved by TL-ResNet34.

A new clustering method for the diagnosis of CoVID19 using medical images

With the spread of COVID-19, there is an urgent need for a fast and reliable diagnostic aid. For the same, literature has witnessed that medical imaging plays a vital role, and tools using supervised methods have promising results. However, the limited size of medical images for diagnosis of CoVID19 may impact the generalization of such supervised methods. To alleviate this, a new clustering method is presented. In this method, a novel variant of a gravitational search algorithm is employed for obtaining optimal clusters. To validate the performance of the proposed variant, a comparative analysis among recent metaheuristic algorithms is conducted. The experimental study includes two sets of benchmark functions, namely standard functions and CEC2013 functions, belonging to different categories such as unimodal, multimodal, and unconstrained optimization functions. The performance comparison is evaluated and statistically validated in terms of mean fitness value, Friedman test, and box-plot. Further, the presented clustering method tested against three different types of publicly available CoVID19 medical images, namely X-ray, CT scan, and Ultrasound images. Experiments demonstrate that the proposed method is comparatively outperforming in terms of accuracy, precision, sensitivity, specificity, and F1-score.

An Artificial Neural Network Approach and a Data Augmentation Algorithm to Systematize the Diagnosis of Deep-Vein Thrombosis by Using Wells’ Criteria

The use of a back-propagation artificial neural network (ANN) to systematize the reliability of a Deep Vein Thrombosis (DVT) diagnostic by using Wells’ criteria is introduced herein. In this paper, a new ANN model is proposed to improve the Accuracy when dealing with a highly unbalanced dataset. To create the training dataset, a new data augmentation algorithm based on statistical data known as the prevalence of DVT of real cases reported in literature and from the public hospital is proposed. The above is used to generate one dataset of 10,000 synthetic cases. Each synthetic case has nine risk factors according to Wells’ criteria and also the use of two additional factors, such as gender and age, is proposed. According to interviews with medical specialists, a training scheme was established. In addition, a new algorithm is presented to improve the Accuracy and Sensitivity/Recall. According to the proposed algorithm, two thresholds of decision were found, the first one is 0.484, which is to improve Accuracy. The other one is 0.138 to improve Sensitivity/Recall. The Accuracy achieved is 90.99%, which is greater than that obtained with other related machine learning methods. The proposed ANN model was validated performing the k-fold cross validation technique using a dataset with 10,000 synthetic cases. The test was performed by using 59 real cases obtained from a regional hospital, achieving an Accuracy of 98.30%.

Artificial intelligence for anterior segment diseases: Emerging applications in ophthalmology

With the advancement of computational power, refinement of learning algorithms and architectures, and availability of big data, artificial intelligence (AI) technology, particularly with machine learning and deep learning, is paving the way for 'intelligent' healthcare systems. AI-related research in ophthalmology previously focused on the screening and diagnosis of posterior segment diseases, particularly diabetic retinopathy, age-related macular degeneration and glaucoma. There is now emerging evidence demonstrating the application of AI to the diagnosis and management of a variety of anterior segment conditions. In this review, we provide an overview of AI applications to the anterior segment addressing keratoconus, infectious keratitis, refractive surgery, corneal transplant, adult and paediatric cataracts, angle-closure glaucoma and iris tumour, and highlight important clinical considerations for adoption of AI technologies, potential integration with telemedicine and future directions.