Context-Aware Convolutional Neural Networks for Stroke Sign Detection in Non-contrast CT Scans. In: Valdés Hernández M, González-castro V, editors. Medical Image Understanding and Analysis. Cham: Springer International Publishing; 2017. pp. 494-505. [DOI: 10.1007/978-3-319-60964-5_43]

CLAHE-CapsNet: Efficient retina optical coherence tomography classification using capsule networks with contrast limited adaptive histogram equalization

Manual detection of eye diseases using retina Optical Coherence Tomography (OCT) images by Ophthalmologists is time consuming, prone to errors and tedious. Previous researchers have developed a computer aided system using deep learning-based convolutional neural networks (CNNs) to aid in faster detection of the retina diseases. However, these methods find it difficult to achieve better classification performance due to noise in the OCT image. Moreover, the pooling operations in CNN reduce resolution of the image that limits the performance of the model. The contributions of the paper are in two folds. Firstly, this paper makes a comprehensive literature review to establish current-state-of-act methods successfully implemented in retina OCT image classifications. Additionally, this paper proposes a capsule network coupled with contrast limited adaptive histogram equalization (CLAHE-CapsNet) for retina OCT image classification. The CLAHE was implemented as layers to minimize the noise in the retina image for better performance of the model. A three-layer convolutional capsule network was designed with carefully chosen hyperparameters. The dataset used for this study was presented by University of California San Diego (UCSD). The dataset consists of 84,495 X-Ray images (JPEG) and 4 categories (NORMAL, CNV, DME, and DRUSEN). The images went through a grading system consisting of multiple layers of trained graders of expertise for verification and correction of image labels. Evaluation experiments were conducted and comparison of results was done with state-of-the-art models to find out the best performing model. The evaluation metrics; accuracy, sensitivity, precision, specificity, and AUC are used to determine the performance of the models. The evaluation results show that the proposed model achieves the best performing model of accuracies of 97.7%, 99.5%, and 99.3% on overall accuracy (OA), overall sensitivity (OS), and overall precision (OP), respectively. The results obtained indicate that the proposed model can be adopted and implemented to help ophthalmologists in detecting retina OCT diseases.

Deep-Learning-Based Thrombus Localization and Segmentation in Patients with Posterior Circulation Stroke

Thrombus volume in posterior circulation stroke (PCS) has been associated with outcome, through recanalization. Manual thrombus segmentation is impractical for large scale analysis of image characteristics. Hence, in this study we develop the first automatic method for thrombus localization and segmentation on CT in patients with PCS. In this multi-center retrospective study, 187 patients with PCS from the MR CLEAN Registry were included. We developed a convolutional neural network (CNN) that segments thrombi and restricts the volume-of-interest (VOI) to the brainstem (Polar-UNet). Furthermore, we reduced false positive localization by removing small-volume objects, referred to as volume-based removal (VBR). Polar-UNet is benchmarked against a CNN that does not restrict the VOI (BL-UNet). Performance metrics included the intra-class correlation coefficient (ICC) between automated and manually segmented thrombus volumes, the thrombus localization precision and recall, and the Dice coefficient. The majority of the thrombi were localized. Without VBR, Polar-UNet achieved a thrombus localization recall of 0.82, versus 0.78 achieved by BL-UNet. This high recall was accompanied by a low precision of 0.14 and 0.09. VBR improved precision to 0.65 and 0.56 for Polar-UNet and BL-UNet, respectively, with a small reduction in recall to 0.75 and 0.69. The Dice coefficient achieved by Polar-UNet was 0.44, versus 0.38 achieved by BL-UNet with VBR. Both methods achieved ICCs of 0.41 (95% CI: 0.27–0.54). Restricting the VOI to the brainstem improved the thrombus localization precision, recall, and segmentation overlap compared to the benchmark. VBR improved thrombus localization precision but lowered recall.

Investigating the use of a two-stage attention-aware convolutional neural network for the automated diagnosis of otitis media from tympanic membrane images: a prediction model development and validation study

OBJECTIVES

This study investigated the usefulness and performance of a two-stage attention-aware convolutional neural network (CNN) for the automated diagnosis of otitis media from tympanic membrane (TM) images.

DESIGN

A classification model development and validation study in ears with otitis media based on otoscopic TM images. Two commonly used CNNs were trained and evaluated on the dataset. On the basis of a Class Activation Map (CAM), a two-stage classification pipeline was developed to improve accuracy and reliability, and simulate an expert reading the TM images.

SETTING AND PARTICIPANTS

This is a retrospective study using otoendoscopic images obtained from the Department of Otorhinolaryngology in China. A dataset was generated with 6066 otoscopic images from 2022 participants comprising four kinds of TM images, that is, normal eardrum, otitis media with effusion (OME) and two stages of chronic suppurative otitis media (CSOM).

RESULTS

The proposed method achieved an overall accuracy of 93.4% using ResNet50 as the backbone network in a threefold cross-validation. The F1 Score of classification for normal images was 94.3%, and 96.8% for OME. There was a small difference between the active and inactive status of CSOM, achieving 91.7% and 82.4% F1 scores, respectively. The results demonstrate a classification performance equivalent to the diagnosis level of an associate professor in otolaryngology.

CONCLUSIONS

CNNs provide a useful and effective tool for the automated classification of TM images. In addition, having a weakly supervised method such as CAM can help the network focus on discriminative parts of the image and improve performance with a relatively small database. This two-stage method is beneficial to improve the accuracy of diagnosis of otitis media for junior otolaryngologists and physicians in other disciplines.

Machine Learning for Detecting Early Infarction in Acute Stroke with Non-Contrast-enhanced CT

Background Identifying the presence and extent of infarcted brain tissue at baseline plays a crucial role in the treatment of patients with acute ischemic stroke (AIS). Patients with extensive infarction are unlikely to benefit from thrombolysis or thrombectomy procedures. Purpose To develop an automated approach to detect and quantitate infarction by using non-contrast-enhanced CT scans in patients with AIS. Materials and Methods Non-contrast-enhanced CT images in patients with AIS (<6 hours from symptom onset to CT) who also underwent diffusion-weighted (DW) MRI within 1 hour after AIS were obtained from May 2004 to July 2009 and were included in this retrospective study. Ischemic lesions manually contoured on DW MRI scans were used as the reference standard. An automatic segmentation approach involving machine learning (ML) was developed to detect infarction. Randomly selected nonenhanced CT images from 157 patients with the lesion labels manually contoured on DW MRI scans were used to train and validate the ML model; the remaining 100 patients independent of the derivation cohort were used for testing. The ML algorithm was quantitatively compared with the reference standard (DW MRI) by using Bland-Altman plots and Pearson correlation. Results In 100 patients in the testing data set (median age, 69 years; interquartile range [IQR]: 59-76 years; 59 men), baseline non-contrast-enhanced CT was performed within a median time of 48 minutes from symptom onset (IQR, 27-93 minutes); baseline MRI was performed a median of 38 minutes (IQR, 24-48 minutes) later. The algorithm-detected lesion volume correlated with the reference standard of expert-contoured lesion volume in acute DW MRI scans (r = 0.76, P < .001). The mean difference between the algorithm-segmented volume (median, 15 mL; IQR, 9-38 mL) and the DW MRI volume (median, 19 mL; IQR, 5-43 mL) was 11 mL (P = .89). Conclusion A machine learning approach for segmentation of infarction on non-contrast-enhanced CT images in patients with acute ischemic stroke showed good agreement with stroke volume on diffusion-weighted MRI scans. © RSNA, 2020 Online supplemental material is available for this article. See also the editorial by Nael in this issue.

Artificial intelligence to diagnose ischemic stroke and identify large vessel occlusions: a systematic review

Background and purpose

Acute stroke caused by large vessel occlusions (LVOs) requires emergent detection and treatment by endovascular thrombectomy. However, radiologic LVO detection and treatment is subject to variable delays and human expertise, resulting in morbidity. Imaging software using artificial intelligence (AI) and machine learning (ML), a branch of AI, may improve rapid frontline detection of LVO strokes. This report is a systematic review of AI in acute LVO stroke identification and triage, and characterizes LVO detection software.

Methods

A systematic review of acute stroke diagnostic-focused AI studies from January 2014 to February 2019 in PubMed, Medline, and Embase using terms: ‘artificial intelligence’ or ‘machine learning or deep learning’ and ‘ischemic stroke’ or ‘large vessel occlusion’ was performed.

Results

Variations of AI, including ML methods of random forest learning (RFL) and convolutional neural networks (CNNs), are used to detect LVO strokes. Twenty studies were identified that use ML. Alberta Stroke Program Early CT Score (ASPECTS) commonly used RFL, while LVO detection typically used CNNs. Image feature detection had greater sensitivity with CNN than with RFL, 85% versus 68%. However, AI algorithm performance metrics use different standards, precluding ideal objective comparison. Four current software platforms incorporate ML: Brainomix (greatest validation of AI for ASPECTS, uses CNNs to automatically detect LVOs), General Electric, iSchemaView (largest number of perfusion study validations for thrombectomy), and Viz.ai (uses CNNs to automatically detect LVOs, then automatically activates emergency stroke treatment systems).

Conclusions

AI may improve LVO stroke detection and rapid triage necessary for expedited treatment. Standardization of performance assessment is needed in future studies.

Attention to Lesion: Lesion-Aware Convolutional Neural Network for Retinal Optical Coherence Tomography Image Classification

Automatic and accurate classification of retinal optical coherence tomography (OCT) images is essential to assist ophthalmologist in the diagnosis and grading of macular diseases. Clinically, ophthalmologists usually diagnose macular diseases according to the structures of macular lesions, whose morphologies, size, and numbers are important criteria. In this paper, we propose a novel lesion-aware convolutional neural network (LACNN) method for retinal OCT image classification, in which retinal lesions within OCT images are utilized to guide the CNN to achieve more accurate classification. The LACNN simulates the ophthalmologists' diagnosis that focuses on local lesion-related regions when analyzing the OCT image. Specifically, we first design a lesion detection network to generate a soft attention map from the whole OCT image. The attention map is then incorporated into a classification network to weight the contributions of local convolutional representations. Guided by the lesion attention map, the classification network can utilize the information from local lesion-related regions to further accelerate the network training process and improve the OCT classification. Our experimental results on two clinically acquired OCT datasets demonstrate the effectiveness and efficiency of the proposed LACNN method for retinal OCT image classification.

3D convolutional neural networks applied to CT angiography in the detection of acute ischemic stroke

Background

The aim of this study was to investigate the feasibility of ischemic stroke detection from computed tomography angiography source images (CTA-SI) using three-dimensional convolutional neural networks.

Methods

CTA-SI of 60 patients with a suspected acute ischemic stroke of the middle cerebral artery were randomly selected for this study; 30 patients were used in the neural network training, and the subsequent testing was performed using the remaining 30 patients. The training and testing were based on manually segmented lesions. Cerebral hemispheric comparison CTA and non-contrast computed tomography (NCCT) were studied as additional input features.

Results

All ischemic lesions in the testing data were correctly lateralized, and a high correspondence to manual segmentations was achieved. Patients with a diagnosed stroke had clinically relevant regions labeled infarcted with a 0.93 sensitivity and 0.82 specificity. The highest achieved voxel-wise area under receiver operating characteristic curve was 0.93, and the highest Dice similarity coefficient was 0.61. When cerebral hemispheric comparison was used as an input feature, the algorithm performance improved. Only a slight effect was seen when NCCT was included.

Conclusion

The results support the hypothesis that an acute ischemic stroke lesion can be detected with 3D convolutional neural network-based software from CTA-SI. Utilizing information from the contralateral hemisphere appears to be beneficial for reducing false positive findings.