A deep supervised approach for ischemic lesion segmentation from multimodal MRI using Fully Convolutional Network

A 25-Year Retrospective of the Use of AI for Diagnosing Acute Stroke: Systematic Review

BACKGROUND

Stroke is a leading cause of death and disability worldwide. Rapid and accurate diagnosis is crucial for minimizing brain damage and optimizing treatment plans.

OBJECTIVE

This review aims to summarize the methods of artificial intelligence (AI)-assisted stroke diagnosis over the past 25 years, providing an overview of performance metrics and algorithm development trends. It also delves into existing issues and future prospects, intending to offer a comprehensive reference for clinical practice.

METHODS

A total of 50 representative articles published between 1999 and 2024 on using AI technology for stroke prevention and diagnosis were systematically selected and analyzed in detail.

RESULTS

AI-assisted stroke diagnosis has made significant advances in stroke lesion segmentation and classification, stroke risk prediction, and stroke prognosis. Before 2012, research mainly focused on segmentation using traditional thresholding and heuristic techniques. From 2012 to 2016, the focus shifted to machine learning (ML)-based approaches. After 2016, the emphasis moved to deep learning (DL), which brought significant improvements in accuracy. In stroke lesion segmentation and classification as well as stroke risk prediction, DL has shown superiority over ML. In stroke prognosis, both DL and ML have shown good performance.

CONCLUSIONS

Over the past 25 years, AI technology has shown promising performance in stroke diagnosis.

Robust Ensemble of Two Different Multimodal Approaches to Segment 3D Ischemic Stroke Segmentation Using Brain Tumor Representation Among Multiple Center Datasets

Ischemic stroke segmentation at an acute stage is vital in assessing the severity of patients' impairment and guiding therapeutic decision-making for reperfusion. Although many deep learning studies have shown attractive performance in medical segmentation, it is difficult to use these models trained on public data with private hospitals' datasets. Here, we demonstrate an ensemble model that employs two different multimodal approaches for generalization, a more effective way to perform on external datasets. First, after we jointly train a segmentation model on diffusion-weighted imaging (DWI) and apparent diffusion coefficient (ADC) MR modalities, the model is inferred on the DWI images. Second, a channel-wise segmentation model is trained by concatenating the DWI and ADC images as input, and then is inferred using both MR modalities. Before training with ischemic stroke data, we utilized BraTS 2021, a public brain tumor dataset, for transfer learning. An extensive ablation study evaluates which strategy learns better representations for ischemic stroke segmentation. In our study, nnU-Net well-known for robustness is selected as our baseline model. Our proposed method is evaluated on three different datasets: the Asan Medical Center (AMC) I and II, and the 2022 Ischemic Stroke Lesion Segmentation (ISLES). Our experiments are widely validated over a large, multi-center, and multi-scanner dataset with a huge amount of 846 scans. Not only stroke lesion models can benefit from transfer learning using brain tumor data, but combining the MR modalities using different training schemes also highly improves segmentation performance. The method achieved a top-1 ranking in the ongoing ISLES'22 challenge and performed particularly well on lesion-wise metrics of interest to neuroradiologists, achieving a Dice coefficient of 78.69% and a lesion-wise F1 score of 82.46%. Also, the method was relatively robust on the AMC I (Dice, 60.35%; lesion-wise F1, 68.30%) and II (Dice; 74.12%; lesion-wise F1, 67.53%) datasets in different settings. The high segmentation accuracy of our proposed method could improve radiologists' ability to detect ischemic stroke lesions in MRI images. Our model weights and inference code are available on https://github.com/MDOpx/ISLES22-model-inference .

AI-Enhanced Detection of Clinically Relevant Structural and Functional Anomalies in MRI: Traversing the Landscape of Conventional to Explainable Approaches

Anomaly detection in medical imaging, particularly within the realm of magnetic resonance imaging (MRI), stands as a vital area of research with far-reaching implications across various medical fields. This review meticulously examines the integration of artificial intelligence (AI) in anomaly detection for MR images, spotlighting its transformative impact on medical diagnostics. We delve into the forefront of AI applications in MRI, exploring advanced machine learning (ML) and deep learning (DL) methodologies that are pivotal in enhancing the precision of diagnostic processes. The review provides a detailed analysis of preprocessing, feature extraction, classification, and segmentation techniques, alongside a comprehensive evaluation of commonly used metrics. Further, this paper explores the latest developments in ensemble methods and explainable AI, offering insights into future directions and potential breakthroughs. This review synthesizes current insights, offering a valuable guide for researchers, clinicians, and medical imaging experts. It highlights AI's crucial role in improving the precision and speed of detecting key structural and functional irregularities in MRI. Our exploration of innovative techniques and trends furthers MRI technology development, aiming to refine diagnostics, tailor treatments, and elevate patient care outcomes. LEVEL OF EVIDENCE: 5 TECHNICAL EFFICACY: Stage 1.

Stroke Lesion Segmentation and Deep Learning: A Comprehensive Review

Stroke is a medical condition that affects around 15 million people annually. Patients and their families can face severe financial and emotional challenges as it can cause motor, speech, cognitive, and emotional impairments. Stroke lesion segmentation identifies the stroke lesion visually while providing useful anatomical information. Though different computer-aided software are available for manual segmentation, state-of-the-art deep learning makes the job much easier. This review paper explores the different deep-learning-based lesion segmentation models and the impact of different pre-processing techniques on their performance. It aims to provide a comprehensive overview of the state-of-the-art models and aims to guide future research and contribute to the development of more robust and effective stroke lesion segmentation models.

M-MSSEU: source-free domain adaptation for multi-modal stroke lesion segmentation using shadowed sets and evidential uncertainty

Due to the unavailability of source domain data encountered in unsupervised domain adaptation, there has been an increasing number of studies on source-free domain adaptation (SFDA) in recent years. To better solve the SFDA problem and effectively leverage the multi-modal information in medical images, this paper presents a novel SFDA method for multi-modal stroke lesion segmentation in which evidential deep learning instead of convolutional neural network. Specifically, for multi-modal stroke images, we design a multi-modal opinion fusion module which uses Dempster-Shafer evidence theory for decision fusion of different modalities. Besides, for the SFDA problem, we use the pseudo label learning method, which obtains pseudo labels from the pre-trained source model to perform the adaptation process. To solve the unreliability of pseudo label caused by domain shift, we propose a pseudo label filtering scheme using shadowed sets theory and a pseudo label refining scheme using evidential uncertainty. These two schemes can automatically extract unreliable parts in pseudo labels and jointly improve the quality of pseudo labels with low computational costs. Experiments on two multi-modal stroke lesion datasets demonstrate the superiority of our method over other state-of-the-art SFDA methods.

SAN-Net: Learning generalization to unseen sites for stroke lesion segmentation with self-adaptive normalization

There are considerable interests in automatic stroke lesion segmentation on magnetic resonance (MR) images in the medical imaging field, as stroke is an important cerebrovascular disease. Although deep learning-based models have been proposed for this task, generalizing these models to unseen sites is difficult due to not only the large inter-site discrepancy among different scanners, imaging protocols, and populations, but also the variations in stroke lesion shape, size, and location. To tackle this issue, we introduce a self-adaptive normalization network, termed SAN-Net, to achieve adaptive generalization on unseen sites for stroke lesion segmentation. Motivated by traditional z-score normalization and dynamic network, we devise a masked adaptive instance normalization (MAIN) to minimize inter-site discrepancies, which standardizes input MR images from different sites into a site-unrelated style by dynamically learning affine parameters from the input; i.e., MAIN can affinely transform the intensity values. Then, we leverage a gradient reversal layer to force the U-net encoder to learn site-invariant representation with a site classifier, which further improves the model generalization in conjunction with MAIN. Finally, inspired by the "pseudosymmetry" of the human brain, we introduce a simple yet effective data augmentation technique, termed symmetry-inspired data augmentation (SIDA), that can be embedded within SAN-Net to double the sample size while halving memory consumption. Experimental results on the benchmark Anatomical Tracings of Lesions After Stroke (ATLAS) v1.2 dataset, which includes MR images from 9 different sites, demonstrate that under the "leave-one-site-out" setting, the proposed SAN-Net outperforms recently published methods in terms of quantitative metrics and qualitative comparisons.

A Deep Learning Approach for Detecting Stroke from Brain CT Images Using OzNet

A brain stroke is a life-threatening medical disorder caused by the inadequate blood supply to the brain. After the stroke, the damaged area of the brain will not operate normally. As a result, early detection is crucial for more effective therapy. Computed tomography (CT) images supply a rapid diagnosis of brain stroke. However, while doctors are analyzing each brain CT image, time is running fast. This circumstance may lead to result in a delay in treatment and making errors. Therefore, we targeted the utilization of an efficient artificial intelligence algorithm in stroke detection. In this paper, we designed hybrid algorithms that include a new convolution neural networks (CNN) architecture called OzNet and various machine learning algorithms for binary classification of real brain stroke CT images. When we classified the dataset with OzNet, we acquired successful performance. However, for this target, we combined it with a minimum Redundancy Maximum Relevance (mRMR) method and Decision Tree (DT), k-Nearest Neighbors (kNN), Linear Discriminant Analysis (LDA), Naïve Bayes (NB), and Support Vector Machines (SVM). In addition, 4096 significant features were obtained from the fully connected layer of OzNet, and we reduced the dimension of features from 4096 to 250 using the mRMR method. Finally, we utilized these machine learning algorithms to classify important features. As a result, OzNet-mRMR-NB was an excellent hybrid algorithm and achieved an accuracy of 98.42% and AUC of 0.99 to detect stroke from brain CT images.

Predicting final ischemic stroke lesions from initial diffusion-weighted images using a deep neural network

BACKGROUND

For prognosis of stroke, measurement of the diffusion-perfusion mismatch is a common practice for estimating tissue at risk of infarction in the absence of timely reperfusion. However, perfusion-weighted imaging (PWI) adds time and expense to the acute stroke imaging workup. We explored whether a deep convolutional neural network (DCNN) model trained with diffusion-weighted imaging obtained at admission could predict final infarct volume and location in acute stroke patients.

METHODS

In 445 patients, we trained and validated an attention-gated (AG) DCNN to predict final infarcts as delineated on follow-up studies obtained 3 to 7 days after stroke. The input channels consisted of MR diffusion-weighted imaging (DWI), apparent diffusion coefficients (ADC) maps, and thresholded ADC maps with values less than 620 × 10-6 mm2/s, while the output was a voxel-by-voxel probability map of tissue infarction. We evaluated performance of the model using the area under the receiver-operator characteristic curve (AUC), the Dice similarity coefficient (DSC), absolute lesion volume error, and the concordance correlation coefficient (ρc) of the predicted and true infarct volumes.

RESULTS

The model obtained a median AUC of 0.91 (IQR: 0.84-0.96). After thresholding at an infarction probability of 0.5, the median sensitivity and specificity were 0.60 (IQR: 0.16-0.84) and 0.97 (IQR: 0.93-0.99), respectively, while the median DSC and absolute volume error were 0.50 (IQR: 0.17-0.66) and 27 ml (IQR: 7-60 ml), respectively. The model's predicted lesion volumes showed high correlation with ground truth volumes (ρc = 0.73, p < 0.01).

CONCLUSION

An AG-DCNN using diffusion information alone upon admission was able to predict infarct volumes at 3-7 days after stroke onset with comparable accuracy to models that consider both DWI and PWI. This may enable treatment decisions to be made with shorter stroke imaging protocols.

A 3D Multi-task Regression and Ordinal Regression Deep Neural Network for Collateral Imaging from Dynamic Susceptibility Contrast-Enhanced MR perfusion in Acute Ischemic Stroke

BACKGROUND AND OBJECTIVE

Cerebral collaterals have been identified as one of the primary determinants for treatment options in acute ischemic stroke. Several works have been proposed, but these have not been adopted for a routine clinical usage due to their manual and heuristic nature as well as inconsistency and instability of the assessment. Herein, we present an advanced deep learning-based method that can automatically generate a multiphase collateral imaging (collateral map) derived from dynamic susceptibility contrast-enhanced MR perfusion (DSC-MRP) in an accurate and robust manner.

METHODS

We develop a 3D multi-task regression and ordinal regression deep neural network for generating collateral maps from DSC-MRP, which formulates the prediction of collateral maps as both a regression task and an ordinal regression task. For an ordinal regression task, we introduce a spacing-decreasing discretization (SDD) strategy to represent the intensity of the collateral status on a discrete, ordinal scale. We also devise loss functions to achieve effective and efficient multi-task learning.

RESULTS

We systematically evaluated the performance of the proposed network using DSC-MRP from 802 patients. On average, the proposed network achieved ≥0.900 squared correlation coefficient (R-Squared), ≥0.916 Tanimoto measure (TM), ≥0.0913 structural similarity index measure (SSIM), and ≤0.564 × 10^-1 mean absolute error (MAE), outperforming eight competing models that have been recently developed in medical imaging and computer vision. We also found that the proposed network could provide an improved contrast between the low and high intensity regions in the collateral maps, which is a key to an accurate evaluation of the collateral status.

CONCLUSIONS

The experimental results demonstrate that the proposed network is able to generate collateral maps with high accuracy, facilitating a timely and prompt assessment of the collateral status in clinlcs. The future study will entail the optimization of the proposed network and its clinical evalution in a prospective manner.

A Deep Learning Approach for Sentiment Analysis of COVID-19 Reviews

User-generated multi-media content, such as images, text, videos, and speech, has recently become more popular on social media sites as a means for people to share their ideas and opinions. One of the most popular social media sites for providing public sentiment towards events that occurred during the COVID-19 period is Twitter. This is because Twitter posts are short and constantly being generated. This paper presents a deep learning approach for sentiment analysis of Twitter data related to COVID-19 reviews. The proposed algorithm is based on an LSTM-RNN-based network and enhanced featured weighting by attention layers. This algorithm uses an enhanced feature transformation framework via the attention mechanism. A total of four class labels (sad, joy, fear, and anger) from publicly available Twitter data posted in the Kaggle database were used in this study. Based on the use of attention layers with the existing LSTM-RNN approach, the proposed deep learning approach significantly improved the performance metrics, with an increase of 20% in accuracy and 10% to 12% in precision but only 12–13% in recall as compared with the current approaches. Out of a total of 179,108 COVID-19-related tweets, tweets with positive, neutral, and negative sentiments were found to account for 45%, 30%, and 25%, respectively. This shows that the proposed deep learning approach is efficient and practical and can be easily implemented for sentiment classification of COVID-19 reviews.

A Review on Computer Aided Diagnosis of Acute Brain Stroke

Amongst the most common causes of death globally, stroke is one of top three affecting over 100 million people worldwide annually. There are two classes of stroke, namely ischemic stroke (due to impairment of blood supply, accounting for ~70% of all strokes) and hemorrhagic stroke (due to bleeding), both of which can result, if untreated, in permanently damaged brain tissue. The discovery that the affected brain tissue (i.e., 'ischemic penumbra') can be salvaged from permanent damage and the bourgeoning growth in computer aided diagnosis has led to major advances in stroke management. Abiding to the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) guidelines, we have surveyed a total of 177 research papers published between 2010 and 2021 to highlight the current status and challenges faced by computer aided diagnosis (CAD), machine learning (ML) and deep learning (DL) based techniques for CT and MRI as prime modalities for stroke detection and lesion region segmentation. This work concludes by showcasing the current requirement of this domain, the preferred modality, and prospective research areas.

Deep learning-based detection and segmentation of diffusion abnormalities in acute ischemic stroke

Background

Accessible tools to efficiently detect and segment diffusion abnormalities in acute strokes are highly anticipated by the clinical and research communities.

Methods

We developed a tool with deep learning networks trained and tested on a large dataset of 2,348 clinical diffusion weighted MRIs of patients with acute and sub-acute ischemic strokes, and further tested for generalization on 280 MRIs of an external dataset (STIR).

Results

Our proposed model outperforms generic networks and DeepMedic, particularly in small lesions, with lower false positive rate, balanced precision and sensitivity, and robustness to data perturbs (e.g., artefacts, low resolution, technical heterogeneity). The agreement with human delineation rivals the inter-evaluator agreement; the automated lesion quantification of volume and contrast has virtually total agreement with human quantification.

Conclusion

Our tool is fast, public, accessible to non-experts, with minimal computational requirements, to detect and segment lesions via a single command line. Therefore, it fulfills the conditions to perform large scale, reliable and reproducible clinical and translational research.

Local Style Preservation in Improved GAN-Driven Synthetic Image Generation for Endoscopic Tool Segmentation

Accurate semantic image segmentation from medical imaging can enable intelligent vision-based assistance in robot-assisted minimally invasive surgery. The human body and surgical procedures are highly dynamic. While machine-vision presents a promising approach, sufficiently large training image sets for robust performance are either costly or unavailable. This work examines three novel generative adversarial network (GAN) methods of providing usable synthetic tool images using only surgical background images and a few real tool images. The best of these three novel approaches generates realistic tool textures while preserving local background content by incorporating both a style preservation and a content loss component into the proposed multi-level loss function. The approach is quantitatively evaluated, and results suggest that the synthetically generated training tool images enhance UNet tool segmentation performance. More specifically, with a random set of 100 cadaver and live endoscopic images from the University of Washington Sinus Dataset, the UNet trained with synthetically generated images using the presented method resulted in 35.7% and 30.6% improvement over using purely real images in mean Dice coefficient and Intersection over Union scores, respectively. This study is promising towards the use of more widely available and routine screening endoscopy to preoperatively generate synthetic training tool images for intraoperative UNet tool segmentation.

Fusion of Higher Order Spectra and Texture Extraction Methods for Automated Stroke Severity Classification with MRI Images

This paper presents a scientific foundation for automated stroke severity classification. We have constructed and assessed a system which extracts diagnostically relevant information from Magnetic Resonance Imaging (MRI) images. The design was based on 267 images that show the brain from individual subjects after stroke. They were labeled as either Lacunar Syndrome (LACS), Partial Anterior Circulation Syndrome (PACS), or Total Anterior Circulation Stroke (TACS). The labels indicate different physiological processes which manifest themselves in distinct image texture. The processing system was tasked with extracting texture information that could be used to classify a brain MRI image from a stroke survivor into either LACS, PACS, or TACS. We analyzed 6475 features that were obtained with Gray-Level Run Length Matrix (GLRLM), Higher Order Spectra (HOS), as well as a combination of Discrete Wavelet Transform (DWT) and Gray-Level Co-occurrence Matrix (GLCM) methods. The resulting features were ranked based on the p-value extracted with the Analysis Of Variance (ANOVA) algorithm. The ranked features were used to train and test four types of Support Vector Machine (SVM) classification algorithms according to the rules of 10-fold cross-validation. We found that SVM with Radial Basis Function (RBF) kernel achieves: Accuracy (ACC) = 93.62%, Specificity (SPE) = 95.91%, Sensitivity (SEN) = 92.44%, and Dice-score = 0.95. These results indicate that computer aided stroke severity diagnosis support is possible. Such systems might lead to progress in stroke diagnosis by enabling healthcare professionals to improve diagnosis and management of stroke patients with the same resources.

Multi-view iterative random walker for automated salvageable tissue delineation in ischemic stroke from multi-sequence MRI

BACKGROUND AND OBJECTIVE

Non-invasive and robust identification of salvageable tissue (penumbra) is crucial for interventional stroke therapy. Besides identifying stroke injury as a whole, the ability to automatically differentiate core and penumbra tissues, using both diffusion and perfusion magnetic resonance imaging (MRI) sequences is essential for ischemic stroke treatment.

METHOD

A fully automated and novel one-shot multi-view iterative random walker (MIRW) method with an automated injury seed point detection is developed for lesion delineation. MIRW utilizes the heirarchical decomposition of multi-sequence MRI physical properties of the underlying tissue within the lesion to maximize the inter-class variations of the volumetric histogram to estimate the probable seed points. These estimates are further utilized to conglomerate the lesion estimations iteratively from axial, coronal and sagittal MRI volumes for a computationally efficient segmentation and quantification of salvageable and necrotic tissues from multi-sequence MRI.

RESULTS

Comprehensive experimental analysis of MIRW is performed on three challenging adult(sub-)acute ischemic stroke datasets using performance measures like precision, sensitivity, specificity and Dice similarity score (DSC), which are computed with respect to the manual ground-truth.

COMPARISON WITH EXISTING METHODS

MIRW method resulted in a high DSC of 83.5% in a very less computational time of 98.23 s/volume, which is a significant improvement on the ISLES benchmark dataset for penumbra detection, compared to the state-of-the-art techniques.

CONCLUSION

Quantitative measures demonstrate the promising potential of MIRW for computational analysis of adult stroke and quantifying penumbra in stroke patients which is essential for selecting the good candidates for recanalization.

Ischemic Lesion Segmentation using Ensemble of Multi-Scale Region Aligned CNN

The first and foremost step in the diagnosis of ischemic stroke is the delineation of the lesion from radiological images for effective treatment planning. Manual delineation of the lesion by radiological experts is generally laborious and time-consuming. Sometimes, it is prone to intra-observer and inter-observer variability. State of the art deep architectures based on Fully Convolutional Networks (FCN) and cascaded CNNs have shown good results in automated lesion segmentation. This work proposes a series of enhancements over the learning paradigm in the existing methods, by focusing on learning meticulous feature representations through the CNN layers for accurate ischemic lesion segmentation from multimodal MRI. Multiple levels of losses, integration of features from multiple scales, an ensemble of prediction maps from sub-networks are employed to enable the CNN to correlate between features seen from different receptive fields. To allow for progressive refinement of features from block to block, a custom dropout module has been proposed that suppresses noisy features. Multi-branch residual connections and attention mechanisms were also included in the CNN blocks to enable the integration of information from multiple receptive fields and selectively weigh significant features. Also, to tackle data imbalance both at voxel and sample level, patch-based modeling and separation of concerns into classification & segmentation functional branches are proposed. By incorporating the above mentioned architectural enhancements, the proposed deep architecture was able to achieve better segmentation performance against the existing models. The proposed approach was evaluated on the ISLES 2015 SISS dataset, and it achieved a mean dice coefficient of 0.775. By combining sample classification and lesion segmentation into a fully automated framework, the proposed approach has yielded better results compared to most of the existing works.

Neuroimaging and deep learning for brain stroke detection - A review of recent advancements and future prospects

BACKGROUND AND OBJECTIVE

In recent years, deep learning algorithms have created a massive impact on addressing research challenges in different domains. The medical field also greatly benefits from the use of improving deep learning models which save time and produce accurate results. This research aims to emphasize the impact of deep learning models in brain stroke detection and lesion segmentation. This is achieved by discussing the state of the art approaches proposed by the recent works in this field.

METHODS

In this study, the advancements in stroke lesion detection and segmentation were focused. The survey analyses 113 research papers published in different academic research databases. The research articles have been filtered out based on specific criteria to obtain the most prominent insights related to stroke lesion detection and segmentation.

RESULTS

The features of the stroke lesion vary based on the type of imaging modality. To develop an effective method for stroke lesion detection, the features need to be carefully extracted from the input images. This review takes an attempt to categorize and discuss the different deep architectures employed for stroke lesion detection and segmentation, based on the underlying imaging modality. This further assists in understanding the relevance of the two-deep neural network components in medical image analysis namely Convolutional Neural Network (CNN) and Fully Convolutional Network (FCN). It hints at other possible deep architectures that can be proposed for better results towards stroke lesion detection. Also, the emerging trends and breakthroughs in stroke detection have been detailed in this evaluation.

CONCLUSION

This work concludes by examining the technical and non-technical challenges faced by researchers and indicate the future implications in stroke detection. It could support the bio-medical researchers to propose better solutions for stroke lesion detection.

Delineation of ischemic lesion from brain MRI using attention gated fully convolutional network

Precise delineation of the ischemic lesion from unimodal Magnetic Resonance Imaging (MRI) is a challenging task due to the subtle intensity difference between the lesion and normal tissues. Hence, multispectral MRI modalities are used for characterizing the properties of brain tissues. Traditional lesion detection methods rely on extracting significant hand-engineered features to differentiate normal and abnormal brain tissues. But the identification of those discriminating features is quite complex, as the degree of differentiation varies according to each modality. This can be addressed well by Convolutional Neural Networks (CNN) which supports automatic feature extraction. It is capable of learning the global features from images effectively for image classification. But it loses the context of local information among the pixels that need to be retained for segmentation. Also, it must provide more emphasis on the features of the lesion region for precise reconstruction. The major contribution of this work is the integration of attention mechanism with a Fully Convolutional Network (FCN) to segment ischemic lesion. This attention model is applied to learn and concentrate only on salient features of the lesion region by suppressing the details of other regions. Hence the proposed FCN with attention mechanism was able to segment ischemic lesion of varying size and shape. To study the effectiveness of attention mechanism, various experiments were carried out on ISLES 2015 dataset and a mean dice coefficient of 0.7535 was obtained. Experimental results indicate that there is an improvement of 5% compared to the existing works.

Acute and sub-acute stroke lesion segmentation from multimodal MRI

BACKGROUND AND OBJECTIVE

Acute stroke lesion segmentation tasks are of great clinical interest as they can help doctors make better informed time-critical treatment decisions. Magnetic resonance imaging (MRI) is time demanding but can provide images that are considered the gold standard for diagnosis. Automated stroke lesion segmentation can provide with an estimate of the location and volume of the lesioned tissue, which can help in the clinical practice to better assess and evaluate the risks of each treatment.

METHODS

We propose a deep learning methodology for acute and sub-acute stroke lesion segmentation using multimodal MR imaging. We pre-process the data to facilitate learning features based on the symmetry of brain hemispheres. The issue of class imbalance is tackled using small patches with a balanced training patch sampling strategy and a dynamically weighted loss function. Moreover, a combination of whole patch predictions, using a U-Net based CNN architecture, and high degree of overlapping patches reduces the need for additional post-processing.

RESULTS

The proposed method is evaluated using two public datasets from the 2015 Ischemic Stroke Lesion Segmentation challenge (ISLES 2015). These involve the tasks of sub-acute stroke lesion segmentation (SISS) and acute stroke penumbra estimation (SPES) from multiple diffusion, perfusion and anatomical MRI modalities. The performance is compared against state-of-the-art methods with a blind online testing set evaluation on each of the challenges. At the time of submitting this manuscript, our approach is the first method in the online rankings for the SISS (DSC=0.59 ± 0.31) and SPES sub-tasks (DSC=0.84 ± 0.10). When compared with the rest of submitted strategies, we achieve top rank performance with a lower Hausdorff distance.

CONCLUSIONS

Better segmentation results are obtained by leveraging the anatomy and pathophysiology of acute stroke lesions and using a combined approach to minimize the effects of class imbalance. The same training procedure is used for both tasks, showing the proposed methodology can generalize well enough to deal with different unrelated tasks and imaging modalities without hyper-parameter tuning. In order to promote the reproducibility of our results, a public version of the proposed method has been released to the scientific community.

Ischemic stroke lesion detection, characterization and classification in CT images with optimal features selection

Ischemic stroke is the dominant disorder for mortality and morbidity. For immediate diagnosis and treatment plan of ischemic stroke, computed tomography (CT) images are used. This paper proposes a histogram bin based novel algorithm to segment the ischemic stroke lesion using CT and optimal feature group selection to classify normal and abnormal regions. Steps followed are pre-processing, segmentation, extracting texture features, feature ranking, feature grouping, classification and optimal feature group (FG) selection. The first order features, gray level run length matrix features, gray level co-occurrence matrix features and Hu's moment features are extracted. Classification is done using logistic regression (LR), support vector machine classifier (SVMC), random forest classifier (RFC) and neural network classifier (NNC). This proposed approach effectively detects ischemic stroke lesion with a classification accuracy of 88.77%, 97.86%, 99.79% and 99.79% obtained by the LR, SVMC, RFC and NNC when FG12 is opted, which is validated by fourfold cross validation.

Characterizing liver sinusoidal endothelial cell fenestrae on soft substrates upon AFM imaging and deep learning

BACKGROUND

Liver sinusoidal endothelial cells (LSECs) display unique fenestrated morphology. Alterations in the size and number of fenestrae play a crucial role in the progression of various liver diseases. While their features have been visualized using atomic force microscopy (AFM), the in situ imaging methods and off-line analyses are further required for fenestra quantification.

METHODS

Primary mouse LSECs were cultured on a collagen-I-coated culture dish, or a polydimethylsiloxane (PDMS) or polyacrylamide (PA) hydrogel substrate. An AFM contact mode was applied to visualize fenestrae on individual fixed LSECs. Collected images were analyzed using an in-house developed image recognition program based on fully convolutional networks (FCN).

RESULTS

Key scanning parameters were first optimized for visualizing the fenestrae on LSECs on culture dish, which was also applicable for the LSECs cultured on various hydrogels. The intermediate-magnification morphology images of LSECs were used for developing the FCN-based, fenestra recognition program. This program enabled us to recognize the vast majority of fenestrae from AFM images after twice trainings at a typical accuracy of 81.6% on soft substrate and also quantify the statistics of porosity, number of fenestrae and distribution of fenestra diameter.

CONCLUSIONS

Combining AFM imaging with FCN training is able to quantify the morphological distributions of LSEC fenestrae on various substrates.

SIGNIFICANCE

AFM images acquired and analyzed here provided the global information of surface ultramicroscopic structures over an entire cell, which is fundamental in understanding their regulatory mechanisms and pathophysiological relevance in fenestra-like evolution of individual cells on stiffness-varied substrates.

Ischemic stroke segmentation in multi-sequence MRI by symmetry determined superpixel based hierarchical clustering

Automated estimation of ischemic stroke evolution across different brain anatomical regions has immense potential to revolutionize stroke treatment. Multi-sequence Magnetic Resonance Imaging (MRI) techniques provide information to characterize abnormal tissues based on their anatomy and physical properties. Asymmetry of the right and left hemispheres of the brain is an important cue for abnormality estimation but using it alone is susceptible to occasional error due to self-asymmetry of the brain. A precise estimate of the symmetry axis is therefore essential for accurate asymmetry identification, which holds the key to the proposed method. The proposed symmetry determined superpixel based hierarchical clustering (SSHC) method initially estimates the lesion from inter-hemispheric asymmetry. This asymmetry further determines the thresholding parameter for hierarchically clustering the superpixels leading to an automated and accurate lesion delineation. A multi-sequence MRI based pipeline also combines the estimations from individual sequences. SSHC is evaluated on different sequences of the Loma Linda University (LLU) dataset with 26 patients and the Ischemic Stroke Lesion Segmentation (ISLES'15) dataset with 28 patients. SSHC eliminates the need for manual determination of threshold for combining the superpixel clusters and is more reliable as it derives the information from the quick estimation of asymmetry. SSHC outperforms the state-of-the-art resulting in a high Dice similarity score of 0.704±0.27 and a recall of 0.85±0.01 which are 6% and 35% respectively higher than the challenge winning method. SSHC thus demonstrates a promising potential in the automated detection of (sub-)acute adult ischemic stroke.