Predicting treatment-specific lesion outcomes in acute ischemic stroke from 4D CT perfusion imaging using spatio-temporal convolutional neural networks

Annotation-free prediction of treatment-specific tissue outcome from 4D CT perfusion imaging in acute ischemic stroke

Acute ischemic stroke is a critical health condition that requires timely intervention. Following admission, clinicians typically use perfusion imaging to facilitate treatment decision-making. While deep learning models leveraging perfusion data have demonstrated the ability to predict post-treatment tissue infarction for individual patients, predictions are often represented as binary or probabilistic masks that are not straightforward to interpret or easy to obtain. Moreover, these models typically rely on large amounts of subjectively segmented data and non-standard perfusion analysis techniques. To address these challenges, we propose a novel deep learning approach that directly predicts follow-up computed tomography images from full spatio-temporal 4D perfusion scans through a temporal compression. The results show that this method leads to realistic follow-up image predictions containing the infarcted tissue outcomes. The proposed compression method achieves comparable prediction results to using perfusion maps as inputs but without the need for perfusion analysis or arterial input function selection. Additionally, separate models trained on 45 patients treated with thrombolysis and 102 treated with thrombectomy showed that each model correctly captured the different patient-specific treatment effects as shown by image difference maps. The findings of this work clearly highlight the potential of our method to provide interpretable stroke treatment decision support without requiring manual annotations.

Challenges and Potential of Artificial Intelligence in Neuroradiology

PURPOSE

Artificial intelligence (AI) has emerged as a transformative force in medical research and is garnering increased attention in the public consciousness. This represents a critical time period in which medical researchers, healthcare providers, insurers, regulatory agencies, and patients are all developing and shaping their beliefs and policies regarding the use of AI in the healthcare sector. The successful deployment of AI will require support from all these groups. This commentary proposes that widespread support for medical AI must be driven by clear and transparent scientific reporting, beginning at the earliest stages of scientific research.

METHODS

A review of relevant guidelines and literature describing how scientific reporting plays a central role at key stages in the life cycle of an AI software product was conducted. To contextualize this principle within a specific medical domain, we discuss the current state of predictive tissue outcome modeling in acute ischemic stroke and the unique challenges presented therein.

RESULTS AND CONCLUSION

Translating AI methods from the research to the clinical domain is complicated by challenges related to model design and validation studies, medical product regulations, and healthcare providers' reservations regarding AI's efficacy and affordability. However, each of these limitations is also an opportunity for high-impact research that will help to accelerate the clinical adoption of state-of-the-art medical AI. In all cases, establishing and adhering to appropriate reporting standards is an important responsibility that is shared by all of the parties involved in the life cycle of a prospective AI software product.

Identifying Biases in a Multicenter MRI Database for Parkinson's Disease Classification: Is the Disease Classifier a Secret Site Classifier?

Sharing multicenter imaging datasets can be advantageous to increase data diversity and size but may lead to spurious correlations between site-related biological and non-biological image features and target labels, which machine learning (ML) models may exploit as shortcuts. To date, studies analyzing how and if deep learning models may use such effects as a shortcut are scarce. Thus, the aim of this work was to investigate if site-related effects are encoded in the feature space of an established deep learning model designed for Parkinson's disease (PD) classification based on T1-weighted MRI datasets. Therefore, all layers of the PD classifier were frozen, except for the last layer of the network, which was replaced by a linear layer that was exclusively re-trained to predict three potential bias types (biological sex, scanner type, and originating site). Our findings based on a large database consisting of 1880 MRI scans collected across 41 centers show that the feature space of the established PD model (74% accuracy) can be used to classify sex (75% accuracy), scanner type (79% accuracy), and site location (71% accuracy) with high accuracies despite this information never being explicitly provided to the PD model during original training. Overall, the results of this study suggest that trained image-based classifiers may use unwanted shortcuts that are not meaningful for the actual clinical task at hand. This finding may explain why many image-based deep learning models do not perform well when applied to data from centers not contributing to the training set.

A comprehensive review for artificial intelligence on neuroimaging in rehabilitation of ischemic stroke

Stroke is the second leading cause of death worldwide, with ischemic stroke accounting for a significant proportion of morbidity and mortality among stroke patients. Ischemic stroke often causes disability and cognitive impairment in patients, which seriously affects the quality of life of patients. Therefore, how to predict the recovery of patients can provide support for clinical intervention in advance and improve the enthusiasm of patients for rehabilitation treatment. With the popularization of imaging technology, the diagnosis and treatment of ischemic stroke patients are often accompanied by a large number of imaging data. Through machine learning and Deep Learning, information from imaging data can be used more effectively. In this review, we discuss recent advances in neuroimaging, machine learning, and Deep Learning in the rehabilitation of ischemic stroke.

Prediction of tissue outcome in acute ischemic stroke based on single-phase CT angiography at admission

Introduction

In acute ischemic stroke, prediction of the tissue outcome after reperfusion can be used to identify patients that might benefit from mechanical thrombectomy (MT). The aim of this work was to develop a deep learning model that can predict the follow-up infarct location and extent exclusively based on acute single-phase computed tomography angiography (CTA) datasets. In comparison to CT perfusion (CTP), CTA imaging is more widely available, less prone to artifacts, and the established standard of care in acute stroke imaging protocols. Furthermore, recent RCTs have shown that also patients with large established infarctions benefit from MT, which might not have been selected for MT based on CTP core/penumbra mismatch analysis.

Methods

All patients with acute large vessel occlusion of the anterior circulation treated at our institution between 12/2015 and 12/2020 were screened (N = 404) and 238 patients undergoing MT with successful reperfusion were included for final analysis. Ground truth infarct lesions were segmented on 24 h follow-up CT scans. Pre-processed CTA images were used as input for a U-Net-based convolutional neural network trained for lesion prediction, enhanced with a spatial and channel-wise squeeze-and-excitation block. Post-processing was applied to remove small predicted lesion components. The model was evaluated using a 5-fold cross-validation and a separate test set with Dice similarity coefficient (DSC) as the primary metric and average volume error as the secondary metric.

Results

The mean ± standard deviation test set DSC over all folds after post-processing was 0.35 ± 0.2 and the mean test set average volume error was 11.5 mL. The performance was relatively uniform across models with the best model according to the DSC achieved a score of 0.37 ± 0.2 after post-processing and the best model in terms of average volume error yielded 3.9 mL.

Conclusion

24 h follow-up infarct prediction using acute CTA imaging exclusively is feasible with DSC measures comparable to results of CTP-based algorithms reported in other studies. The proposed method might pave the way to a wider acceptance, feasibility, and applicability of follow-up infarct prediction based on artificial intelligence.

Systematic Review of Machine Learning Applied to the Secondary Prevention of Ischemic Stroke

Ischemic stroke is a serious disease posing significant threats to human health and life, with the highest absolute and relative risks of a poor prognosis following the first occurrence, and more than 90% of strokes are attributable to modifiable risk factors. Currently, machine learning (ML) is widely used for the prediction of ischemic stroke outcomes. By identifying risk factors, predicting the risk of poor prognosis and thus developing personalized treatment plans, it effectively reduces the probability of poor prognosis, leading to more effective secondary prevention. This review includes 41 studies since 2018 that used ML algorithms to build prognostic prediction models for ischemic stroke, transient ischemic attack (TIA), and acute ischemic stroke (AIS). We analyzed in detail the risk factors used in these studies, the sources and processing methods of the required data, the model building and validation, and their application in different prediction time windows. The results indicate that among the included studies, the top five risk factors in terms of frequency were cardiovascular diseases, age, sex, national institutes of health stroke scale (NIHSS) score, and diabetes. Furthermore, 64% of the studies used single-center data, 65% of studies using imbalanced data did not perform data balancing, 88% of the studies did not utilize external validation datasets for model validation, and 72% of the studies did not provide explanations for their models. Addressing these issues is crucial for enhancing the credibility and effectiveness of the research, consequently improving the development and implementation of secondary prevention measures.

Providing clinical context to the spatio-temporal analysis of 4D CT perfusion to predict acute ischemic stroke lesion outcomes

Acute ischemic stroke is a leading cause of mortality and morbidity worldwide. Timely identification of the extent of a stroke is crucial for effective treatment, whereas spatio-temporal (4D) Computed Tomography Perfusion (CTP) imaging is playing a critical role in this process. Recently, the first deep learning-based methods that leverage the full spatio-temporal nature of perfusion imaging for predicting stroke lesion outcomes have been proposed. However, clinical information is typically not integrated into the learning process, which may be helpful to improve the tissue outcome prediction given the known influence of various factors (i.e., physiological, demographic, and treatment factors) on lesion growth. Cross-attention, a multimodal fusion strategy, has been successfully used to combine information from multiple sources, but it has yet to be applied to stroke lesion outcome prediction. Therefore, this work aimed to develop and evaluate a novel multimodal and spatio-temporal deep learning model that utilizes cross-attention to combine information from 4D CTP and clinical metadata simultaneously to predict stroke lesion outcomes. The proposed model was evaluated using a dataset of 70 acute ischemic stroke patients, demonstrating significantly improved volume estimates (mean error = 19 ml) compared to a baseline unimodal approach (mean error = 35 ml, p< 0.05). The proposed model allows generating attention maps and counterfactual outcome scenarios to investigate the relevance of clinical variables in predicting stroke lesion outcomes at a patient level, helping to provide a better understanding of the model's decision-making process.

Machine learning segmentation of core and penumbra from acute stroke CT perfusion data

Introduction

Computed tomography perfusion (CTP) imaging is widely used in cases of suspected acute ischemic stroke to positively identify ischemia and assess suitability for treatment through identification of reversible and irreversible tissue injury. Traditionally, this has been done via setting single perfusion thresholds on two or four CTP parameter maps. We present an alternative model for the estimation of tissue fate using multiple perfusion measures simultaneously.

Methods

We used machine learning (ML) models based on four different algorithms, combining four CTP measures (cerebral blood flow, cerebral blood volume, mean transit time and delay time) plus 3D-neighborhood (patch) analysis to predict the acute ischemic core and perfusion lesion volumes. The model was developed using 86 patient images, and then tested further on 22 images.

Results

XGBoost was the highest-performing algorithm. With standard threshold-based core and penumbra measures as the reference, the model demonstrated moderate agreement in segmenting core and penumbra on test images. Dice similarity coefficients for core and penumbra were 0.38 ± 0.26 and 0.50 ± 0.21, respectively, demonstrating moderate agreement. Skull-related image artefacts contributed to lower accuracy.

Discussion

Further development may enable us to move beyond the current overly simplistic core and penumbra definitions using single thresholds where a single error or artefact may lead to substantial error.

Predicting the tissue outcome of acute ischemic stroke from acute 4D computed tomography perfusion imaging using temporal features and deep learning

Predicting follow-up lesions from baseline CT perfusion (CTP) datasets in acute ischemic stroke patients is important for clinical decision making. Deep convolutional networks (DCNs) are assumed to be the current state-of-the-art for this task. However, many DCN classifiers have not been validated against the methods currently used in research (random decision forests, RDF) and clinical routine (Tmax thresholding). Specialized DCNs have even been designed to extract complex temporal features directly from spatiotemporal CTP data instead of using standard perfusion parameter maps. However, the benefits of applying deep learning to source or deconvolved CTP data compared to perfusion parameter maps have not been formally investigated so far. In this work, a modular UNet-based DCN is proposed that separates temporal feature extraction from tissue outcome prediction, allowing for both model validation using perfusion parameter maps as well as end-to-end learning from spatiotemporal CTP data. 145 retrospective datasets comprising baseline CTP imaging, perfusion parameter maps, and follow-up non-contrast CT with manual lesion segmentations were assembled from acute ischemic stroke patients treated with intravenous thrombolysis alone (IV; n = 43) or intra-arterial mechanical thrombectomy (IA; n = 102) with or without combined IV. Using the perfusion parameter maps as input, the proposed DCN (mean Dice: 0.287) outperformed the RDF (0.262) and simple Tmax-thresholding (0.249). The performance of the proposed DCN was approximately equal using features optimized from the deconvolved residual curves (0.286) compared to perfusion parameter maps (0.287), while using features optimized from the source concentration-time curves (0.296) provided the best tissue outcome predictions.