Annotation-free prediction of treatment-specific tissue outcome from 4D CT perfusion imaging in acute ischemic stroke

Acute ischemic stroke is a critical health condition that requires timely intervention. Following admission, clinicians typically use perfusion imaging to facilitate treatment decision-making. While deep learning models leveraging perfusion data have demonstrated the ability to predict post-treatment tissue infarction for individual patients, predictions are often represented as binary or probabilistic masks that are not straightforward to interpret or easy to obtain. Moreover, these models typically rely on large amounts of subjectively segmented data and non-standard perfusion analysis techniques. To address these challenges, we propose a novel deep learning approach that directly predicts follow-up computed tomography images from full spatio-temporal 4D perfusion scans through a temporal compression. The results show that this method leads to realistic follow-up image predictions containing the infarcted tissue outcomes. The proposed compression method achieves comparable prediction results to using perfusion maps as inputs but without the need for perfusion analysis or arterial input function selection. Additionally, separate models trained on 45 patients treated with thrombolysis and 102 treated with thrombectomy showed that each model correctly captured the different patient-specific treatment effects as shown by image difference maps. The findings of this work clearly highlight the potential of our method to provide interpretable stroke treatment decision support without requiring manual annotations.

Providing clinical context to the spatio-temporal analysis of 4D CT perfusion to predict acute ischemic stroke lesion outcomes

Acute ischemic stroke is a leading cause of mortality and morbidity worldwide. Timely identification of the extent of a stroke is crucial for effective treatment, whereas spatio-temporal (4D) Computed Tomography Perfusion (CTP) imaging is playing a critical role in this process. Recently, the first deep learning-based methods that leverage the full spatio-temporal nature of perfusion imaging for predicting stroke lesion outcomes have been proposed. However, clinical information is typically not integrated into the learning process, which may be helpful to improve the tissue outcome prediction given the known influence of various factors (i.e., physiological, demographic, and treatment factors) on lesion growth. Cross-attention, a multimodal fusion strategy, has been successfully used to combine information from multiple sources, but it has yet to be applied to stroke lesion outcome prediction. Therefore, this work aimed to develop and evaluate a novel multimodal and spatio-temporal deep learning model that utilizes cross-attention to combine information from 4D CTP and clinical metadata simultaneously to predict stroke lesion outcomes. The proposed model was evaluated using a dataset of 70 acute ischemic stroke patients, demonstrating significantly improved volume estimates (mean error = 19 ml) compared to a baseline unimodal approach (mean error = 35 ml, p< 0.05). The proposed model allows generating attention maps and counterfactual outcome scenarios to investigate the relevance of clinical variables in predicting stroke lesion outcomes at a patient level, helping to provide a better understanding of the model's decision-making process.

Core and penumbra estimation using deep learning-based AIF in association with clinical measures in computed tomography perfusion (CTP)

OBJECTIVES

To investigate whether utilizing a convolutional neural network (CNN)-based arterial input function (AIF) improves the volumetric estimation of core and penumbra in association with clinical measures in stroke patients.

METHODS

The study included 160 acute ischemic stroke patients (male = 87, female = 73, median age = 73 years) with approval from the institutional review board. The patients had undergone CTP imaging, NIHSS and ASPECTS grading. convolutional neural network (CNN) model was trained to fit a raw AIF curve to a gamma variate function. CNN AIF was utilized to estimate the core and penumbra volumes which were further validated with clinical scores.

RESULTS

Penumbra estimated by CNN AIF correlated positively with the NIHSS score (r = 0.69; p < 0.001) and negatively with the ASPECTS (r =  - 0.43; p < 0.001). The CNN AIF estimated penumbra and core volume matching the patient symptoms, typically in patients with higher NIHSS (> 20) and lower ASPECT score (< 5). In group analysis, the median CBF < 20%, CBF < 30%, rCBF < 38%, Tmax > 10 s, Tmax > 10 s volumes were statistically significantly higher (p < .05).

CONCLUSIONS

With inclusion of the CNN AIF in perfusion imaging pipeline, penumbra and core estimations are more reliable as they correlate with scores representing neurological deficits in stroke.

CRITICAL RELEVANCE STATEMENT

With CNN AIF perfusion imaging pipeline, penumbra and core estimations are more reliable as they correlate with scores representing neurological deficits in stroke.

Arterial input functions in dynamic susceptibility contrast MRI (DSC-MRI) in longitudinal evaluation of brain metastases

BACKGROUND

Dynamic susceptibility contrast magnetic resonance imaging (DSC-MRI) could be helpful to separate true disease progression from pseudo-progression in brain metastases when assessing the need for retreatment. However, the selection of arterial input functions (AIFs) is not standardized for analysis, limiting its use for this application.

PURPOSE

To compare population-based AIFs, AIFs specific to each patient, and AIFs specific to every visit in the longitudinal follow-up of brain metastases.

MATERIAL AND METHODS

Longitudinal data were collected from eight patients before treatment (6 of 8 patients) and after treatment (6-17 visits). Imaging was performed using a 1.5-T MRI system. Lesions were segmented by subtracting precontrast images from postcontrast images. Cerebral blood volume (rCBV) and cerebral blood flow (rCBF) were computed, and Pearson's product moment correlation coefficients were calculated to evaluate similarity of DSC parameters dependent on various AIF choices across time. AIF shape characteristics were compared. Parameter differences between white matter (WM) and gray matter (GM) were obtained to determine which AIF choice maximizes tissue differentiation.

RESULTS

Although DSC parameters follow similar patterns in time, the various AIF selections cause large parameter variations with relative standard deviations of up to ±60%. AIFs sampled in one patient across sessions more similar in shape than AIFs sampled across patients. Estimates of rCBV based on scan-specific AIFs differentiated better between perfusion in WM and GM than patient-specific or population-based AIFs (P ≤ 0.02).

CONCLUSION

Results indicate that scan-specific AIFs are the best choice for DSC-MRI parameter estimations in the longitudinal follow-up of brain metastases.

Predicting the tissue outcome of acute ischemic stroke from acute 4D computed tomography perfusion imaging using temporal features and deep learning

Predicting follow-up lesions from baseline CT perfusion (CTP) datasets in acute ischemic stroke patients is important for clinical decision making. Deep convolutional networks (DCNs) are assumed to be the current state-of-the-art for this task. However, many DCN classifiers have not been validated against the methods currently used in research (random decision forests, RDF) and clinical routine (Tmax thresholding). Specialized DCNs have even been designed to extract complex temporal features directly from spatiotemporal CTP data instead of using standard perfusion parameter maps. However, the benefits of applying deep learning to source or deconvolved CTP data compared to perfusion parameter maps have not been formally investigated so far. In this work, a modular UNet-based DCN is proposed that separates temporal feature extraction from tissue outcome prediction, allowing for both model validation using perfusion parameter maps as well as end-to-end learning from spatiotemporal CTP data. 145 retrospective datasets comprising baseline CTP imaging, perfusion parameter maps, and follow-up non-contrast CT with manual lesion segmentations were assembled from acute ischemic stroke patients treated with intravenous thrombolysis alone (IV; n = 43) or intra-arterial mechanical thrombectomy (IA; n = 102) with or without combined IV. Using the perfusion parameter maps as input, the proposed DCN (mean Dice: 0.287) outperformed the RDF (0.262) and simple Tmax-thresholding (0.249). The performance of the proposed DCN was approximately equal using features optimized from the deconvolved residual curves (0.286) compared to perfusion parameter maps (0.287), while using features optimized from the source concentration-time curves (0.296) provided the best tissue outcome predictions.

Predicting treatment-specific lesion outcomes in acute ischemic stroke from 4D CT perfusion imaging using spatio-temporal convolutional neural networks

For the diagnosis and precise treatment of acute ischemic stroke, predicting the final location and volume of lesions is of great clinical interest. Current deep learning-based prediction methods mainly use perfusion parameter maps, which can be calculated from spatio-temporal (4D) CT perfusion (CTP) imaging data, to estimate the tissue outcome of an acute ischemic stroke. However, this calculation relies on a deconvolution operation, an ill-posed problem requiring strong regularization and definition of an arterial input function. Thus, improved predictions might be achievable if the deep learning models were applied directly to acute 4D CTP data rather than perfusion maps. In this work, a novel deep spatio-temporal convolutional neural network is proposed for predicting treatment-dependent stroke lesion outcomes by making full use of raw 4D CTP data. By merging a U-Net-like architecture with temporal convolutional networks, we efficiently process the spatio-temporal information available in CTP datasets to make a tissue outcome prediction. The proposed method was evaluated on 147 patients using a 10-fold cross validation, which demonstrated that the proposed 3D+time model (mean Dice=0.45) significantly outperforms both a 2D+time variant of our approach (mean Dice=0.43) and a state-of-the-art method that uses perfusion maps (mean Dice=0.38). These results show that 4D CTP datasets include more predictive information than perfusion parameter maps, and that the proposed method is an efficient approach to make use of this complex data.

Basis and current state of computed tomography perfusion imaging: a review

Computed tomography perfusion (CTP) is a functional imaging that allows for providing capillary-level hemodynamics information of the desired tissue in clinics. In this paper, we aim to offer insight into CTP imaging which covers the basics and current state of CTP imaging, then summarize the technical applications in the CTP imaging as well as the future technological potential. At first, we focus on the fundamentals of CTP imaging including systematically summarized CTP image acquisition and hemodynamic parameter map estimation techniques. A short assessment is presented to outline the clinical applications with CTP imaging, and then a review of radiation dose effect of the CTP imaging on the different applications is presented. We present a categorized methodology review on known and potential solvable challenges of radiation dose reduction in CTP imaging. To evaluate the quality of CTP images, we list various standardized performance metrics. Moreover, we present a review on the determination of infarct and penumbra. Finally, we reveal the popularity and future trend of CTP imaging.

Estimation of the capillary level input function for dynamic contrast-enhanced MRI of the breast using a deep learning approach

PURPOSE

To develop a deep learning approach to estimate the local capillary-level input function (CIF) for pharmacokinetic model analysis of DCE-MRI.

METHODS

A deep convolutional network was trained with numerically simulated data to estimate the CIF. The trained network was tested using simulated lesion data and used to estimate voxel-wise CIF for pharmacokinetic model analysis of breast DCE-MRI data using an abbreviated protocol from women with malignant (n = 25) and benign (n = 28) lesions. The estimated parameters were used to build a logistic regression model to detect the malignancy.

RESULT

The pharmacokinetic parameters estimated using the network-predicted CIF from our breast DCE data showed significant differences between the malignant and benign groups for all parameters. Testing the diagnostic performance with the estimated parameters, the conventional approach with arterial input function (AIF) showed an area under the curve (AUC) between 0.76 and 0.87, and the proposed approach with CIF demonstrated similar performance with an AUC between 0.79 and 0.81.

CONCLUSION

This study shows the feasibility of estimating voxel-wise CIF using a deep neural network. The proposed approach could eliminate the need to measure AIF manually without compromising the diagnostic performance to detect the malignancy in the clinical setting.

Optimal Scaling Approaches for Perfusion MRI with Distorted Arterial Input Function (AIF) in Patients with Ischemic Stroke

Background: Diagnosis and timely treatment of ischemic stroke depends on the fast and accurate quantification of perfusion parameters. Arterial input function (AIF) describes contrast agent concentration over time as it enters the brain through the brain feeding artery. AIF is the central quantity required to estimate perfusion parameters. Inaccurate and distorted AIF, due to partial volume effects (PVE), would lead to inaccurate quantification of perfusion parameters. Methods: Fifteen patients suffering from stroke underwent perfusion MRI imaging at the Tri-Service General Hospital, Taipei. Various degrees of the PVE were induced on the AIF and subsequently corrected using rescaling methods. Results: Rescaled AIFs match the exact reference AIF curve either at peak height or at tail. Inaccurate estimation of CBF values estimated from non-rescaled AIFs increase with increasing PVE. Rescaling of the AIF using all three approaches resulted in reduced deviation of CBF values from the reference CBF values. In most cases, CBF map generated by rescaled AIF approaches show increased CBF and Tmax values on the slices in the left and right hemispheres. Conclusion: Rescaling AIF by VOF approach seems to be a robust and adaptable approach for correction of the PVE-affected multivoxel AIF. Utilizing an AIF scaling approach leads to more reasonable absolute perfusion parameter values, represented by the increased mean CBF/Tmax values and CBF/Tmax images.

Magnetic particle imaging for assessment of cerebral perfusion and ischemia

Stroke is one of the leading worldwide causes of death and sustained disability. Rapid and accurate assessment of cerebral perfusion is essential to diagnose and successfully treat stroke patients. Magnetic particle imaging (MPI) is a new technology with the potential to overcome some limitations of established imaging modalities. It is an innovative and radiation-free imaging technique with high sensitivity, specificity, and superior temporal resolution. MPI enables imaging and diagnosis of stroke and other neurological pathologies such as hemorrhage, tumors, and inflammatory processes. MPI scanners also offer the potential for targeted therapies of these diseases. Due to lower field requirements, MPI scanners can be designed as resistive magnets and employed as mobile devices for bedside imaging. With these advantages, MPI could accelerate and improve the diagnosis and treatment of neurological disorders. This review provides a basic introduction to MPI, discusses its current use for stroke imaging, and addresses future applications, including the potential for clinical implementation. This article is categorized under: Diagnostic Tools > In Vivo Nanodiagnostics and Imaging Therapeutic Approaches and Drug Discovery > Nanomedicine for Neurological Disease.

AIFNet: Automatic vascular function estimation for perfusion analysis using deep learning

Perfusion imaging is crucial in acute ischemic stroke for quantifying the salvageable penumbra and irreversibly damaged core lesions. As such, it helps clinicians to decide on the optimal reperfusion treatment. In perfusion CT imaging, deconvolution methods are used to obtain clinically interpretable perfusion parameters that allow identifying brain tissue abnormalities. Deconvolution methods require the selection of two reference vascular functions as inputs to the model: the arterial input function (AIF) and the venous output function, with the AIF as the most critical model input. When manually performed, the vascular function selection is time demanding, suffers from poor reproducibility and is subject to the professionals' experience. This leads to potentially unreliable quantification of the penumbra and core lesions and, hence, might harm the treatment decision process. In this work we automatize the perfusion analysis with AIFNet, a fully automatic and end-to-end trainable deep learning approach for estimating the vascular functions. Unlike previous methods using clustering or segmentation techniques to select vascular voxels, AIFNet is directly optimized at the vascular function estimation, which allows to better recognise the time-curve profiles. Validation on the public ISLES18 stroke database shows that AIFNet almost reaches inter-rater performance for the vascular function estimation and, subsequently, for the parameter maps and core lesion quantification obtained through deconvolution. We conclude that AIFNet has potential for clinical transfer and could be incorporated in perfusion deconvolution software.