1
|
Welle F, Stoll K, Gillmann C, Henkelmann J, Prasse G, Kaiser DPO, Kellner E, Reisert M, Schneider HR, Klingbeil J, Stockert A, Lobsien D, Hoffmann KT, Saur D, Wawrzyniak M. Tissue Outcome Prediction in Patients with Proximal Vessel Occlusion and Mechanical Thrombectomy Using Logistic Models. Transl Stroke Res 2024; 15:739-749. [PMID: 37249761 PMCID: PMC11226467 DOI: 10.1007/s12975-023-01160-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Revised: 04/28/2023] [Accepted: 05/21/2023] [Indexed: 05/31/2023]
Abstract
Perfusion CT is established to aid selection of patients with proximal intracranial vessel occlusion for thrombectomy in the extended time window. Selection is mostly based on simple thresholding of perfusion parameter maps, which, however, does not exploit the full information hidden in the high-dimensional perfusion data. We implemented a multiparametric mass-univariate logistic model to predict tissue outcome based on data from 405 stroke patients with acute proximal vessel occlusion in the anterior circulation who underwent mechanical thrombectomy. Input parameters were acute multimodal CT imaging (perfusion, angiography, and non-contrast) as well as basic demographic and clinical parameters. The model was trained with the knowledge of recanalization status and final infarct localization. We found that perfusion parameter maps (CBF, CBV, and Tmax) were sufficient for tissue outcome prediction. Compared with single-parameter thresholding-based models, our logistic model had comparable volumetric accuracy, but was superior with respect to topographical accuracy (AUC of receiver operating characteristic). We also found higher spatial accuracy (Dice index) in an independent internal but not external cross-validation. Our results highlight the value of perfusion data compared with non-contrast CT, CT angiography and clinical information for tissue outcome-prediction. Multiparametric logistic prediction has high potential to outperform the single-parameter thresholding-based approach. In the future, the combination of tissue and functional outcome prediction might provide an individual biomarker for the benefit from mechanical thrombectomy in acute stroke care.
Collapse
Affiliation(s)
- Florian Welle
- Neuroimaging Laboratory, Department of Neurology, University of Leipzig Medical Center, Leipzig, Germany
| | - Kristin Stoll
- Neuroimaging Laboratory, Department of Neurology, University of Leipzig Medical Center, Leipzig, Germany
| | - Christina Gillmann
- Signal and Image Processing Group, Institute for Informatics, University of Leipzig, Leipzig, Germany
| | - Jeanette Henkelmann
- Department of Radiology, University of Leipzig Medical Center, Leipzig, Germany
| | - Gordian Prasse
- Department of Neuroradiology, University of Leipzig Medical Center, Leipzig, Germany
| | - Daniel P O Kaiser
- Institute of Neuroradiology, University Hospital Carl Gustav Carus, Dresden, Germany
| | - Elias Kellner
- Medical Physics, Department of Diagnostic and Interventional Radiology, Medical Center - University of Freiburg, Faculty of Medicine, Freiburg, Germany
| | - Marco Reisert
- Medical Physics, Department of Diagnostic and Interventional Radiology, Medical Center - University of Freiburg, Faculty of Medicine, Freiburg, Germany
| | - Hans R Schneider
- Neuroimaging Laboratory, Department of Neurology, University of Leipzig Medical Center, Leipzig, Germany
| | - Julian Klingbeil
- Neuroimaging Laboratory, Department of Neurology, University of Leipzig Medical Center, Leipzig, Germany
| | - Anika Stockert
- Neuroimaging Laboratory, Department of Neurology, University of Leipzig Medical Center, Leipzig, Germany
| | - Donald Lobsien
- Department of Neuroradiology, University of Leipzig Medical Center, Leipzig, Germany
- Institute for Diagnostic and Interventional Radiology and Neuroradiology, Helios Hospital Erfurt, Erfurt, Germany
| | - Karl-Titus Hoffmann
- Department of Neuroradiology, University of Leipzig Medical Center, Leipzig, Germany
| | - Dorothee Saur
- Neuroimaging Laboratory, Department of Neurology, University of Leipzig Medical Center, Leipzig, Germany
| | - Max Wawrzyniak
- Neuroimaging Laboratory, Department of Neurology, University of Leipzig Medical Center, Leipzig, Germany.
| |
Collapse
|
2
|
Micali G, Corallo F, Pagano M, Giambò FM, Duca A, D’Aleo P, Anselmo A, Bramanti A, Garofano M, Mazzon E, Bramanti P, Cappadona I. Artificial Intelligence and Heart-Brain Connections: A Narrative Review on Algorithms Utilization in Clinical Practice. Healthcare (Basel) 2024; 12:1380. [PMID: 39057522 PMCID: PMC11276532 DOI: 10.3390/healthcare12141380] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2024] [Revised: 07/04/2024] [Accepted: 07/08/2024] [Indexed: 07/28/2024] Open
Abstract
Cardiovascular and neurological diseases are a major cause of mortality and morbidity worldwide. Such diseases require careful monitoring to effectively manage their progression. Artificial intelligence (AI) offers valuable tools for this purpose through its ability to analyse data and identify predictive patterns. This review evaluated the application of AI in cardiac and neurological diseases for their clinical impact on the general population. We reviewed studies on the application of AI in the neurological and cardiological fields. Our search was performed on the PubMed, Web of Science, Embase and Cochrane library databases. Of the initial 5862 studies, 23 studies met the inclusion criteria. The studies showed that the most commonly used algorithms in these clinical fields are Random Forest and Artificial Neural Network, followed by logistic regression and Support-Vector Machines. In addition, an ECG-AI algorithm based on convolutional neural networks has been developed and has been widely used in several studies for the detection of atrial fibrillation with good accuracy. AI has great potential to support physicians in interpretation, diagnosis, risk assessment and disease management.
Collapse
Affiliation(s)
- Giuseppe Micali
- IRCCS Centro Neurolesi Bonino-Pulejo, Via Palermo, S.S. 113, C.da Casazza, 98124 Messina, Italy; (G.M.)
| | - Francesco Corallo
- IRCCS Centro Neurolesi Bonino-Pulejo, Via Palermo, S.S. 113, C.da Casazza, 98124 Messina, Italy; (G.M.)
| | - Maria Pagano
- IRCCS Centro Neurolesi Bonino-Pulejo, Via Palermo, S.S. 113, C.da Casazza, 98124 Messina, Italy; (G.M.)
| | - Fabio Mauro Giambò
- IRCCS Centro Neurolesi Bonino-Pulejo, Via Palermo, S.S. 113, C.da Casazza, 98124 Messina, Italy; (G.M.)
| | - Antonio Duca
- IRCCS Centro Neurolesi Bonino-Pulejo, Via Palermo, S.S. 113, C.da Casazza, 98124 Messina, Italy; (G.M.)
| | - Piercataldo D’Aleo
- IRCCS Centro Neurolesi Bonino-Pulejo, Via Palermo, S.S. 113, C.da Casazza, 98124 Messina, Italy; (G.M.)
| | - Anna Anselmo
- IRCCS Centro Neurolesi Bonino-Pulejo, Via Palermo, S.S. 113, C.da Casazza, 98124 Messina, Italy; (G.M.)
| | - Alessia Bramanti
- Department of Medicine, Surgery and Dentistry, University of Salerno, 84081 Baronissi, Italy
| | - Marina Garofano
- Department of Medicine, Surgery and Dentistry, University of Salerno, 84081 Baronissi, Italy
| | - Emanuela Mazzon
- IRCCS Centro Neurolesi Bonino-Pulejo, Via Palermo, S.S. 113, C.da Casazza, 98124 Messina, Italy; (G.M.)
| | - Placido Bramanti
- IRCCS Centro Neurolesi Bonino-Pulejo, Via Palermo, S.S. 113, C.da Casazza, 98124 Messina, Italy; (G.M.)
- Faculty of Psychology, Università degli Studi eCampus, Via Isimbardi 10, 22060 Novedrate, Italy
| | - Irene Cappadona
- IRCCS Centro Neurolesi Bonino-Pulejo, Via Palermo, S.S. 113, C.da Casazza, 98124 Messina, Italy; (G.M.)
| |
Collapse
|
3
|
Winder AJ, Stanley EA, Fiehler J, Forkert ND. Challenges and Potential of Artificial Intelligence in Neuroradiology. Clin Neuroradiol 2024; 34:293-305. [PMID: 38285239 DOI: 10.1007/s00062-024-01382-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Accepted: 01/03/2024] [Indexed: 01/30/2024]
Abstract
PURPOSE Artificial intelligence (AI) has emerged as a transformative force in medical research and is garnering increased attention in the public consciousness. This represents a critical time period in which medical researchers, healthcare providers, insurers, regulatory agencies, and patients are all developing and shaping their beliefs and policies regarding the use of AI in the healthcare sector. The successful deployment of AI will require support from all these groups. This commentary proposes that widespread support for medical AI must be driven by clear and transparent scientific reporting, beginning at the earliest stages of scientific research. METHODS A review of relevant guidelines and literature describing how scientific reporting plays a central role at key stages in the life cycle of an AI software product was conducted. To contextualize this principle within a specific medical domain, we discuss the current state of predictive tissue outcome modeling in acute ischemic stroke and the unique challenges presented therein. RESULTS AND CONCLUSION Translating AI methods from the research to the clinical domain is complicated by challenges related to model design and validation studies, medical product regulations, and healthcare providers' reservations regarding AI's efficacy and affordability. However, each of these limitations is also an opportunity for high-impact research that will help to accelerate the clinical adoption of state-of-the-art medical AI. In all cases, establishing and adhering to appropriate reporting standards is an important responsibility that is shared by all of the parties involved in the life cycle of a prospective AI software product.
Collapse
Affiliation(s)
- Anthony J Winder
- Department of Radiology, University of Calgary, Calgary, Canada.
- Hotchkiss Brain Institute, University of Calgary, Calgary, Canada.
| | - Emma Am Stanley
- Department of Radiology, University of Calgary, Calgary, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, Canada
- Biomedical Engineering Graduate Program, University of Calgary, Calgary, Canada
- Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada
| | - Jens Fiehler
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Nils D Forkert
- Department of Radiology, University of Calgary, Calgary, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, Canada
- Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada
- Department of Clinical Neuroscience, University of Calgary, Calgary, Canada
- Department of Electrical and Software Engineering, University of Calgary, Calgary, Canada
| |
Collapse
|
4
|
Zhao Z, Zhang Y, Su J, Yang L, Pang L, Gao Y, Wang H. A comprehensive review for artificial intelligence on neuroimaging in rehabilitation of ischemic stroke. Front Neurol 2024; 15:1367854. [PMID: 38606275 PMCID: PMC11007047 DOI: 10.3389/fneur.2024.1367854] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Accepted: 03/08/2024] [Indexed: 04/13/2024] Open
Abstract
Stroke is the second leading cause of death worldwide, with ischemic stroke accounting for a significant proportion of morbidity and mortality among stroke patients. Ischemic stroke often causes disability and cognitive impairment in patients, which seriously affects the quality of life of patients. Therefore, how to predict the recovery of patients can provide support for clinical intervention in advance and improve the enthusiasm of patients for rehabilitation treatment. With the popularization of imaging technology, the diagnosis and treatment of ischemic stroke patients are often accompanied by a large number of imaging data. Through machine learning and Deep Learning, information from imaging data can be used more effectively. In this review, we discuss recent advances in neuroimaging, machine learning, and Deep Learning in the rehabilitation of ischemic stroke.
Collapse
Affiliation(s)
- Zijian Zhao
- Rehabilitation Center, ShengJing Hospital of China Medical University, Shenyang, Liaoning Province, China
| | - Yuanyuan Zhang
- Rehabilitation Center, ShengJing Hospital of China Medical University, Shenyang, Liaoning Province, China
| | - Jiuhui Su
- Department of Orthopedics, Haicheng Bonesetting Hospital, Haicheng, Liaoning Province, China
| | - Lianbo Yang
- Department of Reparative and Reconstructive Surgery, The Second Hospital of Dalian Medical University, Dalian Liaoning Province, China
| | - Luhang Pang
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning Province, China
| | - Yingshan Gao
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning Province, China
| | - Hongbo Wang
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning Province, China
| |
Collapse
|
5
|
Akay EMZ, Hilbert A, Carlisle BG, Madai VI, Mutke MA, Frey D. Artificial Intelligence for Clinical Decision Support in Acute Ischemic Stroke: A Systematic Review. Stroke 2023; 54:1505-1516. [PMID: 37216446 DOI: 10.1161/strokeaha.122.041442] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Accepted: 02/21/2023] [Indexed: 05/24/2023]
Abstract
BACKGROUND Established randomized trial-based parameters for acute ischemic stroke group patients into generic treatment groups, leading to attempts using various artificial intelligence (AI) methods to directly correlate patient characteristics to outcomes and thereby provide decision support to stroke clinicians. We review AI-based clinical decision support systems in the development stage, specifically regarding methodological robustness and constraints for clinical implementation. METHODS Our systematic review included full-text English language publications proposing a clinical decision support system using AI techniques for direct decision support in acute ischemic stroke cases in adult patients. We (1) describe data and outcomes used in those systems, (2) estimate the systems' benefits compared with traditional stroke diagnosis and treatment, and (3) reported concordance with reporting standards for AI in healthcare. RESULTS One hundred twenty-one studies met our inclusion criteria. Sixty-five were included for full extraction. In our sample, utilized data sources, methods, and reporting practices were highly heterogeneous. CONCLUSIONS Our results suggest significant validity threats, dissonance in reporting practices, and challenges to clinical translation. We outline practical recommendations for the successful implementation of AI research in acute ischemic stroke treatment and diagnosis.
Collapse
Affiliation(s)
- Ela Marie Z Akay
- Charité Lab for Artificial Intelligence in Medicine (CLAIM) (E.M.Z.A., A.H., D.F.), Charité Universitätsmedizin Berlin, Germany
| | - Adam Hilbert
- Charité Lab for Artificial Intelligence in Medicine (CLAIM) (E.M.Z.A., A.H., D.F.), Charité Universitätsmedizin Berlin, Germany
| | - Benjamin G Carlisle
- QUEST Center for Responsible Research, Berlin Institute of Health (BIH) (B.G.C., V.I.M.), Charité Universitätsmedizin Berlin, Germany
| | - Vince I Madai
- QUEST Center for Responsible Research, Berlin Institute of Health (BIH) (B.G.C., V.I.M.), Charité Universitätsmedizin Berlin, Germany
- Faculty of Computing, Engineering and the Built Environment, School of Computing and Digital Technology, Birmingham City University, United Kingdom (V.I.M.)
| | - Matthias A Mutke
- Department of Neuroradiology, Heidelberg University Hospital, Germany (M.A.M.)
| | - Dietmar Frey
- Charité Lab for Artificial Intelligence in Medicine (CLAIM) (E.M.Z.A., A.H., D.F.), Charité Universitätsmedizin Berlin, Germany
| |
Collapse
|
6
|
Automatic identification of early ischemic lesions on non-contrast CT with deep learning approach. Sci Rep 2022; 12:18054. [PMID: 36302876 PMCID: PMC9613643 DOI: 10.1038/s41598-022-22939-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2022] [Accepted: 10/21/2022] [Indexed: 01/24/2023] Open
Abstract
Early ischemic lesion on non-contrast computed tomogram (NCCT) in acute stroke can be subtle and need confirmation with magnetic resonance (MR) image for treatment decision-making. We retrospectively included the NCCT slices of 129 normal subjects and 546 ischemic stroke patients (onset < 12 h) with corresponding MR slices as reference standard from a prospective registry of Chang Gung Research Databank. In model selection, NCCT slices were preprocessed and fed into five different pre-trained convolutional neural network (CNN) models including Visual Geometry Group 16 (VGG16), Residual Networks 50, Inception-ResNet-v2, Inception-v3, and Inception-v4. In model derivation, the customized-VGG16 model could achieve an accuracy of 0.83, sensitivity 0.85, F-score 0.80, specificity 0.82, and AP 0.82 after using a tenfold cross-validation method, outperforming the pre-trained VGG16 model. In model evaluation, the customized-VGG16 model could correctly identify 53 in 58 subjects (91.37%) including 29 ischemic stroke patients and 24 normal subjects and reached the sensitivity of 86.95% in identifying ischemic NCCT slices (200/230), irrespective of supratentorial or infratentorial lesions. The customized-VGG16 CNN model can successfully identify the presence of early ischemic lesions on NCCT slices using the concept of automatic feature learning. Further study will be proceeded to detect the location of ischemic lesion.
Collapse
|
7
|
He Y, Luo Z, Zhou Y, Xue R, Li J, Hu H, Yan S, Chen Z, Wang J, Lou M. U-net Models Based on Computed Tomography Perfusion Predict Tissue Outcome in Patients with Different Reperfusion Patterns. Transl Stroke Res 2022; 13:707-715. [PMID: 35043358 DOI: 10.1007/s12975-022-00986-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2021] [Revised: 12/05/2021] [Accepted: 01/10/2022] [Indexed: 12/30/2022]
Abstract
Evaluation of cerebral perfusion is important for treatment selection in patients with acute large vessel occlusion (LVO). To assess ischemic core and tissue at risk more accurately, we developed a deep learning model named U-net using computed tomography perfusion (CTP) images. A total of 110 acute ischemic stroke patients undergoing endovascular treatment with major reperfusion (≥ 80%) or minimal reperfusion (≤ 20%) were included. Using baseline CTP, we developed two U-net models: one model in major reperfusion group to identify infarct core; the other in minimal reperfusion group to identify tissue at risk. The performance of fixed-thresholding methods was compared with that of U-net models. In the major reperfusion group, the model estimated infarct core with a Dice score coefficient (DSC) of 0.61 and an area under the curve (AUC) of 0.92, while fixed-thresholding methods had a DSC of 0.52. In the minimal reperfusion group, the model estimated tissue at risk with a DSC of 0.67 and an AUC of 0.93, while fixed-thresholding methods had a DSC of 0.51. In both groups, excellent volumetric consistency (intraclass correlation coefficient was 0.951 in major reperfusion and 0.746 in minimal reperfusion) was achieved between the estimated lesion and the actual lesion volume. Thus, in patients with anterior LVO, the CTP-based U-net models were able to identify infarct core and tissue at risk on baseline CTP superior to fixed-thresholding methods, providing individualized prediction of final lesion in patients with different reperfusion patterns.
Collapse
Affiliation(s)
- Yaode He
- Department of Neurology, School of Medicine, the Second Affiliated Hospital of Zhejiang University, 88# Jiefang Road, Hangzhou, 310009, China
| | - Zhongyu Luo
- Department of Neurology, School of Medicine, the Second Affiliated Hospital of Zhejiang University, 88# Jiefang Road, Hangzhou, 310009, China
| | - Ying Zhou
- Department of Neurology, School of Medicine, the Second Affiliated Hospital of Zhejiang University, 88# Jiefang Road, Hangzhou, 310009, China
| | - Rui Xue
- Department of Neurology, School of Medicine, the Second Affiliated Hospital of Zhejiang University, 88# Jiefang Road, Hangzhou, 310009, China
| | - Jiaping Li
- Department of Neurology, School of Medicine, the Second Affiliated Hospital of Zhejiang University, 88# Jiefang Road, Hangzhou, 310009, China
| | - Haitao Hu
- Department of Neurology, School of Medicine, the Second Affiliated Hospital of Zhejiang University, 88# Jiefang Road, Hangzhou, 310009, China
| | - Shenqiang Yan
- Department of Neurology, School of Medicine, the Second Affiliated Hospital of Zhejiang University, 88# Jiefang Road, Hangzhou, 310009, China
| | - Zhicai Chen
- Department of Neurology, School of Medicine, the Second Affiliated Hospital of Zhejiang University, 88# Jiefang Road, Hangzhou, 310009, China
| | - Jianan Wang
- Department of Neurology, School of Medicine, the Second Affiliated Hospital of Zhejiang University, 88# Jiefang Road, Hangzhou, 310009, China
| | - Min Lou
- Department of Neurology, School of Medicine, the Second Affiliated Hospital of Zhejiang University, 88# Jiefang Road, Hangzhou, 310009, China.
| |
Collapse
|
8
|
Wang X, Fan Y, Zhang N, Li J, Duan Y, Yang B. Performance of Machine Learning for Tissue Outcome Prediction in Acute Ischemic Stroke: A Systematic Review and Meta-Analysis. Front Neurol 2022; 13:910259. [PMID: 35873778 PMCID: PMC9305175 DOI: 10.3389/fneur.2022.910259] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2022] [Accepted: 06/20/2022] [Indexed: 12/03/2022] Open
Abstract
Machine learning (ML) has been proposed for lesion segmentation in acute ischemic stroke (AIS). This study aimed to provide a systematic review and meta-analysis of the overall performance of current ML algorithms for final infarct prediction from baseline imaging. We made a comprehensive literature search on eligible studies developing ML models for core infarcted tissue estimation on admission CT or MRI in AIS patients. Eleven studies meeting the inclusion criteria were included in the quantitative analysis. Study characteristics, model methodology, and predictive performance of the included studies were extracted. A meta-analysis was conducted on the dice similarity coefficient (DSC) score by using a random-effects model to assess the overall predictive performance. Study heterogeneity was assessed by Cochrane Q and Higgins I2 tests. The pooled DSC score of the included ML models was 0.50 (95% CI 0.39–0.61), with high heterogeneity observed across studies (I2 96.5%, p < 0.001). Sensitivity analyses using the one-study removed method showed the adjusted overall DSC score ranged from 0.47 to 0.52. Subgroup analyses indicated that the DL-based models outperformed the conventional ML classifiers with the best performance observed in DL algorithms combined with CT data. Despite the presence of heterogeneity, current ML-based approaches for final infarct prediction showed moderate but promising performance. Before well integrated into clinical stroke workflow, future investigations are suggested to train ML models on large-scale, multi-vendor data, validate on external cohorts and adopt formalized reporting standards for improving model accuracy and robustness.
Collapse
Affiliation(s)
- Xinrui Wang
- Department of Radiology, General Hospital of Northern Theater Command, Shenyang, China
| | - Yiming Fan
- Department of Orthopedics, Chinese PLA General Hospital, Beijing, China
| | - Nan Zhang
- Department of Radiology, General Hospital of Northern Theater Command, Shenyang, China
| | - Jing Li
- Department of Radiology, Changhai Hospital, Shanghai, China
| | - Yang Duan
- Department of Radiology, General Hospital of Northern Theater Command, Shenyang, China
| | - Benqiang Yang
- Department of Radiology, General Hospital of Northern Theater Command, Shenyang, China
- *Correspondence: Benqiang Yang
| |
Collapse
|
9
|
Hatami N, Cho TH, Mechtouff L, Eker OF, Rousseau D, Frindel C. CNN-LSTM Based Multimodal MRI and Clinical Data Fusion for Predicting Functional Outcome in Stroke Patients. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:3430-3434. [PMID: 36085793 DOI: 10.1109/embc48229.2022.9871735] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Clinical outcome prediction plays an important role in stroke patient management. From a machine learning point-of-view, one of the main challenges is dealing with heterogeneous data at patient admission, i.e. the image data which are multidimensional and the clinical data which are scalars. In this paper, a multimodal convolutional neural network - long short-term memory (CNN-LSTM) based ensemble model is proposed. For each MR image module, a dedicated network provides preliminary prediction of the clinical outcome using the modified Rankin scale (mRS). The final mRS score is obtained by merging the preliminary probabilities of each module dedicated to a specific type of MR image weighted by the clinical metadata, here age or the National Institutes of Health Stroke Scale (NIHSS). The experimental results demonstrate that the proposed model surpasses the baselines and offers an original way to automatically encode the spatio-temporal context of MR images in a deep learning architecture. The highest AUC (0.77) was achieved for the proposed model with NIHSS. Clinical Relevance- - We present the first deep learning approach predicting the clinical outcome of stroke patients treated by mechanical thrombectomy which integrates imaging data at the voxel level with key clinical metadata. Combining clinical and imaging data to evaluate the potential benefit from therapy closely mirrors the clinical decision process. Our promising results suggest our predictive model could assist in acute stroke management.
Collapse
|
10
|
Mutke MA, Madai VI, Hilbert A, Zihni E, Potreck A, Weyland CS, Möhlenbruch MA, Heiland S, Ringleb PA, Nagel S, Bendszus M, Frey D. Comparing Poor and Favorable Outcome Prediction With Machine Learning After Mechanical Thrombectomy in Acute Ischemic Stroke. Front Neurol 2022; 13:737667. [PMID: 35693017 PMCID: PMC9184444 DOI: 10.3389/fneur.2022.737667] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Accepted: 03/28/2022] [Indexed: 11/13/2022] Open
Abstract
Background and PurposeOutcome prediction after mechanical thrombectomy (MT) in patients with acute ischemic stroke (AIS) and large vessel occlusion (LVO) is commonly performed by focusing on favorable outcome (modified Rankin Scale, mRS 0–2) after 3 months but poor outcome representing severe disability and mortality (mRS 5 and 6) might be of equal importance for clinical decision-making.MethodsWe retrospectively analyzed patients with AIS and LVO undergoing MT from 2009 to 2018. Prognostic variables were grouped in baseline clinical (A), MRI-derived variables including mismatch [apparent diffusion coefficient (ADC) and time-to-maximum (Tmax) lesion volume] (B), and variables reflecting speed and extent of reperfusion (C) [modified treatment in cerebral ischemia (mTICI) score and time from onset to mTICI]. Three different scenarios were analyzed: (1) baseline clinical parameters only, (2) baseline clinical and MRI-derived parameters, and (3) all baseline clinical, imaging-derived, and reperfusion-associated parameters. For each scenario, we assessed prediction for favorable and poor outcome with seven different machine learning algorithms.ResultsIn 210 patients, prediction of favorable outcome was improved after including speed and extent of recanalization [highest area under the curve (AUC) 0.73] compared to using baseline clinical variables only (highest AUC 0.67). Prediction of poor outcome remained stable by using baseline clinical variables only (highest AUC 0.71) and did not improve further by additional variables. Prediction of favorable and poor outcomes was not improved by adding MR-mismatch variables. Most important baseline clinical variables for both outcomes were age, National Institutes of Health Stroke Scale, and premorbid mRS.ConclusionsOur results suggest that a prediction of poor outcome after AIS and MT could be made based on clinical baseline variables only. Speed and extent of MT did improve prediction for a favorable outcome but is not relevant for poor outcome. An MR mismatch with small ischemic core and larger penumbral tissue showed no predictive importance.
Collapse
Affiliation(s)
- Matthias A. Mutke
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
- *Correspondence: Matthias A. Mutke
| | - Vince I. Madai
- Charité Lab for Artificial Intelligence in Medicine, Charité Universitätsmedizin Berlin, Berlin, Germany
- QUEST (Quality, Ethics, Open Science, Translation) Center for Responsible Research at Berlin Institute of Health, Charité Universitätsmedizin Berlin, Berlin, Germany
- School of Computing and Digital Technology, Faculty of Computing, Engineering and the Built Environment, Birmingham City University, Birmingham, United Kingdom
| | - Adam Hilbert
- Charité Lab for Artificial Intelligence in Medicine, Charité Universitätsmedizin Berlin, Berlin, Germany
| | - Esra Zihni
- Charité Lab for Artificial Intelligence in Medicine, Charité Universitätsmedizin Berlin, Berlin, Germany
- School of Computing, Technological University Dublin, Dublin, Ireland
| | - Arne Potreck
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Charlotte S. Weyland
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
| | | | - Sabine Heiland
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Peter A. Ringleb
- Department of Neurology, Heidelberg University Hospital, Heidelberg, Germany
| | - Simon Nagel
- Department of Neurology, Heidelberg University Hospital, Heidelberg, Germany
| | - Martin Bendszus
- Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Dietmar Frey
- Charité Lab for Artificial Intelligence in Medicine, Charité Universitätsmedizin Berlin, Berlin, Germany
| |
Collapse
|
11
|
Zhu G, Chen H, Jiang B, Chen F, Xie Y, Wintermark M. Application of Deep Learning to Ischemic and Hemorrhagic Stroke Computed Tomography and Magnetic Resonance Imaging. Semin Ultrasound CT MR 2022; 43:147-152. [PMID: 35339255 DOI: 10.1053/j.sult.2022.02.004] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Deep Learning (DL) algorithm holds great potential in the field of stroke imaging. It has been applied not only to the "downstream" side such as lesion detection, treatment decision making, and outcome prediction, but also to the "upstream" side for generation and enhancement of stroke imaging. This paper aims to comprehensively overview the common applications of DL to stroke imaging. In the future, more standardized imaging datasets and more extensive studies are needed to establish and validate the role of DL in stroke imaging.
Collapse
Affiliation(s)
- Guangming Zhu
- Department of Radiology, Neuroradiology Section, Stanford University School of Medicine, Stanford, CA
| | - Hui Chen
- Department of Radiology, Neuroradiology Section, Stanford University School of Medicine, Stanford, CA
| | - Bin Jiang
- Department of Radiology, Neuroradiology Section, Stanford University School of Medicine, Stanford, CA
| | - Fei Chen
- Department of Neurology, Xuan Wu hospital, Capital Meidcal University, Beijing, China
| | - Yuan Xie
- Subtle Medical Inc, Menlo Park, CA
| | - Max Wintermark
- Department of Radiology, Neuroradiology Section, Stanford University School of Medicine, Stanford, CA.
| |
Collapse
|
12
|
Zhu H, Chen Y, Tang T, Ma G, Zhou J, Zhang J, Lu S, Wu F, Luo L, Liu S, Ju S, Shi H. ISP-Net: Fusing features to predict ischemic stroke infarct core on CT perfusion maps. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 215:106630. [PMID: 35063712 DOI: 10.1016/j.cmpb.2022.106630] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Revised: 01/04/2022] [Accepted: 01/08/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND Acute ischemic stroke is one of the leading death causes. Delineating stoke infarct core in medical images plays a critical role in optimal stroke treatment selection. However, accurate estimation of infarct core still remains challenging because of 1) the large shape and location variation of infarct cores; 2) the complex relationships between perfusion parameters and final tissue outcome. METHODS We develop an encoder-decoder based semantic model, i.e., Ischemic Stroke Prediction Network (ISP-Net), to predict infarct core after thrombolysis treatment on CT perfusion (CTP) maps. Features of native CTP, CBF (Cerebral Blood Flow), CBV (Cerebral Blood Volume), MTT (Mean Transit Time), Tmax are generated and fused with five-path convolutions for comprehensive analysis. A multi-scale atrous convolution (MSAC) block is firstly put forward as the enriched high-level feature extractor in ISP-Net to improve prediction accuracy. A retrospective dataset which is collected from multiple stroke centers is used to evaluate the performance of ISP-Net. The gold standard infarct cores are delineated on the follow-up scans, i.e., non-contrast CT (NCCT) or MRI diffusion-weighted image (DWI). RESULTS In clinical dataset cross-validation, we achieve mean Dice Similarity Coefficient (DSC) of 0.801, precision of 81.3%, sensitivity of 79.5%, specificity of 99.5%, Area Under Curve (AUC) of 0.721. Our approach yields better outcomes than several advanced deep learning methods, i.e., Deeplab V3, U-Net++, CE-Net, X-Net and Non-local U-Net, demonstrating the promising performance in infarct core prediction. No significant difference of the prediction error is shown for the patients with follow-up NCCT and follow-up DWI (P >0.05). CONCLUSION This study provides an approach for fast and accurate stroke infarct core estimation. We anticipate the prediction results of ISP-Net could offer assistance to the physicians in the thrombolysis or thrombectomy therapy selection.
Collapse
Affiliation(s)
- Haichen Zhu
- Lab of Image Science and Technology, Key Laboratory of Computer Network and Information Integration (Ministry of Education), Southeast University, Nanjing 210096, China
| | - Yang Chen
- Lab of Image Science and Technology, Key Laboratory of Computer Network and Information Integration (Ministry of Education), Southeast University, Nanjing 210096, China; Jiangsu Provincial Joint International Research Laboratory of Medical Information Processing, School of Computer Science and Engineering, Southeast University, Nanjing 210096, China
| | - Tianyu Tang
- Jiangsu Key Laboratory of Molecular and Functional Imaging, Department of Radiology, Zhongda Hospital, Southeast University, Nanjing 210009, China
| | - Gao Ma
- Department of Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, China
| | - Jiaying Zhou
- Jiangsu Key Laboratory of Molecular and Functional Imaging, Department of Radiology, Zhongda Hospital, Southeast University, Nanjing 210009, China
| | - Jiulou Zhang
- Department of Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, China
| | - Shanshan Lu
- Department of Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, China
| | - Feiyun Wu
- Department of Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, China
| | - Limin Luo
- Lab of Image Science and Technology, Key Laboratory of Computer Network and Information Integration (Ministry of Education), Southeast University, Nanjing 210096, China
| | - Sheng Liu
- Department of Interventional Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, China
| | - Shenghong Ju
- Jiangsu Key Laboratory of Molecular and Functional Imaging, Department of Radiology, Zhongda Hospital, Southeast University, Nanjing 210009, China.
| | - Haibin Shi
- Department of Interventional Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, China.
| |
Collapse
|
13
|
Zeleňák K, Krajina A, Meyer L, Fiehler J, Behme D, Bulja D, Caroff J, Chotai AA, Da Ros V, Gentric JC, Hofmeister J, Kass-Hout O, Kocatürk Ö, Lynch J, Pearson E, Vukasinovic I. How to Improve the Management of Acute Ischemic Stroke by Modern Technologies, Artificial Intelligence, and New Treatment Methods. Life (Basel) 2021; 11:life11060488. [PMID: 34072071 PMCID: PMC8229281 DOI: 10.3390/life11060488] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2021] [Revised: 05/25/2021] [Accepted: 05/25/2021] [Indexed: 12/22/2022] Open
Abstract
Stroke remains one of the leading causes of death and disability in Europe. The European Stroke Action Plan (ESAP) defines four main targets for the years 2018 to 2030. The COVID-19 pandemic forced the use of innovative technologies and created pressure to improve internet networks. Moreover, 5G internet network will be helpful for the transfer and collecting of extremely big databases. Nowadays, the speed of internet connection is a limiting factor for robotic systems, which can be controlled and commanded potentially from various places in the world. Innovative technologies can be implemented for acute stroke patient management soon. Artificial intelligence (AI) and robotics are used increasingly often without the exception of medicine. Their implementation can be achieved in every level of stroke care. In this article, all steps of stroke health care processes are discussed in terms of how to improve them (including prehospital diagnosis, consultation, transfer of the patient, diagnosis, techniques of the treatment as well as rehabilitation and usage of AI). New ethical problems have also been discovered. Everything must be aligned to the concept of “time is brain”.
Collapse
Affiliation(s)
- Kamil Zeleňák
- Clinic of Radiology, Jessenius Faculty of Medicine in Martin, Comenius University in Bratislava, 03659 Martin, Slovakia
- ESMINT Artificial Intelligence and Robotics Ad hoc Committee, ESMINT, 8008 Zurich, Switzerland; (E.A.I.R.A.h.C.); (D.B.); (D.B.); (J.C.); (A.A.C.); (V.D.R.); (J.-C.G.); (J.H.); (O.K.-H.); (Ö.K.); (J.L.); (E.P.); (I.V.)
- Correspondence: ; Tel.: +421-43-4203-990
| | - Antonín Krajina
- Department of Radiology, Charles University Faculty of Medicine and University Hospital, CZ-500 05 Hradec Králové, Czech Republic;
| | - Lukas Meyer
- Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, 20251 Hamburg, Germany; (L.M.); (J.F.)
| | - Jens Fiehler
- Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, 20251 Hamburg, Germany; (L.M.); (J.F.)
| | | | - Daniel Behme
- ESMINT Artificial Intelligence and Robotics Ad hoc Committee, ESMINT, 8008 Zurich, Switzerland; (E.A.I.R.A.h.C.); (D.B.); (D.B.); (J.C.); (A.A.C.); (V.D.R.); (J.-C.G.); (J.H.); (O.K.-H.); (Ö.K.); (J.L.); (E.P.); (I.V.)
- University Clinic for Neuroradiology, Medical Faculty, Otto-von-Guericke University Magdeburg, 39120 Magdeburg, Germany
| | - Deniz Bulja
- ESMINT Artificial Intelligence and Robotics Ad hoc Committee, ESMINT, 8008 Zurich, Switzerland; (E.A.I.R.A.h.C.); (D.B.); (D.B.); (J.C.); (A.A.C.); (V.D.R.); (J.-C.G.); (J.H.); (O.K.-H.); (Ö.K.); (J.L.); (E.P.); (I.V.)
- Diagnostic-Interventional Radiology Department, Clinic of Radiology, Clinical Center of University of Sarajevo, 71000 Sarajevo, Bosnia and Herzegovina
| | - Jildaz Caroff
- ESMINT Artificial Intelligence and Robotics Ad hoc Committee, ESMINT, 8008 Zurich, Switzerland; (E.A.I.R.A.h.C.); (D.B.); (D.B.); (J.C.); (A.A.C.); (V.D.R.); (J.-C.G.); (J.H.); (O.K.-H.); (Ö.K.); (J.L.); (E.P.); (I.V.)
- Department of Interventional Neuroradiology–NEURI Brain Vascular Center, Bicêtre Hospital, APHP, 94270 Paris, France
| | - Amar Ajay Chotai
- ESMINT Artificial Intelligence and Robotics Ad hoc Committee, ESMINT, 8008 Zurich, Switzerland; (E.A.I.R.A.h.C.); (D.B.); (D.B.); (J.C.); (A.A.C.); (V.D.R.); (J.-C.G.); (J.H.); (O.K.-H.); (Ö.K.); (J.L.); (E.P.); (I.V.)
- Department of Neuroradiology, Royal Victoria Infirmary, Newcastle upon Tyne NE14LP, UK
| | - Valerio Da Ros
- ESMINT Artificial Intelligence and Robotics Ad hoc Committee, ESMINT, 8008 Zurich, Switzerland; (E.A.I.R.A.h.C.); (D.B.); (D.B.); (J.C.); (A.A.C.); (V.D.R.); (J.-C.G.); (J.H.); (O.K.-H.); (Ö.K.); (J.L.); (E.P.); (I.V.)
- Department of Biomedicine and Prevention, University Hospital of Rome “Tor Vergata”, 00133 Rome, Italy
| | - Jean-Christophe Gentric
- ESMINT Artificial Intelligence and Robotics Ad hoc Committee, ESMINT, 8008 Zurich, Switzerland; (E.A.I.R.A.h.C.); (D.B.); (D.B.); (J.C.); (A.A.C.); (V.D.R.); (J.-C.G.); (J.H.); (O.K.-H.); (Ö.K.); (J.L.); (E.P.); (I.V.)
- Interventional Neuroradiology Unit, Hôpital de la Cavale Blanche, 29200 Brest, France
| | - Jeremy Hofmeister
- ESMINT Artificial Intelligence and Robotics Ad hoc Committee, ESMINT, 8008 Zurich, Switzerland; (E.A.I.R.A.h.C.); (D.B.); (D.B.); (J.C.); (A.A.C.); (V.D.R.); (J.-C.G.); (J.H.); (O.K.-H.); (Ö.K.); (J.L.); (E.P.); (I.V.)
- Unité de Neuroradiologie Interventionnelle, Service de Neuroradiologie Diagnostique et Interventionnelle, 1205 Genève, Switzerland
| | - Omar Kass-Hout
- ESMINT Artificial Intelligence and Robotics Ad hoc Committee, ESMINT, 8008 Zurich, Switzerland; (E.A.I.R.A.h.C.); (D.B.); (D.B.); (J.C.); (A.A.C.); (V.D.R.); (J.-C.G.); (J.H.); (O.K.-H.); (Ö.K.); (J.L.); (E.P.); (I.V.)
- Stroke and Neuroendovascular Surgery, Rex Hospital, University of North Carolina, 4207 Lake Boone Trail, Suite 220, Raleigh, NC 27607, USA
| | - Özcan Kocatürk
- ESMINT Artificial Intelligence and Robotics Ad hoc Committee, ESMINT, 8008 Zurich, Switzerland; (E.A.I.R.A.h.C.); (D.B.); (D.B.); (J.C.); (A.A.C.); (V.D.R.); (J.-C.G.); (J.H.); (O.K.-H.); (Ö.K.); (J.L.); (E.P.); (I.V.)
- Balikesir Atatürk City Hospital, Gaziosmanpaşa Mahallesi 209., Sok. No: 26, 10100 Altıeylül/Balıkesir, Turkey
| | - Jeremy Lynch
- ESMINT Artificial Intelligence and Robotics Ad hoc Committee, ESMINT, 8008 Zurich, Switzerland; (E.A.I.R.A.h.C.); (D.B.); (D.B.); (J.C.); (A.A.C.); (V.D.R.); (J.-C.G.); (J.H.); (O.K.-H.); (Ö.K.); (J.L.); (E.P.); (I.V.)
- Department of Neuroradiology, Toronto Western Hospital, Toronto, ON M5T 2S8, Canada
| | - Ernesto Pearson
- ESMINT Artificial Intelligence and Robotics Ad hoc Committee, ESMINT, 8008 Zurich, Switzerland; (E.A.I.R.A.h.C.); (D.B.); (D.B.); (J.C.); (A.A.C.); (V.D.R.); (J.-C.G.); (J.H.); (O.K.-H.); (Ö.K.); (J.L.); (E.P.); (I.V.)
- CH Bergerac-Centre Hospitalier, Samuel Pozzi 9 Boulevard du Professeur Albert Calmette, 24100 Bergerac, France
| | - Ivan Vukasinovic
- ESMINT Artificial Intelligence and Robotics Ad hoc Committee, ESMINT, 8008 Zurich, Switzerland; (E.A.I.R.A.h.C.); (D.B.); (D.B.); (J.C.); (A.A.C.); (V.D.R.); (J.-C.G.); (J.H.); (O.K.-H.); (Ö.K.); (J.L.); (E.P.); (I.V.)
- Department of Neuroradiology, University Clinical Center of Serbia, 11000 Belgrade, Serbia
| |
Collapse
|