1
|
Fang T, Jiang Z, Zhou Y, Jia S, Zhao J, Nie S. Automatic assessment of DWI-ASPECTS for acute ischemic stroke based on deep learning. Med Phys 2024; 51:4351-4364. [PMID: 38687043 DOI: 10.1002/mp.17101] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Revised: 04/04/2024] [Accepted: 04/12/2024] [Indexed: 05/02/2024] Open
Abstract
BACKGROUND Alberta Stroke Program Early Computed Tomography Score (ASPECTS) is a standardized semi-quantitative method for early ischemic changes in acute ischemic stroke. PURPOSE However, ASPECTS is still affected by expert experience and inconsistent results between readers in clinical. This study aims to propose an automatic ASPECTS scoring model based on diffusion-weighted imaging (DWI) mode to help clinicians make accurate treatment plans. METHODS Eighty-two patients with stroke were included in the study. First, we designed a new deep learning network for segmenting ASPECTS scoring brain regions. The network is improved based on U-net, which integrates multiple modules. Second, we proposed using hybrid classifiers to classify brain regions. For brain regions with larger areas, we used brain grayscale comparison algorithm to train machine learning classifiers, while using hybrid feature training for brain regions with smaller areas. RESULTS The average DICE coefficient of the segmented hindbrain area can reach 0.864. With the proposed hybrid classifier, our method performs significantly on both region-level ASPECTS and dichotomous ASPECTS. The sensitivity and accuracy on the test set are 95.51% and 93.43%, respectively. For dichotomous ASPECTS, the intraclass correlation coefficient (ICC) between our automated ASPECTS score and the expert reading was 0.87. CONCLUSIONS This study proposed an automated model for ASPECTS scoring of patients with acute ischemic stroke based on DWI images. Experimental results show that the method of segmentation first and then classification is feasible. Our method has the potential to assist physicians in the Alberta Stroke Program with early CT scoring and clinical stroke diagnosis.
Collapse
Affiliation(s)
- Ting Fang
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China
| | - Zhuoyun Jiang
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China
| | - Yuxi Zhou
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China
| | - Shouqiang Jia
- Department of Imaging, Jinan People's Hospital affiliated to Shandong First Medical University, Shandong, China
| | - Jiaqi Zhao
- Department of Ultrasound, Shanghai Fourth People's Hospital, School of Medicine, Tongji University, Shanghai, China
| | - Shengdong Nie
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China
| |
Collapse
|
2
|
Aktar M, Xiao Y, Tehrani AKZ, Tampieri D, Rivaz H, Kersten-Oertel M. SCANED: Siamese collateral assessment network for evaluation of collaterals from ischemic damage. Comput Med Imaging Graph 2024; 113:102346. [PMID: 38364600 DOI: 10.1016/j.compmedimag.2024.102346] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Revised: 01/31/2024] [Accepted: 01/31/2024] [Indexed: 02/18/2024]
Abstract
This study conducts collateral evaluation from ischemic damage using a deep learning-based Siamese network, addressing the challenges associated with a small and imbalanced dataset. The collateral network provides an alternative oxygen and nutrient supply pathway in ischemic stroke cases, influencing treatment decisions. Research in this area focuses on automated collateral assessment using deep learning (DL) methods to expedite decision-making processes and enhance accuracy. Our study employed a 3D ResNet-based Siamese network, referred to as SCANED, to classify collaterals as good/intermediate or poor. Utilizing non-contrast computed tomography (NCCT) images, the network automates collateral identification and assessment by analyzing tissue degeneration around the ischemic site. Relevant features from the left/right hemispheres were extracted, and Euclidean Distance (ED) was employed for similarity measurement. Finally, dichotomized classification of good/intermediate or poor collateral is performed by SCANED using an optimal threshold derived from ROC analysis. SCANED provides a sensitivity of 0.88, a specificity of 0.63, and a weighted F1 score of 0.86 in the dichotomized classification.
Collapse
Affiliation(s)
- Mumu Aktar
- Concordia University, Gina Cody School of Engineering and Computer Science, 1455 De Maisonneuve Blvd. W., Montreal, H3g 1M8, Quebec, Canada.
| | - Yiming Xiao
- Concordia University, Gina Cody School of Engineering and Computer Science, 1455 De Maisonneuve Blvd. W., Montreal, H3g 1M8, Quebec, Canada
| | - Ali K Z Tehrani
- Concordia University, Gina Cody School of Engineering and Computer Science, 1455 De Maisonneuve Blvd. W., Montreal, H3g 1M8, Quebec, Canada
| | - Donatella Tampieri
- Queens University, Department of Diagnostic Radiology, Kingston Health Sciences Centre, Kingston General Hospital 76 Stuart Street Kingston, K7L 2V7, Ontario, Canada
| | - Hassan Rivaz
- Concordia University, Gina Cody School of Engineering and Computer Science, 1455 De Maisonneuve Blvd. W., Montreal, H3g 1M8, Quebec, Canada
| | - Marta Kersten-Oertel
- Concordia University, Gina Cody School of Engineering and Computer Science, 1455 De Maisonneuve Blvd. W., Montreal, H3g 1M8, Quebec, Canada
| |
Collapse
|
3
|
Zhang Y, Joshi J, Hadi M. AI in Acute Cerebrovascular Disorders: What can the Radiologist Contribute? Semin Roentgenol 2024; 59:137-147. [PMID: 38880512 DOI: 10.1053/j.ro.2024.01.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Revised: 01/13/2024] [Accepted: 01/27/2024] [Indexed: 06/18/2024]
Affiliation(s)
- Yi Zhang
- Department of Radiology, University of Louisville, 530 South Jackson Street, CCB-C07, Louisville, KY
| | - Jonathan Joshi
- Department of Radiology, University of Louisville, 530 South Jackson Street, CCB-C07, Louisville, KY
| | - Mohiuddin Hadi
- Department of Radiology, University of Louisville, 530 South Jackson Street, CCB-C07, Louisville, KY.
| |
Collapse
|
4
|
Oura D, Gekka M, Sugimori H. The montage method improves the classification of suspected acute ischemic stroke using the convolution neural network and brain MRI. Radiol Phys Technol 2024; 17:297-305. [PMID: 37934345 DOI: 10.1007/s12194-023-00754-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 10/15/2023] [Accepted: 10/17/2023] [Indexed: 11/08/2023]
Abstract
This study investigated the usefulness of the montage method that combines four different magnetic resonance images into one images for automatic acute ischemic stroke (AIS) diagnosis with deep learning method. The montage image was consisted from diffusion weighted image (DWI), fluid attenuated inversion recovery (FLAIR), arterial spin labeling (ASL), and apparent diffusion coefficient (ASL). The montage method was compared with pseudo color map (pCM) which was consisted from FLAIR, ASL and ADC. 473 AIS patients were classified into four categories: mechanical thrombectomy, conservative therapy, hemorrhage, and other diseases. The results showed that the montage image significantly outperformed pCM in terms of accuracy (montage image = 0.76 ± 0.01, pCM = 0.54 ± 0.05) and the area under the curve (AUC) (montage image = 0.94 ± 0.01, pCM = 0.76 ± 0.01). This study demonstrates the usefulness of the montage method and its potential for overcoming the limitations of pCM.
Collapse
Affiliation(s)
- Daisuke Oura
- Department of Radiology, Otaru General Hospital, Otaru, 047-0152, Japan
- Graduate School of Health Sciences, Hokkaido University, Sapporo, 060-0812, Japan
| | - Masayuki Gekka
- Department of Neurosurgery, Otaru General Hospital, Otaru, 047-0152, Japan
| | - Hiroyuki Sugimori
- Faculty of Health Sciences, Hokkaido University, Sapporo, 060-0812, Japan.
| |
Collapse
|
5
|
Koska IO, Selver A. Artificial Intelligence in Stroke Imaging: A Comprehensive Review. Eurasian J Med 2023; 55:91-97. [PMID: 39109827 PMCID: PMC11075039 DOI: 10.5152/eurasianjmed.2023.23347] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Accepted: 12/25/2023] [Indexed: 08/11/2024] Open
Abstract
The aging population challenges the health-care system with chronic diseases. Cerebrovascular diseases are important components of these chronic conditions. Stroke is the acute cessation of blood in the brain, which can lead to rapid tissue loss. Therefore, fast, accurate, and reliable automatic methods are required to facilitate stroke management. The performance of artificial intelligence (AI) methods is increasing in all domains. Vision tasks, including natural images and medical images, are particularly benefiting from the skills of AI models. The AI methods that can be applied to stroke imaging have a broad range, including classical machine learning tools such as support vector machines, random forests, logistic regression, and linear discriminant analysis, as well as deep learning models, such as convolutional neural networks, recurrent neural networks, autoencoders, and U-Net. Both tools can be applied to various aspects of stroke management, including time-to-event onset determination, stroke confirmation, large vessel occlusion detection, difusion restriction, perfusion deficit, core and penumbra identification, afected region segmentation, and functional outcome prediction. While building these AI models, maximum care should be exercised in order to reduce bias and build generalizable models. One of the most important prerequisites for building unbiased models is collecting large, diverse, and quality data that reflects the underlying population well and splitting the training and testing parts in a way that both represent a similar distribution. Explainability and trustworthiness are other important properties of machine learning models that could be widely adopted in clinical practices.
Collapse
Affiliation(s)
- Ilker Ozgur Koska
- Department of Radiology, Behçet Uz Children’s Hospital, İzmir, Turkey
- Department of Advanced Biomedical Technologies, Dokuz Eylül University, İzmir, Turkey
| | - Alper Selver
- İzmir Health Technologies Development and Accelerator (BioIzmir), Dokuz Eylül University, İzmir, Turkey
- Department of Electrical and Electronics Engineering, Dokuz Eylül University, İzmir, Turkey
| |
Collapse
|
6
|
Wu M, Cui G, Lv S, Chen L, Tian Z, Yang M, Bai W. Deep convolutional neural networks for multiple histologic types of ovarian tumors classification in ultrasound images. Front Oncol 2023; 13:1154200. [PMID: 37427129 PMCID: PMC10326903 DOI: 10.3389/fonc.2023.1154200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Accepted: 06/12/2023] [Indexed: 07/11/2023] Open
Abstract
Objective This study aimed to evaluate and validate the performance of deep convolutional neural networks when discriminating different histologic types of ovarian tumor in ultrasound (US) images. Material and methods Our retrospective study took 1142 US images from 328 patients from January 2019 to June 2021. Two tasks were proposed based on US images. Task 1 was to classify benign and high-grade serous carcinoma in original ovarian tumor US images, in which benign ovarian tumor was divided into six classes: mature cystic teratoma, endometriotic cyst, serous cystadenoma, granulosa-theca cell tumor, mucinous cystadenoma and simple cyst. The US images in task 2 were segmented. Deep convolutional neural networks (DCNN) were applied to classify different types of ovarian tumors in detail. We used transfer learning on six pre-trained DCNNs: VGG16, GoogleNet, ResNet34, ResNext50, DensNet121 and DensNet201. Several metrics were adopted to assess the model performance: accuracy, sensitivity, specificity, FI-score and the area under the receiver operating characteristic curve (AUC). Results The DCNN performed better in labeled US images than in original US images. The best predictive performance came from the ResNext50 model. The model had an overall accuracy of 0.952 for in directly classifying the seven histologic types of ovarian tumors. It achieved a sensitivity of 90% and a specificity of 99.2% for high-grade serous carcinoma, and a sensitivity of over 90% and a specificity of over 95% in most benign pathological categories. Conclusion DCNN is a promising technique for classifying different histologic types of ovarian tumors in US images, and provide valuable computer-aided information.
Collapse
Affiliation(s)
- Meijing Wu
- The Department of Gynecology and Obstetrics, Beijing Shijitan Hospital, Capital Medical University, Beijing, China
| | - Guangxia Cui
- The Department of Gynecology and Obstetrics, Beijing Shijitan Hospital, Capital Medical University, Beijing, China
| | - Shuchang Lv
- The Department of Electronics and Information Engineering, Beihang University, Beijing, China
| | - Lijiang Chen
- The Department of Electronics and Information Engineering, Beihang University, Beijing, China
| | - Zongmei Tian
- The Department of Gynecology and Obstetrics, Beijing Shijitan Hospital, Capital Medical University, Beijing, China
| | - Min Yang
- The Department of Gynecology and Obstetrics, Beijing Shijitan Hospital, Capital Medical University, Beijing, China
| | - Wenpei Bai
- The Department of Gynecology and Obstetrics, Beijing Shijitan Hospital, Capital Medical University, Beijing, China
| |
Collapse
|
7
|
Wu Y, Sun R, Xie Y, Nie S. Automatic Alberta Stroke Program Early Computed Tomographic Scoring in patients with acute ischemic stroke using diffusion-weighted imaging. Med Biol Eng Comput 2023:10.1007/s11517-023-02867-2. [PMID: 37347402 DOI: 10.1007/s11517-023-02867-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Accepted: 06/08/2023] [Indexed: 06/23/2023]
Abstract
Alberta Stroke Program Early Computed Tomographic Scoring (ASPECTS) is a reliable method for assessing early ischemic changes in the blood supply area of the middle cerebral artery in patients with acute ischemic stroke. This study aims to propose a deep learning based automatic evaluation strategy for DWI-ASPECTS to serve as a reference for clinicians in urgent decision making for endovascular thrombectomy. Ten ASPECTS regions are extracted from the DWI series to train the independent classification network for each region, the accurate training labels of which are confirmed by neuroradiologists. Two classical convolutional neural networks (VGG-16 and ResNet-50) are validated. Subsequently, the innovative CBAM-VGG is designed to improve the accurate scoring of four small-volume DWI-ASPECTS regions, including caudate nucleus, lenticular nucleus, internal capsule, and insular lobe. Average F1-score of 0.929 and 0.840 and the average accuracy of 94.75% and 84.99% are obtained when scoring on six cortical regions M1-M6 and four small ASPECTS regions, respectively. In addition, the modified algorithm CBAM-VGG shows a significant improvement in the accuracy of estimating the four ASPECTS regions with smaller volumes. The experimental results demonstrate that the deep learning methods facilitate the efficiency and robustness of automatic DWI-ASPECTS scoring, which can provide a reference for clinical decision-making.
Collapse
Affiliation(s)
- Yan Wu
- School of Health Science and Engineering, University of Shanghai for Science and Technology, No. 516 Jun-Gong Road, Shanghai, 200093, China
| | - Rong Sun
- School of Health Science and Engineering, University of Shanghai for Science and Technology, No. 516 Jun-Gong Road, Shanghai, 200093, China
| | - Yuanzhong Xie
- Medical Imaging Center, Tai'an Central Hospital, Shandong, China
| | - Shengdong Nie
- School of Health Science and Engineering, University of Shanghai for Science and Technology, No. 516 Jun-Gong Road, Shanghai, 200093, China.
| |
Collapse
|
8
|
Lin SY, Chiang PL, Chen MH, Lee MY, Lin WC, Chen YS. DGA3-Net: A parameter-efficient deep learning model for ASPECTS assessment for acute ischemic stroke using non-contrast computed tomography. Neuroimage Clin 2023; 38:103441. [PMID: 37224605 PMCID: PMC10225927 DOI: 10.1016/j.nicl.2023.103441] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2023] [Revised: 05/15/2023] [Accepted: 05/16/2023] [Indexed: 05/26/2023]
Abstract
Detecting the early signs of stroke using non-contrast computerized tomography (NCCT) is essential for the diagnosis of acute ischemic stroke (AIS). However, the hypoattenuation in NCCT is difficult to precisely identify, and accurate assessments of the Alberta Stroke Program Early CT Score (ASPECTS) are usually time-consuming and require experienced neuroradiologists. To this end, this study proposes DGA3-Net, a convolutional neural network (CNN)-based model for ASPECTS assessment via detecting early ischemic changes in ASPECTS regions. DGA3-Net is based on a novel parameter-efficient dihedral group CNN encoder to exploit the rotation and reflection symmetry of convolution kernels. The bounding volume of each ASPECTS region is extracted from the encoded feature, and an attention-guided slice aggregation module is used to aggregate features from all slices. An asymmetry-aware classifier is then used to predict stroke presence via comparison between ASPECTS regions from the left and right hemispheres. Pre-treatment NCCTs of suspected AIS patients were collected retrospectively, which consists of a primary dataset (n = 170) and an external validation dataset (n = 90), with expert consensus ASPECTS readings as ground truth. DGA3-Net outperformed two expert neuroradiologists in regional stroke identification (F1 = 0.69) and ASPECTS evaluation (Cohen's weighted Kappa = 0.70). Our ablation study also validated the efficacy of the proposed model design. In addition, class-relevant areas highlighted by visualization techniques corresponded highly with various well-established qualitative imaging signs, further validating the learned representation. This study demonstrates the potential of deep learning techniques for timely and accurate AIS diagnosis from NCCT, which could substantially improve the quality of treatment for AIS patients.
Collapse
Affiliation(s)
- Shih-Yen Lin
- Department of Computer Science, National Yang Ming Chiao Tung University, Hsinchu, Taiwan; Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA.
| | - Pi-Ling Chiang
- Department of Diagnostic Radiology, Kaohsiung Chang Gung Memorial Hospital, and Chang Gung University College of Medicine, Kaohsiung, Taiwan.
| | - Meng-Hsiang Chen
- Department of Diagnostic Radiology, Kaohsiung Chang Gung Memorial Hospital, and Chang Gung University College of Medicine, Kaohsiung, Taiwan.
| | - Meng-Yang Lee
- Institute of Biomedical Engineering, National Yang Ming Chiao Tung University, Hsinchu, Taiwan
| | - Wei-Che Lin
- Department of Diagnostic Radiology, Kaohsiung Chang Gung Memorial Hospital, and Chang Gung University College of Medicine, Kaohsiung, Taiwan.
| | - Yong-Sheng Chen
- Department of Computer Science, National Yang Ming Chiao Tung University, Hsinchu, Taiwan.
| |
Collapse
|
9
|
Aktar M, Reyes J, Tampieri D, Rivaz H, Xiao Y, Kersten-Oertel M. Deep learning for collateral evaluation in ischemic stroke with imbalanced data. Int J Comput Assist Radiol Surg 2023; 18:733-740. [PMID: 36635594 DOI: 10.1007/s11548-022-02826-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Accepted: 12/22/2022] [Indexed: 01/14/2023]
Abstract
PURPOSE Collateral evaluation is typically done using visual inspection of cerebral images and thus suffers from intra- and inter-rater variability. Large open databases of ischemic stroke patients are rare, limiting the use of deep learning methods in treatment decision-making. METHODS We adapted a pre-trained EfficientNet B0 network through transfer learning to improve collateral evaluation using slice-based and subject-level classification. Our method uses stacking and overlapping of 2D slices from a patient's 4D computed tomography angiography (CTA) and a majority voting scheme to determine a patient's final collateral grade based on all classified 2D MIPs. Class imbalance is handled in the evaluation process by using the focal loss with class weight to penalize the majority class. RESULTS We evaluated our method using a nine-fold cross-validation performed with 83 subjects. Mean sensitivity of 0.71, specificity of 0.84, and a weighted F1 score of 0.71 in multi-class (good, intermediate, and poor) classification were obtained. Considering treatment effect, a dichotomized decision is also made for collateral scoring of a subject based on two classes (good/intermediate and poor) which achieves a sensitivity of 0.89 and specificity of 0.96 with a weighted F1 score of 0.95. CONCLUSION An automatic and robust collateral assessment method that mitigates the issues with the small imbalanced dataset was developed. Computer-aided evaluation of collaterals can help decision-making of ischemic stroke treatment strategy in clinical settings.
Collapse
Affiliation(s)
- Mumu Aktar
- Computer Science and Software Engineering, Concordia University, 1455 boul. De Maisonneuve O., Montreal, QC, H3G 1M8, Canada.
| | - Jonatan Reyes
- Computer Science and Software Engineering, Concordia University, 1455 boul. De Maisonneuve O., Montreal, QC, H3G 1M8, Canada
| | - Donatella Tampieri
- Department of Diagnostic Radiology, Kingston Health Sciences Centre, Kingston General Hospital, Kingston, ON, K7L 2V7, Canada
| | - Hassan Rivaz
- Electrical and Computer Engineering, Concordia University, 1455 boul. De Maisonneuve O., Montreal, QC, H3G 1M8, Canada
| | - Yiming Xiao
- Computer Science and Software Engineering, Concordia University, 1455 boul. De Maisonneuve O., Montreal, QC, H3G 1M8, Canada
| | - Marta Kersten-Oertel
- Computer Science and Software Engineering, Concordia University, 1455 boul. De Maisonneuve O., Montreal, QC, H3G 1M8, Canada
| |
Collapse
|
10
|
Krishnamoorthy S, Paulraj S, Selvaraj NP, Ragupathy B, Arumugam S. A novel approach for neural networks based diagnosis and grading of stroke in tumor-affected brain MRIs. NETWORK (BRISTOL, ENGLAND) 2023; 34:190-220. [PMID: 37352128 DOI: 10.1080/0954898x.2023.2225601] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Revised: 04/28/2023] [Accepted: 06/11/2023] [Indexed: 06/25/2023]
Abstract
Recognition and diagnosis of stroke from magnetic resonance Image (MRIs) are significant for medical procedures in therapeutic standards. The primary goal of this scheme is the discovery of stroke in tumour locale in brain tissues influenced image. The probability of stroke is categorized on brain tumour influenced images into mild, moderate, or serious cases. The mild and moderate phases of stroke are recognized as "Ahead of schedule" findings and serious cases are distinguished as "Advance" determination. The proposed Glioblastoma brain tumour recognition strategy used the Multifaceted Brain Tumour Image Segmentation test open-access dataset for evaluating the presentation. The brain images are classified utilizing the Deep Neural Networks classification algorithm as normal and abnormal images. The tumour region is segmented from the identified set of abnormal images using the normalized graph cut algorithm. The stroke likelihood is identified using the Deep Neural Networks by analysing the proximity of tumour section in brain matters. The proposed stroke analysis framework accurately groups 10 images as "Right on time" stroke probability images and accomplishes 90% order rate. The proposed stroke prediction framework effectively characterizes images as "Advance" stroke probability images and accomplishes 90% characterization rate.
Collapse
Affiliation(s)
| | - Sivakumar Paulraj
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, Tamil Nadu, India
| | - Nagendra Prabhu Selvaraj
- Department of Computational Intelligence, SRM Institute of Science and Technology, Chennai, Tamil Nadu, India
| | - Balakumaresan Ragupathy
- Department of Electronics and Communication Engineering, PSNA College of Engineering and Technology, Dindigul, Tamil Nadu, India
| | - Selvapandian Arumugam
- Department of Electronics and Communication Engineering, PSNA College of Engineering and Technology, Dindigul, Tamil Nadu, India
| |
Collapse
|
11
|
Chaki J, Woźniak M. Deep learning for neurodegenerative disorder (2016 to 2022): A systematic review. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104223] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
12
|
Lee KY, Liu CC, Chen DYT, Weng CL, Chiu HW, Chiang CH. Automatic detection and vascular territory classification of hyperacute staged ischemic stroke on diffusion weighted image using convolutional neural networks. Sci Rep 2023; 13:404. [PMID: 36624122 PMCID: PMC9829896 DOI: 10.1038/s41598-023-27621-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Accepted: 01/04/2023] [Indexed: 01/11/2023] Open
Abstract
Automated ischemic stroke detection and classification according to its vascular territory is an essential step in stroke image evaluation, especially at hyperacute stage where mechanical thrombectomy may improve patients' outcome. This study aimed to evaluate the performance of various convolutional neural network (CNN) models on hyperacute staged diffusion-weighted images (DWI) for detection of ischemic stroke and classification into anterior circulation infarct (ACI), posterior circulation infarct (PCI) and normal image slices. In this retrospective study, 253 cases of hyperacute staged DWI were identified, downloaded and reviewed. After exclusion, DWI from 127 cases were used and we created a dataset containing total of 2119 image slices, and separates it into three groups, namely ACI (618 slices), PCI (149 slices) and normal (1352 slices). Two transfer learning based CNN models, namely Inception-v3, EfficientNet-b0 and one self-derived modified LeNet model were used. The performance of the models was evaluated and activation maps using gradient-weighted class activation mapping (Grad-Cam) technique were made. Inception-v3 had the best overall accuracy (86.3%), weighted F1 score (86.2%) and kappa score (0.715), followed by the modified LeNet (85.2% accuracy, 84.7% weighted F1 score and 0.693 kappa score). The EfficientNet-b0 had the poorest performance of 83.6% accuracy, 83% weighted F1 score and 0.662 kappa score. The activation map showed that one possible explanation for misclassification is due to susceptibility artifact. A sufficiently high performance can be achieved by using CNN model to detect ischemic stroke on hyperacute staged DWI and classify it according to vascular territory.
Collapse
Affiliation(s)
- Kun-Yu Lee
- grid.412955.e0000 0004 0419 7197Department of Medical Image, Shuang Ho Hospital, Taipei Medical University, No. 291, Zhongzheng Road, Zhonghe District, New Taipei City, 23561 Taiwan, ROC ,grid.412896.00000 0000 9337 0481Department of Radiology, School of Medicine, College of Medicine, Taipei Medical University, No. 250 Wu-Hsing Street, Taipei City, 11031 Taiwan, ROC
| | - Chia-Chuan Liu
- grid.412955.e0000 0004 0419 7197Department of Medical Image, Shuang Ho Hospital, Taipei Medical University, No. 291, Zhongzheng Road, Zhonghe District, New Taipei City, 23561 Taiwan, ROC ,grid.412896.00000 0000 9337 0481Department of Radiology, School of Medicine, College of Medicine, Taipei Medical University, No. 250 Wu-Hsing Street, Taipei City, 11031 Taiwan, ROC
| | - David Yen-Ting Chen
- grid.412955.e0000 0004 0419 7197Department of Medical Image, Shuang Ho Hospital, Taipei Medical University, No. 291, Zhongzheng Road, Zhonghe District, New Taipei City, 23561 Taiwan, ROC ,grid.412896.00000 0000 9337 0481Department of Radiology, School of Medicine, College of Medicine, Taipei Medical University, No. 250 Wu-Hsing Street, Taipei City, 11031 Taiwan, ROC
| | - Chi-Lun Weng
- grid.413878.10000 0004 0572 9327Department of Radiology, Ditmanson Medical Foundation Chia-Yi Christian Hospital, No. 539, Zhongxiao Rd., East Dist., Chiayi City, 600566 Taiwan, ROC
| | - Hung-Wen Chiu
- grid.412896.00000 0000 9337 0481Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University TW, No. 250 Wu-Hsing Street, Taipei City, 11031 Taiwan, ROC
| | - Chen-Hua Chiang
- Department of Medical Image, Shuang Ho Hospital, Taipei Medical University, No. 291, Zhongzheng Road, Zhonghe District, New Taipei City, 23561, Taiwan, ROC. .,Department of Radiology, School of Medicine, College of Medicine, Taipei Medical University, No. 250 Wu-Hsing Street, Taipei City, 11031, Taiwan, ROC.
| |
Collapse
|
13
|
Do LN, Lee HJ, Im C, Park JH, Lim HS, Park I. Predicting Underestimation of Invasive Cancer in Patients with Core-Needle-Biopsy-Diagnosed Ductal Carcinoma In Situ Using Deep Learning Algorithms. Tomography 2022; 9:1-11. [PMID: 36648988 PMCID: PMC9844271 DOI: 10.3390/tomography9010001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2022] [Revised: 12/13/2022] [Accepted: 12/16/2022] [Indexed: 12/24/2022] Open
Abstract
The prediction of an occult invasive component in ductal carcinoma in situ (DCIS) before surgery is of clinical importance because the treatment strategies are different between pure DCIS without invasive component and upgraded DCIS. We demonstrated the potential of using deep learning models for differentiating between upgraded versus pure DCIS in DCIS diagnosed by core-needle biopsy. Preoperative axial dynamic contrast-enhanced magnetic resonance imaging (MRI) data from 352 lesions were used to train, validate, and test three different types of deep learning models. The highest performance was achieved by Recurrent Residual Convolutional Neural Network using Regions of Interest (ROIs) with an accuracy of 75.0% and area under the receiver operating characteristic curve (AUC) of 0.796. Our results suggest that the deep learning approach may provide an assisting tool to predict the histologic upgrade of DCIS and provide personalized treatment strategies to patients with underestimated invasive disease.
Collapse
Affiliation(s)
- Luu-Ngoc Do
- Department of Radiology, Chonnam National University, 42 Jebong-ro, Dong-gu, Gwangju 61469, Republic of Korea
| | - Hyo-Jae Lee
- Department of Radiology, Chonnam National University Hospital, 42 Jebong-ro, Dong-gu, Gwangju 61469, Republic of Korea
| | - Chaeyeong Im
- Department of Medicine, Chonnam National University, Gwangju 61469, Republic of Korea
| | - Jae Hyeok Park
- Department of Medicine, Chonnam National University, Gwangju 61469, Republic of Korea
| | - Hyo Soon Lim
- Department of Radiology, Chonnam National University, 42 Jebong-ro, Dong-gu, Gwangju 61469, Republic of Korea
- Department of Radiology, Chonnam National University Hwasun Hospital, Gwangju 58128, Republic of Korea
- Correspondence: (H.S.L.); (I.P.)
| | - Ilwoo Park
- Department of Radiology, Chonnam National University, 42 Jebong-ro, Dong-gu, Gwangju 61469, Republic of Korea
- Department of Radiology, Chonnam National University Hospital, 42 Jebong-ro, Dong-gu, Gwangju 61469, Republic of Korea
- Department of Artificial Intelligence Convergence, Chonnam National University, Gwangju 61186, Republic of Korea
- Department of Data Science, Chonnam National University, Gwangju 61186, Republic of Korea
- Correspondence: (H.S.L.); (I.P.)
| |
Collapse
|
14
|
Cui L, Fan Z, Yang Y, Liu R, Wang D, Feng Y, Lu J, Fan Y. Deep Learning in Ischemic Stroke Imaging Analysis: A Comprehensive Review. BIOMED RESEARCH INTERNATIONAL 2022; 2022:2456550. [PMID: 36420096 PMCID: PMC9678444 DOI: 10.1155/2022/2456550] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Revised: 09/27/2022] [Accepted: 10/20/2022] [Indexed: 09/15/2023]
Abstract
Ischemic stroke is a cerebrovascular disease with a high morbidity and mortality rate, which poses a serious challenge to human health and life. Meanwhile, the management of ischemic stroke remains highly dependent on manual visual analysis of noncontrast computed tomography (CT) or magnetic resonance imaging (MRI). However, artifacts and noise of the equipment as well as the radiologist experience play a significant role on diagnostic accuracy. To overcome these defects, the number of computer-aided diagnostic (CAD) methods for ischemic stroke is increasing substantially during the past decade. Particularly, deep learning models with massive data learning capabilities are recognized as powerful auxiliary tools for the acute intervention and guiding prognosis of ischemic stroke. To select appropriate interventions, facilitate clinical practice, and improve the clinical outcomes of patients, this review firstly surveys the current state-of-the-art deep learning technology. Then, we summarized the major applications in acute ischemic stroke imaging, particularly in exploring the potential function of stroke diagnosis and multimodal prognostication. Finally, we sketched out the current problems and prospects.
Collapse
Affiliation(s)
- Liyuan Cui
- School of Medical Imaging, Hangzhou Medical College, Hangzhou, Zhejiang, China
| | - Zhiyuan Fan
- Centre of Intelligent Medical Technology and Equipment, Binjiang Institute of Zhejiang University, Hangzhou, Zhejiang, China
| | - Yingjian Yang
- School of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China
| | - Rui Liu
- School of Medical Imaging, Hangzhou Medical College, Hangzhou, Zhejiang, China
| | - Dajiang Wang
- School of Medical Imaging, Hangzhou Medical College, Hangzhou, Zhejiang, China
| | - Yingying Feng
- School of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China
| | - Jiahui Lu
- School of Medical Imaging, Hangzhou Medical College, Hangzhou, Zhejiang, China
| | - Yifeng Fan
- School of Medical Imaging, Hangzhou Medical College, Hangzhou, Zhejiang, China
| |
Collapse
|
15
|
Chen S, Duan J, Wang H, Wang R, Li J, Qi M, Duan Y, Qi S. Automatic detection of stroke lesion from diffusion-weighted imaging via the improved YOLOv5. Comput Biol Med 2022; 150:106120. [PMID: 36179511 DOI: 10.1016/j.compbiomed.2022.106120] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2022] [Revised: 08/31/2022] [Accepted: 09/17/2022] [Indexed: 11/30/2022]
Abstract
BACKGROUND AND OBJECTIVE Stroke is the second most deadly disease globally and seriously endangers people's lives and health. The automatic detection of stroke lesions from diffusion-weighted imaging (DWI) can improve the diagnosis. Recently, automatic detection methods based on YOLOv5 have been utilized in medical images. However, most of them barely capture the stroke lesions because of their small size and fuzzy boundaries. METHODS To address this problem, a novel method for tracing the edge of the stroke lesion based on YOLOv5 (TE-YOLOv5) is proposed. Specifically, we constantly update the high-level features of the lesion using an aggregate pool (AP) module. Conversely, we feed the extracted feature into the reverse attention (RA) module to trace the edge relationship promptly. Overall, 1681 DWI images of 319 stroke patients have been collected, and experienced radiologists have marked the lesions. DWI images were randomly split into the training and test set at a ratio of 8:2. TE-YOLOv5 has been compared with the related models, and a detailed ablation analysis has been conducted to clarify the role of the RA and AP modules. RESULTS TE-YOLOv5 outperforms its counterparts and achieves competitive performance with a precision of 81.5%, a recall of 75.8%, and a mAP@0.5 of 80.7% (mean average precision while the intersection over union is 0.5) under the same backbone. At the patient level, the positive finding rate can reach 98.51%, while the confidence is set at 80.0%. After ablating RA, the mAP@0.5 decreases to 79.6%; after ablating RA and AP, the mAP@0.5 decreases to 78.1%. CONCLUSIONS The proposed TE-YOLOv5 can automatically and effectively detect stroke lesions from DWI images, especially for those with an extremely small size and blurred boundaries. AP and RA modules can aggregate multi-layer high-level features and concurrently track the edge relationship of stroke lesions. These detection methods might help radiologists improve stroke diagnosis and have great application potential in clinical practice.
Collapse
Affiliation(s)
- Shannan Chen
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China; Key Lab of Advanced Design and Intelligent Computing, Ministry of Education, Dalian University, Dalian, China.
| | - Jinfeng Duan
- Department of General Surgery, General Hospital of Northern Theater Command, Shenyang, China.
| | - Hong Wang
- Department of Radiology, General Hospital of Northern Theater Command, Shenyang, China.
| | - Rongqiang Wang
- Department of Radiology, General Hospital of Northern Theater Command, Shenyang, China.
| | - Jinze Li
- Department of Radiology, General Hospital of Northern Theater Command, Shenyang, China.
| | - Miao Qi
- Department of Radiology, General Hospital of Northern Theater Command, Shenyang, China.
| | - Yang Duan
- Department of Radiology, General Hospital of Northern Theater Command, Shenyang, China.
| | - Shouliang Qi
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, China.
| |
Collapse
|
16
|
Chavva IR, Crawford AL, Mazurek MH, Yuen MM, Prabhat AM, Payabvash S, Sze G, Falcone GJ, Matouk CC, de Havenon A, Kim JA, Sharma R, Schiff SJ, Rosen MS, Kalpathy-Cramer J, Iglesias Gonzalez JE, Kimberly WT, Sheth KN. Deep Learning Applications for Acute Stroke Management. Ann Neurol 2022; 92:574-587. [PMID: 35689531 DOI: 10.1002/ana.26435] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Revised: 05/27/2022] [Accepted: 06/04/2022] [Indexed: 11/08/2022]
Abstract
Brain imaging is essential to the clinical care of patients with stroke, a leading cause of disability and death worldwide. Whereas advanced neuroimaging techniques offer opportunities for aiding acute stroke management, several factors, including time delays, inter-clinician variability, and lack of systemic conglomeration of clinical information, hinder their maximal utility. Recent advances in deep machine learning (DL) offer new strategies for harnessing computational medical image analysis to inform decision making in acute stroke. We examine the current state of the field for DL models in stroke triage. First, we provide a brief, clinical practice-focused primer on DL. Next, we examine real-world examples of DL applications in pixel-wise labeling, volumetric lesion segmentation, stroke detection, and prediction of tissue fate postintervention. We evaluate recent deployments of deep neural networks and their ability to automatically select relevant clinical features for acute decision making, reduce inter-rater variability, and boost reliability in rapid neuroimaging assessments, and integrate neuroimaging with electronic medical record (EMR) data in order to support clinicians in routine and triage stroke management. Ultimately, we aim to provide a framework for critically evaluating existing automated approaches, thus equipping clinicians with the ability to understand and potentially apply DL approaches in order to address challenges in clinical practice. ANN NEUROL 2022.
Collapse
Affiliation(s)
- Isha R Chavva
- Department of Neurology, Yale School of Medicine, New Haven, CT
| | - Anna L Crawford
- Department of Neurology, Yale School of Medicine, New Haven, CT
| | - Mercy H Mazurek
- Department of Neurology, Yale School of Medicine, New Haven, CT
| | - Matthew M Yuen
- Department of Neurology, Yale School of Medicine, New Haven, CT
| | | | - Sam Payabvash
- Department of Radiology, Yale School of Medicine, New Haven, CT
| | - Gordon Sze
- Department of Radiology, Yale School of Medicine, New Haven, CT
| | - Guido J Falcone
- Department of Neurology, Yale School of Medicine, New Haven, CT
| | - Charles C Matouk
- Department of Neurosurgery, Yale School of Medicine, New Haven, CT
| | - Adam de Havenon
- Department of Neurology, Yale School of Medicine, New Haven, CT
| | - Jennifer A Kim
- Department of Neurology, Yale School of Medicine, New Haven, CT
| | - Richa Sharma
- Department of Neurology, Yale School of Medicine, New Haven, CT
| | - Steven J Schiff
- Departments of Neurosurgery, Engineering Science and Mechanics and Physics, Penn State University, University Park, PA
| | - Matthew S Rosen
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA
| | - Jayashree Kalpathy-Cramer
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA
| | - Juan E Iglesias Gonzalez
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA
| | - W Taylor Kimberly
- Department of Neurology, Division of Neurocritical Care, Massachusetts General Hospital, Boston, MA
| | - Kevin N Sheth
- Department of Neurology, Yale School of Medicine, New Haven, CT
| |
Collapse
|
17
|
Zhu G, Chen H, Jiang B, Chen F, Xie Y, Wintermark M. Application of Deep Learning to Ischemic and Hemorrhagic Stroke Computed Tomography and Magnetic Resonance Imaging. Semin Ultrasound CT MR 2022; 43:147-152. [PMID: 35339255 DOI: 10.1053/j.sult.2022.02.004] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Deep Learning (DL) algorithm holds great potential in the field of stroke imaging. It has been applied not only to the "downstream" side such as lesion detection, treatment decision making, and outcome prediction, but also to the "upstream" side for generation and enhancement of stroke imaging. This paper aims to comprehensively overview the common applications of DL to stroke imaging. In the future, more standardized imaging datasets and more extensive studies are needed to establish and validate the role of DL in stroke imaging.
Collapse
Affiliation(s)
- Guangming Zhu
- Department of Radiology, Neuroradiology Section, Stanford University School of Medicine, Stanford, CA
| | - Hui Chen
- Department of Radiology, Neuroradiology Section, Stanford University School of Medicine, Stanford, CA
| | - Bin Jiang
- Department of Radiology, Neuroradiology Section, Stanford University School of Medicine, Stanford, CA
| | - Fei Chen
- Department of Neurology, Xuan Wu hospital, Capital Meidcal University, Beijing, China
| | - Yuan Xie
- Subtle Medical Inc, Menlo Park, CA
| | - Max Wintermark
- Department of Radiology, Neuroradiology Section, Stanford University School of Medicine, Stanford, CA.
| |
Collapse
|
18
|
Foundations of Lesion Detection Using Machine Learning in Clinical Neuroimaging. ACTA NEUROCHIRURGICA. SUPPLEMENT 2021; 134:171-182. [PMID: 34862541 DOI: 10.1007/978-3-030-85292-4_21] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
This chapter describes technical considerations and current and future clinical applications of lesion detection using machine learning in the clinical setting. Lesion detection is central to neuroradiology and precedes all further processes which include but are not limited to lesion characterization, quantification, longitudinal disease assessment, prognosis, and prediction of treatment response. A number of machine learning algorithms focusing on lesion detection have been developed or are currently under development which may either support or extend the imaging process. Examples include machine learning applications in stroke, aneurysms, multiple sclerosis, neuro-oncology, neurodegeneration, and epilepsy.
Collapse
|