1
|
Jia XF, Chen YC, Zheng KK, Zhu DQ, Chen C, Liu J, Yang YJ, Li CT. Clinical-Radiomics Nomogram Model Based on CT Angiography for Prediction of Intracranial Aneurysm Rupture: A Multicenter Study. J Multidiscip Healthc 2024; 17:5917-5926. [PMID: 39678712 PMCID: PMC11645942 DOI: 10.2147/jmdh.s491697] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2024] [Accepted: 12/05/2024] [Indexed: 12/17/2024] Open
Abstract
Objective Risk estimation of intracranial aneurysm rupture is critical in determining treatment strategy. There is a scarcity of multicenter studies on the predictive power of clinical-radiomics models for aneurysm rupture. This study aims to develop a clinical-radiomics model and explore its additional value in the discrimination of aneurysm rupture. Methods A total of 516 aneurysms, including 273 (52.9%) with ruptured aneurysms, were retrospectively enrolled from four hospitals between January 2019 and August 2020. Relevant clinical features were collected, and radiomic characteristics associated with aneurysm were extracted. Subsequently, three models, including a clinical model, a radiomics model, and a clinical-radiomics model were constructed using multivariate logistic regression analysis to effectively classify aneurysm rupture. The performance of models was analyzed through operating characteristic curves, decision curve, and calibration curves analysis. Different models' comparison used DeLong tests. To offer an understandable and intuitive scoring system for assessing rupture risk, we developed a comprehensive nomogram based on the developed model. Results Three clinical risk factors and fourteen radiomics features were explored to establish three models. The area under the receiver operating curve (AUC) for the radiomics model was 0.775 (95% CI,0.719-0.830), 0.752 (95% CI,0.663-0.841), 0.747 (95% CI,0.658-0.835) in the training, internal and external test datasets, respectively. The AUC for clinical model was 0.802 (95% CI, 0.749-0.854), 0.736 (95% CI, 0.644-0.828), 0.789 (95% CI, 0.709-0.870) in these three sets, respectively. The clinical-radiomics model showed an AUC of 0.880 (95% CI,0.840-0.920), 0.807 (95% CI,0.728-0.887), 0.815 (95% CI,0.740-0.891) in three datasets respectively. Compared with the radiomics and clinical models, the clinical-radiomics model demonstrated better diagnostic performance (DeLong' test P < 0.05). Conclusion The clinical-radiomics model represents a promising approach for predicting rupture of intracranial aneurysms.
Collapse
Affiliation(s)
- Xiu-Fen Jia
- Department of Radiology, Shandong Provincial Hospital, Shandong University, Jinan, 250021, People’s Republic of China
- Department of Radiology, First Affiliated Hospital of Wenzhou Medical University, Wenzhou, 325000, People’s Republic of China
| | - Yong-Chun Chen
- Department of Radiology, First Affiliated Hospital of Wenzhou Medical University, Wenzhou, 325000, People’s Republic of China
| | - Kui-Kui Zheng
- Department of Radiology, First Affiliated Hospital of Wenzhou Medical University, Wenzhou, 325000, People’s Republic of China
| | - Dong-Qin Zhu
- Department of Radiology, First Affiliated Hospital of Wenzhou Medical University, Wenzhou, 325000, People’s Republic of China
| | - Chao Chen
- Department of Radiology, First Affiliated Hospital of Wenzhou Medical University, Wenzhou, 325000, People’s Republic of China
| | - Jinjin Liu
- Department of Radiology, First Affiliated Hospital of Wenzhou Medical University, Wenzhou, 325000, People’s Republic of China
| | - Yun-Jun Yang
- Department of Radiology, First Affiliated Hospital of Wenzhou Medical University, Wenzhou, 325000, People’s Republic of China
| | - Chuan-Ting Li
- Department of Radiology, Shandong Provincial Hospital, Shandong University, Jinan, 250021, People’s Republic of China
| |
Collapse
|
2
|
Wang H, Xu H, Fan J, Liu J, Li L, Kong Z, Zhao H. Predictive value of radiomics for intracranial aneurysm rupture: a systematic review and meta-analysis. Front Neurosci 2024; 18:1474780. [PMID: 39445076 PMCID: PMC11496283 DOI: 10.3389/fnins.2024.1474780] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2024] [Accepted: 09/23/2024] [Indexed: 10/25/2024] Open
Abstract
Objective To systematically review the literature on radiomics for predicting intracranial aneurysm rupture and conduct a meta-analysis to obtain evidence confirming the value of radiomics in this prediction. Methods A systematic literature search was conducted in PubMed, Web of Science, Embase, and The Cochrane Library databases up to March 2024. The QUADAS-2 tool was used to assess study quality. Stata 15.0 and Review Manager 5.4.1 were used for statistical analysis. Outcomes included combined sensitivity (Sen), specificity (Spe), positive likelihood ratio (+LR), negative likelihood ratio (-LR), diagnostic odds ratio (DOR), and their 95% confidence intervals (CI), as well as pre-test and post-test probabilities. The SROC curve was plotted, and the area under the curve (AUC) was calculated. Publication bias and small-study effects were assessed using the Deeks' funnel plot. Results The 9 included studies reported 4,284 patients, with 1,411 patients with intracranial aneurysm rupture (prevalence 32.9%). The overall performance of radiomics for predicting intracranial aneurysm rupture showed a combined Sen of 0.78 (95% CI: 0.74-0.82), Spe of 0.74 (95% CI: 0.70-0.78), +LR of 3.0 (95% CI: 2.7-3.4), -LR of 0.29 (95% CI: 0.25-0.35), DOR of 10 (95% CI: 9-12), and AUC of 0.83 (95% CI: 0.79-0.86). Significant heterogeneity was observed in both Sen (I2 = 90.93, 95% CI: 89.00-92.87%) and Spe (I2 = 94.28, 95% CI: 93.21-95.34%). Conclusion Radiomics can improve the diagnostic efficacy of intracranial aneurysm rupture. More large-sample, prospective, multicenter clinical studies are needed to further evaluate its predictive value. Systematic review registration https://www.crd.york.ac.uk/PROSPERO/.
Collapse
Affiliation(s)
- Haoda Wang
- Department of Radiology, The First Hospital of Huhhot, Huhhot, China
| | - Haidong Xu
- Department of Radiology, The First Hospital of Huhhot, Huhhot, China
| | - Junsheng Fan
- Department of Radiology, The First Hospital of Huhhot, Huhhot, China
| | - Jie Liu
- Department of Radiology, The First Hospital of Huhhot, Huhhot, China
| | - Liangfu Li
- Department of Radiology, The First Hospital of Huhhot, Huhhot, China
| | - Zailiang Kong
- Department of Radiology, The First Hospital of Huhhot, Huhhot, China
| | - Hui Zhao
- Department of Radiotherapy, Affiliated Hospital of Inner Mongolia Medical University, Huhhot, China
| |
Collapse
|
3
|
Sohrabi-Ashlaghi A, Azizi N, Abbastabar H, Shakiba M, Zebardast J, Firouznia K. Accuracy of radiomics-Based models in distinguishing between ruptured and unruptured intracranial aneurysms: A systematic review and meta-Analysis. Eur J Radiol 2024; 181:111739. [PMID: 39293240 DOI: 10.1016/j.ejrad.2024.111739] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2024] [Revised: 08/13/2024] [Accepted: 09/14/2024] [Indexed: 09/20/2024]
Abstract
INTRODUCTION Intracranial aneurysms (IAs) pose a severe health risk due to the potential for subarachnoid hemorrhage upon rupture. This study aims to conduct a systematic review and meta-analysis on the accuracy of radiomics features derived from computed tomography angiography (CTA) in differentiating ruptured from unruptured IAs. MATERIALS AND METHODS A systematic search was performed across multiple databases for articles published up to January 2024. Observational studies analyzing CTA using radiomics features were included. The area under the curve (AUC) for classifying ruptured vs. unruptured IAs was pooled using a random-effects model. Subgroup analyses were conducted based on the use of radiomics-only features versus radiomics plus additional image-based features, as well as the type of filters used for image processing. RESULTS Six studies with 4,408 patients were included. The overall pooled AUC for radiomics features in differentiating ruptured from unruptured IAs was 0.86 (95% CI: 0.84-0.88). The AUC was 0.85 (95% CI: 0.82-0.88) for studies using only radiomics features and 0.87 (95% CI: 0.83-0.91) for studies incorporating radiomics plus additional image-based features. Subgroup analysis based on filter type showed an AUC of 0.87 (95% CI: 0.83-0.90) for original filters and 0.86 (95% CI: 0.81-0.90) for studies using additional filters. CONCLUSION Radiomics-based models demonstrate very good diagnostic accuracy in classifying ruptured and unruptured IAs, with AUC values exceeding 0.8. This highlights the potential of radiomics as a useful tool in the non-invasive assessment of aneurysm rupture risk, particularly in the management of patients with multiple aneurysms.
Collapse
Affiliation(s)
- Ahmadreza Sohrabi-Ashlaghi
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Science, Tehran, Iran
| | - Narges Azizi
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Science, Tehran, Iran
| | - Hedayat Abbastabar
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Science, Tehran, Iran
| | - Madjid Shakiba
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Science, Tehran, Iran
| | - Jayran Zebardast
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Science, Tehran, Iran
| | - Kavous Firouznia
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Science, Tehran, Iran.
| |
Collapse
|
4
|
Luo S, Wen L, Jing Y, Xu J, Huang C, Dong Z, Wang G. A simple and effective machine learning model for predicting the stability of intracranial aneurysms using CT angiography. Front Neurol 2024; 15:1398225. [PMID: 38962476 PMCID: PMC11219573 DOI: 10.3389/fneur.2024.1398225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2024] [Accepted: 06/06/2024] [Indexed: 07/05/2024] Open
Abstract
Background It is vital to accurately and promptly distinguish unstable from stable intracranial aneurysms (IAs) to facilitate treatment optimization and avoid unnecessary treatment. The aim of this study is to develop a simple and effective predictive model for the clinical evaluation of the stability of IAs. Methods In total, 1,053 patients with 1,239 IAs were randomly divided the dataset into training (70%) and internal validation (30%) datasets. One hundred and ninety seven patients with 229 IAs from another hospital were evaluated as an external validation dataset. The prediction models were developed using machine learning based on clinical information, manual parameters, and radiomic features. In addition, a simple model for predicting the stability of IAs was developed, and a nomogram was drawn for clinical use. Results Fourteen machine learning models exhibited excellent classification performance. Logistic regression Model E (clinical information, manual parameters, and radiomic shape features) had the highest AUC of 0.963 (95% CI 0.943-0.980). Compared to manual parameters, radiomic features did not significantly improve the identification of unstable IAs. In the external validation dataset, the simplified model demonstrated excellent performance (AUC = 0.950) using only five manual parameters. Conclusion Machine learning models have excellent potential in the classification of unstable IAs. The manual parameters from CTA images are sufficient for developing a simple and effective model for identifying unstable IAs.
Collapse
Affiliation(s)
- Sha Luo
- Department of Radiology, Xinqiao Hospital, The Second Affiliated Hospital of Army Medical University, Chongqing, China
| | - Li Wen
- Department of Radiology, Xinqiao Hospital, The Second Affiliated Hospital of Army Medical University, Chongqing, China
| | - Yang Jing
- Huiying Medical Technology Co., Ltd., Beijing, China
| | - Jingxu Xu
- Department of Research Collaboration, R&D Center, Beijing Deepwise & League of PHD Technology Co., Ltd., Beijing, China
| | - Chencui Huang
- Department of Research Collaboration, R&D Center, Beijing Deepwise & League of PHD Technology Co., Ltd., Beijing, China
| | - Zhang Dong
- Department of Radiology, Xinqiao Hospital, The Second Affiliated Hospital of Army Medical University, Chongqing, China
| | - Guangxian Wang
- Department of Radiology, People’s Hospital of Chongqing Banan District, Chongqing, China
| |
Collapse
|
5
|
Ye Y, Chen J, Qiu X, Chen J, Ming X, Wang Z, Zhou X, Song L. Prediction of small intracranial aneurysm rupture status based on combined Clinical-Radiomics model. Heliyon 2024; 10:e30214. [PMID: 38707310 PMCID: PMC11066671 DOI: 10.1016/j.heliyon.2024.e30214] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2023] [Revised: 04/21/2024] [Accepted: 04/22/2024] [Indexed: 05/07/2024] Open
Abstract
Background Accumulating small unruptured intracranial aneurysms are detected due to the improved quality and higher frequency of cranial imaging, but treatment remains controversial. While surgery or endovascular treatment is effective for small aneurysms with a high risk of rupture, such interventions are unnecessary for aneurysms with a low risk of rupture. Consequently, it is imperative to accurately identify small aneurysms with a low risk of rupture. The purpose of this study was to develop a clinically practical model to predict small aneurysm ruptures based on a radiomics signature and clinical risk factors. Methods A total of 293 patients having an aneurysm with a diameter of less than 5 mm, including 199 patients (67.9 %) with a ruptured aneurysm and 94 patients (32.1 %) without a ruptured aneurysm, were included in this study. Digital subtraction angiography or surgical treatment was required in all cases. Data on the clinical risk factors and the features on computed tomography angiography images associated with the aneurysm rupture status were collected simultaneously. We developed a clinical-radiomics model to predict aneurysm rupture status using multivariate logistic regression analysis. The combined clinical-radiomics model was constructed by nomogram analysis. The diagnostic performance, clinical utility, and model calibration were evaluated by operating characteristic curve analysis, decision curve analysis, and calibration analysis. Results A combined clinical-radiomics model (Area Under Curve [AUC], 0.85; 95 % confidence interval [CI], 0.757-0.947) showed effective performance in the operating characteristic curve analysis. In the validation cohort, the performance of the combined model was better than that of the radiomics model (AUC, 0.75; 95 % CI, 0.645-0.865; Delong's test p-value = 0.01) and the clinical model (AUC, 0.74; 95 % CI, 0.625-0.851; Delong's test p-value <0.01) alone. The results of the decision curve, nomogram, and calibration analyses demonstrated the clinical utility and good fitness of the combined model. Conclusion Our study demonstrated the effectiveness of a clinical-radiomics model for predicting rupture status in small aneurysms.
Collapse
Affiliation(s)
- Yu Ye
- Department of Radiology, Huangshi Central Hospital, Affiliated Hospital of Hubei Polytechnic University, Huangshi, China
| | - Jiao Chen
- Department of Radiology, Huangshi Central Hospital, Affiliated Hospital of Hubei Polytechnic University, Huangshi, China
| | - Xiaoming Qiu
- Department of Radiology, Huangshi Central Hospital, Affiliated Hospital of Hubei Polytechnic University, Huangshi, China
| | | | - Xianfang Ming
- Department of Radiology, Huangshi Central Hospital, Affiliated Hospital of Hubei Polytechnic University, Huangshi, China
| | - Zhen Wang
- Department of Radiology, Huangshi Central Hospital, Affiliated Hospital of Hubei Polytechnic University, Huangshi, China
| | - Xin Zhou
- Department of Radiology, Huangshi Central Hospital, Affiliated Hospital of Hubei Polytechnic University, Huangshi, China
| | - Lei Song
- Department of Radiology, Huangshi Central Hospital, Affiliated Hospital of Hubei Polytechnic University, Huangshi, China
| |
Collapse
|
6
|
Kamphuis MJ, Timmins KM, Kuijf HJ, de Graaf EKL, Rinkel GJE, Vergouwen MDI, van der Schaaf IC. Three-Dimensional Morphological Change of Intracranial Aneurysms Before and Around Rupture. Neurosurgery 2024:00006123-990000000-01009. [PMID: 38169305 DOI: 10.1227/neu.0000000000002812] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Accepted: 11/13/2023] [Indexed: 01/05/2024] Open
Abstract
BACKGROUND AND OBJECTIVES Patients with an unruptured intracranial aneurysm often undergo periodic imaging to detect potential aneurysm growth, which is associated with an increased rupture risk. Because prediction of rupture based on growth is moderate, morphological changes have gained interest as a risk factor for rupture. We studied 3-dimensional-quantified morphological changes over time during radiological monitoring before rupture and around rupture. METHODS In this retrospective observational study, we identified aneurysms that ruptured during follow-up, with imaging available for at least 2 time points before rupture and one after rupture. For each time point, we obtained 8 morphological parameters: 2-dimensional size, volume, surface area, compactness 1 and 2, sphericity, elongation, and flatness. Morphological changes before rupture and around rupture were log-transformed, scaled, and analyzed with linear mixed-effects models. RESULTS We included 16 aneurysms in 16 patients who were imaged between 2004 and 2021. In the time period before rupture (median follow-up duration 1200 days, IQR 736-1340), 3 size-related morphological parameters increased: 2-dimensional size (estimated mean change 0.44, 95% CI 0.24-0.65), volume (estimated mean change 0.34, 95% CI 0.12-0.56), and surface area (0.33, 95% CI 0.11-0.54). In the period around rupture (median follow-up duration 407 days, IQR 148-719), these parameters further increased. In addition, 5 morphological parameters (compactness 1 and 2, sphericity, elongation, and flatness) decreased around rupture but not before rupture. CONCLUSION Change in aneurysm volume and surface area may be novel risk factors for rupture. Because most morphological parameters changed around but not before rupture, morphological changes during these 2 periods should be regarded as different processes. This implies that postrupture morphology should not be used as a surrogate for prerupture morphology in rupture prediction models.
Collapse
Affiliation(s)
- Maarten J Kamphuis
- Department of Radiology, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
- Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Kimberley M Timmins
- Image Sciences Institute, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Hugo J Kuijf
- Image Sciences Institute, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Eva K L de Graaf
- Department of Radiology, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Gabriel J E Rinkel
- Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Mervyn D I Vergouwen
- Department of Neurology and Neurosurgery, UMC Utrecht Brain Center, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Irene C van der Schaaf
- Department of Radiology, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
7
|
Gilotra K, Swarna S, Mani R, Basem J, Dashti R. Role of artificial intelligence and machine learning in the diagnosis of cerebrovascular disease. Front Hum Neurosci 2023; 17:1254417. [PMID: 37746051 PMCID: PMC10516608 DOI: 10.3389/fnhum.2023.1254417] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Accepted: 08/23/2023] [Indexed: 09/26/2023] Open
Abstract
Introduction Cerebrovascular diseases are known to cause significant morbidity and mortality to the general population. In patients with cerebrovascular disease, prompt clinical evaluation and radiographic interpretation are both essential in optimizing clinical management and in triaging patients for critical and potentially life-saving neurosurgical interventions. With recent advancements in the domains of artificial intelligence (AI) and machine learning (ML), many AI and ML algorithms have been developed to further optimize the diagnosis and subsequent management of cerebrovascular disease. Despite such advances, further studies are needed to substantively evaluate both the diagnostic accuracy and feasibility of these techniques for their application in clinical practice. This review aims to analyze the current use of AI and MI algorithms in the diagnosis of, and clinical decision making for cerebrovascular disease, and to discuss both the feasibility and future applications of utilizing such algorithms. Methods We review the use of AI and ML algorithms to assist clinicians in the diagnosis and management of ischemic stroke, hemorrhagic stroke, intracranial aneurysms, and arteriovenous malformations (AVMs). After identifying the most widely used algorithms, we provide a detailed analysis of the accuracy and effectiveness of these algorithms in practice. Results The incorporation of AI and ML algorithms for cerebrovascular patients has demonstrated improvements in time to detection of intracranial pathologies such as intracerebral hemorrhage (ICH) and infarcts. For ischemic and hemorrhagic strokes, commercial AI software platforms such as RapidAI and Viz.AI have bene implemented into routine clinical practice at many stroke centers to expedite the detection of infarcts and ICH, respectively. Such algorithms and neural networks have also been analyzed for use in prognostication for such cerebrovascular pathologies. These include predicting outcomes for ischemic stroke patients, hematoma expansion, risk of aneurysm rupture, bleeding of AVMs, and in predicting outcomes following interventions such as risk of occlusion for various endovascular devices. Preliminary analyses have yielded promising sensitivities when AI and ML are used in concert with imaging modalities and a multidisciplinary team of health care providers. Conclusion The implementation of AI and ML algorithms to supplement clinical practice has conferred a high degree of accuracy, efficiency, and expedited detection in the clinical and radiographic evaluation and management of ischemic and hemorrhagic strokes, AVMs, and aneurysms. Such algorithms have been explored for further purposes of prognostication for these conditions, with promising preliminary results. Further studies should evaluate the longitudinal implementation of such techniques into hospital networks and residency programs to supplement clinical practice, and the extent to which these techniques improve patient care and clinical outcomes in the long-term.
Collapse
Affiliation(s)
| | | | | | | | - Reza Dashti
- Dashti Lab, Department of Neurological Surgery, Stony Brook University Hospital, Stony Brook, NY, United States
| |
Collapse
|
8
|
Yang B, Li W, Wu X, Zhong W, Wang J, Zhou Y, Huang T, Zhou L, Zhou Z. Comparison of Ruptured Intracranial Aneurysms Identification Using Different Machine Learning Algorithms and Radiomics. Diagnostics (Basel) 2023; 13:2627. [PMID: 37627886 PMCID: PMC10453422 DOI: 10.3390/diagnostics13162627] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Revised: 08/03/2023] [Accepted: 08/05/2023] [Indexed: 08/27/2023] Open
Abstract
Different machine learning algorithms have different characteristics and applicability. This study aims to predict ruptured intracranial aneurysms by radiomics models based on different machine learning algorithms and evaluate their differences in the same data condition. A total of 576 patients with intracranial aneurysms (192 ruptured and 384 unruptured intracranial aneurysms) from two institutions are included and randomly divided into training and validation cohorts in a ratio of 7:3. Of the 107 radiomics features extracted from computed tomography angiography images, seven features stood out. Then, radiomics features and 12 common machine learning algorithms, including the decision-making tree, support vector machine, logistic regression, Gaussian Naive Bayes, k-nearest neighbor, random forest, extreme gradient boosting, bagging classifier, AdaBoost, gradient boosting, light gradient boosting machine, and CatBoost were applied to construct models for predicting ruptured intracranial aneurysms, and the predictive performance of all models was compared. In the validation cohort, the area under curve (AUC) values of models based on AdaBoost, gradient boosting, and CatBoost for predicting ruptured intracranial aneurysms were 0.889, 0.883, and 0.864, respectively, with no significant differences among them. Of note, the performance of these models was significantly superior to that of the other nine models. The AUC of the AdaBoost model in the cross-validation was within the range of 0.842 to 0.918. Radiomics models based on the machine learning algorithms can be used to predict ruptured intracranial aneurysms, and the prediction efficacy differs among machine learning algorithms. The boosting algorithms might be superior in the application of radiomics combined with the machine learning algorithm to predict aneurysm ruptures.
Collapse
Affiliation(s)
- Beisheng Yang
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing 400000, China; (B.Y.); (W.L.); (X.W.); (W.Z.); (J.W.); (Y.Z.); (T.H.); (L.Z.)
| | - Wenjie Li
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing 400000, China; (B.Y.); (W.L.); (X.W.); (W.Z.); (J.W.); (Y.Z.); (T.H.); (L.Z.)
| | - Xiaojia Wu
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing 400000, China; (B.Y.); (W.L.); (X.W.); (W.Z.); (J.W.); (Y.Z.); (T.H.); (L.Z.)
| | - Weijia Zhong
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing 400000, China; (B.Y.); (W.L.); (X.W.); (W.Z.); (J.W.); (Y.Z.); (T.H.); (L.Z.)
| | - Jing Wang
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing 400000, China; (B.Y.); (W.L.); (X.W.); (W.Z.); (J.W.); (Y.Z.); (T.H.); (L.Z.)
| | - Yu Zhou
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing 400000, China; (B.Y.); (W.L.); (X.W.); (W.Z.); (J.W.); (Y.Z.); (T.H.); (L.Z.)
| | - Tianxing Huang
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing 400000, China; (B.Y.); (W.L.); (X.W.); (W.Z.); (J.W.); (Y.Z.); (T.H.); (L.Z.)
| | - Lu Zhou
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing 400000, China; (B.Y.); (W.L.); (X.W.); (W.Z.); (J.W.); (Y.Z.); (T.H.); (L.Z.)
- Department of Radiology, The Third Affiliated Hospital of Chongqing Medical University, Chongqing 400000, China
| | - Zhiming Zhou
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing 400000, China; (B.Y.); (W.L.); (X.W.); (W.Z.); (J.W.); (Y.Z.); (T.H.); (L.Z.)
| |
Collapse
|
9
|
Xie Y, Liu S, Lin H, Wu M, Shi F, Pan F, Zhang L, Song B. Automatic risk prediction of intracranial aneurysm on CTA image with convolutional neural networks and radiomics analysis. Front Neurol 2023; 14:1126949. [PMID: 37456640 PMCID: PMC10345199 DOI: 10.3389/fneur.2023.1126949] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2022] [Accepted: 05/30/2023] [Indexed: 07/18/2023] Open
Abstract
Background Intracranial aneurysm (IA) is a nodular protrusion of the arterial wall caused by the localized abnormal enlargement of the lumen of a brain artery, which is the primary cause of subarachnoid hemorrhage. Accurate rupture risk prediction can effectively aid treatment planning, but conventional rupture risk estimation based on clinical information is subjective and time-consuming. Methods We propose a novel classification method based on the CTA images for differentiating aneurysms that are prone to rupture. The main contribution of this study is that the learning-based method proposed in this study leverages deep learning and radiomics features and integrates clinical information for a more accurate prediction of the risk of rupture. Specifically, we first extracted the provided aneurysm regions from the CTA images as 3D patches with the lesions located at their centers. Then, we employed an encoder using a 3D convolutional neural network (CNN) to extract complex latent features automatically. These features were then combined with radiomics features and clinical information. We further applied the LASSO regression method to find optimal features that are highly relevant to the rupture risk information, which is fed into a support vector machine (SVM) for final rupture risk prediction. Results The experimental results demonstrate that our classification method can achieve accuracy and AUC scores of 89.78% and 89.09%, respectively, outperforming all the alternative methods. Discussion Our study indicates that the incorporation of CNN and radiomics analysis can improve the prediction performance, and the selected optimal feature set can provide essential biomarkers for the determination of rupture risk, which is also of great clinical importance for individualized treatment planning and patient care of IA.
Collapse
Affiliation(s)
- Yuan Xie
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Shuyu Liu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Hen Lin
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Min Wu
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
| | - Feng Shi
- Department of Research and Development, Shanghai United Imaging Intelligence Co., Ltd., Shanghai, China
| | - Feng Pan
- Department of Pulmonary Medicine, Shanghai Chest Hospital, Shanghai Jiao Tong University, Shanghai, China
| | - Lichi Zhang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Bin Song
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
| |
Collapse
|
10
|
Feng J, Zeng R, Geng Y, Chen Q, Zheng Q, Yu F, Deng T, Lv L, Li C, Xue B, Li C. Automatic differentiation of ruptured and unruptured intracranial aneurysms on computed tomography angiography based on deep learning and radiomics. Insights Imaging 2023; 14:76. [PMID: 37142819 PMCID: PMC10160318 DOI: 10.1186/s13244-023-01423-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2023] [Accepted: 04/05/2023] [Indexed: 05/06/2023] Open
Abstract
OBJECTIVES Rupture of intracranial aneurysm is very dangerous, often leading to death and disability. In this study, deep learning and radiomics techniques were used to automatically detect and differentiate ruptured and unruptured intracranial aneurysms. MATERIALS AND METHODS 363 ruptured aneurysms and 535 unruptured aneurysms from Hospital 1 were included in the training set. 63 ruptured aneurysms and 190 unruptured aneurysms from Hospital 2 were used for independent external testing. Aneurysm detection, segmentation and morphological features extraction were automatically performed with a 3-dimensional convolutional neural network (CNN). Radiomic features were additionally computed via pyradiomics package. After dimensionality reduction, three classification models including support vector machines (SVM), random forests (RF), and multi-layer perceptron (MLP) were established and evaluated via area under the curve (AUC) of receiver operating characteristics. Delong tests were used for the comparison of different models. RESULTS The 3-dimensional CNN automatically detected, segmented aneurysms and calculated 21 morphological features for each aneurysm. The pyradiomics provided 14 radiomics features. After dimensionality reduction, 13 features were found associated with aneurysm rupture. The AUCs of SVM, RF and MLP on the training dataset and external testing dataset were 0.86, 0.85, 0.90 and 0.85, 0.88, 0.86, respectively, for the discrimination of ruptured and unruptured intracranial aneurysms. Delong tests showed that there was no significant difference among the three models. CONCLUSIONS In this study, three classification models were established to distinguish ruptured and unruptured aneurysms accurately. The aneurysms segmentation and morphological measurements were performed automatically, which greatly improved the clinical efficiency. CLINICAL RELEVANCE STATEMENT Our fully automatic models could rapidly process the CTA data and evaluate the status of aneurysms in one minute.
Collapse
Affiliation(s)
- Junbang Feng
- Medical Imaging Department, Chongqing University Central Hospital, No. 1, Jiankang Road, Yuzhong District, Chongqing, 400014, China
- Medical Imaging Department, Chongqing Emergency Medical Center, No. 1, Jiankang Road, Yuzhong District, Chongqing, 400014, China
| | - Rong Zeng
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, No. 74 Linjiang Road, Yuzhong District, Chongqing, 400010, China
| | - Yayuan Geng
- Department of Research and Development, Shukun (Beijing) Network Technology Co., Ltd, No. Room 801, Jinhui Building, Qiyang Road, Chaoyang District, Beijing, 200232, China
| | - Qiang Chen
- Department of Research and Development, Shukun (Beijing) Network Technology Co., Ltd, No. Room 801, Jinhui Building, Qiyang Road, Chaoyang District, Beijing, 200232, China
| | - Qingqing Zheng
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, No. 74 Linjiang Road, Yuzhong District, Chongqing, 400010, China
| | - Fei Yu
- Medical Imaging Department, Chongqing University Central Hospital, No. 1, Jiankang Road, Yuzhong District, Chongqing, 400014, China
- Medical Imaging Department, Chongqing Emergency Medical Center, No. 1, Jiankang Road, Yuzhong District, Chongqing, 400014, China
| | - Tie Deng
- Medical Imaging Department, Chongqing University Central Hospital, No. 1, Jiankang Road, Yuzhong District, Chongqing, 400014, China
- Medical Imaging Department, Chongqing Emergency Medical Center, No. 1, Jiankang Road, Yuzhong District, Chongqing, 400014, China
| | - Lei Lv
- Medical Imaging Department, Chongqing University Central Hospital, No. 1, Jiankang Road, Yuzhong District, Chongqing, 400014, China
| | - Chang Li
- Medical Imaging Department, Chongqing University Central Hospital, No. 1, Jiankang Road, Yuzhong District, Chongqing, 400014, China
- Medical Imaging Department, Chongqing Emergency Medical Center, No. 1, Jiankang Road, Yuzhong District, Chongqing, 400014, China
| | - Bo Xue
- Medical Imaging Department, Chongqing University Central Hospital, No. 1, Jiankang Road, Yuzhong District, Chongqing, 400014, China.
- Medical Imaging Department, Chongqing Emergency Medical Center, No. 1, Jiankang Road, Yuzhong District, Chongqing, 400014, China.
| | - Chuanming Li
- Medical Imaging Department, Chongqing University Central Hospital, No. 1, Jiankang Road, Yuzhong District, Chongqing, 400014, China.
- Medical Imaging Department, Chongqing Emergency Medical Center, No. 1, Jiankang Road, Yuzhong District, Chongqing, 400014, China.
| |
Collapse
|
11
|
McCague C, Ramlee S, Reinius M, Selby I, Hulse D, Piyatissa P, Bura V, Crispin-Ortuzar M, Sala E, Woitek R. Introduction to radiomics for a clinical audience. Clin Radiol 2023; 78:83-98. [PMID: 36639175 DOI: 10.1016/j.crad.2022.08.149] [Citation(s) in RCA: 37] [Impact Index Per Article: 37.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Accepted: 08/31/2022] [Indexed: 01/12/2023]
Abstract
Radiomics is a rapidly developing field of research focused on the extraction of quantitative features from medical images, thus converting these digital images into minable, high-dimensional data, which offer unique biological information that can enhance our understanding of disease processes and provide clinical decision support. To date, most radiomics research has been focused on oncological applications; however, it is increasingly being used in a raft of other diseases. This review gives an overview of radiomics for a clinical audience, including the radiomics pipeline and the common pitfalls associated with each stage. Key studies in oncology are presented with a focus on both those that use radiomics analysis alone and those that integrate its use with other multimodal data streams. Importantly, clinical applications outside oncology are also presented. Finally, we conclude by offering a vision for radiomics research in the future, including how it might impact our practice as radiologists.
Collapse
Affiliation(s)
- C McCague
- Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK.
| | - S Ramlee
- Department of Radiology, University of Cambridge, Cambridge, UK
| | - M Reinius
- Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - I Selby
- Department of Radiology, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - D Hulse
- Department of Radiology, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - P Piyatissa
- Department of Radiology, University of Cambridge, Cambridge, UK
| | - V Bura
- Department of Radiology, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK; Department of Radiology and Medical Imaging, County Clinical Emergency Hospital, Cluj-Napoca, Romania
| | - M Crispin-Ortuzar
- Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK; Department of Oncology, University of Cambridge, Cambridge, UK
| | - E Sala
- Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - R Woitek
- Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK; Research Centre for Medical Image Analysis and Artificial Intelligence (MIAAI), Department of Medicine, Faculty of Medicine and Dentistry, Danube Private University, Krems, Austria
| |
Collapse
|
12
|
Li R, Zhou P, Chen X, Mossa-Basha M, Zhu C, Wang Y. Construction and Evaluation of Multiple Radiomics Models for Identifying the Instability of Intracranial Aneurysms Based on CTA. Front Neurol 2022; 13:876238. [PMID: 35481272 PMCID: PMC9037633 DOI: 10.3389/fneur.2022.876238] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Accepted: 03/14/2022] [Indexed: 11/18/2022] Open
Abstract
Background and Aims Identifying unruptured intracranial aneurysm instability is crucial for therapeutic decision-making. This study aims to evaluate the role of Radiomics and traditional morphological features in identifying aneurysm instability by constructing and comparing multiple models. Materials and Methods A total of 227 patients with 254 intracranial aneurysms evaluated by CTA were included. Aneurysms were divided into unstable and stable groups using comprehensive criteria: the unstable group was defined as aneurysms with near-term rupture, growth during follow-up, or caused compressive symptoms; those without the aforementioned conditions were grouped as stable aneurysms. Aneurysms were randomly divided into training and test sets at a 1:1 ratio. Radiomics and traditional morphological features (maximum diameter, irregular shape, aspect ratio, size ratio, location, etc.) were extracted. Three basic models and two integrated models were constructed after corresponding statistical analysis. Model A used traditional morphological parameters. Model B used Radiomics features. Model C used the Radiomics features related to aneurysm morphology. Furthermore, integrated models of traditional and Radiomics features were built (model A+B, model A+C). The area under curves (AUC) of each model was calculated and compared. Results There were 31 (13.7%) patients harboring 36 (14.2%) unstable aneurysms, 15 of which ruptured post-imaging, 16 with growth on serial imaging, and 5 with compressive symptoms, respectively. Four traditional morphological features, six Radiomics features, and three Radiomics-derived morphological features were identified. The classification of aneurysm stability was as follows: the AUC of the training set and test set in models A, B, and C are 0.888 (95% CI 0.808–0.967) and 0.818 (95% CI 0.705–0.932), 0.865 (95% CI 0.777–0.952) and 0.739 (95% CI 0.636–0.841), 0.605(95% CI 0.470–0.740) and 0.552 (95% CI 0.401–0.703), respectively. The AUC of integrated Model A+B was numerically slightly higher than any single model, whereas Model A+C was not. Conclusions A radiomics and traditional morphology integrated model seems to be an effective tool for identifying intracranial aneurysm instability, whereas the use of Radiomics-derived morphological features alone is not recommended. Radiomics-based models were not superior to the traditional morphological features model.
Collapse
Affiliation(s)
- Ran Li
- Department of Radiology, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, China
| | - Pengyu Zhou
- Department of Radiology, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, China
| | - Xinyue Chen
- Computed Tomography Angiography Collaboration, Siemens Healthineers, Chengdu, China
| | - Mahmud Mossa-Basha
- Department of Radiology, University of Washington School of Medicine, Seattle, WA, United States
| | - Chengcheng Zhu
- Department of Radiology, University of Washington School of Medicine, Seattle, WA, United States
| | - Yuting Wang
- Department of Radiology, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, China
| |
Collapse
|
13
|
An X, He J, Di Y, Wang M, Luo B, Huang Y, Ming D. Intracranial Aneurysm Rupture Risk Estimation With Multidimensional Feature Fusion. Front Neurosci 2022; 16:813056. [PMID: 35250455 PMCID: PMC8893318 DOI: 10.3389/fnins.2022.813056] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2021] [Accepted: 01/05/2022] [Indexed: 12/25/2022] Open
Abstract
The rupture of aneurysms is the main cause of spontaneous subarachnoid hemorrhage (SAH), which is a serious life-threatening disease with high mortality and permanent disability rates. Therefore, it is highly desirable to evaluate the rupture risk of aneurysms. In this study, we proposed a novel semiautomatic prediction model for the rupture risk estimation of aneurysms based on the CADA dataset, including 108 datasets with 125 annotated aneurysms. The model consisted of multidimensional feature fusion, feature selection, and the construction of classification methods. For the multidimensional feature fusion, we extracted four kinds of features and combined them into the feature set, including morphological features, radiomics features, clinical features, and deep learning features. Specifically, we applied the feature extractor 3D EfficientNet-B0 to extract and analyze the classification capabilities of three different deep learning features, namely, no-sigmoid features, sigmoid features, and binarization features. In the experiment, we constructed five distinct classification models, among which the k-nearest neighbor classifier showed the best performance for aneurysm rupture risk estimation, reaching an F2-score of 0.789. Our results suggest that the full use of multidimensional feature fusion can improve the performance of aneurysm rupture risk assessment. Compared with other methods, our method achieves the state-of-the-art performance for aneurysm rupture risk assessment methods based on CADA 2020.
Collapse
Affiliation(s)
- Xingwei An
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Tianjin Center for Brain Science, Tianjin, China
| | - Jiaqian He
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Yang Di
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Miao Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Bin Luo
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Department of Neurosurgery, Huanhu Hospital of Tianjin University, Tianjin, China
| | - Ying Huang
- Department of Neurosurgery, Huanhu Hospital of Tianjin University, Tianjin, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Tianjin Center for Brain Science, Tianjin, China
- Department of Biomedical Engineering, School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
- *Correspondence: Dong Ming,
| |
Collapse
|
14
|
Dynamic contract-enhanced CT-based radiomics for differentiation of pancreatobiliary-type and intestinal-type periampullary carcinomas. Clin Radiol 2021; 77:e75-e83. [PMID: 34753589 DOI: 10.1016/j.crad.2021.09.010] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2021] [Accepted: 09/09/2021] [Indexed: 11/21/2022]
Abstract
AIM To investigate whether computed tomography (CT) radiomics can differentiate pancreatobiliary-type from intestinal-type periampullary carcinomas. MATERIALS AND METHODS CT radiomics of 96 patients (54 pancreatobiliary type and 42 intestinal type) with surgically confirmed periampullary carcinoma were assessed retrospectively. Volumes of interest (VOIs) were delineated manually. Radiomic features were extracted from preoperative CT images. A single-phase model and combined-phase model were constructed. Five-fold cross-validation and five machine-learning algorithms were utilised for model construction. The diagnostic performance of the models was evaluated by receiver operating characteristic (ROC) curves, and indicators included area under the curve (AUC), accuracy, sensitivity, specificity, and precision. ROC curves were compared using DeLong's test. RESULTS A total of 788 features were extracted on each phase. After feature selection using least absolute shrinkage and selection operator (LASSO) algorithm, the number of selected optimal feature was 18 (plain scan), nine (arterial phase), two (venous phase), 23 (delayed phase), 15 (three enhanced phases), and 29 (all phases), respectively. For the single-phase model, the delayed-phase model using the logistic regression (LR) algorithm showed the best prediction performance with AUC, accuracy, sensitivity, specificity, and precision of 0.89, 0.83, 0.80, 0.88, and 0.93, respectively. Two combined-phase models showed better results than the single-phase models. The model of all phases using the LR algorithm showed the best prediction performance with AUC, accuracy, sensitivity, specificity, and precision of 0.96, 0.88, 0.90, 0.93, and 0.92, respectively. CONCLUSION Radiomic models based on preoperative CT images can differentiate pancreatobiliary-type from intestinal-type periampullary carcinomas, in particular, the model of all phases using the LR algorithm.
Collapse
|