Automated computer-assisted detection system for cerebral aneurysms in time-of-flight magnetic resonance angiography using fully convolutional network

Artificial intelligence can help detecting incidental intracranial aneurysm on routine brain MRI using TOF MRA data sets and improve the time required for analysis of these images

PURPOSE

The aim of our study was to assess the diagnostic performance of commercially available AI software for intracranial aneurysm detection and to determine if the AI system enhances the radiologist's accuracy in identifying aneurysms and reduces image analysis time.

METHODS

TOF-MRA clinical brain examinations were analyzed using commercially available software and by an consultant neuroradiologist for the presence of intracranial aneurysms. The results were compared with the reference standard, to measure the sensitivity and specificity of the software and the consultant neuroradiologist. Furthermore, we examined the time required for the neuroradiologist to analyze the TOF-MRA image set, both with and without use of the AI software.

RESULTS

In 500 TOF-MRI brain studies, 106 aneurysms were detected in 85 examinations by combining AI software with neuroradiologist readings. The neuroradiologist identified 98 aneurysms (92.5% sensitivity), while AI detected 77 aneurysms (72.6% sensitivity). Specificity and sensitivity were calculated from the combined effort as reference. Combining AI and neuroradiologist readings significantly improves detection reliability. Additionally, AI integration reduced TOF-MRA analysis time by 19 s (23% reduction).

CONCLUSIONS

Our findings indicate that the AI-based software can support neuroradiologists in interpreting brain TOF-MRA. A combined reading of the AI-based software and the neuroradiologist demonstrated higher reliability in identifying intracranial aneurysms as compared to reading by either neuroradiologist or software, thus improving diagnostic accuracy of the neuroradiologist. Simultaneously, reading time for the neuroradiologist was reduced by approximately one quarter.

Reproducibility and across-site transferability of an improved deep learning approach for aneurysm detection and segmentation in time-of-flight MR-angiograms

This study aimed to (1) replicate a deep-learning-based model for cerebral aneurysm segmentation in TOF-MRAs, (2) improve the approach by testing various fully automatic pre-processing pipelines, and (3) rigorously validate the model's transferability on independent, external test-datasets. A convolutional neural network was trained on 235 TOF-MRAs acquired on local scanners from a single vendor to segment intracranial aneurysms. Different pre-processing pipelines including bias field correction, resampling, cropping and intensity-normalization were compared regarding their effect on model performance. The models were tested on independent, external same-vendor and other-vendor test-datasets, each comprised of 70 TOF-MRAs, including patients with and without aneurysms. The best-performing model achieved excellent results on the external same-vendor test-dataset, surpassing the results of the previous publication with an improved sensitivity (0.97 vs. ~ 0.86), a higher Dice score coefficient (DSC, 0.60 ± 0.25 vs. 0.53 ± 0.31), and an improved false-positive rate (0.87 ± 1.35 vs. ~ 2.7 FPs/case). The model further showed excellent performance in the external other-vendor test-datasets (DSC 0.65 ± 0.26; sensitivity 0.92, 0.96 ± 2.38 FPs/case). Specificity was 0.38 and 0.53, respectively. Raising the voxel-size from 0.5 × 0.5×0.5 mm to 1 × 1×1 mm reduced the false-positive rate seven-fold. This study successfully replicated core principles of a previous approach for detecting and segmenting cerebral aneurysms in TOF-MRAs with a robust, fully automatable pre-processing pipeline. The model demonstrated robust transferability on two independent external datasets using TOF-MRAs from the same scanner vendor as the training dataset and from other vendors. These findings are very encouraging regarding the clinical application of such an approach.

Deep learning-based platform performs high detection sensitivity of intracranial aneurysms in 3D brain TOF-MRA: An external clinical validation study

PURPOSE

To evaluate the diagnostic efficacy of a developed artificial intelligence (AI) platform incorporating deep learning algorithms for the automated detection of intracranial aneurysms in time-of-flight (TOF) magnetic resonance angiography (MRA).

METHOD

This retrospective study encompassed 3D TOF MRA images acquired between January 2023 and June 2023, aiming to validate the presence of intracranial aneurysms via our developed AI platform. The manual segmentation results by experienced neuroradiologists served as the "gold standard". Following annotation of MRA images by neuroradiologists using InferScholar software, the AI platform conducted automatic segmentation of intracranial aneurysms. Various metrics including accuracy (ACC), balanced ACC, area under the curve (AUC), sensitivity (SE), specificity (SP), F1 score, Brier Score, and Net Benefit were utilized to evaluate the generalization of AI platform. Comparison of intracranial aneurysm identification performance was conducted between the AI platform and six radiologists with experience ranging from 3 to 12 years in interpreting MR images. Additionally, a comparative analysis was carried out between radiologists' detection performance based on independent visual diagnosis and AI-assisted diagnosis. Subgroup analyses were also performed based on the size and location of the aneurysms to explore factors impacting aneurysm detectability.

RESULTS

510 patients were enrolled including 215 patients (42.16 %) with intracranial aneurysms and 295 patients (57.84 %) without aneurysms. Compared with six radiologists, the AI platform showed competitive discrimination power (AUC, 0.96), acceptable calibration (Brier Score loss, 0.08), and clinical utility (Net Benefit, 86.96 %). The AI platform demonstrated superior performance in detecting aneurysms with an overall SE, SP, ACC, balanced ACC, and F1 score of 91.63 %, 92.20 %, 91.96 %, 91.92 %, and 90.57 % respectively, outperforming the detectability of the two resident radiologists. For subgroup analysis based on aneurysm size and location, we observed that the SE of the AI platform for identifying tiny (diameter＜3mm), small (3 mm ≤ diameter＜5mm), medium (5 mm ≤ diameter＜7mm) and large aneurysms (diameter ≥ 7 mm) was 87.80 %, 93.14 %, 95.45 %, and 100 %, respectively. Furthermore, the SE for detecting aneurysms in the anterior circulation was higher than that in the posterior circulation. Utilizing the AI assistance, six radiologists (i.e., two residents, two attendings and two professors) achieved statistically significant improvements in mean SE (residents: 71.40 % vs. 88.37 %; attendings: 82.79 % vs. 93.26 %; professors: 90.07 % vs. 97.44 %; P < 0.05) and ACC (residents: 85.29 % vs. 94.12 %; attendings: 91.76 % vs. 97.06 %; professors: 95.29 % vs. 98.82 %; P < 0.05) while no statistically significant change was observed in SP. Overall, radiologists' mean SE increased by 11.40 %, mean SP increased by 1.86 %, and mean ACC increased by 5.88 %, mean balanced ACC promoted by 6.63 %, mean F1 score grew by 7.89 %, and Net Benefit rose by 12.52 %, with a concurrent decrease in mean Brier score declined by 0.06.

CONCLUSIONS

The deep learning algorithms implemented in the AI platform effectively detected intracranial aneurysms on TOF-MRA and notably enhanced the diagnostic capabilities of radiologists. This indicates that the AI-based auxiliary diagnosis model can provide dependable and precise prediction to improve the diagnostic capacity of radiologists.

Impact of an AI software on the diagnostic performance and reading time for the detection of cerebral aneurysms on time of flight MR-angiography

PURPOSE

To evaluate the impact of an AI-based software trained to detect cerebral aneurysms on TOF-MRA on the diagnostic performance and reading times across readers with varying experience levels.

METHODS

One hundred eighty-six MRI studies were reviewed by six readers to detect cerebral aneurysms. Initially, readings were assisted by the CNN-based software mdbrain. After 6 weeks, a second reading was conducted without software assistance. The results were compared to the consensus reading of two neuroradiological specialists and sensitivity (lesion and patient level), specificity (patient level), and false positives per case were calculated for the group of all readers, for the subgroup of physicians, and for each individual reader. Also, reading times for each reader were measured.

RESULTS

The dataset contained 54 aneurysms. The readers had no experience (three medical students), 2 years experience (resident in neuroradiology), 6 years experience (radiologist), and 12 years (neuroradiologist). Significant improvements of overall specificity and the overall number of false positives per case were observed in the reading with AI support. For the physicians, we found significant improvements of sensitivity on lesion and patient level and false positives per case. Four readers experienced reduced reading times with the software, while two encountered increased times.

CONCLUSION

In the reading with the AI-based software, we observed significant improvements in terms of specificity and false positives per case for the group of all readers and significant improvements of sensitivity and false positives per case for the physicians. Further studies are needed to investigate the effects of the AI-based software in a prospective setting.

A deep learning framework for intracranial aneurysms automatic segmentation and detection on magnetic resonance T1 images

OBJECTIVES

To design a deep learning-based framework for automatic segmentation and detection of intracranial aneurysms (IAs) on magnetic resonance T1 images and test the robustness and performance of framework.

METHODS

A retrospective diagnostic study was conducted based on 159 IAs from 136 patients who underwent the T1 images. Among them, 127 cases were randomly selected for training and validation, and 32 cases were used to assess the accuracy and consistency of our algorithm. We developed and assembled three convolutional neural networks for the segmentation and detection of IAs. The segmentation and detection performance of the model were compared with the ground truth, and various metrics were calculated at the voxel level, IAs level, and patient level to show the performance of our framework.

RESULTS

Our assembled model achieved overall Dice, voxel-level sensitivity, specificity, balanced accuracy, and F1 score of 0.802, 0.874, 0.9998, 0.937, and 0.802, respectively. A coincidence greater than 0.7 between the aneurysms predicted by the model and the ground truth was considered as a true positive. For IAs detection, the sensitivity reached 90.63% with 0.58 false positives per case. The volume of IAs segmented by our model showed a high agreement and consistency with the volume of IAs labeled by experts.

CONCLUSION

The deep learning framework is achievable and robust for IAs segmentation and detection. Our model offers more clinical application opportunities compared to digital subtraction angiography (DSA)-based, CTA-based, and MRA-based methods.

CLINICAL RELEVANCE STATEMENT

Our deep learning framework effectively detects and segments intracranial aneurysms using clinical routine T1 sequences, showing remarkable effectiveness and offering great potential for improving the detection of latent intracranial aneurysms and enabling early identification.

KEY POINTS

•There is no segmentation method based on clinical routine T1 images. Our study shows that the proper deep learning framework can effectively localize the intracranial aneurysms. •The T1-based segmentation and detection method is more universal than other angiography-based detection methods, which can potentially reduce missed diagnoses caused by the absence of angiography images. •The deep learning framework is robust and has the potential to be applied in a clinical setting.

[Automatic detection method of intracranial aneurysms on maximum intensity projection images based on SE-CaraNet]

Conventional maximum intensity projection (MIP) images tend to ignore some morphological features in the detection of intracranial aneurysms, resulting in missed detection and misdetection. To solve this problem, a new method for intracranial aneurysm detection based on omni-directional MIP image is proposed in this paper. Firstly, the three-dimensional magnetic resonance angiography (MRA) images were projected with the maximum density in all directions to obtain the MIP images. Then, the region of intracranial aneurysm was prepositioned by matching filter. Finally, the Squeeze and Excitation (SE) module was used to improve the CaraNet model. Excitation and the improved model were used to detect the predetermined location in the omni-directional MIP image to determine whether there was intracranial aneurysm. In this paper, 245 cases of images were collected to test the proposed method. The results showed that the accuracy and specificity of the proposed method could reach 93.75% and 93.86%, respectively, significantly improved the detection performance of intracranial aneurysms in MIP images.

Global trend in research of intracranial aneurysm management with artificial intelligence technology: a bibliometric analysis

Background

The use of artificial intelligence (AI) technology has been growing in the management of intracranial aneurysms (IAs). This study aims to conduct a bibliometric analysis of researches on intracranial aneurysm management with artificial intelligence technology (IAMWAIT) to gain insights into global research trends and potential future directions.

Methods

A comprehensive search of articles and reviews related to IAMWAIT, published from January 1, 1900 to July 20, 2023, was conducted using the Web of Science Core Collection (WoWCC).Visualizations of the bibliometric analysis were generated utilizing WPS Office, Scimago Graphica, VOSviewer, CiteSpace, and R.

Results

A total of 277 papers were included in the study. China emerged as the most prolific country in terms of publications, institutions, cooperating countries, and prolific authors. The United States garnered the highest number of total citations, institutions with the highest citations/H index, cooperating countries (n=9), and 3 of the top 10 cited papers. Both the total number of papers and the citation count exhibited a positive and significant correlation with the gross domestic product (GDP) of countries. The journal with the highest publication frequency was Frontiers in Neurology, while Stroke recorded the highest number of citations, H-index, and impact factor (IF). Areas of primary interest in IAMWAIT, leveraging AI technology, included rupture risk assessment/prediction, computer-assisted diagnosis, outcome prediction, hemodynamics, and laboratory research of IAs.

Conclusions

IAMWAIT is an active area of research that has undergone rapid development in recent years. Future endeavors should focus on broader application of AI algorithms in various sub-fields of IAMWAIT to better suit the real world.

Role of artificial intelligence and machine learning in the diagnosis of cerebrovascular disease

Introduction

Cerebrovascular diseases are known to cause significant morbidity and mortality to the general population. In patients with cerebrovascular disease, prompt clinical evaluation and radiographic interpretation are both essential in optimizing clinical management and in triaging patients for critical and potentially life-saving neurosurgical interventions. With recent advancements in the domains of artificial intelligence (AI) and machine learning (ML), many AI and ML algorithms have been developed to further optimize the diagnosis and subsequent management of cerebrovascular disease. Despite such advances, further studies are needed to substantively evaluate both the diagnostic accuracy and feasibility of these techniques for their application in clinical practice. This review aims to analyze the current use of AI and MI algorithms in the diagnosis of, and clinical decision making for cerebrovascular disease, and to discuss both the feasibility and future applications of utilizing such algorithms.

Methods

We review the use of AI and ML algorithms to assist clinicians in the diagnosis and management of ischemic stroke, hemorrhagic stroke, intracranial aneurysms, and arteriovenous malformations (AVMs). After identifying the most widely used algorithms, we provide a detailed analysis of the accuracy and effectiveness of these algorithms in practice.

Results

The incorporation of AI and ML algorithms for cerebrovascular patients has demonstrated improvements in time to detection of intracranial pathologies such as intracerebral hemorrhage (ICH) and infarcts. For ischemic and hemorrhagic strokes, commercial AI software platforms such as RapidAI and Viz.AI have bene implemented into routine clinical practice at many stroke centers to expedite the detection of infarcts and ICH, respectively. Such algorithms and neural networks have also been analyzed for use in prognostication for such cerebrovascular pathologies. These include predicting outcomes for ischemic stroke patients, hematoma expansion, risk of aneurysm rupture, bleeding of AVMs, and in predicting outcomes following interventions such as risk of occlusion for various endovascular devices. Preliminary analyses have yielded promising sensitivities when AI and ML are used in concert with imaging modalities and a multidisciplinary team of health care providers.

Conclusion

The implementation of AI and ML algorithms to supplement clinical practice has conferred a high degree of accuracy, efficiency, and expedited detection in the clinical and radiographic evaluation and management of ischemic and hemorrhagic strokes, AVMs, and aneurysms. Such algorithms have been explored for further purposes of prognostication for these conditions, with promising preliminary results. Further studies should evaluate the longitudinal implementation of such techniques into hospital networks and residency programs to supplement clinical practice, and the extent to which these techniques improve patient care and clinical outcomes in the long-term.

Detection of cerebral aneurysms using artificial intelligence: a systematic review and meta-analysis

BACKGROUND

Subarachnoid hemorrhage from cerebral aneurysm rupture is a major cause of morbidity and mortality. Early aneurysm identification, aided by automated systems, may improve patient outcomes. Therefore, a systematic review and meta-analysis of the diagnostic accuracy of artificial intelligence (AI) algorithms in detecting cerebral aneurysms using CT, MRI or DSA was performed.

METHODS

MEDLINE, Embase, Cochrane Library and Web of Science were searched until August 2021. Eligibility criteria included studies using fully automated algorithms to detect cerebral aneurysms using MRI, CT or DSA. Following Preferred Reporting Items for Systematic Reviews and Meta-Analysis: Diagnostic Test Accuracy (PRISMA-DTA), articles were assessed using Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2). Meta-analysis included a bivariate random-effect model to determine pooled sensitivity, specificity, and area under the receiver operator characteristic curve (ROC-AUC).

PROSPERO

CRD42021278454.

RESULTS

43 studies were included, and 41/43 (95%) were retrospective. 34/43 (79%) used AI as a standalone tool, while 9/43 (21%) used AI assisting a reader. 23/43 (53%) used deep learning. Most studies had high bias risk and applicability concerns, limiting conclusions. Six studies in the standalone AI meta-analysis gave (pooled) 91.2% (95% CI 82.2% to 95.8%) sensitivity; 16.5% (95% CI 9.4% to 27.1%) false-positive rate (1-specificity); 0.936 ROC-AUC. Five reader-assistive AI studies gave (pooled) 90.3% (95% CI 88.0% - 92.2%) sensitivity; 7.9% (95% CI 3.5% to 16.8%) false-positive rate; 0.910 ROC-AUC.

CONCLUSION

AI has the potential to support clinicians in detecting cerebral aneurysms. Interpretation is limited due to high risk of bias and poor generalizability. Multicenter, prospective studies are required to assess AI in clinical practice.

Automated unruptured cerebral aneurysms detection in TOF MR angiography images using dual-channel SE-3D UNet: a multi-center research

OBJECTIVES

Time of flight magnetic resonance angiography (TOF-MRA) is the primary non-invasive screening method for cerebral aneurysms. We aimed to develop a computer-aided aneurysm detection method to improve the diagnostic efficiency and accuracy, especially decrease the false positive rate.

METHODS

This is a retrospective multicenter study. The dataset contained 1160 TOF-MRA examinations composed of unruptured aneurysms (n = 1096) and normal controls (n = 166) from six hospitals. A total of 1037 examinations acquired from 2013 to 2019 were used as training set; 123 examinations acquired from 2020 to 2021 were used as external test set. We proposed an equalized augmentation strategy based on aneurysm location and constructed a detection model based on dual channel SE-3D UNet. The model was trained with a 5-fold cross-validation in the training set, then tested on the external test set.

RESULTS

The proposed method achieved 82.46% sensitivity on patient-level, 73.85% sensitivity on lesion-level, and 0.88 false positives per case in the external test set. The performance did not show significant differences in subgroups according to the aneurysm site (except ACA), aneurysm size (except smaller than 3 mm), or MRI scanners. The performance preceded the basic SE-3D UNet by increasing 15.79% patient-level sensitivity and decreasing 4.19 FPs/case.

CONCLUSIONS

The proposed automated aneurysm detection method achieved acceptable sensitivity while controlling fairly low false positives per case. It might provide a useful auxiliary tool of cerebral aneurysms MRA screening.

KEY POINTS

• The need for automated cerebral aneurysms detecting is growing. • The strategy of equalized augmentation based on aneurysm location and dual-channel input could improve the model performance. • The retrospective multi-center study showed that the proposed automated cerebral aneurysms detection using dual-channel SE-3D UNet could achieve acceptable sensitivity while controlling a low false positive rate.

Automated Detection of Cerebral Aneurysms on TOF-MRA Using a Deep Learning Approach: An External Validation Study

BACKGROUND AND PURPOSE

Cerebral aneurysms yield the risk of rupture, severe disability and death. Thus, early detection of cerebral aneurysms is crucial to ensure timely treatment, if necessary. AI-based software tools are expected to enhance radiologists' performance in detecting pathologies like cerebral aneurysms in the future. Our aim was to evaluate the diagnostic performance of an artificial intelligence-based software designed to detect intracranial aneurysms on TOF-MRA.

MATERIALS AND METHODS

One hundred ninety-one MR imaging data sets were analyzed using the software mdbrain for the presence of intracranial aneurysms on TOF-MRA obtained using two 3T MR imaging scanners or a 1.5T MR imaging scanner according to our clinical standard protocol. The results were compared with the reading of an experienced radiologist as a criterion standard to measure the sensitivity, specificity, positive and negative predictive values, and accuracy of the software. Additionally, detection rates depending on size, morphology, and location of the aneurysms were evaluated.

RESULTS

Fifty-four aneurysms were detected by the expert reader. The overall sensitivity of the software for the detection of cerebral aneurysms was 72.6%, the specificity was 87.2%, and the accuracy was 82.6%. The positive predictive value was 67.9%, and the negative predictive value was 88.5%. We observed a sensitivity of 100% for saccular aneurysms of >5 mm without signs of thrombosis and low detection rates for fusiform or thrombosed aneurysms of 33.3% and 16.7%, respectively. Of 8 aneurysms that were not included in the initial written reports but were detected by the expert reader, retrospectively, 4 were detected by the software.

CONCLUSIONS

Our data suggest that the software can assist radiologists in reporting TOF-MRA. The software was highly reliable in detecting saccular aneurysms, while for fusiform or thrombosed aneurysms, further improvements are needed. Further studies are necessary to investigate the impact of the software on detection rates, interrater reliability, and reading times.

A coarse-to-fine cascade deep learning neural network for segmenting cerebral aneurysms in time-of-flight magnetic resonance angiography

BACKGROUND

Accurate segmentation of unruptured cerebral aneurysms (UCAs) is essential to treatment planning and rupture risk assessment. Currently, three-dimensional time-of-flight magnetic resonance angiography (3D TOF-MRA) has been the most commonly used method for screening aneurysms due to its noninvasiveness. The methods based on deep learning technologies can assist radiologists in achieving accurate and reliable analysis of the size and shape of aneurysms, which may be helpful in rupture risk prediction models. However, the existing methods did not accomplish accurate segmentation of cerebral aneurysms in 3D TOF-MRA.

METHODS

This paper proposed a CCDU-Net for segmenting UCAs of 3D TOF-MRA images. The CCDU-Net was a cascade of a convolutional neural network for coarse segmentation and the proposed DU-Net for fine segmentation. Especially, the dual-channel inputs of DU-Net were composed of the vessel image and its contour image which can augment the vascular morphological information. Furthermore, a newly designed weighted loss function was used in the training process of DU-Net to promote the segmentation performance.

RESULTS

A total of 270 patients with UCAs were enrolled in this study. The images were divided into the training (N = 174), validation (N = 43), and testing (N = 53) cohorts. The CCDU-Net achieved a dice similarity coefficient (DSC) of 0.616 ± 0.167, Hausdorff distance (HD) of 5.686 ± 7.020 mm, and volumetric similarity (VS) of 0.752 ± 0.226 in the testing cohort. Compared with the existing best method, the DSC and VS increased by 18% and 5%, respectively, while the HD decreased by one-tenth.

CONCLUSIONS

We proposed a CCDU-Net for segmenting UCAs in 3D TOF-MRA, and the obtained results show that the proposed method outperformed other existing methods.

Machine Learning Algorithms for Rupture Risk Assessment of Intracranial Aneurysms: A Diagnostic Meta-Analysis

OBJECTIVE

Several machine learning algorithms have been increasingly applied to predict the rupture risk of intracranial aneurysms. We performed the present diagnostic meta-analysis to comprehensively evaluate the diagnostic value of machine learning algorithms for assessing the rupture risk of intracranial aneurysms.

METHODS

We systematically searched 3 electronic databases, including Medline (via PubMed), the Cochrane Register of Controlled Trials (via Ovid), and Embase (via Elsevier), to retrieve eligible studies from the databases' inception through March 2021. The latest update was performed in June 2021. StataMP, version 14, was used to estimate all pooled diagnostic values.

RESULTS

A total of 4 studies involving 6 reports were considered to meet the inclusion criteria. Our diagnostic meta-analysis generated the following pooled diagnostic values: sensitivity, 0.84 (95% confidence interval [CI], 0.75-0.90); specificity, 0.78 (95% CI, 0.68-0.85); positive likelihood ratio, 3.8 (95% CI, 2.4-5.9); negative likelihood ratio, 0.21 (95% CI, 0.12-0.35), diagnostic odd ratio, 18 (95% CI, 7-46), and area under the summary receiver operating characteristic curve, 0.88 (95% CI, 0.85-0.90).

CONCLUSIONS

Our findings have demonstrated that the diagnostic performance of machine learning algorithms for the rupture risk assessment of AIs is excellent. Considering that the negative effects resulted from the limited number of eligible studies, we suggest developing more well-designed studies with larger sample sizes to validate our findings.

RAPID Aneurysm: Artificial intelligence for unruptured cerebral aneurysm detection on CT angiography

OBJECTIVES

Cerebral aneurysms may result in significant morbidity and mortality. Identification of these aneurysms on CT Angiography (CTA) studies is critical to guide patient treatment. Artificial intelligence platforms to assist with automated aneurysm detection are of high interest. We determined the performance of a semi-automated artificial intelligence software program (RAPID Aneurysm) for the detection of cerebral aneurysms.

MATERIALS AND METHODS

RAPID Aneurysm was used to detect retrospectively the presence of cerebral aneurysms in CTA studies performed between January 2019 and December 2020. The gold standard was aneurysm presence and location as determined by the consensus of three expert neuroradiologists. Aneurysm detection accuracy, sensitivity, specificity, positive predictive value, negative predictive value, and positive and negative likelihood ratios by RAPID Aneurysm were determined.

RESULTS

51 patients (mean age, 56±15; 24 women [47.1%]) with a single CTA were included. A total of 60 aneurysms were identified. RAPID Aneurysm had a sensitivity of 0.950 (95% CI: 0.863-0.983), specificity of 1.000 (95% CI: 0.996-1.000), a positive predictive value (PPV) of 1.000 (95% CI: 0.937-1.000), a negative predictive value (NPV) of 0.997 (95% CI: 0.991-0.999), and an accuracy of 0.997 (95% CI: 0.991-0.999) for cerebral aneurysm detection.

CONCLUSIONS

RAPID Aneurysm is highly accurate for the detection of cerebral aneurysms on CTA.

A Review of Artificial Intelligence in Cerebrovascular Disease Imaging: Applications and Challenges

BACKGROUND

A variety of emerging medical imaging technologies based on artificial intelligence have been widely applied in many diseases, but they are still limitedly used in the cerebrovascular field even though the diseases can lead to catastrophic consequences.

OBJECTIVE

This work aims to discuss the current challenges and future directions of artificial intelligence technology in cerebrovascular diseases through reviewing the existing literature related to applications in terms of computer-aided detection, prediction and treatment of cerebrovascular diseases.

METHODS

Based on artificial intelligence applications in four representative cerebrovascular diseases including intracranial aneurysm, arteriovenous malformation, arteriosclerosis and moyamoya disease, this paper systematically reviews studies published between 2006 and 2021 in five databases: National Center for Biotechnology Information, Elsevier Science Direct, IEEE Xplore Digital Library, Web of Science and Springer Link. And three refinement steps were further conducted after identifying relevant literature from these databases.

RESULTS

For the popular research topic, most of the included publications involved computer-aided detection and prediction of aneurysms, while studies about arteriovenous malformation, arteriosclerosis and moyamoya disease showed an upward trend in recent years. Both conventional machine learning and deep learning algorithms were utilized in these publications, but machine learning techniques accounted for a larger proportion.

CONCLUSION

Algorithms related to artificial intelligence, especially deep learning, are promising tools for medical imaging analysis and will enhance the performance of computer-aided detection, prediction and treatment of cerebrovascular diseases.

Detection and analysis of cerebral aneurysms based on X-ray rotational angiography - the CADA 2020 challenge

The Cerebral Aneurysm Detection and Analysis (CADA) challenge was organized to support the development and benchmarking of algorithms for detecting, analyzing, and risk assessment of cerebral aneurysms in X-ray rotational angiography (3DRA) images. 109 anonymized 3DRA datasets were provided for training, and 22 additional datasets were used to test the algorithmic solutions. Cerebral aneurysm detection was assessed using the F2 score based on recall and precision, and the fit of the delivered bounding box was assessed using the distance to the aneurysm. The segmentation quality was measured using the Jaccard index and a combination of different surface distance measures. Systematic errors were analyzed using volume correlation and bias. Rupture risk assessment was evaluated using the F2 score. 158 participants from 22 countries registered for the CADA challenge. The U-Net-based detection solutions presented by the community show similar accuracy compared to experts (F2 score 0.92), with a small number of missed aneurysms with diameters smaller than 3.5 mm. In addition, the delineation of these structures, based on U-Net variations, is excellent, with a Jaccard score of 0.92. The rupture risk estimation methods achieved an F2 score of 0.71. The performance of the detection and segmentation solutions is equivalent to that of human experts. The best results are obtained in rupture risk estimation by combining different image-based, morphological, and computational fluid dynamic parameters using machine learning methods. Furthermore, we evaluated the best methods pipeline, from detecting and delineating the vessel dilations to estimating the risk of rupture. The chain of these methods achieves an F2-score of 0.70, which is comparable to applying the risk prediction to the ground-truth delineation (0.71).

Artificial Intelligence Applications in Intracranial Aneurysm: Achievements, Challenges and Opportunities

Intracranial aneurysms present in about 3% of the general population and the number of detected aneurysms is continuously rising with the advances in imaging techniques. Intracranial aneurysm rupture carries a high risk of death or permanent disabilities; therefore assessment of the intracranial aneurysm along the entire course is of great clinical importance. Given the outstanding performance of artificial intelligence (AI) in image-based tasks, many AI-based applications have emerged in recent years for the assessment of intracranial aneurysms. In this review we will summarize the state-of-the-art of AI applications in intracranial aneurysms, emphasizing the achievements, and exploring the challenges. We will also discuss the future prospects and potential opportunities. This article provides an updated view of the AI applications in intracranial aneurysms and may act as a basis for guiding the related future works.

Performance changes due to differences in training data for cerebral aneurysm detection in head MR angiography images

PURPOSE

The performance of computer-aided detection (CAD) software depends on the quality and quantity of the dataset used for machine learning. If the data characteristics in development and practical use are different, the performance of CAD software degrades. In this study, we investigated changes in detection performance due to differences in training data for cerebral aneurysm detection software in head magnetic resonance angiography images.

MATERIALS AND METHODS

We utilized three types of CAD software for cerebral aneurysm detection in MRA images, which were based on 3D local intensity structure analysis, graph-based features, and convolutional neural network. For each type of CAD software, we compared three types of training pattern, which were two types of training using single-site data and one type of training using multisite data. We also carried out internal and external evaluations.

RESULTS

In training using single-site data, the performance of CAD software largely and unpredictably fluctuated when the training dataset was changed. Training using multisite data did not show the lowest performance among the three training patterns for any CAD software and dataset.

CONCLUSION

The training of cerebral aneurysm detection software using data collected from multiple sites is desirable to ensure the stable performance of the software.