Fully automatic volume segmentation of infrarenal abdominal aortic aneurysm computed tomography images with deep learning approaches versus physician controlled manual segmentation

Volume Measurements for Surveillance after Endovascular Aneurysm Repair using Artificial Intelligence

OBJECTIVE

Surveillance after endovascular aneurysm repair (EVAR) is suboptimal due to limited compliance and relatively large variability in measurement methods of abdominal aortic aneurysm (AAA) sac size after treatment. Measuring volume offers a more sensitive early indicator of aneurysm sac growth or regression and stability, but is more time consuming and thus less practical than measuring maximum diameter. This study evaluated the accuracy and consistency of the artificial intelligence (AI) driven software PRAEVAorta 2 and compared it with an established semi-automated segmentation method.

METHODS

Post-EVAR aneurysm sac volumes measured by AI were compared with a semi-automated segmentation method (3mensio software) in patients with an infrarenal AAA, focusing on absolute aneurysm volume and volume evolution over time. The clinical impact of both methods was evaluated by categorising patients as showing either AAA sac regression, stabilisation, or growth comparing the 30 day and one year post-EVAR computed tomography angiography (CTA) images. Inter- and intra-method agreement were assessed using Bland-Altman analysis, the intraclass correlation coefficient (ICC), and Cohen's κ statistic.

RESULTS

Forty nine patients (98 CTA images) were analysed, after excluding 15 patients due to segmentation errors by AI owing to low quality CT scans. Aneurysm sac volume measurements showed excellent correlation (ICC = 0.94, 95% confidence interval [CI] 0.88 - 0.99) with good to excellent correlation for volume evolution over time (ICC = 0.85, 95% CI 0.75 - 0.91). Categorisation of AAA sac evolution showed fair correlation (Cohen's κ = 0.33), with 12 discrepancies (24%) between methods. The intra-method agreement for the AI software demonstrated perfect consistency (bias = -0.01 cc), indicating that it is more reliable compared with the semi-automated method.

CONCLUSION

Despite some differences in AAA sac volume measurements, the highly consistent AI driven software accurately measured AAA sac volume evolution. AAA sac evolution classification appears to be more reliable than existing methods and may therefore improve risk stratification post-EVAR, and could facilitate AI driven personalised surveillance programmes. While high quality CTA images are crucial, considering radiation exposure is important, validating the software with non-contrast CT scans might reduce the radiation burden.

Machine Learning Based Prediction of Post-operative Infrarenal Endograft Apposition for Abdominal Aortic Aneurysms

OBJECTIVE

Challenging infrarenal aortic neck characteristics have been associated with an increased risk of type Ia endoleak after endovascular aneurysm repair (EVAR). Short apposition (< 10 mm circumferential shortest apposition length [SAL]) on the first post-operative computed tomography angiography (CTA) has been associated with type Ia endoleak. Therefore, this study aimed to develop a model to predict post-operative SAL in patients with an abdominal aortic aneurysm based on the pre-operative shape.

METHODS

A statistical shape model was developed to obtain principal component scores. The dataset comprised patients treated by standard EVAR without complications (n = 93) enriched with patients with a late type Ia endoleak (n = 54). The infrarenal SAL was obtained from the first post-operative CTA and subsequently binarised (< 10 mm and ≥ 10 mm). The principal component scores that were statistically different between the SAL groups were used as input for five classification models, and evaluated by means of leave one out cross validation. Area under the receiver operating characteristic curves (AUC), accuracy, sensitivity, and specificity were determined for each classification model.

RESULTS

Of the 147 patients, 24 patients had an infrarenal SAL < 10 mm and 123 patients had a SAL ≥ 10 mm. The gradient boosting model resulted in the highest AUC of 0.77. Using this model, 114 patients (77.6%) were correctly classified; sensitivity (< 10 mm apposition was correctly predicted) and specificity (≥ 10 mm apposition was correctly predicted) were 0.70 and 0.79 based on a threshold of 0.21, respectively.

CONCLUSION

A model was developed to predict which patients undergoing EVAR will achieve sufficient graft apposition (≥ 10 mm) in the infrarenal aortic neck based on a statistical shape model of pre-operative CTA data. This model can help vascular specialists during the planning phase to accurately identify patients who are unlikely to achieve sufficient apposition after standard EVAR.

A Statistical Shape Model of Infrarenal Aortic Necks in Patients With and Without Late Type Ia Endoleak After Endovascular Aneurysm Repair

PURPOSE

Hostile aortic neck characteristics, including short length, severe suprarenal and infrarenal angulation, conicity, and large diameter, have been associated with increased risk for type Ia endoleak (T1aEL) after endovascular aneurysm repair (EVAR). This study investigates the mid-term discriminative ability of a statistical shape model (SSM) of the infrarenal aortic neck morphology compared with or in combination with conventional measurements in patients who developed T1aEL post-EVAR.

MATERIALS AND METHODS

The dataset composed of EVAR patients who developed a T1aEL during follow-up and a control group without T1aEL. Principal component (PC) analysis was performed using a parametrization to create an SSM. Three logistic regression models were created. To discriminate between patients with and without T1aEL, sensitivity, specificity, and the area under the receiver operating characteristic (ROC) curve (AUC) were calculated.

RESULTS

In total, 126 patients (84% male) were included. Median follow-up time in T1aEl group and control group was 52 (31, 78.5) and 51 (40, 62.5) months, respectively. Median follow-up time was not statistically different between the groups (p=0.72). A statistically significant difference between the median PC scores of the T1aEL and control groups was found for the first, eighth, and ninth PC. Sensitivity, specificity, and AUC values for the SSM-based versus the conventional measurements-based logistic regression models were 79%, 70%, and 0.82 versus 74%, 73%, and 0.85, respectively. The model of the SSM and conventional measurements combined resulted in sensitivity, specificity, and AUC of 81%, 81%, and 0.92.

CONCLUSION

An SSM of the infrarenal aortic neck determines its 3-dimensional geometry. The SSM is a potential valuable tool for risk stratification and T1aEL prediction in EVAR. The SSM complements the conventional measurements of the individual preoperative infrarenal aortic neck geometry by increasing the predictive value for late type Ia endoleak after standard EVAR.

CLINICAL IMPACT

A statistical shape model (SSM) determines the 3-dimensional geometry of the infrarenal aortic neck. The SSM complements the conventional measurements of the individual pre-operative infrarenal aortic neck geometry by increasing the predictive value for late type Ia endoleaks post-EVAR. The SSM is a potential valuable tool for risk stratification and late T1aEL prediction in EVAR and it is a first step toward implementation of a treatment planning support tool in daily clinical practice.

The current state of MRI-based radiomics in pituitary adenoma: promising but challenging

In the clinical diagnosis and treatment of pituitary adenomas, MRI plays a crucial role. However, traditional manual interpretations are plagued by inter-observer variability and limitations in recognizing details. Radiomics, based on MRI, facilitates quantitative analysis by extracting high-throughput data from images. This approach elucidates correlations between imaging features and pituitary tumor characteristics, thereby establishing imaging biomarkers. Recent studies have demonstrated the extensive application of radiomics in differential diagnosis, subtype identification, consistency evaluation, invasiveness assessment, and treatment response in pituitary adenomas. This review succinctly presents the general workflow of radiomics, reviews pertinent literature with a summary table, and provides a comparative analysis with traditional methods. We further elucidate the connections between radiological features and biological findings in the field of pituitary adenoma. While promising, the clinical application of radiomics still has a considerable distance to traverse, considering the issues with reproducibility of imaging features and the significant heterogeneity in pituitary adenoma patients.

Computational surgery in the management of patients with abdominal aortic aneurysms: Opportunities, challenges, and future directions

Computational surgery (CS) is an interdisciplinary field that uses mathematical models and algorithms to focus specifically on operative planning, simulation, and outcomes analysis to improve surgical care provision. As the digital revolution transforms the surgical work environment through broader adoption of artificial intelligence and machine learning, close collaboration between surgeons and computational scientists is not only unavoidable, but will become essential. In this review, the authors summarize the main advances, as well as ongoing challenges and prospects, that surround the implementation of CS techniques in vascular surgery, with a particular focus on the care of patients affected by abdominal aortic aneurysms (AAAs). Several key areas of AAA care delivery, including patient-specific modelling, virtual surgery simulation, intraoperative imaging-guided surgery, and predictive analytics, as well as biomechanical analysis and machine learning, will be discussed. The overarching goals of these CS applications is to improve the precision and accuracy of AAA repair procedures, while enhancing safety and long-term outcomes. Accordingly, CS has the potential to significantly enhance patient care across the entire surgical journey, from preoperative planning and intraoperative decision making to postoperative surveillance. Moreover, CS-based approaches offer promising opportunities to augment AAA repair quality by enabling precise preoperative simulations, real-time intraoperative navigation, and robust postoperative monitoring. However, integrating these advanced computer-based technologies into medical research and clinical practice presents new challenges. These include addressing technical limitations, ensuring accuracy and reliability, and managing unique ethical considerations associated with their use. Thorough evaluation of these aspects of advanced computation techniques in AAA management is crucial before widespread integration into health care systems can be achieved.

Current Applications and Future Perspectives of Artificial and Biomimetic Intelligence in Vascular Surgery and Peripheral Artery Disease

Artificial Intelligence (AI) made its first appearance in 1956, and since then it has progressively introduced itself in healthcare systems and patients' information and care. AI functions can be grouped under the following headings: Machine Learning (ML), Deep Learning (DL), Artificial Neural Network (ANN), Convolutional Neural Network (CNN), Computer Vision (CV). Biomimetic intelligence (BI) applies the principles of systems of nature to create biological algorithms, such as genetic and neural network, to be used in different scenarios. Chronic limb-threatening ischemia (CLTI) represents the last stage of peripheral artery disease (PAD) and has increased over recent years, together with the rise in prevalence of diabetes and population ageing. Nowadays, AI and BI grant the possibility of developing new diagnostic and treatment solutions in the vascular field, given the possibility of accessing clinical, biological, and imaging data. By assessing the vascular anatomy in every patient, as well as the burden of atherosclerosis, and classifying the level and degree of disease, sizing and planning the best endovascular treatment, defining the perioperative complications risk, integrating experiences and resources between different specialties, identifying latent PAD, thus offering evidence-based solutions and guiding surgeons in the choice of the best surgical technique, AI and BI challenge the role of the physician's experience in PAD treatment.

Multicentric clinical evaluation of a computed tomography-based fully automated deep neural network for aortic maximum diameter and volumetric measurements

OBJECTIVE

This study aims to evaluate a fully automatic deep learning-based method (augmented radiology for vascular aneurysm [ARVA]) for aortic segmentation and simultaneous diameter and volume measurements.

METHODS

A clinical validation dataset was constructed from preoperative and postoperative aortic computed tomography angiography (CTA) scans for assessing these functions. The dataset totaled 350 computed tomography angiography scans from 216 patients treated at two different hospitals. ARVA's ability to segment the aorta into seven morphologically based aortic segments and measure maximum outer-to-outer wall transverse diameters and compute volumes for each was compared with the measurements of six experts (ground truth) and thirteen clinicians.

RESULTS

Ground truth (experts') measurements of diameters and volumes were manually performed for all aortic segments. The median absolute diameter difference between ground truth and ARVA was 1.6 mm (95% confidence interval [CI], 1.5-1.7; and 1.6 mm [95% CI, 1.6-1.7]) between ground truth and clinicians. ARVA produced measurements within the clinical acceptable range with a proportion of 85.5% (95% CI, 83.5-86.3) compared with the clinicians' 86.0% (95% CI, 83.9-86.0). The median volume similarity error ranged from 0.93 to 0.95 in the main trunk and achieved 0.88 in the iliac arteries.

CONCLUSIONS

This study demonstrates the reliability of a fully automated artificial intelligence-driven solution capable of quick aortic segmentation and analysis of both diameter and volume for each segment.

Computed tomography-based automated measurement of abdominal aortic aneurysm using semantic segmentation with active learning

Accurate measurement of abdominal aortic aneurysm is essential for selecting suitable stent-grafts to avoid complications of endovascular aneurysm repair. However, the conventional image-based measurements are inaccurate and time-consuming. We introduce the automated workflow including semantic segmentation with active learning (AL) and measurement using an application programming interface of computer-aided design. 300 patients underwent CT scans, and semantic segmentation for aorta, thrombus, calcification, and vessels was performed in 60-300 cases with AL across five stages using UNETR, SwinUNETR, and nnU-Net consisted of 2D, 3D U-Net, 2D-3D U-Net ensemble, and cascaded 3D U-Net. 7 clinical landmarks were automatically measured for 96 patients. In AL stage 5, 3D U-Net achieved the highest dice similarity coefficient (DSC) with statistically significant differences (p < 0.01) except from the 2D-3D U-Net ensemble and cascade 3D U-Net. SwinUNETR excelled in 95% Hausdorff distance (HD95) with significant differences (p < 0.01) except from UNETR and 3D U-Net. DSC of aorta and calcification were saturated at stage 1 and 4, whereas thrombus and vessels were continuously improved at stage 5. The segmentation time between the manual and AL-corrected segmentation using the best model (3D U-Net) was reduced to 9.51 ± 1.02, 2.09 ± 1.06, 1.07 ± 1.10, and 1.07 ± 0.97 min for the aorta, thrombus, calcification, and vessels, respectively (p < 0.001). All measurement and tortuosity ratio measured - 1.71 ± 6.53 mm and - 0.15 ± 0.25. We developed an automated workflow with semantic segmentation and measurement, demonstrating its efficiency compared to conventional methods.

USE-Evaluator: Performance metrics for medical image segmentation models supervised by uncertain, small or empty reference annotations in neuroimaging

Performance metrics for medical image segmentation models are used to measure the agreement between the reference annotation and the predicted segmentation. Usually, overlap metrics, such as the Dice, are used as a metric to evaluate the performance of these models in order for results to be comparable. However, there is a mismatch between the distributions of cases and the difficulty level of segmentation tasks in public data sets compared to clinical practice. Common metrics used to assess performance fail to capture the impact of this mismatch, particularly when dealing with datasets in clinical settings that involve challenging segmentation tasks, pathologies with low signal, and reference annotations that are uncertain, small, or empty. Limitations of common metrics may result in ineffective machine learning research in designing and optimizing models. To effectively evaluate the clinical value of such models, it is essential to consider factors such as the uncertainty associated with reference annotations, the ability to accurately measure performance regardless of the size of the reference annotation volume, and the classification of cases where reference annotations are empty. We study how uncertain, small, and empty reference annotations influence the value of metrics on a stroke in-house data set regardless of the model. We examine metrics behavior on the predictions of a standard deep learning framework in order to identify suitable metrics in such a setting. We compare our results to the BRATS 2019 and Spinal Cord public data sets. We show how uncertain, small, or empty reference annotations require a rethinking of the evaluation. The evaluation code was released to encourage further analysis of this topic https://github.com/SophieOstmeier/UncertainSmallEmpty.git.

Research on augmented reality navigation of in vitro fenestration of stent-graft based on deep learning and virtual-real registration

OBJECTIVES

In vitro fenestration of stent-graft (IVFS) demands high-precision navigation methods to achieve optimal surgical outcomes. This study aims to propose an augmented reality (AR) navigation method for IVFS, which can provide in situ overlay display to locate fenestration positions.

METHODS

We propose an AR navigation method to assist doctors in performing IVFS. A deep learning-based aorta segmentation algorithm is used to achieve automatic and rapid aorta segmentation. The Vuforia-based virtual-real registration and marker recognition algorithm are integrated to ensure accurate in situ AR image.

RESULTS

The proposed method can provide three-dimensional in situ AR image, and the fiducial registration error after virtual-real registration is 2.070 mm. The aorta segmentation experiment obtains dice similarity coefficient of 91.12% and Hausdorff distance of 2.59, better than conventional algorithms before improvement.

CONCLUSIONS

The proposed method can intuitively and accurately locate fenestration positions, and therefore can assist doctors in performing IVFS.

Artificial Intelligence-Assisted Sac Diameter Assessment for Complex Endovascular Aortic Repair

PURPOSE

Artificial intelligence (AI) using an automated, deep learning-based method, Augmented Radiology for Vascular Aneurysm (ARVA), has been verified as a viable aide in aneurysm morphology assessment. The aim of this study was to evaluate the accuracy of ARVA when analyzing preoperative and postoperative computed tomography angiography (CTA) in patients managed with fenestrated endovascular repair (FEVAR) for complex aortic aneurysms (cAAs).

MATERIALS AND METHODS

Preoperative and postoperative CTAs from 50 patients (n=100 CTAs) who underwent FEVAR for cAAs were extracted from the picture archiving and communication system (PACS) of a single aortic center equipped with ARVA. All studies underwent automated AI aneurysm morphology assessment by ARVA. Appropriate identification of the outer wall of the aorta was verified by manual review of the AI-generated overlays for each patient. Maximum outer-wall aortic diameters were measured by 2 clinicians using multiplanar reconstruction (MPR) and curved planar reformatting (CPR), and among studies where the aortic wall was appropriately identified by ARVA, they were compared with ARVA automated measurements.

RESULTS

Identification of the outer wall of the aorta was accurate in 89% of CTA studies. Among these, diameter measurements by ARVA were comparable to clinician measurements by MPR or CPR, with a median absolute difference of 2.4 mm on the preoperative CTAs and 1.6 mm on the postoperative CTAs. Of note, no significant difference was detected between clinician measurements using MPR or CPR on preoperative and postoperative scans (range 0.5-0.9 mm).

CONCLUSION

For patients with cAAs managed with FEVAR, ARVA provides accurate preoperative and postoperative assessment of aortic diameter in 89% of studies. This technology may provide an opportunity to automate cAA morphology assessment in most cases where time-intensive, manual clinician measurements are currently required.

CLINICAL IMPACT

In this retrospective analysis of preoperative and postoperative imaging from 50 patients managed with FEVAR, AI provided accurate aortic diameter measurements in 89% of the CTAs reviewed, despite the complexity of the aortic anatomies, and in post-operative CTAs despite metal artifact from stent grafts, markers and embolization materials. Outliers with imprecise automated aortic overlays were easily identified by scrolling through the axial AI-generated segmentation MPR cuts of the entire aorta.This study supports the notion that such emerging AI technologies can improve efficiency of routine clinician workflows while maintaining excellent measurement accuracy when analyzing complex aortic anatomies by CTA.

Artificial Intelligence Application to Screen Abdominal Aortic Aneurysm Using Computed tomography Angiography

The aim of our study is to validate a totally automated deep learning (DL)-based segmentation pipeline to screen abdominal aortic aneurysms (AAA) in computed tomography angiography (CTA) scans. We retrospectively evaluated 73 thoraco-abdominal CTAs (48 AAA and 25 control CTA) by means of a DL-based segmentation pipeline built on a 2.5D convolutional neural network (CNN) architecture to segment lumen and thrombus of the aorta. The maximum aortic diameter of the abdominal tract was compared using a threshold value (30 mm). Blinded manual measurements from a radiologist were done in order to create a true comparison. The screening pipeline was tested on 48 patients with aneurysm and 25 without aneurysm. The average diameter manually measured was 51.1 ± 14.4 mm for patients with aneurysms and 21.7 ± 3.6 mm for patients without aneurysms. The pipeline correctly classified 47 AAA out of 48 and 24 control patients out of 25 with 97% accuracy, 98% sensitivity, and 96% specificity. The automated pipeline of aneurysm measurements in the abdominal tract reported a median error with regard to the maximum abdominal diameter measurement of 1.3 mm. Our approach allowed for the maximum diameter of 51.2 ± 14.3 mm in patients with aneurysm and 22.0 ± 4.0 mm in patients without an aneurysm. The DL-based screening for AAA is a feasible and accurate method, calling for further validation using a larger pool of diagnostic images towards its clinical use.

Artificial intelligence in clinical workflow processes in vascular surgery and beyond

In the past decade, artificial intelligence (AI)-based applications have exploded in health care. In cardiovascular disease, and vascular surgery specifically, AI tools such as machine learning, natural language processing, and deep neural networks have been applied to automatically detect underdiagnosed diseases, such as peripheral artery disease, abdominal aortic aneurysms, and atherosclerotic cardiovascular disease. In addition to disease detection and risk stratification, AI has been used to identify guideline-concordant statin therapy use and reasons for nonuse, which has important implications for population-based cardiovascular disease health. Although many studies highlight the potential applications of AI, few address true clinical workflow implementation of available AI-based tools. Specific examples, such as determination of optimal statin treatment based on individual patient risk factors and enhancement of intraoperative fluoroscopy and ultrasound imaging, demonstrate the potential promise of AI integration into clinical workflow. Many challenges to AI implementation in health care remain, including data interoperability, model bias and generalizability, prospective evaluation, privacy and security, and regulation. Multidisciplinary and multi-institutional collaboration, as well as adopting a framework for integration, will be critical for the successful implementation of AI tools into clinical practice.

Automatic Detection of Visceral Arterial Aneurysms on Computed Tomography Angiography Using Artificial Intelligence Based Segmentation of the Vascular System

Introduction

Visceral arterial aneurysms (VAAs) are life threatening. Due to the paucity of symptoms and rarity of the disease, VAAs are underdiagnosed and underestimated. Artificial intelligence (AI) offers new insights into segmentation of the vascular system, and opportunities to better detect VAAs. This pilot study aimed to develop an AI based method to automatically detect VAAs from computed tomography angiography (CTA).

Methods

A hybrid method combining a feature based expert system with a supervised deep learning algorithm (convolutional neural network) was used to enable fully automatic segmentation of the abdominal vascular tree. Centrelines were built and reference diameters of each visceral artery were calculated. An abnormal dilatation (VAAs) was defined as a substantial increase in diameter at the pixel of interest compared with the mean diameter of the reference portion. The automatic software provided 3D rendered images with a flag on the identified VAA areas. The performance of the method was tested in a dataset of 33 CTA scans and compared with the ground truth provided by two human experts.

Results

Forty-three VAAs were identified by human experts (32 in the coeliac trunk branches, eight in the superior mesenteric artery, one in the left renal, and two in the right renal arteries). The automatic system accurately detected 40 of the 43 VAAs, with a sensitivity of 0.93 and a positive predictive value of 0.51. The mean number of flag areas per CTA was 3.5 ± 1.5 and they could be reviewed and checked by a human expert in less than 30 seconds per CTA.

Conclusion

Although the specificity needs to be improved, this study demonstrates the potential of an AI based automatic method to develop new tools to improve screening and detection of VAAs by automatically attracting clinicians' attention to suspicious dilatations of the visceral arteries.

Deep-learning method for fully automatic segmentation of the abdominal aortic aneurysm from computed tomography imaging

Abdominal aortic aneurysm (AAA) is one of the leading causes of death worldwide. AAAs often remain asymptomatic until they are either close to rupturing or they cause pressure to the spine and/or other organs. Fast progression has been linked to future clinical outcomes. Therefore, a reliable and efficient system to quantify geometric properties and growth will enable better clinical prognoses for aneurysms. Different imaging systems can be used to locate and characterize an aneurysm; computed tomography (CT) is the modality of choice in many clinical centers to monitor later stages of the disease and plan surgical treatment. The lack of accurate and automated techniques to segment the outer wall and lumen of the aneurysm results in either simplified measurements that focus on few salient features or time-consuming segmentation affected by high inter- and intra-operator variability. To overcome these limitations, we propose a model for segmenting AAA tissues automatically by using a trained deep learning-based approach. The model is composed of three different steps starting with the extraction of the aorta and iliac arteries followed by the detection of the lumen and other AAA tissues. The results of the automated segmentation demonstrate very good agreement when compared to manual segmentation performed by an expert.

Abdominal Aortic Thrombus Segmentation in Postoperative Computed Tomography Angiography Images Using Bi-Directional Convolutional Long Short-Term Memory Architecture

Abdominal aortic aneurysm (AAA) is a fatal clinical condition with high mortality. Computed tomography angiography (CTA) imaging is the preferred minimally invasive modality for the long-term postoperative observation of AAA. Accurate segmentation of the thrombus region of interest (ROI) in a postoperative CTA image volume is essential for quantitative assessment and rapid clinical decision making by clinicians. Few investigators have proposed the adoption of convolutional neural networks (CNN). Although these methods demonstrated the potential of CNN architectures by automating the thrombus ROI segmentation, the segmentation performance can be further improved. The existing methods performed the segmentation process independently per 2D image and were incapable of using adjacent images, which could be useful for the robust segmentation of thrombus ROIs. In this work, we propose a thrombus ROI segmentation method to utilize not only the spatial features of a target image, but also the volumetric coherence available from adjacent images. We newly adopted a recurrent neural network, bi-directional convolutional long short-term memory (Bi-CLSTM) architecture, which can learn coherence between a sequence of data. This coherence learning capability can be useful for challenging situations, for example, when the target image exhibits inherent postoperative artifacts and noises, the inclusion of adjacent images would facilitate learning more robust features for thrombus ROI segmentation. We demonstrate the segmentation capability of our Bi-CLSTM-based method with a comparison of the existing 2D-based thrombus ROI segmentation counterpart as well as other established 2D- and 3D-based alternatives. Our comparison is based on a large-scale clinical dataset of 60 patient studies (i.e., 60 CTA image volumes). The results suggest the superior segmentation performance of our Bi-CLSTM-based method by achieving the highest scores of the evaluation metrics, e.g., our Bi-CLSTM results were 0.0331 higher on total overlap and 0.0331 lower on false negative when compared to 2D U-net++ as the second-best.

Automatic segmentation of thrombosed aortic dissection in post-operative CT-angiography images

PURPOSE

The thrombus in the false lumen (FL) of aortic dissection (AD) patients is a meaningful indicator to determine aortic remodeling but difficult to measure in clinic. In this study, a novel segmentation strategy based on deep learning was proposed to automatically extract the thrombus in the FL in post-operative computed tomography angiography (CTA) images of AD patients, which provided an efficient and convenient segmentation method with high accuracy.

METHODS

A two-step segmentation strategy was proposed. Each step contained a convolutional neural network (CNN) to segment the aorta and the thrombus, respectively. In the first step, a CNN was used to obtain the binary segmentation mask of the whole aorta. In the second step, another CNN was introduced to segment the thrombus. The results of the first step were used as additional input to the second step to highlight the aorta in the complex background. Moreover, skip connection attention refinement (SAR) modules were designed and added in the second step to improve the segmentation accuracy of the thrombus details by efficiently using the low-level features.

RESULTS

The proposed method provided accurate thrombus segmentation results (0.903 ± 0.062 in dice score, 0.828 ± 0.092 in Jaccard index, and 2.209 ± 2.945 in 95% Hausdorff distance), which showed improvement compared to the methods without prior information (0.846 ± 0.085 in dice score) and the method without SAR (0.899 ± 0.060 in dice score). Moreover, the proposed method achieved 0.967 ± 0.029 and 0.948 ± 0.041 in dice score of true lumen (TL) and patent FL (PFL) segmentation, respectively, indicating the excellence of the proposed method in the segmentation task of the overall aorta.

CONCLUSIONS

A novel CNN-based segmentation framework was proposed to automatically obtain thrombus segmentation for thrombosed AD in post-operative CTA images, which provided a useful tool for further application of thrombus-related indicators in clinical and research application.

Diagnostic Accuracy of AI for Opportunistic Screening of Abdominal Aortic Aneurysm in CT: A Systematic Review and Narrative Synthesis

In this review, we focused on the applicability of artificial intelligence (AI) for opportunistic abdominal aortic aneurysm (AAA) detection in computed tomography (CT). We used the academic search system PubMed as the primary source for the literature search and Google Scholar as a supplementary source of evidence. We searched through 2 February 2022. All studies on automated AAA detection or segmentation in noncontrast abdominal CT were included. For bias assessment, we developed and used an adapted version of the QUADAS-2 checklist. We included eight studies with 355 cases, of which 273 (77%) contained AAA. The highest risk of bias and level of applicability concerns were observed for the "patient selection" domain, due to the 100% pathology rate in the majority (75%) of the studies. The mean sensitivity value was 95% (95% CI 100-87%), the mean specificity value was 96.6% (95% CI 100-75.7%), and the mean accuracy value was 95.2% (95% CI 100-54.5%). Half of the included studies performed diagnostic accuracy estimation, with only one study having data on all diagnostic accuracy metrics. Therefore, we conducted a narrative synthesis. Our findings indicate high study heterogeneity, requiring further research with balanced noncontrast CT datasets and adherence to reporting standards in order to validate the high sensitivity value obtained.

Evaluation of a hybrid pipeline for automated segmentation of solid lesions based on mathematical algorithms and deep learning

We evaluate the accuracy of an original hybrid segmentation pipeline, combining variational and deep learning methods, in the segmentation of CT scans of stented aortic aneurysms, abdominal organs and brain lesions. The hybrid pipeline is trained on 50 aortic CT scans and tested on 10. Additionally, we trained and tested the hybrid pipeline on publicly available datasets of CT scans of abdominal organs and MR scans of brain tumours. We tested the accuracy of the hybrid pipeline against a gold standard (manual segmentation) and compared its performance to that of a standard automated segmentation method with commonly used metrics, including the DICE and JACCARD and volumetric similarity (VS) coefficients, and the Hausdorff Distance (HD). Results. The hybrid pipeline produced very accurate segmentations of the aorta, with mean DICE, JACCARD and VS coefficients of: 0.909, 0.837 and 0.972 in thrombus segmentation and 0.937, 0.884 and 0.970 for stent and lumen segmentation. It consistently outperformed the standard automated method. Similar results were observed when the hybrid pipeline was trained and tested on publicly available datasets, with mean DICE scores of: 0.832 on brain tumour segmentation, and 0.894/0.841/0.853/0.847/0.941 on left kidney/right kidney/spleen/aorta/liver organ segmentation.

Proceedings from the Society of Interventional Radiology Foundation Research Consensus Panel on Artificial Intelligence in Interventional Radiology: From Code to Bedside

Artificial intelligence (AI)-based technologies are the most rapidly growing field of innovation in healthcare with the promise to achieve substantial improvements in delivery of patient care across all disciplines of medicine. Recent advances in imaging technology along with marked expansion of readily available advanced health information, data offer a unique opportunity for interventional radiology (IR) to reinvent itself as a data-driven specialty. Additionally, the growth of AI-based applications in diagnostic imaging is expected to have downstream effects on all image-guidance modalities. Therefore, the Society of Interventional Radiology Foundation has called upon 13 key opinion leaders in the field of IR to develop research priorities for clinical applications of AI in IR. The objectives of the assembled research consensus panel were to assess the availability and understand the applicability of AI for IR, estimate current needs and clinical use cases, and assemble a list of research priorities for the development of AI in IR. Individual panel members proposed and all participants voted upon consensus statements to rank them according to their overall impact for IR. The results identified the top priorities for the IR research community and provide organizing principles for innovative academic-industrial research collaborations that will leverage both clinical expertise and cutting-edge technology to benefit patient care in IR.

Fully automatic volume segmentation using deep learning approaches to assess aneurysmal sac evolution after infra-renal endovascular aortic repair

OBJECTIVE

Endovascular aortic repair (EVAR) surveillance relies on serial measurements of maximal diameter despite significant inter- and intra-observer variability. Volumetric measurements are more sensitive but general use is hampered by the time required for their implementation. An innovative fully automated software (PRAEVAorta® from Nurea), using artificial intelligence (AI), previously demonstrated fast and robust detection of infra-renal abdominal aortic aneurysm's (AAA) characteristics on pre-operative imaging. This study aimed to assess the robustness of these data on post-EVAR computed tomography (CT) scans.

METHODS

Comparison was made between fully automatic and semi-automatic segmentation manually corrected by a senior surgeon on a dataset of 48 patients (48 early post-EVAR CT scans with 6466 slices, and a total of 101 follow-up CT scans with 13708 slices).

RESULTS

The analyses confirmed an excellent correlation of post-EVAR volumes and surfaces, as well as, proximal neck and maximum aneurysm diameters measured with the fully automatic and manually corrected segmentation methods (Pearson's coefficient correlation >.99, p<.0001). Comparison between the fully automatic and manually corrected segmentation method revealed a mean Dice Similarity Coefficient of 0.950±0.015, Jaccard index of 0.906±0.028, Sensitivity of 0.929±0.028, Specificity of 0.965±0.016, Volumetric Similarity (VS) of 0.973±0.018 and mean Hausdorff Distance/slice of 8.7±10.8mm. The mean VS reached 0.873±0.100 for the lumen and 0.903±0.091 for the thrombus. The segmentation time was 9 times faster with the fully automatic method (2.5 vs 22 min/patient with the manually corrected method; p<.0001). Preliminary analysis also demonstrated that a diameter increase of 2mm can actually represent >5% volume increase.

CONCLUSION

PRAEVAorta® enables a fast, reproducible, and fully automated analysis of post-EVAR AAA sac and neck characteristics, with comparison between different time points. It could become a crucial adjunct for EVAR follow-up through early detection of sac evolution, which may reduce the risk of secondary rupture.

Development and Comparison of Multimodal Models for Preoperative Prediction of Outcomes After Endovascular Aneurysm Repair

Objective

The aim of this study was to develop and compare multimodal models for predicting outcomes after endovascular abdominal aortic aneurysm repair (EVAR) based on morphological, deep learning (DL), and radiomic features.

Methods

We retrospectively reviewed 979 patients (January 2010—December 2019) with infrarenal abdominal aortic aneurysms (AAAs) who underwent elective EVAR procedures. A total of 486 patients (January 2010–December 2015) were used for morphological feature model development and optimization. Univariable and multivariable analyses were conducted to determine significant morphological features of EVAR-related severe adverse events (SAEs) and to build a morphological feature model based on different machine learning algorithms. Subsequently, to develop the morphological feature model more easily and better compare with other modal models, 340 patients of AAA with intraluminal thrombosis (ILT) were used for automatic segmentation of ILT based on deep convolutional neural networks (DCNNs). Notably, 493 patients (January 2016–December 2019) were used for the development and comparison of multimodal models (optimized morphological feature, DL, and radiomic models). Of note, 80% of patients were classified as the training set and 20% of patients were classified as the test set. The area under the curve (AUC) was used to evaluate the predictive abilities of different modal models.

Results

The mean age of the patients was 69.9 years, the mean follow-up was 54 months, and 307 (31.4%) patients experienced SAEs. Statistical analysis revealed that short neck, angulated neck, conical neck, ILT, ILT percentage ≥51.6%, luminal calcification, double iliac sign, and common iliac artery index ≥1.255 were associated with SAEs. The morphological feature model based on the support vector machine had a better predictive performance with an AUC of 0.76, an accuracy of 0.76, and an F1 score of 0.82. Our DCNN model achieved a mean intersection over union score of more than 90.78% for the segmentation of ILT and AAA aortic lumen. The multimodal model result showed that the radiomic model based on logistics regression had better predictive performance (AUC 0.93, accuracy 0.86, and F1 score 0.91) than the optimized morphological feature model (AUC 0.62, accuracy 0.69, and F1 score 0.81) and the DL model (AUC 0.82, accuracy 0.85, and F1 score 0.89).

Conclusion

The radiomic model has better predictive performance for patient status after EVAR. The morphological feature model and DL model have their own advantages and could also be used to predict outcomes after EVAR.

Fully automatic segmentation of abdominal aortic thrombus in pre-operative CTA images using deep convolutional neural networks

BACKGROUND

Endovascular aortic aneurysm repair (EVAR) is currently established as the first-line treatment for anatomically suitable abdominal aortic aneurysm (AAA).

OBJECTIVE

To establish a deep convolutional neural networks (DCNN) model for fully automatic segmentation intraluminal thrombosis (ILT) of abdominal aortic aneurysm (AAA) in pre-operative computed tomography angiography (CTA) images.

METHODS

We retrospectively reviewed 340 patients of AAA with ILT at our single center. The software ITKSNAP was used to draw AAA and ILT region of interests (ROIs), respectively. Image preprocessing and DCNN model build using MATLAB. Randomly divided, 80% of patients was classified as training set, 20% of patients was classified as test set. Accuracy, intersection over union (IOU), Boundary F1 (BF) Score were used to evaluate the predictive effect of the model.

RESULTS

By training in 34760-35652 CTA images (n= 204) and validation in 6968-7860 CTA images (n=68), the DCNN model achieved encouraging predictive performance in test set (n= 68, 6898 slices): Global accuracy 0.9988 ± 5.7735E-05, mean accuracy 0.9546 ± 0.0054, ILT IOU 0.8650 ± 0.0033, aortic lumen IOU 0.8595 ± 0.0085, ILT weighted IOU 0.9976 ± 0.0001, mean IOU 0.9078 ± 0.0029, mean BF Score 0.9829 ± 0.0011. Our DCNN model achieved a mean IOU of more than 90.78% for segmentation of ILT and aortic lumen. It provides a mean relative volume difference between automatic segmentation and ground truth (P> 0.05).

CONCLUSION

An end-to-end DCNN model could be used as an efficient and adjunctive tool for fully automatic segmentation of abdominal aortic thrombus in pre-operative CTA image.

Deep Learning to Automatically Segment and Analyze Abdominal Aortic Aneurysm from Computed Tomography Angiography

PURPOSE

Although segmentation of Abdominal Aortic Aneurysms (AAA) thrombus is a crucial step for both the planning of endovascular treatment and the monitoring of the intervention's outcome, it is still performed manually implying time consuming operations as well as operator dependency. The present paper proposes a fully automatic pipeline to segment the intraluminal thrombus in AAA from contrast-enhanced Computed Tomography Angiography (CTA) images and to subsequently analyze AAA geometry.

METHODS

A deep-learning-based pipeline is developed to localize and segment the thrombus from the CTA scans. The thrombus is first identified in the whole sub-sampled CTA, then multi-view U-Nets are combined together to segment the thrombus from the identified region of interest. Polygonal models are generated for the thrombus and the lumen. The lumen centerline is automatically extracted from the lumen mesh and used to compute the aneurysm and lumen diameters.

RESULTS

The proposed multi-view integration approach returns an improvement in thrombus segmentation with respect to the single-view prediction. The thrombus segmentation model is trained over a training set of 63 CTA and a validation set of 8 CTA scans. By comparing the thrombus segmentation predicted by the model with the ground truth data, a Dice Similarity Coefficient (DSC) of 0.89 ± 0.04 is achieved. The AAA geometry analysis provided an Intraclass Correlation Coefficient (ICC) of 0.92 and a mean-absolute difference of 3.2 ± 2.4 mm, for the measurements of the total diameter of the aneurysm. Validation of both thrombus segmentation and aneurysm geometry analysis is performed over a test set of 14 CTA scans.

CONCLUSION

The developed deep learning models can effectively segment the thrombus from patients affected by AAA. Moreover, the diameters automatically extracted from the AAA show high correlation with those manually measured by experts.

Pre-surgical and Post-surgical Aortic Aneurysm Maximum Diameter Measurement: Full Automation by Artificial Intelligence

OBJECTIVE

The aim of this study was to evaluate an automatic, deep learning based method (Augmented Radiology for Vascular Aneurysm [ARVA]), to detect and assess maximum aortic diameter, providing cross sectional outer to outer aortic wall measurements.

METHODS

Accurate external aortic wall diameter measurement is performed along the entire aorta, from the ascending aorta to the iliac bifurcations, on both pre- and post-operative contrast enhanced computed tomography angiography (CTA) scans. A training database of 489 CTAs was used to train a pipeline of neural networks for automatic external aortic wall measurements. Another database of 62 CTAs, including controls, aneurysmal aortas, and aortic dissections scanned before and/or after endovascular or open repair, was used for validation. The measurements of maximum external aortic wall diameter made by ARVA were compared with those of seven clinicians on this validation dataset.

RESULTS

The median absolute difference with respect to expert's measurements ranged from 1 mm to 2 mm among all annotators, while ARVA reported a median absolute difference of 1.2 mm.

CONCLUSION

The performance of the automatic maximum aortic diameter method falls within the interannotator variability, making it a potentially reliable solution for assisting clinical practice.

Artificial intelligence and machine learning in aortic disease

PURPOSE OF REVIEW

Discuss foundational concepts for artificial intelligence (AI) and review recent literature on its application to aortic disease.

RECENT FINDINGS

Machine learning (ML) techniques are rapidly evolving for the evaluation of aortic disease - broadly categorized as algorithms for aortic segmentation, detection of pathology, and risk stratification. Advances in deep learning, particularly U-Net architectures, have revolutionized segmentation of the aorta and show potential for monitoring the size of aortic aneurysm and characterizing aortic dissection. These algorithms also facilitate application of more complex technologies including analysis of flow dynamics with 4D Flow magnetic resonance imaging (MRI) and computational simulation of fluid dynamics for aortic coarctation. In addition, AI algorithms have been proposed to assist in 'opportunistic' screening from routine imaging exams, including automated aortic calcification score, which has emerged as a strong predictor of cardiovascular risk. Finally, several ML algorithms are being explored for risk stratification of patients with aortic aneurysm and dissection, in addition to prediction of postprocedural complications.

SUMMARY

Multiple ML techniques have potential for characterization and risk prediction of aortic aneurysm, dissection, coarctation, and atherosclerotic disease on computed tomography and MRI. This nascent field shows considerable promise with many applications in development and in early preclinical evaluation.

Leveraging Machine Learning and Artificial Intelligence to Improve Peripheral Artery Disease Detection, Treatment, and Outcomes

Peripheral artery disease is an atherosclerotic disorder which, when present, portends poor patient outcomes. Low diagnosis rates perpetuate poor management, leading to limb loss and excess rates of cardiovascular morbidity and death. Machine learning algorithms and artificially intelligent systems have shown great promise in application to many areas in health care, such as accurately detecting disease, predicting patient outcomes, and automating image interpretation. Although the application of these technologies to peripheral artery disease are in their infancy, their promises are tremendous. In this review, we provide an introduction to important concepts in the fields of machine learning and artificial intelligence, detail the current state of how these technologies have been applied to peripheral artery disease, and discuss potential areas for future care enhancement with advanced analytics.