Machine learning in vascular surgery: a systematic review and critical appraisal

An Appraisal of the Quality of Development and Reporting of Predictive Models in Neurosurgery: A Systematic Review

BACKGROUND AND OBJECTIVES

Significant evidence has indicated that the reporting quality of novel predictive models is poor because of confounding by small data sets, inappropriate statistical analyses, and a lack of validation and reproducibility. The Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD) statement was developed to increase the generalizability of predictive models. This study evaluated the quality of predictive models reported in neurosurgical literature through their compliance with the TRIPOD guidelines.

METHODS

Articles reporting prediction models published in the top 5 neurosurgery journals by SCImago Journal Rank-2 (Neurosurgery, Journal of Neurosurgery, Journal of Neurosurgery: Spine, Journal of NeuroInterventional Surgery, and Journal of Neurology, Neurosurgery, and Psychiatry) between January 1st, 2018, and January 1st, 2023, were identified through a PubMed search strategy that combined terms related to machine learning and prediction modeling. These original research articles were analyzed against the TRIPOD criteria.

RESULTS

A total of 110 articles were assessed with the TRIPOD checklist. The median compliance was 57.4% (IQR: 50.0%-66.7%). Models using machine learning-based models exhibited lower compliance on average compared with conventional learning-based models (57.1%, 50.0%-66.7% vs 68.1%, 50.2%-68.1%, P = .472). Among the TRIPOD criteria, the lowest compliance was observed in blinding the assessment of predictors and outcomes (n = 7, 12.7% and n = 10, 16.9%, respectively), including an informative title (n = 17, 15.6%) and reporting model performance measures such as confidence intervals (n = 27, 24.8%). Few studies provided sufficient information to allow for the external validation of results (n = 26, 25.7%).

CONCLUSION

Published predictive models in neurosurgery commonly fall short of meeting the established guidelines laid out by TRIPOD for optimal development, validation, and reporting. This lack of compliance may represent the minor extent to which these models have been subjected to external validation or adopted into routine clinical practice in neurosurgery.

Deciphering Popliteal Artery Aneurysm Patient Diversity: Insights From a Cluster Analysis of the POPART Registry

BACKGROUND

Popliteal artery aneurysms (PAAs) are the most common peripheral aneurysm. However, due to its rarity, the cumulative body of evidence regarding patient patterns, treatment strategies, and perioperative outcomes is limited. This analysis aims to investigate distinct phenotypical patient profiles and associated treatment and outcomes in patients with a PAA by performing an unsupervised clustering analysis of the POPART (Practice of Popliteal Artery Aneurysm Repair and Therapy) registry.

METHODS AND RESULTS

A cluster analysis (using k-means clustering) was performed on data obtained from the multicenter POPART registry (42 centers from Germany and Luxembourg). Sensitivity analyses were conducted to explore validity and stability. Using 2 clusters, patients were primarily separated by the absence or presence of clinical symptoms. Within the cluster of symptomatic patients, the main difference between patients with acute limb ischemia presentation and nonemergency symptomatic patients was PAA diameter. When using 6 clusters, patients were primarily grouped by comorbidities, with patients with acute limb ischemia forming a separate cluster. Despite markedly different risk profiles, perioperative complication rates appeared to be positively associated with the proportion of emergency patients. However, clusters with a higher proportion of patients having any symptoms before treatment experienced a lower rate of perioperative complications.

CONCLUSIONS

The conducted analyses revealed both an insight to the public health reality of PAA care as well as patients with PAA at elevated risk for adverse outcomes. This analysis suggests that the preoperative clinic is a far more crucial adjunct to the patient's preoperative risk assessment than the patient's epidemiological profile by itself.

Streamlining Acute Abdominal Aortic Dissection Management-An AI-based CT Imaging Workflow

Life-threatening acute aortic dissection (AD) demands timely diagnosis for effective intervention. To streamline intrahospital workflows, automated detection of AD in abdominal computed tomography (CT) scans seems useful to assist humans. We aimed at creating a robust convolutional neural network (CNN)-based pipeline capable of real-time screening for signs of abdominal AD in CT. In this retrospective study, abdominal CT data from AD patients presenting with AD and from non-AD patients were collected (n 195, AD cases 94, mean age 65.9 years, female ratio 35.8%). A CNN-based algorithm was developed with the goal of enabling a robust, automated, and highly sensitive detection of abdominal AD. Two sets from internal (n = 32, AD cases 16) and external sources (n = 1189, AD cases 100) were procured for validation. The abdominal region was extracted, followed by the automatic isolation of the aorta region of interest (ROI) and highlighting of the membrane via edge extraction, followed by classification of the aortic ROI as dissected/healthy. A fivefold cross-validation was employed on the internal set, and an ensemble of the 5 trained models was used to predict the internal and external validation set. Evaluation metrics included receiver operating characteristic curve (AUC) and balanced accuracy. The AUC, balanced accuracy, and sensitivity scores of the internal dataset were 0.932 (CI 0.891-0.963), 0.860, and 0.885, respectively. For the internal validation dataset, the AUC, balanced accuracy, and sensitivity scores were 0.887 (CI 0.732-0.988), 0.781, and 0.875, respectively. Furthermore, for the external validation dataset, AUC, balanced accuracy, and sensitivity scores were 0.993 (CI 0.918-0.994), 0.933, and 1.000, respectively. The proposed automated pipeline could assist humans in expediting acute aortic dissection management when integrated into clinical workflows.

Predicting Major Adverse Carotid Cerebrovascular Events in Patients with Carotid Stenosis: Integrating a Panel of Plasma Protein Biomarkers and Clinical Features-A Pilot Study

Background: Carotid stenosis (CS) is an atherosclerotic disease of the carotid artery that can lead to devastating cardiovascular outcomes such as stroke, disability, and death. The currently available treatment for CS is medical management through risk reduction, including control of hypertension, diabetes, and/or hypercholesterolemia. Surgical interventions are currently suggested for patients with symptomatic disease with stenosis >50%, where patients have suffered from a carotid-related event such as a cerebrovascular accident, or asymptomatic disease with stenosis >60% if the long-term risk of death is <3%. There is a lack of current plasma protein biomarkers available to predict patients at risk of such adverse events. Methods: In this study, we investigated several growth factors and biomarkers of inflammation as potential biomarkers for adverse CS events such as stroke, need for surgical intervention, myocardial infarction, and cardiovascular-related death. In this pilot study, we use a support vector machine (SVM), random forest models, and the following four significantly elevated biomarkers: C-X-C Motif Chemokine Ligand 6 (CXCL6); Interleukin-2 (IL-2); Galectin-9; and angiopoietin-like protein (ANGPTL4). Results: Our SVM model best predicted carotid cerebrovascular events with an area under the curve (AUC) of >0.8 and an accuracy of 0.88, demonstrating strong prognostic capability. Conclusions: Our SVM model may be used for risk stratification of patients with CS to determine those who may benefit from surgical intervention.

Current Prognostic Biomarkers for Abdominal Aortic Aneurysm: A Comprehensive Scoping Review of the Literature

Abdominal aortic aneurysm (AAA) is a progressive dilatation of the aorta that can lead to aortic rupture. The pathophysiology of the disease is not well characterized but is known to be caused by the general breakdown of the extracellular matrix within the aortic wall. In this comprehensive literature review, all current research on proteins that have been investigated for their potential prognostic capabilities in patients with AAA was included. A total of 45 proteins were found to be potential prognostic biomarkers for AAA, predicting incidence of AAA, AAA rupture, AAA growth, endoleak, and post-surgical mortality. The 45 proteins fell into the following seven general categories based on their primary function: (1) cardiovascular health, (2) hemostasis, (3) transport proteins, (4) inflammation and immunity, (5) kidney function, (6) cellular structure, (7) and hormones and growth factors. This is the most up-to-date literature review on current prognostic markers for AAA and their functions. This review outlines the wide pathophysiological processes that are implicated in AAA disease progression.

The state of vascular surgery education in the United States

With the growing proportion of elderly population in the US and a relatively fixed supply of well-trained vascular surgeons, there is a serious concern that we will be facing a shortage of vascular surgery workforce in the near future. One of the main reasons why there is a shortage of vascular surgeons in the US is due to the fact that many students don't get exposed to this field throughout their student lives and a recent survey of medical students from a non-urban tertiary care academic institution showed that early exposure of the medical students to the surgical careers is correlated with an increased interest in the surgical field. This review of the state of vascular surgery education in the US at the undergraduate level describes in detail the importance of an early introduction to vascular surgery in the education curricula, the current state of the education, potential avenues to improve the exposure of students to the field of vascular surgery and the importance of this effort in matching the increasing need for vascular surgeons for an aging population which is likely to require dedicated care by vascular surgeons of the future. At the present time, the two pathways by the Accreditation Council for Graduate Medical Education (ACGME) to obtain dedicated vascular surgery training in the US include either enrolling in a two year clinical fellowship after completion of general surgery training or to match in a five year vascular surgery integrated residency program after successful completion of medical degree.

Artificial intelligence in surgery

Artificial intelligence (AI) is rapidly emerging in healthcare, yet applications in surgery remain relatively nascent. Here we review the integration of AI in the field of surgery, centering our discussion on multifaceted improvements in surgical care in the preoperative, intraoperative and postoperative space. The emergence of foundation model architectures, wearable technologies and improving surgical data infrastructures is enabling rapid advances in AI interventions and utility. We discuss how maturing AI methods hold the potential to improve patient outcomes, facilitate surgical education and optimize surgical care. We review the current applications of deep learning approaches and outline a vision for future advances through multimodal foundation models.

Predicting non-muscle invasive bladder cancer outcomes using artificial intelligence: a systematic review using APPRAISE-AI

Accurate prediction of recurrence and progression in non-muscle invasive bladder cancer (NMIBC) is essential to inform management and eligibility for clinical trials. Despite substantial interest in developing artificial intelligence (AI) applications in NMIBC, their clinical readiness remains unclear. This systematic review aimed to critically appraise AI studies predicting NMIBC outcomes, and to identify common methodological and reporting pitfalls. MEDLINE, EMBASE, Web of Science, and Scopus were searched from inception to February 5th, 2024 for AI studies predicting NMIBC recurrence or progression. APPRAISE-AI was used to assess methodological and reporting quality of these studies. Performance between AI and non-AI approaches included within these studies were compared. A total of 15 studies (five on recurrence, four on progression, and six on both) were included. All studies were retrospective, with a median follow-up of 71 months (IQR 32-93) and median cohort size of 125 (IQR 93-309). Most studies were low quality, with only one classified as high quality. While AI models generally outperformed non-AI approaches with respect to accuracy, c-index, sensitivity, and specificity, this margin of benefit varied with study quality (median absolute performance difference was 10 for low, 22 for moderate, and 4 for high quality studies). Common pitfalls included dataset limitations, heterogeneous outcome definitions, methodological flaws, suboptimal model evaluation, and reproducibility issues. Recommendations to address these challenges are proposed. These findings emphasise the need for collaborative efforts between urological and AI communities paired with rigorous methodologies to develop higher quality models, enabling AI to reach its potential in enhancing NMIBC care.

Development and evaluation of a prediction model for peripheral artery disease-related major adverse limb events using novel biomarker data

OBJECTIVE

Prognostic tools for individuals with peripheral artery disease (PAD) remain limited. We developed prediction models for 3-year PAD-related major adverse limb events (MALE) using demographic, clinical, and biomarker data previously validated by our group.

METHODS

We performed a prognostic study using a prospectively recruited cohort of patients with PAD (n = 569). Demographic/clinical data were recorded including sex, age, comorbidities, previous procedures, and medications. Plasma concentrations of three biomarkers (N-terminal pro-B-type natriuretic peptide [NT-proBNP], fatty acid binding protein 3 [FABP3], and FABP4) were measured at baseline. The cohort was followed for 3 years. MALE was the primary outcome (composite of open/endovascular vascular intervention or major amputation). We trained three machine learning models with 10-fold cross-validation using demographic, clinical, and biomarker data (random forest, decision trees, and Extreme Gradient Boosting [XGBoost]) to predict 3-year MALE in patients. Area under the receiver operating characteristic curve (AUROC) was the primary model evaluation metric.

RESULTS

Three-year MALE was observed in 162 patients (29%). XGBoost was the top-performing predictive model for 3-year MALE, achieving the following performance metrics: AUROC = 0.88 (95% confidence interval [CI], 0.84-0.94); sensitivity, 88%; specificity, 84%; positive predictive value, 83%; and negative predictive value, 91% on test set data. On an independent validation cohort of patients with PAD, XGBoost attained an AUROC of 0.87 (95% CI, 0.82-0.90). The 10 most important predictors of 3-year MALE consisted of: (1) FABP3; (2) FABP4; (3) age; (4) NT-proBNP; (5) active smoking; (6) diabetes; (7) hypertension; (8) dyslipidemia; (9) coronary artery disease; and (10) sex.

CONCLUSIONS

We built robust machine learning algorithms that accurately predict 3-year MALE in patients with PAD using demographic, clinical, and novel biomarker data. Our algorithms can support risk stratification of patients with PAD for additional vascular evaluation and early aggressive medical management, thereby improving outcomes. Further validation of our models for clinical implementation is warranted.

Contributions of Machine Learning in the Management of Stroke: A Bibliometric Analysis of the 50 Most Cited Articles

BACKGROUND

Though currently considered a 'black box,' machine learning (ML) has a promising future to ameliorate the health-care burden of stroke which is the second leading cause of mortality worldwide. Through this study, we sought to review the most influential articles on the applications of ML in stroke.

METHODS

Web of Sciences database was searched, and a list of the top 50 most cited articles, assessing the application of ML in stroke, was prepared by 2 authors, independently. Subsequently, a detailed analysis was performed to characterize the most impactful studies.

RESULTS

The total number of citations to the top 50 articles were 2959 (range 35-243 citations) with a median of 47 citations. Highest number of articles were published in the journal Stroke and the United States was the major contributing country. The majority of the studies focused on the utilization of ML to improve stroke risk prediction, diagnosis, and outcome prediction. Statistical analysis revealed an insignificant association between the total and mean number of citations and the impact factor of the journal (P = 0.516 and 0.987, respectively).

CONCLUSIONS

Recent years have witnessed a surge in the application of ML in stroke, with an enhancement in interest and funding over the years. ML has revolutionized the management of stroke and continues to aid in the neurosurgical decision-making and care in stroke patients.

A machine learning algorithm for peripheral artery disease prognosis using biomarker data

Peripheral artery disease (PAD) biomarkers have been studied in isolation; however, an algorithm that considers a protein panel to inform PAD prognosis may improve predictive accuracy. Biomarker-based prediction models were developed and evaluated using a model development (n = 270) and prospective validation cohort (n = 277). Plasma concentrations of 37 proteins were measured at baseline and the patients were followed for 2 years. The primary outcome was 2-year major adverse limb event (MALE; composite of vascular intervention or major amputation). Of the 37 proteins tested, 6 were differentially expressed in patients with vs. without PAD (ADAMTS13, ICAM-1, ANGPTL3, Alpha 1-microglobulin, GDF15, and endostatin). Using 10-fold cross-validation, we developed a random forest machine learning model that accurately predicts 2-year MALE in a prospective validation cohort of PAD patients using a 6-protein panel (AUROC 0.84). This algorithm can support PAD risk stratification, informing clinical decisions on further vascular evaluation and management.

Using machine learning to predict outcomes following suprainguinal bypass

OBJECTIVE

Suprainguinal bypass for peripheral artery disease (PAD) carries important surgical risks; however, outcome prediction tools remain limited. We developed machine learning (ML) algorithms that predict outcomes following suprainguinal bypass.

METHODS

The Vascular Quality Initiative database was used to identify patients who underwent suprainguinal bypass for PAD between 2003 and 2023. We identified 100 potential predictor variables from the index hospitalization (68 preoperative [demographic/clinical], 13 intraoperative [procedural], and 19 postoperative [in-hospital course/complications]). The primary outcomes were major adverse limb events (MALE; composite of untreated loss of patency, thrombectomy/thrombolysis, surgical revision, or major amputation) or death at 1 year following suprainguinal bypass. Our data were split into training (70%) and test (30%) sets. Using 10-fold cross-validation, we trained six ML models using preoperative features (Extreme Gradient Boosting [XGBoost], random forest, Naïve Bayes classifier, support vector machine, artificial neural network, and logistic regression). The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). The best performing algorithm was further trained using intra- and postoperative data. Model robustness was evaluated using calibration plots and Brier scores. Performance was assessed on subgroups based on age, sex, race, ethnicity, rurality, median Area Deprivation Index, symptom status, procedure type, prior intervention for PAD, concurrent interventions, and urgency.

RESULTS

Overall, 16,832 patients underwent suprainguinal bypass, and 3136 (18.6%) developed 1-year MALE or death. Patients with 1-year MALE or death were older (mean age, 64.9 vs 63.5 years; P < .001) with more comorbidities, had poorer functional status (65.7% vs 80.9% independent at baseline; P < .001), and were more likely to have chronic limb-threatening ischemia (67.4% vs 47.6%; P < .001) than those without an outcome. Despite being at higher cardiovascular risk, they were less likely to receive acetylsalicylic acid or statins preoperatively and at discharge. Our best performing prediction model at the preoperative stage was XGBoost, achieving an AUROC of 0.92 (95% confidence interval [CI], 0.91-0.93). In comparison, logistic regression had an AUROC of 0.67 (95% CI, 0.65-0.69). Our XGBoost model maintained excellent performance at the intra- and postoperative stages, with AUROCs of 0.93 (95% CI, 0.92-0.94) and 0.98 (95% CI, 0.97-0.99), respectively. Calibration plots showed good agreement between predicted and observed event probabilities with Brier scores of 0.12 (preoperative), 0.11 (intraoperative), and 0.10 (postoperative). Of the top 10 predictors, nine were preoperative features including chronic limb-threatening ischemia, previous procedures, comorbidities, and functional status. Model performance remained robust on all subgroup analyses.

CONCLUSIONS

We developed ML models that accurately predict outcomes following suprainguinal bypass, performing better than logistic regression. Our algorithms have potential for important utility in guiding perioperative risk mitigation strategies to prevent adverse outcomes following suprainguinal bypass.

Classification of anatomic patterns of peripheral artery disease with automated machine learning (AutoML)

AIM

The aim of this study was to investigate the potential of novel automated machine learning (AutoML) in vascular medicine by developing a discriminative artificial intelligence (AI) model for the classification of anatomical patterns of peripheral artery disease (PAD).

MATERIAL AND METHODS

Random open-source angiograms of lower limbs were collected using a web-indexed search. An experienced researcher in vascular medicine labelled the angiograms according to the most applicable grade of femoropopliteal disease in the Global Limb Anatomic Staging System (GLASS). An AutoML model was trained using the Vertex AI (Google Cloud) platform to classify the angiograms according to the GLASS grade with a multi-label algorithm. Following deployment, we conducted a test using 25 random angiograms (five from each GLASS grade). Model tuning through incremental training by introducing new angiograms was executed to the limit of the allocated quota following the initial evaluation to determine its effect on the software's performance.

RESULTS

We collected 323 angiograms to create the AutoML model. Among these, 80 angiograms were labelled as grade 0 of femoropopliteal disease in GLASS, 114 as grade 1, 34 as grade 2, 25 as grade 3 and 70 as grade 4. After 4.5 h of training, the AI model was deployed. The AI self-assessed average precision was 0.77 (0 is minimal and 1 is maximal). During the testing phase, the AI model successfully determined the GLASS grade in 100% of the cases. The agreement with the researcher was almost perfect with the number of observed agreements being 22 (88%), Kappa = 0.85 (95% CI 0.69-1.0). The best results were achieved in predicting GLASS grade 0 and grade 4 (initial precision: 0.76 and 0.84). However, the AI model exhibited poorer results in classifying GLASS grade 3 (initial precision: 0.2) compared to other grades. Disagreements between the AI and the researcher were associated with the low resolution of the test images. Incremental training expanded the initial dataset by 23% to a total of 417 images, which improved the model's average precision by 11% to 0.86.

CONCLUSION

After a brief training period with a limited dataset, AutoML has demonstrated its potential in identifying and classifying the anatomical patterns of PAD, operating unhindered by the factors that can affect human analysts, such as fatigue or lack of experience. This technology bears the potential to revolutionize outcome prediction and standardize evidence-based revascularization strategies for patients with PAD, leveraging its adaptability and ability to continuously improve with additional data. The pursuit of further research in AutoML within the field of vascular medicine is both promising and warranted. However, it necessitates additional financial support to realize its full potential.

Artificial intelligence in the risk prediction models of cardiovascular disease and development of an independent validation screening tool: a systematic review

BACKGROUND

A comprehensive overview of artificial intelligence (AI) for cardiovascular disease (CVD) prediction and a screening tool of AI models (AI-Ms) for independent external validation are lacking. This systematic review aims to identify, describe, and appraise AI-Ms of CVD prediction in the general and special populations and develop a new independent validation score (IVS) for AI-Ms replicability evaluation.

METHODS

PubMed, Web of Science, Embase, and IEEE library were searched up to July 2021. Data extraction and analysis were performed for the populations, distribution, predictors, algorithms, etc. The risk of bias was evaluated with the prediction risk of bias assessment tool (PROBAST). Subsequently, we designed IVS for model replicability evaluation with five steps in five items, including transparency of algorithms, performance of models, feasibility of reproduction, risk of reproduction, and clinical implication, respectively. The review is registered in PROSPERO (No. CRD42021271789).

RESULTS

In 20,887 screened references, 79 articles (82.5% in 2017-2021) were included, which contained 114 datasets (67 in Europe and North America, but 0 in Africa). We identified 486 AI-Ms, of which the majority were in development (n = 380), but none of them had undergone independent external validation. A total of 66 idiographic algorithms were found; however, 36.4% were used only once and only 39.4% over three times. A large number of different predictors (range 5-52,000, median 21) and large-span sample size (range 80-3,660,000, median 4466) were observed. All models were at high risk of bias according to PROBAST, primarily due to the incorrect use of statistical methods. IVS analysis confirmed only 10 models as "recommended"; however, 281 and 187 were "not recommended" and "warning," respectively.

CONCLUSION

AI has led the digital revolution in the field of CVD prediction, but is still in the early stage of development as the defects of research design, report, and evaluation systems. The IVS we developed may contribute to independent external validation and the development of this field.

Development of an Artificial Intelligence Tool for Intraoperative Guidance During Endovascular Abdominal Aortic Aneurysm Repair

BACKGROUND

Adverse events during surgery can occur in part due to errors in visual perception and judgment. Deep learning is a branch of artificial intelligence (AI) that has shown promise in providing real-time intraoperative guidance. This study aims to train and test the performance of a deep learning model that can identify inappropriate landing zones during endovascular aneurysm repair (EVAR).

METHODS

A deep learning model was trained to identify a "No-Go" landing zone during EVAR, defined by coverage of the lowest renal artery by the stent graft. Fluoroscopic images from elective EVAR procedures performed at a single institution and from open-access sources were selected. Annotations of the "No-Go" zone were performed by trained annotators. A 10-fold cross-validation technique was used to evaluate the performance of the model against human annotations. Primary outcomes were intersection-over-union (IoU) and F1 score and secondary outcomes were pixel-wise accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).

RESULTS

The AI model was trained using 369 images procured from 110 different patients/videos, including 18 patients/videos (44 images) from open-access sources. For the primary outcomes, IoU and F1 were 0.43 (standard deviation ± 0.29) and 0.53 (±0.32), respectively. For the secondary outcomes, accuracy, sensitivity, specificity, NPV, and PPV were 0.97 (±0.002), 0.51 (±0.34), 0.99 (±0.001). 0.99 (±0.002), and 0.62 (±0.34), respectively.

CONCLUSIONS

AI can effectively identify suboptimal areas of stent deployment during EVAR. Further directions include validating the model on datasets from other institutions and assessing its ability to predict optimal stent graft placement and clinical outcomes.

Emergent Applications of Machine Learning for Diagnosing and Managing Appendicitis: A State-of-the-Art Review

Background: Appendicitis is an inflammatory condition that requires timely and effective intervention. Despite being one of the most common surgically treated diseases, the condition is difficult to diagnose because of atypical presentations. Ultrasound and computed tomography (CT) imaging improve the sensitivity and specificity of diagnoses, yet these tools bear the drawbacks of high operator dependency and radiation exposure, respectively. However, new artificial intelligence tools (such as machine learning) may be able to address these shortcomings. Methods: We conducted a state-of-the-art review to delineate the various use cases of emerging machine learning algorithms for diagnosing and managing appendicitis in recent literature. The query ("Appendectomy" OR "Appendicitis") AND ("Machine Learning" OR "Artificial Intelligence") was searched across three databases for publications ranging from 2012 to 2022. Upon filtering for duplicates and based on our predefined inclusion criteria, 39 relevant studies were identified. Results: The algorithms used in these studies performed with an average accuracy of 86% (18/39), a sensitivity of 81% (16/39), a specificity of 75% (16/39), and area under the receiver operating characteristic curves (AUROCs) of 0.82 (15/39) where reported. Based on accuracy alone, the optimal model was logistic regression in 18% of studies, an artificial neural network in 15%, a random forest in 13%, and a support vector machine in 10%. Conclusions: The identified studies suggest that machine learning may provide a novel solution for diagnosing appendicitis and preparing for patient-specific post-operative complications. However, further studies are warranted to assess the feasibility and advisability of implementing machine learning-based tools in clinical practice.

Current status and quality of radiomics studies for predicting outcome in acute ischemic stroke patients: a systematic review and meta-analysis

Background

Pre-treatment prediction of reperfusion and long-term prognosis in acute ischemic stroke (AIS) patients is crucial for effective treatment and decision-making. Recent studies have demonstrated that the inclusion of radiomics data can improve the performance of predictive models. This paper reviews published studies focused on radiomics-based prediction of reperfusion and long-term prognosis in AIS patients.

Methods

We systematically searched PubMed, Web of Science, and Cochrane databases up to September 9, 2023, for studies on radiomics-based prediction of AIS patient outcomes. The methodological quality of the included studies was evaluated using the phase classification criteria, the radiomics quality scoring (RQS) tool, and the Prediction model Risk Of Bias Assessment Tool (PROBAST). Two separate meta-analyses were performed of these studies that predict long-term prognosis and reperfusion in AIS patients.

Results

Sixteen studies with sample sizes ranging from 67 to 3,001 were identified. Ten studies were classified as phase II, and the remaining were categorized as phase 0 (n = 2), phase I (n = 1), and phase III (n = 3). The mean RQS score of all studies was 39.41%, ranging from 5.56 to 75%. Most studies (87.5%, 14/16) were at high risk of bias due to their retrospective design. The remaining two studies were categorized as low risk and unclear risk, respectively. The pooled area under the curve (AUC) was 0.88 [95% confidence interval (CI) 0.84-0.92] for predicting the long-term prognosis and 0.80 (95% CI 0.74-0.86) for predicting reperfusion in AIS.

Conclusion

Radiomics has the potential to predict immediate reperfusion and long-term outcomes in AIS patients. Further external validation and evaluation within the clinical workflow can facilitate personalized treatment for AIS patients. This systematic review provides valuable insights for optimizing radiomics prediction systems for both reperfusion and long-term outcomes in AIS patients.

Systematic review registration

https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42023461671, identifier CRD42023461671.

Assessing the robustness of positive vascular surgery randomized controlled trials using their fragility index

OBJECTIVE

The fragility index (FI) measures the robustness of statistically significant findings in randomized controlled trials (RCTs) by quantifying the minimum number of event conversions required to reverse a dichotomous outcome's statistical significance. In vascular surgery, many clinical guidelines and critical decision-making points are informed by a handful of key RCTs, especially regarding open surgical versus endovascular treatment. The objective of this study is to evaluate the FI of RCTs with statistically significant primary outcomes that compared open vs endovascular surgery in vascular surgery.

METHODS

In this meta-epidemiological study and systematic review, MEDLINE, Embase, and CENTRAL were searched for RCTs comparing open versus endovascular treatments for abdominal aortic aneurysms, carotid artery stenosis, and peripheral arterial disease to December 2022. RCTs with statistically significant primary outcomes were included. Data screening and extraction were conducted in duplicate. The FI was calculated by adding an event to the group with the smaller number of events while subtracting a nonevent to the same group until Fisher's exact test produced a nonstatistically significant result. The primary outcome was the FI and proportion of outcomes where the loss to follow-up was greater than the FI. The secondary outcomes assessed the relationship of the FI to disease state, presence of commercial funding, and study design.

RESULTS

Overall, 5133 articles were captured in the initial search with 21 RCTs reporting 23 different primary outcomes being included in the final analysis. The median FI (first quartile, third quartile) was 3 (3, 20) with 16 outcomes (70%) reporting a loss to follow-up greater than its FI. Mann-Whitney U test revealed that commercially funded RCTs and composite outcomes had greater FIs (median, 20.0 [5.5, 24.5] vs median, 3.0 [2.0, 5.5], P = .035; median, 21 [8, 38] vs median, 3.0 [2.0, 8.5], P = .01, respectively). The FI did not vary between disease states (P = .285) or between index and follow-up trials (P = .147). There were significant correlations between the FI and P values (Pearson r = 0.90; 95% confidence interval, 0.77-0.96), and the number of events (r = 0.82; 95% confidence interval, 0.48-0.97).

CONCLUSIONS

A small number of event conversions (median, 3) are needed to alter the statistical significance of primary outcomes in vascular surgery RCTs evaluating open surgical and endovascular treatments. Most studies had loss to follow-up greater than its FI, which can call into question trial results, and commercially funded studies had a greater FI. The FI and these findings should be considered in future trial design in vascular surgery.

Predicting outcomes following open revascularization for aortoiliac occlusive disease using machine learning

OBJECTIVE

Open surgical treatment options for aortoiliac occlusive disease carry significant perioperative risks; however, outcome prediction tools remain limited. Using machine learning (ML), we developed automated algorithms that predict 30-day outcomes following open aortoiliac revascularization.

METHODS

The National Surgical Quality Improvement Program (NSQIP) targeted vascular database was used to identify patients who underwent open aortoiliac revascularization for atherosclerotic disease between 2011 and 2021. Input features included 38 preoperative demographic/clinical variables. The primary outcome was 30-day major adverse limb event (MALE; composite of untreated loss of patency, major reintervention, or major amputation) or death. The 30-day secondary outcomes were individual components of the primary outcome, major adverse cardiovascular event (MACE; composite of myocardial infarction, stroke, or death), individual components of MACE, wound complication, bleeding, other morbidity, non-home discharge, and unplanned readmission. Our data were split into training (70%) and test (30%) sets. Using 10-fold cross-validation, we trained six ML models using preoperative features. The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). Model robustness was evaluated with calibration plot and Brier score. Variable importance scores were calculated to determine the top 10 predictive features. Performance was assessed on subgroups based on age, sex, race, ethnicity, symptom status, procedure type, and urgency.

RESULTS

Overall, 9649 patients were included. The primary outcome of 30-day MALE or death occurred in 1021 patients (10.6%). Our best performing prediction model for 30-day MALE or death was XGBoost, achieving an AUROC of 0.95 (95% confidence interval [CI], 0.94-0.96). In comparison, logistic regression had an AUROC of 0.79 (95% CI, 0.77-0.81). For 30-day secondary outcomes, XGBoost achieved AUROCs between 0.87 and 0.97 (untreated loss of patency [0.95], major reintervention [0.88], major amputation [0.96], death [0.97], MACE [0.95], myocardial infarction [0.88], stroke [0.93], wound complication [0.94], bleeding [0.87], other morbidity [0.96], non-home discharge [0.90], and unplanned readmission [0.91]). The calibration plot showed good agreement between predicted and observed event probabilities with a Brier score of 0.05. The strongest predictive feature in our algorithm was chronic limb-threatening ischemia. Model performance remained robust on all subgroup analyses of specific demographic/clinical populations.

CONCLUSIONS

Our ML models accurately predict 30-day outcomes following open aortoiliac revascularization using preoperative data, performing better than logistic regression. They have potential for important utility in guiding risk-mitigation strategies for patients being considered for open aortoiliac revascularization to improve outcomes.

Machine learning to predict outcomes following endovascular abdominal aortic aneurysm repair

BACKGROUND

Endovascular aneurysm repair (EVAR) for abdominal aortic aneurysm (AAA) carries important perioperative risks; however, there are no widely used outcome prediction tools. The aim of this study was to apply machine learning (ML) to develop automated algorithms that predict 1-year mortality following EVAR.

METHODS

The Vascular Quality Initiative database was used to identify patients who underwent elective EVAR for infrarenal AAA between 2003 and 2023. Input features included 47 preoperative demographic/clinical variables. The primary outcome was 1-year all-cause mortality. Data were split into training (70 per cent) and test (30 per cent) sets. Using 10-fold cross-validation, 6 ML models were trained using preoperative features with logistic regression as the baseline comparator. The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). Model robustness was evaluated with calibration plot and Brier score.

RESULTS

Some 63 655 patients were included. One-year mortality occurred in 3122 (4.9 per cent) patients. The best performing prediction model for 1-year mortality was XGBoost, achieving an AUROC (95 per cent c.i.) of 0.96 (0.95-0.97). Comparatively, logistic regression had an AUROC (95 per cent c.i.) of 0.69 (0.68-0.71). The calibration plot showed good agreement between predicted and observed event probabilities with a Brier score of 0.04. The top 3 predictive features in the algorithm were 1) unfit for open AAA repair, 2) functional status, and 3) preoperative dialysis.

CONCLUSIONS

In this data set, machine learning was able to predict 1-year mortality following EVAR using preoperative data and outperformed standard logistic regression models.

Machine Learning and Omics Analysis in Aortic Aneurysm

Aortic aneurysm is a life-threatening condition and mechanisms underlying its formation and progression are still incompletely understood. Omics approach has brought new insights to identify a broad spectrum of biomarkers and better understand cellular and molecular pathways involved. Omics generate a large amount of data and several studies have highlighted that artificial intelligence (AI) and techniques such as machine learning (ML)/deep learning (DL) can be of use in analyzing such complex datasets. However, only a few studies have so far reported the use of ML/DL for omics analysis in aortic aneurysms. The aim of this study is to summarize recent advances on the use of ML/DL for omics analysis to decipher aortic aneurysm pathophysiology and develop patient-tailored risk prediction models. In the light of current knowledge, we discuss current limits and highlight future directions in the field.

Using machine learning to predict outcomes following carotid endarterectomy

OBJECTIVE

Prediction of outcomes following carotid endarterectomy (CEA) remains challenging, with a lack of standardized tools to guide perioperative management. We used machine learning (ML) to develop automated algorithms that predict outcomes following CEA.

METHODS

The Vascular Quality Initiative (VQI) database was used to identify patients who underwent CEA between 2003 and 2022. We identified 71 potential predictor variables (features) from the index hospitalization (43 preoperative [demographic/clinical], 21 intraoperative [procedural], and 7 postoperative [in-hospital complications]). The primary outcome was stroke or death at 1 year following CEA. Our data were split into training (70%) and test (30%) sets. Using 10-fold cross-validation, we trained six ML models using preoperative features (Extreme Gradient Boosting [XGBoost], random forest, Naïve Bayes classifier, support vector machine, artificial neural network, and logistic regression). The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). After selecting the best performing algorithm, additional models were built using intra- and postoperative data. Model robustness was evaluated using calibration plots and Brier scores. Performance was assessed on subgroups based on age, sex, race, ethnicity, insurance status, symptom status, and urgency of surgery.

RESULTS

Overall, 166,369 patients underwent CEA during the study period. In total, 7749 patients (4.7%) had the primary outcome of stroke or death at 1 year. Patients with an outcome were older with more comorbidities, had poorer functional status, and demonstrated higher risk anatomic features. They were also more likely to undergo intraoperative surgical re-exploration and have in-hospital complications. Our best performing prediction model at the preoperative stage was XGBoost, achieving an AUROC of 0.90 (95% confidence interval [CI], 0.89-0.91). In comparison, logistic regression had an AUROC of 0.65 (95% CI, 0.63-0.67), and existing tools in the literature demonstrate AUROCs ranging from 0.58 to 0.74. Our XGBoost models maintained excellent performance at the intra- and postoperative stages, with AUROCs of 0.90 (95% CI, 0.89-0.91) and 0.94 (95% CI, 0.93-0.95), respectively. Calibration plots showed good agreement between predicted and observed event probabilities with Brier scores of 0.15 (preoperative), 0.14 (intraoperative), and 0.11 (postoperative). Of the top 10 predictors, eight were preoperative features, including comorbidities, functional status, and previous procedures. Model performance remained robust on all subgroup analyses.

CONCLUSIONS

We developed ML models that accurately predict outcomes following CEA. Our algorithms perform better than logistic regression and existing tools, and therefore, have potential for important utility in guiding perioperative risk mitigation strategies to prevent adverse outcomes.

Natural Language Processing for Literature Search in Vascular Surgery: A Pilot Study Testing an Artificial Intelligence Based Application

Introduction

The use of natural language processing (NLP) for a literature search has been poorly investigated in vascular surgery so far. The aim of this pilot study was to test the applicability of an artificial intelligence (AI) based mobile application for literature searching in a topic related to vascular surgery.

Technique

A focused scientific question was defined to evaluate the performance of the AI application for a literature search and compare the results with the ground truth provided via a traditional literature search performed by human experts. Using pre-defined keywords, the literature search was performed automatically by the AI application through different steps, including quality assessment based on evaluation of the information available and quality filters using indicators of level of evidence, selection of publications based on relevancy filters using NLP, summarisation, and visualisation of the publications via the mobile app. A traditional literature search performed by human experts required 10 hours to check 154 original articles, among which 26 (16.9%) were truly related to the question, 63 (40.9%) related to the field but not to the specific question, and 65 (42.2%) were unrelated. The AI based search was performed in less than one hour, and, compared with traditional search, the method identified 17 original articles (48.6%) truly related to the question (p < .010), 18 (51.4%) related to the field but not to the specific question (p = .26), and no unrelated publications (p < .001). Fifteen truly related articles (88.2%) were identified jointly by the two methods. No significant difference was observed regarding the median number of citations, year of publications, and impact factor of journals.

Discussion

The AI based method enabled a targeted, focused, and time saving literature search, although the selection of publications was not completely exhaustive. These results suggest that such an AI driven application is a complementary tool to help researchers and clinicians for continuous education and dissemination of knowledge.

Methodological quality of radiomic-based prognostic studies in gastric cancer: a cross-sectional study

Background

Machine learning radiomics models are increasingly being used to predict gastric cancer prognoses. However, the methodological quality of these models has not been evaluated. Therefore, this study aimed to evaluate the methodological quality of radiomics studies in predicting the prognosis of gastric cancer, summarize their methodological characteristics and performance.

Methods

The PubMed and Embase databases were searched for radiomics studies used to predict the prognosis of gastric cancer published in last 5 years. The characteristics of the studies and the performance of the models were extracted from the eligible full texts. The methodological quality, reporting completeness and risk of bias of the included studies were evaluated using the RQS, TRIPOD and PROBAST. The discrimination ability scores of the models were also compared.

Results

Out of 283 identified records, 22 studies met the inclusion criteria. The study endpoints included survival time, treatment response, and recurrence, with reported discriminations ranging between 0.610 and 0.878 in the validation dataset. The mean overall RQS value was 15.32 ± 3.20 (range: 9 to 21). The mean adhered items of the 35 item of TRIPOD checklist was 20.45 ± 1.83. The PROBAST showed all included studies were at high risk of bias.

Conclusion

The current methodological quality of gastric cancer radiomics studies is insufficient. Large and reasonable sample, prospective, multicenter and rigorously designed studies are required to improve the quality of radiomics models for gastric cancer prediction.

Study registration

This protocol was prospectively registered in the Open Science Framework Registry (https://osf.io/ja52b).

Artificial intelligence-based predictive models in vascular diseases

Cardiovascular disease represents a source of major health problems worldwide, and although medical and technical advances have been achieved, they are still associated with high morbidity and mortality rates. Personalized medicine would benefit from novel tools to better predict individual prognosis and outcomes after intervention. Artificial intelligence (AI) has brought new insights to cardiovascular medicine, especially with the use of machine learning techniques that allow the identification of hidden patterns and complex associations in health data without any a priori assumptions. This review provides an overview on the use of artificial intelligence-based prediction models in vascular diseases, specifically focusing on aortic aneurysm, lower extremity arterial disease, and carotid stenosis. Potential benefits include the development of precision medicine in patients with vascular diseases. In addition, the main challenges that remain to be overcome to integrate artificial intelligence-based predictive models in clinical practice are discussed.

Protecting patient safety and privacy in the era of artificial intelligence

The promise of artificial intelligence (AI) in health care has propelled a significant uptrend in the number of clinical trials in AI and global market spending in this novel technology. In vascular surgery, this technology has the ability to diagnose disease, predict disease outcomes, and assist with image-guided surgery. As we enter an era of rapid change, it is critical to evaluate the ethical concerns of AI, particularly as it may impact patient safety and privacy. This is particularly important to discuss in the early stages of AI, as technology frequently outpaces the policies and ethical guidelines regulating it. Issues at the forefront include patient privacy and confidentiality, protection of patient autonomy and informed consent, accuracy and applicability of this technology, and propagation of health care disparities. Vascular surgeons should be equipped to work with AI, as well as discuss its novel risks to patient safety and privacy.

Mature artificial intelligence- and machine learning-enabled medical tools impacting vascular surgical care: A scoping review of late-stage, US Food and Drug Administration-approved or cleared technologies relevant to vascular surgeons

Artificial intelligence and machine learning (AI/ML)-enabled tools are shifting from theoretical or research-only applications to mature, clinically useful tools. The goal of this article was to provide a scoping review of the most mature AI/ML-enabled technologies reviewed and cleared by the US Food and Drug Administration relevant to the field of vascular surgery. Despite decades of slow progress, this landscape is now evolving rapidly, with more than 100 AI/ML-powered tools being approved by the US Food and Drug Administration each year. Within the field of vascular surgery specifically, this review identified 17 companies with mature technologies that have at least one US Food and Drug Administration clearance, all occurring between 2016 and 2022. The maturation of these technologies appears to be accelerating, with improving regulatory clarity and clinical uptake. The early AI/ML-powered devices extend or amplify clinically entrenched platform technologies and tend to be focused on the diagnosis or evaluation of time-sensitive, clinically important pathologies (eg, reading Digital Imaging and Communications in Medicine-compliant computed tomography images to identify pulmonary embolism), or when physician efficiency or time savings is improved (eg, preoperative planning and intraoperative guidance). The majority (>75%) of these technologies are at the intersection of radiology and vascular surgery. It is becoming increasingly important that the contemporary vascular surgeon understands this shifting paradigm, as these once-nascent technologies are finally maturing and will be encountered with increasingly regularity in daily clinical practice.

Computer Science meets Vascular Surgery: Keeping a pulse on artificial intelligence

Artificial intelligence (AI)-based technologies have garnered interest across a range of disciplines in the past several years, with an even more recent interest in various health care fields, including Vascular Surgery. AI offers a unique ability to analyze health data more quickly and efficiently than could be done by humans alone and can be used for clinical applications such as diagnosis, risk stratification, and follow-up, as well as patient-used applications to improve both patient and provider experiences, mitigate health care disparities, and individualize treatment. As with all novel technologies, AI is not without its risks and carries with it unique ethical considerations that will need to be addressed before its broad integration into health care systems. AI has the potential to revolutionize the way care is provided to patients, including those requiring vascular care.

Bias in artificial intelligence in vascular surgery

Application of artificial intelligence (AI) has revolutionized the utilization of big data, especially in patient care. The potential of deep learning models to learn without a priori assumption, or without prior learning, to connect seemingly unrelated information mixes excitement alongside hesitation to fully understand AI's limitations. Bias, ranging from data collection and input to algorithm development to finally human review of algorithm output affects AI's application to clinical patient presents unique challenges that differ significantly from biases in traditional analyses. Algorithm fairness, a new field of research within AI, aims to mitigate bias by evaluating the data at the preprocessing stage, optimizing during algorithm development, and evaluating algorithm output at the postprocessing stage. As the field continues to develop, being cognizant of the inherent biases and limitations related to black box decision making, biased data sets agnostic to patient-level disparities, wide variation of present methodologies, and lack of common reporting standards will require ongoing research to provide transparency to AI and its applications.

Machine learning prediction of motor function in chronic stroke patients: a systematic review and meta-analysis

Background

Recent studies have reported that machine learning (ML), with a relatively strong capacity for processing non-linear data and adaptive ability, could improve the accuracy and efficiency of prediction. The article summarizes the published studies on ML models that predict motor function 3-6 months post-stroke.

Methods

A systematic literature search was conducted in PubMed, Embase, Cochorane and Web of Science as of April 3, 2023 for studies on ML prediction of motor function in stroke patients. The quality of the literature was assessed using the Prediction model Risk Of Bias Assessment Tool (PROBAST). A random-effects model was preferred for meta-analysis using R4.2.0 because of the different variables and parameters.

Results

A total of 44 studies were included in this meta-analysis, involving 72,368 patients and 136 models. Models were categorized into subgroups according to the predicted outcome Modified Rankin Scale cut-off value and whether they were constructed based on radiomics. C-statistics, sensitivity, and specificity were calculated. The random-effects model showed that the C-statistics of all models were 0.81 (95% CI: 0.79; 0.83) in the training set and 0.82 (95% CI: 0.80; 0.85) in the validation set. According to different Modified Rankin Scale cut-off values, C-statistics of ML models predicting Modified Rankin Scale>2(used most widely) in stroke patients were 0.81 (95% CI: 0.78; 0.84) in the training set, and 0.84 (95% CI: 0.81; 0.87) in the validation set. C-statistics of radiomics-based ML models in the training set and validation set were 0.81 (95% CI: 0.78; 0.84) and 0.87 (95% CI: 0.83; 0.90), respectively.

Conclusion

ML can be used as an assessment tool for predicting the motor function in patients with 3-6 months of post-stroke. Additionally, the study found that ML models with radiomics as a predictive variable were also demonstrated to have good predictive capabilities. This systematic review provides valuable guidance for the future optimization of ML prediction systems that predict poor motor outcomes in stroke patients.

Systematic review registration

https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42022335260, identifier: CRD42022335260.

The digital transformation of surgery

Rapid advances in digital technology and artificial intelligence in recent years have already begun to transform many industries, and are beginning to make headway into healthcare. There is tremendous potential for new digital technologies to improve the care of surgical patients. In this piece, we highlight work being done to advance surgical care using machine learning, computer vision, wearable devices, remote patient monitoring, and virtual and augmented reality. We describe ways these technologies can be used to improve the practice of surgery, and discuss opportunities and challenges to their widespread adoption and use in operating rooms and at the bedside.

Automatic Detection of Visceral Arterial Aneurysms on Computed Tomography Angiography Using Artificial Intelligence Based Segmentation of the Vascular System

Introduction

Visceral arterial aneurysms (VAAs) are life threatening. Due to the paucity of symptoms and rarity of the disease, VAAs are underdiagnosed and underestimated. Artificial intelligence (AI) offers new insights into segmentation of the vascular system, and opportunities to better detect VAAs. This pilot study aimed to develop an AI based method to automatically detect VAAs from computed tomography angiography (CTA).

Methods

A hybrid method combining a feature based expert system with a supervised deep learning algorithm (convolutional neural network) was used to enable fully automatic segmentation of the abdominal vascular tree. Centrelines were built and reference diameters of each visceral artery were calculated. An abnormal dilatation (VAAs) was defined as a substantial increase in diameter at the pixel of interest compared with the mean diameter of the reference portion. The automatic software provided 3D rendered images with a flag on the identified VAA areas. The performance of the method was tested in a dataset of 33 CTA scans and compared with the ground truth provided by two human experts.

Results

Forty-three VAAs were identified by human experts (32 in the coeliac trunk branches, eight in the superior mesenteric artery, one in the left renal, and two in the right renal arteries). The automatic system accurately detected 40 of the 43 VAAs, with a sensitivity of 0.93 and a positive predictive value of 0.51. The mean number of flag areas per CTA was 3.5 ± 1.5 and they could be reviewed and checked by a human expert in less than 30 seconds per CTA.

Conclusion

Although the specificity needs to be improved, this study demonstrates the potential of an AI based automatic method to develop new tools to improve screening and detection of VAAs by automatically attracting clinicians' attention to suspicious dilatations of the visceral arteries.

Deep Learning Prediction for Distal Aortic Remodeling After Thoracic Endovascular Aortic Repair in Stanford Type B Aortic Dissection

PURPOSE

This study aimed to develop a deep learning model for predicting distal aortic remodeling after proximal thoracic endovascular aortic repair (TEVAR) in patients with Stanford type B aortic dissection (TBAD) using computed tomography angiography (CTA).

METHODS

A total of 147 patients with acute or subacute TBAD who underwent proximal TEVAR at a single center were retrospectively reviewed. The boundary of aorta was manually segmented, and the point clouds of each aorta were obtained. Prediction of negative aortic remodeling or reintervention was accomplished by a convolutional neural network (CNN) and a point cloud neural network (PC-NN), respectively. The discriminatory value of the established models was mainly evaluated by the area under the receiver operating characteristic curve (AUC) in the test set.

RESULTS

The mean follow-up time was 34.0 months (range: 12-108 months). During follow-up, a total of 25 (17.0%) patients were identified as having negative aortic remodeling, and 16 (10.9%) patients received reintervention. The AUC (0.876) by PC-NN for predicting negative aortic remodeling was superior to that obtained by CNN (0.612, p=0.034) and similar to the AUC by PC-NN combined with clinical features (0.884, p=0.92). As to reintervention, the AUC by PC-NN was significantly higher than that by CNN (0.805 vs 0.579; p=0.042), and AUCs by PC-NN combined with clinical features and PC-NN alone were comparable (0.836 vs 0.805; p=0.81).

CONCLUSION

The CTA-based deep learning algorithms may assist clinicians in automated prediction of distal aortic remodeling after TEVAR for acute or subacute TBAD.

CLINICAL IMPACT

Negative aortic remodeling is the leading cause of late reintervention after proximal thoracic endovascular aortic repair (TEVAR) for Stanford type B aortic dissection (TBAD), and possesses great challenge to endovascular repair. Early recognizing high-risk patients is of supreme importance for optimizing the follow-up interval and therapy strategy. Currently, clinicians predict the prognosis of these patients based on several imaging signs, which is subjective. The computed tomography angiography-based deep learning algorithms may incorporate abundant morphological information of aorta, provide with a definite and objective output value, and finally assist clinicians in automated prediction of distal aortic remodeling after TEVAR for acute or subacute TBAD.

Machine Learning in Dentistry: A Scoping Review

Machine learning (ML) is being increasingly employed in dental research and application. We aimed to systematically compile studies using ML in dentistry and assess their methodological quality, including the risk of bias and reporting standards. We evaluated studies employing ML in dentistry published from 1 January 2015 to 31 May 2021 on MEDLINE, IEEE Xplore, and arXiv. We assessed publication trends and the distribution of ML tasks (classification, object detection, semantic segmentation, instance segmentation, and generation) in different clinical fields. We appraised the risk of bias and adherence to reporting standards, using the QUADAS-2 and TRIPOD checklists, respectively. Out of 183 identified studies, 168 were included, focusing on various ML tasks and employing a broad range of ML models, input data, data sources, strategies to generate reference tests, and performance metrics. Classification tasks were most common. Forty-two different metrics were used to evaluate model performances, with accuracy, sensitivity, precision, and intersection-over-union being the most common. We observed considerable risk of bias and moderate adherence to reporting standards which hampers replication of results. A minimum (core) set of outcome and outcome metrics is necessary to facilitate comparisons across studies.

Assessing the robustness of negative vascular surgery randomized controlled trials using their reverse fragility index

OBJECTIVE

The reverse fragility index (RFI) describes the number of event conversions needed to convert a statistically nonsignificant dichotomous outcome to a significant one. The objective of the present study was to assess the RFI of vascular surgery randomized controlled trials (RCTs) comparing endovascular vs open surgery for the treatment of abdominal aortic aneurysms (AAAs), carotid artery stenosis (CAS), and peripheral artery disease (PAD).

METHODS

MEDLINE and Embase were searched for RCTs that had investigated AAAs, CAS, or PAD with statistically nonsignificant binary primary outcomes. The primary outcome for the present study was the median RFI. Calculation of the RFI was performed by creating two-by-two contingency tables and subtracting events from the group with fewer events and adding nonevents to the same group until a two-tailed Fisher exact test had produced a statistically significant result (P ≤ .05).

RESULTS

Of 4187 reports, 49 studies reporting 103 different primary end points were included. The overall median RFI was 7 (interquartile range [IQR], 5-13). The specific RFIs for AAA, CAS, and PAD were 10 (IQR, 6-15.5), 6 (IQR, 5-9.5), and 7 (IQR, 5.5-10), respectively. Of the 103 end points, 42 (47%) had had a loss to follow-up greater than the RFI, of which 10 were AAA trials (24%), 23 were CAS trials (55%), and 9 were PAD trials (21%). The Pearson correlation demonstrated a significant positive relationship between a study's RFI and the impact factor of its publishing journal (r = 0.38; 95% confidence interval [CI], 0.20-0.54; P < .01), length of follow-up (r = 0.43; 95% CI, 0.26-0.58; P < .01), and sample size (r = 0.28; 95% CI, 0.09-0.45; P < .01).

CONCLUSIONS

A small number of events (median, 7) was required to change the outcome of negative RCTs from statistically nonsignificant to significant, with 47% of the studies having missing data that could have reversed the finding of its primary outcome. Reporting of the RFI relative to the loss to follow-up could be of benefit in future trials and provide confidence regarding the robustness of the P value.

A Systematic Review of Artificial Intelligence Applications in Plastic Surgery: Looking to the Future

Artificial intelligence (AI) is presently employed in several medical specialties, particularly those that rely on large quantities of standardized data. The integration of AI in surgical subspecialties is under preclinical investigation but is yet to be widely implemented. Plastic surgeons collect standardized data in various settings and could benefit from AI. This systematic review investigates the current clinical applications of AI in plastic and reconstructive surgery.

METHODS

A comprehensive literature search of the Medline, EMBASE, Cochrane, and PubMed databases was conducted for AI studies with multiple search terms. Articles that progressed beyond the title and abstract screening were then subcategorized based on the plastic surgery subspecialty and AI application.

RESULTS

The systematic search yielded a total of 1820 articles. Forty-four studies met inclusion criteria warranting further analysis. Subcategorization of articles by plastic surgery subspecialties revealed that most studies fell into aesthetic and breast surgery (27%), craniofacial surgery (23%), or microsurgery (14%). Analysis of the research study phase of included articles indicated that the current research is primarily in phase 0 (discovery and invention; 43.2%), phase 1 (technical performance and safety; 27.3%), or phase 2 (efficacy, quality improvement, and algorithm performance in a medical setting; 27.3%). Only one study demonstrated translation to clinical practice.

CONCLUSIONS

The potential of AI to optimize clinical efficiency is being investigated in every subfield of plastic surgery, but much of the research to date remains in the preclinical status. Future implementation of AI into everyday clinical practice will require collaborative efforts.

Perceptions of Canadian vascular surgeons toward artificial intelligence and machine learning

Background

Artificial intelligence (AI) and machine learning (ML) are rapidly advancing fields with increasing utility in health care. We conducted a survey to determine the perceptions of Canadian vascular surgeons toward AI/ML.

Methods

An online questionnaire was distributed to 162 members of the Canadian Society for Vascular Surgery. Self-reported knowledge, attitudes, and perceptions with respect to potential applications, limitations, and facilitators of AI/ML were assessed.

Results

Overall, 50 of the 162 Canadian vascular surgeons (31%) responded to the survey. Most respondents were aged 30 to 59 years (72%), male (80%), and White (67%) and practiced in academic settings (72%). One half of the participants reported that their knowledge of AI/ML was poor or very poor. Most were excited or very excited about AI/ML (66%) and were interested or very interested in learning more about the field (83.7%). The respondents believed that AI/ML would be useful or very useful for diagnosis (62%), prognosis (72%), patient selection (56%), image analysis (64%), intraoperative guidance (52%), research (88%), and education (80%). The limitations that the participants were most concerned about were errors leading to patient harm (42%), bias based on patient demographics (42%), and lack of clinician knowledge and skills in AI/ML (40%). Most were not concerned or were mildly concerned about job replacement (86%). The factors that were most important to encouraging clinicians to use AI/ML models were improvements in efficiency (88%), accurate predictions (84%), and ease of use (84%). The comments from respondents focused on the pressing need for the implementation of AI/ML in vascular surgery owing to the potential to improve care delivery.

Conclusions

Canadian vascular surgeons have positive views on AI/ML and believe this technology can be applied to multiple aspects of the specialty to improve patient care, research, and education. Current self-reported knowledge is poor, although interest was expressed in learning more about the field. The facilitators and barriers to the effective use of AI/ML identified in the present study can guide future development of these tools in vascular surgery.

A Systematic Review and Bibliometric Analysis of Applications of Artificial Intelligence and Machine Learning in Vascular Surgery

INTRODUCTION

Artificial intelligence (AI) and machine learning (ML) have seen increasingly intimate integration with medicine and healthcare in the last two decades. The objective of this study was to summarize all current applications of AI and ML in the vascular surgery literature and to conduct a bibliometric analysis of the published studies.

METHODS

A comprehensive literature search was conducted through EMBASE, MEDLINE, and Ovid HealthStar from inception until February 19, 2021. Reporting of this study was conducted using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Title and abstract screening, full-text screening, and data extraction were conducted in duplicate. Data extracted included study meta-data, the clinical area of study within vascular surgery, type of AI/ML method used, data set, and the application of AI/ML. Publishing journals were classified as having either a clinical scope or technical scope. Author academic background was classified as clinical, non-clinical (e.g., engineering) or both, depending on author affiliation.

RESULTS

The initial search identified 7434 studies, of which 249 were included for final analysis. The rate of publications is exponentially increasing, with 158 (63%) studies being published in the last 5 years. Studies were most commonly related to carotid artery disease (118, 47%), abdominal aortic aneurysms (51, 20%), and peripheral arterial disease (26, 10%). Study authors employed an average of 1.50 (range: 1-6) distinct AI methods in their studies. The application of AI/ML methods broadly related to predictive models (54, 22%), image segmentation (49, 19.4%), diagnostic methods (46, 18%), or multiple combined applications (91, 37%). The most commonly used AI/ML methods were artificial neural networks (155/378 use cases, 41%), support vector machines (64, 17%), k-nearest neighbors algorithm (26, 7%), and random forests (23, 6%). Data sets to which these AI/ML methods were applied frequently involved ultrasound images (87, 35%), CT images (42, 17%), clinical data (34, 14%) or multiple data sets (36, 14%). Overall, 22 (9%) studies were published in journals specific to vascular surgery, with the majority (147/249, 59%) being published in journals with a scope related to computer science or engineering. Among 1576 publishing authors, 46% had exclusively a clinical background, 48% a non-clinical background, and 5% had both a clinical and non-clinical background.

CONCLUSION

There is an exponentially growing body of literature describing the use of AI and ML in vascular surgery. There is a focus on carotid artery disease and abdominal aortic disease, with many other areas of vascular surgery underrepresented. Neural networks and support vector machines composed most AI methods in the literature. As AI/ML continues to see more expanded applications in the field, it is important that vascular surgeons appreciate its potential and limitations. Additionally, as it sees increasing use, there is a need for clinicians with expertise in AI/ML methods who can optimize its transition into daily practice.