Attention-Based UNet Deep Learning Model for Plaque Segmentation in Carotid Ultrasound for Stroke Risk Stratification: An Artificial Intelligence Paradigm

Stroke and cardiovascular diseases (CVD) significantly affect the world population. The early detection of such events may prevent the burden of death and costly surgery. Conventional methods are neither automated nor clinically accurate. Artificial Intelligence-based methods of automatically detecting and predicting the severity of CVD and stroke in their early stages are of prime importance. This study proposes an attention-channel-based UNet deep learning (DL) model that identifies the carotid plaques in the internal carotid artery (ICA) and common carotid artery (CCA) images. Our experiments consist of 970 ICA images from the UK, 379 CCA images from diabetic Japanese patients, and 300 CCA images from post-menopausal women from Hong Kong. We combined both CCA images to form an integrated database of 679 images. A rotation transformation technique was applied to 679 CCA images, doubling the database for the experiments. The cross-validation K5 (80% training: 20% testing) protocol was applied for accuracy determination. The results of the Attention-UNet model are benchmarked against UNet, UNet++, and UNet3P models. Visual plaque segmentation showed improvement in the Attention-UNet results compared to the other three models. The correlation coefficient (CC) value for Attention-UNet is 0.96, compared to 0.93, 0.96, and 0.92 for UNet, UNet++, and UNet3P models. Similarly, the AUC value for Attention-UNet is 0.97, compared to 0.964, 0.966, and 0.965 for other models. Conclusively, the Attention-UNet model is beneficial in segmenting very bright and fuzzy plaque images that are hard to diagnose using other methods. Further, we present a multi-ethnic, multi-center, racial bias-free study of stroke risk assessment.

Vascular Implications of COVID-19: Role of Radiological Imaging, Artificial Intelligence, and Tissue Characterization: A Special Report

The SARS-CoV-2 virus has caused a pandemic, infecting nearly 80 million people worldwide, with mortality exceeding six million. The average survival span is just 14 days from the time the symptoms become aggressive. The present study delineates the deep-driven vascular damage in the pulmonary, renal, coronary, and carotid vessels due to SARS-CoV-2. This special report addresses an important gap in the literature in understanding (i) the pathophysiology of vascular damage and the role of medical imaging in the visualization of the damage caused by SARS-CoV-2, and (ii) further understanding the severity of COVID-19 using artificial intelligence (AI)-based tissue characterization (TC). PRISMA was used to select 296 studies for AI-based TC. Radiological imaging techniques such as magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound were selected for imaging of the vasculature infected by COVID-19. Four kinds of hypotheses are presented for showing the vascular damage in radiological images due to COVID-19. Three kinds of AI models, namely, machine learning, deep learning, and transfer learning, are used for TC. Further, the study presents recommendations for improving AI-based architectures for vascular studies. We conclude that the process of vascular damage due to COVID-19 has similarities across vessel types, even though it results in multi-organ dysfunction. Although the mortality rate is ~2% of those infected, the long-term effect of COVID-19 needs monitoring to avoid deaths. AI seems to be penetrating the health care industry at warp speed, and we expect to see an emerging role in patient care, reduce the mortality and morbidity rate.

Hybrid deep learning segmentation models for atherosclerotic plaque in internal carotid artery B-mode ultrasound

The automated and accurate carotid plaque segmentation in B-mode ultrasound (US) is an essential part of stroke risk stratification. Previous segmented methods used AtheroEdge™ 2.0 (AtheroPoint™, Roseville, CA) for the common carotid artery (CCA). This study focuses on automated plaque segmentation in the internal carotid artery (ICA) using solo deep learning (SDL) and hybrid deep learning (HDL) models. The methodology consists of a novel design of 10 types of SDL/HDL models (AtheroEdge™ 3.0 systems (AtheroPoint™, Roseville, CA) with a depth of four layers each. Five of the models use cross-entropy (CE)-loss, and the other five models use Dice similarity coefficient (DSC)-loss functions derived from UNet, UNet+, SegNet, SegNet-UNet, and SegNet-UNet+. The K10 protocol (Train:Test:90%:10%) was applied for all 10 models for training and predicting (segmenting) the plaque region, which was then quantified to compute the plaque area in mm². Further, the data augmentation effect was analyzed. The database consisted of 970 ICA B-mode US scans taken from 99 moderate to high-risk patients. Using the difference area threshold of 10 mm² between ground truth (GT) and artificial intelligence (AI), the area under the curve (AUC) values were 0.91, 0.911, 0.908, 0.905, and 0.898, all with a p-value of <0.001 (for CE-loss models) and 0.883, 0.889, 0.905, 0.889, and 0.907, all with a p-value of <0.001 (for DSC-loss models). The correlations between the AI-based plaque area and GT plaque area were 0.98, 0.96, 0.97, 0.98, and 0.97, all with a p-value of <0.001 (for CE-loss models) and 0.98, 0.98, 0.97, 0.98, and 0.98 (for DSC-loss models). Overall, the online system performs plaque segmentation in less than 1 s. We validate our hypothesis that HDL and SDL models demonstrate comparable performance. SegNet-UNet was the best-performing hybrid architecture.

A Review on Joint Carotid Intima-Media Thickness and Plaque Area Measurement in Ultrasound for Cardiovascular/Stroke Risk Monitoring: Artificial Intelligence Framework

Cardiovascular diseases (CVDs) are the top ten leading causes of death worldwide. Atherosclerosis disease in the arteries is the main cause of the CVD, leading to myocardial infarction and stroke. The two primary image-based phenotypes used for monitoring the atherosclerosis burden is carotid intima-media thickness (cIMT) and plaque area (PA). Earlier segmentation and measurement methods were based on ad hoc conventional and semi-automated digital imaging solutions, which are unreliable, tedious, slow, and not robust. This study reviews the modern and automated methods such as artificial intelligence (AI)-based. Machine learning (ML) and deep learning (DL) can provide automated techniques in the detection and measurement of cIMT and PA from carotid vascular images. Both ML and DL techniques are examples of supervised learning, i.e., learn from "ground truth" images and transformation of test images that are not part of the training. This review summarizes (1) the evolution and impact of the fast-changing AI technology on cIMT/PA measurement, (2) the mathematical representations of ML/DL methods, and (3) segmentation approaches for cIMT/PA regions in carotid scans based for (a) region-of-interest detection and (b) lumen-intima and media-adventitia interface detection using ML/DL frameworks. AI-based methods for cIMT/PA segmentation have emerged for CVD/stroke risk monitoring and may expand to the recommended parameters for atherosclerosis assessment by carotid ultrasound.

Artificial intelligence framework for predictive cardiovascular and stroke risk assessment models: A narrative review of integrated approaches using carotid ultrasound

RECENT FINDINGS

Cardiovascular disease (CVD) is the leading cause of mortality and poses challenges for healthcare providers globally. Risk-based approaches for the management of CVD are becoming popular for recommending treatment plans for asymptomatic individuals. Several conventional predictive CVD risk models based do not provide an accurate CVD risk assessment for patients with different baseline risk profiles. Artificial intelligence (AI) algorithms have changed the landscape of CVD risk assessment and demonstrated a better performance when compared against conventional models, mainly due to its ability to handle the input nonlinear variations. Further, it has the flexibility to add risk factors derived from medical imaging modalities that image the morphology of the plaque. The integration of noninvasive carotid ultrasound image-based phenotypes with conventional risk factors in the AI framework has further provided stronger power for CVD risk prediction, so-called "integrated predictive CVD risk models."

PURPOSE

of the review: The objective of this review is (i) to understand several aspects in the development of predictive CVD risk models, (ii) to explore current conventional predictive risk models and their successes and challenges, and (iii) to refine the search for predictive CVD risk models using noninvasive carotid ultrasound as an exemplar in the artificial intelligence-based framework.

CONCLUSION

Conventional predictive CVD risk models are suboptimal and could be improved. This review examines the potential to include more noninvasive image-based phenotypes in the CVD risk assessment using powerful AI-based strategies.

Does the Carotid Bulb Offer a Better 10-Year CVD/Stroke Risk Assessment Compared to the Common Carotid Artery? A 1516 Ultrasound Scan Study

The objectives of this study are to (1) examine the "10-year cardiovascular risk" in the common carotid artery (CCA) versus carotid bulb using an integrated calculator called "AtheroEdge Composite Risk Score 2.0" (AECRS2.0) and (2) evaluate the performance of AECRS2.0 against "conventional cardiovascular risk calculators." These objectives are met by measuring (1) image-based phenotypes and AECRS2.0 score computation and (2) performance evaluation of AECRS2.0 against 12 conventional cardiovascular risk calculators. The Asian-Indian cohort (n = 379) with type 2 diabetes mellitus (T2DM), chronic kidney disease (CKD), or hypertension were retrospectively analyzed by acquiring the 1516 carotid ultrasound scans (mean age: 55 ± 10.1 years, 67% males, ∼92% with T2DM, ∼83% with CKD [stage 1-5], and 87.5% with hypertension [stage 1-2]). The carotid bulb showed a higher 10-year cardiovascular risk compared to the CCA by 18% (P < .0001). Patients with T2DM and/or CKD also followed a similar trend. The carotid bulb demonstrated a superior risk assessment compared to CCA in patients with T2DM and/or CKD by showing: (1) ∼13% better than CCA (0.93 vs 0.82, P = .0001) and (2) ∼29% better compared with 12 types of risk conventional calculators (0.93 vs 0.72, P = .06).

Integration of estimated glomerular filtration rate biomarker in image-based cardiovascular disease/stroke risk calculator: a south Asian-Indian diabetes cohort with moderate chronic kidney disease

BACKGROUND

Recently, a 10-year image-based integrated calculator (called AtheroEdge Composite Risk Score-AECRS1.0) was developed which combines conventional cardiovascular risk factors (CCVRF) with image phenotypes derived from carotid ultrasound (CUS). Such calculators did not include chronic kidney disease (CKD)-based biomarker called estimated glomerular filtration rate (eGFR). The novelty of this study is to design and develop an advanced integrated version called-AECRS2.0 that combines eGFR with image phenotypes to compute the composite risk score. Furthermore, AECRS2.0 was benchmarked against QRISK3 which considers eGFR for risk assessment.

METHODS

The method consists of three major steps: 1) five, current CUS image phenotypes (CUSIP) measurements using AtheroEdge system (AtheroPoint, CA, USA) consisting of: average carotid intima-media thickness (cIMTave), maximum cIMT (cIMTmax), minimum cIMT (cIMTmin), variability in cIMT (cIMTV), and total plaque area (TPA); 2) five, 10-year CUSIP measurements by combining these current five CUSIP with 11 CCVRF (age, ethnicity, gender, body mass index, systolic blood pressure, smoking, carotid artery type, hemoglobin, low-density lipoprotein cholesterol, total cholesterol, and eGFR); 3) AECRS2.0 risk score computation and its comparison to QRISK3 using area-under-the-curve (AUC).

RESULTS

South Asian-Indian 339 patients were retrospectively analyzed by acquiring their left/right common carotid arteries (678 CUS, mean age: 54.25±9.84 years; 75.22% males; 93.51% diabetic with HbA1c ≥6.5%; and mean eGFR 73.84±20.91 mL/min/1.73m²). The proposed AECRS2.0 reported higher AUC (AUC=0.89, P<0.001) compared to QRISK3 (AUC=0.51, P<0.001) by ~74% in CKD patients.

CONCLUSIONS

An integrated calculator AECRS2.0 can be used to assess the 10-year CVD/stroke risk in patients suffering from CKD. AECRS2.0 was much superior to QRISK3.

Morphological Carotid Plaque Area Is Associated With Glomerular Filtration Rate: A Study of South Asian Indian Patients With Diabetes and Chronic Kidney Disease

We evaluated the association between automatically measured carotid total plaque area (TPA) and the estimated glomerular filtration rate (eGFR), a biomarker of chronic kidney disease (CKD). Automated average carotid intima-media thickness (cIMTave) and TPA measurements in carotid ultrasound (CUS) were performed using AtheroEdge (AtheroPoint). Pearson correlation coefficient (CC) was then computed between the TPA and eGFR for (1) males versus females, (2) diabetic versus nondiabetic patients, and (3) between the left and right carotid artery. Overall, 339 South Asian Indian patients with either type 2 diabetes mellitus (T2DM) or CKD, or hypertension (stage 1 or stage 2) were retrospectively analyzed by acquiring cIMTave and TPA measurements of their left and right common carotid arteries (CCA; total CUS: 678, mean age: 54.2 ± 9.8 years; 75.2% males; 93.5% with T2DM). The CC between TPA and eGFR for different scenarios were (1) for males and females -0.25 (P < .001) and -0.35 (P < .001), respectively; (2) for T2DM and non-T2DM -0.26 (P < .001) and -0.49 (P = .02), respectively, and (3) for left and right CCA -0.25 (P < .001) and -0.23 (P < .001), respectively. Automated TPA is an equally reliable biomarker compared with cIMTave for patients with CKD (with or without T2DM) with subclinical atherosclerosis.

Global perspective on carotid intima-media thickness and plaque: should the current measurement guidelines be revisited?

Carotid intima-media thickness (cIMT) and carotid plaque (CP) currently act as risk predictors for CVD/Stroke risk assessment. Over 2000 articles have been published that cover either use cIMT/CP or alterations of cIMT/CP and additional image-based phenotypes to associate cIMT related markers with CVD/Stroke risk. These articles have shown variable results, which likely reflect a lack of standardization in the tools for measurement, risk stratification, and risk assessment. Guidelines for cIMT/CP measurement are influenced by major factors like the atherosclerosis disease itself, conventional risk factors, 10-year measurement tools, types of CVD/Stroke risk calculators, incomplete validation of measurement tools, and the fast pace of computer technology advancements. This review discusses the following major points: 1) the American Society of Echocardiography and Mannheim guidelines for cIMT/CP measurements; 2) forces that influence the guidelines; and 3) calculators for risk stratification and assessment under the influence of advanced intelligence methods. The review also presents the knowledge-based learning strategies such as machine and deep learning which may play a future role in CVD/stroke risk assessment. We conclude that both machine learning and non-machine learning strategies will flourish for current and 10-year CVD/Stroke risk prediction as long as they integrate image-based phenotypes with conventional risk factors.

A Special Report on Changing Trends in Preventive Stroke/Cardiovascular Risk Assessment Via B-Mode Ultrasonography

PURPOSE OF REVIEW

Cardiovascular disease (CVD) and stroke risk assessment have been largely based on the success of traditional statistically derived risk calculators such as Pooled Cohort Risk Score or Framingham Risk Score. However, over the last decade, automated computational paradigms such as machine learning (ML) and deep learning (DL) techniques have penetrated into a variety of medical domains including CVD/stroke risk assessment. This review is mainly focused on the changing trends in CVD/stroke risk assessment and its stratification from statistical-based models to ML-based paradigms using non-invasive carotid ultrasonography.

RECENT FINDINGS

In this review, ML-based strategies are categorized into two types: non-image (or conventional ML-based) and image-based (or integrated ML-based). The success of conventional (non-image-based) ML-based algorithms lies in the different data-driven patterns or features which are used to train the ML systems. Typically these features are the patients' demographics, serum biomarkers, and multiple clinical parameters. The integrated (image-based) ML-based algorithms integrate the features derived from the ultrasound scans of the arterial walls (such as morphological measurements) with conventional risk factors in ML frameworks. Even though the review covers ML-based system designs for carotid and coronary ultrasonography, the main focus of the review is on CVD/stroke risk scores based on carotid ultrasound. There are two key conclusions from this review: (i) fusion of image-based features with conventional cardiovascular risk factors can lead to more accurate CVD/stroke risk stratification; (ii) the ability to handle multiple sources of information in big data framework using artificial intelligence-based paradigms (such as ML and DL) is likely to be the future in preventive CVD/stroke risk assessment.

Effect of carotid image-based phenotypes on cardiovascular risk calculator: AECRS1.0

Today, the 10-year cardiovascular risk largely relies on conventional cardiovascular risk factors (CCVRFs) and suffers from the effect of atherosclerotic wall changes. In this study, we present a novel risk calculator AtheroEdge Composite Risk Score (AECRS1.0), designed by fusing CCVRF with ultrasound image-based phenotypes. Ten-year risk was computed using the Framingham Risk Score (FRS), United Kingdom Prospective Diabetes Study 56 (UKPDS56), UKPDS60, Reynolds Risk Score (RRS), and pooled composite risk (PCR) score. AECRS1.0 was computed by measuring the 10-year five carotid phenotypes such as IMT (ave., max., min.), IMT variability, and total plaque area (TPA) by fusing eight CCVRFs and then compositing them. AECRS1.0 was then benchmarked against the five conventional cardiovascular risk calculators by computing the receiver operating characteristics (ROC) and area under curve (AUC) values with a 95% CI. Two hundred four IRB-approved Japanese patients' left/right common carotid arteries (407 ultrasound scans) were collected with a mean age of 69 ± 11 years. The calculators gave the following AUC: FRS, 0.615; UKPDS56, 0.576; UKPDS60, 0.580; RRS, 0.590; PCRS, 0.613; and AECRS1.0, 0.990. When fusing CCVRF, TPA reported the highest AUC of 0.81. The patients were risk-stratified into low, moderate, and high risk using the standardized thresholds. The AECRS1.0 demonstrated the best performance on a Japanese diabetes cohort when compared with five conventional calculators. Graphical abstract AECRS1.0: Carotid ultrasound image phenotype-based 10-year cardiovascular risk calculator. The figure provides brief overview of the proposed carotid image phenotype-based 10-year cardiovascular risk calculator called AECRS1.0. AECRS1.0 was also benchmarked against five conventional cardiovascular risk calculators (Framingham Risk Score (FRS), United Kingdom Prospective Diabetes Study 56 (UKPDS56), UKPDS60, Reynolds Risk Score (RRS), and pooled composite risk (PCR) score).

Performance evaluation of 10-year ultrasound image-based stroke/cardiovascular (CV) risk calculator by comparing against ten conventional CV risk calculators: A diabetic study

MOTIVATION

AtheroEdge Composite Risk Score (AECRS1.0_10yr) is an integrated stroke/cardiovascular risk calculator that was recently developed and computes the 10-year risk of carotid image phenotypes by integrating conventional cardiovascular risk factors (CCVRFs). It is therefore important to understand how closely AECRS1.0_10yr is associated with the ten other currently available conventional cardiovascular risk calculators (CCVRCs).

METHODS

The Institutional Review Board of Toho University approved the examination of the left/right common carotid arteries of 202 Japanese patients. Step 1 consists of measurement of AECRS1.0_10yr, given current image phenotypes and CCVRFs. Step 2 consists of computing the risk score using ten different CCVRCs given CCVR factors: QRISK3, Framingham Risk Score (FRS), United Kingdom Prospective Diabetes Study (UKPDS) 56, UKPDS60, Reynolds Risk Score (RRS), Pooled cohort Risk Score (PCRS or ASCVD), Systematic Coronary Risk Evaluation (SCORE), Prospective Cardiovascular Munster Study (PROCAM) calculator, NIPPON, and World Health Organization (WHO) risk. Step 3 consists of computing the closeness factor between AECRS1.0_10yr and ten CCVRCs using cumulative ranking index derived using eight different statistically derived metrics.

RESULTS

AECRS1.0_10yr reported the highest area-under-the-curve (0.927;P < 0.001) among all the risk calculators. The top three CCVRCs closest to AECRS1.0_10yr were QRISK3, FRS, and UKPDS60 with cumulative ranking scores of 2.1, 3.0, and 3.8, respectively.

CONCLUSION

AECRS1.0_10yr produced the largest AUC due to the integration of image-based phenotypes with CCVR factors, and ranked at first place with the highest AUC. Cumulative ranking of ten CCVRCs demonstrated that QRISK3 was the closest calculator to AECRS1.0_10yr, which is also consistent with the industry trend.