Ultrasound-based internal carotid artery plaque characterization using deep learning paradigm on a supercomputer: a cardiovascular disease/stroke risk assessment system

Carotid artery calcium score: Definition, classification, application, and limits

INTRODUCTION

In the current paper, the "carotid artery calcium score" method is presented with the target to offer a metric method to quantify the amount of calcification in the carotid artery.

MODEL AND DEFINITION

The Volume of Interest (VOI) should be extracted and those voxels, with a Hounsfield Unit (HU) value ≥130, should be considered. The total weight value is determined by calculating the sum of the HU attenuation values of all voxels with values ≥130 HU. This value should be multiplied by the conversion factor ("or voxel size") and divided by a weighting factor, the attenuation threshold to consider a voxel as calcified (and therefore 130 HU): this equation determines the Carotid Artery Calcium Score (CACS).

RESULTS

In order to provide the demonstration of the potential feasibility of the model, the CACS was calculated in 131 subjects (94 males; mean age 72.7 years) for 235 carotid arteries (in 27 subjects, unilateral plaque was present) considered. The CACS value ranged from 0.67 to 11716. A statistically significant correlation was found (rho value = 0.663, p value = .0001) between the CACS in the right and left carotid plaques. Moreover, a statistically significant correlation between the age and the total CACS was present (rho value = 0.244, p value = .005), whereas no statistically significant difference was found in the distribution of CACS by gender (p = .148). The CACS was also tested at baseline and after contrast and no statistically significant difference was found.

CONCLUSION

In conclusion, this method is of easy application, and it weights at the same time the volume and the degree of calcification in a unique parameter. This method needs to be tested to verify its potential utility, similar to the coronary artery calcium score, for the risk stratification of the occurrence of cerebrovascular events of the anterior circulation. Further studies using this new diagnostic tool to determine the prognostic value of carotid calcium quantification are needed.

Deep learning approach for cardiovascular disease risk stratification and survival analysis on a Canadian cohort

The quantification of carotid plaque has been routinely used to predict cardiovascular risk in cardiovascular disease (CVD) and coronary artery disease (CAD). To determine how well carotid plaque features predict the likelihood of CAD and cardiovascular (CV) events using deep learning (DL) and compare against the machine learning (ML) paradigm. The participants in this study consisted of 459 individuals who had undergone coronary angiography, contrast-enhanced ultrasonography, and focused carotid B-mode ultrasound. Each patient was tracked for thirty days. The measurements on these patients consisted of maximum plaque height (MPH), total plaque area (TPA), carotid intima-media thickness (cIMT), and intraplaque neovascularization (IPN). CAD risk and CV event stratification were performed by applying eight types of DL-based models. Univariate and multivariate analysis was also conducted to predict the most significant risk predictors. The DL's model effectiveness was evaluated by the area-under-the-curve measurement while the CV event prediction was evaluated using the Cox proportional hazard model (CPHM) and compared against the DL-based concordance index (c-index). IPN showed a substantial ability to predict CV events (p < 0.0001). The best DL system improved by 21% (0.929 vs. 0.762) over the best ML system. DL-based CV event prediction showed a ~ 17% increase in DL-based c-index compared to the CPHM (0.86 vs. 0.73). CAD and CV incidents were linked to IPN and carotid imaging characteristics. For survival analysis and CAD prediction, the DL-based system performs superior to ML-based models.

GeneAI 3.0: powerful, novel, generalized hybrid and ensemble deep learning frameworks for miRNA species classification of stationary patterns from nucleotides

Due to the intricate relationship between the small non-coding ribonucleic acid (miRNA) sequences, the classification of miRNA species, namely Human, Gorilla, Rat, and Mouse is challenging. Previous methods are not robust and accurate. In this study, we present AtheroPoint's GeneAI 3.0, a powerful, novel, and generalized method for extracting features from the fixed patterns of purines and pyrimidines in each miRNA sequence in ensemble paradigms in machine learning (EML) and convolutional neural network (CNN)-based deep learning (EDL) frameworks. GeneAI 3.0 utilized five conventional (Entropy, Dissimilarity, Energy, Homogeneity, and Contrast), and three contemporary (Shannon entropy, Hurst exponent, Fractal dimension) features, to generate a composite feature set from given miRNA sequences which were then passed into our ML and DL classification framework. A set of 11 new classifiers was designed consisting of 5 EML and 6 EDL for binary/multiclass classification. It was benchmarked against 9 solo ML (SML), 6 solo DL (SDL), 12 hybrid DL (HDL) models, resulting in a total of 11 + 27 = 38 models were designed. Four hypotheses were formulated and validated using explainable AI (XAI) as well as reliability/statistical tests. The order of the mean performance using accuracy (ACC)/area-under-the-curve (AUC) of the 24 DL classifiers was: EDL > HDL > SDL. The mean performance of EDL models with CNN layers was superior to that without CNN layers by 0.73%/0.92%. Mean performance of EML models was superior to SML models with improvements of ACC/AUC by 6.24%/6.46%. EDL models performed significantly better than EML models, with a mean increase in ACC/AUC of 7.09%/6.96%. The GeneAI 3.0 tool produced expected XAI feature plots, and the statistical tests showed significant p-values. Ensemble models with composite features are highly effective and generalized models for effectively classifying miRNA sequences.

Positron emission tomography and its role in the assessment of vulnerable plaques in comparison to other imaging modalities

The diagnosis and management of vulnerable plaques are topics of high interest in the cardiovascular field. Although imaging techniques like computed tomography angiography (MCTA) and ultrasonography (USG) can structurally evaluate atherosclerotic plaques, they are limited in examining internal cellular processes. Positron emission tomography (PET) molecular imaging, on the other hand, can highlight these cellular processes, including inflammation, angiogenesis, and lipid oxidation. Magnetic resonance imaging (MRI) is also a valuable non-invasive imaging technique that can provide detailed anatomical and functional information on the cardiovascular system. In this review, we compare the advantages and drawbacks of MCTA, USG and MRI imaging techniques with PET molecular imaging in evaluating vulnerable plaques. PET imaging allows physicians to measure different pathophysiological events within the plaque using intravenous radiotracers, of which 18F-fluorodeoxyglucose (18F-FDG) is the most validated one. By using 18F-FDG, physicians can understand the formation of the plaque, assess the accumulation of macrophages, and predict major cardiovascular events. However, some limitations exist in using 18F-FDG, including myocardial uptake and low sensitivity in imaging coronary arteries. We also mention other radiotracers that can help in evaluating vulnerable plaques, including 18F-NaF. Although PET imaging is still challenging, it has shown promise in evaluating vulnerable plaques and could be used to intervene in high-risk patients before major cardiovascular events occur.

Software that combines deep learning, 3D reconstruction and CFD to analyze the state of carotid arteries from ultrasound imaging

BACKGROUND

Ultrasound is one of the non-invasive techniques that are used in clinical diagnostics of carotid artery disease.

OBJECTIVE

This paper presents software methodology that can be used in combination with this imaging technique to provide additional information about the state of patient-specific artery.

METHODS

Overall three modules are combined within the proposed methodology. A clinical dataset is used within the deep learning module to extract the contours of the carotid artery. This data is then used within the second module to perform the three-dimensional reconstruction of the geometry of the carotid bifurcation and ultimately this geometry is used within the third module, where the hemodynamic analysis is performed. The obtained distributions of hemodynamic quantities enable a more detailed analysis of the blood flow and state of the arterial wall and could be useful to predict further progress of present abnormalities in the carotid bifurcation.

RESULTS

The performance of the deep learning module was demonstrated through the high values of relevant common classification metric parameters. Also, the accuracy of the proposed methodology was shown through the validation of results for the reconstructed parameters against the clinically measured values.

CONCLUSION

The presented methodology could be used in combination with standard clinical ultrasound examination to quickly provide additional quantitative and qualitative information about the state of the patient's carotid bifurcation and thus ensure a treatment that is more adapted to the specific patient.

Collaborative Multi-Metadata Fusion to Improve the Classification of Lumbar Disc Herniation

Computed tomography (CT) images are the most commonly used radiographic imaging modality for detecting and diagnosing lumbar diseases. Despite many outstanding advances, computer-aided diagnosis (CAD) of lumbar disc disease remains challenging due to the complexity of pathological abnormalities and poor discrimination between different lesions. Therefore, we propose a Collaborative Multi-Metadata Fusion classification network (CMMF-Net) to address these challenges. The network consists of a feature selection model and a classification model. We propose a novel Multi-scale Feature Fusion (MFF) module that can improve the edge learning ability of the network region of interest (ROI) by fusing features of different scales and dimensions. We also propose a new loss function to improve the convergence of the network to the internal and external edges of the intervertebral disc. Subsequently, we use the ROI bounding box from the feature selection model to crop the original image and calculate the distance features matrix. We then concatenate the cropped CT images, multiscale fusion features, and distance feature matrices and input them into the classification network. Next, the model outputs the classification results and the class activation map (CAM). Finally, the CAM of the original image size is returned to the feature selection network during the upsampling process to achieve collaborative model training. Extensive experiments demonstrate the effectiveness of our method. The model achieved 91.32% accuracy in the lumbar spine disease classification task. In the labelled lumbar disc segmentation task, the Dice coefficient reaches 94.39%. The classification accuracy in the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) reaches 91.82%.

Ultrasound-Based Image Analysis for Predicting Carotid Artery Stenosis Risk: A Comprehensive Review of the Problem, Techniques, Datasets, and Future Directions

The carotid artery is a major blood vessel that supplies blood to the brain. Plaque buildup in the arteries can lead to cardiovascular diseases such as atherosclerosis, stroke, ruptured arteries, and even death. Both invasive and non-invasive methods are used to detect plaque buildup in the arteries, with ultrasound imaging being the first line of diagnosis. This paper presents a comprehensive review of the existing literature on ultrasound image analysis methods for detecting and characterizing plaque buildup in the carotid artery. The review includes an in-depth analysis of datasets; image segmentation techniques for the carotid artery plaque area, lumen area, and intima-media thickness (IMT); and plaque measurement, characterization, classification, and stenosis grading using deep learning and machine learning. Additionally, the paper provides an overview of the performance of these methods, including challenges in analysis, and future directions for research.

Development of gene model combined with machine learning technology to predict for advanced atherosclerotic plaques

BACKGROUND

Atherosclerosis, as a major cause of stroke, is responsible for a quarter of deaths worldwide. In particular, rupture of late-stage plaques in large vessels such as the carotid artery can lead to serious cardiovascular disease. The aim of our study was to establish a genetic model combined with machining leaning techniques to screen out gene signatures and predict for advanced atherosclerosis plaques.

METHODS

The microarray dataset GSE28829 and GSE43292 which were publicly obtained from the Gene Expression Omnibus database were utilized to screen for potential predictive genes. Differentially expressed genes (DEGs) were identified by using the "limma" R package. Gene Ontology (GO) and Kyoto Encyclopedia of Genes Genomes (KEGG) analyses of these DEGs were performed by Metascape. Later, Random Forest (RF) algorithm was applied to further screen out top-30 genes which contribute the most. The expression data of top 30-DEGs were converted into a "Gene Score". Finally, we developed a model based on artificial neural network (ANN) to predict advanced atherosclerotic plaques. The model later was validated in an independent test dataset GSE104140.

RESULTS

A total of 176 DEGs were identified in the training datasets. GO and KEGG enrichment analysis revealed that these genes were enriched in leukocyte-mediated immune response, cytokine- cytokine interactions, and immunoinflammatory signaling. Further, top-30 genes (including 25 upregulated and 5 downregulated DEGs) were screened as predictors by RF algorithm. The predictive model was developed with a significantly predictive value (AUC = 0.913) in the training datasets, and was validated with an independent dataset GSE104140 (AUC = 0.827).

CONCLUSION

In present study, our prediction model was established and showed satisfactory predictive power in both training and test datasets. In addition, this is the first study adopted bioinformatics methods combined with machine learning techniques (RF and ANN) to explore and predict for the advanced atherosclerotic plaques. However, further investigations were needed to verify the screened DEGs and predictive effectiveness of this model.

Machine Learning and the Conundrum of Stroke Risk Prediction

Stroke is a leading cause of death worldwide. With escalating healthcare costs, early non-invasive stroke risk stratification is vital. The current paradigm of stroke risk assessment and mitigation is focused on clinical risk factors and comorbidities. Standard algorithms predict risk using regression-based statistical associations, which, while useful and easy to use, have moderate predictive accuracy. This review summarises recent efforts to deploy machine learning (ML) to predict stroke risk and enrich the understanding of the mechanisms underlying stroke. The surveyed body of literature includes studies comparing ML algorithms with conventional statistical models for predicting cardiovascular disease and, in particular, different stroke subtypes. Another avenue of research explored is ML as a means of enriching multiscale computational modelling, which holds great promise for revealing thrombogenesis mechanisms. Overall, ML offers a new approach to stroke risk stratification that accounts for subtle physiologic variants between patients, potentially leading to more reliable and personalised predictions than standard regression-based statistical associations.

Vascular wall motion detection models based on long short-term memory in plane-wave-based ultrasound imaging

Objective.Vascular wall motion can be used to diagnose cardiovascular diseases. In this study, long short-term memory (LSTM) neural networks were used to track vascular wall motion in plane-wave-based ultrasound imaging.Approach.The proposed LSTM and convolutional LSTM (ConvLSTM) models were trained using ultrasound data from simulations and tested experimentally using a tissue-mimicking vascular phantom and anin vivostudy using a carotid artery. The performance of the models in the simulation was evaluated using the mean square error from axial and lateral motions and compared with the cross-correlation (XCorr) method. Statistical analysis was performed using the Bland-Altman plot, Pearson correlation coefficient, and linear regression in comparison with the manually annotated ground truth.Main results.For thein vivodata, the median error and 95% limit of agreement from the Bland-Altman analysis were (0.01, 0.13), (0.02, 0.19), and (0.03, 0.18), the Pearson correlation coefficients were 0.97, 0.94, and 0.94, respectively, and the linear equations were 0.89x+ 0.02, 0.84x+ 0.03, and 0.88x+ 0.03 from linear regression for the ConvLSTM model, LSTM model, and XCorr method, respectively. In the longitudinal and transverse views of the carotid artery, the LSTM-based models outperformed the XCorr method. Overall, the ConvLSTM model was superior to the LSTM model and XCorr method.Significance.This study demonstrated that vascular wall motion can be tracked accurately and precisely using plane-wave-based ultrasound imaging and the proposed LSTM-based models.

Cross-Sectional Association of Dietary Patterns and Supplement Intake with Presence and Gray-Scale Median of Carotid Plaques-A Comparison between Women and Men in the Population-Based Hamburg City Health Study

This population-based cross-sectional cohort study investigated the association of the Mediterranean and DASH (Dietary Approach to Stop Hypertension) diet as well as supplement intake with gray-scale median (GSM) and the presence of carotid plaques comparing women and men. Low GSM is associated with plaque vulnerability. Ten thousand participants of the Hamburg City Health Study aged 45-74 underwent carotid ultrasound examination. We analyzed plaque presence in all participants plus GSM in those having plaques (n = 2163). Dietary patterns and supplement intake were assessed via a food frequency questionnaire. Multiple linear and logistic regression models were used to assess associations between dietary patterns, supplement intake and GSM plus plaque presence. Linear regressions showed an association between higher GSM and folate intake only in men (+9.12, 95% CI (1.37, 16.86), p = 0.021). High compared to intermediate adherence to the DASH diet was associated with higher odds for carotid plaques (OR = 1.18, 95% CI (1.02, 1.36), p = 0.027, adjusted). Odds for plaque presence were higher for men, older age, low education, hypertension, hyperlipidemia and smoking. In this study, the intake of most supplements, as well as DASH or Mediterranean diet, was not significantly associated with GSM for women or men. Future research is needed to clarify the influence, especially of the folate intake and DASH diet, on the presence and vulnerability of plaques.

Role of Ensemble Deep Learning for Brain Tumor Classification in Multiple Magnetic Resonance Imaging Sequence Data

The biopsy is a gold standard method for tumor grading. However, due to its invasive nature, it has sometimes proved fatal for brain tumor patients. As a result, a non-invasive computer-aided diagnosis (CAD) tool is required. Recently, many magnetic resonance imaging (MRI)-based CAD tools have been proposed for brain tumor grading. The MRI has several sequences, which can express tumor structure in different ways. However, a suitable MRI sequence for brain tumor classification is not yet known. The most common brain tumor is 'glioma', which is the most fatal form. Therefore, in the proposed study, to maximize the classification ability between low-grade versus high-grade glioma, three datasets were designed comprising three MRI sequences: T1-Weighted (T1W), T2-weighted (T2W), and fluid-attenuated inversion recovery (FLAIR). Further, five well-established convolutional neural networks, AlexNet, VGG16, ResNet18, GoogleNet, and ResNet50 were adopted for tumor classification. An ensemble algorithm was proposed using the majority vote of above five deep learning (DL) models to produce more consistent and improved results than any individual model. Five-fold cross validation (K5-CV) protocol was adopted for training and testing. For the proposed ensembled classifier with K5-CV, the highest test accuracies of 98.88 ± 0.63%, 97.98 ± 0.86%, and 94.75 ± 0.61% were achieved for FLAIR, T2W, and T1W-MRI data, respectively. FLAIR-MRI data was found to be most significant for brain tumor classification, where it showed a 4.17% and 0.91% improvement in accuracy against the T1W-MRI and T2W-MRI sequence data, respectively. The proposed ensembled algorithm (MajVot) showed significant improvements in the average accuracy of three datasets of 3.60%, 2.84%, 1.64%, 4.27%, and 1.14%, respectively, against AlexNet, VGG16, ResNet18, GoogleNet, and ResNet50.

Deep learning based on carotid transverse B-mode scan videos for the diagnosis of carotid plaque: a prospective multicenter study

OBJECTIVES

Accurate detection of carotid plaque using ultrasound (US) is essential for preventing stroke. However, the diagnostic performance of junior radiologists (with approximately 1 year of experience in carotid US evaluation) is relatively poor. We thus aim to develop a deep learning (DL) model based on US videos to improve junior radiologists' performance in plaque detection.

METHODS

This multicenter prospective study was conducted at five hospitals. CaroNet-Dynamic automatically detected carotid plaque from carotid transverse US videos allowing clinical detection. Model performance was evaluated using expert annotations (with more than 10 years of experience in carotid US evaluation) as the ground truth. Model robustness was investigated on different plaque characteristics and US scanning systems. Furthermore, its clinical applicability was evaluated by comparing the junior radiologists' diagnoses with and without DL-model assistance.

RESULTS

A total of 1647 videos from 825 patients were evaluated. The DL model yielded high performance with sensitivities of 87.03% and 94.17%, specificities of 82.07% and 74.04%, and areas under the receiver operating characteristic curve of 0.845 and 0.841 on the internal and multicenter external test sets, respectively. Moreover, no significant difference in performance was noted among different plaque characteristics and scanning systems. Using the DL model, the performance of the junior radiologists improved significantly, especially in terms of sensitivity (largest increase from 46.3 to 94.44%).

CONCLUSIONS

The DL model based on US videos corresponding to real examinations showed robust performance for plaque detection and significantly improved the diagnostic performance of junior radiologists.

KEY POINTS

• The deep learning model based on US videos conforming to real examinations showed robust performance for plaque detection. • Computer-aided diagnosis can significantly improve the diagnostic performance of junior radiologists in clinical practice.

Cardiovascular/Stroke Risk Stratification in Diabetic Foot Infection Patients Using Deep Learning-Based Artificial Intelligence: An Investigative Study

A diabetic foot infection (DFI) is among the most serious, incurable, and costly to treat conditions. The presence of a DFI renders machine learning (ML) systems extremely nonlinear, posing difficulties in CVD/stroke risk stratification. In addition, there is a limited number of well-explained ML paradigms due to comorbidity, sample size limits, and weak scientific and clinical validation methodologies. Deep neural networks (DNN) are potent machines for learning that generalize nonlinear situations. The objective of this article is to propose a novel investigation of deep learning (DL) solutions for predicting CVD/stroke risk in DFI patients. The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) search strategy was used for the selection of 207 studies. We hypothesize that a DFI is responsible for increased morbidity and mortality due to the worsening of atherosclerotic disease and affecting coronary artery disease (CAD). Since surrogate biomarkers for CAD, such as carotid artery disease, can be used for monitoring CVD, we can thus use a DL-based model, namely, Long Short-Term Memory (LSTM) and Recurrent Neural Networks (RNN) for CVD/stroke risk prediction in DFI patients, which combines covariates such as office and laboratory-based biomarkers, carotid ultrasound image phenotype (CUSIP) lesions, along with the DFI severity. We confirmed the viability of CVD/stroke risk stratification in the DFI patients. Strong designs were found in the research of the DL architectures for CVD/stroke risk stratification. Finally, we analyzed the AI bias and proposed strategies for the early diagnosis of CVD/stroke in DFI patients. Since DFI patients have an aggressive atherosclerotic disease, leading to prominent CVD/stroke risk, we, therefore, conclude that the DL paradigm is very effective for predicting the risk of CVD/stroke in DFI patients.

Segmentation-Based Classification Deep Learning Model Embedded with Explainable AI for COVID-19 Detection in Chest X-ray Scans

Background and Motivation: COVID-19 has resulted in a massive loss of life during the last two years. The current imaging-based diagnostic methods for COVID-19 detection in multiclass pneumonia-type chest X-rays are not so successful in clinical practice due to high error rates. Our hypothesis states that if we can have a segmentation-based classification error rate <5%, typically adopted for 510 (K) regulatory purposes, the diagnostic system can be adapted in clinical settings. Method: This study proposes 16 types of segmentation-based classification deep learning-based systems for automatic, rapid, and precise detection of COVID-19. The two deep learning-based segmentation networks, namely UNet and UNet+, along with eight classification models, namely VGG16, VGG19, Xception, InceptionV3, Densenet201, NASNetMobile, Resnet50, and MobileNet, were applied to select the best-suited combination of networks. Using the cross-entropy loss function, the system performance was evaluated by Dice, Jaccard, area-under-the-curve (AUC), and receiver operating characteristics (ROC) and validated using Grad-CAM in explainable AI framework. Results: The best performing segmentation model was UNet, which exhibited the accuracy, loss, Dice, Jaccard, and AUC of 96.35%, 0.15%, 94.88%, 90.38%, and 0.99 (p-value <0.0001), respectively. The best performing segmentation-based classification model was UNet+Xception, which exhibited the accuracy, precision, recall, F1-score, and AUC of 97.45%, 97.46%, 97.45%, 97.43%, and 0.998 (p-value <0.0001), respectively. Our system outperformed existing methods for segmentation-based classification models. The mean improvement of the UNet+Xception system over all the remaining studies was 8.27%. Conclusion: The segmentation-based classification is a viable option as the hypothesis (error rate <5%) holds true and is thus adaptable in clinical practice.

Brain Tumor Characterization Using Radiogenomics in Artificial Intelligence Framework

Brain tumor characterization (BTC) is the process of knowing the underlying cause of brain tumors and their characteristics through various approaches such as tumor segmentation, classification, detection, and risk analysis. The substantial brain tumor characterization includes the identification of the molecular signature of various useful genomes whose alteration causes the brain tumor. The radiomics approach uses the radiological image for disease characterization by extracting quantitative radiomics features in the artificial intelligence (AI) environment. However, when considering a higher level of disease characteristics such as genetic information and mutation status, the combined study of "radiomics and genomics" has been considered under the umbrella of "radiogenomics". Furthermore, AI in a radiogenomics' environment offers benefits/advantages such as the finalized outcome of personalized treatment and individualized medicine. The proposed study summarizes the brain tumor's characterization in the prospect of an emerging field of research, i.e., radiomics and radiogenomics in an AI environment, with the help of statistical observation and risk-of-bias (RoB) analysis. The PRISMA search approach was used to find 121 relevant studies for the proposed review using IEEE, Google Scholar, PubMed, MDPI, and Scopus. Our findings indicate that both radiomics and radiogenomics have been successfully applied aggressively to several oncology applications with numerous advantages. Furthermore, under the AI paradigm, both the conventional and deep radiomics features have made an impact on the favorable outcomes of the radiogenomics approach of BTC. Furthermore, risk-of-bias (RoB) analysis offers a better understanding of the architectures with stronger benefits of AI by providing the bias involved in them.

Vascular Implications of COVID-19: Role of Radiological Imaging, Artificial Intelligence, and Tissue Characterization: A Special Report

The SARS-CoV-2 virus has caused a pandemic, infecting nearly 80 million people worldwide, with mortality exceeding six million. The average survival span is just 14 days from the time the symptoms become aggressive. The present study delineates the deep-driven vascular damage in the pulmonary, renal, coronary, and carotid vessels due to SARS-CoV-2. This special report addresses an important gap in the literature in understanding (i) the pathophysiology of vascular damage and the role of medical imaging in the visualization of the damage caused by SARS-CoV-2, and (ii) further understanding the severity of COVID-19 using artificial intelligence (AI)-based tissue characterization (TC). PRISMA was used to select 296 studies for AI-based TC. Radiological imaging techniques such as magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound were selected for imaging of the vasculature infected by COVID-19. Four kinds of hypotheses are presented for showing the vascular damage in radiological images due to COVID-19. Three kinds of AI models, namely, machine learning, deep learning, and transfer learning, are used for TC. Further, the study presents recommendations for improving AI-based architectures for vascular studies. We conclude that the process of vascular damage due to COVID-19 has similarities across vessel types, even though it results in multi-organ dysfunction. Although the mortality rate is ~2% of those infected, the long-term effect of COVID-19 needs monitoring to avoid deaths. AI seems to be penetrating the health care industry at warp speed, and we expect to see an emerging role in patient care, reduce the mortality and morbidity rate.

Evaluation of Intima-Media Thickness and Arterial Stiffness as Early Ultrasound Biomarkers of Carotid Artery Atherosclerosis

Carotid atherosclerosis is a major and potentially preventable cause of ischemic stroke. It begins early in life and progresses silently over the years. Identification of individuals with subclinical atherosclerosis is needed to initiate early aggressive vascular prevention. Although carotid plaque appears to be a powerful predictor of cardiovascular risk, carotid intima-media thickness (CIMT) and arterial stiffness can be detected at the initial phases and, therefore, they are considered important new biomarkers of carotid atherosclerosis. There is a well-documented association between CIMT and cerebrovascular events. CIMT provides a reliable marker in young people, in whom plaque formation or calcification is not established. However, the usefulness of CIMT measurement in the improvement of risk cardiovascular models is still controversial. Carotid stiffness is also significantly associated with ischemic stroke. Carotid stiffness adds value to the existing risk prediction based on Framingham risk factors, particularly individuals at intermediate cardiovascular risk. Carotid ultrasound is used to assess carotid atherosclerosis. During the last decade, automated techniques for sophisticated analysis of vascular mechanics have evolved, such as speckle tracking, and new methods based on deep learning have been proposed with promising outcomes. Additional research is needed to investigate the imaging-based cardiovascular risk prediction of CIMT and stiffness.

An artificial intelligence framework and its bias for brain tumor segmentation: A narrative review

BACKGROUND

Artificial intelligence (AI) has become a prominent technique for medical diagnosis and represents an essential role in detecting brain tumors. Although AI-based models are widely used in brain lesion segmentation (BLS), understanding their effectiveness is challenging due to their complexity and diversity. Several reviews on brain tumor segmentation are available, but none of them describe a link between the threats due to risk-of-bias (RoB) in AI and its architectures. In our review, we focused on linking RoB and different AI-based architectural Cluster in popular DL framework. Further, due to variance in these designs and input data types in medical imaging, it is necessary to present a narrative review considering all facets of BLS.

APPROACH

The proposed study uses a PRISMA strategy based on 75 relevant studies found by searching PubMed, Scopus, and Google Scholar. Based on the architectural evolution, DL studies were subsequently categorized into four classes: convolutional neural network (CNN)-based, encoder-decoder (ED)-based, transfer learning (TL)-based, and hybrid DL (HDL)-based architectures. These studies were then analyzed considering 32 AI attributes, with clusters including AI architecture, imaging modalities, hyper-parameters, performance evaluation metrics, and clinical evaluation. Then, after these studies were scored for all attributes, a composite score was computed, normalized, and ranked. Thereafter, a bias cutoff (AP(ai)Bias 1.0, AtheroPoint, Roseville, CA, USA) was established to detect low-, moderate- and high-bias studies.

CONCLUSION

The four classes of architectures, from best-to worst-performing, are TL > ED > CNN > HDL. ED-based models had the lowest AI bias for BLS. This study presents a set of three primary and six secondary recommendations for lowering the RoB.

Four Types of Multiclass Frameworks for Pneumonia Classification and Its Validation in X-ray Scans Using Seven Types of Deep Learning Artificial Intelligence Models

Background and Motivation: The novel coronavirus causing COVID-19 is exceptionally contagious, highly mutative, decimating human health and life, as well as the global economy, by consistent evolution of new pernicious variants and outbreaks. The reverse transcriptase polymerase chain reaction currently used for diagnosis has major limitations. Furthermore, the multiclass lung classification X-ray systems having viral, bacterial, and tubercular classes—including COVID-19—are not reliable. Thus, there is a need for a robust, fast, cost-effective, and easily available diagnostic method. Method: Artificial intelligence (AI) has been shown to revolutionize all walks of life, particularly medical imaging. This study proposes a deep learning AI-based automatic multiclass detection and classification of pneumonia from chest X-ray images that are readily available and highly cost-effective. The study has designed and applied seven highly efficient pre-trained convolutional neural networks—namely, VGG16, VGG19, DenseNet201, Xception, InceptionV3, NasnetMobile, and ResNet152—for classification of up to five classes of pneumonia. Results: The database consisted of 18,603 scans with two, three, and five classes. The best results were using DenseNet201, VGG16, and VGG16, respectively having accuracies of 99.84%, 96.7%, 92.67%; sensitivity of 99.84%, 96.63%, 92.70%; specificity of 99.84, 96.63%, 92.41%; and AUC of 1.0, 0.97, 0.92 (p < 0.0001 for all), respectively. Our system outperformed existing methods by 1.2% for the five-class model. The online system takes <1 s while demonstrating reliability and stability. Conclusions: Deep learning AI is a powerful paradigm for multiclass pneumonia classification.

Human activity recognition in artificial intelligence framework: a narrative review

Human activity recognition (HAR) has multifaceted applications due to its worldly usage of acquisition devices such as smartphones, video cameras, and its ability to capture human activity data. While electronic devices and their applications are steadily growing, the advances in Artificial intelligence (AI) have revolutionized the ability to extract deep hidden information for accurate detection and its interpretation. This yields a better understanding of rapidly growing acquisition devices, AI, and applications, the three pillars of HAR under one roof. There are many review articles published on the general characteristics of HAR, a few have compared all the HAR devices at the same time, and few have explored the impact of evolving AI architecture. In our proposed review, a detailed narration on the three pillars of HAR is presented covering the period from 2011 to 2021. Further, the review presents the recommendations for an improved HAR design, its reliability, and stability. Five major findings were: (1) HAR constitutes three major pillars such as devices, AI and applications; (2) HAR has dominated the healthcare industry; (3) Hybrid AI models are in their infancy stage and needs considerable work for providing the stable and reliable design. Further, these trained models need solid prediction, high accuracy, generalization, and finally, meeting the objectives of the applications without bias; (4) little work was observed in abnormality detection during actions; and (5) almost no work has been done in forecasting actions. We conclude that: (a) HAR industry will evolve in terms of the three pillars of electronic devices, applications and the type of AI. (b) AI will provide a powerful impetus to the HAR industry in future.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10462-021-10116-x.

Cardiovascular disease detection using machine learning and carotid/femoral arterial imaging frameworks in rheumatoid arthritis patients

The study proposes a novel machine learning (ML) paradigm for cardiovascular disease (CVD) detection in individuals at medium to high cardiovascular risk using data from a Greek cohort of 542 individuals with rheumatoid arthritis, or diabetes mellitus, and/or arterial hypertension, using conventional or office-based, laboratory-based blood biomarkers and carotid/femoral ultrasound image-based phenotypes. Two kinds of data (CVD risk factors and presence of CVD-defined as stroke, or myocardial infarction, or coronary artery syndrome, or peripheral artery disease, or coronary heart disease) as ground truth, were collected at two-time points: (i) at visit 1 and (ii) at visit 2 after 3 years. The CVD risk factors were divided into three clusters (conventional or office-based, laboratory-based blood biomarkers, carotid ultrasound image-based phenotypes) to study their effect on the ML classifiers. Three kinds of ML classifiers (Random Forest, Support Vector Machine, and Linear Discriminant Analysis) were applied in a two-fold cross-validation framework using the data augmented by synthetic minority over-sampling technique (SMOTE) strategy. The performance of the ML classifiers was recorded. In this cohort with overall 46 CVD risk factors (covariates) implemented in an online cardiovascular framework, that requires calculation time less than 1 s per patient, a mean accuracy and area-under-the-curve (AUC) of 98.40% and 0.98 (p < 0.0001) for CVD presence detection at visit 1, and 98.39% and 0.98 (p < 0.0001) at visit 2, respectively. The performance of the cardiovascular framework was significantly better than the classical CVD risk score. The ML paradigm proved to be powerful for CVD prediction in individuals at medium to high cardiovascular risk.

Contrast enhanced sonothrombolysis using streptokinase loaded phase change nano-droplets for potential treatment of deep venous thrombosis

Current thrombolytic therapies for deep venous thrombosis are limited due to the wide side effect profile. Contrast mediated sonothrombolysis is a promising approach for thrombus treatment. The current study examines the effectiveness of in vitro streptokinase (SK) loaded phase-change nanodroplet (PCND) mediated sonothrombolysis at 7 MHz for the diagnosis of deep venous thrombosis. Lecithin shell and perfluorohexane core nanodroplets were prepared via the thin-film hydration method and morphologically characterized. Sonothrombolysis was performed at 7 MHz at different mechanical indexes of samples i.e., only sonothrombolysis, PCND mediated sonothrombolysis, sonothrombolysis with SK and SK loaded PCND mediated sonothrombolysis. Thrombolysis efficacy was assessed by measuring clot weight changes during 30 min US exposure, recording the mean gray intensity from the US images of the clot by computer software ImageJ, and spectrophotometric quantification of the hemoglobin in the clot lysate. In 15 minutes of sonothrombolysis performed at high mechanical index (0.9 and 1.2), SK loaded PCNDs showed a 48.61% and 74.29% reduction of mean gray intensity. At 0.9 and 1.2 MI, 86% and 92% weight loss was noted for SK-loaded PCNDs in confidence with spectrophotometric results. A significant difference (P < 0.05) was noted for SK-loaded PCND mediated sonothrombolysis compared to other groups. Loading of SK inside the PCNDs enhanced the efficacy of sonothrombolysis. An increase in MI and time also increased the efficacy of sonothrombolysis. This in vitro study showed the potential use of SK-loaded perfluorohexane core PCNDs as sonothrombolytic agents for deep venous thrombosis.

Contrast enhanced sonothrombolysis using streptokinase loaded phase change nano-droplets.

Unseen Artificial Intelligence-Deep Learning Paradigm for Segmentation of Low Atherosclerotic Plaque in Carotid Ultrasound: A Multicenter Cardiovascular Study

BACKGROUND

The early detection of carotid wall plaque is recommended in the prevention of cardiovascular disease (CVD) in moderate-risk patients. Previous techniques for B-mode carotid atherosclerotic wall plaque segmentation used artificial intelligence (AI) methods on monoethnic databases, where training and testing are from the "same" ethnic group ("Seen AI"). Therefore, the versatility of the system is questionable. This is the first study of its kind that uses the "Unseen AI" paradigm where training and testing are from "different" ethnic groups. We hypothesized that deep learning (DL) models should perform in 10% proximity between "Unseen AI" and "Seen AI".

METHODOLOGY

Two cohorts from multi-ethnic groups (330 Japanese and 300 Hong Kong (HK)) were used for the validation of our hypothesis. We used a four-layered UNet architecture for the segmentation of the atherosclerotic wall with low plaque. "Unseen AI" (training: Japanese, testing: HK or vice versa) and "Seen AI" experiments (single ethnicity or mixed ethnicity) were performed. Evaluation was conducted by measuring the wall plaque area. Statistical tests were conducted for its stability and reliability.

RESULTS

When using the UNet DL architecture, the "Unseen AI" pair one (Training: 330 Japanese and Testing: 300 HK), the mean accuracy, dice-similarity, and correlation-coefficient were 98.55, 78.38, and 0.80 (p < 0.0001), respectively, while for "Unseen AI" pair two (Training: 300 HK and Testing: 330 Japanese), these were 98.67, 82.49, and 0.87 (p < 0.0001), respectively. Using "Seen AI", the same parameters were 99.01, 86.89 and 0.92 (p < 0.0001), respectively.

CONCLUSION

We demonstrated that "Unseen AI" was in close proximity (<10%) to "Seen AI", validating our DL model for low atherosclerotic wall plaque segmentation. The online system runs < 1 s.

Automated deep learning-based paradigm for high-risk plaque detection in B-mode common carotid ultrasound scans: an asymptomatic Japanese cohort study

BACKGROUND

The death due to stroke is caused by embolism of the arteries which is due to the rupture of the atherosclerotic lesions in carotid arteries. The lesion formation is over time, and thus, early screening is recommended for asymptomatic and moderate-risk patients. The previous techniques adopted conventional methods or semi-automated and, more recently, machine learning solutions. A handful of studies have emerged based on solo deep learning (SDL) models such as UNet architecture.

METHODS

The proposed research is the first to adopt hybrid deep learning (HDL) artificial intelligence models such as SegNet-UNet. This model is benchmarked against UNet and advanced conventional models using scale-space such as AtheroEdge 2.0 (AtheroPoint, CA, USA). All our resultant statistics of the three systems were in the order of UNet, SegNet-UNet, and AtheroEdge 2.0.

RESULTS

Using the database of 379 ultrasound scans from a Japanese cohort of 190 patients having moderate risk and implementing the cross-validation deep learning framework, our system performance using area-under-the-curve (AUC) for UNet, SegNet-UNet, and AtheroEdge 2.0 were 0.93, 0.94, and 0.95 (p<0.001), respectively. The coefficient of correlation between the three systems and ground truth (GT) were: 0.82, 0.89, and 0.85 (p<0.001 for all three), respectively. The mean absolute area error for the three systems against manual GT was 4.07±4.70 mm2, 3.11±3.92 mm2, 3.72±4.76 mm2, respectively, proving the superior performance SegNet-UNet against UNet and AtheroEdge 2.0, respectively. Statistical tests were also conducted for their reliability and stability.

CONCLUSIONS

The proposed study demonstrates a fast, accurate, and reliable solution for early detection and quantification of plaque lesions in common carotid artery ultrasound scans. The system runs on a test US image in < 1 second, proving overall performance to be clinically reliable.

Ten Fast Transfer Learning Models for Carotid Ultrasound Plaque Tissue Characterization in Augmentation Framework Embedded with Heatmaps for Stroke Risk Stratification

Background and Purpose: Only 1-2% of the internal carotid artery asymptomatic plaques are unstable as a result of >80% stenosis. Thus, unnecessary efforts can be saved if these plaques can be characterized and classified into symptomatic and asymptomatic using non-invasive B-mode ultrasound. Earlier plaque tissue characterization (PTC) methods were machine learning (ML)-based, which used hand-crafted features that yielded lower accuracy and unreliability. The proposed study shows the role of transfer learning (TL)-based deep learning models for PTC. Methods: As pertained weights were used in the supercomputer framework, we hypothesize that transfer learning (TL) provides improved performance compared with deep learning. We applied 11 kinds of artificial intelligence (AI) models, 10 of them were augmented and optimized using TL approaches-a class of Atheromatic™ 2.0 TL (AtheroPoint™, Roseville, CA, USA) that consisted of (i-ii) Visual Geometric Group-16, 19 (VGG16, 19); (iii) Inception V3 (IV3); (iv-v) DenseNet121, 169; (vi) XceptionNet; (vii) ResNet50; (viii) MobileNet; (ix) AlexNet; (x) SqueezeNet; and one DL-based (xi) SuriNet-derived from UNet. We benchmark 11 AI models against our earlier deep convolutional neural network (DCNN) model. Results: The best performing TL was MobileNet, with accuracy and area-under-the-curve (AUC) pairs of 96.10 ± 3% and 0.961 (p < 0.0001), respectively. In DL, DCNN was comparable to SuriNet, with an accuracy of 95.66% and 92.7 ± 5.66%, and an AUC of 0.956 (p < 0.0001) and 0.927 (p < 0.0001), respectively. We validated the performance of the AI architectures with established biomarkers such as greyscale median (GSM), fractal dimension (FD), higher-order spectra (HOS), and visual heatmaps. We benchmarked against previously developed Atheromatic™ 1.0 ML and showed an improvement of 12.9%. Conclusions: TL is a powerful AI tool for PTC into symptomatic and asymptomatic plaques.

Systematic Review of Artificial Intelligence in Acute Respiratory Distress Syndrome for COVID-19 Lung Patients: A Biomedical Imaging Perspective

SARS-CoV-2 has infected over ∼165 million people worldwide causing Acute Respiratory Distress Syndrome (ARDS) and has killed ∼3.4 million people. Artificial Intelligence (AI) has shown to benefit in the biomedical image such as X-ray/Computed Tomography in diagnosis of ARDS, but there are limited AI-based systematic reviews (aiSR). The purpose of this study is to understand the Risk-of-Bias (RoB) in a non-randomized AI trial for handling ARDS using novel AtheroPoint-AI-Bias (AP(ai)Bias). Our hypothesis for acceptance of a study to be in low RoB must have a mean score of 80% in a study. Using the PRISMA model, 42 best AI studies were analyzed to understand the RoB. Using the AP(ai)Bias paradigm, the top 19 studies were then chosen using the raw-cutoff of 1.9. This was obtained using the intersection of the cumulative plot of "mean score vs. study" and score distribution. Finally, these studies were benchmarked against ROBINS-I and PROBAST paradigm. Our observation showed that AP(ai)Bias, ROBINS-I, and PROBAST had only 32%, 16%, and 26% studies, respectively in low-moderate RoB (cutoff>2.5), however none of them met the RoB hypothesis. Further, the aiSR analysis recommends six primary and six secondary recommendations for the non-randomized AI for ARDS. The primary recommendations for improvement in AI-based ARDS design inclusive of (i) comorbidity, (ii) inter-and intra-observer variability studies, (iii) large data size, (iv) clinical validation, (v) granularity of COVID-19 risk, and (vi) cross-modality scientific validation. The AI is an important component for diagnosis of ARDS and the recommendations must be followed to lower the RoB.

Hybrid deep learning segmentation models for atherosclerotic plaque in internal carotid artery B-mode ultrasound

The automated and accurate carotid plaque segmentation in B-mode ultrasound (US) is an essential part of stroke risk stratification. Previous segmented methods used AtheroEdge™ 2.0 (AtheroPoint™, Roseville, CA) for the common carotid artery (CCA). This study focuses on automated plaque segmentation in the internal carotid artery (ICA) using solo deep learning (SDL) and hybrid deep learning (HDL) models. The methodology consists of a novel design of 10 types of SDL/HDL models (AtheroEdge™ 3.0 systems (AtheroPoint™, Roseville, CA) with a depth of four layers each. Five of the models use cross-entropy (CE)-loss, and the other five models use Dice similarity coefficient (DSC)-loss functions derived from UNet, UNet+, SegNet, SegNet-UNet, and SegNet-UNet+. The K10 protocol (Train:Test:90%:10%) was applied for all 10 models for training and predicting (segmenting) the plaque region, which was then quantified to compute the plaque area in mm². Further, the data augmentation effect was analyzed. The database consisted of 970 ICA B-mode US scans taken from 99 moderate to high-risk patients. Using the difference area threshold of 10 mm² between ground truth (GT) and artificial intelligence (AI), the area under the curve (AUC) values were 0.91, 0.911, 0.908, 0.905, and 0.898, all with a p-value of <0.001 (for CE-loss models) and 0.883, 0.889, 0.905, 0.889, and 0.907, all with a p-value of <0.001 (for DSC-loss models). The correlations between the AI-based plaque area and GT plaque area were 0.98, 0.96, 0.97, 0.98, and 0.97, all with a p-value of <0.001 (for CE-loss models) and 0.98, 0.98, 0.97, 0.98, and 0.98 (for DSC-loss models). Overall, the online system performs plaque segmentation in less than 1 s. We validate our hypothesis that HDL and SDL models demonstrate comparable performance. SegNet-UNet was the best-performing hybrid architecture.

Multimodality carotid plaque tissue characterization and classification in the artificial intelligence paradigm: a narrative review for stroke application

Cardiovascular disease (CVD) is one of the leading causes of morbidity and mortality in the United States of America and globally. Carotid arterial plaque, a cause and also a marker of such CVD, can be detected by various non-invasive imaging modalities such as magnetic resonance imaging (MRI), computer tomography (CT), and ultrasound (US). Characterization and classification of carotid plaque-type in these imaging modalities, especially into symptomatic and asymptomatic plaque, helps in the planning of carotid endarterectomy or stenting. It can be challenging to characterize plaque components due to (I) partial volume effect in magnetic resonance imaging (MRI) or (II) varying Hausdorff values in plaque regions in CT, and (III) attenuation of echoes reflected by the plaque during US causing acoustic shadowing. Artificial intelligence (AI) methods have become an indispensable part of healthcare and their applications to the non-invasive imaging technologies such as MRI, CT, and the US. In this narrative review, three main types of AI models (machine learning, deep learning, and transfer learning) are analyzed when applied to MRI, CT, and the US. A link between carotid plaque characteristics and the risk of coronary artery disease is presented. With regard to characterization, we review tools and techniques that use AI models to distinguish carotid plaque types based on signal processing and feature strengths. We conclude that AI-based solutions offer an accurate and robust path for tissue characterization and classification for carotid artery plaque imaging in all three imaging modalities. Due to cost, user-friendliness, and clinical effectiveness, AI in the US has dominated the most.