Multimodality carotid plaque tissue characterization and classification in the artificial intelligence paradigm: a narrative review for stroke application

COVLIAS 3.0: cloud-based quantized hybrid UNet3+ deep learning for COVID-19 lesion detection in lung computed tomography

Background and novelty

When RT-PCR is ineffective in early diagnosis and understanding of COVID-19 severity, Computed Tomography (CT) scans are needed for COVID diagnosis, especially in patients having high ground-glass opacities, consolidations, and crazy paving. Radiologists find the manual method for lesion detection in CT very challenging and tedious. Previously solo deep learning (SDL) was tried but they had low to moderate-level performance. This study presents two new cloud-based quantized deep learning UNet3+ hybrid (HDL) models, which incorporated full-scale skip connections to enhance and improve the detections.

Methodology

Annotations from expert radiologists were used to train one SDL (UNet3+), and two HDL models, namely, VGG-UNet3+ and ResNet-UNet3+. For accuracy, 5-fold cross-validation protocols, training on 3,500 CT scans, and testing on unseen 500 CT scans were adopted in the cloud framework. Two kinds of loss functions were used: Dice Similarity (DS) and binary cross-entropy (BCE). Performance was evaluated using (i) Area error, (ii) DS, (iii) Jaccard Index, (iii) Bland-Altman, and (iv) Correlation plots.

Results

Among the two HDL models, ResNet-UNet3+ was superior to UNet3+ by 17 and 10% for Dice and BCE loss. The models were further compressed using quantization showing a percentage size reduction of 66.76, 36.64, and 46.23%, respectively, for UNet3+, VGG-UNet3+, and ResNet-UNet3+. Its stability and reliability were proved by statistical tests such as the Mann-Whitney, Paired t-Test, Wilcoxon test, and Friedman test all of which had a p < 0.001.

Conclusion

Full-scale skip connections of UNet3+ with VGG and ResNet in HDL framework proved the hypothesis showing powerful results improving the detection accuracy of COVID-19.

The new era of artificial intelligence in neuroradiology: current research and promising tools

Radiology has a number of characteristics that make it an especially suitable medical discipline for early artificial intelligence (AI) adoption. These include having a well-established digital workflow, standardized protocols for image storage, and numerous well-defined interpretive activities. The more than 200 commercial radiologic AI-based products recently approved by the Food and Drug Administration (FDA) to assist radiologists in a number of narrow image-analysis tasks such as image enhancement, workflow triage, and quantification, corroborate this observation. However, in order to leverage AI to boost efficacy and efficiency, and to overcome substantial obstacles to widespread successful clinical use of these products, radiologists should become familiarized with the emerging applications in their particular areas of expertise. In light of this, in this article we survey the existing literature on the application of AI-based techniques in neuroradiology, focusing on conditions such as vascular diseases, epilepsy, and demyelinating and neurodegenerative conditions. We also introduce some of the algorithms behind the applications, briefly discuss a few of the challenges of generalization in the use of AI models in neuroradiology, and skate over the most relevant commercially available solutions adopted in clinical practice. If well designed, AI algorithms have the potential to radically improve radiology, strengthening image analysis, enhancing the value of quantitative imaging techniques, and mitigating diagnostic errors.

Deep learning approach for cardiovascular disease risk stratification and survival analysis on a Canadian cohort

The quantification of carotid plaque has been routinely used to predict cardiovascular risk in cardiovascular disease (CVD) and coronary artery disease (CAD). To determine how well carotid plaque features predict the likelihood of CAD and cardiovascular (CV) events using deep learning (DL) and compare against the machine learning (ML) paradigm. The participants in this study consisted of 459 individuals who had undergone coronary angiography, contrast-enhanced ultrasonography, and focused carotid B-mode ultrasound. Each patient was tracked for thirty days. The measurements on these patients consisted of maximum plaque height (MPH), total plaque area (TPA), carotid intima-media thickness (cIMT), and intraplaque neovascularization (IPN). CAD risk and CV event stratification were performed by applying eight types of DL-based models. Univariate and multivariate analysis was also conducted to predict the most significant risk predictors. The DL's model effectiveness was evaluated by the area-under-the-curve measurement while the CV event prediction was evaluated using the Cox proportional hazard model (CPHM) and compared against the DL-based concordance index (c-index). IPN showed a substantial ability to predict CV events (p < 0.0001). The best DL system improved by 21% (0.929 vs. 0.762) over the best ML system. DL-based CV event prediction showed a ~ 17% increase in DL-based c-index compared to the CPHM (0.86 vs. 0.73). CAD and CV incidents were linked to IPN and carotid imaging characteristics. For survival analysis and CAD prediction, the DL-based system performs superior to ML-based models.

UltraAIGenomics: Artificial Intelligence-Based Cardiovascular Disease Risk Assessment by Fusion of Ultrasound-Based Radiomics and Genomics Features for Preventive, Personalized and Precision Medicine: A Narrative Review

Cardiovascular disease (CVD) diagnosis and treatment are challenging since symptoms appear late in the disease's progression. Despite clinical risk scores, cardiac event prediction is inadequate, and many at-risk patients are not adequately categorised by conventional risk factors alone. Integrating genomic-based biomarkers (GBBM), specifically those found in plasma and/or serum samples, along with novel non-invasive radiomic-based biomarkers (RBBM) such as plaque area and plaque burden can improve the overall specificity of CVD risk. This review proposes two hypotheses: (i) RBBM and GBBM biomarkers have a strong correlation and can be used to detect the severity of CVD and stroke precisely, and (ii) introduces a proposed artificial intelligence (AI)-based preventive, precision, and personalized ( aiP 3 ) CVD/Stroke risk model. The PRISMA search selected 246 studies for the CVD/Stroke risk. It showed that using the RBBM and GBBM biomarkers, deep learning (DL) modelscould be used for CVD/Stroke risk stratification in the aiP 3 framework. Furthermore, we present a concise overview of platelet function, complete blood count (CBC), and diagnostic methods. As part of the AI paradigm, we discuss explainability, pruning, bias, and benchmarking against previous studies and their potential impacts. The review proposes the integration of RBBM and GBBM, an innovative solution streamlined in the DL paradigm for predicting CVD/Stroke risk in the aiP 3 framework. The combination of RBBM and GBBM introduces a powerful CVD/Stroke risk assessment paradigm. aiP 3 model signifies a promising advancement in CVD/Stroke risk assessment.

[A multiscale carotid plaque detection method based on two-stage analysis]

OBJECTIVE

To develop a method for accurate identification of multiscale carotid plaques in ultrasound images.

METHODS

We proposed a two-stage carotid plaque detection method based on deep convolutional neural network (SM-YOLO).A series of algorithms such as median filtering, histogram equalization, and Gamma transformation were used to preprocess the dataset to improve image quality. In the first stage of the model construction, a candidate plaque set was built based on the YOLOX_l target detection network, using multiscale image training and multiscale image prediction strategies to accommodate carotid artery plaques of different shapes and sizes. In the second stage, the Histogram of Oriented Gradient (HOG) features and Local Binary Pattern (LBP) features were extracted and fused, and a Support Vector Machine (SVM) classifier was used to screen the candidate plaque set to obtain the final detection results. This model was compared quantitatively and visually with several target detection models (YOLOX_l, SSD, EfficientDet, YOLOV5_l, Faster R-CNN).

RESULTS

SM-YOLO achieved a recall of 89.44%, an accuracy of 90.96%, a F1-Score of 90.19%, and an AP of 92.70% on the test set, outperforming other models in all performance indicators and visual effects. The constructed model had a much shorter detection time than the Faster R-CNN model (only one third of that of the latter), thus meeting the requirements of real-time detection.

CONCLUSION

The proposed carotid artery plaque detection method has good performance for accurate identification of carotid plaques in ultrasound images.

Vascular "Long COVID": A New Vessel Disease?

Vascular sequelae following (SARS-CoV-2 coronavirus disease) (COVID)-19 infection are considered as "Long Covid (LC)" disease, when occurring 12 weeks after the original infection. The paucity of specific data can be obviated by translating pathophysiological elements from the original Severe Acute Respiratory Syndrome-Corona Virus (SARS-CoV-2) infection (In a microcirculatory system, a first "endotheliitis," is often followed by production of "Neutrophil Extracellular Trap," and can evolve into a more complex leukocytoklastic-like and hyperimmune vasculitis. In medium/large-sized vessels, this corresponds to endothelial dysfunction, leading to an accelerated progression of pre-existing atherosclerotic plaques through an increased deposition of platelets, circulating inflammatory cells and proteins. Associated dysregulated immune and pro-coagulant conditions can directly cause thrombo-embolic arterial or venous complications. In order to implement appropriate treatment, physicians need to consider vascular pathologies observed after SARS-Cov-2 infections as possible "LC" disease.

Assessment of Subclinical Atherosclerosis in Asymptomatic People In Vivo: Measurements Suitable for Biomarker and Mendelian Randomization Studies

BACKGROUND

One strategy to reduce the burden of cardiovascular disease is the early detection and treatment of atherosclerosis. This has led to significant interest in studies of subclinical atherosclerosis, using different phenotypes, not all of which are accurate reflections of the presence of asymptomatic atherosclerotic plaques. The aim of part 2 of this series is to provide a review of the existing literature on purported measures of subclinical disease and recommendations concerning which tests may be appropriate in the prevention of incident cardiovascular disease.

METHODS

We conducted a critical review of measurements used to infer the presence of subclinical atherosclerosis in the major conduit arteries and focused on the predictive value of these tests for future cardiovascular events, independent of conventional cardiovascular risk factors, in asymptomatic people. The emphasis was on studies with >10 000 person-years of follow-up, with meta-analysis of results reporting adjusted hazard ratios (HRs) with 95% CIs. The arterial territories were limited to carotid, coronary, aorta, and lower limb arteries.

RESULTS

In the carotid arteries, the presence of plaque (8 studies) was independently associated with future stroke (pooled HR, 1.89 [1.04-3.44]) and cardiac events (7 studies), with a pooled HR, 1.77 (1.19-2.62). Increased coronary artery calcium (5 studies) was associated with the risk of coronary heart disease events, pooled HR, 1.54 (1.07-2.07) and increasing severity of calcification (by Agaston score) was associated with escalation of risk (13 studies). An ankle/brachial index (ABI) of <0.9, the pooled HR for cardiovascular death from 7 studies was 2.01 (1.43-2.81). There were insufficient studies of either, thoracic or aortic calcium, aortic diameter, or femoral plaque to synthesize the data based on consistent reporting of these measures.

CONCLUSIONS

The presence of carotid plaque, coronary artery calcium, or abnormal ankle pressures seems to be a valid indicator of the presence of subclinical atherosclerosis and may be considered for use in biomarker, Mendelian randomization and similar studies.

Deep Learning Paradigm and Its Bias for Coronary Artery Wall Segmentation in Intravascular Ultrasound Scans: A Closer Look

BACKGROUND AND MOTIVATION

Coronary artery disease (CAD) has the highest mortality rate; therefore, its diagnosis is vital. Intravascular ultrasound (IVUS) is a high-resolution imaging solution that can image coronary arteries, but the diagnosis software via wall segmentation and quantification has been evolving. In this study, a deep learning (DL) paradigm was explored along with its bias.

METHODS

Using a PRISMA model, 145 best UNet-based and non-UNet-based methods for wall segmentation were selected and analyzed for their characteristics and scientific and clinical validation. This study computed the coronary wall thickness by estimating the inner and outer borders of the coronary artery IVUS cross-sectional scans. Further, the review explored the bias in the DL system for the first time when it comes to wall segmentation in IVUS scans. Three bias methods, namely (i) ranking, (ii) radial, and (iii) regional area, were applied and compared using a Venn diagram. Finally, the study presented explainable AI (XAI) paradigms in the DL framework.

FINDINGS AND CONCLUSIONS

UNet provides a powerful paradigm for the segmentation of coronary walls in IVUS scans due to its ability to extract automated features at different scales in encoders, reconstruct the segmented image using decoders, and embed the variants in skip connections. Most of the research was hampered by a lack of motivation for XAI and pruned AI (PAI) models. None of the UNet models met the criteria for bias-free design. For clinical assessment and settings, it is necessary to move from a paper-to-practice approach.

Artificial intelligence in vascular surgical decision making

Despite advances in prevention, detection, and treatment, cardiovascular disease is a leading cause of mortality and represents a major health problem worldwide. Artificial intelligence and machine learning have brought new insights to the management of vascular diseases by allowing analysis of huge and complex datasets and by offering new techniques to develop advanced imaging analysis. Artificial intelligence-based applications have the potential to improve prognostic evaluation and evidence-based decision making and contribute to vascular therapeutic decision making. In this scoping review, we provide an overview on how artificial intelligence could help in vascular surgical clinical decision making, highlighting potential benefits, current limitations, and future challenges.

Artificial intelligence-based predictive models in vascular diseases

Cardiovascular disease represents a source of major health problems worldwide, and although medical and technical advances have been achieved, they are still associated with high morbidity and mortality rates. Personalized medicine would benefit from novel tools to better predict individual prognosis and outcomes after intervention. Artificial intelligence (AI) has brought new insights to cardiovascular medicine, especially with the use of machine learning techniques that allow the identification of hidden patterns and complex associations in health data without any a priori assumptions. This review provides an overview on the use of artificial intelligence-based prediction models in vascular diseases, specifically focusing on aortic aneurysm, lower extremity arterial disease, and carotid stenosis. Potential benefits include the development of precision medicine in patients with vascular diseases. In addition, the main challenges that remain to be overcome to integrate artificial intelligence-based predictive models in clinical practice are discussed.

Machine learning and image analysis in vascular surgery

Deep learning, a subset of machine learning within artificial intelligence, has been successful in medical image analysis in vascular surgery. Unlike traditional computer-based segmentation methods that manually extract features from input images, deep learning methods learn image features and classify data without making prior assumptions. Convolutional neural networks, the main type of deep learning for computer vision processing, are neural networks with multilevel architecture and weighted connections between nodes that can "auto-learn" through repeated exposure to training data without manual input or supervision. These networks have numerous applications in vascular surgery imaging analysis, particularly in disease classification, object identification, semantic segmentation, and instance segmentation. The purpose of this review article was to review the relevant concepts of machine learning image analysis and its application to the field of vascular surgery.

Computed tomography angiography-based radiomics model to identify high-risk carotid plaques

Background

Extracranial atherosclerosis is one of the major causes of stroke. Carotid computed tomography angiography (CTA) is a widely used imaging modality that allows detailed assessments of plaque characteristics. This study aimed to develop and test radiomics models of carotid plaques and perivascular adipose tissue (PVAT) to distinguish symptomatic from asymptomatic plaques and compare the diagnostic value between radiomics models and traditional CTA model.

Methods

A total of 144 patients with carotid plaques were divided into symptomatic and asymptomatic groups. The traditional CTA model was built by the traditional radiological features of carotid plaques measured on CTA images which were screened by univariate analysis and multivariable logistic regression. We extracted and screened radiomics features from carotid plaques and PVAT. Then, a support vector machine was used for building plaque and PVAT radiomics models, as well as a combined model using traditional CTA features and radiomics features. The diagnostic value between radiomics models and traditional CTA model was compared in identifying symptomatic carotid plaques by Delong method.

Results

The area under curve (AUC) values of traditional CTA model were 0.624 and 0.624 for the training and validation groups, respectively. The plaque radiomics model and PVAT radiomics model achieved AUC values of 0.766, 0.740 and 0.759, 0.618 in the two groups, respectively. Meanwhile, the combined model of plaque and PVAT radiomics features and traditional CTA features had AUC values of 0.883 and 0.840 for the training and validation groups, respectively, and the receiver operating characteristic curves of combined model were significantly better than those of traditional CTA model in the training group (P<0.001) and validation group (P=0.029).

Conclusions

The combined model of the radiomics features of carotid plaques and PVAT and the traditional CTA features significantly contributes to identifying high-risk carotid plaques compared with traditional CTA model.

Automatic Classification of Magnetic Resonance Histology of Peripheral Arterial Chronic Total Occlusions Using a Variational Autoencoder: A Feasibility Study

The novel approach of our study consists in adapting and in evaluating a custom-made variational autoencoder (VAE) using two-dimensional (2D) convolutional neural networks (CNNs) on magnetic resonance imaging (MRI) images for differentiate soft vs. hard plaque components in peripheral arterial disease (PAD). Five amputated lower extremities were imaged at a clinical ultra-high field 7 Tesla MRI. Ultrashort echo time (UTE), T1-weighted (T1w) and T2-weighted (T2w) datasets were acquired. Multiplanar reconstruction (MPR) images were obtained from one lesion per limb. Images were aligned to each other and pseudo-color red-green-blue images were created. Four areas in latent space were defined corresponding to the sorted images reconstructed by the VAE. Images were classified from their position in latent space and scored using tissue score (TS) as following: (1) lumen patent, TS:0; (2) partially patent, TS:1; (3) mostly occluded with soft tissue, TS:3; (4) mostly occluded with hard tissue, TS:5. Average and relative percentage of TS was calculated per lesion defined as the sum of the tissue score for each image divided by the total number of images. In total, 2390 MPR reconstructed images were included in the analysis. Relative percentage of average tissue score varied from only patent (lesion #1) to presence of all four classes. Lesions #2, #3 and #5 were classified to contain tissues except mostly occluded with hard tissue while lesion #4 contained all (ranges (I): 0.2-100%, (II): 46.3-75.9%, (III): 18-33.5%, (IV): 20%). Training the VAE was successful as images with soft/hard tissues in PAD lesions were satisfactory separated in latent space. Using VAE may assist in rapid classification of MRI histology images acquired in a clinical setup for facilitating endovascular procedures.

The renal artery-aorta angle associated with renal artery plaque: a retrospective analysis based on CT

PURPOSE

To investigate the relationship between renal artery anatomical configuration and renal artery plaque (RAP) based on 320-row CT.

METHODS

The abdominal contrast-enhanced CT data from 210 patients was retrospectively analyzed. Among 210 patients, there were 118 patients with RAP and 92 patients with no RAP. The anatomical parameters between lesion group and control group were compared and analyzed by using t-test, χ2-test and logistic regression analysis.

RESULTS

(1) There were statistical differences on age, hypertension, diabetes, hypertriglyceridemia and hypercholesterolemia between lesion group and control group. (2) The differences on the distribution and type and of RAP between lesion group and control group were statistically significant. The most common position was the proximal, and the most common type was calcified plaque. (3)There were significant statistical differences on the proximal diameter of renal artery and renal artery-aorta angle A between lesion group and control group. The differences on the other anatomical factors between two groups were not statistically significant. (4) The result of logistic regression analysis showed that right RAP was related to age, hypertension and right renal artery angle A (the AUC of ROC = 0.82), and left RAP was related to high serum cholesterol, age and left renal artery angle A(the AUC of ROC = 0.83). (5) The RAP was associated with renal artery-aorta angle A, but the differences on distribution, type stability of RAP between R1 (L1) group and R2 (L2) group were not statistically significant.

CONCLUSIONS

The RAP was associated with age, hypertension, hypercholesterolemia and renal artery-aorta angle A. Adults which had the greater renal artery-aorta angle A and the other above risk factors may be at increased risk for RAP.

Artificial intelligence applied in pulmonary hypertension: a bibliometric analysis

Introduction

Advances in Artificial Intelligence (AI) offer new Information Technology (IT) opportunities in various applications and fields (industry, health, etc.). The medical informatics scientific community expends tremendous effort on the management of diseases affecting vital organs making it a complex disease (lungs, heart, brain, kidneys, pancreas, and liver). Scientific research becomes more complex when several organs are simultaneously affected, as is the case with Pulmonary Hypertension (PH), which affects both the lungs and the heart. Therefore, early detection and diagnosis of PH are essential to monitor the disease's progression and prevent associated mortality.

Method

The issue addressed relates to knowledge of recent developments in AI approaches applied to PH. The aim is to provide a systematic review through a quantitative analysis of the scientific production concerning PH and the analysis of the networks of this production. This bibliometric approach is based on various statistical, data mining, and data visualization methods to assess research performance using scientific publications and various indicators (e.g., direct indicators of scientific production and scientific impact).

Results

The main sources used to obtain citation data are the Web of Science Core Collection and Google Scholar. The results indicate a diversity of journals (e.g., IEEE Access, Computers in Biology and Medicine, Biology Signal Processing and Control, Frontiers in Cardiovascular Medicine, Sensors) at the top of publications. The most relevant affiliations are universities from United States of America (Boston Univ, Harvard Med Sch, Univ Oxford, Stanford Univ) and United Kingdom (Imperial Coll London). The most cited keywords are "Classification", "Diagnosis", "Disease", "Prediction", and "Risk".

Conclusion

This bibliometric study is a crucial part of the review of the scientific literature on PH. It can be viewed as a guideline or tool that helps researchers and practitioners to understand the main scientific issues and challenges of AI modeling applied to PH. On the one hand, it makes it possible to increase the visibility of the progress made or the limits observed. Consequently, it promotes their wide dissemination. Furthermore, it offers valuable assistance in understanding the evolution of scientific AI activities applied to managing the diagnosis, treatment, and prognosis of PH. Finally, ethical considerations are described in each activity of data collection, treatment, and exploitation to preserve patients' legitimate rights.

Economics of Artificial Intelligence in Healthcare: Diagnosis vs. Treatment

Motivation: The price of medical treatment continues to rise due to (i) an increasing population; (ii) an aging human growth; (iii) disease prevalence; (iv) a rise in the frequency of patients that utilize health care services; and (v) increase in the price. Objective: Artificial Intelligence (AI) is already well-known for its superiority in various healthcare applications, including the segmentation of lesions in images, speech recognition, smartphone personal assistants, navigation, ride-sharing apps, and many more. Our study is based on two hypotheses: (i) AI offers more economic solutions compared to conventional methods; (ii) AI treatment offers stronger economics compared to AI diagnosis. This novel study aims to evaluate AI technology in the context of healthcare costs, namely in the areas of diagnosis and treatment, and then compare it to the traditional or non-AI-based approaches. Methodology: PRISMA was used to select the best 200 studies for AI in healthcare with a primary focus on cost reduction, especially towards diagnosis and treatment. We defined the diagnosis and treatment architectures, investigated their characteristics, and categorized the roles that AI plays in the diagnostic and therapeutic paradigms. We experimented with various combinations of different assumptions by integrating AI and then comparing it against conventional costs. Lastly, we dwell on three powerful future concepts of AI, namely, pruning, bias, explainability, and regulatory approvals of AI systems. Conclusions: The model shows tremendous cost savings using AI tools in diagnosis and treatment. The economics of AI can be improved by incorporating pruning, reduction in AI bias, explainability, and regulatory approvals.

Cardiovascular/Stroke Risk Stratification in Diabetic Foot Infection Patients Using Deep Learning-Based Artificial Intelligence: An Investigative Study

A diabetic foot infection (DFI) is among the most serious, incurable, and costly to treat conditions. The presence of a DFI renders machine learning (ML) systems extremely nonlinear, posing difficulties in CVD/stroke risk stratification. In addition, there is a limited number of well-explained ML paradigms due to comorbidity, sample size limits, and weak scientific and clinical validation methodologies. Deep neural networks (DNN) are potent machines for learning that generalize nonlinear situations. The objective of this article is to propose a novel investigation of deep learning (DL) solutions for predicting CVD/stroke risk in DFI patients. The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) search strategy was used for the selection of 207 studies. We hypothesize that a DFI is responsible for increased morbidity and mortality due to the worsening of atherosclerotic disease and affecting coronary artery disease (CAD). Since surrogate biomarkers for CAD, such as carotid artery disease, can be used for monitoring CVD, we can thus use a DL-based model, namely, Long Short-Term Memory (LSTM) and Recurrent Neural Networks (RNN) for CVD/stroke risk prediction in DFI patients, which combines covariates such as office and laboratory-based biomarkers, carotid ultrasound image phenotype (CUSIP) lesions, along with the DFI severity. We confirmed the viability of CVD/stroke risk stratification in the DFI patients. Strong designs were found in the research of the DL architectures for CVD/stroke risk stratification. Finally, we analyzed the AI bias and proposed strategies for the early diagnosis of CVD/stroke in DFI patients. Since DFI patients have an aggressive atherosclerotic disease, leading to prominent CVD/stroke risk, we, therefore, conclude that the DL paradigm is very effective for predicting the risk of CVD/stroke in DFI patients.

Attention-Based UNet Deep Learning Model for Plaque Segmentation in Carotid Ultrasound for Stroke Risk Stratification: An Artificial Intelligence Paradigm

Stroke and cardiovascular diseases (CVD) significantly affect the world population. The early detection of such events may prevent the burden of death and costly surgery. Conventional methods are neither automated nor clinically accurate. Artificial Intelligence-based methods of automatically detecting and predicting the severity of CVD and stroke in their early stages are of prime importance. This study proposes an attention-channel-based UNet deep learning (DL) model that identifies the carotid plaques in the internal carotid artery (ICA) and common carotid artery (CCA) images. Our experiments consist of 970 ICA images from the UK, 379 CCA images from diabetic Japanese patients, and 300 CCA images from post-menopausal women from Hong Kong. We combined both CCA images to form an integrated database of 679 images. A rotation transformation technique was applied to 679 CCA images, doubling the database for the experiments. The cross-validation K5 (80% training: 20% testing) protocol was applied for accuracy determination. The results of the Attention-UNet model are benchmarked against UNet, UNet++, and UNet3P models. Visual plaque segmentation showed improvement in the Attention-UNet results compared to the other three models. The correlation coefficient (CC) value for Attention-UNet is 0.96, compared to 0.93, 0.96, and 0.92 for UNet, UNet++, and UNet3P models. Similarly, the AUC value for Attention-UNet is 0.97, compared to 0.964, 0.966, and 0.965 for other models. Conclusively, the Attention-UNet model is beneficial in segmenting very bright and fuzzy plaque images that are hard to diagnose using other methods. Further, we present a multi-ethnic, multi-center, racial bias-free study of stroke risk assessment.

Detecting vulnerable carotid plaque and its component characteristics: Progress in related imaging techniques

Carotid atherosclerotic plaque rupture and thrombosis are independent risk factors for acute ischemic cerebrovascular disease. Timely identification of vulnerable plaque can help prevent stroke and provide evidence for clinical treatment. Advanced invasive and non-invasive imaging modalities such as computed tomography, magnetic resonance imaging, intravascular ultrasound, optical coherence tomography, and near-infrared spectroscopy can be employed to image and classify carotid atherosclerotic plaques to provide clinically relevant predictors used for patient risk stratification. This study compares existing clinical imaging methods, and the advantages and limitations of different imaging techniques for identifying vulnerable carotid plaque are reviewed to effectively prevent and treat cerebrovascular diseases.

Brain Tumor Characterization Using Radiogenomics in Artificial Intelligence Framework

Brain tumor characterization (BTC) is the process of knowing the underlying cause of brain tumors and their characteristics through various approaches such as tumor segmentation, classification, detection, and risk analysis. The substantial brain tumor characterization includes the identification of the molecular signature of various useful genomes whose alteration causes the brain tumor. The radiomics approach uses the radiological image for disease characterization by extracting quantitative radiomics features in the artificial intelligence (AI) environment. However, when considering a higher level of disease characteristics such as genetic information and mutation status, the combined study of "radiomics and genomics" has been considered under the umbrella of "radiogenomics". Furthermore, AI in a radiogenomics' environment offers benefits/advantages such as the finalized outcome of personalized treatment and individualized medicine. The proposed study summarizes the brain tumor's characterization in the prospect of an emerging field of research, i.e., radiomics and radiogenomics in an AI environment, with the help of statistical observation and risk-of-bias (RoB) analysis. The PRISMA search approach was used to find 121 relevant studies for the proposed review using IEEE, Google Scholar, PubMed, MDPI, and Scopus. Our findings indicate that both radiomics and radiogenomics have been successfully applied aggressively to several oncology applications with numerous advantages. Furthermore, under the AI paradigm, both the conventional and deep radiomics features have made an impact on the favorable outcomes of the radiogenomics approach of BTC. Furthermore, risk-of-bias (RoB) analysis offers a better understanding of the architectures with stronger benefits of AI by providing the bias involved in them.

Multicenter Study on COVID-19 Lung Computed Tomography Segmentation with varying Glass Ground Opacities using Unseen Deep Learning Artificial Intelligence Paradigms: COVLIAS 1.0 Validation

Variations in COVID-19 lesions such as glass ground opacities (GGO), consolidations, and crazy paving can compromise the ability of solo-deep learning (SDL) or hybrid-deep learning (HDL) artificial intelligence (AI) models in predicting automated COVID-19 lung segmentation in Computed Tomography (CT) from unseen data leading to poor clinical manifestations. As the first study of its kind, “COVLIAS 1.0-Unseen” proves two hypotheses, (i) contrast adjustment is vital for AI, and (ii) HDL is superior to SDL. In a multicenter study, 10,000 CT slices were collected from 72 Italian (ITA) patients with low-GGO, and 80 Croatian (CRO) patients with high-GGO. Hounsfield Units (HU) were automatically adjusted to train the AI models and predict from test data, leading to four combinations—two Unseen sets: (i) train-CRO:test-ITA, (ii) train-ITA:test-CRO, and two Seen sets: (iii) train-CRO:test-CRO, (iv) train-ITA:test-ITA. COVILAS used three SDL models: PSPNet, SegNet, UNet and six HDL models: VGG-PSPNet, VGG-SegNet, VGG-UNet, ResNet-PSPNet, ResNet-SegNet, and ResNet-UNet. Two trained, blinded senior radiologists conducted ground truth annotations. Five types of performance metrics were used to validate COVLIAS 1.0-Unseen which was further benchmarked against MedSeg, an open-source web-based system. After HU adjustment for DS and JI, HDL (Unseen AI) > SDL (Unseen AI) by 4% and 5%, respectively. For CC, HDL (Unseen AI) > SDL (Unseen AI) by 6%. The COVLIAS-MedSeg difference was < 5%, meeting regulatory guidelines.Unseen AI was successfully demonstrated using automated HU adjustment. HDL was found to be superior to SDL.

Vascular Implications of COVID-19: Role of Radiological Imaging, Artificial Intelligence, and Tissue Characterization: A Special Report

The SARS-CoV-2 virus has caused a pandemic, infecting nearly 80 million people worldwide, with mortality exceeding six million. The average survival span is just 14 days from the time the symptoms become aggressive. The present study delineates the deep-driven vascular damage in the pulmonary, renal, coronary, and carotid vessels due to SARS-CoV-2. This special report addresses an important gap in the literature in understanding (i) the pathophysiology of vascular damage and the role of medical imaging in the visualization of the damage caused by SARS-CoV-2, and (ii) further understanding the severity of COVID-19 using artificial intelligence (AI)-based tissue characterization (TC). PRISMA was used to select 296 studies for AI-based TC. Radiological imaging techniques such as magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound were selected for imaging of the vasculature infected by COVID-19. Four kinds of hypotheses are presented for showing the vascular damage in radiological images due to COVID-19. Three kinds of AI models, namely, machine learning, deep learning, and transfer learning, are used for TC. Further, the study presents recommendations for improving AI-based architectures for vascular studies. We conclude that the process of vascular damage due to COVID-19 has similarities across vessel types, even though it results in multi-organ dysfunction. Although the mortality rate is ~2% of those infected, the long-term effect of COVID-19 needs monitoring to avoid deaths. AI seems to be penetrating the health care industry at warp speed, and we expect to see an emerging role in patient care, reduce the mortality and morbidity rate.

Stratification of risk of atherosclerotic plaque using Hu’s moment invariants of segmented ultrasonic images

Myocardial infarction is one of the major life-threatening diseases. The cause is atherosclerosis i.e. the occlusion of the coronary artery by deposition of plaque on its walls. The severity of plaque deposition in the artery depends on the characteristics of the plaque. Hence, the classification of the type of plaque is crucial for assessing the risk of atherosclerosis and predicting the chances of myocardial infarction. This paper proposes prediction of atherosclerotic risk by non-invasive ultrasound image segmentation and textural feature extraction. The intima-media complex is segmented using a snakes-based segmentation algorithm on the arterial wall in the ultrasound images. Then, the plaque is extracted from the segmented intima-media complex. The features of the plaque are obtained by computing Hu’s moment invariants. Visual pattern recognition independent of position, size, orientation and parallel projection could be done using these moment invariants. For the classification of the features of the plaque, an SVM classifier is used. The performance shows improvement in accuracy using lesser number of features than previous works. The reduction in feature size is achieved by incorporating segmentation in the pre-processing stage. Tenfold cross-validation protocol is used for training and testing the classifier. An accuracy of 97.9% is obtained with only two features. This proposed technique could work as an adjunct tool in quick decision-making for cardiologists and radiologists. The segmentation step introduced in the preprocessing stage improved the feature extraction technique. An improvement in performance is achieved with much less number of features.

Eight pruning deep learning models for low storage and high-speed COVID-19 computed tomography lung segmentation and heatmap-based lesion localization: A multicenter study using COVLIAS 2.0

BACKGROUND

COVLIAS 1.0: an automated lung segmentation was designed for COVID-19 diagnosis. It has issues related to storage space and speed. This study shows that COVLIAS 2.0 uses pruned AI (PAI) networks for improving both storage and speed, wiliest high performance on lung segmentation and lesion localization.

METHOD

ology: The proposed study uses multicenter ∼9,000 CT slices from two different nations, namely, CroMed from Croatia (80 patients, experimental data), and NovMed from Italy (72 patients, validation data). We hypothesize that by using pruning and evolutionary optimization algorithms, the size of the AI models can be reduced significantly, ensuring optimal performance. Eight different pruning techniques (i) differential evolution (DE), (ii) genetic algorithm (GA), (iii) particle swarm optimization algorithm (PSO), and (iv) whale optimization algorithm (WO) in two deep learning frameworks (i) Fully connected network (FCN) and (ii) SegNet were designed. COVLIAS 2.0 was validated using "Unseen NovMed" and benchmarked against MedSeg. Statistical tests for stability and reliability were also conducted.

RESULTS

Pruning algorithms (i) FCN-DE, (ii) FCN-GA, (iii) FCN-PSO, and (iv) FCN-WO showed improvement in storage by 92.4%, 95.3%, 98.7%, and 99.8% respectively when compared against solo FCN, and (v) SegNet-DE, (vi) SegNet-GA, (vii) SegNet-PSO, and (viii) SegNet-WO showed improvement by 97.1%, 97.9%, 98.8%, and 99.2% respectively when compared against solo SegNet. AUC > 0.94 (p < 0.0001) on CroMed and > 0.86 (p < 0.0001) on NovMed data set for all eight EA model. PAI <0.25 s per image. DenseNet-121-based Grad-CAM heatmaps showed validation on glass ground opacity lesions.

CONCLUSIONS

Eight PAI networks that were successfully validated are five times faster, storage efficient, and could be used in clinical settings.

Deep Learning Paradigm for Cardiovascular Disease/Stroke Risk Stratification in Parkinson’s Disease Affected by COVID-19: A Narrative Review

Background and Motivation: Parkinson’s disease (PD) is one of the most serious, non-curable, and expensive to treat. Recently, machine learning (ML) has shown to be able to predict cardiovascular/stroke risk in PD patients. The presence of COVID-19 causes the ML systems to become severely non-linear and poses challenges in cardiovascular/stroke risk stratification. Further, due to comorbidity, sample size constraints, and poor scientific and clinical validation techniques, there have been no well-explained ML paradigms. Deep neural networks are powerful learning machines that generalize non-linear conditions. This study presents a novel investigation of deep learning (DL) solutions for CVD/stroke risk prediction in PD patients affected by the COVID-19 framework. Method: The PRISMA search strategy was used for the selection of 292 studies closely associated with the effect of PD on CVD risk in the COVID-19 framework. We study the hypothesis that PD in the presence of COVID-19 can cause more harm to the heart and brain than in non-COVID-19 conditions. COVID-19 lung damage severity can be used as a covariate during DL training model designs. We, therefore, propose a DL model for the estimation of, (i) COVID-19 lesions in computed tomography (CT) scans and (ii) combining the covariates of PD, COVID-19 lesions, office and laboratory arterial atherosclerotic image-based biomarkers, and medicine usage for the PD patients for the design of DL point-based models for CVD/stroke risk stratification. Results: We validated the feasibility of CVD/stroke risk stratification in PD patients in the presence of a COVID-19 environment and this was also verified. DL architectures like long short-term memory (LSTM), and recurrent neural network (RNN) were studied for CVD/stroke risk stratification showing powerful designs. Lastly, we examined the artificial intelligence bias and provided recommendations for early detection of CVD/stroke in PD patients in the presence of COVID-19. Conclusion: The DL is a very powerful tool for predicting CVD/stroke risk in PD patients affected by COVID-19.

COVLIAS 2.0-cXAI: Cloud-Based Explainable Deep Learning System for COVID-19 Lesion Localization in Computed Tomography Scans

Background: The previous COVID-19 lung diagnosis system lacks both scientific validation and the role of explainable artificial intelligence (AI) for understanding lesion localization. This study presents a cloud-based explainable AI, the “COVLIAS 2.0-cXAI” system using four kinds of class activation maps (CAM) models. Methodology: Our cohort consisted of ~6000 CT slices from two sources (Croatia, 80 COVID-19 patients and Italy, 15 control patients). COVLIAS 2.0-cXAI design consisted of three stages: (i) automated lung segmentation using hybrid deep learning ResNet-UNet model by automatic adjustment of Hounsfield units, hyperparameter optimization, and parallel and distributed training, (ii) classification using three kinds of DenseNet (DN) models (DN-121, DN-169, DN-201), and (iii) validation using four kinds of CAM visualization techniques: gradient-weighted class activation mapping (Grad-CAM), Grad-CAM++, score-weighted CAM (Score-CAM), and FasterScore-CAM. The COVLIAS 2.0-cXAI was validated by three trained senior radiologists for its stability and reliability. The Friedman test was also performed on the scores of the three radiologists. Results: The ResNet-UNet segmentation model resulted in dice similarity of 0.96, Jaccard index of 0.93, a correlation coefficient of 0.99, with a figure-of-merit of 95.99%, while the classifier accuracies for the three DN nets (DN-121, DN-169, and DN-201) were 98%, 98%, and 99% with a loss of ~0.003, ~0.0025, and ~0.002 using 50 epochs, respectively. The mean AUC for all three DN models was 0.99 (p < 0.0001). The COVLIAS 2.0-cXAI showed 80% scans for mean alignment index (MAI) between heatmaps and gold standard, a score of four out of five, establishing the system for clinical settings. Conclusions: The COVLIAS 2.0-cXAI successfully showed a cloud-based explainable AI system for lesion localization in lung CT scans.

Role of Artificial Intelligence in Radiogenomics for Cancers in the Era of Precision Medicine

Simple Summary

Recently, radiogenomics has played a significant role and offered a new understanding of cancer’s biology and behavior in response to standard therapy. It also provides a more precise prognosis, investigation, and analysis of the patient’s cancer. Over the years, Artificial Intelligence (AI) has provided a significant strength in radiogenomics. In this paper, we offer computational and oncological prospects of the role of AI in radiogenomics, as well as its offers, achievements, opportunities, and limitations in the current clinical practices.

Abstract

Radiogenomics, a combination of “Radiomics” and “Genomics,” using Artificial Intelligence (AI) has recently emerged as the state-of-the-art science in precision medicine, especially in oncology care. Radiogenomics syndicates large-scale quantifiable data extracted from radiological medical images enveloped with personalized genomic phenotypes. It fabricates a prediction model through various AI methods to stratify the risk of patients, monitor therapeutic approaches, and assess clinical outcomes. It has recently shown tremendous achievements in prognosis, treatment planning, survival prediction, heterogeneity analysis, reoccurrence, and progression-free survival for human cancer study. Although AI has shown immense performance in oncology care in various clinical aspects, it has several challenges and limitations. The proposed review provides an overview of radiogenomics with the viewpoints on the role of AI in terms of its promises for computational as well as oncological aspects and offers achievements and opportunities in the era of precision medicine. The review also presents various recommendations to diminish these obstacles.

COVLIAS 1.0Lesion vs. MedSeg: An Artificial Intelligence Framework for Automated Lesion Segmentation in COVID-19 Lung Computed Tomography Scans

Background: COVID-19 is a disease with multiple variants, and is quickly spreading throughout the world. It is crucial to identify patients who are suspected of having COVID-19 early, because the vaccine is not readily available in certain parts of the world. Methodology: Lung computed tomography (CT) imaging can be used to diagnose COVID-19 as an alternative to the RT-PCR test in some cases. The occurrence of ground-glass opacities in the lung region is a characteristic of COVID-19 in chest CT scans, and these are daunting to locate and segment manually. The proposed study consists of a combination of solo deep learning (DL) and hybrid DL (HDL) models to tackle the lesion location and segmentation more quickly. One DL and four HDL models—namely, PSPNet, VGG-SegNet, ResNet-SegNet, VGG-UNet, and ResNet-UNet—were trained by an expert radiologist. The training scheme adopted a fivefold cross-validation strategy on a cohort of 3000 images selected from a set of 40 COVID-19-positive individuals. Results: The proposed variability study uses tracings from two trained radiologists as part of the validation. Five artificial intelligence (AI) models were benchmarked against MedSeg. The best AI model, ResNet-UNet, was superior to MedSeg by 9% and 15% for Dice and Jaccard, respectively, when compared against MD 1, and by 4% and 8%, respectively, when compared against MD 2. Statistical tests—namely, the Mann−Whitney test, paired t-test, and Wilcoxon test—demonstrated its stability and reliability, with p < 0.0001. The online system for each slice was <1 s. Conclusions: The AI models reliably located and segmented COVID-19 lesions in CT scans. The COVLIAS 1.0Lesion lesion locator passed the intervariability test.

Cardiovascular/Stroke Risk Assessment in Patients with Erectile Dysfunction-A Role of Carotid Wall Arterial Imaging and Plaque Tissue Characterization Using Artificial Intelligence Paradigm: A Narrative Review

PURPOSE

The role of erectile dysfunction (ED) has recently shown an association with the risk of stroke and coronary heart disease (CHD) via the atherosclerotic pathway. Cardiovascular disease (CVD)/stroke risk has been widely understood with the help of carotid artery disease (CTAD), a surrogate biomarker for CHD. The proposed study emphasizes artificial intelligence-based frameworks such as machine learning (ML) and deep learning (DL) that can accurately predict the severity of CVD/stroke risk using carotid wall arterial imaging in ED patients.

METHODS

Using the PRISMA model, 231 of the best studies were selected. The proposed study mainly consists of two components: (i) the pathophysiology of ED and its link with coronary artery disease (COAD) and CHD in the ED framework and (ii) the ultrasonic-image morphological changes in the carotid arterial walls by quantifying the wall parameters and the characterization of the wall tissue by adapting the ML/DL-based methods, both for the prediction of the severity of CVD risk. The proposed study analyzes the hypothesis that ML/DL can lead to an accurate and early diagnosis of the CVD/stroke risk in ED patients. Our finding suggests that the routine ED patient practice can be amended for ML/DL-based CVD/stroke risk assessment using carotid wall arterial imaging leading to fast, reliable, and accurate CVD/stroke risk stratification.

SUMMARY

We conclude that ML and DL methods are very powerful tools for the characterization of CVD/stroke in patients with varying ED conditions. We anticipate a rapid growth of these tools for early and better CVD/stroke risk management in ED patients.

Cardiovascular/Stroke Risk Stratification in Parkinson's Disease Patients Using Atherosclerosis Pathway and Artificial Intelligence Paradigm: A Systematic Review

Parkinson’s disease (PD) is a severe, incurable, and costly condition leading to heart failure. The link between PD and cardiovascular disease (CVD) is not available, leading to controversies and poor prognosis. Artificial Intelligence (AI) has already shown promise for CVD/stroke risk stratification. However, due to a lack of sample size, comorbidity, insufficient validation, clinical examination, and a lack of big data configuration, there have been no well-explained bias-free AI investigations to establish the CVD/Stroke risk stratification in the PD framework. The study has two objectives: (i) to establish a solid link between PD and CVD/stroke; and (ii) to use the AI paradigm to examine a well-defined CVD/stroke risk stratification in the PD framework. The PRISMA search strategy selected 223 studies for CVD/stroke risk, of which 54 and 44 studies were related to the link between PD-CVD, and PD-stroke, respectively, 59 studies for joint PD-CVD-Stroke framework, and 66 studies were only for the early PD diagnosis without CVD/stroke link. Sequential biological links were used for establishing the hypothesis. For AI design, PD risk factors as covariates along with CVD/stroke as the gold standard were used for predicting the CVD/stroke risk. The most fundamental cause of CVD/stroke damage due to PD is cardiac autonomic dysfunction due to neurodegeneration that leads to heart failure and its edema, and this validated our hypothesis. Finally, we present the novel AI solutions for CVD/stroke risk prediction in the PD framework. The study also recommends strategies for removing the bias in AI for CVD/stroke risk prediction using the PD framework.

Bias Investigation in Artificial Intelligence Systems for Early Detection of Parkinson's Disease: A Narrative Review

Background and Motivation: Diagnosis of Parkinson's disease (PD) is often based on medical attention and clinical signs. It is subjective and does not have a good prognosis. Artificial Intelligence (AI) has played a promising role in the diagnosis of PD. However, it introduces bias due to lack of sample size, poor validation, clinical evaluation, and lack of big data configuration. The purpose of this study is to compute the risk of bias (RoB) automatically.

METHOD

The PRISMA search strategy was adopted to select the best 39 AI studies out of 85 PD studies closely associated with early diagnosis PD. The studies were used to compute 30 AI attributes (based on 6 AI clusters), using AP(ai)Bias 1.0 (AtheroPointTM, Roseville, CA, USA), and the mean aggregate score was computed. The studies were ranked and two cutoffs (Moderate-Low (ML) and High-Moderate (MH)) were determined to segregate the studies into three bins: low-, moderate-, and high-bias.

RESULT

The ML and HM cutoffs were 3.50 and 2.33, respectively, which constituted 7, 13, and 6 for low-, moderate-, and high-bias studies. The best and worst architectures were "deep learning with sketches as outcomes" and "machine learning with Electroencephalography," respectively. We recommend (i) the usage of power analysis in big data framework, (ii) that it must undergo scientific validation using unseen AI models, and (iii) that it should be taken towards clinical evaluation for reliability and stability tests.

CONCLUSION

The AI is a vital component for the diagnosis of early PD and the recommendations must be followed to lower the RoB.

Artificial intelligence's role in vascular surgery decision-making

Artificial intelligence (AI) is the next great advance informing medical science. Several disciplines, including vascular surgery, use AI-based decision-making tools to improve clinical performance. Although applied widely, AI functions best when confronted with voluminous, accurate data. Consistent, predictable analytic technique selection also challenges researchers. This article contextualizes AI analyses within evidence-based medicine, focusing on "big data" and health services research, as well as discussing opportunities to improve data collection and realize AI's promise.

COVLIAS 1.0 vs. MedSeg: Artificial Intelligence-Based Comparative Study for Automated COVID-19 Computed Tomography Lung Segmentation in Italian and Croatian Cohorts

(1) Background: COVID-19 computed tomography (CT) lung segmentation is critical for COVID lung severity diagnosis. Earlier proposed approaches during 2020–2021 were semiautomated or automated but not accurate, user-friendly, and industry-standard benchmarked. The proposed study compared the COVID Lung Image Analysis System, COVLIAS 1.0 (GBTI, Inc., and AtheroPoint^TM, Roseville, CA, USA, referred to as COVLIAS), against MedSeg, a web-based Artificial Intelligence (AI) segmentation tool, where COVLIAS uses hybrid deep learning (HDL) models for CT lung segmentation. (2) Materials and Methods: The proposed study used 5000 ITALIAN COVID-19 positive CT lung images collected from 72 patients (experimental data) that confirmed the reverse transcription-polymerase chain reaction (RT-PCR) test. Two hybrid AI models from the COVLIAS system, namely, VGG-SegNet (HDL 1) and ResNet-SegNet (HDL 2), were used to segment the CT lungs. As part of the results, we compared both COVLIAS and MedSeg against two manual delineations (MD 1 and MD 2) using (i) Bland–Altman plots, (ii) Correlation coefficient (CC) plots, (iii) Receiver operating characteristic curve, and (iv) Figure of Merit and (v) visual overlays. A cohort of 500 CROATIA COVID-19 positive CT lung images (validation data) was used. A previously trained COVLIAS model was directly applied to the validation data (as part of Unseen-AI) to segment the CT lungs and compare them against MedSeg. (3) Result: For the experimental data, the four CCs between COVLIAS (HDL 1) vs. MD 1, COVLIAS (HDL 1) vs. MD 2, COVLIAS (HDL 2) vs. MD 1, and COVLIAS (HDL 2) vs. MD 2 were 0.96, 0.96, 0.96, and 0.96, respectively. The mean value of the COVLIAS system for the above four readings was 0.96. CC between MedSeg vs. MD 1 and MedSeg vs. MD 2 was 0.98 and 0.98, respectively. Both had a mean value of 0.98. On the validation data, the CC between COVLIAS (HDL 1) vs. MedSeg and COVLIAS (HDL 2) vs. MedSeg was 0.98 and 0.99, respectively. For the experimental data, the difference between the mean values for COVLIAS and MedSeg showed a difference of <2.5%, meeting the standard of equivalence. The average running times for COVLIAS and MedSeg on a single lung CT slice were ~4 s and ~10 s, respectively. (4) Conclusions: The performances of COVLIAS and MedSeg were similar. However, COVLIAS showed improved computing time over MedSeg.

A hybrid deep learning paradigm for carotid plaque tissue characterization and its validation in multicenter cohorts using a supercomputer framework

BACKGROUND

Early and automated detection of carotid plaques prevents strokes, which are the second leading cause of death worldwide according to the World Health Organization. Artificial intelligence (AI) offers automated solutions for plaque tissue characterization. Recently, solo deep learning (SDL) models have been used, but they do not take advantage of the tandem connectivity offered by AI's hybrid nature. Therefore, this study explores the use of hybrid deep learning (HDL) models in a multicenter framework, making this study the first of its kind.

METHODS

We hypothesize that HDL techniques perform better than SDL and transfer learning (TL) techniques. We propose two kinds of HDL frameworks: (i) the fusion of two SDLs (Inception with ResNet) or (ii) 10 other kinds of tandem models that fuse SDL with ML. The system Atheromatic™ 2.0_HDL (AtheroPoint, CA, USA) was designed on an augmentation framework and three kinds of loss functions (cross-entropy, hinge, and mean-square-error) during training to determine the best optimization paradigm. These 11 combined HDL models were then benchmarked against one SDL model and five types of TL models; thus, this study considers a total of 17 AI models.

RESULTS

Among the 17 AI models, the best performing HDL system was that comprising CNN and decision tree (DT), as its accuracy and area-under-the-curve were 99.78 ± 1.05% and 0.99 (p<0.0001), respectively. These values are 6.4% and 3.2% better than those recorded for the SDL and TL models, respectively. We validated the performance of the HDL models with diagnostics odds ratio (DOR) and Cohen and Kappa statistics; here, HDL outperformed DL and TL by 23% and 7%, respectively. The online system ran in <2 s.

CONCLUSION

HDL is a fast, reliable, and effective tool for characterizing the carotid plaque for early stroke risk stratification.

Unseen Artificial Intelligence-Deep Learning Paradigm for Segmentation of Low Atherosclerotic Plaque in Carotid Ultrasound: A Multicenter Cardiovascular Study

BACKGROUND

The early detection of carotid wall plaque is recommended in the prevention of cardiovascular disease (CVD) in moderate-risk patients. Previous techniques for B-mode carotid atherosclerotic wall plaque segmentation used artificial intelligence (AI) methods on monoethnic databases, where training and testing are from the "same" ethnic group ("Seen AI"). Therefore, the versatility of the system is questionable. This is the first study of its kind that uses the "Unseen AI" paradigm where training and testing are from "different" ethnic groups. We hypothesized that deep learning (DL) models should perform in 10% proximity between "Unseen AI" and "Seen AI".

METHODOLOGY

Two cohorts from multi-ethnic groups (330 Japanese and 300 Hong Kong (HK)) were used for the validation of our hypothesis. We used a four-layered UNet architecture for the segmentation of the atherosclerotic wall with low plaque. "Unseen AI" (training: Japanese, testing: HK or vice versa) and "Seen AI" experiments (single ethnicity or mixed ethnicity) were performed. Evaluation was conducted by measuring the wall plaque area. Statistical tests were conducted for its stability and reliability.

RESULTS

When using the UNet DL architecture, the "Unseen AI" pair one (Training: 330 Japanese and Testing: 300 HK), the mean accuracy, dice-similarity, and correlation-coefficient were 98.55, 78.38, and 0.80 (p < 0.0001), respectively, while for "Unseen AI" pair two (Training: 300 HK and Testing: 330 Japanese), these were 98.67, 82.49, and 0.87 (p < 0.0001), respectively. Using "Seen AI", the same parameters were 99.01, 86.89 and 0.92 (p < 0.0001), respectively.

CONCLUSION

We demonstrated that "Unseen AI" was in close proximity (<10%) to "Seen AI", validating our DL model for low atherosclerotic wall plaque segmentation. The online system runs < 1 s.

Inter-Variability Study of COVLIAS 1.0: Hybrid Deep Learning Models for COVID-19 Lung Segmentation in Computed Tomography

Background: For COVID-19 lung severity, segmentation of lungs on computed tomography (CT) is the first crucial step. Current deep learning (DL)-based Artificial Intelligence (AI) models have a bias in the training stage of segmentation because only one set of ground truth (GT) annotations are evaluated. We propose a robust and stable inter-variability analysis of CT lung segmentation in COVID-19 to avoid the effect of bias. Methodology: The proposed inter-variability study consists of two GT tracers for lung segmentation on chest CT. Three AI models, PSP Net, VGG-SegNet, and ResNet-SegNet, were trained using GT annotations. We hypothesized that if AI models are trained on the GT tracings from multiple experience levels, and if the AI performance on the test data between these AI models is within the 5% range, one can consider such an AI model robust and unbiased. The K5 protocol (training to testing: 80%:20%) was adapted. Ten kinds of metrics were used for performance evaluation. Results: The database consisted of 5000 CT chest images from 72 COVID-19-infected patients. By computing the coefficient of correlations (CC) between the output of the two AI models trained corresponding to the two GT tracers, computing their differences in their CC, and repeating the process for all three AI-models, we show the differences as 0%, 0.51%, and 2.04% (all < 5%), thereby validating the hypothesis. The performance was comparable; however, it had the following order: ResNet-SegNet > PSP Net > VGG-SegNet. Conclusions: The AI models were clinically robust and stable during the inter-variability analysis on the CT lung segmentation on COVID-19 patients.

Hybrid deep learning segmentation models for atherosclerotic plaque in internal carotid artery B-mode ultrasound

The automated and accurate carotid plaque segmentation in B-mode ultrasound (US) is an essential part of stroke risk stratification. Previous segmented methods used AtheroEdge™ 2.0 (AtheroPoint™, Roseville, CA) for the common carotid artery (CCA). This study focuses on automated plaque segmentation in the internal carotid artery (ICA) using solo deep learning (SDL) and hybrid deep learning (HDL) models. The methodology consists of a novel design of 10 types of SDL/HDL models (AtheroEdge™ 3.0 systems (AtheroPoint™, Roseville, CA) with a depth of four layers each. Five of the models use cross-entropy (CE)-loss, and the other five models use Dice similarity coefficient (DSC)-loss functions derived from UNet, UNet+, SegNet, SegNet-UNet, and SegNet-UNet+. The K10 protocol (Train:Test:90%:10%) was applied for all 10 models for training and predicting (segmenting) the plaque region, which was then quantified to compute the plaque area in mm². Further, the data augmentation effect was analyzed. The database consisted of 970 ICA B-mode US scans taken from 99 moderate to high-risk patients. Using the difference area threshold of 10 mm² between ground truth (GT) and artificial intelligence (AI), the area under the curve (AUC) values were 0.91, 0.911, 0.908, 0.905, and 0.898, all with a p-value of <0.001 (for CE-loss models) and 0.883, 0.889, 0.905, 0.889, and 0.907, all with a p-value of <0.001 (for DSC-loss models). The correlations between the AI-based plaque area and GT plaque area were 0.98, 0.96, 0.97, 0.98, and 0.97, all with a p-value of <0.001 (for CE-loss models) and 0.98, 0.98, 0.97, 0.98, and 0.98 (for DSC-loss models). Overall, the online system performs plaque segmentation in less than 1 s. We validate our hypothesis that HDL and SDL models demonstrate comparable performance. SegNet-UNet was the best-performing hybrid architecture.