Automated stratification of liver disease in ultrasound: An online accurate feature classification paradigm

Neural Network Classification Algorithm Based on Self-attention Mechanism and Ensemble Learning for MASLD Ultrasound Images

BACKGROUND

Ultrasound image examination has become the preferred choice for diagnosing metabolic dysfunction-associated steatotic liver disease (MASLD) due to its non-invasive nature. Computer-aided diagnosis (CAD) technology can assist doctors in avoiding deviations in the detection and classification of MASLD.

METHOD

We propose a hybrid model that integrates the pre-trained VGG16 network with an attention mechanism and a stacking ensemble learning model, which is capable of multi-scale feature aggregation based on the self-attention mechanism and multi-classification model fusion (Logistic regression, random forest, support vector machine) based on stacking ensemble learning. The proposed hybrid method achieves four classifications of normal, mild, moderate, and severe fatty liver based on ultrasound images.

RESULT AND CONCLUSION

Our proposed hybrid model reaches an accuracy of 91.34% and exhibits superior robustness against interference, which is better than traditional neural network algorithms. Experimental results show that, compared with the pre-trained VGG16 model, adding the self-attention mechanism improves the accuracy by 3.02%. Using the stacking ensemble learning model as a classifier further increases the accuracy to 91.34%, exceeding any single classifier such as LR (89.86%) and SVM (90.34%) and RF (90.73%). The proposed hybrid method can effectively improve the efficiency and accuracy of MASLD ultrasound image detection.

Image-based AI diagnostic performance for fatty liver: a systematic review and meta-analysis

BACKGROUND

The gold standard to diagnose fatty liver is pathology. Recently, image-based artificial intelligence (AI) has been found to have high diagnostic performance. We systematically reviewed studies of image-based AI in the diagnosis of fatty liver.

METHODS

We searched the Cochrane Library, Pubmed, Embase and assessed the quality of included studies by QUADAS-AI. The pooled sensitivity, specificity, negative likelihood ratio (NLR), positive likelihood ratio (PLR), and diagnostic odds ratio (DOR) were calculated using a random effects model. Summary receiver operating characteristic curves (SROC) were generated to identify the diagnostic accuracy of AI models.

RESULTS

15 studies were selected in our meta-analysis. Pooled sensitivity and specificity were 92% (95% CI: 90-93%) and 94% (95% CI: 93-96%), PLR and NLR were 12.67 (95% CI: 7.65-20.98) and 0.09 (95% CI: 0.06-0.13), DOR was 182.36 (95% CI: 94.85-350.61). After subgroup analysis by AI algorithm (conventional machine learning/deep learning), region, reference (US, MRI or pathology), imaging techniques (MRI or US) and transfer learning, the model also demonstrated acceptable diagnostic efficacy.

CONCLUSION

AI has satisfactory performance in the diagnosis of fatty liver by medical imaging. The integration of AI into imaging devices may produce effective diagnostic tools, but more high-quality studies are needed for further evaluation.

Nonalcoholic fatty liver disease (NAFLD) detection and deep learning in a Chinese community-based population

OBJECTIVES

We aimed to develop and validate a deep learning system (DLS) by using an auxiliary section that extracts and outputs specific ultrasound diagnostic features to improve the explainable, clinical relevant utility of using DLS for detecting NAFLD.

METHODS

In a community-based study of 4144 participants with abdominal ultrasound scan in Hangzhou, China, we sampled 928 (617 [66.5%] females, mean age: 56 years ± 13 [standard deviation]) participants (2 images per participant) to develop and validate DLS, a two-section neural network (2S-NNet). Radiologists' consensus diagnosis classified hepatic steatosis as none steatosis, mild, moderate, and severe. We also explored the NAFLD detection performance of six one-section neural network models and five fatty liver indices on our data set. We further evaluated the influence of participants' characteristics on the correctness of 2S-NNet by logistic regression.

RESULTS

Area under the curve (AUROC) of 2S-NNet for hepatic steatosis was 0.90 for ≥ mild, 0.85 for ≥ moderate, and 0.93 for severe steatosis, and was 0.90 for NAFLD presence, 0.84 for moderate to severe NAFLD, and 0.93 for severe NAFLD. The AUROC of NAFLD severity was 0.88 for 2S-NNet, and 0.79-0.86 for one-section models. The AUROC of NAFLD presence was 0.90 for 2S-NNet, and 0.54-0.82 for fatty liver indices. Age, sex, body mass index, diabetes, fibrosis-4 index, android fat ratio, and skeletal muscle via dual-energy X-ray absorptiometry had no significant impact on the correctness of 2S-NNet (p > 0.05).

CONCLUSIONS

By using two-section design, 2S-NNet had improved the performance for detecting NAFLD with more explainable, clinical relevant utility than using one-section design.

KEY POINTS

• Based on the consensus review derived from radiologists, our DLS (2S-NNet) had an AUROC of 0.88 by using two-section design and yielded better performance for detecting NAFLD than using one-section design with more explainable, clinical relevant utility. • The 2S-NNet outperformed five fatty liver indices with the highest AUROCs (0.84-0.93 vs. 0.54-0.82) for different NAFLD severity screening, indicating screening utility of deep learning-based radiology may perform better than blood biomarker panels in epidemiology. • The correctness of 2S-NNet was not significantly influenced by individual's characteristics, including age, sex, body mass index, diabetes, fibrosis-4 index, android fat ratio, and skeletal muscle via dual-energy X-ray absorptiometry.

The Role of Radiomics and AI Technologies in the Segmentation, Detection, and Management of Hepatocellular Carcinoma

Hepatocellular carcinoma (HCC) is the most common primary hepatic neoplasm. Thanks to recent advances in computed tomography (CT) and magnetic resonance imaging (MRI), there is potential to improve detection, segmentation, discrimination from HCC mimics, and monitoring of therapeutic response. Radiomics, artificial intelligence (AI), and derived tools have already been applied in other areas of diagnostic imaging with promising results. In this review, we briefly discuss the current clinical applications of radiomics and AI in the detection, segmentation, and management of HCC. Moreover, we investigate their potential to reach a more accurate diagnosis of HCC and to guide proper treatment planning.

Feasibility of using AI to auto-catch responsible frames in ultrasound screening for breast cancer diagnosis

The research of AI-assisted breast diagnosis has primarily been based on static images. It is unclear whether it represents the best diagnosis image.To explore the method of capturing complementary responsible frames from breast ultrasound screening by using artificial intelligence. We used feature entropy breast network (FEBrNet) to select responsible frames from breast ultrasound screenings and compared the diagnostic performance of AI models based on FEBrNet-recommended frames, physician-selected frames, 5-frame interval-selected frames, all frames of video, as well as that of ultrasound and mammography specialists. The AUROC of AI model based on FEBrNet-recommended frames outperformed other frame set based AI models, as well as ultrasound and mammography physicians, indicating that FEBrNet can reach level of medical specialists in frame selection.FEBrNet model can extract video responsible frames for breast nodule diagnosis, whose performance is equivalent to the doctors selected responsible frames.

Artificial Intelligence for Detecting and Quantifying Fatty Liver in Ultrasound Images: A Systematic Review

BACKGROUND

Non-alcoholic Fatty Liver Disease (NAFLD) is growing more prevalent worldwide. Although non-invasive diagnostic approaches such as conventional ultrasonography and clinical scoring systems have been proposed as alternatives to liver biopsy, their efficacy has been called into doubt. Artificial Intelligence (AI) is now combined with traditional diagnostic processes to improve the performance of non-invasive approaches.

OBJECTIVE

This study explores how well various AI methods function and perform on ultrasound (US) images to diagnose and quantify non-alcoholic fatty liver disease.

METHODOLOGY

A systematic review was conducted to achieve this objective. Five science bibliographic databases were searched, including PubMed, Association for Computing Machinery ACM Digital Library, Institute of Electrical and Electronics Engineers IEEE Xplore, Scopus, and Google Scholar. Only peer-reviewed English articles, conferences, theses, and book chapters were included. Data from studies were synthesized using narrative methodologies per Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria.

RESULTS

Forty-nine studies were included in the systematic review. According to the qualitative analysis, AI significantly enhanced the diagnosis of NAFLD, Non-Alcoholic Steatohepatitis (NASH), and liver fibrosis. In addition, modalities, image acquisition, feature extraction and selection, data management, and classifiers were assessed and compared in terms of performance measures (i.e., accuracy, sensitivity, and specificity).

CONCLUSION

AI-supported systems show potential performance increases in detecting and quantifying steatosis, NASH, and liver fibrosis in NAFLD patients. Before real-world implementation, prospective studies with direct comparisons of AI-assisted modalities and conventional techniques are necessary.

Diagnosis of liver disease by computer- assisted imaging techniques: A literature review

Diagnosis of liver disease using computer-aided detection (CAD) systems is one of the most efficient and cost-effective methods of medical image diagnosis. Accurate disease detection by using ultrasound images or other medical imaging modalities depends on the physician’s or doctor’s experience and skill. CAD systems have a critical role in helping experts make accurate and right-sized assessments. There are different types of CAD systems for diagnosing different diseases, and one of the applications is in liver disease diagnosis and detection by using intelligent algorithms to detect any abnormalities. Machine learning and deep learning algorithms and models play also a big role in this area. In this article, we tried to review the techniques which are utilized in different stages of CAD systems and pursue the methods used in preprocessing, extracting, and selecting features and classification. Also, different techniques are used to segment and analyze the liver ultrasound medical images, which is still a challenging approach to how to use these techniques and their technical and clinical effectiveness as a global approach.

Recent advancement in cancer diagnosis using machine learning and deep learning techniques: A comprehensive review

Being a second most cause of mortality worldwide, cancer has been identified as a perilous disease for human beings, where advance stage diagnosis may not help much in safeguarding patients from mortality. Thus, efforts to provide a sustainable architecture with proven cancer prevention estimate and provision for early diagnosis of cancer is the need of hours. Advent of machine learning methods enriched cancer diagnosis area with its overwhelmed efficiency & low error-rate then humans. A significant revolution has been witnessed in the development of machine learning & deep learning assisted system for segmentation & classification of various cancers during past decade. This research paper includes a review of various types of cancer detection via different data modalities using machine learning & deep learning-based methods along with different feature extraction techniques and benchmark datasets utilized in the recent six years studies. The focus of this study is to review, analyse, classify, and address the recent development in cancer detection and diagnosis of six types of cancers i.e., breast, lung, liver, skin, brain and pancreatic cancer, using machine learning & deep learning techniques. Various state-of-the-art technique are clustered into same group and results are examined through key performance indicators like accuracy, area under the curve, precision, sensitivity, dice score on benchmark datasets and concluded with future research work challenges.

Bias Investigation in Artificial Intelligence Systems for Early Detection of Parkinson's Disease: A Narrative Review

Background and Motivation: Diagnosis of Parkinson's disease (PD) is often based on medical attention and clinical signs. It is subjective and does not have a good prognosis. Artificial Intelligence (AI) has played a promising role in the diagnosis of PD. However, it introduces bias due to lack of sample size, poor validation, clinical evaluation, and lack of big data configuration. The purpose of this study is to compute the risk of bias (RoB) automatically.

METHOD

The PRISMA search strategy was adopted to select the best 39 AI studies out of 85 PD studies closely associated with early diagnosis PD. The studies were used to compute 30 AI attributes (based on 6 AI clusters), using AP(ai)Bias 1.0 (AtheroPointTM, Roseville, CA, USA), and the mean aggregate score was computed. The studies were ranked and two cutoffs (Moderate-Low (ML) and High-Moderate (MH)) were determined to segregate the studies into three bins: low-, moderate-, and high-bias.

RESULT

The ML and HM cutoffs were 3.50 and 2.33, respectively, which constituted 7, 13, and 6 for low-, moderate-, and high-bias studies. The best and worst architectures were "deep learning with sketches as outcomes" and "machine learning with Electroencephalography," respectively. We recommend (i) the usage of power analysis in big data framework, (ii) that it must undergo scientific validation using unseen AI models, and (iii) that it should be taken towards clinical evaluation for reliability and stability tests.

CONCLUSION

The AI is a vital component for the diagnosis of early PD and the recommendations must be followed to lower the RoB.

COVLIAS 1.0 vs. MedSeg: Artificial Intelligence-Based Comparative Study for Automated COVID-19 Computed Tomography Lung Segmentation in Italian and Croatian Cohorts

(1) Background: COVID-19 computed tomography (CT) lung segmentation is critical for COVID lung severity diagnosis. Earlier proposed approaches during 2020–2021 were semiautomated or automated but not accurate, user-friendly, and industry-standard benchmarked. The proposed study compared the COVID Lung Image Analysis System, COVLIAS 1.0 (GBTI, Inc., and AtheroPoint^TM, Roseville, CA, USA, referred to as COVLIAS), against MedSeg, a web-based Artificial Intelligence (AI) segmentation tool, where COVLIAS uses hybrid deep learning (HDL) models for CT lung segmentation. (2) Materials and Methods: The proposed study used 5000 ITALIAN COVID-19 positive CT lung images collected from 72 patients (experimental data) that confirmed the reverse transcription-polymerase chain reaction (RT-PCR) test. Two hybrid AI models from the COVLIAS system, namely, VGG-SegNet (HDL 1) and ResNet-SegNet (HDL 2), were used to segment the CT lungs. As part of the results, we compared both COVLIAS and MedSeg against two manual delineations (MD 1 and MD 2) using (i) Bland–Altman plots, (ii) Correlation coefficient (CC) plots, (iii) Receiver operating characteristic curve, and (iv) Figure of Merit and (v) visual overlays. A cohort of 500 CROATIA COVID-19 positive CT lung images (validation data) was used. A previously trained COVLIAS model was directly applied to the validation data (as part of Unseen-AI) to segment the CT lungs and compare them against MedSeg. (3) Result: For the experimental data, the four CCs between COVLIAS (HDL 1) vs. MD 1, COVLIAS (HDL 1) vs. MD 2, COVLIAS (HDL 2) vs. MD 1, and COVLIAS (HDL 2) vs. MD 2 were 0.96, 0.96, 0.96, and 0.96, respectively. The mean value of the COVLIAS system for the above four readings was 0.96. CC between MedSeg vs. MD 1 and MedSeg vs. MD 2 was 0.98 and 0.98, respectively. Both had a mean value of 0.98. On the validation data, the CC between COVLIAS (HDL 1) vs. MedSeg and COVLIAS (HDL 2) vs. MedSeg was 0.98 and 0.99, respectively. For the experimental data, the difference between the mean values for COVLIAS and MedSeg showed a difference of <2.5%, meeting the standard of equivalence. The average running times for COVLIAS and MedSeg on a single lung CT slice were ~4 s and ~10 s, respectively. (4) Conclusions: The performances of COVLIAS and MedSeg were similar. However, COVLIAS showed improved computing time over MedSeg.

Ten Fast Transfer Learning Models for Carotid Ultrasound Plaque Tissue Characterization in Augmentation Framework Embedded with Heatmaps for Stroke Risk Stratification

Background and Purpose: Only 1-2% of the internal carotid artery asymptomatic plaques are unstable as a result of >80% stenosis. Thus, unnecessary efforts can be saved if these plaques can be characterized and classified into symptomatic and asymptomatic using non-invasive B-mode ultrasound. Earlier plaque tissue characterization (PTC) methods were machine learning (ML)-based, which used hand-crafted features that yielded lower accuracy and unreliability. The proposed study shows the role of transfer learning (TL)-based deep learning models for PTC. Methods: As pertained weights were used in the supercomputer framework, we hypothesize that transfer learning (TL) provides improved performance compared with deep learning. We applied 11 kinds of artificial intelligence (AI) models, 10 of them were augmented and optimized using TL approaches-a class of Atheromatic™ 2.0 TL (AtheroPoint™, Roseville, CA, USA) that consisted of (i-ii) Visual Geometric Group-16, 19 (VGG16, 19); (iii) Inception V3 (IV3); (iv-v) DenseNet121, 169; (vi) XceptionNet; (vii) ResNet50; (viii) MobileNet; (ix) AlexNet; (x) SqueezeNet; and one DL-based (xi) SuriNet-derived from UNet. We benchmark 11 AI models against our earlier deep convolutional neural network (DCNN) model. Results: The best performing TL was MobileNet, with accuracy and area-under-the-curve (AUC) pairs of 96.10 ± 3% and 0.961 (p < 0.0001), respectively. In DL, DCNN was comparable to SuriNet, with an accuracy of 95.66% and 92.7 ± 5.66%, and an AUC of 0.956 (p < 0.0001) and 0.927 (p < 0.0001), respectively. We validated the performance of the AI architectures with established biomarkers such as greyscale median (GSM), fractal dimension (FD), higher-order spectra (HOS), and visual heatmaps. We benchmarked against previously developed Atheromatic™ 1.0 ML and showed an improvement of 12.9%. Conclusions: TL is a powerful AI tool for PTC into symptomatic and asymptomatic plaques.

Artificial intelligence-based hybrid deep learning models for image classification: The first narrative review

BACKGROUND

Artificial intelligence (AI) has served humanity in many applications since its inception. Currently, it dominates the imaging field-in particular, image classification. The task of image classification became much easier with machine learning (ML) and subsequently got automated and more accurate by using deep learning (DL). By default, DL consists of a single architecture and is termed solo deep learning (SDL). When two or more DL architectures are fused, the result is termed a hybrid deep learning (HDL) model. The use of HDL models is becoming popular in several applications, but no review of these uses has been designed thus far. Therefore, this study provides the first narrative HDL review by considering all facets of image classification using AI.

APPROACH

Our review employs a PRISMA search strategy using Google Scholar, PubMed, IEEE, and Elsevier Science Direct, through which 127 relevant HDL studies were considered. Based on the computer vision evolution, HDLs were subsequently classified into three categories (spatial, temporal, and spatial-temporal). Each study was then analyzed based on several attributes, including continent, publisher, hybridization of two DL or ML, architecture layout, application type, data set type, dataset size, feature extraction methodology, connecting classifier, performance evaluation metrics, and risk-of-bias.

CONCLUSION

The HDL models have shown stable and superior performance by taking the best aspects of two or more solo DL or fusion of DL with ML models. Our findings indicate that HDL is being applied aggressively to several medical and non-medical applications. Furthermore, risk-of-bias is highly debatable for DL and HDL models.

Artificial Intelligence in Imaging of Chronic Liver Diseases: Current Update and Future Perspectives

Here we review artificial intelligence (AI) models which aim to assess various aspects of chronic liver disease. Despite the clinical importance of hepatocellular carcinoma in the setting of chronic liver disease, we focus this review on AI models which are not lesion-specific and instead review models developed for liver parenchyma segmentation, evaluation of portal circulation, assessment of hepatic fibrosis, and identification of hepatic steatosis. Optimization of these models offers the opportunity to potentially reduce the need for invasive procedures such as catheterization to measure hepatic venous pressure gradient or biopsy to assess fibrosis and steatosis. We compare the performance of these AI models amongst themselves as well as to radiomics approaches and alternate modality assessments. We conclude that these models show promising performance and merit larger-scale evaluation. We review artificial intelligence models that aim to assess various aspects of chronic liver disease aside from hepatocellular carcinoma. We focus this review on models for liver parenchyma segmentation, evaluation of portal circulation, assessment of hepatic fibrosis, and identification of hepatic steatosis. We conclude that these models show promising performance and merit a larger scale evaluation.

Multimodality carotid plaque tissue characterization and classification in the artificial intelligence paradigm: a narrative review for stroke application

Cardiovascular disease (CVD) is one of the leading causes of morbidity and mortality in the United States of America and globally. Carotid arterial plaque, a cause and also a marker of such CVD, can be detected by various non-invasive imaging modalities such as magnetic resonance imaging (MRI), computer tomography (CT), and ultrasound (US). Characterization and classification of carotid plaque-type in these imaging modalities, especially into symptomatic and asymptomatic plaque, helps in the planning of carotid endarterectomy or stenting. It can be challenging to characterize plaque components due to (I) partial volume effect in magnetic resonance imaging (MRI) or (II) varying Hausdorff values in plaque regions in CT, and (III) attenuation of echoes reflected by the plaque during US causing acoustic shadowing. Artificial intelligence (AI) methods have become an indispensable part of healthcare and their applications to the non-invasive imaging technologies such as MRI, CT, and the US. In this narrative review, three main types of AI models (machine learning, deep learning, and transfer learning) are analyzed when applied to MRI, CT, and the US. A link between carotid plaque characteristics and the risk of coronary artery disease is presented. With regard to characterization, we review tools and techniques that use AI models to distinguish carotid plaque types based on signal processing and feature strengths. We conclude that AI-based solutions offer an accurate and robust path for tissue characterization and classification for carotid artery plaque imaging in all three imaging modalities. Due to cost, user-friendliness, and clinical effectiveness, AI in the US has dominated the most.

Liver disease classification from ultrasound using multi-scale CNN

PURPOSE

Ultrasound (US) is the preferred modality for fatty liver disease diagnosis due to its noninvasive, real-time, and cost-effective imaging capabilities. However, traditional B-mode US is qualitative, and therefore, the assessment is very subjective. Computer-aided diagnostic tools can improve the specificity and sensitivity of US and help clinicians to perform uniform diagnoses.

METHODS

In this work, we propose a novel deep learning model for nonalcoholic fatty liver disease classification from US data. We design a multi-feature guided multi-scale residual convolutional neural network (CNN) architecture to capture features of different receptive fields. B-mode US images are combined with their corresponding local phase filtered images and radial symmetry transformed images as multi-feature inputs for the network. Various fusion strategies are studied to improve prediction accuracy. We evaluate the designed network architectures on B-mode in vivo liver US images collected from 55 subjects. We also provide quantitative results by comparing our proposed multi-feature CNN architecture against traditional CNN designs and machine learning methods.

RESULTS

Quantitative results show an average classification accuracy above 90% over tenfold cross-validation. Our proposed method achieves a 97.8% area under the ROC curve (AUC) for the patient-specific leave-one-out cross-validation (LOOCV) evaluation. Comprehensive validation results further demonstrate that our proposed approaches achieve significant improvements compared to training mono-feature CNN architectures ([Formula: see text]).

CONCLUSIONS

Feature combination is valuable for the traditional classification methods, and the use of multi-scale CNN can improve liver classification accuracy. Based on the promising performance, the proposed method has the potential in practical applications to help radiologists diagnose nonalcoholic fatty liver disease.

Role of artificial intelligence in cardiovascular risk prediction and outcomes: comparison of machine-learning and conventional statistical approaches for the analysis of carotid ultrasound features and intra-plaque neovascularization

The aim of this study was to compare machine learning (ML) methods with conventional statistical methods to investigate the predictive ability of carotid plaque characteristics for assessing the risk of coronary artery disease (CAD) and cardiovascular (CV) events. Focused carotid B-mode ultrasound, contrast-enhanced ultrasound, and coronary angiography were performed on 459 participants. These participants were followed for 30 days. Plaque characteristics such as carotid intima-media thickness (cIMT), maximum plaque height (MPH), total plaque area (TPA), and intraplaque neovascularization (IPN) were measured at baseline. Two ML-based algorithms-random forest (RF) and random survival forest (RSF) were used for CAD and CV event prediction. The performance of these algorithms was compared against (i) univariate and multivariate analysis for CAD prediction using the area-under-the-curve (AUC) and (ii) Cox proportional hazard model for CV event prediction using the concordance index (c-index). There was a significant association between CAD and carotid plaque characteristics [cIMT (odds ratio (OR) = 1.49, p = 0.03), MPH (OR = 2.44, p < 0.0001), TPA (OR = 1.61, p < 0.0001), and IPN (OR = 2.78, p < 0.0001)]. IPN alone reported significant CV event prediction (hazard ratio = 1.24, p < 0.0001). CAD prediction using the RF algorithm reported an improvement in AUC by ~ 3% over the univariate analysis with IPN alone (0.97 vs. 0.94, p < 0.0001). Cardiovascular event prediction using RSF demonstrated an improvement in the c-index by ~ 17.8% over the Cox-based model (0.86 vs. 0.73). Carotid imaging phenotypes and IPN were associated with CAD and CV events. The ML-based system is superior to the conventional statistically-derived approaches for CAD prediction and survival analysis.

Wilson disease tissue classification and characterization using seven artificial intelligence models embedded with 3D optimization paradigm on a weak training brain magnetic resonance imaging datasets: a supercomputer application

Wilson's disease (WD) is caused by copper accumulation in the brain and liver, and if not treated early, can lead to severe disability and death. WD has shown white matter hyperintensity (WMH) in the brain magnetic resonance scans (MRI) scans, but the diagnosis is challenging due to (i) subtle intensity changes and (ii) weak training MRI when using artificial intelligence (AI). Design and validate seven types of high-performing AI-based computer-aided design (CADx) systems consisting of 3D optimized classification, and characterization of WD against controls. We propose a "conventional deep convolution neural network" (cDCNN) and an "improved DCNN" (iDCNN) where rectified linear unit (ReLU) activation function was modified ensuring "differentiable at zero." Three-dimensional optimization was achieved by recording accuracy while changing the CNN layers and augmentation by several folds. WD was characterized using (i) CNN-based feature map strength and (ii) Bispectrum strengths of pixels having higher probabilities of WD. We further computed the (a) area under the curve (AUC), (b) diagnostic odds ratio (DOR), (c) reliability, and (d) stability and (e) benchmarking. Optimal results were achieved using 9 layers of CNN, with 4-fold augmentation. iDCNN yields superior performance compared to cDCNN with accuracy and AUC of 98.28 ± 1.55, 0.99 (p < 0.0001), and 97.19 ± 2.53%, 0.984 (p < 0.0001), respectively. DOR of iDCNN outperformed cDCNN fourfold. iDCNN also outperformed (a) transfer learning-based "Inception V3" paradigm by 11.92% and (b) four types of "conventional machine learning-based systems": k-NN, decision tree, support vector machine, and random forest by 55.13%, 28.36%, 15.35%, and 14.11%, respectively. The AI-based systems can potentially be useful in the early WD diagnosis. Graphical Abstract.

A Novel Block Imaging Technique Using Nine Artificial Intelligence Models for COVID-19 Disease Classification, Characterization and Severity Measurement in Lung Computed Tomography Scans on an Italian Cohort

Computer Tomography (CT) is currently being adapted for visualization of COVID-19 lung damage. Manual classification and characterization of COVID-19 may be biased depending on the expert's opinion. Artificial Intelligence has recently penetrated COVID-19, especially deep learning paradigms. There are nine kinds of classification systems in this study, namely one deep learning-based CNN, five kinds of transfer learning (TL) systems namely VGG16, DenseNet121, DenseNet169, DenseNet201 and MobileNet, three kinds of machine-learning (ML) systems, namely artificial neural network (ANN), decision tree (DT), and random forest (RF) that have been designed for classification of COVID-19 segmented CT lung against Controls. Three kinds of characterization systems were developed namely (a) Block imaging for COVID-19 severity index (CSI); (b) Bispectrum analysis; and (c) Block Entropy. A cohort of Italian patients with 30 controls (990 slices) and 30 COVID-19 patients (705 slices) was used to test the performance of three types of classifiers. Using K10 protocol (90% training and 10% testing), the best accuracy and AUC was for DCNN and RF pairs were 99.41 ± 5.12%, 0.991 (p < 0.0001), and 99.41 ± 0.62%, 0.988 (p < 0.0001), respectively, followed by other ML and TL classifiers. We show that diagnostics odds ratio (DOR) was higher for DL compared to ML, and both, Bispecturm and Block Entropy shows higher values for COVID-19 patients. CSI shows an association with Ground Glass Opacities (0.9146, p < 0.0001). Our hypothesis holds true that deep learning shows superior performance compared to machine learning models. Block imaging is a powerful novel approach for pinpointing COVID-19 severity and is clinically validated.

Artificial intelligence framework for predictive cardiovascular and stroke risk assessment models: A narrative review of integrated approaches using carotid ultrasound

RECENT FINDINGS

Cardiovascular disease (CVD) is the leading cause of mortality and poses challenges for healthcare providers globally. Risk-based approaches for the management of CVD are becoming popular for recommending treatment plans for asymptomatic individuals. Several conventional predictive CVD risk models based do not provide an accurate CVD risk assessment for patients with different baseline risk profiles. Artificial intelligence (AI) algorithms have changed the landscape of CVD risk assessment and demonstrated a better performance when compared against conventional models, mainly due to its ability to handle the input nonlinear variations. Further, it has the flexibility to add risk factors derived from medical imaging modalities that image the morphology of the plaque. The integration of noninvasive carotid ultrasound image-based phenotypes with conventional risk factors in the AI framework has further provided stronger power for CVD risk prediction, so-called "integrated predictive CVD risk models."

PURPOSE

of the review: The objective of this review is (i) to understand several aspects in the development of predictive CVD risk models, (ii) to explore current conventional predictive risk models and their successes and challenges, and (iii) to refine the search for predictive CVD risk models using noninvasive carotid ultrasound as an exemplar in the artificial intelligence-based framework.

CONCLUSION

Conventional predictive CVD risk models are suboptimal and could be improved. This review examines the potential to include more noninvasive image-based phenotypes in the CVD risk assessment using powerful AI-based strategies.

Texture Feature-Based Classification on Transrectal Ultrasound Image for Prostatic Cancer Detection

Prostate cancer is one of the most common cancers in men. Early detection of prostate cancer is the key to successful treatment. Ultrasound imaging is one of the most suitable methods for the early detection of prostate cancer. Although ultrasound images can show cancer lesions, subjective interpretation is not accurate. Therefore, this paper proposes a transrectal ultrasound image analysis method, aiming at characterizing prostate tissue through image processing to evaluate the possibility of malignant tumours. Firstly, the input image is preprocessed by optical density conversion. Then, local binarization and Gaussian Markov random fields are used to extract texture features, and the linear combination is performed. Finally, the fused texture features are provided to SVM classifier for classification. The method has been applied to data set of 342 transrectal ultrasound images obtained from hospitals with an accuracy of 70.93%, sensitivity of 70.00%, and specificity of 71.74%. The experimental results show that it is possible to distinguish cancerous tissues from noncancerous tissues to some extent.

Cardiovascular risk assessment in patients with rheumatoid arthritis using carotid ultrasound B-mode imaging

Rheumatoid arthritis (RA) is a systemic chronic inflammatory disease that affects synovial joints and has various extra-articular manifestations, including atherosclerotic cardiovascular disease (CVD). Patients with RA experience a higher risk of CVD, leading to increased morbidity and mortality. Inflammation is a common phenomenon in RA and CVD. The pathophysiological association between these diseases is still not clear, and, thus, the risk assessment and detection of CVD in such patients is of clinical importance. Recently, artificial intelligence (AI) has gained prominence in advancing healthcare and, therefore, may further help to investigate the RA-CVD association. There are three aims of this review: (1) to summarize the three pathophysiological pathways that link RA to CVD; (2) to identify several traditional and carotid ultrasound image-based CVD risk calculators useful for RA patients, and (3) to understand the role of artificial intelligence in CVD risk assessment in RA patients. Our search strategy involves extensively searches in PubMed and Web of Science databases using search terms associated with CVD risk assessment in RA patients. A total of 120 peer-reviewed articles were screened for this review. We conclude that (a) two of the three pathways directly affect the atherosclerotic process, leading to heart injury, (b) carotid ultrasound image-based calculators have shown superior performance compared with conventional calculators, and (c) AI-based technologies in CVD risk assessment in RA patients are aggressively being adapted for routine practice of RA patients.

3-D optimized classification and characterization artificial intelligence paradigm for cardiovascular/stroke risk stratification using carotid ultrasound-based delineated plaque: Atheromatic™ 2.0

BACKGROUND AND PURPOSE

Atherosclerotic plaque tissue rupture is one of the leading causes of strokes. Early carotid plaque monitoring can help reduce cardiovascular morbidity and mortality. Manual ultrasound plaque classification and characterization methods are time-consuming and can be imprecise due to significant variations in tissue characteristics. We report a novel artificial intelligence (AI)-based plaque tissue classification and characterization system.

METHODS

We hypothesize that symptomatic plaque is hypoechoic due to its large lipid core and minimal collagen, as well as its heterogeneous makeup. Meanwhile, asymptomatic plaque is hyperechoic due to its small lipid core, abundant collagen, and the fact that it is often calcified. We designed a computer-aided diagnosis (CADx) system consisting of three kinds of deep learning (DL) classification paradigms: Deep Convolutional Neural Network (DCNN), Visual Geometric Group-16 (VGG16), and transfer learning, (tCNN). DCNN was 3-D optimized by varying the number of CNN layers and data augmentation frameworks. The DL systems were benchmarked against four types of machine learning (ML) classification systems, and the CADx system was characterized using two novel strategies consisting of DL mean feature strength (MFS) and a bispectrum model using higher-order spectra.

RESULTS

After balancing symptomatic and asymptomatic plaque classes, a five-fold augmentation process was applied, yielding 1000 carotid scans in each class. Then, using a K10 protocol (trained to test the ratio of 90%-10%), tCNN and DCNN yielded accuracy (area under the curve (AUC)) pairs of 83.33%, 0.833 (p < 0.0001) and 95.66%, 0.956 (p < 0.0001), respectively. DCNN was superior to ML by 7.01%. As part of the characterization process, the MFS of the symptomatic plaque was found to be higher compared to the asymptomatic plaque by 17.5% (p < 0.0001). A similar pattern was seen in the bispectrum, which was higher for symptomatic plaque by 5.4% (p < 0.0001). It took <2 s to perform the online CADx process on a supercomputer.

CONCLUSIONS

The performance order of the three AI systems was DCNN > tCNN > ML. Bispectrum-based on higher-order spectra proved a powerful paradigm for plaque tissue characterization. Overall, the AI-based systems offer a powerful solution for plaque tissue classification and characterization.

Cardiovascular/stroke risk predictive calculators: a comparison between statistical and machine learning models

Background

Statistically derived cardiovascular risk calculators (CVRC) that use conventional risk factors, generally underestimate or overestimate the risk of cardiovascular disease (CVD) or stroke events primarily due to lack of integration of plaque burden. This study investigates the role of machine learning (ML)-based CVD/stroke risk calculators (CVRC_ML) and compares against statistically derived CVRC (CVRC_Stat) based on (I) conventional factors or (II) combined conventional with plaque burden (integrated factors).

Methods

The proposed study is divided into 3 parts: (I) statistical calculator: initially, the 10-year CVD/stroke risk was computed using 13 types of CVRC_Stat (without and with plaque burden) and binary risk stratification of the patients was performed using the predefined thresholds and risk classes; (II) ML calculator: using the same risk factors (without and with plaque burden), as adopted in 13 different CVRC_Stat, the patients were again risk-stratified using CVRC_ML based on support vector machine (SVM) and finally; (III) both types of calculators were evaluated using AUC based on ROC analysis, which was computed using combination of predicted class and endpoint equivalent to CVD/stroke events.

Results

An Institutional Review Board approved 202 patients (156 males and 46 females) of Japanese ethnicity were recruited for this study with a mean age of 69±11 years. The AUC for 13 different types of CVRC_Stat calculators were: AECRS2.0 (AUC 0.83, P<0.001), QRISK3 (AUC 0.72, P<0.001), WHO (AUC 0.70, P<0.001), ASCVD (AUC 0.67, P<0.001), FRS_cardio (AUC 0.67, P<0.01), FRS_stroke (AUC 0.64, P<0.001), MSRC (AUC 0.63, P=0.03), UKPDS56 (AUC 0.63, P<0.001), NIPPON (AUC 0.63, P<0.001), PROCAM (AUC 0.59, P<0.001), RRS (AUC 0.57, P<0.001), UKPDS60 (AUC 0.53, P<0.001), and SCORE (AUC 0.45, P<0.001), while the AUC for the CVRC_ML with integrated risk factors (AUC 0.88, P<0.001), a 42% increase in performance. The overall risk-stratification accuracy for the CVRC_ML with integrated risk factors was 92.52% which was higher compared all the other CVRC_Stat.

Conclusions

ML-based CVD/stroke risk calculator provided a higher predictive ability of 10-year CVD/stroke compared to the 13 different types of statistically derived risk calculators including integrated model AECRS 2.0.

Ultrasound-based stroke/cardiovascular risk stratification using Framingham Risk Score and ASCVD Risk Score based on "Integrated Vascular Age" instead of "Chronological Age": a multi-ethnic study of Asian Indian, Caucasian, and Japanese cohorts

Background

Vascular age (VA) has recently emerged for CVD risk assessment and can either be computed using conventional risk factors (CRF) or by using carotid intima-media thickness (cIMT) derived from carotid ultrasound (CUS). This study investigates a novel method of integrating both CRF and cIMT for estimating VA [so-called integrated VA (IVA)]. Further, the study analyzes and compares CVD/stroke risk using the Framingham Risk Score (FRS)-based risk calculator when adapting IVA against VA.

Methods

The system follows a four-step process: (I) VA using cIMT based using linear-regression (LR) model and its coefficients; (II) VA prediction using ten CRF using a multivariate linear regression (MLR)-based model with gender adjustment; (III) coefficients from the LR-based model and MLR-based model are combined using a linear model to predict the final IVA; (IV) the final step consists of FRS-based risk stratification with IVA as inputs and benchmarked against FRS using conventional method of CA. Area-under-the-curve (AUC) is computed using IVA and benchmarked against CA while taking the response variable as a standardized combination of cIMT and glycated hemoglobin.

Results

The study recruited 648 patients, 202 were Japanese, 314 were Asian Indian, and 132 were Caucasians. Both left and right common carotid arteries (CCA) of all the population were scanned, thus a total of 1,287 ultrasound scans. The 10-year FRS using IVA reported higher AUC (AUC =0.78) compared with 10-year FRS using CA (AUC =0.66) by ~18%.

Conclusions

IVA is an efficient biomarker for risk stratifications for patients in routine practice.

Two-stage artificial intelligence model for jointly measurement of atherosclerotic wall thickness and plaque burden in carotid ultrasound: A screening tool for cardiovascular/stroke risk assessment

MOTIVATION

The early screening of cardiovascular diseases (CVD) can lead to effective treatment. Thus, accurate and reliable atherosclerotic carotid wall detection and plaque measurements are crucial. Current measurement methods are time-consuming and do not utilize the power of knowledge-based paradigms such as artificial intelligence (AI). We present an AI-based methodology for the joint automated detection and measurement of wall thickness and carotid plaque (CP) in the form of carotid intima-media thickness (cIMT) and total plaque area (TPA), a class of AtheroEdge™ system (AtheroPoint™, CA, USA).

METHOD

The novel system consists of two stages, and each stage comprises an independent deep learning (DL) model. In Stage I, the first DL model segregates the common carotid artery (CCA) patches from ultrasound (US) images into the rectangular wall and non-wall patches. The characterized wall patches are integrated to form the region of interest (ROI), which is then fed into Stage II. In Stage II, the second DL model segments the far wall region. Lumen-intima (LI) and media-adventitial (MA) boundaries are then extracted from the wall region, which is then used for cIMT and PA measurement.

RESULTS

Using the database of 250 carotid scans, the cIMT error using the AI model is 0.0935±0.0637 mm, which is lower than those of all previous methods. The PA error is found to be 2.7939±2.3702 mm². The system's correlation coefficient (CC) between AI and ground truth (GT) values for cIMT is 0.99 (p < 0.0001), which is higher compared with the CC of 0.96 (p < 0.0001) shown by the earlier DL method. The CC for PA between AI and GT values is 0.89 (p < 0.0001).

CONCLUSION

A novel AI-based strategy was applied to carotid US images for the joint detection of carotid wall thickness (cWT) and plaque area (PA), followed by cIMT and PA measurement. This AI-based strategy shows improved performance using the patch technique compared with previous methods using full carotid scans.

Morphological Carotid Plaque Area Is Associated With Glomerular Filtration Rate: A Study of South Asian Indian Patients With Diabetes and Chronic Kidney Disease

We evaluated the association between automatically measured carotid total plaque area (TPA) and the estimated glomerular filtration rate (eGFR), a biomarker of chronic kidney disease (CKD). Automated average carotid intima-media thickness (cIMTave) and TPA measurements in carotid ultrasound (CUS) were performed using AtheroEdge (AtheroPoint). Pearson correlation coefficient (CC) was then computed between the TPA and eGFR for (1) males versus females, (2) diabetic versus nondiabetic patients, and (3) between the left and right carotid artery. Overall, 339 South Asian Indian patients with either type 2 diabetes mellitus (T2DM) or CKD, or hypertension (stage 1 or stage 2) were retrospectively analyzed by acquiring cIMTave and TPA measurements of their left and right common carotid arteries (CCA; total CUS: 678, mean age: 54.2 ± 9.8 years; 75.2% males; 93.5% with T2DM). The CC between TPA and eGFR for different scenarios were (1) for males and females -0.25 (P < .001) and -0.35 (P < .001), respectively; (2) for T2DM and non-T2DM -0.26 (P < .001) and -0.49 (P = .02), respectively, and (3) for left and right CCA -0.25 (P < .001) and -0.23 (P < .001), respectively. Automated TPA is an equally reliable biomarker compared with cIMTave for patients with CKD (with or without T2DM) with subclinical atherosclerosis.

Colored Video Analysis in Wireless Capsule Endoscopy: A Survey of State-of-the-Art

Wireless Capsule Endoscopy (WCE) is a highly promising technology for gastrointestinal (GI) tract abnormality diagnosis. However, low image resolution and low frame rates are challenging issues in WCE. In addition, the relevant frames containing the features of interest for accurate diagnosis only constitute 1% of the complete video information. For these reasons, analyzing the WCE videos is still a time consuming and laborious examination for the gastroenterologists, which reduces WCE system usability. This leads to the emergent need to speed-up and automates the WCE video process for GI tract examinations. Consequently, the present work introduced the concept of WCE technology, including the structure of WCE systems, with a focus on the medical endoscopy video capturing process using image sensors. It discussed also the significant characteristics of the different GI tract for effective feature extraction. Furthermore, video approaches for bleeding and lesion detection in the WCE video were reported with computer-aided diagnosis systems in different applications to support the gastroenterologist in the WCE video analysis. In image enhancement, WCE video review time reduction is also discussed, while reporting the challenges and future perspectives, including the new trend to employ the deep learning models for feature Learning, polyp recognition, and classification, as a new opportunity for researchers to develop future WCE video analysis techniques.

Artificial Intelligence in Interventional Radiology: A Literature Review and Future Perspectives

The term “artificial intelligence” (AI) includes computational algorithms that can perform tasks considered typical of human intelligence, with partial to complete autonomy, to produce new beneficial outputs from specific inputs. The development of AI is largely based on the introduction of artificial neural networks (ANN) that allowed the introduction of the concepts of “computational learning models,” machine learning (ML) and deep learning (DL). AI applications appear promising for radiology scenarios potentially improving lesion detection, segmentation, and interpretation with a recent application also for interventional radiology (IR) practice, including the ability of AI to offer prognostic information to both patients and physicians about interventional oncology procedures. This article integrates evidence-reported literature and experience-based perceptions to assist not only residents and fellows who are training in interventional radiology but also practicing colleagues who are approaching to locoregional mini-invasive treatments.

The present and future of deep learning in radiology

The advent of Deep Learning (DL) is poised to dramatically change the delivery of healthcare in the near future. Not only has DL profoundly affected the healthcare industry it has also influenced global businesses. Within a span of very few years, advances such as self-driving cars, robots performing jobs that are hazardous to human, and chat bots talking with human operators have proved that DL has already made large impact on our lives. The open source nature of DL and decreasing prices of computer hardware will further propel such changes. In healthcare, the potential is immense due to the need to automate the processes and evolve error free paradigms. The sheer quantum of DL publications in healthcare has surpassed other domains growing at a very fast pace, particular in radiology. It is therefore imperative for the radiologists to learn about DL and how it differs from other approaches of Artificial Intelligence (AI). The next generation of radiology will see a significant role of DL and will likely serve as the base for augmented radiology (AR). Better clinical judgement by AR will help in improving the quality of life and help in life saving decisions, while lowering healthcare costs. A comprehensive review of DL as well as its implications upon the healthcare is presented in this review. We had analysed 150 articles of DL in healthcare domain from PubMed, Google Scholar, and IEEE EXPLORE focused in medical imagery only. We have further examined the ethic, moral and legal issues surrounding the use of DL in medical imaging.

Non-invasive detection of coronary artery disease in high-risk patients based on the stenosis prediction of separate coronary arteries

BACKGROUND AND OBJECTIVE

Cardiovascular diseases are an extremely widespread sickness and account for 17 million deaths in the world per annum. Coronary artery disease (CAD) is one of such diseases with an annual mortality rate of about 7 million. Thus, early diagnosis of CAD is of vital importance. Angiography is currently the modality of choice for the detection of CAD. However, its complications and costs have prompted researchers to seek alternative methods via machine learning algorithms.

METHODS

The present study proposes a novel machine learning algorithm. The proposed algorithm uses three classifiers for detection of the stenosis of three coronary arteries, i.e., left anterior descending (LAD), left circumflex (LCX) and right coronary artery (RCA) to get higher accuracy for CAD diagnosis.

RESULTS

This method was applied on the extension of Z-Alizadeh Sani dataset which contains demographic, examination, ECG, and laboratory and echo data of 500 patients. This method achieves an accuracy, sensitivity and specificity rates of 96.40%, 100% and 88.1%, respectively for the detection of CAD. To our knowledge, such high rates of accuracy and sensitivity have not been attained elsewhere before.

CONCLUSION

This new algorithm reliably distinguishes those with normal coronary arteries from those with CAD which may obviate the need for angiography in the normal group.

Symtosis: A liver ultrasound tissue characterization and risk stratification in optimized deep learning paradigm

Background and Objective Fatty Liver Disease (FLD) - a disease caused by deposition of fat in liver cells, is predecessor to terminal diseases such as liver cancer. The machine learning (ML) techniques applied for FLD detection and risk stratification using ultrasound (US) have limitations in computing tissue characterization features, thereby limiting the accuracy. Methods Under the class of Symtosis for FLD detection and risk stratification, this study presents a Deep Learning (DL)-based paradigm that computes nearly seven million weights per image when passed through a 22 layered neural network during the cross-validation (training and testing) paradigm. The DL architecture consists of cascaded layers of operations such as: convolution, pooling, rectified linear unit, dropout and a special block called inception model that provides speed and efficiency. All data analysis is performed in optimized tissue region, obtained by removing background information. We benchmark the DL system against the conventional ML protocols: support vector machine (SVM) and extreme learning machine (ELM). Results The liver US data consists of 63 patients (27 normal/36 abnormal). Using the K10 cross-validation protocol (90% training and 10% testing), the detection and risk stratification accuracies are: 82%, 92% and 100% for SVM, ELM and DL systems, respectively. The corresponding area under the curve is: 0.79, 0.92 and 1.0, respectively. We further validate our DL system using two class biometric facial data that yields an accuracy of 99%. Conclusion DL system shows a superior performance for liver detection and risk stratification compared to conventional machine learning systems: SVM and ELM.

Thermal Imaging in Medical Science

Thermal imaging is a non-destructive, non-contact and rapid system. It reports temperature through measuring infrared radiation emanated by an object/ material surface. Automated thermal imaging system involves thermal camera equipped with infrared detectors, signal processing unit and image acquisition system supported by computer. It is elaborated in wide domains applications. Extensive focus is directed to the thermal imaging in the medical domain especially breast cancer detection. This chapter provided the main concept and the different applications of thermal imaging. It explores and analyses several works in the light of studding the thermograph. It is an effective screening tool for breast cancer prediction. Studies justify that thermography can be considered a complementary tool to detect breast diseases. The current chapter reviews many usages and limitations of thermography in biomedical field. Extensive recommendations for future directions are summarized to provide a structured vision of breast thermography.