1
|
Scicolone R, Vacca S, Pisu F, Benson JC, Nardi V, Lanzino G, Suri JS, Saba L. Radiomics and artificial intelligence: General notions and applications in the carotid vulnerable plaque. Eur J Radiol 2024; 176:111497. [PMID: 38749095 DOI: 10.1016/j.ejrad.2024.111497] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2024] [Revised: 04/14/2024] [Accepted: 05/03/2024] [Indexed: 06/17/2024]
Abstract
Carotid atherosclerosis plays a substantial role in cardiovascular morbidity and mortality. Given the multifaceted impact of this disease, there has been increasing interest in harnessing artificial intelligence (AI) and radiomics as complementary tools for the quantitative analysis of medical imaging data. This integrated approach holds promise not only in refining medical imaging data analysis but also in optimizing the utilization of radiologists' expertise. By automating time consuming tasks, AI allows radiologists to focus on more pertinent responsibilities. Simultaneously, the capacity of AI in radiomics to extract nuanced patterns from raw data enhances the exploration of carotid atherosclerosis, advancing efforts in terms of (1) early detection and diagnosis, (2) risk stratification and predictive modeling, (3) improving workflow efficiency, and (4) contributing to advancements in research. This review provides an overview of general concepts related to radiomics and AI, along with their application in the field of carotid vulnerable plaque. It also offers insights into various research studies conducted on this topic across different imaging techniques.
Collapse
Affiliation(s)
- Roberta Scicolone
- Department of Radiology, Azienda Ospedaliero-Universitaria (A.O.U.), di Cagliari-Polo di Monserrato, Cagliari, Italy
| | - Sebastiano Vacca
- University of Cagliari, School of Medicine and Surgery, Cagliari, Italy
| | - Francesco Pisu
- Department of Radiology, Azienda Ospedaliero-Universitaria (A.O.U.), di Cagliari-Polo di Monserrato, Cagliari, Italy
| | - John C Benson
- Department of Radiology, Mayo Clinic, Rochester, MN, USA
| | - Valentina Nardi
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN, USA
| | | | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero-Universitaria (A.O.U.), di Cagliari-Polo di Monserrato, Cagliari, Italy.
| |
Collapse
|
2
|
Agarwal S, Saxena S, Carriero A, Chabert GL, Ravindran G, Paul S, Laird JR, Garg D, Fatemi M, Mohanty L, Dubey AK, Singh R, Fouda MM, Singh N, Naidu S, Viskovic K, Kukuljan M, Kalra MK, Saba L, Suri JS. COVLIAS 3.0: cloud-based quantized hybrid UNet3+ deep learning for COVID-19 lesion detection in lung computed tomography. Front Artif Intell 2024; 7:1304483. [PMID: 39006802 PMCID: PMC11240867 DOI: 10.3389/frai.2024.1304483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Accepted: 06/10/2024] [Indexed: 07/16/2024] Open
Abstract
Background and novelty When RT-PCR is ineffective in early diagnosis and understanding of COVID-19 severity, Computed Tomography (CT) scans are needed for COVID diagnosis, especially in patients having high ground-glass opacities, consolidations, and crazy paving. Radiologists find the manual method for lesion detection in CT very challenging and tedious. Previously solo deep learning (SDL) was tried but they had low to moderate-level performance. This study presents two new cloud-based quantized deep learning UNet3+ hybrid (HDL) models, which incorporated full-scale skip connections to enhance and improve the detections. Methodology Annotations from expert radiologists were used to train one SDL (UNet3+), and two HDL models, namely, VGG-UNet3+ and ResNet-UNet3+. For accuracy, 5-fold cross-validation protocols, training on 3,500 CT scans, and testing on unseen 500 CT scans were adopted in the cloud framework. Two kinds of loss functions were used: Dice Similarity (DS) and binary cross-entropy (BCE). Performance was evaluated using (i) Area error, (ii) DS, (iii) Jaccard Index, (iii) Bland-Altman, and (iv) Correlation plots. Results Among the two HDL models, ResNet-UNet3+ was superior to UNet3+ by 17 and 10% for Dice and BCE loss. The models were further compressed using quantization showing a percentage size reduction of 66.76, 36.64, and 46.23%, respectively, for UNet3+, VGG-UNet3+, and ResNet-UNet3+. Its stability and reliability were proved by statistical tests such as the Mann-Whitney, Paired t-Test, Wilcoxon test, and Friedman test all of which had a p < 0.001. Conclusion Full-scale skip connections of UNet3+ with VGG and ResNet in HDL framework proved the hypothesis showing powerful results improving the detection accuracy of COVID-19.
Collapse
Affiliation(s)
- Sushant Agarwal
- Advanced Knowledge Engineering Center, GBTI, Roseville, CA, United States
- Department of CSE, PSIT, Kanpur, India
| | | | - Alessandro Carriero
- Department of Radiology, “Maggiore della Carità” Hospital, University of Piemonte Orientale (UPO), Novara, Italy
| | | | - Gobinath Ravindran
- Department of Civil Engineering, SR University, Warangal, Telangana, India
| | - Sudip Paul
- Department of Biomedical Engineering, NEHU, Shillong, India
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA, United States
| | - Deepak Garg
- School of CS and AI, SR University, Warangal, Telangana, India
| | - Mostafa Fatemi
- Department of Physiology and Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN, United States
| | - Lopamudra Mohanty
- Department of Computer Science, ABES Engineering College, Ghaziabad, UP, India
- Department of Computer science, Bennett University, Greater Noida, UP, India
| | - Arun K. Dubey
- Bharati Vidyapeeth’s College of Engineering, New Delhi, India
| | - Rajesh Singh
- Division of Research and Innovation, Uttaranchal Institute of Technology, Uttaranchal University, Dehradun, India
| | - Mostafa M. Fouda
- Department of ECE, Idaho State University, Pocatello, ID, United States
| | - Narpinder Singh
- Department of Food Science and Technology, Graphic Era Deemed to be University, Dehradun, India
| | - Subbaram Naidu
- Department of EE, University of Minnesota, Duluth, MN, United States
| | | | - Melita Kukuljan
- Department of Interventional and Diagnostic Radiology, Clinical Hospital Center Rijeka, Rijeka, Croatia
| | - Manudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA, United States
| | - Luca Saba
- Department of Radiology, A.O.U., Cagliari, Italy
| | - Jasjit S. Suri
- Department of ECE, Idaho State University, Pocatello, ID, United States
- Department of Computer Science, Graphic Era Deemed to Be University, Dehradun, Uttarakhand, India
- Symbiosis Institute of Technology, Nagpur Campus, Symbiosis International (Deemed University), Pune, India
- Stroke and Monitoring Division, AtheroPoint LLC, Roseville, CA, United States
| |
Collapse
|
3
|
Al-Maini M, Maindarkar M, Kitas GD, Khanna NN, Misra DP, Johri AM, Mantella L, Agarwal V, Sharma A, Singh IM, Tsoulfas G, Laird JR, Faa G, Teji J, Turk M, Viskovic K, Ruzsa Z, Mavrogeni S, Rathore V, Miner M, Kalra MK, Isenovic ER, Saba L, Fouda MM, Suri JS. Artificial intelligence-based preventive, personalized and precision medicine for cardiovascular disease/stroke risk assessment in rheumatoid arthritis patients: a narrative review. Rheumatol Int 2023; 43:1965-1982. [PMID: 37648884 DOI: 10.1007/s00296-023-05415-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Accepted: 07/31/2023] [Indexed: 09/01/2023]
Abstract
The challenges associated with diagnosing and treating cardiovascular disease (CVD)/Stroke in Rheumatoid arthritis (RA) arise from the delayed onset of symptoms. Existing clinical risk scores are inadequate in predicting cardiac events, and conventional risk factors alone do not accurately classify many individuals at risk. Several CVD biomarkers consider the multiple pathways involved in the development of atherosclerosis, which is the primary cause of CVD/Stroke in RA. To enhance the accuracy of CVD/Stroke risk assessment in the RA framework, a proposed approach involves combining genomic-based biomarkers (GBBM) derived from plasma and/or serum samples with innovative non-invasive radiomic-based biomarkers (RBBM), such as measurements of synovial fluid, plaque area, and plaque burden. This review presents two hypotheses: (i) RBBM and GBBM biomarkers exhibit a significant correlation and can precisely detect the severity of CVD/Stroke in RA patients. (ii) Artificial Intelligence (AI)-based preventive, precision, and personalized (aiP3) CVD/Stroke risk AtheroEdge™ model (AtheroPoint™, CA, USA) that utilizes deep learning (DL) to accurately classify the risk of CVD/stroke in RA framework. The authors conducted a comprehensive search using the PRISMA technique, identifying 153 studies that assessed the features/biomarkers of RBBM and GBBM for CVD/Stroke. The study demonstrates how DL models can be integrated into the AtheroEdge™-aiP3 framework to determine the risk of CVD/Stroke in RA patients. The findings of this review suggest that the combination of RBBM with GBBM introduces a new dimension to the assessment of CVD/Stroke risk in the RA framework. Synovial fluid levels that are higher than normal lead to an increase in the plaque burden. Additionally, the review provides recommendations for novel, unbiased, and pruned DL algorithms that can predict CVD/Stroke risk within a RA framework that is preventive, precise, and personalized.
Collapse
Affiliation(s)
- Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON, L4Z 4C4, Canada
| | - Mahesh Maindarkar
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, 95661, USA
- Asia Pacific Vascular Society, New Delhi, 110001, India
| | - George D Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, DY1 2HQ, UK
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester, M13 9PL, UK
| | - Narendra N Khanna
- Asia Pacific Vascular Society, New Delhi, 110001, India
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, 110001, India
| | | | - Amer M Johri
- Division of Cardiology, Department of Medicine, Queen's University, Kingston, Canada
| | - Laura Mantella
- Division of Cardiology, Department of Medicine, University of Toronto, Toronto, Canada
| | - Vikas Agarwal
- Department of Immunology, SGPIMS, Lucknow, 226014, India
| | - Aman Sharma
- Department of Immunology, SGPIMS, Lucknow, 226014, India
| | - Inder M Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, 95661, USA
| | - George Tsoulfas
- Department of Surgery, Aristoteleion University of Thessaloniki, 54124, Thessaloniki, Greece
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, 94574, USA
| | - Gavino Faa
- Department of Pathology, Azienda Ospedaliero Universitaria, 09124, Cagliari, Italy
| | - Jagjit Teji
- Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, 60611, USA
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, 27753, Delmenhorst, Germany
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, UHID, 10 000, Zagreb, Croatia
| | - Zoltan Ruzsa
- Invasive Cardiology Division, University of Szeged, Szeged, Hungary
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Centre, Athens, Greece
| | - Vijay Rathore
- Nephrology Department, Kaiser Permanente, Sacramento, CA, 95823, USA
| | - Martin Miner
- Men's Health Centre, Miriam Hospital Providence, Providence, RI, 02906, USA
| | - Manudeep K Kalra
- Department of Radiology, Harvard Medical School, Boston, MA, USA
| | - Esma R Isenovic
- Department of Radiobiology and Molecular Genetics, National Institute of the Republic of Serbia, University of Belgrade, 11000, Belgrade, Serbia
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria, 40138, Cagliari, Italy
| | - Mostafa M Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID, 83209, USA
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, 95661, USA.
| |
Collapse
|
4
|
Sanga P, Singh J, Dubey AK, Khanna NN, Laird JR, Faa G, Singh IM, Tsoulfas G, Kalra MK, Teji JS, Al-Maini M, Rathore V, Agarwal V, Ahluwalia P, Fouda MM, Saba L, Suri JS. DermAI 1.0: A Robust, Generalized, and Novel Attention-Enabled Ensemble-Based Transfer Learning Paradigm for Multiclass Classification of Skin Lesion Images. Diagnostics (Basel) 2023; 13:3159. [PMID: 37835902 PMCID: PMC10573070 DOI: 10.3390/diagnostics13193159] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 09/03/2023] [Accepted: 10/04/2023] [Indexed: 10/15/2023] Open
Abstract
Skin lesion classification plays a crucial role in dermatology, aiding in the early detection, diagnosis, and management of life-threatening malignant lesions. However, standalone transfer learning (TL) models failed to deliver optimal performance. In this study, we present an attention-enabled ensemble-based deep learning technique, a powerful, novel, and generalized method for extracting features for the classification of skin lesions. This technique holds significant promise in enhancing diagnostic accuracy by using seven pre-trained TL models for classification. Six ensemble-based DL (EBDL) models were created using stacking, softmax voting, and weighted average techniques. Furthermore, we investigated the attention mechanism as an effective paradigm and created seven attention-enabled transfer learning (aeTL) models before branching out to construct three attention-enabled ensemble-based DL (aeEBDL) models to create a reliable, adaptive, and generalized paradigm. The mean accuracy of the TL models is 95.30%, and the use of an ensemble-based paradigm increased it by 4.22%, to 99.52%. The aeTL models' performance was superior to the TL models in accuracy by 3.01%, and aeEBDL models outperformed aeTL models by 1.29%. Statistical tests show significant p-value and Kappa coefficient along with a 99.6% reliability index for the aeEBDL models. The approach is highly effective and generalized for the classification of skin lesions.
Collapse
Affiliation(s)
- Prabhav Sanga
- Department of Information Technology, Bharati Vidyapeeth’s College of Engineering, New Delhi 110063, India; (P.S.); (A.K.D.)
- Global Biomedical Technologies, Inc., Roseville, CA 95661, USA
| | - Jaskaran Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA (I.M.S.); (V.R.)
| | - Arun Kumar Dubey
- Department of Information Technology, Bharati Vidyapeeth’s College of Engineering, New Delhi 110063, India; (P.S.); (A.K.D.)
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha Apollo Hospitals, New Delhi 110076, India;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA;
| | - Gavino Faa
- Department of Pathology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy;
| | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA (I.M.S.); (V.R.)
| | - Georgios Tsoulfas
- Department of Surgery, Aristoteleion University of Thessaloniki, 54124 Thessaloniki, Greece;
| | - Mannudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, USA;
| | - Jagjit S. Teji
- Department of Pediatrics, Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA;
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON L4Z 4C4, Canada;
| | - Vijay Rathore
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA (I.M.S.); (V.R.)
| | - Vikas Agarwal
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India;
| | - Puneet Ahluwalia
- Department of Uro Oncology, Medanta the Medicity, Gurugram 122001, India;
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA;
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy;
| | - Jasjit S. Suri
- Global Biomedical Technologies, Inc., Roseville, CA 95661, USA
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA (I.M.S.); (V.R.)
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA;
- Department of Computer Science and Engineering, Graphic Era University (G.E.U.), Dehradun 248002, India
| |
Collapse
|
5
|
Saxena S, Jena B, Mohapatra B, Gupta N, Kalra M, Scartozzi M, Saba L, Suri JS. Fused deep learning paradigm for the prediction of o6-methylguanine-DNA methyltransferase genotype in glioblastoma patients: A neuro-oncological investigation. Comput Biol Med 2023; 153:106492. [PMID: 36621191 DOI: 10.1016/j.compbiomed.2022.106492] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2022] [Revised: 11/29/2022] [Accepted: 12/27/2022] [Indexed: 01/06/2023]
Abstract
BACKGROUND The O6-methylguanine-DNA methyltransferase (MGMT) is a deoxyribonucleic acid (DNA) repairing enzyme that has been established as an essential clinical brain tumor biomarker for Glioblastoma Multiforme (GBM). Knowing the status of MGMT methylation biomarkers using multi-parametric MRI (mp-MRI) helps neuro-oncologists to analyze GBM and its treatment plan. METHOD The hand-crafted radiomics feature extraction of GBM's subregions, such as edema(ED), tumor core (TC), and enhancing tumor (ET) in the machine learning (ML) framework, was investigated using support vector machine(SVM), K-Nearest Neighbours (KNN), random forest (RF), LightGBM, and extreme gradient boosting (XGB). For tissue-level analysis of the promotor genes in GBM, we used the deep residual neural network (ResNet-18) with 3D architecture, followed by EfficientNet-based investigation for variants as B0 and B1. Lastly, we analyzed the fused deep learning (FDL) framework that combines ML and DL frameworks. RESULT Structural mp-MRI consisting of T1, T2, FLAIR, and T1GD having a size of 400 and 185 patients, respectively, for discovery and replication cohorts. Using the CV protocol in the ResNet-3D framework, MGMT methylation status prediction in mp-MRI gave the AUC of 0.753 (p < 0.0001) and 0.72 (p < 0.0001) for the discovery and replication cohort, respectively. We presented that the FDL is ∼7% superior to solo DL and ∼15% to solo ML. CONCLUSION The proposed study aims to provide solutions for building an efficient predictive model of MGMT for GBM patients using deep radiomics features obtained from mp-MRI with the end-to-end ResNet-18 3D and FDL imaging signatures.
Collapse
Affiliation(s)
- Sanjay Saxena
- Department of Computer Science & Engineering, International Institute of Information Technology, Bhubaneswar, Odisha, India
| | - Biswajit Jena
- Department of Computer Science & Engineering, Institute of Technical Education and Research, SOA Deemed to be University, Bhubaneswar, India
| | - Bibhabasu Mohapatra
- Department of Computer Science & Engineering, International Institute of Information Technology, Bhubaneswar, Odisha, India
| | - Neha Gupta
- Bharati Vidyapeeth's College of Engineering, Paschim Vihar, New Delhi, India
| | - Manudeep Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA, 02114, USA
| | - Mario Scartozzi
- Department of Radiology, A.O.U, di Cagliari-Polo di Monserrato s.s, 09124, Cagliari, Italy
| | - Luca Saba
- Department of Radiology, A.O.U, di Cagliari-Polo di Monserrato s.s, 09124, Cagliari, Italy
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™ LLC, Roseville, CA, USA; Knowledge Engineering Centre, Global Biomedical Technologies, Inc, Roseville, CA, USA.
| |
Collapse
|
6
|
Lv P, Yang J, Wang J, Guo Y, Tang Q, Magnier B, Lin J, Zhou J. Ischemic stroke prediction of patients with carotid atherosclerotic stenosis via multi-modality fused network. Front Neurosci 2023; 17:1118376. [PMID: 36908778 PMCID: PMC9998529 DOI: 10.3389/fnins.2023.1118376] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2022] [Accepted: 02/06/2023] [Indexed: 03/14/2023] Open
Abstract
Carotid atherosclerotic stenosis of the carotid artery is an important cause of ischemic cerebrovascular disease. The aim of this study was to predict the presence or absence of clinical symptoms in unknown patients by studying the existence or lack of symptoms of patients with carotid atherosclerotic stenosis. First, a deep neural network prediction model based on brain MRI imaging data of patients with multiple modalities is constructed; it uses the multi-modality features extracted from the neural network as inputs and the incidence of diagnosis as output to train the model. Then, a machine learning-based classification algorithm is developed to utilize the clinical features for comparison and evaluation. The experimental results showed that the deep learning model using imaging data could better predict the clinical symptom classification of patients. As part of preventive medicine, this study could help patients with carotid atherosclerosis narrowing to prepare for stroke prevention based on the prediction results.
Collapse
Affiliation(s)
- Peng Lv
- Department of Radiology, Zhongshan Hospital, Fudan University and Shanghai Institute of Medical Imaging, Shanghai, China
| | - Jing Yang
- School of Medicine, Xiamen University, Xiamen, China
| | - Jiacheng Wang
- Department of Computer Science at School of Informatics, Xiamen University, Xiamen, China
| | - Yi Guo
- Department of Radiology, Zhongshan Hospital Xiamen, Fudan University, Xiamen, China.,Xiamen Municipal Clinical Research Center for Medical Imaging, Xiamen, China
| | - Qiying Tang
- Department of Radiology, Zhongshan Hospital Xiamen, Fudan University, Xiamen, China.,Xiamen Municipal Clinical Research Center for Medical Imaging, Xiamen, China
| | - Baptiste Magnier
- Euromov Digital Health in Motion, Univ Montpellier, IMT Mines Ales, Ales, France
| | - Jiang Lin
- Department of Radiology, Zhongshan Hospital, Fudan University and Shanghai Institute of Medical Imaging, Shanghai, China
| | - Jianjun Zhou
- Department of Radiology, Zhongshan Hospital Xiamen, Fudan University, Xiamen, China.,Xiamen Municipal Clinical Research Center for Medical Imaging, Xiamen, China
| |
Collapse
|
7
|
Khanna NN, Maindarkar MA, Viswanathan V, Fernandes JFE, Paul S, Bhagawati M, Ahluwalia P, Ruzsa Z, Sharma A, Kolluri R, Singh IM, Laird JR, Fatemi M, Alizad A, Saba L, Agarwal V, Sharma A, Teji JS, Al-Maini M, Rathore V, Naidu S, Liblik K, Johri AM, Turk M, Mohanty L, Sobel DW, Miner M, Viskovic K, Tsoulfas G, Protogerou AD, Kitas GD, Fouda MM, Chaturvedi S, Kalra MK, Suri JS. Economics of Artificial Intelligence in Healthcare: Diagnosis vs. Treatment. Healthcare (Basel) 2022; 10:2493. [PMID: 36554017 PMCID: PMC9777836 DOI: 10.3390/healthcare10122493] [Citation(s) in RCA: 32] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2022] [Revised: 12/03/2022] [Accepted: 12/07/2022] [Indexed: 12/14/2022] Open
Abstract
Motivation: The price of medical treatment continues to rise due to (i) an increasing population; (ii) an aging human growth; (iii) disease prevalence; (iv) a rise in the frequency of patients that utilize health care services; and (v) increase in the price. Objective: Artificial Intelligence (AI) is already well-known for its superiority in various healthcare applications, including the segmentation of lesions in images, speech recognition, smartphone personal assistants, navigation, ride-sharing apps, and many more. Our study is based on two hypotheses: (i) AI offers more economic solutions compared to conventional methods; (ii) AI treatment offers stronger economics compared to AI diagnosis. This novel study aims to evaluate AI technology in the context of healthcare costs, namely in the areas of diagnosis and treatment, and then compare it to the traditional or non-AI-based approaches. Methodology: PRISMA was used to select the best 200 studies for AI in healthcare with a primary focus on cost reduction, especially towards diagnosis and treatment. We defined the diagnosis and treatment architectures, investigated their characteristics, and categorized the roles that AI plays in the diagnostic and therapeutic paradigms. We experimented with various combinations of different assumptions by integrating AI and then comparing it against conventional costs. Lastly, we dwell on three powerful future concepts of AI, namely, pruning, bias, explainability, and regulatory approvals of AI systems. Conclusions: The model shows tremendous cost savings using AI tools in diagnosis and treatment. The economics of AI can be improved by incorporating pruning, reduction in AI bias, explainability, and regulatory approvals.
Collapse
Affiliation(s)
- Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110001, India
| | - Mahesh A. Maindarkar
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India
| | | | | | - Sudip Paul
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India
| | - Mrinalini Bhagawati
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India
| | - Puneet Ahluwalia
- Max Institute of Cancer Care, Max Super Specialty Hospital, New Delhi 110017, India
| | - Zoltan Ruzsa
- Invasive Cardiology Division, Faculty of Medicine, University of Szeged, 6720 Szeged, Hungary
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22904, USA
| | - Raghu Kolluri
- Ohio Health Heart and Vascular, Columbus, OH 43214, USA
| | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA
| | - Mostafa Fatemi
- Department of Physiology & Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA
| | - Azra Alizad
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria, 40138 Cagliari, Italy
| | - Vikas Agarwal
- Department of Immunology, SGPGIMS, Lucknow 226014, India
| | - Aman Sharma
- Department of Immunology, SGPGIMS, Lucknow 226014, India
| | - Jagjit S. Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON L4Z 4C4, Canada
| | | | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN 55812, USA
| | - Kiera Liblik
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Amer M. Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, 27753 Delmenhorst, Germany
| | - Lopamudra Mohanty
- Department of Computer Science, ABES Engineering College, Ghaziabad 201009, India
| | - David W. Sobel
- Rheumatology Unit, National Kapodistrian University of Athens, 15772 Athens, Greece
| | - Martin Miner
- Men’s Health Centre, Miriam Hospital Providence, Providence, RI 02906, USA
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, 10000 Zagreb, Croatia
| | - George Tsoulfas
- Department of Surgery, Aristoteleion University of Thessaloniki, 54124 Thessaloniki, Greece
| | - Athanasios D. Protogerou
- Cardiovascular Prevention and Research Unit, Department of Pathophysiology, National & Kapodistrian University of Athens, 15772 Athens, Greece
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PL, UK
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA
| | - Seemant Chaturvedi
- Department of Neurology & Stroke Program, University of Maryland School of Medicine, Baltimore, MD 21201, USA
| | | | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
| |
Collapse
|
8
|
Khanna NN, Maindarkar MA, Viswanathan V, Puvvula A, Paul S, Bhagawati M, Ahluwalia P, Ruzsa Z, Sharma A, Kolluri R, Krishnan PR, Singh IM, Laird JR, Fatemi M, Alizad A, Dhanjil SK, Saba L, Balestrieri A, Faa G, Paraskevas KI, Misra DP, Agarwal V, Sharma A, Teji JS, Al-Maini M, Nicolaides A, Rathore V, Naidu S, Liblik K, Johri AM, Turk M, Sobel DW, Miner M, Viskovic K, Tsoulfas G, Protogerou AD, Mavrogeni S, Kitas GD, Fouda MM, Kalra MK, Suri JS. Cardiovascular/Stroke Risk Stratification in Diabetic Foot Infection Patients Using Deep Learning-Based Artificial Intelligence: An Investigative Study. J Clin Med 2022; 11:6844. [PMID: 36431321 PMCID: PMC9693632 DOI: 10.3390/jcm11226844] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Revised: 11/15/2022] [Accepted: 11/16/2022] [Indexed: 11/22/2022] Open
Abstract
A diabetic foot infection (DFI) is among the most serious, incurable, and costly to treat conditions. The presence of a DFI renders machine learning (ML) systems extremely nonlinear, posing difficulties in CVD/stroke risk stratification. In addition, there is a limited number of well-explained ML paradigms due to comorbidity, sample size limits, and weak scientific and clinical validation methodologies. Deep neural networks (DNN) are potent machines for learning that generalize nonlinear situations. The objective of this article is to propose a novel investigation of deep learning (DL) solutions for predicting CVD/stroke risk in DFI patients. The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) search strategy was used for the selection of 207 studies. We hypothesize that a DFI is responsible for increased morbidity and mortality due to the worsening of atherosclerotic disease and affecting coronary artery disease (CAD). Since surrogate biomarkers for CAD, such as carotid artery disease, can be used for monitoring CVD, we can thus use a DL-based model, namely, Long Short-Term Memory (LSTM) and Recurrent Neural Networks (RNN) for CVD/stroke risk prediction in DFI patients, which combines covariates such as office and laboratory-based biomarkers, carotid ultrasound image phenotype (CUSIP) lesions, along with the DFI severity. We confirmed the viability of CVD/stroke risk stratification in the DFI patients. Strong designs were found in the research of the DL architectures for CVD/stroke risk stratification. Finally, we analyzed the AI bias and proposed strategies for the early diagnosis of CVD/stroke in DFI patients. Since DFI patients have an aggressive atherosclerotic disease, leading to prominent CVD/stroke risk, we, therefore, conclude that the DL paradigm is very effective for predicting the risk of CVD/stroke in DFI patients.
Collapse
Affiliation(s)
- Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110001, India
| | - Mahesh A. Maindarkar
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India
| | | | - Anudeep Puvvula
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
- Annu’s Hospitals for Skin and Diabetes, Nellore 524101, India
| | - Sudip Paul
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India
| | - Mrinalini Bhagawati
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India
| | - Puneet Ahluwalia
- Max Institute of Cancer Care, Max Super Specialty Hospital, New Delhi 110017, India
| | - Zoltan Ruzsa
- Invasive Cardiology Division, Faculty of Medicine, University of Szeged, 6720 Szeged, Hungary
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22904, USA
| | - Raghu Kolluri
- Ohio Health Heart and Vascular, Columbus, OH 43214, USA
| | | | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA 94574, USA
| | - Mostafa Fatemi
- Department of Physiology & Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA
| | - Azra Alizad
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA
| | - Surinder K. Dhanjil
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria, 40138 Cagliari, Italy
| | - Antonella Balestrieri
- Cardiovascular Prevention and Research Unit, Department of Pathophysiology, National & Kapodistrian University of Athens, 15772 Athens, Greece
| | - Gavino Faa
- Department of Pathology, Azienda Ospedaliero Universitaria, 09124 Cagliari, Italy
| | | | | | - Vikas Agarwal
- Department of Immunology, SGPGIMS, Lucknow 226014, India
| | - Aman Sharma
- Department of Immunology, SGPGIMS, Lucknow 226014, India
| | - Jagjit S. Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON L4Z 4C4, Canada
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia Medical School, Egkomi 2408, Cyprus
| | | | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN 55812, USA
| | - Kiera Liblik
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Amer M. Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, 27753 Delmenhorst, Germany
| | - David W. Sobel
- Rheumatology Unit, National Kapodistrian University of Athens, 15772 Athens, Greece
| | - Martin Miner
- Men’s Health Centre, Miriam Hospital Providence, Providence, RI 02906, USA
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, 10000 Zagreb, Croatia
| | - George Tsoulfas
- Department of Surgery, Aristoteleion University of Thessaloniki, 54124 Thessaloniki, Greece
| | - Athanasios D. Protogerou
- Cardiovascular Prevention and Research Unit, Department of Pathophysiology, National & Kapodistrian University of Athens, 15772 Athens, Greece
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Centre, 17674 Athens, Greece
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PL, UK
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA
| | | | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
| |
Collapse
|
9
|
Johri AM, Singh KV, Mantella LE, Saba L, Sharma A, Laird JR, Utkarsh K, Singh IM, Gupta S, Kalra MS, Suri JS. Deep learning artificial intelligence framework for multiclass coronary artery disease prediction using combination of conventional risk factors, carotid ultrasound, and intraplaque neovascularization. Comput Biol Med 2022; 150:106018. [PMID: 36174330 DOI: 10.1016/j.compbiomed.2022.106018] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Revised: 08/06/2022] [Accepted: 08/20/2022] [Indexed: 11/23/2022]
Abstract
OBJECTIVE Cardiovascular disease (CVD) is a major healthcare challenge and therefore early risk assessment is vital. Previous assessment techniques use either "conventional CVD risk calculators (CCVRC)" or machine learning (ML) paradigms. These techniques are ad-hoc, unreliable, not fully automated, and have variabilities. We, therefore, introduce AtheroEdge-MCDLAI (AE3.0DL) windows-based platform using multiclass Deep Learning (DL) system. METHODS Data was collected on 500 patients having both carotid ultrasound and corresponding coronary angiography scores (CAS), measured as stenosis in coronary arteries and considered as the gold standard. A total of 39 covariates were used, clubbed into three clusters, namely (i) Office-based: age, gender, body mass index, smoker, hypertension, systolic blood pressure, and diastolic blood pressure; (ii) Laboratory-based: Hyperlipidemia, hemoglobin A1c, and estimated glomerular filtration rate; and (iii) Carotid ultrasound image phenotypes: maximum plaque height, total plaque area, and intra-plaque neovascularization. Baseline characteristics for four classes (target labels) having significant (p < 0.0001) values were calculated using Chi-square and ANOVA. For handling the cohort's imbalance in the risk classes, AE3.0DL used the synthetic minority over-sampling technique (SMOTE). AE3.0DL used Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) DL models and the performance (accuracy and area-under-the-curve) was computed using 10-fold cross-validation (90% training, 10% testing) frameworks. AE3.0DL was validated and benchmarked. RESULTS The AE3.0DL using RNN and LSTM showed an accuracy and AUC (p < 0.0001) pairs as (95.00% and 0.98), and (95.34% and 0.99), respectively, and showed an improvement of 32.93% and 9.94% against CCVRC and ML, respectively. AE3.0DL runs in <1 s. CONCLUSION DL algorithms are a powerful paradigm for coronary artery disease (CAD) risk prediction and CVD risk stratification.
Collapse
Affiliation(s)
- Amer M Johri
- Department of Medicine, Division of Cardiology, Queen's University, Kingston, ON, Canada
| | | | - Laura E Mantella
- Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA, USA
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | | | | | - Suneet Gupta
- Department of Computer Science, Bennett University, Gr. Noida, India
| | - Manudeep S Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA, 02114, USA
| | - Jasjit S Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, USA; Knowledge Engineering Center, Global Biomedical Technologies, Inc., Roseville, CA, USA.
| |
Collapse
|
10
|
Far wall plaque segmentation and area measurement in common and internal carotid artery ultrasound using U-series architectures: An unseen Artificial Intelligence paradigm for stroke risk assessment. Comput Biol Med 2022; 149:106017. [DOI: 10.1016/j.compbiomed.2022.106017] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Revised: 08/10/2022] [Accepted: 08/20/2022] [Indexed: 12/18/2022]
|
11
|
Jain PK, Dubey A, Saba L, Khanna NN, Laird JR, Nicolaides A, Fouda MM, Suri JS, Sharma N. Attention-Based UNet Deep Learning Model for Plaque Segmentation in Carotid Ultrasound for Stroke Risk Stratification: An Artificial Intelligence Paradigm. J Cardiovasc Dev Dis 2022; 9:326. [PMID: 36286278 PMCID: PMC9604424 DOI: 10.3390/jcdd9100326] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2022] [Revised: 09/06/2022] [Accepted: 09/14/2022] [Indexed: 11/17/2022] Open
Abstract
Stroke and cardiovascular diseases (CVD) significantly affect the world population. The early detection of such events may prevent the burden of death and costly surgery. Conventional methods are neither automated nor clinically accurate. Artificial Intelligence-based methods of automatically detecting and predicting the severity of CVD and stroke in their early stages are of prime importance. This study proposes an attention-channel-based UNet deep learning (DL) model that identifies the carotid plaques in the internal carotid artery (ICA) and common carotid artery (CCA) images. Our experiments consist of 970 ICA images from the UK, 379 CCA images from diabetic Japanese patients, and 300 CCA images from post-menopausal women from Hong Kong. We combined both CCA images to form an integrated database of 679 images. A rotation transformation technique was applied to 679 CCA images, doubling the database for the experiments. The cross-validation K5 (80% training: 20% testing) protocol was applied for accuracy determination. The results of the Attention-UNet model are benchmarked against UNet, UNet++, and UNet3P models. Visual plaque segmentation showed improvement in the Attention-UNet results compared to the other three models. The correlation coefficient (CC) value for Attention-UNet is 0.96, compared to 0.93, 0.96, and 0.92 for UNet, UNet++, and UNet3P models. Similarly, the AUC value for Attention-UNet is 0.97, compared to 0.964, 0.966, and 0.965 for other models. Conclusively, the Attention-UNet model is beneficial in segmenting very bright and fuzzy plaque images that are hard to diagnose using other methods. Further, we present a multi-ethnic, multi-center, racial bias-free study of stroke risk assessment.
Collapse
Affiliation(s)
- Pankaj K. Jain
- School of Biomedical Engineering, Indian Institute of Technology (BHU), Varanasi 221005, India
| | - Abhishek Dubey
- School of Biomedical Engineering, Indian Institute of Technology (BHU), Varanasi 221005, India
- Department of Electronics and Communication, Shree Mata Vaishno Devi University, Jammu 182301, India
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09100 Cagliari, Italy
| | - Narender N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospital, New Delhi 110076, India
| | - John R. Laird
- Heart and Vascular Institute, Adventist Heath St. Helena, St. Helena, CA 94574, USA
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre and University of Nicosia Medical School, Nicosia 2409, Cyprus
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA
| | - Jasjit S. Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA
| | - Neeraj Sharma
- Department of Electronics and Communication, Shree Mata Vaishno Devi University, Jammu 182301, India
| |
Collapse
|
12
|
Jena B, Saxena S, Nayak GK, Balestrieri A, Gupta N, Khanna NN, Laird JR, Kalra MK, Fouda MM, Saba L, Suri JS. Brain Tumor Characterization Using Radiogenomics in Artificial Intelligence Framework. Cancers (Basel) 2022; 14:4052. [PMID: 36011048 PMCID: PMC9406706 DOI: 10.3390/cancers14164052] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Revised: 08/17/2022] [Accepted: 08/19/2022] [Indexed: 11/16/2022] Open
Abstract
Brain tumor characterization (BTC) is the process of knowing the underlying cause of brain tumors and their characteristics through various approaches such as tumor segmentation, classification, detection, and risk analysis. The substantial brain tumor characterization includes the identification of the molecular signature of various useful genomes whose alteration causes the brain tumor. The radiomics approach uses the radiological image for disease characterization by extracting quantitative radiomics features in the artificial intelligence (AI) environment. However, when considering a higher level of disease characteristics such as genetic information and mutation status, the combined study of "radiomics and genomics" has been considered under the umbrella of "radiogenomics". Furthermore, AI in a radiogenomics' environment offers benefits/advantages such as the finalized outcome of personalized treatment and individualized medicine. The proposed study summarizes the brain tumor's characterization in the prospect of an emerging field of research, i.e., radiomics and radiogenomics in an AI environment, with the help of statistical observation and risk-of-bias (RoB) analysis. The PRISMA search approach was used to find 121 relevant studies for the proposed review using IEEE, Google Scholar, PubMed, MDPI, and Scopus. Our findings indicate that both radiomics and radiogenomics have been successfully applied aggressively to several oncology applications with numerous advantages. Furthermore, under the AI paradigm, both the conventional and deep radiomics features have made an impact on the favorable outcomes of the radiogenomics approach of BTC. Furthermore, risk-of-bias (RoB) analysis offers a better understanding of the architectures with stronger benefits of AI by providing the bias involved in them.
Collapse
Affiliation(s)
- Biswajit Jena
- Department of CSE, International Institute of Information Technology, Bhubaneswar 751003, India
| | - Sanjay Saxena
- Department of CSE, International Institute of Information Technology, Bhubaneswar 751003, India
| | - Gopal Krishna Nayak
- Department of CSE, International Institute of Information Technology, Bhubaneswar 751003, India
| | | | - Neha Gupta
- Department of IT, Bharati Vidyapeeth’s College of Engineering, New Delhi 110056, India
| | - Narinder N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA
| | - Manudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA
| | - Luca Saba
- Department of Radiology, AOU, University of Cagliari, 09124 Cagliari, Italy
| | - Jasjit S. Suri
- Stroke Diagnosis and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA
| |
Collapse
|
13
|
Suri JS, Agarwal S, Saba L, Chabert GL, Carriero A, Paschè A, Danna P, Mehmedović A, Faa G, Jujaray T, Singh IM, Khanna NN, Laird JR, Sfikakis PP, Agarwal V, Teji JS, R Yadav R, Nagy F, Kincses ZT, Ruzsa Z, Viskovic K, Kalra MK. Multicenter Study on COVID-19 Lung Computed Tomography Segmentation with varying Glass Ground Opacities using Unseen Deep Learning Artificial Intelligence Paradigms: COVLIAS 1.0 Validation. J Med Syst 2022; 46:62. [PMID: 35988110 PMCID: PMC9392994 DOI: 10.1007/s10916-022-01850-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Accepted: 08/02/2022] [Indexed: 11/09/2022]
Abstract
Variations in COVID-19 lesions such as glass ground opacities (GGO), consolidations, and crazy paving can compromise the ability of solo-deep learning (SDL) or hybrid-deep learning (HDL) artificial intelligence (AI) models in predicting automated COVID-19 lung segmentation in Computed Tomography (CT) from unseen data leading to poor clinical manifestations. As the first study of its kind, “COVLIAS 1.0-Unseen” proves two hypotheses, (i) contrast adjustment is vital for AI, and (ii) HDL is superior to SDL. In a multicenter study, 10,000 CT slices were collected from 72 Italian (ITA) patients with low-GGO, and 80 Croatian (CRO) patients with high-GGO. Hounsfield Units (HU) were automatically adjusted to train the AI models and predict from test data, leading to four combinations—two Unseen sets: (i) train-CRO:test-ITA, (ii) train-ITA:test-CRO, and two Seen sets: (iii) train-CRO:test-CRO, (iv) train-ITA:test-ITA. COVILAS used three SDL models: PSPNet, SegNet, UNet and six HDL models: VGG-PSPNet, VGG-SegNet, VGG-UNet, ResNet-PSPNet, ResNet-SegNet, and ResNet-UNet. Two trained, blinded senior radiologists conducted ground truth annotations. Five types of performance metrics were used to validate COVLIAS 1.0-Unseen which was further benchmarked against MedSeg, an open-source web-based system. After HU adjustment for DS and JI, HDL (Unseen AI) > SDL (Unseen AI) by 4% and 5%, respectively. For CC, HDL (Unseen AI) > SDL (Unseen AI) by 6%. The COVLIAS-MedSeg difference was < 5%, meeting regulatory guidelines.Unseen AI was successfully demonstrated using automated HU adjustment. HDL was found to be superior to SDL.
Collapse
|
14
|
Khanna NN, Maindarkar M, Puvvula A, Paul S, Bhagawati M, Ahluwalia P, Ruzsa Z, Sharma A, Munjral S, Kolluri R, Krishnan PR, Singh IM, Laird JR, Fatemi M, Alizad A, Dhanjil SK, Saba L, Balestrieri A, Faa G, Paraskevas KI, Misra DP, Agarwal V, Sharma A, Teji J, Al-Maini M, Nicolaides A, Rathore V, Naidu S, Liblik K, Johri AM, Turk M, Sobel DW, Pareek G, Miner M, Viskovic K, Tsoulfas G, Protogerou AD, Mavrogeni S, Kitas GD, Fouda MM, Kalra MK, Suri JS. Vascular Implications of COVID-19: Role of Radiological Imaging, Artificial Intelligence, and Tissue Characterization: A Special Report. J Cardiovasc Dev Dis 2022; 9:jcdd9080268. [PMID: 36005433 PMCID: PMC9409845 DOI: 10.3390/jcdd9080268] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2022] [Revised: 07/30/2022] [Accepted: 08/09/2022] [Indexed: 12/15/2022] Open
Abstract
The SARS-CoV-2 virus has caused a pandemic, infecting nearly 80 million people worldwide, with mortality exceeding six million. The average survival span is just 14 days from the time the symptoms become aggressive. The present study delineates the deep-driven vascular damage in the pulmonary, renal, coronary, and carotid vessels due to SARS-CoV-2. This special report addresses an important gap in the literature in understanding (i) the pathophysiology of vascular damage and the role of medical imaging in the visualization of the damage caused by SARS-CoV-2, and (ii) further understanding the severity of COVID-19 using artificial intelligence (AI)-based tissue characterization (TC). PRISMA was used to select 296 studies for AI-based TC. Radiological imaging techniques such as magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound were selected for imaging of the vasculature infected by COVID-19. Four kinds of hypotheses are presented for showing the vascular damage in radiological images due to COVID-19. Three kinds of AI models, namely, machine learning, deep learning, and transfer learning, are used for TC. Further, the study presents recommendations for improving AI-based architectures for vascular studies. We conclude that the process of vascular damage due to COVID-19 has similarities across vessel types, even though it results in multi-organ dysfunction. Although the mortality rate is ~2% of those infected, the long-term effect of COVID-19 needs monitoring to avoid deaths. AI seems to be penetrating the health care industry at warp speed, and we expect to see an emerging role in patient care, reduce the mortality and morbidity rate.
Collapse
Affiliation(s)
- Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110001, India
| | - Mahesh Maindarkar
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India
| | - Anudeep Puvvula
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
- Annu’s Hospitals for Skin and Diabetes, Nellore 524101, India
| | - Sudip Paul
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India
| | - Mrinalini Bhagawati
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India
| | - Puneet Ahluwalia
- Max Institute of Cancer Care, Max Super Specialty Hospital, New Delhi 110017, India
| | - Zoltan Ruzsa
- Invasive Cardiology Division, Faculty of Medicine, University of Szeged, 6720 Szeged, Hungary
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22904, USA
| | - Smiksha Munjral
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
| | - Raghu Kolluri
- Ohio Health Heart and Vascular, Columbus, OH 43214, USA
| | | | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA 94574, USA
| | - Mostafa Fatemi
- Department of Physiology & Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA
| | - Azra Alizad
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA
| | - Surinder K. Dhanjil
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria, 40138 Cagliari, Italy
| | - Antonella Balestrieri
- Cardiovascular Prevention and Research Unit, Department of Pathophysiology, National & Kapodistrian University of Athens, 15772 Athens, Greece
| | - Gavino Faa
- Department of Pathology, Azienda Ospedaliero Universitaria, 09124 Cagliari, Italy
| | | | - Durga Prasanna Misra
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India
| | - Vikas Agarwal
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India
| | - Aman Sharma
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India
| | - Jagjit Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON L4Z 4C4, Canada
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre and University of Nicosia Medical School, 2408 Nicosia, Cyprus
| | - Vijay Rathore
- Nephrology Department, Kaiser Permanente, Sacramento, CA 95119, USA
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN 55812, USA
| | - Kiera Liblik
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Amer M. Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, 27753 Delmenhorst, Germany
| | - David W. Sobel
- Rheumatology Unit, National Kapodistrian University of Athens, 15772 Athens, Greece
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA
| | - Martin Miner
- Men’s Health Centre, Miriam Hospital Providence, Providence, RI 02906, USA
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, 10000 Zagreb, Croatia
| | - George Tsoulfas
- Department of Surgery, Aristoteleion University of Thessaloniki, 54124 Thessaloniki, Greece
| | - Athanasios D. Protogerou
- Cardiovascular Prevention and Research Unit, Department of Pathophysiology, National & Kapodistrian University of Athens, 15772 Athens, Greece
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Centre, 17674 Athens, Greece
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PL, UK
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA
| | - Manudeep K. Kalra
- Department of Radiology, Harvard Medical School, Boston, MA 02115, USA
| | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
- Correspondence: ; Tel.: +1-916-749-5628
| |
Collapse
|
15
|
Skandha SS, Agarwal M, Utkarsh K, Gupta SK, Koppula VK, Suri JS. A novel genetic algorithm-based approach for compression and acceleration of deep learning convolution neural network: an application in computer tomography lung cancer data. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07567-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
16
|
Stratification of risk of atherosclerotic plaque using Hu’s moment invariants of segmented ultrasonic images. BIOMED ENG-BIOMED TE 2022; 67:391-402. [DOI: 10.1515/bmt-2021-0044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2021] [Accepted: 06/21/2022] [Indexed: 11/15/2022]
Abstract
Abstract
Myocardial infarction is one of the major life-threatening diseases. The cause is atherosclerosis i.e. the occlusion of the coronary artery by deposition of plaque on its walls. The severity of plaque deposition in the artery depends on the characteristics of the plaque. Hence, the classification of the type of plaque is crucial for assessing the risk of atherosclerosis and predicting the chances of myocardial infarction. This paper proposes prediction of atherosclerotic risk by non-invasive ultrasound image segmentation and textural feature extraction. The intima-media complex is segmented using a snakes-based segmentation algorithm on the arterial wall in the ultrasound images. Then, the plaque is extracted from the segmented intima-media complex. The features of the plaque are obtained by computing Hu’s moment invariants. Visual pattern recognition independent of position, size, orientation and parallel projection could be done using these moment invariants. For the classification of the features of the plaque, an SVM classifier is used. The performance shows improvement in accuracy using lesser number of features than previous works. The reduction in feature size is achieved by incorporating segmentation in the pre-processing stage. Tenfold cross-validation protocol is used for training and testing the classifier. An accuracy of 97.9% is obtained with only two features. This proposed technique could work as an adjunct tool in quick decision-making for cardiologists and radiologists. The segmentation step introduced in the preprocessing stage improved the feature extraction technique. An improvement in performance is achieved with much less number of features.
Collapse
|
17
|
Agarwal M, Agarwal S, Saba L, Chabert GL, Gupta S, Carriero A, Pasche A, Danna P, Mehmedovic A, Faa G, Shrivastava S, Jain K, Jain H, Jujaray T, Singh IM, Turk M, Chadha PS, Johri AM, Khanna NN, Mavrogeni S, Laird JR, Sobel DW, Miner M, Balestrieri A, Sfikakis PP, Tsoulfas G, Misra DP, Agarwal V, Kitas GD, Teji JS, Al-Maini M, Dhanjil SK, Nicolaides A, Sharma A, Rathore V, Fatemi M, Alizad A, Krishnan PR, Yadav RR, Nagy F, Kincses ZT, Ruzsa Z, Naidu S, Viskovic K, Kalra MK, Suri JS. Eight pruning deep learning models for low storage and high-speed COVID-19 computed tomography lung segmentation and heatmap-based lesion localization: A multicenter study using COVLIAS 2.0. Comput Biol Med 2022; 146:105571. [PMID: 35751196 PMCID: PMC9123805 DOI: 10.1016/j.compbiomed.2022.105571] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Revised: 04/05/2022] [Accepted: 04/26/2022] [Indexed: 12/12/2022]
Abstract
BACKGROUND COVLIAS 1.0: an automated lung segmentation was designed for COVID-19 diagnosis. It has issues related to storage space and speed. This study shows that COVLIAS 2.0 uses pruned AI (PAI) networks for improving both storage and speed, wiliest high performance on lung segmentation and lesion localization. METHOD ology: The proposed study uses multicenter ∼9,000 CT slices from two different nations, namely, CroMed from Croatia (80 patients, experimental data), and NovMed from Italy (72 patients, validation data). We hypothesize that by using pruning and evolutionary optimization algorithms, the size of the AI models can be reduced significantly, ensuring optimal performance. Eight different pruning techniques (i) differential evolution (DE), (ii) genetic algorithm (GA), (iii) particle swarm optimization algorithm (PSO), and (iv) whale optimization algorithm (WO) in two deep learning frameworks (i) Fully connected network (FCN) and (ii) SegNet were designed. COVLIAS 2.0 was validated using "Unseen NovMed" and benchmarked against MedSeg. Statistical tests for stability and reliability were also conducted. RESULTS Pruning algorithms (i) FCN-DE, (ii) FCN-GA, (iii) FCN-PSO, and (iv) FCN-WO showed improvement in storage by 92.4%, 95.3%, 98.7%, and 99.8% respectively when compared against solo FCN, and (v) SegNet-DE, (vi) SegNet-GA, (vii) SegNet-PSO, and (viii) SegNet-WO showed improvement by 97.1%, 97.9%, 98.8%, and 99.2% respectively when compared against solo SegNet. AUC > 0.94 (p < 0.0001) on CroMed and > 0.86 (p < 0.0001) on NovMed data set for all eight EA model. PAI <0.25 s per image. DenseNet-121-based Grad-CAM heatmaps showed validation on glass ground opacity lesions. CONCLUSIONS Eight PAI networks that were successfully validated are five times faster, storage efficient, and could be used in clinical settings.
Collapse
Affiliation(s)
- Mohit Agarwal
- Department of Computer Science Engineering, Bennett University, India
| | - Sushant Agarwal
- Department of Computer Science Engineering, PSIT, Kanpur, India; Advanced Knowledge Engineering Centre, Global Biomedical Technologies, Inc., Roseville, CA 95661, USA
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Gian Luca Chabert
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Suneet Gupta
- Department of Computer Science Engineering, Bennett University, India
| | - Alessandro Carriero
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Alessio Pasche
- Depart of Radiology, "Maggiore della Carità" Hospital, University of Piemonte Orientale, Via Solaroli 17, 28100, Novara, Italy
| | - Pietro Danna
- Depart of Radiology, "Maggiore della Carità" Hospital, University of Piemonte Orientale, Via Solaroli 17, 28100, Novara, Italy
| | | | - Gavino Faa
- Department of Pathology - AOU of Cagliari, Italy
| | - Saurabh Shrivastava
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad, 244001, India
| | - Kanishka Jain
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad, 244001, India
| | - Harsh Jain
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad, 244001, India
| | - Tanay Jujaray
- Dept of Molecular, Cell and Developmental Biology, University of California, Santa Cruz, CA, USA
| | | | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, Delmenhorst, Germany
| | | | - Amer M Johri
- Division of Cardiology, Queen's University, Kingston, Ontario, Canada
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, Athens, Greece
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | - David W Sobel
- Minimally Invasive Urology Institute, Brown University, Providence, RI, USA
| | - Martin Miner
- Men's Health Center, Miriam Hospital Providence, Rhode Island, USA
| | - Antonella Balestrieri
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Greece
| | - George Tsoulfas
- Aristoteleion University of Thessaloniki, Thessaloniki, Greece
| | | | | | - George D Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK; Arthritis Research UK Epidemiology Unit, Manchester University, Manchester, UK
| | - Jagjit S Teji
- Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, USA
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, Canada
| | | | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre and Univ. of Nicosia Medical School, Cyprus
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA, USA
| | | | - Mostafa Fatemi
- Dept. of Physiology & Biomedical Engg., Mayo Clinic College of Medicine and Science, MN, USA
| | - Azra Alizad
- Dept. of Radiology, Mayo Clinic College of Medicine and Science, MN, USA
| | | | | | - Frence Nagy
- Department of Radiology, University of Szeged, 6725, Hungary
| | | | - Zoltan Ruzsa
- Invasive Cardiology Division, University of Szeged, Budapest, Hungary
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN, USA
| | | | - Manudeep K Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA, USA
| | - Jasjit S Suri
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad, 244001, India; Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, USA.
| |
Collapse
|
18
|
COVLIAS 2.0-cXAI: Cloud-Based Explainable Deep Learning System for COVID-19 Lesion Localization in Computed Tomography Scans. Diagnostics (Basel) 2022; 12:diagnostics12061482. [PMID: 35741292 PMCID: PMC9221733 DOI: 10.3390/diagnostics12061482] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2022] [Revised: 06/07/2022] [Accepted: 06/13/2022] [Indexed: 02/07/2023] Open
Abstract
Background: The previous COVID-19 lung diagnosis system lacks both scientific validation and the role of explainable artificial intelligence (AI) for understanding lesion localization. This study presents a cloud-based explainable AI, the “COVLIAS 2.0-cXAI” system using four kinds of class activation maps (CAM) models. Methodology: Our cohort consisted of ~6000 CT slices from two sources (Croatia, 80 COVID-19 patients and Italy, 15 control patients). COVLIAS 2.0-cXAI design consisted of three stages: (i) automated lung segmentation using hybrid deep learning ResNet-UNet model by automatic adjustment of Hounsfield units, hyperparameter optimization, and parallel and distributed training, (ii) classification using three kinds of DenseNet (DN) models (DN-121, DN-169, DN-201), and (iii) validation using four kinds of CAM visualization techniques: gradient-weighted class activation mapping (Grad-CAM), Grad-CAM++, score-weighted CAM (Score-CAM), and FasterScore-CAM. The COVLIAS 2.0-cXAI was validated by three trained senior radiologists for its stability and reliability. The Friedman test was also performed on the scores of the three radiologists. Results: The ResNet-UNet segmentation model resulted in dice similarity of 0.96, Jaccard index of 0.93, a correlation coefficient of 0.99, with a figure-of-merit of 95.99%, while the classifier accuracies for the three DN nets (DN-121, DN-169, and DN-201) were 98%, 98%, and 99% with a loss of ~0.003, ~0.0025, and ~0.002 using 50 epochs, respectively. The mean AUC for all three DN models was 0.99 (p < 0.0001). The COVLIAS 2.0-cXAI showed 80% scans for mean alignment index (MAI) between heatmaps and gold standard, a score of four out of five, establishing the system for clinical settings. Conclusions: The COVLIAS 2.0-cXAI successfully showed a cloud-based explainable AI system for lesion localization in lung CT scans.
Collapse
|
19
|
Role of Artificial Intelligence in Radiogenomics for Cancers in the Era of Precision Medicine. Cancers (Basel) 2022; 14:cancers14122860. [PMID: 35740526 PMCID: PMC9220825 DOI: 10.3390/cancers14122860] [Citation(s) in RCA: 29] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2022] [Revised: 06/03/2022] [Accepted: 06/07/2022] [Indexed: 12/12/2022] Open
Abstract
Simple Summary Recently, radiogenomics has played a significant role and offered a new understanding of cancer’s biology and behavior in response to standard therapy. It also provides a more precise prognosis, investigation, and analysis of the patient’s cancer. Over the years, Artificial Intelligence (AI) has provided a significant strength in radiogenomics. In this paper, we offer computational and oncological prospects of the role of AI in radiogenomics, as well as its offers, achievements, opportunities, and limitations in the current clinical practices. Abstract Radiogenomics, a combination of “Radiomics” and “Genomics,” using Artificial Intelligence (AI) has recently emerged as the state-of-the-art science in precision medicine, especially in oncology care. Radiogenomics syndicates large-scale quantifiable data extracted from radiological medical images enveloped with personalized genomic phenotypes. It fabricates a prediction model through various AI methods to stratify the risk of patients, monitor therapeutic approaches, and assess clinical outcomes. It has recently shown tremendous achievements in prognosis, treatment planning, survival prediction, heterogeneity analysis, reoccurrence, and progression-free survival for human cancer study. Although AI has shown immense performance in oncology care in various clinical aspects, it has several challenges and limitations. The proposed review provides an overview of radiogenomics with the viewpoints on the role of AI in terms of its promises for computational as well as oncological aspects and offers achievements and opportunities in the era of precision medicine. The review also presents various recommendations to diminish these obstacles.
Collapse
|
20
|
Suri JS, Agarwal S, Chabert GL, Carriero A, Paschè A, Danna PSC, Saba L, Mehmedović A, Faa G, Singh IM, Turk M, Chadha PS, Johri AM, Khanna NN, Mavrogeni S, Laird JR, Pareek G, Miner M, Sobel DW, Balestrieri A, Sfikakis PP, Tsoulfas G, Protogerou AD, Misra DP, Agarwal V, Kitas GD, Teji JS, Al-Maini M, Dhanjil SK, Nicolaides A, Sharma A, Rathore V, Fatemi M, Alizad A, Krishnan PR, Nagy F, Ruzsa Z, Fouda MM, Naidu S, Viskovic K, Kalra MK. COVLIAS 1.0 Lesion vs. MedSeg: An Artificial Intelligence Framework for Automated Lesion Segmentation in COVID-19 Lung Computed Tomography Scans. Diagnostics (Basel) 2022; 12:1283. [PMID: 35626438 PMCID: PMC9141749 DOI: 10.3390/diagnostics12051283] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2022] [Revised: 05/18/2022] [Accepted: 05/19/2022] [Indexed: 02/01/2023] Open
Abstract
Background: COVID-19 is a disease with multiple variants, and is quickly spreading throughout the world. It is crucial to identify patients who are suspected of having COVID-19 early, because the vaccine is not readily available in certain parts of the world. Methodology: Lung computed tomography (CT) imaging can be used to diagnose COVID-19 as an alternative to the RT-PCR test in some cases. The occurrence of ground-glass opacities in the lung region is a characteristic of COVID-19 in chest CT scans, and these are daunting to locate and segment manually. The proposed study consists of a combination of solo deep learning (DL) and hybrid DL (HDL) models to tackle the lesion location and segmentation more quickly. One DL and four HDL models—namely, PSPNet, VGG-SegNet, ResNet-SegNet, VGG-UNet, and ResNet-UNet—were trained by an expert radiologist. The training scheme adopted a fivefold cross-validation strategy on a cohort of 3000 images selected from a set of 40 COVID-19-positive individuals. Results: The proposed variability study uses tracings from two trained radiologists as part of the validation. Five artificial intelligence (AI) models were benchmarked against MedSeg. The best AI model, ResNet-UNet, was superior to MedSeg by 9% and 15% for Dice and Jaccard, respectively, when compared against MD 1, and by 4% and 8%, respectively, when compared against MD 2. Statistical tests—namely, the Mann−Whitney test, paired t-test, and Wilcoxon test—demonstrated its stability and reliability, with p < 0.0001. The online system for each slice was <1 s. Conclusions: The AI models reliably located and segmented COVID-19 lesions in CT scans. The COVLIAS 1.0Lesion lesion locator passed the intervariability test.
Collapse
Affiliation(s)
- Jasjit S. Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA 95661, USA;
| | - Sushant Agarwal
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA 95661, USA;
- Department of Computer Science Engineering, PSIT, Kanpur 209305, India
| | - Gian Luca Chabert
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (G.L.C.); (A.P.); (P.S.C.D.); (L.S.); (A.B.)
| | - Alessandro Carriero
- Department of Radiology, “Maggiore della Carità” Hospital, University of Piemonte Orientale (UPO), Via Solaroli 17, 28100 Novara, Italy;
| | - Alessio Paschè
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (G.L.C.); (A.P.); (P.S.C.D.); (L.S.); (A.B.)
| | - Pietro S. C. Danna
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (G.L.C.); (A.P.); (P.S.C.D.); (L.S.); (A.B.)
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (G.L.C.); (A.P.); (P.S.C.D.); (L.S.); (A.B.)
| | - Armin Mehmedović
- University Hospital for Infectious Diseases, 10000 Zagreb, Croatia; (A.M.); (K.V.)
| | - Gavino Faa
- Department of Pathology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy;
| | - Inder M. Singh
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, 27753 Delmenhorst, Germany;
| | - Paramjit S. Chadha
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
| | - Amer M. Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, 17674 Athens, Greece;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA 94574, USA;
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA; (G.P.); (D.W.S.)
| | - Martin Miner
- Men’s Health Center, Miriam Hospital, Providence, RI 02906, USA;
| | - David W. Sobel
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA; (G.P.); (D.W.S.)
| | - Antonella Balestrieri
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (G.L.C.); (A.P.); (P.S.C.D.); (L.S.); (A.B.)
| | - Petros P. Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, 15772 Athens, Greece;
| | - George Tsoulfas
- Department of Surgery, Aristoteleion University of Thessaloniki, 54124 Thessaloniki, Greece;
| | - Athanasios D. Protogerou
- Cardiovascular Prevention and Research Unit, Department of Pathophysiology, National & Kapodistrian University of Athens, 15772 Athens, Greece;
| | - Durga Prasanna Misra
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - Vikas Agarwal
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK;
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PL, UK
| | - Jagjit S. Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA;
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON L4Z 4C4, Canada;
| | | | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia Medical School, Nicosia 2408, Cyprus;
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22908, USA;
| | - Vijay Rathore
- AtheroPoint LLC, Roseville, CA 95661, USA; (S.K.D.); (V.R.)
| | - Mostafa Fatemi
- Department of Physiology and Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | - Azra Alizad
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | | | - Ferenc Nagy
- Internal Medicine Department, University of Szeged, 6725 Szeged, Hungary;
| | - Zoltan Ruzsa
- Invasive Cardiology Division, University of Szeged, 6725 Szeged, Hungary;
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA;
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN 55812, USA;
| | - Klaudija Viskovic
- University Hospital for Infectious Diseases, 10000 Zagreb, Croatia; (A.M.); (K.V.)
| | - Manudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA;
| |
Collapse
|
21
|
Khanna NN, Maindarkar M, Saxena A, Ahluwalia P, Paul S, Srivastava SK, Cuadrado-Godia E, Sharma A, Omerzu T, Saba L, Mavrogeni S, Turk M, Laird JR, Kitas GD, Fatemi M, Barqawi AB, Miner M, Singh IM, Johri A, Kalra MM, Agarwal V, Paraskevas KI, Teji JS, Fouda MM, Pareek G, Suri JS. Cardiovascular/Stroke Risk Assessment in Patients with Erectile Dysfunction-A Role of Carotid Wall Arterial Imaging and Plaque Tissue Characterization Using Artificial Intelligence Paradigm: A Narrative Review. Diagnostics (Basel) 2022; 12:1249. [PMID: 35626404 PMCID: PMC9141739 DOI: 10.3390/diagnostics12051249] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 05/14/2022] [Accepted: 05/15/2022] [Indexed: 12/12/2022] Open
Abstract
PURPOSE The role of erectile dysfunction (ED) has recently shown an association with the risk of stroke and coronary heart disease (CHD) via the atherosclerotic pathway. Cardiovascular disease (CVD)/stroke risk has been widely understood with the help of carotid artery disease (CTAD), a surrogate biomarker for CHD. The proposed study emphasizes artificial intelligence-based frameworks such as machine learning (ML) and deep learning (DL) that can accurately predict the severity of CVD/stroke risk using carotid wall arterial imaging in ED patients. METHODS Using the PRISMA model, 231 of the best studies were selected. The proposed study mainly consists of two components: (i) the pathophysiology of ED and its link with coronary artery disease (COAD) and CHD in the ED framework and (ii) the ultrasonic-image morphological changes in the carotid arterial walls by quantifying the wall parameters and the characterization of the wall tissue by adapting the ML/DL-based methods, both for the prediction of the severity of CVD risk. The proposed study analyzes the hypothesis that ML/DL can lead to an accurate and early diagnosis of the CVD/stroke risk in ED patients. Our finding suggests that the routine ED patient practice can be amended for ML/DL-based CVD/stroke risk assessment using carotid wall arterial imaging leading to fast, reliable, and accurate CVD/stroke risk stratification. SUMMARY We conclude that ML and DL methods are very powerful tools for the characterization of CVD/stroke in patients with varying ED conditions. We anticipate a rapid growth of these tools for early and better CVD/stroke risk management in ED patients.
Collapse
Affiliation(s)
- Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - Mahesh Maindarkar
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (M.M.); (S.P.)
- Stroke Monitoring and Diagnostic Division, AtheroPoint, Roseville, CA 95661, USA;
| | - Ajit Saxena
- Department of Urology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - Puneet Ahluwalia
- Max Institute of Cancer Care, Max Super Specialty Hospital, New Delhi 110017, India;
| | - Sudip Paul
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (M.M.); (S.P.)
| | - Saurabh K. Srivastava
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad 244001, India;
| | - Elisa Cuadrado-Godia
- Department of Neurology, Hospital del Mar Medical Research Institute, 08003 Barcelona, Spain;
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22908, USA;
| | - Tomaz Omerzu
- Department of Neurology, University Medical Centre Maribor, 2000 Maribor, Slovenia; (T.O.); (M.T.)
| | - Luca Saba
- Department of Radiology, University of Cagliari, 09124 Cagliari, Italy;
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Centre, 176 74 Athens, Greece;
| | - Monika Turk
- Department of Neurology, University Medical Centre Maribor, 2000 Maribor, Slovenia; (T.O.); (M.T.)
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA;
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK;
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PL, UK
| | - Mostafa Fatemi
- Department of Physiology & Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, NY 55905, USA;
| | - Al Baha Barqawi
- Division of Urology, Department of Surgery, University of Colorado Anschutz Medical Campus, Aurora, CO 80045, USA;
| | - Martin Miner
- Men’s Health Centre, Miriam Hospital Providence, Providence, RI 02906, USA;
| | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint, Roseville, CA 95661, USA;
| | - Amer Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | | | - Vikas Agarwal
- Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India;
| | - Kosmas I. Paraskevas
- Department of Vascular Surgery, Central Clinic of Athens, 106 80 Athens, Greece;
| | - Jagjit S. Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA;
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA;
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA;
| | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint, Roseville, CA 95661, USA;
| |
Collapse
|
22
|
Suri JS, Paul S, Maindarkar MA, Puvvula A, Saxena S, Saba L, Turk M, Laird JR, Khanna NN, Viskovic K, Singh IM, Kalra M, Krishnan PR, Johri A, Paraskevas KI. Cardiovascular/Stroke Risk Stratification in Parkinson's Disease Patients Using Atherosclerosis Pathway and Artificial Intelligence Paradigm: A Systematic Review. Metabolites 2022; 12:metabo12040312. [PMID: 35448500 PMCID: PMC9033076 DOI: 10.3390/metabo12040312] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Revised: 03/25/2022] [Accepted: 03/29/2022] [Indexed: 12/20/2022] Open
Abstract
Parkinson’s disease (PD) is a severe, incurable, and costly condition leading to heart failure. The link between PD and cardiovascular disease (CVD) is not available, leading to controversies and poor prognosis. Artificial Intelligence (AI) has already shown promise for CVD/stroke risk stratification. However, due to a lack of sample size, comorbidity, insufficient validation, clinical examination, and a lack of big data configuration, there have been no well-explained bias-free AI investigations to establish the CVD/Stroke risk stratification in the PD framework. The study has two objectives: (i) to establish a solid link between PD and CVD/stroke; and (ii) to use the AI paradigm to examine a well-defined CVD/stroke risk stratification in the PD framework. The PRISMA search strategy selected 223 studies for CVD/stroke risk, of which 54 and 44 studies were related to the link between PD-CVD, and PD-stroke, respectively, 59 studies for joint PD-CVD-Stroke framework, and 66 studies were only for the early PD diagnosis without CVD/stroke link. Sequential biological links were used for establishing the hypothesis. For AI design, PD risk factors as covariates along with CVD/stroke as the gold standard were used for predicting the CVD/stroke risk. The most fundamental cause of CVD/stroke damage due to PD is cardiac autonomic dysfunction due to neurodegeneration that leads to heart failure and its edema, and this validated our hypothesis. Finally, we present the novel AI solutions for CVD/stroke risk prediction in the PD framework. The study also recommends strategies for removing the bias in AI for CVD/stroke risk prediction using the PD framework.
Collapse
Affiliation(s)
- Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (A.P.); (I.M.S.)
- Correspondence: ; Tel.: +1-(916)-749-5628
| | - Sudip Paul
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (S.P.); (M.A.M.)
| | - Maheshrao A. Maindarkar
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (S.P.); (M.A.M.)
| | - Anudeep Puvvula
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (A.P.); (I.M.S.)
- Annu’s Hospitals for Skin & Diabetes, Gudur 524101, India
| | - Sanjay Saxena
- Department of CSE, International Institute of Information Technology, Bhuneshwar 751003, India;
| | - Luca Saba
- Department of Radiology, University of Cagliari, 09121 Cagliari, Italy;
| | - Monika Turk
- Deparment of Neurology, University Medical Centre Maribor, 1262 Maribor, Slovenia;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110001, India;
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, 10000 Zagreb, Croatia;
| | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (A.P.); (I.M.S.)
| | - Mannudeep Kalra
- Department of Radiology, Harvard Medical School, Boston, MA 02115, USA;
| | | | - Amer Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | - Kosmas I. Paraskevas
- Department of Vascular Surgery, Central Clinic of Athens, 106 80 Athens, Greece;
| |
Collapse
|
23
|
Suri JS, Bhagawati M, Paul S, Protogeron A, Sfikakis PP, Kitas GD, Khanna NN, Ruzsa Z, Sharma AM, Saxena S, Faa G, Paraskevas KI, Laird JR, Johri AM, Saba L, Kalra M. Understanding the bias in machine learning systems for cardiovascular disease risk assessment: The first of its kind review. Comput Biol Med 2022; 142:105204. [DOI: 10.1016/j.compbiomed.2021.105204] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2021] [Revised: 12/29/2021] [Accepted: 12/29/2021] [Indexed: 02/09/2023]
|
24
|
Konstantonis G, Singh KV, Sfikakis PP, Jamthikar AD, Kitas GD, Gupta SK, Saba L, Verrou K, Khanna NN, Ruzsa Z, Sharma AM, Laird JR, Johri AM, Kalra M, Protogerou A, Suri JS. Cardiovascular disease detection using machine learning and carotid/femoral arterial imaging frameworks in rheumatoid arthritis patients. Rheumatol Int 2022; 42:215-239. [PMID: 35013839 DOI: 10.1007/s00296-021-05062-4] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Accepted: 11/29/2021] [Indexed: 12/31/2022]
Abstract
The study proposes a novel machine learning (ML) paradigm for cardiovascular disease (CVD) detection in individuals at medium to high cardiovascular risk using data from a Greek cohort of 542 individuals with rheumatoid arthritis, or diabetes mellitus, and/or arterial hypertension, using conventional or office-based, laboratory-based blood biomarkers and carotid/femoral ultrasound image-based phenotypes. Two kinds of data (CVD risk factors and presence of CVD-defined as stroke, or myocardial infarction, or coronary artery syndrome, or peripheral artery disease, or coronary heart disease) as ground truth, were collected at two-time points: (i) at visit 1 and (ii) at visit 2 after 3 years. The CVD risk factors were divided into three clusters (conventional or office-based, laboratory-based blood biomarkers, carotid ultrasound image-based phenotypes) to study their effect on the ML classifiers. Three kinds of ML classifiers (Random Forest, Support Vector Machine, and Linear Discriminant Analysis) were applied in a two-fold cross-validation framework using the data augmented by synthetic minority over-sampling technique (SMOTE) strategy. The performance of the ML classifiers was recorded. In this cohort with overall 46 CVD risk factors (covariates) implemented in an online cardiovascular framework, that requires calculation time less than 1 s per patient, a mean accuracy and area-under-the-curve (AUC) of 98.40% and 0.98 (p < 0.0001) for CVD presence detection at visit 1, and 98.39% and 0.98 (p < 0.0001) at visit 2, respectively. The performance of the cardiovascular framework was significantly better than the classical CVD risk score. The ML paradigm proved to be powerful for CVD prediction in individuals at medium to high cardiovascular risk.
Collapse
Affiliation(s)
- George Konstantonis
- Rheumatology Unit, National Kapodistrian University of Athens, Athens, Greece
| | | | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Athens, Greece
| | - Ankush D Jamthikar
- Research Scientist, AtheroPoint™, USA, Roseville, CA, USA.,Visvesvaraya National Institute of Technology, Nagpur, India
| | - George D Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK.,Arthritis Research UK Epidemiology Unit, Manchester University, Manchester, M13, UK
| | - Suneet K Gupta
- Department of Computer Science, Bennett University, Gr. Noida, India
| | - Luca Saba
- Department of Radiology, University of Cagliari, Cagliari, Italy
| | - Kleio Verrou
- Department of Medicine, National and Kapodistrian University of Athens, Athens, Greece
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha Apollo Hospitals, New Delhi, India
| | - Zoltan Ruzsa
- Department of Internal Medicines, Invasive Cardiology Division, University of Szeged, Szeged, Hungary
| | - Aditya M Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA, USA
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | - Amer M Johri
- Department of Medicine, Division of Cardiology, Queen's University, Kingston, ON, Canada
| | - Manudeep Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA, USA
| | - Athanasios Protogerou
- Cardiovascular Prevention Unit, Department of Pathophysiology, National Kapodistrian University of Athens, Athens, Greece
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, 95661, USA.
| |
Collapse
|
25
|
Corrias G, Micheletti G, Barberini L, Suri JS, Saba L. Texture analysis imaging "what a clinical radiologist needs to know". Eur J Radiol 2021; 146:110055. [PMID: 34902669 DOI: 10.1016/j.ejrad.2021.110055] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2020] [Revised: 04/09/2021] [Accepted: 11/15/2021] [Indexed: 02/07/2023]
Abstract
Texture analysis has arisen as a tool to explore the amount of data contained in images that cannot be explored by humans visually. Radiomics is a method that extracts a large number of features from radiographic medical images using data-characterisation algorithms. These features, termed radiomic features, have the potential to uncover disease characteristics. The goal of both radiomics and texture analysis is to go beyond size or human-eye based semantic descriptors, to enable the non-invasive extraction of quantitative radiological data to correlate them with clinical outcomes or pathological characteristics. In the latest years there has been a flourishing sub-field of radiology where texture analysis and radiomics have been used in many settings. It is difficult for the clinical radiologist to cope with such amount of data in all the different radiological sub-fields and to identify the most significant papers. The aim of this review is to provide a tool to better understand the basic principles underlining texture analysis and radiological data mining and a summary of the most significant papers of the latest years.
Collapse
Affiliation(s)
| | | | | | - Jasjit S Suri
- Stroke Diagnosis and Monitoring Division, AtheroPoint™, Roseville, CA, USA and Knowledge Engineering Center, Global Biomedical Technologies, Inc, Roseville, CA, USA
| | - Luca Saba
- Department of Radiology, University of Cagliari, Italy.
| |
Collapse
|
26
|
Sanagala SS, Nicolaides A, Gupta SK, Koppula VK, Saba L, Agarwal S, Johri AM, Kalra MS, Suri JS. Ten Fast Transfer Learning Models for Carotid Ultrasound Plaque Tissue Characterization in Augmentation Framework Embedded with Heatmaps for Stroke Risk Stratification. Diagnostics (Basel) 2021; 11:2109. [PMID: 34829456 PMCID: PMC8622690 DOI: 10.3390/diagnostics11112109] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Revised: 11/03/2021] [Accepted: 11/09/2021] [Indexed: 12/24/2022] Open
Abstract
Background and Purpose: Only 1-2% of the internal carotid artery asymptomatic plaques are unstable as a result of >80% stenosis. Thus, unnecessary efforts can be saved if these plaques can be characterized and classified into symptomatic and asymptomatic using non-invasive B-mode ultrasound. Earlier plaque tissue characterization (PTC) methods were machine learning (ML)-based, which used hand-crafted features that yielded lower accuracy and unreliability. The proposed study shows the role of transfer learning (TL)-based deep learning models for PTC. Methods: As pertained weights were used in the supercomputer framework, we hypothesize that transfer learning (TL) provides improved performance compared with deep learning. We applied 11 kinds of artificial intelligence (AI) models, 10 of them were augmented and optimized using TL approaches-a class of Atheromatic™ 2.0 TL (AtheroPoint™, Roseville, CA, USA) that consisted of (i-ii) Visual Geometric Group-16, 19 (VGG16, 19); (iii) Inception V3 (IV3); (iv-v) DenseNet121, 169; (vi) XceptionNet; (vii) ResNet50; (viii) MobileNet; (ix) AlexNet; (x) SqueezeNet; and one DL-based (xi) SuriNet-derived from UNet. We benchmark 11 AI models against our earlier deep convolutional neural network (DCNN) model. Results: The best performing TL was MobileNet, with accuracy and area-under-the-curve (AUC) pairs of 96.10 ± 3% and 0.961 (p < 0.0001), respectively. In DL, DCNN was comparable to SuriNet, with an accuracy of 95.66% and 92.7 ± 5.66%, and an AUC of 0.956 (p < 0.0001) and 0.927 (p < 0.0001), respectively. We validated the performance of the AI architectures with established biomarkers such as greyscale median (GSM), fractal dimension (FD), higher-order spectra (HOS), and visual heatmaps. We benchmarked against previously developed Atheromatic™ 1.0 ML and showed an improvement of 12.9%. Conclusions: TL is a powerful AI tool for PTC into symptomatic and asymptomatic plaques.
Collapse
Affiliation(s)
- Skandha S. Sanagala
- CSE Department, CMR College of Engineering & Technology, Hyderabad 501401, TS, India; (S.S.S.); (V.K.K.)
- CSE Department, Bennett University, Greater Noida 203206, UP, India;
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia, Nicosia 1700, Cyprus;
| | - Suneet K. Gupta
- CSE Department, Bennett University, Greater Noida 203206, UP, India;
| | - Vijaya K. Koppula
- CSE Department, CMR College of Engineering & Technology, Hyderabad 501401, TS, India; (S.S.S.); (V.K.K.)
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 10015 Cagliari, Italy;
| | | | - Amer M. Johri
- Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | - Manudeep S. Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA;
| | - Jasjit S. Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™ LLC, Roseville, CA 95661, USA
| |
Collapse
|
27
|
Suri JS, Agarwal S, Elavarthi P, Pathak R, Ketireddy V, Columbu M, Saba L, Gupta SK, Faa G, Singh IM, Turk M, Chadha PS, Johri AM, Khanna NN, Viskovic K, Mavrogeni S, Laird JR, Pareek G, Miner M, Sobel DW, Balestrieri A, Sfikakis PP, Tsoulfas G, Protogerou A, Misra DP, Agarwal V, Kitas GD, Teji JS, Al-Maini M, Dhanjil SK, Nicolaides A, Sharma A, Rathore V, Fatemi M, Alizad A, Krishnan PR, Ferenc N, Ruzsa Z, Gupta A, Naidu S, Kalra MK. Inter-Variability Study of COVLIAS 1.0: Hybrid Deep Learning Models for COVID-19 Lung Segmentation in Computed Tomography. Diagnostics (Basel) 2021; 11:2025. [PMID: 34829372 PMCID: PMC8625039 DOI: 10.3390/diagnostics11112025] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Revised: 10/26/2021] [Accepted: 10/27/2021] [Indexed: 02/05/2023] Open
Abstract
Background: For COVID-19 lung severity, segmentation of lungs on computed tomography (CT) is the first crucial step. Current deep learning (DL)-based Artificial Intelligence (AI) models have a bias in the training stage of segmentation because only one set of ground truth (GT) annotations are evaluated. We propose a robust and stable inter-variability analysis of CT lung segmentation in COVID-19 to avoid the effect of bias. Methodology: The proposed inter-variability study consists of two GT tracers for lung segmentation on chest CT. Three AI models, PSP Net, VGG-SegNet, and ResNet-SegNet, were trained using GT annotations. We hypothesized that if AI models are trained on the GT tracings from multiple experience levels, and if the AI performance on the test data between these AI models is within the 5% range, one can consider such an AI model robust and unbiased. The K5 protocol (training to testing: 80%:20%) was adapted. Ten kinds of metrics were used for performance evaluation. Results: The database consisted of 5000 CT chest images from 72 COVID-19-infected patients. By computing the coefficient of correlations (CC) between the output of the two AI models trained corresponding to the two GT tracers, computing their differences in their CC, and repeating the process for all three AI-models, we show the differences as 0%, 0.51%, and 2.04% (all < 5%), thereby validating the hypothesis. The performance was comparable; however, it had the following order: ResNet-SegNet > PSP Net > VGG-SegNet. Conclusions: The AI models were clinically robust and stable during the inter-variability analysis on the CT lung segmentation on COVID-19 patients.
Collapse
Affiliation(s)
- Jasjit S. Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA 95661, USA; (S.A.); (P.E.)
| | - Sushant Agarwal
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA 95661, USA; (S.A.); (P.E.)
- Department of Computer Science Engineering, PSIT, Kanpur 209305, India
| | - Pranav Elavarthi
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA 95661, USA; (S.A.); (P.E.)
- Thomas Jefferson High School for Science and Technology, Alexandria, VA 22312, USA
| | - Rajesh Pathak
- Department of Computer Science Engineering, Rawatpura Sarkar University, Raipur 492001, India;
| | | | - Marta Columbu
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 10015 Cagliari, Italy; (M.C.); (L.S.); (A.B.)
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 10015 Cagliari, Italy; (M.C.); (L.S.); (A.B.)
| | - Suneet K. Gupta
- Department of Computer Science, Bennett University, Noida 201310, India;
| | - Gavino Faa
- Department of Pathology, Azienda Ospedaliero Universitaria (A.O.U.), 10015 Cagliari, Italy;
| | - Inder M. Singh
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, 27753 Delmenhorst, Germany;
| | - Paramjit S. Chadha
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
| | - Amer M. Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | | | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, 10558 Athens, Greece;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA;
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA; (G.P.); (D.W.S.)
| | - Martin Miner
- Men’s Health Center, Miriam Hospital, Providence, RI 02906, USA;
| | - David W. Sobel
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA; (G.P.); (D.W.S.)
| | - Antonella Balestrieri
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 10015 Cagliari, Italy; (M.C.); (L.S.); (A.B.)
| | - Petros P. Sfikakis
- Rheumatology Unit, National & Kapodistrian University of Athens, 10679 Athens, Greece;
| | - George Tsoulfas
- Aristoteleion University of Thessaloniki, 54636 Thessaloniki, Greece;
| | | | - Durga Prasanna Misra
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - Vikas Agarwal
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK;
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PT, UK
| | - Jagjit S. Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA;
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON L4Z 4C4, Canada;
| | | | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia Medical School, Nicosia 2368, Cyprus;
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22904, USA;
| | - Vijay Rathore
- AtheroPoint LLC, Roseville, CA 95611, USA; (S.K.D.); (V.R.)
| | - Mostafa Fatemi
- Department of Physiology & Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | - Azra Alizad
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | | | - Nagy Ferenc
- Internal Medicine Department, University of Szeged, 6725 Szeged, Hungary;
| | - Zoltan Ruzsa
- Zoltan Invasive Cardiology Division, University of Szeged, 6725 Szeged, Hungary;
| | - Archna Gupta
- Radiology Department, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India;
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN 55812, USA;
| | - Mannudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA;
| |
Collapse
|
28
|
Jain PK, Sharma N, Giannopoulos AA, Saba L, Nicolaides A, Suri JS. Hybrid deep learning segmentation models for atherosclerotic plaque in internal carotid artery B-mode ultrasound. Comput Biol Med 2021; 136:104721. [PMID: 34371320 DOI: 10.1016/j.compbiomed.2021.104721] [Citation(s) in RCA: 52] [Impact Index Per Article: 17.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Revised: 07/26/2021] [Accepted: 07/27/2021] [Indexed: 12/18/2022]
Abstract
The automated and accurate carotid plaque segmentation in B-mode ultrasound (US) is an essential part of stroke risk stratification. Previous segmented methods used AtheroEdge™ 2.0 (AtheroPoint™, Roseville, CA) for the common carotid artery (CCA). This study focuses on automated plaque segmentation in the internal carotid artery (ICA) using solo deep learning (SDL) and hybrid deep learning (HDL) models. The methodology consists of a novel design of 10 types of SDL/HDL models (AtheroEdge™ 3.0 systems (AtheroPoint™, Roseville, CA) with a depth of four layers each. Five of the models use cross-entropy (CE)-loss, and the other five models use Dice similarity coefficient (DSC)-loss functions derived from UNet, UNet+, SegNet, SegNet-UNet, and SegNet-UNet+. The K10 protocol (Train:Test:90%:10%) was applied for all 10 models for training and predicting (segmenting) the plaque region, which was then quantified to compute the plaque area in mm2. Further, the data augmentation effect was analyzed. The database consisted of 970 ICA B-mode US scans taken from 99 moderate to high-risk patients. Using the difference area threshold of 10 mm2 between ground truth (GT) and artificial intelligence (AI), the area under the curve (AUC) values were 0.91, 0.911, 0.908, 0.905, and 0.898, all with a p-value of <0.001 (for CE-loss models) and 0.883, 0.889, 0.905, 0.889, and 0.907, all with a p-value of <0.001 (for DSC-loss models). The correlations between the AI-based plaque area and GT plaque area were 0.98, 0.96, 0.97, 0.98, and 0.97, all with a p-value of <0.001 (for CE-loss models) and 0.98, 0.98, 0.97, 0.98, and 0.98 (for DSC-loss models). Overall, the online system performs plaque segmentation in less than 1 s. We validate our hypothesis that HDL and SDL models demonstrate comparable performance. SegNet-UNet was the best-performing hybrid architecture.
Collapse
Affiliation(s)
| | | | | | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia, Nicosia, Cyprus
| | - Jasjit S Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, USA.
| |
Collapse
|
29
|
Saba L, Sanagala SS, Gupta SK, Koppula VK, Johri AM, Khanna NN, Mavrogeni S, Laird JR, Pareek G, Miner M, Sfikakis PP, Protogerou A, Misra DP, Agarwal V, Sharma AM, Viswanathan V, Rathore VS, Turk M, Kolluri R, Viskovic K, Cuadrado-Godia E, Kitas GD, Sharma N, Nicolaides A, Suri JS. Multimodality carotid plaque tissue characterization and classification in the artificial intelligence paradigm: a narrative review for stroke application. ANNALS OF TRANSLATIONAL MEDICINE 2021; 9:1206. [PMID: 34430647 PMCID: PMC8350643 DOI: 10.21037/atm-20-7676] [Citation(s) in RCA: 36] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Accepted: 02/25/2021] [Indexed: 12/12/2022]
Abstract
Cardiovascular disease (CVD) is one of the leading causes of morbidity and mortality in the United States of America and globally. Carotid arterial plaque, a cause and also a marker of such CVD, can be detected by various non-invasive imaging modalities such as magnetic resonance imaging (MRI), computer tomography (CT), and ultrasound (US). Characterization and classification of carotid plaque-type in these imaging modalities, especially into symptomatic and asymptomatic plaque, helps in the planning of carotid endarterectomy or stenting. It can be challenging to characterize plaque components due to (I) partial volume effect in magnetic resonance imaging (MRI) or (II) varying Hausdorff values in plaque regions in CT, and (III) attenuation of echoes reflected by the plaque during US causing acoustic shadowing. Artificial intelligence (AI) methods have become an indispensable part of healthcare and their applications to the non-invasive imaging technologies such as MRI, CT, and the US. In this narrative review, three main types of AI models (machine learning, deep learning, and transfer learning) are analyzed when applied to MRI, CT, and the US. A link between carotid plaque characteristics and the risk of coronary artery disease is presented. With regard to characterization, we review tools and techniques that use AI models to distinguish carotid plaque types based on signal processing and feature strengths. We conclude that AI-based solutions offer an accurate and robust path for tissue characterization and classification for carotid artery plaque imaging in all three imaging modalities. Due to cost, user-friendliness, and clinical effectiveness, AI in the US has dominated the most.
Collapse
Affiliation(s)
- Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (AOU), Cagliari, Italy
| | - Skandha S Sanagala
- CSE Department, CMR College of Engineering & Technology, Hyderabad, India.,CSE Department, Bennett University, Greater Noida, UP, India
| | - Suneet K Gupta
- CSE Department, Bennett University, Greater Noida, UP, India
| | - Vijaya K Koppula
- CSE Department, CMR College of Engineering & Technology, Hyderabad, India
| | - Amer M Johri
- Department of Medicine, Division of Cardiology, Queen's University, Kingston, Ontario, Canada
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, Athens, Greece
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, Rhode Island, USA
| | - Martin Miner
- Men's Health Center, Miriam Hospital Providence, Rhode Island, USA
| | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Greece
| | - Athanasios Protogerou
- Department of Cardiovascular Prevention, National and Kapodistrian University of Athens, Athens, Greece
| | - Durga P Misra
- Department of Clinical Immunology and Rheumatology, SGPGIMS, Lucknow, India
| | - Vikas Agarwal
- Department of Clinical Immunology and Rheumatology, SGPGIMS, Lucknow, India
| | - Aditya M Sharma
- Division of Cardiovascular Medicine, University of Virginia, VA, USA
| | - Vijay Viswanathan
- MV Hospital for Diabetes & Professor M Viswanathan Diabetes Research Centre, Chennai, India
| | - Vijay S Rathore
- Nephrology Department, Kaiser Permanente, Sacramento, CA, USA
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, Delmenhorst, Germany
| | | | | | | | - George D Kitas
- R & D Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK
| | - Neeraj Sharma
- Department of Biomedical Engineering, IIT-BHU, Banaras, UP, India
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia, Nicosia, Cyprus
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA
| |
Collapse
|
30
|
Agarwal M, Saba L, Gupta SK, Johri AM, Khanna NN, Mavrogeni S, Laird JR, Pareek G, Miner M, Sfikakis PP, Protogerou A, Sharma AM, Viswanathan V, Kitas GD, Nicolaides A, Suri JS. Wilson disease tissue classification and characterization using seven artificial intelligence models embedded with 3D optimization paradigm on a weak training brain magnetic resonance imaging datasets: a supercomputer application. Med Biol Eng Comput 2021; 59:511-533. [PMID: 33547549 DOI: 10.1007/s11517-021-02322-0] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Accepted: 01/18/2021] [Indexed: 01/16/2023]
Abstract
Wilson's disease (WD) is caused by copper accumulation in the brain and liver, and if not treated early, can lead to severe disability and death. WD has shown white matter hyperintensity (WMH) in the brain magnetic resonance scans (MRI) scans, but the diagnosis is challenging due to (i) subtle intensity changes and (ii) weak training MRI when using artificial intelligence (AI). Design and validate seven types of high-performing AI-based computer-aided design (CADx) systems consisting of 3D optimized classification, and characterization of WD against controls. We propose a "conventional deep convolution neural network" (cDCNN) and an "improved DCNN" (iDCNN) where rectified linear unit (ReLU) activation function was modified ensuring "differentiable at zero." Three-dimensional optimization was achieved by recording accuracy while changing the CNN layers and augmentation by several folds. WD was characterized using (i) CNN-based feature map strength and (ii) Bispectrum strengths of pixels having higher probabilities of WD. We further computed the (a) area under the curve (AUC), (b) diagnostic odds ratio (DOR), (c) reliability, and (d) stability and (e) benchmarking. Optimal results were achieved using 9 layers of CNN, with 4-fold augmentation. iDCNN yields superior performance compared to cDCNN with accuracy and AUC of 98.28 ± 1.55, 0.99 (p < 0.0001), and 97.19 ± 2.53%, 0.984 (p < 0.0001), respectively. DOR of iDCNN outperformed cDCNN fourfold. iDCNN also outperformed (a) transfer learning-based "Inception V3" paradigm by 11.92% and (b) four types of "conventional machine learning-based systems": k-NN, decision tree, support vector machine, and random forest by 55.13%, 28.36%, 15.35%, and 14.11%, respectively. The AI-based systems can potentially be useful in the early WD diagnosis. Graphical Abstract.
Collapse
Affiliation(s)
- Mohit Agarwal
- CSE Department, Bennett University, Greater Noida, UP, India
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Suneet K Gupta
- CSE Department, Bennett University, Greater Noida, UP, India
| | - Amer M Johri
- Department of Medicine, Division of Cardiology, Queen's University, Ontario, Kingston, Canada
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, Athens, Greece
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA, USA
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI, USA
| | - Martin Miner
- Men's Health Center, Miriam Hospital Providence, Providence, RI, USA
| | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Athens, Greece
| | - Athanasios Protogerou
- Department of Cardiovascular Prevention, National and Kapodistrian Univ. of Athens, Athens, Greece
| | - Aditya M Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA, USA
| | - Vijay Viswanathan
- MV Hospital for Diabetes & Professor M Viswanathan Diabetes Research Centre, Chennai, India
| | - George D Kitas
- R & D Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia, Nicosia, Cyprus
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, 95661, USA.
| |
Collapse
|
31
|
Agarwal M, Saba L, Gupta SK, Carriero A, Falaschi Z, Paschè A, Danna P, El-Baz A, Naidu S, Suri JS. A Novel Block Imaging Technique Using Nine Artificial Intelligence Models for COVID-19 Disease Classification, Characterization and Severity Measurement in Lung Computed Tomography Scans on an Italian Cohort. J Med Syst 2021; 45:28. [PMID: 33496876 PMCID: PMC7835451 DOI: 10.1007/s10916-021-01707-w] [Citation(s) in RCA: 40] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2020] [Accepted: 01/06/2021] [Indexed: 01/31/2023]
Abstract
Computer Tomography (CT) is currently being adapted for visualization of COVID-19 lung damage. Manual classification and characterization of COVID-19 may be biased depending on the expert's opinion. Artificial Intelligence has recently penetrated COVID-19, especially deep learning paradigms. There are nine kinds of classification systems in this study, namely one deep learning-based CNN, five kinds of transfer learning (TL) systems namely VGG16, DenseNet121, DenseNet169, DenseNet201 and MobileNet, three kinds of machine-learning (ML) systems, namely artificial neural network (ANN), decision tree (DT), and random forest (RF) that have been designed for classification of COVID-19 segmented CT lung against Controls. Three kinds of characterization systems were developed namely (a) Block imaging for COVID-19 severity index (CSI); (b) Bispectrum analysis; and (c) Block Entropy. A cohort of Italian patients with 30 controls (990 slices) and 30 COVID-19 patients (705 slices) was used to test the performance of three types of classifiers. Using K10 protocol (90% training and 10% testing), the best accuracy and AUC was for DCNN and RF pairs were 99.41 ± 5.12%, 0.991 (p < 0.0001), and 99.41 ± 0.62%, 0.988 (p < 0.0001), respectively, followed by other ML and TL classifiers. We show that diagnostics odds ratio (DOR) was higher for DL compared to ML, and both, Bispecturm and Block Entropy shows higher values for COVID-19 patients. CSI shows an association with Ground Glass Opacities (0.9146, p < 0.0001). Our hypothesis holds true that deep learning shows superior performance compared to machine learning models. Block imaging is a powerful novel approach for pinpointing COVID-19 severity and is clinically validated.
Collapse
Affiliation(s)
- Mohit Agarwal
- CSE Department, Bennett University, Greater Noida, India
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria di Cagliari, Cagliari, Monserrato, Italy
| | - Suneet K Gupta
- CSE Department, Bennett University, Greater Noida, India
| | - Alessandro Carriero
- Department of Radiology, A.O.U, "Maggiore d.c." Universiy of Eastern Piedmont, Novara, Italy
| | - Zeno Falaschi
- Department of Radiology, A.O.U, "Maggiore d.c." Universiy of Eastern Piedmont, Novara, Italy
| | - Alessio Paschè
- Department of Radiology, A.O.U, "Maggiore d.c." Universiy of Eastern Piedmont, Novara, Italy
| | - Pietro Danna
- Department of Radiology, A.O.U, "Maggiore d.c." Universiy of Eastern Piedmont, Novara, Italy
| | - Ayman El-Baz
- Biomedical Engineering Department, Louisville, KY, USA
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN, USA
| | - Jasjit S Suri
- Stroke Diagnosis and Monitoring Division, AtheroPoint™, Roseville, CA, 95661, USA.
- Advanced Knowledge Engineering Centre, Global Biomedical Technologies, Inc., Roseville, CA, USA.
| |
Collapse
|
32
|
Ultrasound-based internal carotid artery plaque characterization using deep learning paradigm on a supercomputer: a cardiovascular disease/stroke risk assessment system. Int J Cardiovasc Imaging 2021; 37:1511-1528. [DOI: 10.1007/s10554-020-02124-9] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/19/2020] [Accepted: 11/28/2020] [Indexed: 12/17/2022]
|
33
|
Jamthikar AD, Gupta D, Saba L, Khanna NN, Viskovic K, Mavrogeni S, Laird JR, Sattar N, Johri AM, Pareek G, Miner M, Sfikakis PP, Protogerou A, Viswanathan V, Sharma A, Kitas GD, Nicolaides A, Kolluri R, Suri JS. Artificial intelligence framework for predictive cardiovascular and stroke risk assessment models: A narrative review of integrated approaches using carotid ultrasound. Comput Biol Med 2020; 126:104043. [PMID: 33065389 DOI: 10.1016/j.compbiomed.2020.104043] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Revised: 09/10/2020] [Accepted: 10/04/2020] [Indexed: 12/12/2022]
Abstract
RECENT FINDINGS Cardiovascular disease (CVD) is the leading cause of mortality and poses challenges for healthcare providers globally. Risk-based approaches for the management of CVD are becoming popular for recommending treatment plans for asymptomatic individuals. Several conventional predictive CVD risk models based do not provide an accurate CVD risk assessment for patients with different baseline risk profiles. Artificial intelligence (AI) algorithms have changed the landscape of CVD risk assessment and demonstrated a better performance when compared against conventional models, mainly due to its ability to handle the input nonlinear variations. Further, it has the flexibility to add risk factors derived from medical imaging modalities that image the morphology of the plaque. The integration of noninvasive carotid ultrasound image-based phenotypes with conventional risk factors in the AI framework has further provided stronger power for CVD risk prediction, so-called "integrated predictive CVD risk models." PURPOSE of the review: The objective of this review is (i) to understand several aspects in the development of predictive CVD risk models, (ii) to explore current conventional predictive risk models and their successes and challenges, and (iii) to refine the search for predictive CVD risk models using noninvasive carotid ultrasound as an exemplar in the artificial intelligence-based framework. CONCLUSION Conventional predictive CVD risk models are suboptimal and could be improved. This review examines the potential to include more noninvasive image-based phenotypes in the CVD risk assessment using powerful AI-based strategies.
Collapse
Affiliation(s)
- Ankush D Jamthikar
- Department of Electronics and Communication Engineering, Visvesvaraya National Institute of Technology, Nagpur, Maharashtra, India
| | - Deep Gupta
- Department of Electronics and Communication Engineering, Visvesvaraya National Institute of Technology, Nagpur, Maharashtra, India
| | - Luca Saba
- Department of Radiology, University of Cagliari, Italy
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, Croatia
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, Athens, Greece
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | - Naveed Sattar
- Institute of Cardiovascular & Medical Sciences, University of Glasgow, Scotland, UK
| | - Amer M Johri
- Department of Medicine, Division of Cardiology, Queen's University, Kingston, Ontario, Canada
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI, USA
| | - Martin Miner
- Men's Health Center, Miriam Hospital Providence, Rhode Island, USA
| | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Greece
| | - Athanasios Protogerou
- Department of Cardiovascular Prevention & Research Unit Clinic & Laboratory of Pathophysiology, National and Kapodistrian Univ. of Athens, Greece
| | - Vijay Viswanathan
- MV Hospital for Diabetes and Professor M Viswanathan Diabetes Research Centre, Chennai, India
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA, USA
| | - George D Kitas
- R & D Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, United Kingdom
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre and University of Nicosia Medical School, Nicosia, Cyprus
| | | | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA.
| |
Collapse
|
34
|
Skandha SS, Gupta SK, Saba L, Koppula VK, Johri AM, Khanna NN, Mavrogeni S, Laird JR, Pareek G, Miner M, Sfikakis PP, Protogerou A, Misra DP, Agarwal V, Sharma AM, Viswanathan V, Rathore VS, Turk M, Kolluri R, Viskovic K, Cuadrado-Godia E, Kitas GD, Nicolaides A, Suri JS. 3-D optimized classification and characterization artificial intelligence paradigm for cardiovascular/stroke risk stratification using carotid ultrasound-based delineated plaque: Atheromatic™ 2.0. Comput Biol Med 2020; 125:103958. [PMID: 32927257 DOI: 10.1016/j.compbiomed.2020.103958] [Citation(s) in RCA: 44] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Revised: 08/02/2020] [Accepted: 08/03/2020] [Indexed: 12/18/2022]
Abstract
BACKGROUND AND PURPOSE Atherosclerotic plaque tissue rupture is one of the leading causes of strokes. Early carotid plaque monitoring can help reduce cardiovascular morbidity and mortality. Manual ultrasound plaque classification and characterization methods are time-consuming and can be imprecise due to significant variations in tissue characteristics. We report a novel artificial intelligence (AI)-based plaque tissue classification and characterization system. METHODS We hypothesize that symptomatic plaque is hypoechoic due to its large lipid core and minimal collagen, as well as its heterogeneous makeup. Meanwhile, asymptomatic plaque is hyperechoic due to its small lipid core, abundant collagen, and the fact that it is often calcified. We designed a computer-aided diagnosis (CADx) system consisting of three kinds of deep learning (DL) classification paradigms: Deep Convolutional Neural Network (DCNN), Visual Geometric Group-16 (VGG16), and transfer learning, (tCNN). DCNN was 3-D optimized by varying the number of CNN layers and data augmentation frameworks. The DL systems were benchmarked against four types of machine learning (ML) classification systems, and the CADx system was characterized using two novel strategies consisting of DL mean feature strength (MFS) and a bispectrum model using higher-order spectra. RESULTS After balancing symptomatic and asymptomatic plaque classes, a five-fold augmentation process was applied, yielding 1000 carotid scans in each class. Then, using a K10 protocol (trained to test the ratio of 90%-10%), tCNN and DCNN yielded accuracy (area under the curve (AUC)) pairs of 83.33%, 0.833 (p < 0.0001) and 95.66%, 0.956 (p < 0.0001), respectively. DCNN was superior to ML by 7.01%. As part of the characterization process, the MFS of the symptomatic plaque was found to be higher compared to the asymptomatic plaque by 17.5% (p < 0.0001). A similar pattern was seen in the bispectrum, which was higher for symptomatic plaque by 5.4% (p < 0.0001). It took <2 s to perform the online CADx process on a supercomputer. CONCLUSIONS The performance order of the three AI systems was DCNN > tCNN > ML. Bispectrum-based on higher-order spectra proved a powerful paradigm for plaque tissue characterization. Overall, the AI-based systems offer a powerful solution for plaque tissue classification and characterization.
Collapse
Affiliation(s)
- Sanagala S Skandha
- CSE Department, CMR College of Engineering & Technology, Hyderabad, India; CSE Department, Bennett University, Greater Noida, UP, India
| | - Suneet K Gupta
- CSE Department, Bennett University, Greater Noida, UP, India
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Vijaya K Koppula
- CSE Department, CMR College of Engineering & Technology, Hyderabad, India
| | - Amer M Johri
- Department of Medicine, Division of Cardiology, Queen's University, Kingston, Ontario, Canada
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, Athens, Greece
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI, USA
| | - Martin Miner
- Men's Health Center, Miriam Hospital Providence, RI, USA
| | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Greece
| | - Athanasios Protogerou
- Department of Cardiovascular Prevention, National and Kapodistrian Univ. of Athens, Greece
| | - Durga P Misra
- Dept. of Clinical Immunology and Rheumatology, SGPGIMS, Lucknow, India
| | - Vikas Agarwal
- Dept. of Clinical Immunology and Rheumatology, SGPGIMS, Lucknow, India
| | - Aditya M Sharma
- Division of Cardiovascular Medicine, University of Virginia, VA, USA
| | - Vijay Viswanathan
- MV Hospital for Diabetes & Professor M Viswanathan Diabetes Research Centre, Chennai, India
| | - Vijay S Rathore
- Nephrology Department, Kaiser Permanente, Sacramento, CA, USA
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, Delmenhorst, Germany
| | | | | | | | - George D Kitas
- R & D Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia, Nicosia, Cyprus
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA.
| |
Collapse
|
35
|
Tandel GS, Balestrieri A, Jujaray T, Khanna NN, Saba L, Suri JS. Multiclass magnetic resonance imaging brain tumor classification using artificial intelligence paradigm. Comput Biol Med 2020; 122:103804. [DOI: 10.1016/j.compbiomed.2020.103804] [Citation(s) in RCA: 46] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2020] [Revised: 05/01/2020] [Accepted: 05/02/2020] [Indexed: 12/18/2022]
|
36
|
Saba L, Biswas M, Suri HS, Viskovic K, Laird JR, Cuadrado-Godia E, Nicolaides A, Khanna NN, Viswanathan V, Suri JS. Ultrasound-based carotid stenosis measurement and risk stratification in diabetic cohort: a deep learning paradigm. Cardiovasc Diagn Ther 2019; 9:439-461. [PMID: 31737516 PMCID: PMC6837906 DOI: 10.21037/cdt.2019.09.01] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2019] [Accepted: 08/20/2019] [Indexed: 12/11/2022]
Abstract
BACKGROUND Stroke is in the top three leading causes of death worldwide. Non-invasive monitoring of stroke can be accomplished via stenosis measurements. The current conventional image-based methods for these measurements are not accurate and reliable. They do not incorporate shape and intelligent learning component in their design. METHODS In this study, we propose a deep learning (DL)-based methodology for accurate measurement of stenosis in common carotid artery (CCA) ultrasound (US) scans using a class of AtheroEdge system from AtheroPoint, USA. Three radiologists manually traced the lumen-intima (LI) for the near and the far walls, respectively, which served as a gold standard (GS) for training the DL-based model. Three DL-based systems were developed based on three types of GS. RESULTS IRB approved (Toho University, Japan) 407 US scans from 204 patients were collected. The risk was characterized into three classes: low, moderate, and high-risk. The area-under-curve (AUC) corresponding to three DL systems using receiver operating characteristic (ROC) analysis computed were: 0.90, 0.94 and 0.86, respectively. CONCLUSIONS Novel DL-based strategy showed reliable, accurate and stable stenosis severity index (SSI) measurements.
Collapse
Affiliation(s)
- Luca Saba
- Department of Radiology, A.O.U., Cagliari, Italy
| | - Mainak Biswas
- Department of Computer Science and Engineering, JIS University, Agarpara, Kolkata, India
| | | | - Klaudija Viskovic
- Department of Radiology and Ultrasound University Hospital for Infectious Diseases, Zagreb, Croatia
| | - John R. Laird
- Heart and Vascular Institute, Adventist, St. Helena Hospital, Napa Valley, CA, USA
| | | | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, London, UK
- Department of Biological Sciences, University of Cyprus, Nicosia, Cyprus
| | - N. N. Khanna
- Cardiology Department, Indraprastha Apollo Hospitals, New Delhi, India
| | - Vijay Viswanathan
- MV Hospital for Diabetes and Professor M Viswanathan Diabetes Research Centre, Chennai, India
| | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA
| |
Collapse
|
37
|
Jamthikar A, Gupta D, Khanna NN, Araki T, Saba L, Nicolaides A, Sharma A, Omerzu T, Suri HS, Gupta A, Mavrogeni S, Turk M, Laird JR, Protogerou A, Sfikakis PP, Kitas GD, Viswanathan V, Pareek G, Miner M, Suri JS. A Special Report on Changing Trends in Preventive Stroke/Cardiovascular Risk Assessment Via B-Mode Ultrasonography. Curr Atheroscler Rep 2019; 21:25. [PMID: 31041615 DOI: 10.1007/s11883-019-0788-4] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
PURPOSE OF REVIEW Cardiovascular disease (CVD) and stroke risk assessment have been largely based on the success of traditional statistically derived risk calculators such as Pooled Cohort Risk Score or Framingham Risk Score. However, over the last decade, automated computational paradigms such as machine learning (ML) and deep learning (DL) techniques have penetrated into a variety of medical domains including CVD/stroke risk assessment. This review is mainly focused on the changing trends in CVD/stroke risk assessment and its stratification from statistical-based models to ML-based paradigms using non-invasive carotid ultrasonography. RECENT FINDINGS In this review, ML-based strategies are categorized into two types: non-image (or conventional ML-based) and image-based (or integrated ML-based). The success of conventional (non-image-based) ML-based algorithms lies in the different data-driven patterns or features which are used to train the ML systems. Typically these features are the patients' demographics, serum biomarkers, and multiple clinical parameters. The integrated (image-based) ML-based algorithms integrate the features derived from the ultrasound scans of the arterial walls (such as morphological measurements) with conventional risk factors in ML frameworks. Even though the review covers ML-based system designs for carotid and coronary ultrasonography, the main focus of the review is on CVD/stroke risk scores based on carotid ultrasound. There are two key conclusions from this review: (i) fusion of image-based features with conventional cardiovascular risk factors can lead to more accurate CVD/stroke risk stratification; (ii) the ability to handle multiple sources of information in big data framework using artificial intelligence-based paradigms (such as ML and DL) is likely to be the future in preventive CVD/stroke risk assessment.
Collapse
Affiliation(s)
- Ankush Jamthikar
- Department of ECE, Visvesvaraya National Institute of Technology, Nagpur, Maharashtra, India
| | - Deep Gupta
- Department of ECE, Visvesvaraya National Institute of Technology, Nagpur, Maharashtra, India
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Tadashi Araki
- Division of Cardiovascular Medicine, Toho University, Tokyo, Japan
| | - Luca Saba
- Department of Radiology, University of Cagliari, Cagliari, Italy
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Cyprus, Nicosia, Cyprus
| | - Aditya Sharma
- Cardiovascular Medicine, University of Virginia, Charlottesville, VA, USA
| | - Tomaz Omerzu
- Department of Neurology, University Medical Centre Maribor, Maribor, Slovenia
| | | | - Ajay Gupta
- Department of Radiology, Cornell Medical Center, New York, NY, USA
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, Athens, Greece
| | - Monika Turk
- Department of Neurology, University Medical Centre Maribor, Maribor, Slovenia
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA, USA
| | - Athanasios Protogerou
- Department of Cardiovascular Prevention & Research Unit Clinic & Laboratory of Pathophysiology
- , National and Kapodistrian University of Athens, Athens, Greece
| | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Athens, Greece
| | - George D Kitas
- R&D Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK
| | - Vijay Viswanathan
- MV Hospital for Diabetes and Professor M Viswanathan Diabetes Research Centre, Chennai, India
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI, USA
| | - Martin Miner
- Men's Health Center, Miriam Hospital Providence, Providence, RI, USA
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, 95661, USA.
| |
Collapse
|
38
|
SMITHA B, JOSEPH KPAUL. A NEW APPROACH FOR CLASSIFICATION OF ATHEROSCLEROSIS OF COMMON CAROTID ARTERY FROM ULTRASOUND IMAGES. J MECH MED BIOL 2019. [DOI: 10.1142/s0219519419400013] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Background and objectives: The diagnosis of carotid atherosclerosis is of vital importance, as this cardiovascular disease may cause myocardial infarction. One-third of deaths in the world occur due to myocardial infarction, commonly known as heart attack. Atherosclerosis is deposition of plaque in artery wall. It could be detected from the features of intima-media complex of the artery wall. This study proposes a new classification approach to distinguish between symptomatic and asymptomatic plaques using non-invasive carotid B-mode ultrasound images. These two types of plaques have diverse impacts on human life. In the first condition, slowly plaque formation reaches life-threatening condition and the second condition is acute in nature. Hence treatment protocol is to be decided based on the type of plaque. Methods: To locate the intima-media-complex region, the images are segmented using snake-based segmentation algorithm. Several features are extracted using fixed size blocks selected from the segmented region using gray-level co-occurrence matrix. Finally classification is performed using support vector machine. Results: The performance shows improvement in accuracy using lesser number of features than previous works. The reduction in feature size is achieved by incorporating segmentation in the pre-processing stage. In the classifier, 10-fold cross-validation protocol is used for training and testing and an accuracy of 100% is obtained. Conclusion: This proposed technique could work as an adjunct tool in quick decision-making for cardiologists and radiologists.
Collapse
Affiliation(s)
- B. SMITHA
- Department of Electrical Engineering, National Institute of Technology, Calicut 673601, Kerala, India
| | - K. PAUL JOSEPH
- Department of Electrical Engineering, National Institute of Technology, Calicut 673601, Kerala, India
| |
Collapse
|
39
|
Rheumatoid Arthritis: Atherosclerosis Imaging and Cardiovascular Risk Assessment Using Machine and Deep Learning-Based Tissue Characterization. Curr Atheroscler Rep 2019; 21:7. [PMID: 30684090 DOI: 10.1007/s11883-019-0766-x] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
PURPOSE OF THE REVIEW Rheumatoid arthritis (RA) is a chronic, autoimmune disease which may result in a higher risk of cardiovascular (CV) events and stroke. Tissue characterization and risk stratification of patients with rheumatoid arthritis are a challenging problem. Risk stratification of RA patients using traditional risk factor-based calculators either underestimates or overestimates the CV risk. Advancements in medical imaging have facilitated early and accurate CV risk stratification compared to conventional cardiovascular risk calculators. RECENT FINDING In recent years, a link between carotid atherosclerosis and rheumatoid arthritis has been widely discussed by multiple studies. Imaging the carotid artery using 2-D ultrasound is a noninvasive, economic, and efficient imaging approach that provides an atherosclerotic plaque tissue-specific image. Such images can help to morphologically characterize the plaque type and accurately measure vital phenotypes such as media wall thickness and wall variability. Intelligence-based paradigms such as machine learning- and deep learning-based techniques not only automate the risk characterization process but also provide an accurate CV risk stratification for better management of RA patients. This review provides a brief understanding of the pathogenesis of RA and its association with carotid atherosclerosis imaged using the B-mode ultrasound technique. Lacunas in traditional risk scores and the role of machine learning-based tissue characterization algorithms are discussed and could facilitate cardiovascular risk assessment in RA patients. The key takeaway points from this review are the following: (i) inflammation is a common link between RA and atherosclerotic plaque buildup, (ii) carotid ultrasound is a better choice to characterize the atherosclerotic plaque tissues in RA patients, and (iii) intelligence-based paradigms are useful for accurate tissue characterization and risk stratification of RA patients.
Collapse
|
40
|
Banchhor SK, Londhe ND, Araki T, Saba L, Radeva P, Khanna NN, Suri JS. Calcium detection, its quantification, and grayscale morphology-based risk stratification using machine learning in multimodality big data coronary and carotid scans: A review. Comput Biol Med 2018; 101:184-198. [DOI: 10.1016/j.compbiomed.2018.08.017] [Citation(s) in RCA: 27] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2018] [Revised: 08/14/2018] [Accepted: 08/14/2018] [Indexed: 01/04/2023]
|
41
|
Molinari F, Raghavendra U, Gudigar A, Meiburger KM, Rajendra Acharya U. An efficient data mining framework for the characterization of symptomatic and asymptomatic carotid plaque using bidimensional empirical mode decomposition technique. Med Biol Eng Comput 2018; 56:1579-1593. [DOI: 10.1007/s11517-018-1792-5] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2017] [Accepted: 01/13/2018] [Indexed: 10/18/2022]
|
42
|
Faust O, Acharya UR, Meiburger KM, Molinari F, Koh JE, Yeong CH, Kongmebhol P, Ng KH. Comparative assessment of texture features for the identification of cancer in ultrasound images: a review. Biocybern Biomed Eng 2018. [DOI: 10.1016/j.bbe.2018.01.001] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
43
|
Banchhor SK, Londhe ND, Araki T, Saba L, Radeva P, Laird JR, Suri JS. Wall-based measurement features provides an improved IVUS coronary artery risk assessment when fused with plaque texture-based features during machine learning paradigm. Comput Biol Med 2017; 91:198-212. [PMID: 29100114 DOI: 10.1016/j.compbiomed.2017.10.019] [Citation(s) in RCA: 31] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2017] [Revised: 10/19/2017] [Accepted: 10/19/2017] [Indexed: 12/31/2022]
Abstract
BACKGROUND Planning of percutaneous interventional procedures involves a pre-screening and risk stratification of the coronary artery disease. Current screening tools use stand-alone plaque texture-based features and therefore lack the ability to stratify the risk. METHOD This IRB approved study presents a novel strategy for coronary artery disease risk stratification using an amalgamation of IVUS plaque texture-based and wall-based measurement features. Due to common genetic plaque makeup, carotid plaque burden was chosen as a gold standard for risk labels during training-phase of machine learning (ML) paradigm. Cross-validation protocol was adopted to compute the accuracy of the ML framework. A set of 59 plaque texture-based features was padded with six wall-based measurement features to show the improvement in stratification accuracy. The ML system was executed using principle component analysis-based framework for dimensionality reduction and uses support vector machine classifier for training and testing-phases. RESULTS The ML system produced a stratification accuracy of 91.28%, demonstrating an improvement of 5.69% when wall-based measurement features were combined with plaque texture-based features. The fused system showed an improvement in mean sensitivity, specificity, positive predictive value, and area under the curve by: 6.39%, 4.59%, 3.31% and 5.48%, respectively when compared to the stand-alone system. While meeting the stability criteria of 5%, the ML system also showed a high average feature retaining power and mean reliability of 89.32% and 98.24%, respectively. CONCLUSIONS The ML system showed an improvement in risk stratification accuracy when the wall-based measurement features were fused with the plaque texture-based features.
Collapse
Affiliation(s)
| | | | - Tadashi Araki
- Division of Cardiovascular Medicine, Toho University Ohashi Medical Center, Tokyo, Japan
| | - Luca Saba
- Department of Radiology, University of Cagliari, Italy
| | - Petia Radeva
- Department of Mathematics and Computer Science, University of Barcelona, Barcelona, Spain
| | | | - Jasjit S Suri
- Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA.
| |
Collapse
|
44
|
Shrivastava VK, Londhe ND, Sonawane RS, Suri JS. A novel and robust Bayesian approach for segmentation of psoriasis lesions and its risk stratification. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2017; 150:9-22. [PMID: 28859832 DOI: 10.1016/j.cmpb.2017.07.011] [Citation(s) in RCA: 53] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/04/2017] [Revised: 07/21/2017] [Accepted: 07/31/2017] [Indexed: 06/07/2023]
Abstract
BACKGROUND AND OBJECTIVE The need for characterization of psoriasis lesion severity is clinically valuable and vital for dermatologists since it provides a reliable and precise decision on risk assessment. The automated delineation of lesion is a prerequisite prior to characterization, which is challenging itself. Thus, this paper has two major objectives: (a) design of a segmentation system which can model by learning the lesion characteristics and this is posed as a Bayesian model; (b) develop a psoriasis risk assessment system (pRAS) by crisscrossing the blocks which drives the fundamental machine learning paradigm. METHODS The segmentation system uses the knowledge derived by the experts along with the features reflected by the lesions to build a Bayesian framework that helps to classify each pixel of the image into lesion vs. BACKGROUND Since this lesion has several stages and grades, hence the system undergoes the risk assessment to classify into five levels of severity: healthy, mild, moderate, severe and very severe. We build nine kinds of pRAS utilizing different combinations of the key blocks. These nine pRAS systems use three classifiers (Support Vector Machine (SVM), Decision Tree (DT) and Neural Network (NN)) and three feature selection techniques (Principal Component Analysis (PCA), Fisher Discriminant Ratio (FDR) and Mutual Information (MI)). The two major experiments conducted using these nine systems were: (i) selection of best system combination based on classification accuracy and (ii) understanding the reliability of the system. This leads us to computation of key system performance parameters such as: feature retaining power, aggregated feature effect and reliability index besides conventional attributes like accuracy, sensitivity, specificity. RESULTS Using the database used in this study consisted of 670 psoriasis images, the combination of SVM and FDR was revealed as the optimal pRAS system and yielded a classification accuracy of 99.84% using cross-validation protocol. Further, SVM-FDR system provides the reliability of 99.99% using cross-validation protocol. CONCLUSIONS The study demonstrates a fully novel model of segmentation embedded with risk assessment. Among all nine systems, SVM-FDR produced best results. Further, we validated our pRAS system with automatic segmented lesions against manually segmented lesions showing comparable performance.
Collapse
Affiliation(s)
- Vimal K Shrivastava
- School of Electronics Engineering, Kalinga Institute of Industrial Technology, Bhubaneswar, India.
| | - Narendra D Londhe
- Electrical Engineering Department, National Institute of Technology, Raipur, India; Skin Point-of-Care Division, Global Biomedical Technologies, Inc., Roseville, CA, USA.
| | - Rajendra S Sonawane
- Psoriasis Clinic and Research Centre, Psoriatreat, Pune, Maharashtra, India.
| | - Jasjit S Suri
- Skin Point-of-Care Division, Global Biomedical Technologies, Inc., Roseville, CA, USA; Electrical Engineering Department, Idaho State University (Aff.), Pocatello, ID, USA.
| |
Collapse
|
45
|
Saba L, Jain PK, Suri HS, Ikeda N, Araki T, Singh BK, Nicolaides A, Shafique S, Gupta A, Laird JR, Suri JS. Plaque Tissue Morphology-Based Stroke Risk Stratification Using Carotid Ultrasound: A Polling-Based PCA Learning Paradigm. J Med Syst 2017; 41:98. [PMID: 28501967 DOI: 10.1007/s10916-017-0745-0] [Citation(s) in RCA: 39] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2017] [Accepted: 04/27/2017] [Indexed: 01/18/2023]
Abstract
Severe atherosclerosis disease in carotid arteries causes stenosis which in turn leads to stroke. Machine learning systems have been previously developed for plaque wall risk assessment using morphology-based characterization. The fundamental assumption in such systems is the extraction of the grayscale features of the plaque region. Even though these systems have the ability to perform risk stratification, they lack the ability to achieve higher performance due their inability to select and retain dominant features. This paper introduces a polling-based principal component analysis (PCA) strategy embedded in the machine learning framework to select and retain dominant features, resulting in superior performance. This leads to more stability and reliability. The automated system uses offline image data along with the ground truth labels to generate the parameters, which are then used to transform the online grayscale features to predict the risk of stroke. A set of sixteen grayscale plaque features is computed. Utilizing the cross-validation protocol (K = 10), and the PCA cutoff of 0.995, the machine learning system is able to achieve an accuracy of 98.55 and 98.83%corresponding to the carotidfar wall and near wall plaques, respectively. The corresponding reliability of the system was 94.56 and 95.63%, respectively. The automated system was validated against the manual risk assessment system and the precision of merit for same cross-validation settings and PCA cutoffs are 98.28 and 93.92%for the far and the near wall, respectively.PCA-embedded morphology-based plaque characterization shows a powerful strategy for risk assessment and can be adapted in clinical settings.
Collapse
Affiliation(s)
- Luca Saba
- Department of Radiology, University of Cagliari, Cagliari, Italy
| | - Pankaj K Jain
- Point-of-Care Devices, Global Biomedical Technologies, Inc., Roseville, CA, USA
| | - Harman S Suri
- Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA
| | - Nobutaka Ikeda
- Cardiovascular Medicine, National Center for Global Health and Medicine, Tokyo, Japan
| | - Tadashi Araki
- Division of Cardiovascular Medicine, Toho University Ohashi Medical Center, Tokyo, Japan
| | - Bikesh K Singh
- Department of Biomedical Engineering, NIT Raipur, Raipur, Chhattisgarh, India
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, London, England, UK.,Vascular Diagnostic Centre, University of Cyprus, Nicosia, Cyprus
| | - Shoaib Shafique
- CorVasc Vascular Laboratory, 8433 Harcourt Rd #100, Indianapolis, IN, USA
| | - Ajay Gupta
- Brain and Mind Research Institute and Department of Radiology, Weill Cornell Medical College, New York, NY, USA
| | - John R Laird
- UC Davis Vascular Centre, University of California, Davis, CA, USA
| | - Jasjit S Suri
- Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA. .,Department of Electrical Engineering, University of Idaho (Affl.), Pocatello, ID, USA.
| |
Collapse
|
46
|
Computer aided diagnosis of Coronary Artery Disease, Myocardial Infarction and carotid atherosclerosis using ultrasound images: A review. Phys Med 2017; 33:1-15. [DOI: 10.1016/j.ejmp.2016.12.005] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/25/2016] [Revised: 11/21/2016] [Accepted: 12/04/2016] [Indexed: 02/08/2023] Open
|
47
|
Li B, Jiao Y, Fu C, Xie B, Ma G, Teng G, Yao Y. Contralateral artery enlargement predicts carotid plaque progression based on machine learning algorithm models in apoE -/- mice. Biomed Eng Online 2016; 15:146. [PMID: 28155719 PMCID: PMC5259854 DOI: 10.1186/s12938-016-0265-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
BACKGROUND This study specifically focused on anatomical MRI characterization of the low shear stress-induced atherosclerotic plaque in mice. We used machine learning algorithms to analyze multiple correlation factors of plaque to generate predictive models and to find the predictive factor for vulnerable plaque. METHODS Branches of the left carotid artery in apoE-/- and C57BL/6J mice were ligated to produce the partial left carotid artery model. Before surgery, and 7, 14, and 28 days after surgery, in vivo serial MRI measurements of carotid artery diameter were obtained. Meanwhile, proximal blood flow was evaluated. After image acquisition and animal sacrifice, carotid arteries were harvested for histological analysis. Support vector machine (SVM) and decision tree (DT) were used to select features and generate predictive models of vulnerable plaque progression. RESULT Seven days after surgery, neointima formation was visualized on micro-MRI in both apoE-/- and C57BL/6J mice. Ultrasonography showed that blood flow had significantly decreased compared to that in the contralateral artery. Partial ligation of the carotid artery for 4 weeks in apoE-/- mice induced vulnerable plaque; however, in C57BL/6J mice this same technique performed for 4 weeks induced arterial stenosis. Contralateral carotid artery diameter at 7 days after surgery was the most reliable predictive factor in plaque progression. We achieved over 87.5% accuracy, 80% sensitivity, and 95% specificity with SVM. The accuracy, sensitivity, and specificity for the DT classifier were 90, 90, and 90%, respectively. CONCLUSIONS This study is the first to demonstrate that SVM and DT methods could be suitable models for identifying vulnerable plaque progression in mice. And contralateral artery enlargement can predict the vulnerable plaque in carotid artery at the very early stage. It may be a valuable tool which helps to optimize the clinical work flow process by providing more decision in selecting patients for treatment.
Collapse
Affiliation(s)
- Bing Li
- Department of Cardiology, Zhongda Hospital, Medical School of Southeast University, 87 Dingjiaqiao, Nanjing, 210009, Jiangsu, China
| | - Yun Jiao
- Jiangsu Key Lab of Molecular and Function Imaging, Department of Radiology, Zhongda Hospital, Medical School of Southeast University, Nanjing, 210009, China
| | - Cong Fu
- Department of Cardiology, Zhongda Hospital, Medical School of Southeast University, 87 Dingjiaqiao, Nanjing, 210009, Jiangsu, China
| | - Bo Xie
- Jiangsu Key Lab of Molecular and Function Imaging, Department of Radiology, Zhongda Hospital, Medical School of Southeast University, Nanjing, 210009, China
| | - Genshan Ma
- Department of Cardiology, Zhongda Hospital, Medical School of Southeast University, 87 Dingjiaqiao, Nanjing, 210009, Jiangsu, China
| | - Gaojun Teng
- Jiangsu Key Lab of Molecular and Function Imaging, Department of Radiology, Zhongda Hospital, Medical School of Southeast University, Nanjing, 210009, China
| | - Yuyu Yao
- Department of Cardiology, Zhongda Hospital, Medical School of Southeast University, 87 Dingjiaqiao, Nanjing, 210009, Jiangsu, China.
| |
Collapse
|
48
|
Araki T, Jain PK, Suri HS, Londhe ND, Ikeda N, El-Baz A, Shrivastava VK, Saba L, Nicolaides A, Shafique S, Laird JR, Gupta A, Suri JS. Stroke Risk Stratification and its Validation using Ultrasonic Echolucent Carotid Wall Plaque Morphology: A Machine Learning Paradigm. Comput Biol Med 2016; 80:77-96. [PMID: 27915126 DOI: 10.1016/j.compbiomed.2016.11.011] [Citation(s) in RCA: 47] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2016] [Revised: 11/20/2016] [Accepted: 11/25/2016] [Indexed: 01/26/2023]
Abstract
Stroke risk stratification based on grayscale morphology of the ultrasound carotid wall has recently been shown to have a promise in classification of high risk versus low risk plaque or symptomatic versus asymptomatic plaques. In previous studies, this stratification has been mainly based on analysis of the far wall of the carotid artery. Due to the multifocal nature of atherosclerotic disease, the plaque growth is not restricted to the far wall alone. This paper presents a new approach for stroke risk assessment by integrating assessment of both the near and far walls of the carotid artery using grayscale morphology of the plaque. Further, this paper presents a scientific validation system for stroke risk assessment. Both these innovations have never been presented before. The methodology consists of an automated segmentation system of the near wall and far wall regions in grayscale carotid B-mode ultrasound scans. Sixteen grayscale texture features are computed, and fed into the machine learning system. The training system utilizes the lumen diameter to create ground truth labels for the stratification of stroke risk. The cross-validation procedure is adapted in order to obtain the machine learning testing classification accuracy through the use of three sets of partition protocols: (5, 10, and Jack Knife). The mean classification accuracy over all the sets of partition protocols for the automated system in the far and near walls is 95.08% and 93.47%, respectively. The corresponding accuracies for the manual system are 94.06% and 92.02%, respectively. The precision of merit of the automated machine learning system when compared against manual risk assessment system are 98.05% and 97.53% for the far and near walls, respectively. The ROC of the risk assessment system for the far and near walls is close to 1.0 demonstrating high accuracy.
Collapse
Affiliation(s)
- Tadashi Araki
- Division of Cardiovascular Medicine, Toho University Ohashi Medical Center, Tokyo, Japan
| | - Pankaj K Jain
- Point-of-Care Devices, Global Biomedical Technologies, Inc., Roseville, CA, USA
| | - Harman S Suri
- Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA
| | - Narendra D Londhe
- Department of Electrical Engineering, NIT Raipur, Chhattisgarh, India
| | - Nobutaka Ikeda
- Cardiovascular Medicine, National Center for Global Health and Medicine, Tokyo, Japan
| | - Ayman El-Baz
- Department of Bioengineering, University of Louisville, USA
| | | | - Luca Saba
- Department of Radiology, University of Cagliari, Italy
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, London, England; Vascular Diagnostic Centre, University of Cyprus, Nicosia, Cyprus
| | - Shoaib Shafique
- CorVasc Vascular Laboratory, 8433 Harcourt Rd #100, Indianapolis, IN, USA
| | - John R Laird
- UC Davis Vascular Centre, University of California, Davis, CA, USA
| | - Ajay Gupta
- Brain and Mind Research Institute and Department of Radiology, Weill Cornell Medical College, NY, USA
| | - Jasjit S Suri
- Point-of-Care Devices, Global Biomedical Technologies, Inc., Roseville, CA, USA; Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA; Department of Electrical Engineering, University of Idaho (Affl.), ID, USA.
| |
Collapse
|
49
|
Saba L, Dey N, Ashour AS, Samanta S, Nath SS, Chakraborty S, Sanches J, Kumar D, Marinho R, Suri JS. Automated stratification of liver disease in ultrasound: An online accurate feature classification paradigm. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2016; 130:118-134. [PMID: 27208527 DOI: 10.1016/j.cmpb.2016.03.016] [Citation(s) in RCA: 47] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/22/2014] [Revised: 02/17/2016] [Accepted: 03/15/2016] [Indexed: 06/05/2023]
Abstract
PURPOSE Fatty liver disease (FLD) is one of the most common diseases in liver. Early detection can improve the prognosis considerably. Using ultrasound for FLD detection is highly desirable due to its non-radiation nature, low cost and easy use. However, the results can be slow and ambiguous due to manual detection. The lack of computer trained systems leads to low image quality and inefficient disease classification. Thus, the current study proposes novel, accurate and reliable detection system for the FLD using computer-based training system. MATERIALS AND METHODS One hundred twenty-four ultrasound sample images were selected retrospectively from a database of 62 patients consisting of normal and cancerous. The proposed training system was generated offline parameters using training liver image database. The classifier applied transformation parameters to an online system in order to facilitate real-time detection during the ultrasound scan. The system utilized six sets of features (a total of 128 features), namely Haralick, basic geometric, Fourier transform, discrete cosine transform, Gupta transform and Gabor transform. These features were extracted for both offline training and online testing. Levenberg-Marquardt back propagation network (BPN) classifier was used to classify the liver disease into normal and abnormal categories. RESULTS Random partitioning approach was adapted to evaluate the classifier performance and compute its accuracy. Utilizing all the six sets of 128 features, the computer aided diagnosis (CAD) system achieved classification accuracy of 97.58%. Furthermore, the four performance metrics consisting of sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) realized 98.08%, 97.22%, 96.23%, and 98.59%, respectively. CONCLUSION The proposed system was successfully able to detect and classify the FLD. Furthermore, the proposed system was benchmarked against previous methods. The comparison established an advanced set of features in the Levenberg-Marquardt back propagation network reports a significant improvement compared to the existing techniques.
Collapse
Affiliation(s)
- Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.) di Cagliari - Polo di Monserrato, Università di Cagliari, Italy
| | - Nilanjan Dey
- Point-of-Care Devices, Global Biomedical Technologies, Inc., Roseville, CA, USA
| | - Amira S Ashour
- Department of Electronics and Electrical Communications Engineering, Faculty of Engineering, Tanta University, Egypt
| | - Sourav Samanta
- Point-of-Care Devices, Global Biomedical Technologies, Inc., Roseville, CA, USA
| | | | - Sayan Chakraborty
- Point-of-Care Devices, Global Biomedical Technologies, Inc., Roseville, CA, USA
| | - João Sanches
- Institute for Systems and Robotics (ISR), Instituto Superior Técnico (IST), Lisbon, Portugal
| | - Dinesh Kumar
- Point-of-Care Devices, Global Biomedical Technologies, Inc., Roseville, CA, USA
| | - RuiTato Marinho
- Liver Unit, Department of Gastroenterology and Hepatology, Hospital de Santa Maria, Medical School of Lisbon, Portugal
| | - Jasjit S Suri
- Point-of-Care Devices, Global Biomedical Technologies, Inc., Roseville, CA, USA; Electrical Engineering Department (Affl.), Idaho State University, ID, USA.
| |
Collapse
|
50
|
A novel approach to multiclass psoriasis disease risk stratification: Machine learning paradigm. Biomed Signal Process Control 2016. [DOI: 10.1016/j.bspc.2016.04.001] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
|