1
|
Singh M, Kumar A, Khanna NN, Laird JR, Nicolaides A, Faa G, Johri AM, Mantella LE, Fernandes JFE, Teji JS, Singh N, Fouda MM, Singh R, Sharma A, Kitas G, Rathore V, Singh IM, Tadepalli K, Al-Maini M, Isenovic ER, Chaturvedi S, Garg D, Paraskevas KI, Mikhailidis DP, Viswanathan V, Kalra MK, Ruzsa Z, Saba L, Laine AF, Bhatt DL, Suri JS. Artificial intelligence for cardiovascular disease risk assessment in personalised framework: a scoping review. EClinicalMedicine 2024; 73:102660. [PMID: 38846068 PMCID: PMC11154124 DOI: 10.1016/j.eclinm.2024.102660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 04/25/2024] [Accepted: 05/08/2024] [Indexed: 06/09/2024] Open
Abstract
Background The field of precision medicine endeavors to transform the healthcare industry by advancing individualised strategies for diagnosis, treatment modalities, and predictive assessments. This is achieved by utilizing extensive multidimensional biological datasets encompassing diverse components, such as an individual's genetic makeup, functional attributes, and environmental influences. Artificial intelligence (AI) systems, namely machine learning (ML) and deep learning (DL), have exhibited remarkable efficacy in predicting the potential occurrence of specific cancers and cardiovascular diseases (CVD). Methods We conducted a comprehensive scoping review guided by the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) framework. Our search strategy involved combining key terms related to CVD and AI using the Boolean operator AND. In August 2023, we conducted an extensive search across reputable scholarly databases including Google Scholar, PubMed, IEEE Xplore, ScienceDirect, Web of Science, and arXiv to gather relevant academic literature on personalised medicine for CVD. Subsequently, in January 2024, we extended our search to include internet search engines such as Google and various CVD websites. These searches were further updated in March 2024. Additionally, we reviewed the reference lists of the final selected research articles to identify any additional relevant literature. Findings A total of 2307 records were identified during the process of conducting the study, consisting of 564 entries from external sites like arXiv and 1743 records found through database searching. After 430 duplicate articles were eliminated, 1877 items that remained were screened for relevancy. In this stage, 1241 articles remained for additional review after 158 irrelevant articles and 478 articles with insufficient data were removed. 355 articles were eliminated for being inaccessible, 726 for being written in a language other than English, and 281 for not having undergone peer review. Consequently, 121 studies were deemed suitable for inclusion in the qualitative synthesis. At the intersection of CVD, AI, and precision medicine, we found important scientific findings in our scoping review. Intricate pattern extraction from large, complicated genetic datasets is a skill that AI algorithms excel at, allowing for accurate disease diagnosis and CVD risk prediction. Furthermore, these investigations have uncovered unique genetic biomarkers linked to CVD, providing insight into the workings of the disease and possible treatment avenues. The construction of more precise predictive models and personalised treatment plans based on the genetic profiles of individual patients has been made possible by the revolutionary advancement of CVD risk assessment through the integration of AI and genomics. Interpretation The systematic methodology employed ensured the thorough examination of available literature and the inclusion of relevant studies, contributing to the robustness and reliability of the study's findings. Our analysis stresses a crucial point in terms of the adaptability and versatility of AI solutions. AI algorithms designed in non-CVD domains such as in oncology, often include ideas and tactics that might be modified to address cardiovascular problems. Funding No funding received.
Collapse
Affiliation(s)
- Manasvi Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, 95661, USA
- Bennett University, 201310, Greater Noida, India
| | - Ashish Kumar
- Bennett University, 201310, Greater Noida, India
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, 110001, India
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, 94574, USA
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre and University of Nicosia Medical School, Cyprus
| | - Gavino Faa
- Department of Pathology, University of Cagliari, Cagliari, Italy
| | - Amer M. Johri
- Department of Medicine, Division of Cardiology, Queen's University, Kingston, Canada
| | - Laura E. Mantella
- Department of Medicine, Division of Cardiology, University of Toronto, Toronto, Canada
| | | | - Jagjit S. Teji
- Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, 60611, USA
| | - Narpinder Singh
- Department of Food Science and Technology, Graphic Era Deemed to Be University, Dehradun, Uttarakhand, 248002, India
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID, 83209, USA
| | - Rajesh Singh
- Department of Research and Innovation, Uttaranchal Institute of Technology, Uttaranchal University, Dehradun, 248007, India
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, 22901, VA, USA
| | - George Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, DY1, Dudley, UK
| | - Vijay Rathore
- Nephrology Department, Kaiser Permanente, Sacramento, CA, 95823, USA
| | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, 95661, USA
| | | | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON, L4Z 4C4, Canada
| | - Esma R. Isenovic
- Department of Radiobiology and Molecular Genetics, National Institute of The Republic of Serbia, University of Belgrade, 110010, Serbia
| | - Seemant Chaturvedi
- Department of Neurology & Stroke Program, University of Maryland, Baltimore, MD, USA
| | | | | | - Dimitri P. Mikhailidis
- Department of Clinical Biochemistry, Royal Free Hospital Campus, University College London Medical School, University College London (UCL), London, UK
| | | | | | - Zoltan Ruzsa
- Invasive Cardiology Division, University of Szeged, Szeged, Hungary
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria, 40138, Cagliari, Italy
| | - Andrew F. Laine
- Departments of Biomedical and Radiology, Columbia University, New York, NY, USA
| | | | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, 95661, USA
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID, 83209, USA
- Department of Computer Science, Graphic Era Deemed to Be University, Dehradun, Uttarakhand, 248002, India
| |
Collapse
|
2
|
Agarwal S, Saxena S, Carriero A, Chabert GL, Ravindran G, Paul S, Laird JR, Garg D, Fatemi M, Mohanty L, Dubey AK, Singh R, Fouda MM, Singh N, Naidu S, Viskovic K, Kukuljan M, Kalra MK, Saba L, Suri JS. COVLIAS 3.0: cloud-based quantized hybrid UNet3+ deep learning for COVID-19 lesion detection in lung computed tomography. Front Artif Intell 2024; 7:1304483. [PMID: 39006802 PMCID: PMC11240867 DOI: 10.3389/frai.2024.1304483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Accepted: 06/10/2024] [Indexed: 07/16/2024] Open
Abstract
Background and novelty When RT-PCR is ineffective in early diagnosis and understanding of COVID-19 severity, Computed Tomography (CT) scans are needed for COVID diagnosis, especially in patients having high ground-glass opacities, consolidations, and crazy paving. Radiologists find the manual method for lesion detection in CT very challenging and tedious. Previously solo deep learning (SDL) was tried but they had low to moderate-level performance. This study presents two new cloud-based quantized deep learning UNet3+ hybrid (HDL) models, which incorporated full-scale skip connections to enhance and improve the detections. Methodology Annotations from expert radiologists were used to train one SDL (UNet3+), and two HDL models, namely, VGG-UNet3+ and ResNet-UNet3+. For accuracy, 5-fold cross-validation protocols, training on 3,500 CT scans, and testing on unseen 500 CT scans were adopted in the cloud framework. Two kinds of loss functions were used: Dice Similarity (DS) and binary cross-entropy (BCE). Performance was evaluated using (i) Area error, (ii) DS, (iii) Jaccard Index, (iii) Bland-Altman, and (iv) Correlation plots. Results Among the two HDL models, ResNet-UNet3+ was superior to UNet3+ by 17 and 10% for Dice and BCE loss. The models were further compressed using quantization showing a percentage size reduction of 66.76, 36.64, and 46.23%, respectively, for UNet3+, VGG-UNet3+, and ResNet-UNet3+. Its stability and reliability were proved by statistical tests such as the Mann-Whitney, Paired t-Test, Wilcoxon test, and Friedman test all of which had a p < 0.001. Conclusion Full-scale skip connections of UNet3+ with VGG and ResNet in HDL framework proved the hypothesis showing powerful results improving the detection accuracy of COVID-19.
Collapse
Affiliation(s)
- Sushant Agarwal
- Advanced Knowledge Engineering Center, GBTI, Roseville, CA, United States
- Department of CSE, PSIT, Kanpur, India
| | | | - Alessandro Carriero
- Department of Radiology, “Maggiore della Carità” Hospital, University of Piemonte Orientale (UPO), Novara, Italy
| | | | - Gobinath Ravindran
- Department of Civil Engineering, SR University, Warangal, Telangana, India
| | - Sudip Paul
- Department of Biomedical Engineering, NEHU, Shillong, India
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA, United States
| | - Deepak Garg
- School of CS and AI, SR University, Warangal, Telangana, India
| | - Mostafa Fatemi
- Department of Physiology and Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN, United States
| | - Lopamudra Mohanty
- Department of Computer Science, ABES Engineering College, Ghaziabad, UP, India
- Department of Computer science, Bennett University, Greater Noida, UP, India
| | - Arun K. Dubey
- Bharati Vidyapeeth’s College of Engineering, New Delhi, India
| | - Rajesh Singh
- Division of Research and Innovation, Uttaranchal Institute of Technology, Uttaranchal University, Dehradun, India
| | - Mostafa M. Fouda
- Department of ECE, Idaho State University, Pocatello, ID, United States
| | - Narpinder Singh
- Department of Food Science and Technology, Graphic Era Deemed to be University, Dehradun, India
| | - Subbaram Naidu
- Department of EE, University of Minnesota, Duluth, MN, United States
| | | | - Melita Kukuljan
- Department of Interventional and Diagnostic Radiology, Clinical Hospital Center Rijeka, Rijeka, Croatia
| | - Manudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA, United States
| | - Luca Saba
- Department of Radiology, A.O.U., Cagliari, Italy
| | - Jasjit S. Suri
- Department of ECE, Idaho State University, Pocatello, ID, United States
- Department of Computer Science, Graphic Era Deemed to Be University, Dehradun, Uttarakhand, India
- Symbiosis Institute of Technology, Nagpur Campus, Symbiosis International (Deemed University), Pune, India
- Stroke and Monitoring Division, AtheroPoint LLC, Roseville, CA, United States
| |
Collapse
|
3
|
Kang DH, Kim GHJ, Park SB, Lee SI, Koh JS, Brown MS, Abtin F, McNitt-Gray MF, Goldin JG, Lee JS. Quantitative Computed Tomography Lung COVID Scores with Laboratory Markers: Utilization to Predict Rapid Progression and Monitor Longitudinal Changes in Patients with Coronavirus 2019 (COVID-19) Pneumonia. Biomedicines 2024; 12:120. [PMID: 38255225 PMCID: PMC10813449 DOI: 10.3390/biomedicines12010120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2023] [Revised: 12/27/2023] [Accepted: 01/04/2024] [Indexed: 01/24/2024] Open
Abstract
Coronavirus disease 2019 (COVID-19), is an ongoing issue in certain populations, presenting rapidly worsening pneumonia and persistent symptoms. This study aimed to test the predictability of rapid progression using radiographic scores and laboratory markers and present longitudinal changes. This retrospective study included 218 COVID-19 pneumonia patients admitted at the Chungnam National University Hospital. Rapid progression was defined as respiratory failure requiring mechanical ventilation within one week of hospitalization. Quantitative COVID (QCOVID) scores were derived from high-resolution computed tomography (CT) analyses: (1) ground glass opacity (QGGO), (2) mixed diseases (QMD), and (3) consolidation (QCON), and the sum, quantitative total lung diseases (QTLD). Laboratory data, including inflammatory markers, were obtained from electronic medical records. Rapid progression was observed in 9.6% of patients. All QCOVID scores predicted rapid progression, with QMD showing the best predictability (AUC = 0.813). In multivariate analyses, the QMD score and interleukin(IL)-6 level were important predictors for rapid progression (AUC = 0.864). With >2 months follow-up CT, remained lung lesions were observed in 21 subjects, even after several weeks of negative reverse transcription polymerase chain reaction test. AI-driven quantitative CT scores in conjugation with laboratory markers can be useful in predicting the rapid progression and monitoring of COVID-19.
Collapse
Affiliation(s)
- Da Hyun Kang
- Department of Internal Medicine, College of Medicine, Chungnam National University, Daejeon 35015, Republic of Korea; (D.H.K.); (S.-I.L.); (J.S.K.)
| | - Grace Hyun J. Kim
- Department of Biostatistics, Fielding School of Public Health, University of California, Los Angeles, CA 90095, USA;
- Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles, CA 90024, USA; (M.S.B.); (F.A.); (M.F.M.-G.)
| | - Sa-Beom Park
- Center of Biohealth Convergence and Open Sharing System, Hongik University, Seoul 04401, Republic of Korea;
| | - Song-I Lee
- Department of Internal Medicine, College of Medicine, Chungnam National University, Daejeon 35015, Republic of Korea; (D.H.K.); (S.-I.L.); (J.S.K.)
| | - Jeong Suk Koh
- Department of Internal Medicine, College of Medicine, Chungnam National University, Daejeon 35015, Republic of Korea; (D.H.K.); (S.-I.L.); (J.S.K.)
| | - Matthew S. Brown
- Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles, CA 90024, USA; (M.S.B.); (F.A.); (M.F.M.-G.)
| | - Fereidoun Abtin
- Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles, CA 90024, USA; (M.S.B.); (F.A.); (M.F.M.-G.)
| | - Michael F. McNitt-Gray
- Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles, CA 90024, USA; (M.S.B.); (F.A.); (M.F.M.-G.)
| | - Jonathan G. Goldin
- Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles, CA 90024, USA; (M.S.B.); (F.A.); (M.F.M.-G.)
| | - Jeong Seok Lee
- Graduate School of Medical Science and Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea
| |
Collapse
|
4
|
Kuanr M, Mohapatra P, Mittal S, Maindarkar M, Fouda MM, Saba L, Saxena S, Suri JS. Recommender System for the Efficient Treatment of COVID-19 Using a Convolutional Neural Network Model and Image Similarity. Diagnostics (Basel) 2022; 12:2700. [PMID: 36359545 PMCID: PMC9689970 DOI: 10.3390/diagnostics12112700] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2022] [Revised: 10/30/2022] [Accepted: 11/03/2022] [Indexed: 09/09/2023] Open
Abstract
Background: Hospitals face a significant problem meeting patients' medical needs during epidemics, especially when the number of patients increases rapidly, as seen during the recent COVID-19 pandemic. This study designs a treatment recommender system (RS) for the efficient management of human capital and resources such as doctors, medicines, and resources in hospitals. We hypothesize that a deep learning framework, when combined with search paradigms in an image framework, can make the RS very efficient. Methodology: This study uses a Convolutional neural network (CNN) model for the feature extraction of the images and discovers the most similar patients. The input queries patients from the hospital database with similar chest X-ray images. It uses a similarity metric for the similarity computation of the images. Results: This methodology recommends the doctors, medicines, and resources associated with similar patients to a COVID-19 patients being admitted to the hospital. The performance of the proposed RS is verified with five different feature extraction CNN models and four similarity measures. The proposed RS with a ResNet-50 CNN feature extraction model and Maxwell-Boltzmann similarity is found to be a proper framework for treatment recommendation with a mean average precision of more than 0.90 for threshold similarities in the range of 0.7 to 0.9 and an average highest cosine similarity of more than 0.95. Conclusions: Overall, an RS with a CNN model and image similarity is proven as an efficient tool for the proper management of resources during the peak period of pandemics and can be adopted in clinical settings.
Collapse
Affiliation(s)
- Madhusree Kuanr
- Department of Computer Science and Engineering, IIIT, Bhubaneswar 751003, India
| | | | - Sanchi Mittal
- Department of Computer Science and Engineering, IIIT, Bhubaneswar 751003, India
| | - Mahesh Maindarkar
- Stroke Monitoring and Diagnostic Division, AtheroPointTM, Roseville, CA 95661, USA
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA
| | - Luca Saba
- Department of Radiology, University of Cagliari, 09123 Cagliari, Italy
| | - Sanjay Saxena
- Department of Computer Science and Engineering, IIIT, Bhubaneswar 751003, India
| | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPointTM, Roseville, CA 95661, USA
- Knowledge Engineering Center, Global Biomedical Technologies, Inc., Roseville, CA 95661, USA
| |
Collapse
|
5
|
Muzoğlu N, Halefoğlu AM, Avci MO, Kaya Karaaslan M, Yarman BSB. Detection of COVID-19 and its pulmonary stage using Bayesian hyperparameter optimization and deep feature selection methods. EXPERT SYSTEMS 2022; 40:e13141. [PMID: 36245832 PMCID: PMC9537791 DOI: 10.1111/exsy.13141] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Revised: 07/25/2022] [Accepted: 09/05/2022] [Indexed: 06/16/2023]
Abstract
Since the first case of COVID-19 was reported in December 2019, many studies have been carried out on artificial intelligence for the rapid diagnosis of the disease to support health services. Therefore, in this study, we present a powerful approach to detect COVID-19 and COVID-19 findings from computed tomography images using pre-trained models using two different datasets. COVID-19, influenza A (H1N1) pneumonia, bacterial pneumonia and healthy lung image classes were used in the first dataset. Consolidation, crazy-paving pattern, ground-glass opacity, ground-glass opacity and consolidation, ground-glass opacity and nodule classes were used in the second dataset. The study consists of four steps. In the first two steps, distinctive features were extracted from the final layers of the pre-trained ShuffleNet, GoogLeNet and MobileNetV2 models trained with the datasets. In the next steps, the most relevant features were selected from the models using the Sine-Cosine optimization algorithm. Then, the hyperparameters of the Support Vector Machines were optimized with the Bayesian optimization algorithm and used to reclassify the feature subset that achieved the highest accuracy in the third step. The overall accuracy obtained for the first and second datasets is 99.46% and 99.82%, respectively. Finally, the performance of the results visualized with Occlusion Sensitivity Maps was compared with Gradient-weighted class activation mapping. The approach proposed in this paper outperformed other methods in detecting COVID-19 from multiclass viral pneumonia. Moreover, detecting the stages of COVID-19 in the lungs was an innovative and successful approach.
Collapse
Affiliation(s)
- Nedim Muzoğlu
- Department of Biomedical Engineering, Faculty of EngineeringIstanbul University‐CerrahpasaIstanbulTurkey
| | - Ahmet Mesrur Halefoğlu
- Department of RadiologySisli Hamidiye Etfal Training and Research Hospital, Health Sciences UniversityIstanbulTurkey
| | - Muhammed Onur Avci
- Department of Biomedical Engineering, Faculty of EngineeringIstanbul University‐CerrahpasaIstanbulTurkey
| | - Melike Kaya Karaaslan
- Department of Biomedical SciencesFaculty of Engineering, Kocaeli UniversityKocaeliTurkey
| | - Bekir Sıddık Binboğa Yarman
- Department of Electrical‐Electronics Engineering, Faculty of EngineeringIstanbul University‐CerrahpasaIstanbulTurkey
| |
Collapse
|
6
|
Negroni D, Carriero S, Passarella I, Siani A, Biondetti P, Pizzolante A, Saba L, Guzzardi G. Preliminary Analysis of the Effects of Ad26.COV2.S Vaccination on CT Findings and High Intensive Care Admission Rates of COVID-19 Patients. Tomography 2022; 8:2403-2410. [PMID: 36287798 PMCID: PMC9611738 DOI: 10.3390/tomography8050199] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Revised: 09/19/2022] [Accepted: 09/20/2022] [Indexed: 11/16/2022] Open
Abstract
On 27 February 2021, the Food and Drug Administration(FDA) authorized the administration of the adenovirus-based Ad26.COV2-S vaccine (J&J-Janssen) for the prevention of COVID-19, a viral pandemic that, to date, has killed more than 5.5 million people. Performed during the early phase of the COVID-19 4th wave, this retrospective observational study aims to report the computerized tomography (CT) findings and intensive care unit admission rates of Ad26.COV2-S-vaccinated vs. unvaccinated COVID-19 patients. From the 1st to the 23rd of December 2021, all confirmed COVID-19 patients that had been subjected to chest non-contrast CT scan analysis were enrolled in the study. These were divided into Ad26.COV2.S-vaccinated (group 1) and unvaccinated patients (group 2). The RSNA severity score was calculated for each patient and correlated to CT findings and type of admission to a healthcare setting after CT-i.e., home care, ordinary hospitalization, sub-intensive care, and intensive care. Descriptive and inference statistical analyses were performed by comparing the data from the two groups. Data from a total of 71 patients were collected: 10 patients in group 1 (4M, 6F, mean age 63.5 years, SD ± 4.2) and 61 patients in group 2 (32M, 29F, mean age 64.7 years, SD ± 3.7). Statistical analysis showed lower values of RSNA severity in group 1 compared to group 2 (mean value 14.1 vs. 15.7, p = 0.009, respectively). Furthermore, vaccinated patients were less frequently admitted to both sub-intensive and high-intensive care units than group 2, with an odds ratio of 0.45 [95%CI (0.01; 3.92)]. Ad26.COV2.S vaccination protects from severe COVID-19 based on CT severity scores. As a result, Ad26.COV2.S-vaccinated COVID-19 patients are more frequently admitted to home in comparison with unvaccinated patients.
Collapse
Affiliation(s)
- Davide Negroni
- Department of Radiology, University of Piemonte Orientale, Piedmont, 28100 Novara, Italy
| | - Serena Carriero
- Department of Radiology, Fondazione IRCCS Ca’ Granda Ospedale Maggiore Policlinico, 20122 Milan, Italy
| | - Ilaria Passarella
- Departement of Internal Medicine, ASST Ovest Milanese Ospedale Fornaroli, 20013 Magenta, Italy
| | - Agnese Siani
- Department of Radiology, University of Piemonte Orientale, Piedmont, 28100 Novara, Italy
| | - Pierpaolo Biondetti
- Department of Radiology, Fondazione IRCCS Ca’ Granda Ospedale Maggiore Policlinico, 20122 Milan, Italy
| | - Antonio Pizzolante
- Department of Radiology, University of Piemonte Orientale, Piedmont, 28100 Novara, Italy
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria Cagliari, 09124 Polo di Monserrato, Italy
| | - Giuseppe Guzzardi
- Department of Radiology, University of Piemonte Orientale, Piedmont, 28100 Novara, Italy
| |
Collapse
|
7
|
Suri JS, Agarwal S, Saba L, Chabert GL, Carriero A, Paschè A, Danna P, Mehmedović A, Faa G, Jujaray T, Singh IM, Khanna NN, Laird JR, Sfikakis PP, Agarwal V, Teji JS, R Yadav R, Nagy F, Kincses ZT, Ruzsa Z, Viskovic K, Kalra MK. Multicenter Study on COVID-19 Lung Computed Tomography Segmentation with varying Glass Ground Opacities using Unseen Deep Learning Artificial Intelligence Paradigms: COVLIAS 1.0 Validation. J Med Syst 2022; 46:62. [PMID: 35988110 PMCID: PMC9392994 DOI: 10.1007/s10916-022-01850-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Accepted: 08/02/2022] [Indexed: 11/09/2022]
Abstract
Variations in COVID-19 lesions such as glass ground opacities (GGO), consolidations, and crazy paving can compromise the ability of solo-deep learning (SDL) or hybrid-deep learning (HDL) artificial intelligence (AI) models in predicting automated COVID-19 lung segmentation in Computed Tomography (CT) from unseen data leading to poor clinical manifestations. As the first study of its kind, “COVLIAS 1.0-Unseen” proves two hypotheses, (i) contrast adjustment is vital for AI, and (ii) HDL is superior to SDL. In a multicenter study, 10,000 CT slices were collected from 72 Italian (ITA) patients with low-GGO, and 80 Croatian (CRO) patients with high-GGO. Hounsfield Units (HU) were automatically adjusted to train the AI models and predict from test data, leading to four combinations—two Unseen sets: (i) train-CRO:test-ITA, (ii) train-ITA:test-CRO, and two Seen sets: (iii) train-CRO:test-CRO, (iv) train-ITA:test-ITA. COVILAS used three SDL models: PSPNet, SegNet, UNet and six HDL models: VGG-PSPNet, VGG-SegNet, VGG-UNet, ResNet-PSPNet, ResNet-SegNet, and ResNet-UNet. Two trained, blinded senior radiologists conducted ground truth annotations. Five types of performance metrics were used to validate COVLIAS 1.0-Unseen which was further benchmarked against MedSeg, an open-source web-based system. After HU adjustment for DS and JI, HDL (Unseen AI) > SDL (Unseen AI) by 4% and 5%, respectively. For CC, HDL (Unseen AI) > SDL (Unseen AI) by 6%. The COVLIAS-MedSeg difference was < 5%, meeting regulatory guidelines.Unseen AI was successfully demonstrated using automated HU adjustment. HDL was found to be superior to SDL.
Collapse
|
8
|
Agarwal M, Agarwal S, Saba L, Chabert GL, Gupta S, Carriero A, Pasche A, Danna P, Mehmedovic A, Faa G, Shrivastava S, Jain K, Jain H, Jujaray T, Singh IM, Turk M, Chadha PS, Johri AM, Khanna NN, Mavrogeni S, Laird JR, Sobel DW, Miner M, Balestrieri A, Sfikakis PP, Tsoulfas G, Misra DP, Agarwal V, Kitas GD, Teji JS, Al-Maini M, Dhanjil SK, Nicolaides A, Sharma A, Rathore V, Fatemi M, Alizad A, Krishnan PR, Yadav RR, Nagy F, Kincses ZT, Ruzsa Z, Naidu S, Viskovic K, Kalra MK, Suri JS. Eight pruning deep learning models for low storage and high-speed COVID-19 computed tomography lung segmentation and heatmap-based lesion localization: A multicenter study using COVLIAS 2.0. Comput Biol Med 2022; 146:105571. [PMID: 35751196 PMCID: PMC9123805 DOI: 10.1016/j.compbiomed.2022.105571] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Revised: 04/05/2022] [Accepted: 04/26/2022] [Indexed: 12/12/2022]
Abstract
BACKGROUND COVLIAS 1.0: an automated lung segmentation was designed for COVID-19 diagnosis. It has issues related to storage space and speed. This study shows that COVLIAS 2.0 uses pruned AI (PAI) networks for improving both storage and speed, wiliest high performance on lung segmentation and lesion localization. METHOD ology: The proposed study uses multicenter ∼9,000 CT slices from two different nations, namely, CroMed from Croatia (80 patients, experimental data), and NovMed from Italy (72 patients, validation data). We hypothesize that by using pruning and evolutionary optimization algorithms, the size of the AI models can be reduced significantly, ensuring optimal performance. Eight different pruning techniques (i) differential evolution (DE), (ii) genetic algorithm (GA), (iii) particle swarm optimization algorithm (PSO), and (iv) whale optimization algorithm (WO) in two deep learning frameworks (i) Fully connected network (FCN) and (ii) SegNet were designed. COVLIAS 2.0 was validated using "Unseen NovMed" and benchmarked against MedSeg. Statistical tests for stability and reliability were also conducted. RESULTS Pruning algorithms (i) FCN-DE, (ii) FCN-GA, (iii) FCN-PSO, and (iv) FCN-WO showed improvement in storage by 92.4%, 95.3%, 98.7%, and 99.8% respectively when compared against solo FCN, and (v) SegNet-DE, (vi) SegNet-GA, (vii) SegNet-PSO, and (viii) SegNet-WO showed improvement by 97.1%, 97.9%, 98.8%, and 99.2% respectively when compared against solo SegNet. AUC > 0.94 (p < 0.0001) on CroMed and > 0.86 (p < 0.0001) on NovMed data set for all eight EA model. PAI <0.25 s per image. DenseNet-121-based Grad-CAM heatmaps showed validation on glass ground opacity lesions. CONCLUSIONS Eight PAI networks that were successfully validated are five times faster, storage efficient, and could be used in clinical settings.
Collapse
Affiliation(s)
- Mohit Agarwal
- Department of Computer Science Engineering, Bennett University, India
| | - Sushant Agarwal
- Department of Computer Science Engineering, PSIT, Kanpur, India; Advanced Knowledge Engineering Centre, Global Biomedical Technologies, Inc., Roseville, CA 95661, USA
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Gian Luca Chabert
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Suneet Gupta
- Department of Computer Science Engineering, Bennett University, India
| | - Alessandro Carriero
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Alessio Pasche
- Depart of Radiology, "Maggiore della Carità" Hospital, University of Piemonte Orientale, Via Solaroli 17, 28100, Novara, Italy
| | - Pietro Danna
- Depart of Radiology, "Maggiore della Carità" Hospital, University of Piemonte Orientale, Via Solaroli 17, 28100, Novara, Italy
| | | | - Gavino Faa
- Department of Pathology - AOU of Cagliari, Italy
| | - Saurabh Shrivastava
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad, 244001, India
| | - Kanishka Jain
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad, 244001, India
| | - Harsh Jain
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad, 244001, India
| | - Tanay Jujaray
- Dept of Molecular, Cell and Developmental Biology, University of California, Santa Cruz, CA, USA
| | | | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, Delmenhorst, Germany
| | | | - Amer M Johri
- Division of Cardiology, Queen's University, Kingston, Ontario, Canada
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, Athens, Greece
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | - David W Sobel
- Minimally Invasive Urology Institute, Brown University, Providence, RI, USA
| | - Martin Miner
- Men's Health Center, Miriam Hospital Providence, Rhode Island, USA
| | - Antonella Balestrieri
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Greece
| | - George Tsoulfas
- Aristoteleion University of Thessaloniki, Thessaloniki, Greece
| | | | | | - George D Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK; Arthritis Research UK Epidemiology Unit, Manchester University, Manchester, UK
| | - Jagjit S Teji
- Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, USA
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, Canada
| | | | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre and Univ. of Nicosia Medical School, Cyprus
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA, USA
| | | | - Mostafa Fatemi
- Dept. of Physiology & Biomedical Engg., Mayo Clinic College of Medicine and Science, MN, USA
| | - Azra Alizad
- Dept. of Radiology, Mayo Clinic College of Medicine and Science, MN, USA
| | | | | | - Frence Nagy
- Department of Radiology, University of Szeged, 6725, Hungary
| | | | - Zoltan Ruzsa
- Invasive Cardiology Division, University of Szeged, Budapest, Hungary
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN, USA
| | | | - Manudeep K Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA, USA
| | - Jasjit S Suri
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad, 244001, India; Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, USA.
| |
Collapse
|
9
|
COVLIAS 2.0-cXAI: Cloud-Based Explainable Deep Learning System for COVID-19 Lesion Localization in Computed Tomography Scans. Diagnostics (Basel) 2022; 12:diagnostics12061482. [PMID: 35741292 PMCID: PMC9221733 DOI: 10.3390/diagnostics12061482] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2022] [Revised: 06/07/2022] [Accepted: 06/13/2022] [Indexed: 02/07/2023] Open
Abstract
Background: The previous COVID-19 lung diagnosis system lacks both scientific validation and the role of explainable artificial intelligence (AI) for understanding lesion localization. This study presents a cloud-based explainable AI, the “COVLIAS 2.0-cXAI” system using four kinds of class activation maps (CAM) models. Methodology: Our cohort consisted of ~6000 CT slices from two sources (Croatia, 80 COVID-19 patients and Italy, 15 control patients). COVLIAS 2.0-cXAI design consisted of three stages: (i) automated lung segmentation using hybrid deep learning ResNet-UNet model by automatic adjustment of Hounsfield units, hyperparameter optimization, and parallel and distributed training, (ii) classification using three kinds of DenseNet (DN) models (DN-121, DN-169, DN-201), and (iii) validation using four kinds of CAM visualization techniques: gradient-weighted class activation mapping (Grad-CAM), Grad-CAM++, score-weighted CAM (Score-CAM), and FasterScore-CAM. The COVLIAS 2.0-cXAI was validated by three trained senior radiologists for its stability and reliability. The Friedman test was also performed on the scores of the three radiologists. Results: The ResNet-UNet segmentation model resulted in dice similarity of 0.96, Jaccard index of 0.93, a correlation coefficient of 0.99, with a figure-of-merit of 95.99%, while the classifier accuracies for the three DN nets (DN-121, DN-169, and DN-201) were 98%, 98%, and 99% with a loss of ~0.003, ~0.0025, and ~0.002 using 50 epochs, respectively. The mean AUC for all three DN models was 0.99 (p < 0.0001). The COVLIAS 2.0-cXAI showed 80% scans for mean alignment index (MAI) between heatmaps and gold standard, a score of four out of five, establishing the system for clinical settings. Conclusions: The COVLIAS 2.0-cXAI successfully showed a cloud-based explainable AI system for lesion localization in lung CT scans.
Collapse
|
10
|
Gülbay M, Baştuğ A, Özkan E, Öztürk BY, Mendi BAR, Bodur H. Evaluation of the models generated from clinical features and deep learning-based segmentations: Can thoracic CT on admission help us to predict hospitalized COVID-19 patients who will require intensive care? BMC Med Imaging 2022; 22:110. [PMID: 35672719 PMCID: PMC9172094 DOI: 10.1186/s12880-022-00833-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2021] [Accepted: 05/27/2022] [Indexed: 01/09/2023] Open
Abstract
BACKGROUND The aim of the study was to predict the probability of intensive care unit (ICU) care for inpatient COVID-19 cases using clinical and artificial intelligence segmentation-based volumetric and CT-radiomics parameters on admission. METHODS Twenty-eight clinical/laboratory features, 21 volumetric parameters, and 74 radiomics parameters obtained by deep learning (DL)-based segmentations from CT examinations of 191 severe COVID-19 inpatients admitted between March 2020 and March 2021 were collected. Patients were divided into Group 1 (117 patients discharged from the inpatient service) and Group 2 (74 patients transferred to the ICU), and the differences between the groups were evaluated with the T-test and Mann-Whitney test. The sensitivities and specificities of significantly different parameters were evaluated by ROC analysis. Subsequently, 152 (79.5%) patients were assigned to the training/cross-validation set, and 39 (20.5%) patients were assigned to the test set. Clinical, radiological, and combined logit-fit models were generated by using the Bayesian information criterion from the training set and optimized via tenfold cross-validation. To simultaneously use all of the clinical, volumetric, and radiomics parameters, a random forest model was produced, and this model was trained by using a balanced training set created by adding synthetic data to the existing training/cross-validation set. The results of the models in predicting ICU patients were evaluated with the test set. RESULTS No parameter individually created a reliable classifier. When the test set was evaluated with the final models, the AUC values were 0.736, 0.708, and 0.794, the specificity values were 79.17%, 79.17%, and 87.50%, the sensitivity values were 66.67%, 60%, and 73.33%, and the F1 values were 0.67, 0.62, and 0.76 for the clinical, radiological, and combined logit-fit models, respectively. The random forest model that was trained with the balanced training/cross-validation set was the most successful model, achieving an AUC of 0.837, specificity of 87.50%, sensitivity of 80%, and F1 value of 0.80 in the test set. CONCLUSION By using a machine learning algorithm that was composed of clinical and DL-segmentation-based radiological parameters and that was trained with a balanced data set, COVID-19 patients who may require intensive care could be successfully predicted.
Collapse
Affiliation(s)
- Mutlu Gülbay
- Department of Radiology, Ankara City Hospital, Üniversiteler Mahallesi 1604. Cadde No: 9, 06800, Çankaya, Ankara, Turkey.
| | - Aliye Baştuğ
- Department of Infectious Diseases and Clinical Microbiology, University of Health Sciences Turkey, Gülhane Faculty of Medicine, Ankara City Hospital, Ankara, Turkey
| | - Erdem Özkan
- Department of Radiology, Ankara City Hospital, Üniversiteler Mahallesi 1604. Cadde No: 9, 06800, Çankaya, Ankara, Turkey
| | - Büşra Yüce Öztürk
- Department of Clinical Microbiology and Infectious Diseases, Ankara City Hospital, Ankara, Turkey
| | - Bökebatur Ahmet Raşit Mendi
- Department of Radiology, Ankara City Hospital, Üniversiteler Mahallesi 1604. Cadde No: 9, 06800, Çankaya, Ankara, Turkey
| | - Hürrem Bodur
- Department of Infectious Diseases and Clinical Microbiology, University of Health Sciences Turkey, Gülhane Faculty of Medicine, Ankara City Hospital, Ankara, Turkey
| |
Collapse
|
11
|
Negroni D, Zagaria D, Paladini A, Falaschi Z, Arcoraci A, Barini M, Carriero A. COVID-19 CT Scan Lung Segmentation: How We Do It. J Digit Imaging 2022; 35:424-431. [PMID: 35091874 PMCID: PMC8796745 DOI: 10.1007/s10278-022-00593-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Revised: 01/18/2022] [Accepted: 01/19/2022] [Indexed: 12/15/2022] Open
Abstract
The National Health Systems have been severely stressed out by the COVID-19 pandemic because 14% of patients require hospitalization and oxygen support, and 5% require admission to an Intensive Care Unit (ICU). Relationship between COVID-19 prognosis and the extent of alterations on chest CT obtained by both visual and software-based quantification that expresses objective evaluations of the percentage of ventilated lung parenchyma compared to the affected one has been proven. While commercial applications for automatic medical image computing and visualization are expensive and limited in their spread, the open-source systems are characterized by not enough standardization and time-consuming troubles. We analyzed chest CT exams on 246 patients suspected of COVID-19 performed in the Emergency Department CT room. The lung parenchyma segmentation was obtained by a threshold-based method using the open-source 3D Slicer software and software tools called "Segment Editor" and "Segment Quantification." For the three main characteristics analyzed on lungs affected by COVID-19 pneumonia, a specifical densitometry value range was defined: from - 950 to - 700 HU for well-aerated parenchyma; from - 700 to - 250 HU for interstitial lung disease; from - 250 to 250 HU for parenchymal consolidation. For the well-aerated parenchyma and the interstitial alterations, the procedure was semi-automatic with low time consumption, whereas consolidations' analysis needed manual interventions by the operator. After the chest CT, 13% of the sample was admitted to intensive care, while 34% of them to the sub-intensive care. In patients moved to intensive care, the parenchyma analysis reported a higher crazy paving presentation. The quantitative analysis of the alterations affecting the lung parenchyma of patients with COVID-19 pneumonia can be performed by threshold method segmentation on 3D Slicer. The segmentation could have an important role in the quantification in different COVID-19 pneumonia presentations, allowing to help the clinician in the correct management of patients.
Collapse
Affiliation(s)
- Davide Negroni
- Department of Radiology, “Maggiore Della Carità” Hospital, AOU Maggiore Della Carità, Corso Mazzini 18, Novara, Italy
| | - Domenico Zagaria
- Department of Radiology, “Maggiore Della Carità” Hospital, AOU Maggiore Della Carità, Corso Mazzini 18, Novara, Italy
| | - Andrea Paladini
- Department of Radiology, “Maggiore Della Carità” Hospital, AOU Maggiore Della Carità, Corso Mazzini 18, Novara, Italy
| | - Zeno Falaschi
- Department of Radiology, “Maggiore Della Carità” Hospital, AOU Maggiore Della Carità, Corso Mazzini 18, Novara, Italy
| | - Anna Arcoraci
- Department of Radiology, “Maggiore Della Carità” Hospital, AOU Maggiore Della Carità, Corso Mazzini 18, Novara, Italy
| | - Michela Barini
- Department of Radiology, “Maggiore Della Carità” Hospital, AOU Maggiore Della Carità, Corso Mazzini 18, Novara, Italy
| | - Alessandro Carriero
- Department of Radiology, “Maggiore Della Carità” Hospital, AOU Maggiore Della Carità, Corso Mazzini 18, Novara, Italy
| |
Collapse
|
12
|
Suri JS, Agarwal S, Chabert GL, Carriero A, Paschè A, Danna PSC, Saba L, Mehmedović A, Faa G, Singh IM, Turk M, Chadha PS, Johri AM, Khanna NN, Mavrogeni S, Laird JR, Pareek G, Miner M, Sobel DW, Balestrieri A, Sfikakis PP, Tsoulfas G, Protogerou AD, Misra DP, Agarwal V, Kitas GD, Teji JS, Al-Maini M, Dhanjil SK, Nicolaides A, Sharma A, Rathore V, Fatemi M, Alizad A, Krishnan PR, Nagy F, Ruzsa Z, Fouda MM, Naidu S, Viskovic K, Kalra MK. COVLIAS 1.0 Lesion vs. MedSeg: An Artificial Intelligence Framework for Automated Lesion Segmentation in COVID-19 Lung Computed Tomography Scans. Diagnostics (Basel) 2022; 12:1283. [PMID: 35626438 PMCID: PMC9141749 DOI: 10.3390/diagnostics12051283] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2022] [Revised: 05/18/2022] [Accepted: 05/19/2022] [Indexed: 02/01/2023] Open
Abstract
Background: COVID-19 is a disease with multiple variants, and is quickly spreading throughout the world. It is crucial to identify patients who are suspected of having COVID-19 early, because the vaccine is not readily available in certain parts of the world. Methodology: Lung computed tomography (CT) imaging can be used to diagnose COVID-19 as an alternative to the RT-PCR test in some cases. The occurrence of ground-glass opacities in the lung region is a characteristic of COVID-19 in chest CT scans, and these are daunting to locate and segment manually. The proposed study consists of a combination of solo deep learning (DL) and hybrid DL (HDL) models to tackle the lesion location and segmentation more quickly. One DL and four HDL models—namely, PSPNet, VGG-SegNet, ResNet-SegNet, VGG-UNet, and ResNet-UNet—were trained by an expert radiologist. The training scheme adopted a fivefold cross-validation strategy on a cohort of 3000 images selected from a set of 40 COVID-19-positive individuals. Results: The proposed variability study uses tracings from two trained radiologists as part of the validation. Five artificial intelligence (AI) models were benchmarked against MedSeg. The best AI model, ResNet-UNet, was superior to MedSeg by 9% and 15% for Dice and Jaccard, respectively, when compared against MD 1, and by 4% and 8%, respectively, when compared against MD 2. Statistical tests—namely, the Mann−Whitney test, paired t-test, and Wilcoxon test—demonstrated its stability and reliability, with p < 0.0001. The online system for each slice was <1 s. Conclusions: The AI models reliably located and segmented COVID-19 lesions in CT scans. The COVLIAS 1.0Lesion lesion locator passed the intervariability test.
Collapse
Affiliation(s)
- Jasjit S. Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA 95661, USA;
| | - Sushant Agarwal
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA 95661, USA;
- Department of Computer Science Engineering, PSIT, Kanpur 209305, India
| | - Gian Luca Chabert
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (G.L.C.); (A.P.); (P.S.C.D.); (L.S.); (A.B.)
| | - Alessandro Carriero
- Department of Radiology, “Maggiore della Carità” Hospital, University of Piemonte Orientale (UPO), Via Solaroli 17, 28100 Novara, Italy;
| | - Alessio Paschè
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (G.L.C.); (A.P.); (P.S.C.D.); (L.S.); (A.B.)
| | - Pietro S. C. Danna
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (G.L.C.); (A.P.); (P.S.C.D.); (L.S.); (A.B.)
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (G.L.C.); (A.P.); (P.S.C.D.); (L.S.); (A.B.)
| | - Armin Mehmedović
- University Hospital for Infectious Diseases, 10000 Zagreb, Croatia; (A.M.); (K.V.)
| | - Gavino Faa
- Department of Pathology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy;
| | - Inder M. Singh
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, 27753 Delmenhorst, Germany;
| | - Paramjit S. Chadha
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
| | - Amer M. Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, 17674 Athens, Greece;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA 94574, USA;
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA; (G.P.); (D.W.S.)
| | - Martin Miner
- Men’s Health Center, Miriam Hospital, Providence, RI 02906, USA;
| | - David W. Sobel
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA; (G.P.); (D.W.S.)
| | - Antonella Balestrieri
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (G.L.C.); (A.P.); (P.S.C.D.); (L.S.); (A.B.)
| | - Petros P. Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, 15772 Athens, Greece;
| | - George Tsoulfas
- Department of Surgery, Aristoteleion University of Thessaloniki, 54124 Thessaloniki, Greece;
| | - Athanasios D. Protogerou
- Cardiovascular Prevention and Research Unit, Department of Pathophysiology, National & Kapodistrian University of Athens, 15772 Athens, Greece;
| | - Durga Prasanna Misra
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - Vikas Agarwal
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK;
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PL, UK
| | - Jagjit S. Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA;
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON L4Z 4C4, Canada;
| | | | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia Medical School, Nicosia 2408, Cyprus;
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22908, USA;
| | - Vijay Rathore
- AtheroPoint LLC, Roseville, CA 95661, USA; (S.K.D.); (V.R.)
| | - Mostafa Fatemi
- Department of Physiology and Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | - Azra Alizad
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | | | - Ferenc Nagy
- Internal Medicine Department, University of Szeged, 6725 Szeged, Hungary;
| | - Zoltan Ruzsa
- Invasive Cardiology Division, University of Szeged, 6725 Szeged, Hungary;
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA;
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN 55812, USA;
| | - Klaudija Viskovic
- University Hospital for Infectious Diseases, 10000 Zagreb, Croatia; (A.M.); (K.V.)
| | - Manudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA;
| |
Collapse
|
13
|
Laino ME, Ammirabile A, Lofino L, Lundon DJ, Chiti A, Francone M, Savevski V. Prognostic findings for ICU admission in patients with COVID-19 pneumonia: baseline and follow-up chest CT and the added value of artificial intelligence. Emerg Radiol 2022; 29:243-262. [PMID: 35048222 PMCID: PMC8769787 DOI: 10.1007/s10140-021-02008-y] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Accepted: 12/03/2021] [Indexed: 01/08/2023]
Abstract
Infection with SARS-CoV-2 has dominated discussion and caused global healthcare and economic crisis over the past 18 months. Coronavirus disease 19 (COVID-19) causes mild-to-moderate symptoms in most individuals. However, rapid deterioration to severe disease with or without acute respiratory distress syndrome (ARDS) can occur within 1-2 weeks from the onset of symptoms in a proportion of patients. Early identification by risk stratifying such patients who are at risk of severe complications of COVID-19 is of great clinical importance. Computed tomography (CT) is widely available and offers the potential for fast triage, robust, rapid, and minimally invasive diagnosis: Ground glass opacities (GGO), crazy-paving pattern (GGO with superimposed septal thickening), and consolidation are the most common chest CT findings in COVID pneumonia. There is growing interest in the prognostic value of baseline chest CT since an early risk stratification of patients with COVID-19 would allow for better resource allocation and could help improve outcomes. Recent studies have demonstrated the utility of baseline chest CT to predict intensive care unit (ICU) admission in patients with COVID-19. Furthermore, developments and progress integrating artificial intelligence (AI) with computer-aided design (CAD) software for diagnostic imaging allow for objective, unbiased, and rapid assessment of CT images.
Collapse
Affiliation(s)
- Maria Elena Laino
- Artificial Intelligence Center, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy
| | - Angela Ammirabile
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy
- Department of Radiology, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy
| | - Ludovica Lofino
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy
- Department of Radiology, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy
| | - Dara Joseph Lundon
- Artificial Intelligence Center, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy
| | - Arturo Chiti
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy
- Humanitas Clinical and Research Center—IRCCS, Via Manzoni 56, 20089 Rozzano, Italy
| | - Marco Francone
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy
- Department of Radiology, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy
| | - Victor Savevski
- Artificial Intelligence Center, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy
| |
Collapse
|
14
|
Brandi N, Ciccarese F, Rimondi MR, Balacchi C, Modolon C, Sportoletti C, Renzulli M, Coppola F, Golfieri R. An Imaging Overview of COVID-19 ARDS in ICU Patients and Its Complications: A Pictorial Review. Diagnostics (Basel) 2022; 12:846. [PMID: 35453894 PMCID: PMC9032937 DOI: 10.3390/diagnostics12040846] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Revised: 03/23/2022] [Accepted: 03/28/2022] [Indexed: 01/08/2023] Open
Abstract
A significant proportion of patients with COVID-19 pneumonia could develop acute respiratory distress syndrome (ARDS), thus requiring mechanical ventilation, and resulting in a high rate of intensive care unit (ICU) admission. Several complications can arise during an ICU stay, from both COVID-19 infection and the respiratory supporting system, including barotraumas (pneumothorax and pneumomediastinum), superimposed pneumonia, coagulation disorders (pulmonary embolism, venous thromboembolism, hemorrhages and acute ischemic stroke), abdominal involvement (acute mesenteric ischemia, pancreatitis and acute kidney injury) and sarcopenia. Imaging plays a pivotal role in the detection and monitoring of ICU complications and is expanding even to prognosis prediction. The present pictorial review describes the clinicopathological and radiological findings of COVID-19 ARDS in ICU patients and discusses the imaging features of complications related to invasive ventilation support, as well as those of COVID-19 itself in this particularly fragile population. Radiologists need to be familiar with COVID-19's possible extra-pulmonary complications and, through reliable and constant monitoring, guide therapeutic decisions. Moreover, as more research is pursued and the pathophysiology of COVID-19 is increasingly understood, the role of imaging must evolve accordingly, expanding from the diagnosis and subsequent management of patients to prognosis prediction.
Collapse
Affiliation(s)
- Nicolò Brandi
- Department of Radiology, IRCCS Azienda Ospedaliero-Universitaria di Bologna, Via Albertoni 15, 40138 Bologna, Italy; (F.C.); (C.B.); (M.R.); (F.C.); (R.G.)
| | - Federica Ciccarese
- Department of Radiology, IRCCS Azienda Ospedaliero-Universitaria di Bologna, Via Albertoni 15, 40138 Bologna, Italy; (F.C.); (C.B.); (M.R.); (F.C.); (R.G.)
| | - Maria Rita Rimondi
- Cardio-Thoracic Radiology Unit, University Hospital S.Orsola-Malpighi, 40138 Bologna, Italy; (M.R.R.); (C.M.); (C.S.)
| | - Caterina Balacchi
- Department of Radiology, IRCCS Azienda Ospedaliero-Universitaria di Bologna, Via Albertoni 15, 40138 Bologna, Italy; (F.C.); (C.B.); (M.R.); (F.C.); (R.G.)
| | - Cecilia Modolon
- Cardio-Thoracic Radiology Unit, University Hospital S.Orsola-Malpighi, 40138 Bologna, Italy; (M.R.R.); (C.M.); (C.S.)
| | - Camilla Sportoletti
- Cardio-Thoracic Radiology Unit, University Hospital S.Orsola-Malpighi, 40138 Bologna, Italy; (M.R.R.); (C.M.); (C.S.)
| | - Matteo Renzulli
- Department of Radiology, IRCCS Azienda Ospedaliero-Universitaria di Bologna, Via Albertoni 15, 40138 Bologna, Italy; (F.C.); (C.B.); (M.R.); (F.C.); (R.G.)
| | - Francesca Coppola
- Department of Radiology, IRCCS Azienda Ospedaliero-Universitaria di Bologna, Via Albertoni 15, 40138 Bologna, Italy; (F.C.); (C.B.); (M.R.); (F.C.); (R.G.)
- Italian Society of Medical and Interventional Radiology, SIRM Foundation, Via della Signora 2, 20122 Milano, Italy
| | - Rita Golfieri
- Department of Radiology, IRCCS Azienda Ospedaliero-Universitaria di Bologna, Via Albertoni 15, 40138 Bologna, Italy; (F.C.); (C.B.); (M.R.); (F.C.); (R.G.)
| |
Collapse
|
15
|
Cau R, Mantini C, Monti L, Mannelli L, Di Dedda E, Mahammedi A, Nicola R, Roubil J, Suri JS, Cerrone G, Fanni D, Faa G, Carriero A, Scuteri A, Francone M, Saba L. Role of imaging in rare COVID-19 vaccine multiorgan complications. Insights Imaging 2022; 13:44. [PMID: 35286509 PMCID: PMC8919150 DOI: 10.1186/s13244-022-01176-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2021] [Accepted: 01/25/2022] [Indexed: 12/19/2022] Open
Abstract
As of September 18th, 2021, global casualties due to COVID-19 infections approach 200 million, several COVID-19 vaccines have been authorized to prevent COVID-19 infection and help mitigate the spread of the virus. Despite the vast majority having safely received vaccination against SARS-COV-2, the rare complications following COVID-19 vaccination have often been life-threatening or fatal. The mechanisms underlying (multi) organ complications are associated with COVID-19, either through direct viral damage or from host immune response (i.e., cytokine storm). The purpose of this manuscript is to review the role of imaging in identifying and elucidating multiorgan complications following SARS-COV-2 vaccination-making clear that, in any case, they represent a minute fraction of those in the general population who have been vaccinated. The authors are both staunch supporters of COVID-19 vaccination and vaccinated themselves as well.
Collapse
Affiliation(s)
- Riccardo Cau
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Polo di Monserrato, s.s. 554 Monserrato, 09045, Cagliari, Italy
| | - Cesare Mantini
- Department of Neuroscience, Imaging and Clinical Sciences, 'G. d'Annunzio' University, Chieti, Italy
| | - Lorenzo Monti
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20090, Milan, Italy
- IRCCS Humanitas Research Hospital, Via Manzoni 56, Rozzano, 20089, Milan, Italy
| | | | - Emanuele Di Dedda
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20090, Milan, Italy
- IRCCS Humanitas Research Hospital, Via Manzoni 56, Rozzano, 20089, Milan, Italy
| | - Abdelkader Mahammedi
- Department of Neuroradiology, University of Cincinnati Medical Center, Cincinnati, OH, USA
| | - Refky Nicola
- Roswell Park Cancer Institute, Jacobs School of Medicine and Biomedical Science, Buffalo, NY, USA
| | - John Roubil
- Roswell Park Cancer Institute, Jacobs School of Medicine and Biomedical Science, Buffalo, NY, USA
| | - Jasjit S Suri
- Stroke Diagnosis and Monitoring Division, Atheropoint LLC, Roseville, CA, USA
| | - Giulia Cerrone
- Department of Pathology, Azienda Ospedaliero Universitaria (A.O.U.) di Cagliari, Cagliari, Italy
| | - Daniela Fanni
- Department of Pathology, Azienda Ospedaliero Universitaria (A.O.U.) di Cagliari, Cagliari, Italy
| | - Gavino Faa
- Department of Pathology, Azienda Ospedaliero Universitaria (A.O.U.) di Cagliari, Cagliari, Italy
| | - Alessandro Carriero
- Department of Diagnostic and Interventional Radiology, AOU Ospedale Maggiore Della Carità Di Novara, Novara, Italy
| | - Angelo Scuteri
- Department of Diagnostic and Interventional Radiology, AOU Ospedale Maggiore Della Carità Di Novara, Novara, Italy
| | - Marco Francone
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20090, Milan, Italy
- IRCCS Humanitas Research Hospital, Via Manzoni 56, Rozzano, 20089, Milan, Italy
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Polo di Monserrato, s.s. 554 Monserrato, 09045, Cagliari, Italy.
| |
Collapse
|
16
|
Nillmani, Jain PK, Sharma N, Kalra MK, Viskovic K, Saba L, Suri JS. Four Types of Multiclass Frameworks for Pneumonia Classification and Its Validation in X-ray Scans Using Seven Types of Deep Learning Artificial Intelligence Models. Diagnostics (Basel) 2022; 12:652. [PMID: 35328205 PMCID: PMC8946935 DOI: 10.3390/diagnostics12030652] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Revised: 03/04/2022] [Accepted: 03/04/2022] [Indexed: 12/31/2022] Open
Abstract
Background and Motivation: The novel coronavirus causing COVID-19 is exceptionally contagious, highly mutative, decimating human health and life, as well as the global economy, by consistent evolution of new pernicious variants and outbreaks. The reverse transcriptase polymerase chain reaction currently used for diagnosis has major limitations. Furthermore, the multiclass lung classification X-ray systems having viral, bacterial, and tubercular classes—including COVID-19—are not reliable. Thus, there is a need for a robust, fast, cost-effective, and easily available diagnostic method. Method: Artificial intelligence (AI) has been shown to revolutionize all walks of life, particularly medical imaging. This study proposes a deep learning AI-based automatic multiclass detection and classification of pneumonia from chest X-ray images that are readily available and highly cost-effective. The study has designed and applied seven highly efficient pre-trained convolutional neural networks—namely, VGG16, VGG19, DenseNet201, Xception, InceptionV3, NasnetMobile, and ResNet152—for classification of up to five classes of pneumonia. Results: The database consisted of 18,603 scans with two, three, and five classes. The best results were using DenseNet201, VGG16, and VGG16, respectively having accuracies of 99.84%, 96.7%, 92.67%; sensitivity of 99.84%, 96.63%, 92.70%; specificity of 99.84, 96.63%, 92.41%; and AUC of 1.0, 0.97, 0.92 (p < 0.0001 for all), respectively. Our system outperformed existing methods by 1.2% for the five-class model. The online system takes <1 s while demonstrating reliability and stability. Conclusions: Deep learning AI is a powerful paradigm for multiclass pneumonia classification.
Collapse
Affiliation(s)
- Nillmani
- School of Biomedical Engineering, Indian Institute of Technology (BHU), Varanasi 221005, India; (N.); (P.K.J.); (N.S.)
| | - Pankaj K. Jain
- School of Biomedical Engineering, Indian Institute of Technology (BHU), Varanasi 221005, India; (N.); (P.K.J.); (N.S.)
| | - Neeraj Sharma
- School of Biomedical Engineering, Indian Institute of Technology (BHU), Varanasi 221005, India; (N.); (P.K.J.); (N.S.)
| | - Mannudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02115, USA;
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, 10000 Zagreb, Croatia;
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 10015 Cagliari, Italy;
| | - Jasjit S. Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint, Roseville, CA 95661, USA
- Knowledge Engineering Center, Global Biomedical Technologies, Inc., Roseville, CA 95661, USA
| |
Collapse
|
17
|
Cau R, Faa G, Nardi V, Balestrieri A, Puig J, Suri JS, SanFilippo R, Saba L. Long-COVID diagnosis: From diagnostic to advanced AI-driven models. Eur J Radiol 2022; 148:110164. [PMID: 35114535 PMCID: PMC8791239 DOI: 10.1016/j.ejrad.2022.110164] [Citation(s) in RCA: 32] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2021] [Revised: 01/11/2022] [Accepted: 01/13/2022] [Indexed: 12/19/2022]
Abstract
SARS-COV 2 is recognized to be responsible for a multi-organ syndrome. In most patients, symptoms are mild. However, in certain subjects, COVID-19 tends to progress more severely. Most of the patients infected with SARS-COV2 fully recovered within some weeks. In a considerable number of patients, like many other viral infections, various long-lasting symptoms have been described, now defined as "long COVID-19 syndrome". Given the high number of contagious over the world, it is necessary to understand and comprehend this emerging pathology to enable early diagnosis and improve patents outcomes. In this scenario, AI-based models can be applied in long-COVID-19 patients to assist clinicians and at the same time, to reduce the considerable impact on the care and rehabilitation unit. The purpose of this manuscript is to review different aspects of long-COVID-19 syndrome from clinical presentation to diagnosis, highlighting the considerable impact that AI can have.
Collapse
Affiliation(s)
- Riccardo Cau
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Polo di Monserrato, s.s. 554 Monserrato, Cagliari 09045, Italy
| | - Gavino Faa
- Department of Pathology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari, Italy
| | - Valentina Nardi
- Department of Cardiovascular Medicine Mayo Clinic, Rochester, MN, USA
| | - Antonella Balestrieri
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Polo di Monserrato, s.s. 554 Monserrato, Cagliari 09045, Italy
| | - Josep Puig
- Department of Radiology (IDI), Hospital Universitari de Girona, Girona, Spain
| | - Jasjit S Suri
- Stroke Diagnosis and Monitoring Division, Atheropoint LLC, Roseville, CA, USA
| | - Roberto SanFilippo
- Department of Vascular Surgery, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Polo di Monserrato, s.s. 554 Monserrato, Cagliari 09045, Italy
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Polo di Monserrato, s.s. 554 Monserrato, Cagliari 09045, Italy.
| |
Collapse
|
18
|
Suri JS, Agarwal S, Elavarthi P, Pathak R, Ketireddy V, Columbu M, Saba L, Gupta SK, Faa G, Singh IM, Turk M, Chadha PS, Johri AM, Khanna NN, Viskovic K, Mavrogeni S, Laird JR, Pareek G, Miner M, Sobel DW, Balestrieri A, Sfikakis PP, Tsoulfas G, Protogerou A, Misra DP, Agarwal V, Kitas GD, Teji JS, Al-Maini M, Dhanjil SK, Nicolaides A, Sharma A, Rathore V, Fatemi M, Alizad A, Krishnan PR, Ferenc N, Ruzsa Z, Gupta A, Naidu S, Kalra MK. Inter-Variability Study of COVLIAS 1.0: Hybrid Deep Learning Models for COVID-19 Lung Segmentation in Computed Tomography. Diagnostics (Basel) 2021; 11:2025. [PMID: 34829372 PMCID: PMC8625039 DOI: 10.3390/diagnostics11112025] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Revised: 10/26/2021] [Accepted: 10/27/2021] [Indexed: 02/05/2023] Open
Abstract
Background: For COVID-19 lung severity, segmentation of lungs on computed tomography (CT) is the first crucial step. Current deep learning (DL)-based Artificial Intelligence (AI) models have a bias in the training stage of segmentation because only one set of ground truth (GT) annotations are evaluated. We propose a robust and stable inter-variability analysis of CT lung segmentation in COVID-19 to avoid the effect of bias. Methodology: The proposed inter-variability study consists of two GT tracers for lung segmentation on chest CT. Three AI models, PSP Net, VGG-SegNet, and ResNet-SegNet, were trained using GT annotations. We hypothesized that if AI models are trained on the GT tracings from multiple experience levels, and if the AI performance on the test data between these AI models is within the 5% range, one can consider such an AI model robust and unbiased. The K5 protocol (training to testing: 80%:20%) was adapted. Ten kinds of metrics were used for performance evaluation. Results: The database consisted of 5000 CT chest images from 72 COVID-19-infected patients. By computing the coefficient of correlations (CC) between the output of the two AI models trained corresponding to the two GT tracers, computing their differences in their CC, and repeating the process for all three AI-models, we show the differences as 0%, 0.51%, and 2.04% (all < 5%), thereby validating the hypothesis. The performance was comparable; however, it had the following order: ResNet-SegNet > PSP Net > VGG-SegNet. Conclusions: The AI models were clinically robust and stable during the inter-variability analysis on the CT lung segmentation on COVID-19 patients.
Collapse
Affiliation(s)
- Jasjit S. Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA 95661, USA; (S.A.); (P.E.)
| | - Sushant Agarwal
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA 95661, USA; (S.A.); (P.E.)
- Department of Computer Science Engineering, PSIT, Kanpur 209305, India
| | - Pranav Elavarthi
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA 95661, USA; (S.A.); (P.E.)
- Thomas Jefferson High School for Science and Technology, Alexandria, VA 22312, USA
| | - Rajesh Pathak
- Department of Computer Science Engineering, Rawatpura Sarkar University, Raipur 492001, India;
| | | | - Marta Columbu
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 10015 Cagliari, Italy; (M.C.); (L.S.); (A.B.)
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 10015 Cagliari, Italy; (M.C.); (L.S.); (A.B.)
| | - Suneet K. Gupta
- Department of Computer Science, Bennett University, Noida 201310, India;
| | - Gavino Faa
- Department of Pathology, Azienda Ospedaliero Universitaria (A.O.U.), 10015 Cagliari, Italy;
| | - Inder M. Singh
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, 27753 Delmenhorst, Germany;
| | - Paramjit S. Chadha
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
| | - Amer M. Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | | | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, 10558 Athens, Greece;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA;
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA; (G.P.); (D.W.S.)
| | - Martin Miner
- Men’s Health Center, Miriam Hospital, Providence, RI 02906, USA;
| | - David W. Sobel
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA; (G.P.); (D.W.S.)
| | - Antonella Balestrieri
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 10015 Cagliari, Italy; (M.C.); (L.S.); (A.B.)
| | - Petros P. Sfikakis
- Rheumatology Unit, National & Kapodistrian University of Athens, 10679 Athens, Greece;
| | - George Tsoulfas
- Aristoteleion University of Thessaloniki, 54636 Thessaloniki, Greece;
| | | | - Durga Prasanna Misra
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - Vikas Agarwal
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK;
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PT, UK
| | - Jagjit S. Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA;
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON L4Z 4C4, Canada;
| | | | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia Medical School, Nicosia 2368, Cyprus;
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22904, USA;
| | - Vijay Rathore
- AtheroPoint LLC, Roseville, CA 95611, USA; (S.K.D.); (V.R.)
| | - Mostafa Fatemi
- Department of Physiology & Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | - Azra Alizad
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | | | - Nagy Ferenc
- Internal Medicine Department, University of Szeged, 6725 Szeged, Hungary;
| | - Zoltan Ruzsa
- Zoltan Invasive Cardiology Division, University of Szeged, 6725 Szeged, Hungary;
| | - Archna Gupta
- Radiology Department, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India;
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN 55812, USA;
| | - Mannudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA;
| |
Collapse
|
19
|
Cau R, Pacielli A, Fatemeh H, Vaudano P, Arru C, Crivelli P, Stranieri G, Suri JS, Mannelli L, Conti M, Mahammedi A, Kalra M, Saba L. Complications in COVID-19 patients: Characteristics of pulmonary embolism. Clin Imaging 2021; 77:244-249. [PMID: 34029929 PMCID: PMC8130594 DOI: 10.1016/j.clinimag.2021.05.016] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2021] [Revised: 05/09/2021] [Accepted: 05/16/2021] [Indexed: 12/20/2022]
Abstract
OBJECTIVE The purpose of this study is to evaluate chest CT imaging features, clinical characteristics, laboratory values of COVID-19 patients who underwent CTA for suspected pulmonary embolism. We also examined whether clinical, laboratory or radiological characteristics could be associated with a higher rate of PE. MATERIALS AND METHODS This retrospective study included 84 consecutive patients with laboratory-confirmed SARS-CoV-2 who underwent CTA for suspected PE. The presence and localization of PE as well as the type and extent of pulmonary opacities on chest CT exams were examined and correlated with the information on comorbidities and laboratory values for all patients. RESULTS Of the 84 patients, pulmonary embolism was discovered in 24 patients. We observed that 87% of PE was found to be in lung parenchyma affected by COVID-19 pneumonia. Compared with no-PE patients, PE patients showed an overall greater lung involvement by consolidation (p = 0.02) and GGO (p < 0.01) and a higher level of D-Dimer (p < 0,01). Moreover, the PE group showed a lower level of saturation (p = 0,01) and required more hospitalization (p < 0,01). CONCLUSION Our study showed a high incidence of PE in COVID-19 pneumonia. In 87% of patients, PE was found in lung parenchyma affected by COVID-19 pneumonia with a worse CT severity score and a greater number of lung lobar involvement compared with non-PE patients. CT severity, lower level of saturation, and a rise in D-dimer levels could be an indication for a CTPA. ADVANCES IN KNOWLEDGE Certain findings of non-contrast chest CT could be an indication for a CTPA.
Collapse
Affiliation(s)
- Riccardo Cau
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Polo di Monserrato s.s. 554, Monserrato (Cagliari) 09045, Italy
| | - Alberto Pacielli
- Department of Radiology, Ospedale S. Giovanni Bosco, 10154 Turin, Italy
| | - Homayounieh Fatemeh
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA, USA
| | - Paolo Vaudano
- Department of Radiology, Ospedale S. Giovanni Bosco, 10154 Turin, Italy
| | - Chiara Arru
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Polo di Monserrato s.s. 554, Monserrato (Cagliari) 09045, Italy
| | - Paola Crivelli
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Sassari - Sassari, Italy
| | | | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA
| | | | - Maurizio Conti
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Sassari - Sassari, Italy
| | - Abdelkader Mahammedi
- Department of Neuroradiology, University of Cincinnati Medical Center, OH 45267, USA
| | - Mannudeep Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA, USA
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Polo di Monserrato s.s. 554, Monserrato (Cagliari) 09045, Italy.
| |
Collapse
|
20
|
Suri JS, Agarwal S, Pathak R, Ketireddy V, Columbu M, Saba L, Gupta SK, Faa G, Singh IM, Turk M, Chadha PS, Johri AM, Khanna NN, Viskovic K, Mavrogeni S, Laird JR, Pareek G, Miner M, Sobel DW, Balestrieri A, Sfikakis PP, Tsoulfas G, Protogerou A, Misra DP, Agarwal V, Kitas GD, Teji JS, Al-Maini M, Dhanjil SK, Nicolaides A, Sharma A, Rathore V, Fatemi M, Alizad A, Krishnan PR, Frence N, Ruzsa Z, Gupta A, Naidu S, Kalra M. COVLIAS 1.0: Lung Segmentation in COVID-19 Computed Tomography Scans Using Hybrid Deep Learning Artificial Intelligence Models. Diagnostics (Basel) 2021; 11:1405. [PMID: 34441340 PMCID: PMC8392426 DOI: 10.3390/diagnostics11081405] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2021] [Revised: 07/28/2021] [Accepted: 07/29/2021] [Indexed: 02/05/2023] Open
Abstract
BACKGROUND COVID-19 lung segmentation using Computed Tomography (CT) scans is important for the diagnosis of lung severity. The process of automated lung segmentation is challenging due to (a) CT radiation dosage and (b) ground-glass opacities caused by COVID-19. The lung segmentation methodologies proposed in 2020 were semi- or automated but not reliable, accurate, and user-friendly. The proposed study presents a COVID Lung Image Analysis System (COVLIAS 1.0, AtheroPoint™, Roseville, CA, USA) consisting of hybrid deep learning (HDL) models for lung segmentation. METHODOLOGY The COVLIAS 1.0 consists of three methods based on solo deep learning (SDL) or hybrid deep learning (HDL). SegNet is proposed in the SDL category while VGG-SegNet and ResNet-SegNet are designed under the HDL paradigm. The three proposed AI approaches were benchmarked against the National Institute of Health (NIH)-based conventional segmentation model using fuzzy-connectedness. A cross-validation protocol with a 40:60 ratio between training and testing was designed, with 10% validation data. The ground truth (GT) was manually traced by a radiologist trained personnel. For performance evaluation, nine different criteria were selected to perform the evaluation of SDL or HDL lung segmentation regions and lungs long axis against GT. RESULTS Using the database of 5000 chest CT images (from 72 patients), COVLIAS 1.0 yielded AUC of ~0.96, ~0.97, ~0.98, and ~0.96 (p-value < 0.001), respectively within 5% range of GT area, for SegNet, VGG-SegNet, ResNet-SegNet, and NIH. The mean Figure of Merit using four models (left and right lung) was above 94%. On benchmarking against the National Institute of Health (NIH) segmentation method, the proposed model demonstrated a 58% and 44% improvement in ResNet-SegNet, 52% and 36% improvement in VGG-SegNet for lung area, and lung long axis, respectively. The PE statistics performance was in the following order: ResNet-SegNet > VGG-SegNet > NIH > SegNet. The HDL runs in <1 s on test data per image. CONCLUSIONS The COVLIAS 1.0 system can be applied in real-time for radiology-based clinical settings.
Collapse
Affiliation(s)
- Jasjit S. Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA 95661, USA;
| | - Sushant Agarwal
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA 95661, USA;
- Department of Computer Science Engineering, PSIT, Kanpur 209305, India
| | - Rajesh Pathak
- Department of Computer Science Engineering, Rawatpura Sarkar University, Raipur 492015, India;
| | | | - Marta Columbu
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (M.C.); (L.S.); (A.B.)
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (M.C.); (L.S.); (A.B.)
| | - Suneet K. Gupta
- Department of Computer Science, Bennett University, Noida 201310, India;
| | - Gavino Faa
- Department of Pathology—AOU of Cagliari, 09124 Cagliari, Italy;
| | - Inder M. Singh
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, 27753 Delmenhorst, Germany;
| | - Paramjit S. Chadha
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
| | - Amer M. Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 208011, India;
| | - Klaudija Viskovic
- Department of Radiology, University Hospital for Infectious Diseases, 10000 Zagreb, Croatia;
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, 176 74 Athens, Greece;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA;
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence City, RI 02912, USA; (G.P.); (D.W.S.)
| | - Martin Miner
- Men’s Health Center, Miriam Hospital Providence, Providence, RI 02906, USA;
| | - David W. Sobel
- Minimally Invasive Urology Institute, Brown University, Providence City, RI 02912, USA; (G.P.); (D.W.S.)
| | - Antonella Balestrieri
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (M.C.); (L.S.); (A.B.)
| | - Petros P. Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, 157 72 Athens, Greece;
| | - George Tsoulfas
- Department of Transplantation Surgery, Aristoteleion University of Thessaloniki, 541 24 Thessaloniki, Greece;
| | | | - Durga Prasanna Misra
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - Vikas Agarwal
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK;
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PL, UK
| | - Jagjit S. Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA;
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON M5G 1N8, Canada;
| | | | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia Medical School, Nicosia 2408, Cyprus;
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22904, USA;
| | - Vijay Rathore
- Athero Point LLC, Roseville, CA 95611, USA; (S.K.D.); (V.R.)
| | - Mostafa Fatemi
- Department of Physiology & Biomedical Engg., Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | - Azra Alizad
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | | | - Nagy Frence
- Department of Internal Medicines, Invasive Cardiology Division, University of Szeged, 6720 Szeged, Hungary; (N.F.); (Z.R.)
| | - Zoltan Ruzsa
- Department of Internal Medicines, Invasive Cardiology Division, University of Szeged, 6720 Szeged, Hungary; (N.F.); (Z.R.)
| | - Archna Gupta
- Radiology Department, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India;
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN 55455, USA;
| | - Mannudeep Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA;
| |
Collapse
|