1
|
Karthik R, Menaka R, Hariharan M, Won D. CT-based severity assessment for COVID-19 using weakly supervised non-local CNN. Appl Soft Comput 2022; 121:108765. [PMID: 35370523 PMCID: PMC8962065 DOI: 10.1016/j.asoc.2022.108765] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2021] [Revised: 02/28/2022] [Accepted: 03/17/2022] [Indexed: 01/09/2023]
Abstract
Evaluating patient criticality is the foremost step in administering appropriate COVID-19 treatment protocols. Learning an Artificial Intelligence (AI) model from clinical data for automatic risk-stratification enables accelerated response to patients displaying critical indicators. Chest CT manifestations including ground-glass opacities and consolidations are a reliable indicator for prognostic studies and show variability with patient condition. To this end, we propose a novel attention framework to estimate COVID-19 severity as a regression score from a weakly annotated CT scan dataset. It takes a non-locality approach that correlates features across different parts and spatial scales of the 3D scan. An explicit guidance mechanism from limited infection labeling drives attention refinement and feature modulation. The resulting encoded representation is further enriched through cross-channel attention. The attention model also infuses global contextual awareness into the deep voxel features by querying the base CT scan to mine relevant features. Consequently, it learns to effectively localize its focus region and chisel out the infection precisely. Experimental validation on the MosMed dataset shows that the proposed architecture has significant potential in augmenting existing methods as it achieved a 0.84 R-squared score and 0.133 mean absolute difference.
Collapse
|
2
|
Laino ME, Ammirabile A, Lofino L, Lundon DJ, Chiti A, Francone M, Savevski V. Prognostic findings for ICU admission in patients with COVID-19 pneumonia: baseline and follow-up chest CT and the added value of artificial intelligence. Emerg Radiol 2022; 29:243-262. [PMID: 35048222 PMCID: PMC8769787 DOI: 10.1007/s10140-021-02008-y] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Accepted: 12/03/2021] [Indexed: 01/08/2023]
Abstract
Infection with SARS-CoV-2 has dominated discussion and caused global healthcare and economic crisis over the past 18 months. Coronavirus disease 19 (COVID-19) causes mild-to-moderate symptoms in most individuals. However, rapid deterioration to severe disease with or without acute respiratory distress syndrome (ARDS) can occur within 1-2 weeks from the onset of symptoms in a proportion of patients. Early identification by risk stratifying such patients who are at risk of severe complications of COVID-19 is of great clinical importance. Computed tomography (CT) is widely available and offers the potential for fast triage, robust, rapid, and minimally invasive diagnosis: Ground glass opacities (GGO), crazy-paving pattern (GGO with superimposed septal thickening), and consolidation are the most common chest CT findings in COVID pneumonia. There is growing interest in the prognostic value of baseline chest CT since an early risk stratification of patients with COVID-19 would allow for better resource allocation and could help improve outcomes. Recent studies have demonstrated the utility of baseline chest CT to predict intensive care unit (ICU) admission in patients with COVID-19. Furthermore, developments and progress integrating artificial intelligence (AI) with computer-aided design (CAD) software for diagnostic imaging allow for objective, unbiased, and rapid assessment of CT images.
Collapse
Affiliation(s)
- Maria Elena Laino
- Artificial Intelligence Center, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy
| | - Angela Ammirabile
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy
- Department of Radiology, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy
| | - Ludovica Lofino
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy
- Department of Radiology, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy
| | - Dara Joseph Lundon
- Artificial Intelligence Center, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy
| | - Arturo Chiti
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy
- Humanitas Clinical and Research Center—IRCCS, Via Manzoni 56, 20089 Rozzano, Italy
| | - Marco Francone
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy
- Department of Radiology, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy
| | - Victor Savevski
- Artificial Intelligence Center, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy
| |
Collapse
|
3
|
de Moura LV, Mattjie C, Dartora CM, Barros RC, Marques da Silva AM. Explainable Machine Learning for COVID-19 Pneumonia Classification With Texture-Based Features Extraction in Chest Radiography. Front Digit Health 2022; 3:662343. [PMID: 35112097 PMCID: PMC8801500 DOI: 10.3389/fdgth.2021.662343] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Accepted: 11/29/2021] [Indexed: 12/18/2022] Open
Abstract
Both reverse transcription-PCR (RT-PCR) and chest X-rays are used for the diagnosis of the coronavirus disease-2019 (COVID-19). However, COVID-19 pneumonia does not have a defined set of radiological findings. Our work aims to investigate radiomic features and classification models to differentiate chest X-ray images of COVID-19-based pneumonia and other types of lung patterns. The goal is to provide grounds for understanding the distinctive COVID-19 radiographic texture features using supervised ensemble machine learning methods based on trees through the interpretable Shapley Additive Explanations (SHAP) approach. We use 2,611 COVID-19 chest X-ray images and 2,611 non-COVID-19 chest X-rays. After segmenting the lung in three zones and laterally, a histogram normalization is applied, and radiomic features are extracted. SHAP recursive feature elimination with cross-validation is used to select features. Hyperparameter optimization of XGBoost and Random Forest ensemble tree models is applied using random search. The best classification model was XGBoost, with an accuracy of 0.82 and a sensitivity of 0.82. The explainable model showed the importance of the middle left and superior right lung zones in classifying COVID-19 pneumonia from other lung patterns.
Collapse
Affiliation(s)
- Luís Vinícius de Moura
- Medical Image Computing Laboratory, School of Technology, Pontifical Catholic University of Rio Grande do Sul, PUCRS, Porto Alegre, Brazil
| | - Christian Mattjie
- Medical Image Computing Laboratory, School of Technology, Pontifical Catholic University of Rio Grande do Sul, PUCRS, Porto Alegre, Brazil
- Graduate Program in Biomedical Gerontology, School of Medicine, Pontifical Catholic University of Rio Grande do Sul, PUCRS, Porto Alegre, Brazil
| | - Caroline Machado Dartora
- Medical Image Computing Laboratory, School of Technology, Pontifical Catholic University of Rio Grande do Sul, PUCRS, Porto Alegre, Brazil
- Graduate Program in Biomedical Gerontology, School of Medicine, Pontifical Catholic University of Rio Grande do Sul, PUCRS, Porto Alegre, Brazil
| | - Rodrigo C. Barros
- Machine Learning Theory and Applications Lab, School of Technology, Pontifical Catholic University of Rio Grande do Sul, PUCRS, Porto Alegre, Brazil
| | - Ana Maria Marques da Silva
- Medical Image Computing Laboratory, School of Technology, Pontifical Catholic University of Rio Grande do Sul, PUCRS, Porto Alegre, Brazil
- Graduate Program in Biomedical Gerontology, School of Medicine, Pontifical Catholic University of Rio Grande do Sul, PUCRS, Porto Alegre, Brazil
| |
Collapse
|
4
|
Gudigar A, Raghavendra U, Nayak S, Ooi CP, Chan WY, Gangavarapu MR, Dharmik C, Samanth J, Kadri NA, Hasikin K, Barua PD, Chakraborty S, Ciaccio EJ, Acharya UR. Role of Artificial Intelligence in COVID-19 Detection. SENSORS (BASEL, SWITZERLAND) 2021; 21:8045. [PMID: 34884045 PMCID: PMC8659534 DOI: 10.3390/s21238045] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Revised: 11/26/2021] [Accepted: 11/26/2021] [Indexed: 12/15/2022]
Abstract
The global pandemic of coronavirus disease (COVID-19) has caused millions of deaths and affected the livelihood of many more people. Early and rapid detection of COVID-19 is a challenging task for the medical community, but it is also crucial in stopping the spread of the SARS-CoV-2 virus. Prior substantiation of artificial intelligence (AI) in various fields of science has encouraged researchers to further address this problem. Various medical imaging modalities including X-ray, computed tomography (CT) and ultrasound (US) using AI techniques have greatly helped to curb the COVID-19 outbreak by assisting with early diagnosis. We carried out a systematic review on state-of-the-art AI techniques applied with X-ray, CT, and US images to detect COVID-19. In this paper, we discuss approaches used by various authors and the significance of these research efforts, the potential challenges, and future trends related to the implementation of an AI system for disease detection during the COVID-19 pandemic.
Collapse
Affiliation(s)
- Anjan Gudigar
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - U Raghavendra
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Sneha Nayak
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Chui Ping Ooi
- School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore;
| | - Wai Yee Chan
- Department of Biomedical Imaging, Faculty of Medicine, University of Malaya, Kuala Lumpur 50603, Malaysia;
| | - Mokshagna Rohit Gangavarapu
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Chinmay Dharmik
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Jyothi Samanth
- Department of Cardiovascular Technology, Manipal College of Health Professions, Manipal Academy of Higher Education, Manipal 576104, India;
| | - Nahrizul Adib Kadri
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia; (N.A.K.); (K.H.)
| | - Khairunnisa Hasikin
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia; (N.A.K.); (K.H.)
| | - Prabal Datta Barua
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW 2010, Australia;
- School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD 4350, Australia
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia;
| | - Subrata Chakraborty
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia;
- Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW 2351, Australia
| | - Edward J. Ciaccio
- Department of Medicine, Columbia University Medical Center, New York, NY 10032, USA;
| | - U. Rajendra Acharya
- School of Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore;
- Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung 41354, Taiwan
- International Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto 860-8555, Japan
| |
Collapse
|
5
|
Laino ME, Ammirabile A, Posa A, Cancian P, Shalaby S, Savevski V, Neri E. The Applications of Artificial Intelligence in Chest Imaging of COVID-19 Patients: A Literature Review. Diagnostics (Basel) 2021; 11:1317. [PMID: 34441252 PMCID: PMC8394327 DOI: 10.3390/diagnostics11081317] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Revised: 07/02/2021] [Accepted: 07/09/2021] [Indexed: 12/23/2022] Open
Abstract
Diagnostic imaging is regarded as fundamental in the clinical work-up of patients with a suspected or confirmed COVID-19 infection. Recent progress has been made in diagnostic imaging with the integration of artificial intelligence (AI) and machine learning (ML) algorisms leading to an increase in the accuracy of exam interpretation and to the extraction of prognostic information useful in the decision-making process. Considering the ever expanding imaging data generated amid this pandemic, COVID-19 has catalyzed the rapid expansion in the application of AI to combat disease. In this context, many recent studies have explored the role of AI in each of the presumed applications for COVID-19 infection chest imaging, suggesting that implementing AI applications for chest imaging can be a great asset for fast and precise disease screening, identification and characterization. However, various biases should be overcome in the development of further ML-based algorithms to give them sufficient robustness and reproducibility for their integration into clinical practice. As a result, in this literature review, we will focus on the application of AI in chest imaging, in particular, deep learning, radiomics and advanced imaging as quantitative CT.
Collapse
Affiliation(s)
- Maria Elena Laino
- Artificial Intelligence Center, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy; (P.C.); (V.S.)
| | - Angela Ammirabile
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy;
- Department of Radiology, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy
| | - Alessandro Posa
- Department of Diagnostic Imaging, Oncological Radiotherapy and Hematology, Fondazione Policlinico Universitario Agostino Gemelli—IRCCS, 00168 Rome, Italy;
| | - Pierandrea Cancian
- Artificial Intelligence Center, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy; (P.C.); (V.S.)
| | - Sherif Shalaby
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Via Roma 67, 56126 Pisa, Italy; (S.S.); (E.N.)
| | - Victor Savevski
- Artificial Intelligence Center, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy; (P.C.); (V.S.)
| | - Emanuele Neri
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Via Roma 67, 56126 Pisa, Italy; (S.S.); (E.N.)
- Italian Society of Medical and Interventional Radiology, SIRM Foundation, Via della Signora 2, 20122 Milano, Italy
| |
Collapse
|
6
|
Pang B, Li H, Liu Q, Wu P, Xia T, Zhang X, Le W, Li J, Lai L, Ou C, Ma J, Liu S, Zhou F, Wang X, Xie J, Zhang Q, Jiang M, Liu Y, Zeng Q. CT Quantification of COVID-19 Pneumonia at Admission Can Predict Progression to Critical Illness: A Retrospective Multicenter Cohort Study. Front Med (Lausanne) 2021; 8:689568. [PMID: 34222293 PMCID: PMC8245676 DOI: 10.3389/fmed.2021.689568] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Accepted: 05/10/2021] [Indexed: 01/10/2023] Open
Abstract
Objective: Early identification of coronavirus disease 2019 (COVID-19) patients with worse outcomes may benefit clinical management of patients. We aimed to quantify pneumonia findings on CT at admission to predict progression to critical illness in COVID-19 patients. Methods: This retrospective study included laboratory-confirmed adult patients with COVID-19. All patients underwent a thin-section chest computed tomography (CT) scans showing evidence of pneumonia. CT images with severe moving artifacts were excluded from analysis. Patients' clinical and laboratory data were collected from medical records. Three quantitative CT features of pneumonia lesions were automatically calculated using a care.ai Intelligent Multi-disciplinary Imaging Diagnosis Platform Intelligent Evaluation System of Chest CT for COVID-19, denoting the percentage of pneumonia volume (PPV), ground-glass opacity volume (PGV), and consolidation volume (PCV). According to Chinese COVID-19 guidelines (trial version 7), patients were divided into noncritical and critical groups. Critical illness was defined as a composite of admission to the intensive care unit, respiratory failure requiring mechanical ventilation, shock, or death. The performance of PPV, PGV, and PCV in discrimination of critical illness was assessed. The correlations between PPV and laboratory variables were assessed by Pearson correlation analysis. Results: A total of 140 patients were included, with mean age of 58.6 years, and 85 (60.7%) were male. Thirty-two (22.9%) patients were critical. Using a cutoff value of 22.6%, the PPV had the highest performance in predicting critical illness, with an area under the curve of 0.868, sensitivity of 81.3%, and specificity of 80.6%. The PPV had moderately positive correlation with neutrophil (%) (r = 0.535, p < 0.001), erythrocyte sedimentation rate (r = 0.567, p < 0.001), d-Dimer (r = 0.444, p < 0.001), high-sensitivity C-reactive protein (r = 0.495, p < 0.001), aspartate aminotransferase (r = 0.410, p < 0.001), lactate dehydrogenase (r = 0.644, p < 0.001), and urea nitrogen (r = 0.439, p < 0.001), whereas the PPV had moderately negative correlation with lymphocyte (%) (r = −0.535, p < 0.001). Conclusions: Pneumonia volume quantified on initial CT can non-invasively predict the progression to critical illness in advance, which serve as a prognostic marker of COVID-19.
Collapse
Affiliation(s)
- Baoguo Pang
- Department of Radiology, Huangpi District Hospital of Traditional Chinese Medicine, Wuhan, China
| | - Haijun Li
- Department of Radiology, Han Kou Hospital of Wuhan, Wuhan, China
| | - Qin Liu
- Department of Radiology, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Penghui Wu
- Pulmonary and Critical Care Medicine, National Clinical Research Center for Respiratory Disease, National Center for Respiratory Medicine, State Key Laboratory of Respiratory Diseases, Guangzhou Institute of Respiratory Health, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Tingting Xia
- Department of Radiology, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Xiaoxian Zhang
- Pulmonary and Critical Care Medicine, National Clinical Research Center for Respiratory Disease, National Center for Respiratory Medicine, State Key Laboratory of Respiratory Diseases, Guangzhou Institute of Respiratory Health, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Wenjun Le
- Department of Respiratory, First Affiliated Hospital of Guangxi University of Science and Technology, Liuzhou, China
| | - Jianyu Li
- Department of Radiology, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Lihua Lai
- Department of Radiology, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Changxing Ou
- Pulmonary and Critical Care Medicine, National Clinical Research Center for Respiratory Disease, National Center for Respiratory Medicine, State Key Laboratory of Respiratory Diseases, Guangzhou Institute of Respiratory Health, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Jianjuan Ma
- Department of Pediatric Hematology, Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Shuai Liu
- Department of Hematology, Dawu County People's Hospital, Wuhan, China
| | - Fuling Zhou
- Department of Hematology, Zhongnan Hospital of Wuhan University, Wuhan, China
| | - Xinlu Wang
- Department of Nuclear Medicine, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Jiaxing Xie
- National Clinical Research Center for Respiratory Disease, State Key Laboratory of Respiratory Diseases, Department of Allergy and Clinical Immunology, Guangzhou Institute of Respiratory Health, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Qingling Zhang
- Pulmonary and Critical Care Medicine, National Clinical Research Center for Respiratory Disease, National Center for Respiratory Medicine, State Key Laboratory of Respiratory Diseases, Guangzhou Institute of Respiratory Health, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Min Jiang
- Department of Pediatrics, The First Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Yumei Liu
- Department of Respiratory, Hankou Hospital of Wuhan, Wuhan, China
| | - Qingsi Zeng
- Department of Radiology, The First Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| |
Collapse
|
7
|
Fighting Together against the Pandemic: Learning Multiple Models on Tomography Images for COVID-19 Diagnosis. AI 2021. [DOI: 10.3390/ai2020016] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
COVID-19 has been a great challenge for humanity since the year 2020. The whole world has made a huge effort to find an effective vaccine in order to save those not yet infected. The alternative solution is early diagnosis, carried out through real-time polymerase chain reaction (RT-PCR) tests or thorax Computer Tomography (CT) scan images. Deep learning algorithms, specifically convolutional neural networks, represent a methodology for image analysis. They optimize the classification design task, which is essential for an automatic approach with different types of images, including medical. In this paper, we adopt a pretrained deep convolutional neural network architecture in order to diagnose COVID-19 disease from CT images. Our idea is inspired by what the whole of humanity is achieving, as the set of multiple contributions is better than any single one for the fight against the pandemic. First, we adapt, and subsequently retrain for our assumption, some neural architectures that have been adopted in other application domains. Secondly, we combine the knowledge extracted from images by the neural architectures in an ensemble classification context. Our experimental phase is performed on a CT image dataset, and the results obtained show the effectiveness of the proposed approach with respect to the state-of-the-art competitors.
Collapse
|