1
|
Xie P, Zhao X, He X. Improve the performance of CT-based pneumonia classification via source data reweighting. Sci Rep 2023; 13:9401. [PMID: 37296239 PMCID: PMC10251339 DOI: 10.1038/s41598-023-35938-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2022] [Accepted: 05/26/2023] [Indexed: 06/12/2023] Open
Abstract
Pneumonia is a life-threatening disease. Computer tomography (CT) imaging is broadly used for diagnosing pneumonia. To assist radiologists in accurately and efficiently detecting pneumonia from CT scans, many deep learning methods have been developed. These methods require large amounts of annotated CT scans, which are difficult to obtain due to privacy concerns and high annotation costs. To address this problem, we develop a three-level optimization based method which leverages CT data from a source domain to mitigate the lack of labeled CT scans in a target domain. Our method automatically identifies and downweights low-quality source CT data examples which are noisy or have large domain discrepancy with target data, by minimizing the validation loss of a target model trained on reweighted source data. On a target dataset with 2218 CT scans and a source dataset with 349 CT images, our method achieves an F1 score of 91.8% in detecting pneumonia and an F1 score of 92.4% in detecting other types of pneumonia, which are significantly better than those achieved by state-of-the-art baseline methods.
Collapse
Affiliation(s)
- Pengtao Xie
- Department of Electrical and Computer Engineering, University of California San Diego, San Diego, USA.
| | - Xingchen Zhao
- Department of Electrical and Computer Engineering, Northeastern University, Boston, USA
| | - Xuehai He
- Department of Computer Science and Engineering, University of California Santa Cruz, Santa Cruz, USA
| |
Collapse
|
2
|
Rehman A, Khan A, Fatima G, Naz S, Razzak I. Review on chest pathogies detection systems using deep learning techniques. Artif Intell Rev 2023; 56:1-47. [PMID: 37362896 PMCID: PMC10027283 DOI: 10.1007/s10462-023-10457-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
Abstract
Chest radiography is the standard and most affordable way to diagnose, analyze, and examine different thoracic and chest diseases. Typically, the radiograph is examined by an expert radiologist or physician to decide about a particular anomaly, if exists. Moreover, computer-aided methods are used to assist radiologists and make the analysis process accurate, fast, and more automated. A tremendous improvement in automatic chest pathologies detection and analysis can be observed with the emergence of deep learning. The survey aims to review, technically evaluate, and synthesize the different computer-aided chest pathologies detection systems. The state-of-the-art of single and multi-pathologies detection systems, which are published in the last five years, are thoroughly discussed. The taxonomy of image acquisition, dataset preprocessing, feature extraction, and deep learning models are presented. The mathematical concepts related to feature extraction model architectures are discussed. Moreover, the different articles are compared based on their contributions, datasets, methods used, and the results achieved. The article ends with the main findings, current trends, challenges, and future recommendations.
Collapse
Affiliation(s)
- Arshia Rehman
- COMSATS University Islamabad, Abbottabad-Campus, Abbottabad, Pakistan
| | - Ahmad Khan
- COMSATS University Islamabad, Abbottabad-Campus, Abbottabad, Pakistan
| | - Gohar Fatima
- The Islamia University of Bahawalpur, Bahawal Nagar Campus, Bahawal Nagar, Pakistan
| | - Saeeda Naz
- Govt Girls Post Graduate College No.1, Abbottabad, Pakistan
| | - Imran Razzak
- School of Computer Science and Engineering, University of New South Wales, Sydney, Australia
| |
Collapse
|
3
|
Bhosale YH, Patnaik KS. Bio-medical imaging (X-ray, CT, ultrasound, ECG), genome sequences applications of deep neural network and machine learning in diagnosis, detection, classification, and segmentation of COVID-19: a Meta-analysis & systematic review. MULTIMEDIA TOOLS AND APPLICATIONS 2023:1-54. [PMID: 37362676 PMCID: PMC10015538 DOI: 10.1007/s11042-023-15029-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/12/2022] [Revised: 02/01/2023] [Accepted: 02/27/2023] [Indexed: 06/28/2023]
Abstract
This review investigates how Deep Machine Learning (DML) has dealt with the Covid-19 epidemic and provides recommendations for future Covid-19 research. Despite the fact that vaccines for this epidemic have been developed, DL methods have proven to be a valuable asset in radiologists' arsenals for the automated assessment of Covid-19. This detailed review debates the techniques and applications developed for Covid-19 findings using DL systems. It also provides insights into notable datasets used to train neural networks, data partitioning, and various performance measurement metrics. The PRISMA taxonomy has been formed based on pretrained(45 systems) and hybrid/custom(17 systems) models with radiography modalities. A total of 62 systems with respect to X-ray(32), CT(19), ultrasound(7), ECG(2), and genome sequence(2) based modalities as taxonomy are selected from the studied articles. We originate by valuing the present phase of DL and conclude with significant limitations. The restrictions contain incomprehensibility, simplification measures, learning from incomplete labeled data, and data secrecy. Moreover, DML can be utilized to detect and classify Covid-19 from other COPD illnesses. The proposed literature review has found many DL-based systems to fight against Covid19. We expect this article will assist in speeding up the procedure of DL for Covid-19 researchers, including medical, radiology technicians, and data engineers.
Collapse
Affiliation(s)
- Yogesh H. Bhosale
- Computer Science and Engineering Department, Birla Institute of Technology, Mesra, Ranchi, India
| | - K. Sridhar Patnaik
- Computer Science and Engineering Department, Birla Institute of Technology, Mesra, Ranchi, India
| |
Collapse
|
4
|
Vinod DN, Prabaharan SRS. COVID-19-The Role of Artificial Intelligence, Machine Learning, and Deep Learning: A Newfangled. ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING : STATE OF THE ART REVIEWS 2023; 30:2667-2682. [PMID: 36685135 PMCID: PMC9843670 DOI: 10.1007/s11831-023-09882-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Accepted: 01/05/2023] [Indexed: 05/29/2023]
Abstract
The absolute previously infected novel coronavirus (COVID-19) was found in Wuhan, China, in December 2019. The COVID-19 epidemic has spread to more than 220 nations and territories globally and has altogether influenced each part of our day-to-day lives. As of 9th March 2022, a total aggregate of 44,78,82,185 (60,07,317) contaminated (dead) COVID-19 cases were accounted for all over the world. The quantities of contaminated cases passing despite everything increment essentially and do not indicate a controlled circumstance. The scope of this paper is to address this issue by presenting a comprehensive and comparative analysis of the existing Machine Learning (ML), Deep Learning (DL) and Artificial Intelligence (AI) based approaches used in significance in reacting to the COVID-19 epidemic and diagnosing the severe impacts. The paper provides, firstly, an overview of COVID-19 infection and highlights of this article; Secondly, an overview of exploring various executive innovations by utilizing different resources to stop the spread of COVID-19; Thirdly, a comparison of existing predicting methods of COVID-19 in the literature, with focus on ML, DL and AI-driven techniques with performance metrics; and finally, a discussion on the results of the work as well as future scope.
Collapse
Affiliation(s)
- Dasari Naga Vinod
- Department of Electronics and Communication Engineering, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Avadi, Chennai, Tamil Nadu 600062 India
| | - S. R. S. Prabaharan
- Sathyabama Centre for Advanced Studies, Sathyabama Institute of Science and Technology, Rajiv Gandhi Salai, Chennai, Tamil Nadu 600119 India
| |
Collapse
|
5
|
Montazeri M, Galavi Z, Ahmadian L. The role of mobile health in prevention, diagnosis, treatment and self-care of COVID-19 from the healthcare professionals' perspectives. Digit Health 2023; 9:20552076231171969. [PMID: 37152239 PMCID: PMC10159248 DOI: 10.1177/20552076231171969] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 04/10/2023] [Indexed: 05/09/2023] Open
Abstract
Background To facilitate disease management, understanding the attitude of healthcare professionals regarding the use of this tool can help mobile health (mHealth) program developers develop appropriate interventions. Aims To assess the perspective of healthcare professionals regarding the contribution of mobile-based interventions in the prevention, diagnosis, self-care, and treatment (PDST) of COVID-19. Methods This is a survey study conducted in 2020 in Iran with 81 questions. In this study mHealth functionalities were categorized into four dimensions including innovative, monitoring and screening, remote services, and education and decision-making. The data were analyzed using descriptive statistics, ANOVA, and the Kruskal-Wallis test to compare the attitudes of the different job groups. Results In total, 123 providers participated, and 87.4% of them reported that mHealth technology is moderate to most helpful for the management of COVID-19. Healthcare professionals believed that mHealth technology could be most helpful in self-care and least helpful in the diagnosis of COVID-19. Regarding the functionalities of the mobile application, the results showed that the use of patient decision aids can be most helpful in self-care and the use of computer games can be least helpful in treatment. The participants believed that mHealth is more effective in monitoring and screening dimensions and less effective in providing remote services. Conclusions This study showed that healthcare professionals believed that mHealth technology could have a better contribution to self-care for patients with COVID-19. Therefore, it is better to plan and invest more in the field of self-care to help patients to combat COVID-19. The results of this study revealed which mhealth functionalities work better in four domains of prevention, treatment, self-care, and diagnosis of COVID-19. This can help healthcare authorities to implement appropriate IT-based interventions to combat COVID-19.
Collapse
Affiliation(s)
- Mahdieh Montazeri
- Department of Health Information Sciences, Faculty
of Management and Medical Information Sciences, Kerman University of Medical
Sciences, Kerman, Iran
| | - Zahra Galavi
- Department of Health Information Sciences, Faculty
of Management and Medical Information Sciences, Kerman University of Medical
Sciences, Kerman, Iran
| | - Leila Ahmadian
- Department of Health Information Sciences, Faculty
of Management and Medical Information Sciences, Kerman University of Medical
Sciences, Kerman, Iran
- Leila Ahmadian, Department of Health
Information Sciences, Faculty of Management and Medical Information Sciences,
Kerman University of Medical Sciences, Haft-bagh Highway, PO Box 7616911320,
Kerman, Iran. Emails: ,
| |
Collapse
|
6
|
Rajamani KT, Rani P, Siebert H, ElagiriRamalingam R, Heinrich MP. Attention-augmented U-Net (AA-U-Net) for semantic segmentation. SIGNAL, IMAGE AND VIDEO PROCESSING 2023; 17:981-989. [PMID: 35910403 PMCID: PMC9311338 DOI: 10.1007/s11760-022-02302-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/27/2021] [Revised: 06/24/2022] [Accepted: 06/27/2022] [Indexed: 05/22/2023]
Abstract
UNLABELLED Deep learning-based image segmentation models rely strongly on capturing sufficient spatial context without requiring complex models that are hard to train with limited labeled data. For COVID-19 infection segmentation on CT images, training data are currently scarce. Attention models, in particular the most recent self-attention methods, have shown to help gather contextual information within deep networks and benefit semantic segmentation tasks. The recent attention-augmented convolution model aims to capture long range interactions by concatenating self-attention and convolution feature maps. This work proposes a novel attention-augmented convolution U-Net (AA-U-Net) that enables a more accurate spatial aggregation of contextual information by integrating attention-augmented convolution in the bottleneck of an encoder-decoder segmentation architecture. A deep segmentation network (U-Net) with this attention mechanism significantly improves the performance of semantic segmentation tasks on challenging COVID-19 lesion segmentation. The validation experiments show that the performance gain of the attention-augmented U-Net comes from their ability to capture dynamic and precise (wider) attention context. The AA-U-Net achieves Dice scores of 72.3% and 61.4% for ground-glass opacity and consolidation lesions for COVID-19 segmentation and improves the accuracy by 4.2% points against a baseline U-Net and 3.09% points compared to a baseline U-Net with matched parameters. SUPPLEMENTARY INFORMATION The online version contains supplementary material available at 10.1007/s11760-022-02302-3.
Collapse
Affiliation(s)
| | - Priya Rani
- Applied Artificial Intelligence Institute, Deakin University, Burwood, VIC 3125 Australia
| | - Hanna Siebert
- Institute of Medical Informatics, University of Lübeck, Luebeck, Germany
| | | | | |
Collapse
|
7
|
Abdulghafor R, Abdelmohsen A, Turaev S, Ali MAH, Wani S. An Analysis of Body Language of Patients Using Artificial Intelligence. Healthcare (Basel) 2022; 10:healthcare10122504. [PMID: 36554028 PMCID: PMC9778650 DOI: 10.3390/healthcare10122504] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Revised: 11/29/2022] [Accepted: 12/01/2022] [Indexed: 12/14/2022] Open
Abstract
In recent decades, epidemic and pandemic illnesses have grown prevalent and are a regular source of concern throughout the world. The extent to which the globe has been affected by the COVID-19 epidemic is well documented. Smart technology is now widely used in medical applications, with the automated detection of status and feelings becoming a significant study area. As a result, a variety of studies have begun to focus on the automated detection of symptoms in individuals infected with a pandemic or epidemic disease by studying their body language. The recognition and interpretation of arm and leg motions, facial recognition, and body postures is still a developing field, and there is a dearth of comprehensive studies that might aid in illness diagnosis utilizing artificial intelligence techniques and technologies. This literature review is a meta review of past papers that utilized AI for body language classification through full-body tracking or facial expressions detection for various tasks such as fall detection and COVID-19 detection, it looks at different methods proposed by each paper, their significance and their results.
Collapse
Affiliation(s)
- Rawad Abdulghafor
- Department of Computer Science, Faculty of Information and Communication Technology, International Islamic University Malaysia, Kuala Lumpur 53100, Malaysia
- Correspondence: (R.A.); (S.T.)
| | - Abdelrahman Abdelmohsen
- Department of Computer Science, Faculty of Information and Communication Technology, International Islamic University Malaysia, Kuala Lumpur 53100, Malaysia
| | - Sherzod Turaev
- Department of Computer Science and Software Engineering, College of Information Technology, United Arab Emirates University, Al Ain 15551, United Arab Emirates
- Correspondence: (R.A.); (S.T.)
| | - Mohammed A. H. Ali
- Department of Mechanical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia
| | - Sharyar Wani
- Department of Computer Science, Faculty of Information and Communication Technology, International Islamic University Malaysia, Kuala Lumpur 53100, Malaysia
| |
Collapse
|
8
|
Babukarthik RG, Chandramohan D, Tripathi D, Kumar M, Sambasivam G. COVID-19 identification in chest X-ray images using intelligent multi-level classification scenario. COMPUTERS & ELECTRICAL ENGINEERING : AN INTERNATIONAL JOURNAL 2022; 104:108405. [PMID: 36187137 PMCID: PMC9510091 DOI: 10.1016/j.compeleceng.2022.108405] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/30/2022] [Revised: 09/17/2022] [Accepted: 09/22/2022] [Indexed: 05/27/2023]
Abstract
COVID-19 is an evolving respiratory transmittable disease, and it holds all daily activity worldwide as a global pandemic. It appeared in the city of Wuhan (China) in November 2019 and slowly started spreading to the rest of the world. The number of cases keeps increasing drastically, leading to a shortage of medical resources and testing kids worldwide. As the physicians facing this problem, several scientists and specialists in Artificial Intelligent (AI) are rendering their support to healthcare professionals in the early detection of COVID-19 using chest X-ray image samples to determine the level of severity at a low cost. This paper proposed Genetic Deep Learning Convolutional Neural Network (GDCNN) architecture that includes Huddle Particle Swarm Optimization as an alternative to Gradient descent. Huddle PSO performs better when clubbed with GDCNN architecture. Based on publicly available datasets, trained chest X-ray images are used to predict and identify various pneumonia diseases. The proposed model performed better with an accuracy of 97.23%, a sensitivity of 98.62%, specificity of 97.0%, and precision of 93.0%. The proposed model act as a tool for earlier detection of COVID-19. In the future, we plan to apply the proposed model for the larger dataset and to predict various lung diseases.
Collapse
Affiliation(s)
- R G Babukarthik
- Department of Computer Science and Engineering, Dayananda Sagar University, Bangalore 560078, India
| | - Dhasarathan Chandramohan
- Department of Computer Science & Engineering, Thapar Institute of Engineering & Technology, Patiala, Punjab, India
| | - Diwakar Tripathi
- Department of Computer Science & Engineering, Thapar Institute of Engineering & Technology, Patiala, Punjab, India
| | - Manish Kumar
- Department of Computer Science & Engineering, Thapar Institute of Engineering & Technology, Patiala, Punjab, India
| | - G Sambasivam
- School of Computing Science and Engineering, VIT Bhopal University, Madhya Pradesh, India
| |
Collapse
|
9
|
Hilal W, Chislett MG, Snider B, McBean EA, Yawney J, Gadsden SA. Use of AI to assess COVID-19 variant impacts on hospitalization, ICU, and death. Front Artif Intell 2022; 5:927203. [DOI: 10.3389/frai.2022.927203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2022] [Accepted: 11/07/2022] [Indexed: 12/05/2022] Open
Abstract
The rapid spread of COVID-19 and its variants have devastated communities worldwide, and as the highly transmissible Omicron variant becomes the dominant strain of the virus in late 2021, the need to characterize and understand the difference between the new variant and its predecessors has been an increasing priority for public health authorities. Artificial Intelligence has played a significant role in the analysis of various facets of COVID-19 since the early stages of the pandemic. This study proposes the use of AI, specifically an XGBoost model, to quantify the impact of various medical risk factors (or “population features”) on the possibility of a patient outcome resulting in hospitalization, ICU admission, or death. The results are compared between the Delta and Omicron COVID-19 variants. Results indicated that older age and an unvaccinated patient status most consistently correspond as the most significant population features contributing to all three scenarios (hospitalization, ICU, death). The top 15 features for each variant-outcome scenario were determined, which most frequently included diabetes, cardiovascular disease, chronic kidney disease, and complications of pneumonia as highly significant population features contributing to serious illness outcomes. The Delta/Hospitalization model returned the highest performance metric scores for the area under the receiver operating characteristic (AUROC), F1, and Recall, while Omicron/ICU and Omicron/Hospitalization had the highest accuracy and precision values, respectively. The recall was found to be above 0.60 in most cases (with only two exceptions), indicating that the total number of false positives was generally minimized (accounting for more of the people who would theoretically require medical care).
Collapse
|
10
|
Calibrated bagging deep learning for image semantic segmentation: A case study on COVID-19 chest X-ray image. PLoS One 2022; 17:e0276250. [DOI: 10.1371/journal.pone.0276250] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2022] [Accepted: 10/03/2022] [Indexed: 11/17/2022] Open
Abstract
Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) causes coronavirus disease 2019 (COVID-19). Imaging tests such as chest X-ray (CXR) and computed tomography (CT) can provide useful information to clinical staff for facilitating a diagnosis of COVID-19 in a more efficient and comprehensive manner. As a breakthrough of artificial intelligence (AI), deep learning has been applied to perform COVID-19 infection region segmentation and disease classification by analyzing CXR and CT data. However, prediction uncertainty of deep learning models for these tasks, which is very important to safety-critical applications like medical image processing, has not been comprehensively investigated. In this work, we propose a novel ensemble deep learning model through integrating bagging deep learning and model calibration to not only enhance segmentation performance, but also reduce prediction uncertainty. The proposed method has been validated on a large dataset that is associated with CXR image segmentation. Experimental results demonstrate that the proposed method can improve the segmentation performance, as well as decrease prediction uncertainty.
Collapse
|
11
|
Xiao B, Yang Z, Qiu X, Xiao J, Wang G, Zeng W, Li W, Nian Y, Chen W. PAM-DenseNet: A Deep Convolutional Neural Network for Computer-Aided COVID-19 Diagnosis. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:12163-12174. [PMID: 34428169 PMCID: PMC9647723 DOI: 10.1109/tcyb.2020.3042837] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/07/2023]
Abstract
Currently, several convolutional neural network (CNN)-based methods have been proposed for computer-aided COVID-19 diagnosis based on lung computed tomography (CT) scans. However, the lesions of pneumonia in CT scans have wide variations in appearances, sizes, and locations in the lung regions, and the manifestations of COVID-19 in CT scans are also similar to other types of viral pneumonia, which hinders the further improvement of CNN-based methods. Delineating infection regions manually is a solution to this issue, while excessive workload of physicians during the epidemic makes it difficult for manual delineation. In this article, we propose a CNN called dense connectivity network with parallel attention module (PAM-DenseNet), which can perform well on coarse labels without manually delineated infection regions. The parallel attention module automatically learns to strengthen informative features from both channelwise and spatialwise simultaneously, which can make the network pay more attention to the infection regions without any manual delineation. The dense connectivity structure performs feature maps reuse by introducing direct connections from previous layers to all subsequent layers, which can extract representative features from fewer CT slices. The proposed network is first trained on 3530 lung CT slices selected from 382 COVID-19 lung CT scans, 372 lung CT scans infected by other pneumonia, and 200 normal lung CT scans to obtain a pretrained model for slicewise prediction. We then apply this pretrained model to a CT scans dataset containing 94 COVID-19 CT scans, 93 other pneumonia CT scans, and 93 normal lung scans, and achieve patientwise prediction through a voting mechanism. The experimental results show that the proposed network achieves promising results with an accuracy of 94.29%, a precision of 93.75%, a sensitivity of 95.74%, and a specificity of 96.77%, which is comparable to the methods that are based on manually delineated infection regions.
Collapse
|
12
|
Contrasting EfficientNet, ViT, and gMLP for COVID-19 Detection in Ultrasound Imagery. J Pers Med 2022; 12:jpm12101707. [PMID: 36294846 PMCID: PMC9605641 DOI: 10.3390/jpm12101707] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Revised: 09/19/2022] [Accepted: 10/10/2022] [Indexed: 11/06/2022] Open
Abstract
A timely diagnosis of coronavirus is critical in order to control the spread of the virus. To aid in this, we propose in this paper a deep learning-based approach for detecting coronavirus patients using ultrasound imagery. We propose to exploit the transfer learning of a EfficientNet model pre-trained on the ImageNet dataset for the classification of ultrasound images of suspected patients. In particular, we contrast the results of EfficentNet-B2 with the results of ViT and gMLP. Then, we show the results of the three models by learning from scratch, i.e., without transfer learning. We view the detection problem from a multiclass classification perspective by classifying images as COVID-19, pneumonia, and normal. In the experiments, we evaluated the models on a publically available ultrasound dataset. This dataset consists of 261 recordings (202 videos + 59 images) belonging to 216 distinct patients. The best results were obtained using EfficientNet-B2 with transfer learning. In particular, we obtained precision, recall, and F1 scores of 95.84%, 99.88%, and 24 97.41%, respectively, for detecting the COVID-19 class. EfficientNet-B2 with transfer learning presented an overall accuracy of 96.79%, outperforming gMLP and ViT, which achieved accuracies of 93.03% and 92.82%, respectively.
Collapse
|
13
|
Stubblefield J, Causey J, Dale D, Qualls J, Bellis E, Fowler J, Walker K, Huang X. COVID19 Diagnosis Using Chest X-rays and Transfer Learning. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2022:2022.10.09.22280877. [PMID: 36263062 PMCID: PMC9580378 DOI: 10.1101/2022.10.09.22280877] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
A pandemic of respiratory illnesses from a novel coronavirus known as Sars-CoV-2 has swept across the globe since December of 2019. This is calling upon the research community including medical imaging to provide effective tools for use in combating this virus. Research in biomedical imaging of viral patients is already very active with machine learning models being created for diagnosing Sars-CoV-2 infections in patients using CT scans and chest x-rays. We aim to build upon this research. Here we used a transfer-learning approach to develop models capable of diagnosing COVID19 from chest x-ray. For this work we compiled a dataset of 112120 negative images from the Chest X-Ray 14 and 2725 positive images from public repositories. We tested multiple models, including logistic regression and random forest and XGBoost with and without principal components analysis, using five-fold cross-validation to evaluate recall, precision, and f1-score. These models were compared to a pre-trained deep-learning model for evaluating chest x-rays called COVID-Net. Our best model was XGBoost with principal components with a recall, precision, and f1-score of 0.692, 0.960, 0.804 respectively. This model greatly outperformed COVID-Net which scored 0.987, 0.025, 0.048. This model, with its high precision and reasonable sensitivity, would be most useful as "rule-in" test for COVID19. Though it outperforms some chemical assays in sensitivity, this model should be studied in patients who would not ordinarily receive a chest x-ray before being used for screening.
Collapse
Affiliation(s)
- Jonathan Stubblefield
- Arkansas AI-Campus, Molecular Biosciences, Arkansas State University, Jonesboro, AR, USA
| | - Jason Causey
- Arkansas AI-Campus, Computer Science, Arkansas State University, Jonesboro, AR, USA
| | - Dakota Dale
- Arkansas AI-Campus, Computer Science, University of Arkansas at Fayetteville, AR, USA
| | - Jake Qualls
- Arkansas AI-Campus, Computer Science, Arkansas State University, Jonesboro, AR, USA
| | - Emily Bellis
- Arkansas AI-Campus, Computer Science, Arkansas State University, Jonesboro, AR, USA
| | - Jennifer Fowler
- Arkansas AI-Campus, Molecular Biosciences, Arkansas State University, Jonesboro, AR, USA
| | - Karl Walker
- Arkansas AI-Campus, Computer Science & Math University of Arkansas at Pine Bluff, AR, USA
| | - Xiuzhen Huang
- Arkansas AI-Campus, Arkansas State University, Dept. of Computational Biomedicine, Cedars Sinai Medical Center
| |
Collapse
|
14
|
Chi J, Zhang S, Han X, Wang H, Wu C, Yu X. MID-UNet: Multi-input directional UNet for COVID-19 lung infection segmentation from CT images. SIGNAL PROCESSING. IMAGE COMMUNICATION 2022; 108:116835. [PMID: 35935468 PMCID: PMC9344813 DOI: 10.1016/j.image.2022.116835] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 05/30/2022] [Accepted: 07/23/2022] [Indexed: 05/05/2023]
Abstract
Coronavirus Disease 2019 (COVID-19) has spread globally since the first case was reported in December 2019, becoming a world-wide existential health crisis with over 90 million total confirmed cases. Segmentation of lung infection from computed tomography (CT) scans via deep learning method has a great potential in assisting the diagnosis and healthcare for COVID-19. However, current deep learning methods for segmenting infection regions from lung CT images suffer from three problems: (1) Low differentiation of semantic features between the COVID-19 infection regions, other pneumonia regions and normal lung tissues; (2) High variation of visual characteristics between different COVID-19 cases or stages; (3) High difficulty in constraining the irregular boundaries of the COVID-19 infection regions. To solve these problems, a multi-input directional UNet (MID-UNet) is proposed to segment COVID-19 infections in lung CT images. For the input part of the network, we firstly propose an image blurry descriptor to reflect the texture characteristic of the infections. Then the original CT image, the image enhanced by the adaptive histogram equalization, the image filtered by the non-local means filter and the blurry feature map are adopted together as the input of the proposed network. For the structure of the network, we propose the directional convolution block (DCB) which consist of 4 directional convolution kernels. DCBs are applied on the short-cut connections to refine the extracted features before they are transferred to the de-convolution parts. Furthermore, we propose a contour loss based on local curvature histogram then combine it with the binary cross entropy (BCE) loss and the intersection over union (IOU) loss for better segmentation boundary constraint. Experimental results on the COVID-19-CT-Seg dataset demonstrate that our proposed MID-UNet provides superior performance over the state-of-the-art methods on segmenting COVID-19 infections from CT images.
Collapse
Affiliation(s)
- Jianning Chi
- Northeastern University, NO. 195, Chuangxin Road, Hunnan District, Shenyang, China
| | - Shuang Zhang
- Northeastern University, NO. 195, Chuangxin Road, Hunnan District, Shenyang, China
| | - Xiaoying Han
- Northeastern University, NO. 195, Chuangxin Road, Hunnan District, Shenyang, China
| | - Huan Wang
- Northeastern University, NO. 195, Chuangxin Road, Hunnan District, Shenyang, China
| | - Chengdong Wu
- Northeastern University, NO. 195, Chuangxin Road, Hunnan District, Shenyang, China
| | - Xiaosheng Yu
- Northeastern University, NO. 195, Chuangxin Road, Hunnan District, Shenyang, China
| |
Collapse
|
15
|
Bhosale YH, Patnaik KS. Application of Deep Learning Techniques in Diagnosis of Covid-19 (Coronavirus): A Systematic Review. Neural Process Lett 2022; 55:1-53. [PMID: 36158520 PMCID: PMC9483290 DOI: 10.1007/s11063-022-11023-0] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/29/2022] [Indexed: 01/09/2023]
Abstract
Covid-19 is now one of the most incredibly intense and severe illnesses of the twentieth century. Covid-19 has already endangered the lives of millions of people worldwide due to its acute pulmonary effects. Image-based diagnostic techniques like X-ray, CT, and ultrasound are commonly employed to get a quick and reliable clinical condition. Covid-19 identification out of such clinical scans is exceedingly time-consuming, labor-intensive, and susceptible to silly intervention. As a result, radiography imaging approaches using Deep Learning (DL) are consistently employed to achieve great results. Various artificial intelligence-based systems have been developed for the early prediction of coronavirus using radiography pictures. Specific DL methods such as CNN and RNN noticeably extract extremely critical characteristics, primarily in diagnostic imaging. Recent coronavirus studies have used these techniques to utilize radiography image scans significantly. The disease, as well as the present pandemic, was studied using public and private data. A total of 64 pre-trained and custom DL models concerning imaging modality as taxonomies are selected from the studied articles. The constraints relevant to DL-based techniques are the sample selection, network architecture, training with minimal annotated database, and security issues. This includes evaluating causal agents, pathophysiology, immunological reactions, and epidemiological illness. DL-based Covid-19 detection systems are the key focus of this review article. Covid-19 work is intended to be accelerated as a result of this study.
Collapse
Affiliation(s)
- Yogesh H. Bhosale
- Department of Computer Science and Engineering, Birla Institute of Technology, Mesra, Ranchi 835215 India
| | - K. Sridhar Patnaik
- Department of Computer Science and Engineering, Birla Institute of Technology, Mesra, Ranchi 835215 India
| |
Collapse
|
16
|
Ali AM, Ghafoor K, Mulahuwaish A, Maghdid H. COVID-19 pneumonia level detection using deep learning algorithm and transfer learning. EVOLUTIONARY INTELLIGENCE 2022:1-12. [PMID: 36105664 PMCID: PMC9463680 DOI: 10.1007/s12065-022-00777-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2020] [Revised: 08/05/2022] [Accepted: 08/28/2022] [Indexed: 12/15/2022]
Abstract
The first COVID-19 confirmed case was reported in Wuhan, China, and spread across the globe with an unprecedented impact on humanity. Since this pandemic requires pervasive diagnosis, developing smart, fast, and efficient detection techniques is significant. To this end, we have developed an Artificial Intelligence engine to classify the lung inflammation level (mild, progressive, severe stage) of the COVID-19 confirmed patient. In particular, the developed model consists of two phases; in the first phase, we calculate the volume and density of lesions and opacities of the CT scan images of the confirmed COVID-19 patient using Morphological approaches. The second phase classifies the pneumonia level of the confirmed COVID-19 patient. We use a modified Convolution Neural Network (CNN) and k-Nearest Neighbor; we also compared the results of both models to the other classification algorithms to precisely classify lung inflammation. The experiments show that the CNN model can provide testing accuracy up to 95.65% compared with exiting classification techniques. The proposed system in this work can be applied efficiently to CT scan and X-ray image datasets. Also, in this work, the Transfer Learning technique has been used to train the pre-trained modified CNN model on a smaller dataset than the original dataset; the modified CNN achieved 92.80% of testing accuracy for detecting pneumonia on chest X-ray images for the relatively extensive dataset.
Collapse
Affiliation(s)
- Abbas M. Ali
- Department of Software Engineering, Salahaddin University, Erbil, Iraq
| | - Kayhan Ghafoor
- Department of Computer Science, Knowledge University, University Park, Kirkuk Road, Erbil, Iraq
| | - Aos Mulahuwaish
- Department of Computer Science and Information Systems, Saginaw Valley State University, 7400 Bay Rd, University Center, MI 48710 USA
| | - Halgurd Maghdid
- Department of Software Engineering, Koya University, Kurdistan Region, FR Iraq
| |
Collapse
|
17
|
Tiwari A, Tripathi S, Pandey DC, Sharma N, Sharma S. Detection of COVID-19 Infection in CT and X-ray images using transfer learning approach. Technol Health Care 2022; 30:1273-1286. [PMID: 36093719 DOI: 10.3233/thc-220114] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND The infection caused by the SARS-CoV-2 (COVID-19) pandemic is a threat to human lives. An early and accurate diagnosis is necessary for treatment. OBJECTIVE The study presents an efficient classification methodology for precise identification of infection caused by COVID-19 using CT and X-ray images. METHODS The depthwise separable convolution-based model of MobileNet V2 was exploited for feature extraction. The features of infection were supplied to the SVM classifier for training which produced accurate classification results. RESULT The accuracies for CT and X-ray images are 99.42% and 98.54% respectively. The MCC score was used to avoid any mislead caused by accuracy and F1 score as it is more mathematically balanced metric. The MCC scores obtained for CT and X-ray were 0.9852 and 0.9657, respectively. The Youden's index showed a significant improvement of more than 2% for both imaging techniques. CONCLUSION The proposed transfer learning-based approach obtained the best results for all evaluation metrics and produced reliable results for the accurate identification of COVID-19 symptoms. This study can help in reducing the time in diagnosis of the infection.
Collapse
Affiliation(s)
- Alok Tiwari
- School of Biomedical Engineering, Indian Institute of Technology (Banaras Hindu University), Varanasi, India.,School of Biomedical Engineering, Indian Institute of Technology (Banaras Hindu University), Varanasi, India
| | - Sumit Tripathi
- Department of Electronics and Communication Engineering, Graphic Era Deemed to be University, Dehradun, Uttarakhand, India.,School of Biomedical Engineering, Indian Institute of Technology (Banaras Hindu University), Varanasi, India
| | - Dinesh Chandra Pandey
- Department of Management Studies, Graphic Era Deemed to be University, Dehradun, Uttarakhand, India
| | - Neeraj Sharma
- School of Biomedical Engineering, Indian Institute of Technology (Banaras Hindu University), Varanasi, India
| | - Shiru Sharma
- School of Biomedical Engineering, Indian Institute of Technology (Banaras Hindu University), Varanasi, India
| |
Collapse
|
18
|
Qayyum A, Lalande A, Meriaudeau F. Effective multiscale deep learning model for COVID19 segmentation tasks: A further step towards helping radiologist. Neurocomputing 2022; 499:63-80. [PMID: 35578654 PMCID: PMC9095500 DOI: 10.1016/j.neucom.2022.05.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Revised: 01/28/2022] [Accepted: 05/02/2022] [Indexed: 12/14/2022]
Abstract
Infection by the SARS-CoV-2 leading to COVID-19 disease is still rising and techniques to either diagnose or evaluate the disease are still thoroughly investigated. The use of CT as a complementary tool to other biological tests is still under scrutiny as the CT scans are prone to many false positives as other lung diseases display similar characteristics on CT scans. However, fully investigating CT images is of tremendous interest to better understand the disease progression and therefore thousands of scans need to be segmented by radiologists to study infected areas. Over the last year, many deep learning models for segmenting CT-lungs were developed. Unfortunately, the lack of large and shared annotated multicentric datasets led to models that were either under-tested (small dataset) or not properly compared (own metrics, none shared dataset), often leading to poor generalization performance. To address, these issues, we developed a model that uses a multiscale and multilevel feature extraction strategy for COVID19 segmentation and extensively validated it on several datasets to assess its generalization capability for other segmentation tasks on similar organs. The proposed model uses a novel encoder and decoder with a proposed kernel-based atrous spatial pyramid pooling module that is used at the bottom of the model to extract small features with a multistage skip connection concatenation approach. The results proved that our proposed model could be applied on a small-scale dataset and still produce generalizable performances on other segmentation tasks. The proposed model produced an efficient Dice score of 90% on a 100 cases dataset, 95% on the NSCLC dataset, 88.49% on the COVID19 dataset, and 97.33 on the StructSeg 2019 dataset as compared to existing state-of-the-art models. The proposed solution could be used for COVID19 segmentation in clinic applications. The source code is publicly available at https://github.com/RespectKnowledge/Mutiscale-based-Covid-_segmentation-usingDeep-Learning-models.
Collapse
Affiliation(s)
- Abdul Qayyum
- ImViA Laboratory, University of Bourgogne Franche-Comt́e, Dijon, France
| | - Alain Lalande
- ImViA Laboratory, University of Bourgogne Franche-Comt́e, Dijon, France
- Medical Imaging Department, University Hospital of Dijon, Dijon, France
| | | |
Collapse
|
19
|
Amara K, Aouf A, Kennouche H, Djekoune AO, Zenati N, Kerdjidj O, Ferguene F. COVIR: A virtual rendering of a novel NN architecture O-Net for COVID-19 Ct-scan automatic lung lesions segmentation. COMPUTERS & GRAPHICS 2022; 104:11-23. [PMID: 35310449 PMCID: PMC8923016 DOI: 10.1016/j.cag.2022.03.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/20/2021] [Revised: 03/09/2022] [Accepted: 03/09/2022] [Indexed: 06/14/2023]
Abstract
With the Coronavirus disease 2019 (COVID-19) spread, causing a world pandemic, and recently, the virus new variants continue to appear, making the situation more challenging and threatening, the visual assessment and quantification by expert radiologists have become costly and error-prone. Hence, there is a need to propose a model to predict the COVID-19 cases at the earliest possible to control the disease spread. In order to assist the medical professionals and reduce workload and the time the COVID-19 diagnosis cycle takes, this paper proposes a novel neural network architecture termed as O-Net to automatically segment chest Computerised Tomography Ct-scans infected by COVID-19 with optimised computing power and memory occupation. The O-Net consists of two convolutional autoencoders with an upsampling channel and a downsampling channel. Experimental tests show our proposal's effectiveness and potential, with a dice score of 0.86, pixel accuracy, precision, specificity of 0.99, 0.99, 0.98, respectively. Performance on the external dataset illustrates generalisation and scalability capabilities of the O-Net model to Ct-scan obtained from different scanners with different sizes. The second objective of this work is to introduce our virtual reality platform, COVIR, that visualises and manipulates 3D reconstructed lungs and segmented infected lesions caused by COVID-19. COVIR platform acts as a reading and visualisation support for medical practitioners to diagnose COVID-19 lung infection. The COVIR platform could be used for medical education professional practice and training. It was tested by Thirteen participants (medical staff, researchers, and collaborators), they conclude that the 3D VR visualisation of segmented Ct-Scan provides an aid diagnosis tool for better interpretation.
Collapse
Affiliation(s)
- Kahina Amara
- CDTA Centre for Development of Advanced Technologies, City 20 August 1956 Baba Hassen, Algiers, Algeria
| | - Ali Aouf
- USTHB University of science and technology Houari Boumediene, B.P 32 El Alia 16111 Bab Ezzouar, Algiers, Algeria
| | - Hoceine Kennouche
- USTHB University of science and technology Houari Boumediene, B.P 32 El Alia 16111 Bab Ezzouar, Algiers, Algeria
| | - A Oualid Djekoune
- CDTA Centre for Development of Advanced Technologies, City 20 August 1956 Baba Hassen, Algiers, Algeria
| | - Nadia Zenati
- CDTA Centre for Development of Advanced Technologies, City 20 August 1956 Baba Hassen, Algiers, Algeria
| | - Oussama Kerdjidj
- CDTA Centre for Development of Advanced Technologies, City 20 August 1956 Baba Hassen, Algiers, Algeria
| | - Farid Ferguene
- USTHB University of science and technology Houari Boumediene, B.P 32 El Alia 16111 Bab Ezzouar, Algiers, Algeria
| |
Collapse
|
20
|
de Vente C, Boulogne LH, Venkadesh KV, Sital C, Lessmann N, Jacobs C, Sanchez CI, van Ginneken B. Automated COVID-19 Grading With Convolutional Neural Networks in Computed Tomography Scans: A Systematic Comparison. IEEE TRANSACTIONS ON ARTIFICIAL INTELLIGENCE 2022; 3:129-138. [PMID: 35582210 PMCID: PMC9014473 DOI: 10.1109/tai.2021.3115093] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/28/2021] [Revised: 06/02/2021] [Accepted: 09/18/2021] [Indexed: 11/08/2022]
Abstract
Amidst the ongoing pandemic, the assessment of computed tomography (CT) images for COVID-19 presence can exceed the workload capacity of radiologists. Several studies addressed this issue by automating COVID-19 classification and grading from CT images with convolutional neural networks (CNNs). Many of these studies reported initial results of algorithms that were assembled from commonly used components. However, the choice of the components of these algorithms was often pragmatic rather than systematic and systems were not compared to each other across papers in a fair manner. We systematically investigated the effectiveness of using 3-D CNNs instead of 2-D CNNs for seven commonly used architectures, including DenseNet, Inception, and ResNet variants. For the architecture that performed best, we furthermore investigated the effect of initializing the network with pretrained weights, providing automatically computed lesion maps as additional network input, and predicting a continuous instead of a categorical output. A 3-D DenseNet-201 with these components achieved an area under the receiver operating characteristic curve of 0.930 on our test set of 105 CT scans and an AUC of 0.919 on a publicly available set of 742 CT scans, a substantial improvement in comparison with a previously published 2-D CNN. This article provides insights into the performance benefits of various components for COVID-19 classification and grading systems. We have created a challenge on grand-challenge.org to allow for a fair comparison between the results of this and future research.
Collapse
Affiliation(s)
- Coen de Vente
- Radboud University Medical Center, Donders Institute for Brain, Cognition and BehaviourDepartment of Medical Imaging6525GANijmegenThe Netherlands.,Informatics Institute, Faculty of ScienceUniversity of Amsterdam 1012 WX Amsterdam The Netherlands
| | - Luuk H Boulogne
- Radboud University Medical Center, Radboud Institute for Health SciencesDepartment of Medical Imaging 6525 GA Nijmegen The Netherlands
| | - Kiran Vaidhya Venkadesh
- Radboud University Medical Center, Radboud Institute for Health SciencesDepartment of Medical Imaging 6525 GA Nijmegen The Netherlands
| | - Cheryl Sital
- Radboud University Medical Center, Radboud Institute for Health SciencesDepartment of Medical Imaging 6525 GA Nijmegen The Netherlands
| | - Nikolas Lessmann
- Radboud University Medical Center, Radboud Institute for Health SciencesDepartment of Medical Imaging 6525 GA Nijmegen The Netherlands
| | - Colin Jacobs
- Radboud University Medical Center, Radboud Institute for Health SciencesDepartment of Medical Imaging 6525 GA Nijmegen The Netherlands
| | - Clara I Sanchez
- Informatics Institute, Faculty of ScienceUniversity of Amsterdam 1012 WX Amsterdam The Netherlands
| | - Bram van Ginneken
- Radboud University Medical Center, Radboud Institute for Health SciencesDepartment of Medical Imaging 6525 GA Nijmegen The Netherlands
| |
Collapse
|
21
|
Gunraj H, Sabri A, Koff D, Wong A. COVID-Net CT-2: Enhanced Deep Neural Networks for Detection of COVID-19 From Chest CT Images Through Bigger, More Diverse Learning. Front Med (Lausanne) 2022; 8:729287. [PMID: 35360446 PMCID: PMC8960961 DOI: 10.3389/fmed.2021.729287] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Accepted: 12/31/2021] [Indexed: 01/08/2023] Open
Abstract
The COVID-19 pandemic continues to rage on, with multiple waves causing substantial harm to health and economies around the world. Motivated by the use of computed tomography (CT) imaging at clinical institutes around the world as an effective complementary screening method to RT-PCR testing, we introduced COVID-Net CT, a deep neural network tailored for detection of COVID-19 cases from chest CT images, along with a large curated benchmark dataset comprising 1,489 patient cases as part of the open-source COVID-Net initiative. However, one potential limiting factor is restricted data quantity and diversity given the single nation patient cohort used in the study. To address this limitation, in this study we introduce enhanced deep neural networks for COVID-19 detection from chest CT images which are trained using a large, diverse, multinational patient cohort. We accomplish this through the introduction of two new CT benchmark datasets, the largest of which comprises a multinational cohort of 4,501 patients from at least 16 countries. To the best of our knowledge, this represents the largest, most diverse multinational cohort for COVID-19 CT images in open-access form. Additionally, we introduce a novel lightweight neural network architecture called COVID-Net CT S, which is significantly smaller and faster than the previously introduced COVID-Net CT architecture. We leverage explainability to investigate the decision-making behavior of the trained models and ensure that decisions are based on relevant indicators, with the results for select cases reviewed and reported on by two board-certified radiologists with over 10 and 30 years of experience, respectively. The best-performing deep neural network in this study achieved accuracy, COVID-19 sensitivity, positive predictive value, specificity, and negative predictive value of 99.0%/99.1%/98.0%/99.4%/99.7%, respectively. Moreover, explainability-driven performance validation shows consistency with radiologist interpretation by leveraging correct, clinically relevant critical factors. The results are promising and suggest the strong potential of deep neural networks as an effective tool for computer-aided COVID-19 assessment. While not a production-ready solution, we hope the open-source, open-access release of COVID-Net CT-2 and the associated benchmark datasets will continue to enable researchers, clinicians, and citizen data scientists alike to build upon them.
Collapse
Affiliation(s)
- Hayden Gunraj
- Vision and Image Processing Lab, University of Waterloo, Waterloo, ON, Canada
- *Correspondence: Hayden Gunraj
| | - Ali Sabri
- Department of Radiology, McMaster University, Hamilton, ON, Canada
- Niagara Health System, St. Catharines, ON, Canada
| | - David Koff
- Department of Radiology, McMaster University, Hamilton, ON, Canada
- Hamilton Health Sciences, Hamilton, ON, Canada
| | - Alexander Wong
- Vision and Image Processing Lab, University of Waterloo, Waterloo, ON, Canada
- Waterloo Artificial Intelligence Institute, University of Waterloo, Waterloo, ON, Canada
- DarwinAI Corp., Waterloo, ON, Canada
| |
Collapse
|
22
|
Nayak J, Naik B, Dinesh P, Vakula K, Dash PB, Pelusi D. Significance of deep learning for Covid-19: state-of-the-art review. RESEARCH ON BIOMEDICAL ENGINEERING 2022. [PMCID: PMC7980106 DOI: 10.1007/s42600-021-00135-6] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Purpose The appearance of the 2019 novel coronavirus (Covid-19), for which there is no treatment or a vaccine, formed a sense of necessity for new drug discovery advances. The pandemic of NCOV-19 (novel coronavirus-19) has been engaged as a public health disaster of overall distress by the World Health Organization. Different pandemic models for NCOV-19 are being exploited by researchers all over the world to acquire experienced assessments and impose major control measures. Among the standard techniques for NCOV-19 global outbreak prediction, epidemiological and simple statistical techniques have attained more concern by researchers. Insufficiency and deficiency of health tests for identifying a solution became a major difficulty in controlling the spread of NCOV-19. To solve this problem, deep learning has emerged as a novel solution over a dozen of machine learning techniques. Deep learning has attained advanced performance in medical applications. Deep learning has the capacity of recognizing patterns in large complex datasets. They are identified as an appropriate method for analyzing affected patients of NCOV-19. Conversely, these techniques for disease recognition focus entirely on enhancing the accurateness of forecasts or classifications without the ambiguity measure in a decision. Knowing how much assurance present in a computer-based health analysis is necessary for gaining clinicians’ expectations in the technology and progress treatment consequently. Today, NCOV-19 diseases are the main healthcare confront throughout the world. Detecting NCOV-19 in X-ray images is vital for diagnosis, treatment, and evaluation. Still, analytical ambiguity in a report is a difficult yet predictable task for radiologists. Method In this paper, an in-depth analysis has been performed on the significance of deep learning for Covid-19 and as per the standard search database, this is the first review research work ever made concentrating particularly on Deep Learning for NCOV-19. Conclusion The main aim behind this research work is to inspire the research community and to innovate novel research using deep learning. Moreover, the outcome of this detailed structured review on the impact of deep learning in covid-19 analysis will be helpful for further investigations on various modalities of diseases detection, prevention and finding novel solutions.
Collapse
Affiliation(s)
- Janmenjoy Nayak
- Department of Computer Science and Engineering, Aditya Institute of Technology and Management (AITAM), K Kotturu, Tekkali, AP 532201 India
| | - Bighnaraj Naik
- Department of Computer Application, Veer Surendra Sai University of Technology, Burla, Odisha 768018 India
| | - Paidi Dinesh
- Department of Computer Science and Engineering, Sri Sivani College of Engineering, Srikakulam, AP 532402 India
| | - Kanithi Vakula
- Department of Computer Science and Engineering, Sri Sivani College of Engineering, Srikakulam, AP 532402 India
| | - Pandit Byomakesha Dash
- Department of Computer Application, Veer Surendra Sai University of Technology, Burla, Odisha 768018 India
| | - Danilo Pelusi
- Faculty of Communication Sciences, University of Teramo, Coste Sant', Agostino Campus, Teramo, Italy
| |
Collapse
|
23
|
Dialameh M, Hamzeh A, Rahmani H, Radmard AR, Dialameh S. Proposing a novel deep network for detecting COVID-19 based on chest images. Sci Rep 2022; 12:3116. [PMID: 35210447 PMCID: PMC8873454 DOI: 10.1038/s41598-022-06802-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Accepted: 01/24/2022] [Indexed: 11/29/2022] Open
Abstract
The rapid outbreak of coronavirus threatens humans' life all around the world. Due to the insufficient diagnostic infrastructures, developing an accurate, efficient, inexpensive, and quick diagnostic tool is of great importance. To date, researchers have proposed several detection models based on chest imaging analysis, primarily based on deep neural networks; however, none of which could achieve a reliable and highly sensitive performance yet. Therefore, the nature of this study is primary epidemiological research that aims to overcome the limitations mentioned above by proposing a large-scale publicly available dataset of chest computed tomography scan (CT-scan) images consisting of more than 13k samples. Secondly, we propose a more sensitive deep neural networks model for CT-scan images of the lungs, providing a pixel-wise attention layer on top of the high-level features extracted from the network. Moreover, the proposed model is extended through a transfer learning approach for being applicable in the case of chest X-Ray (CXR) images. The proposed model and its extension have been trained and evaluated through several experiments. The inclusion criteria were patients with suspected PE and positive real-time reverse-transcription polymerase chain reaction (RT-PCR) for SARS-CoV-2. The exclusion criteria were negative or inconclusive RT-PCR and other chest CT indications. Our model achieves an AUC score of 0.886, significantly better than its closest competitor, whose AUC is 0.843. Moreover, the obtained results on another commonly-used benchmark show an AUC of 0.899, outperforming related models. Additionally, the sensitivity of our model is 0.858, while that of its closest competitor is 0.81, explaining the efficiency of pixel-wise attention strategy in detecting coronavirus. Our promising results and the efficiency of the models imply that the proposed models can be considered reliable tools for assisting doctors in detecting coronavirus.
Collapse
Affiliation(s)
- Maryam Dialameh
- Department of Computer Science, Shiraz University, Shiraz, Iran.
| | - Ali Hamzeh
- Department of Computer Science, Shiraz University, Shiraz, Iran
| | - Hossein Rahmani
- School of Computing and Communications, Lancaster University, Lancaster, UK
| | - Amir Reza Radmard
- Department of Radiology, Tehran University of Medical Sciences, Tehran, Iran
| | - Safoura Dialameh
- School of Paramedical Sciences, Bushehr University of Medical Sciences, Bushehr, Iran
| |
Collapse
|
24
|
Semantic segmentation of COVID-19 lesions with a multiscale dilated convolutional network. Sci Rep 2022; 12:1847. [PMID: 35115573 PMCID: PMC8814191 DOI: 10.1038/s41598-022-05527-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Accepted: 01/12/2022] [Indexed: 11/09/2022] Open
Abstract
Automatic segmentation of infected lesions from computed tomography (CT) of COVID-19 patients is crucial for accurate diagnosis and follow-up assessment. The remaining challenges are the obvious scale difference between different types of COVID-19 lesions and the similarity between the lesions and normal tissues. This work aims to segment lesions of different scales and lesion boundaries correctly by utilizing multiscale and multilevel features. A novel multiscale dilated convolutional network (MSDC-Net) is proposed against the scale difference of lesions and the low contrast between lesions and normal tissues in CT images. In our MSDC-Net, we propose a multiscale feature capture block (MSFCB) to effectively capture multiscale features for better segmentation of lesions at different scales. Furthermore, a multilevel feature aggregate (MLFA) module is proposed to reduce the information loss in the downsampling process. Experiments on the publicly available COVID-19 CT Segmentation dataset demonstrate that the proposed MSDC-Net is superior to other existing methods in segmenting lesion boundaries and large, medium, and small lesions, and achieves the best results in Dice similarity coefficient, sensitivity and mean intersection-over-union (mIoU) scores of 82.4%, 81.1% and 78.2%, respectively. Compared with other methods, the proposed model has an average improvement of 10.6% and 11.8% on Dice and mIoU. Compared with the existing methods, our network achieves more accurate segmentation of lesions at various scales and lesion boundaries, which will facilitate further clinical analysis. In the future, we consider integrating the automatic detection and segmentation of COVID-19, and conduct research on the automatic diagnosis system of COVID-19.
Collapse
|
25
|
Irmak E. COVID-19 disease diagnosis from paper-based ECG trace image data using a novel convolutional neural network model. Phys Eng Sci Med 2022; 45:167-179. [PMID: 35020175 PMCID: PMC8753334 DOI: 10.1007/s13246-022-01102-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Accepted: 01/06/2022] [Indexed: 10/29/2022]
Abstract
Clinical reports show that COVID-19 disease has impacts on the cardiovascular system in addition to the respiratory system. Available COVID-19 diagnostic methods have been shown to have limitations. In addition to current diagnostic methods such as low-sensitivity standard RT-PCR tests and expensive medical imaging devices, the development of alternative methods for the diagnosis of COVID-19 disease would be beneficial for control of the COVID-19 pandemic. Further, it is important to quickly and accurately detect abnormalities caused by COVID-19 on the cardiovascular system via ECG. In this study, the diagnosis of COVID-19 disease is proposed using a novel deep Convolutional Neural Network model by using only ECG trace images created from ECG signals of COVID-19 infected patients based on the abnormalities caused by the COVID-19 virus on the cardiovascular system. An overall classification accuracy of 98.57%, 93.20%, 96.74% and AUC value of 0.9966, 0.9771, 0.9905 is achieved for COVID-19 vs. Normal, COVID-19 vs. Abnormal Heartbeats, COVID-19 vs. Myocardial Infarction binary classification tasks, respectively. In addition, an overall classification accuracy of 86.55% and 83.05% is achieved for COVID-19 vs. Abnormal Heartbeats vs. Myocardial Infarction and Normal vs. COVID-19 vs. Abnormal Heartbeats vs. Myocardial Infarction multi-classification tasks. This study is believed to have great potential to speed up the diagnosis and treatment of COVID-19 patients, saving clinicians time and facilitating the control of the pandemic.
Collapse
Affiliation(s)
- Emrah Irmak
- Electrical-Electronics Engineering Department, Alanya Alaaddin Keykubat University, 07425, Alanya, Antalya, Turkey.
| |
Collapse
|
26
|
Virtual Healthcare Center for COVID-19 Patient Detection Based on Artificial Intelligence Approaches. CANADIAN JOURNAL OF INFECTIOUS DISEASES AND MEDICAL MICROBIOLOGY 2022; 2022:6786203. [PMID: 35069953 PMCID: PMC8767384 DOI: 10.1155/2022/6786203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Accepted: 12/22/2021] [Indexed: 11/18/2022]
Abstract
At the end of 2019, the infectious coronavirus disease (COVID-19) was reported for the first time in Wuhan, and, since then, it has become a public health issue in China and even worldwide. This pandemic has devastating effects on societies and economies around the world, and poor countries and continents are likely to face particularly serious and long-lasting damage, which could lead to large epidemic outbreaks because of the lack of financial and health resources. The increasing number of COVID-19 tests gives more information about the epidemic spread, and this can help contain the spread to avoid more infection. As COVID-19 keeps spreading, medical products, especially those needed to perform blood tests, will become scarce as a result of the high demand and insufficient supply and logistical means. However, technological tests based on deep learning techniques and medical images could be useful in fighting this pandemic. In this perspective, we propose a COVID-19 disease diagnosis (CDD) tool that implements a deep learning technique to provide automatic symptoms checking and COVID-19 detection. Our CDD scheme implements two main steps. First, the patient's symptoms are checked, and the infection probability is predicted. Then, based on the infection probability, the patient's lungs will be diagnosed by an automatic analysis of X-ray or computerized tomography (CT) images, and the presence of the infection will be accordingly confirmed or not. The numerical results prove the efficiency of the proposed scheme by achieving an accuracy value over 90% compared with the other schemes.
Collapse
|
27
|
Rani G, Oza MG, Dhaka VS, Pradhan N, Verma S, Rodrigues JJPC. Applying deep learning-based multi-modal for detection of coronavirus. MULTIMEDIA SYSTEMS 2022; 28:1251-1262. [PMID: 34305327 PMCID: PMC8294320 DOI: 10.1007/s00530-021-00824-3] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/21/2020] [Accepted: 06/20/2021] [Indexed: 05/11/2023]
Abstract
Amidst the global pandemic and catastrophe created by 'COVID-19', every research institution and scientist are doing their best efforts to invent or find the vaccine or medicine for the disease. The objective of this research is to design and develop a deep learning-based multi-modal for the screening of COVID-19 using chest radiographs and genomic sequences. The modal is also effective in finding the degree of genomic similarity among the Severe Acute Respiratory Syndrome-Coronavirus 2 and other prevalent viruses such as Severe Acute Respiratory Syndrome-Coronavirus, Middle East Respiratory Syndrome-Coronavirus, Human Immunodeficiency Virus, and Human T-cell Leukaemia Virus. The experimental results on the datasets available at National Centre for Biotechnology Information, GitHub, and Kaggle repositories show that it is successful in detecting the genome of 'SARS-CoV-2' in the host genome with an accuracy of 99.27% and screening of chest radiographs into COVID-19, non-COVID pneumonia and healthy with a sensitivity of 95.47%. Thus, it may prove a useful tool for doctors to quickly classify the infected and non-infected genomes. It can also be useful in finding the most effective drug from the available drugs for the treatment of 'COVID-19'.
Collapse
Affiliation(s)
- Geeta Rani
- Department of Computer and Communication Engineering, Manipal University Jaipur, Jaipur, Rajasthan India
| | - Meet Ganpatlal Oza
- Department of Computer and Communication Engineering, Manipal University Jaipur, Jaipur, Rajasthan India
| | - Vijaypal Singh Dhaka
- Department of Computer and Communication Engineering, Manipal University Jaipur, Jaipur, Rajasthan India
| | - Nitesh Pradhan
- Department of Computer Science and Engineering, Manipal University Jaipur, Jaipur, Rajasthan India
| | - Sahil Verma
- Department of Computer Science and Engineering, Chandigarh University, Mohali, 140413 India
| | - Joel J. P. C. Rodrigues
- Federal University of Piauí (UFPI) Teresina, Teresina, PI Brazil
- Instituto de Telecomunicações, Aveiro, Portugal
| |
Collapse
|
28
|
Qayyum A, Mazhar M, Razzak I, Bouadjenek MR. Multilevel depth-wise context attention network with atrous mechanism for segmentation of COVID19 affected regions. Neural Comput Appl 2021; 35:1-13. [PMID: 34720443 PMCID: PMC8546198 DOI: 10.1007/s00521-021-06636-w] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2021] [Accepted: 10/13/2021] [Indexed: 12/02/2022]
Abstract
Severe acute respiratory syndrome coronavirus (SARS-CoV-2) also named COVID-19, aggressively spread all over the world in just a few months. Since then, it has multiple variants that are far more contagious than its parent. Rapid and accurate diagnosis of COVID-19 and its variants are crucial for its treatment, analysis of lungs damage and quarantine management. Deep learning-based solution for efficient and accurate diagnosis to COVID-19 and its variants using Chest X-rays, and computed tomography images could help to counter its outbreak. This work presents a novel depth-wise residual network with an atrous mechanism for accurate segmentation and lesion location of COVID-19 affected areas using volumetric CT images. The proposed framework consists of 3D depth-wise and 3D residual squeeze and excitation block in cascaded and parallel to capture uniformly multi-scale context (low-level detailed, mid-level comprehensive and high-level rich semantic features). The squeeze and excitation block adaptively recalibrates channel-wise feature responses by explicitly modeling inter-dependencies between various channels. We further have introduced an atrous mechanism with a different atrous rate as the bottom layer. Extensive experiments on benchmark CT datasets showed considerable gain (5%) for accurate segmentation and lesion location of COVID-19 affected areas.
Collapse
Affiliation(s)
- Abdul Qayyum
- Computer Science Department, University of Burgundy, Dijon, France
| | - Mona Mazhar
- Department of Computer Engineering and Mathematics, University Rovira i Virgili, Tarragona, Spain
| | - Imran Razzak
- School of Information Technology, Deakin University, Geelong, Australia
| | | |
Collapse
|
29
|
Kaur J, Kaur P. Outbreak COVID-19 in Medical Image Processing Using Deep Learning: A State-of-the-Art Review. ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING : STATE OF THE ART REVIEWS 2021; 29:2351-2382. [PMID: 34690493 PMCID: PMC8525064 DOI: 10.1007/s11831-021-09667-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/11/2021] [Accepted: 10/01/2021] [Indexed: 06/13/2023]
Abstract
From the month of December-19, the outbreak of Coronavirus (COVID-19) triggered several deaths and overstated every aspect of individual health. COVID-19 has been designated as a pandemic by World Health Organization. The circumstances placed serious trouble on every country worldwide, particularly with health arrangements and time-consuming responses. The increase in the positive cases of COVID-19 globally spread every day. The quantity of accessible diagnosing kits is restricted because of complications in detecting the existence of the illness. Fast and correct diagnosis of COVID-19 is a timely requirement for the prevention and controlling of the pandemic through suitable isolation and medicinal treatment. The significance of the present work is to discuss the outline of the deep learning techniques with medical imaging such as outburst prediction, virus transmitted indications, detection and treatment aspects, vaccine availability with remedy research. Abundant image resources of medical imaging as X-rays, Computed Tomography Scans, Magnetic Resonance imaging, formulate deep learning high-quality methods to fight against the pandemic COVID-19. The review presents a comprehensive idea of deep learning and its related applications in healthcare received over the past decade. At the last, some issues and confrontations to control the health crisis and outbreaks have been introduced. The progress in technology has contributed to developing individual's lives. The problems faced by the radiologists during medical imaging techniques and deep learning approaches for diagnosing the COVID-19 infections have been also discussed.
Collapse
Affiliation(s)
- Jaspreet Kaur
- Department of Computer Engineering & Technology, Guru Nanak Dev University, Amritsar, Punjab India
| | - Prabhpreet Kaur
- Department of Computer Engineering & Technology, Guru Nanak Dev University, Amritsar, Punjab India
| |
Collapse
|
30
|
Zhang M, Zeng X, Huang C, Liu J, Liu X, Xie X, Wang R. An AI-based radiomics nomogram for disease prognosis in patients with COVID-19 pneumonia using initial CT images and clinical indicators. Int J Med Inform 2021; 154:104545. [PMID: 34464848 PMCID: PMC8353975 DOI: 10.1016/j.ijmedinf.2021.104545] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2021] [Revised: 07/07/2021] [Accepted: 07/29/2021] [Indexed: 02/07/2023]
Abstract
BACKGROUND This study utilized a comprehensive nomogram to evaluate the prognosis of patients with COVID-19 pneumonia. METHODS COVID-19 pneumonia data was divided into training set (256 of 321, 80%), internal validation set (65 of 321, 20%) and independent external validation set (n = 188). After image processing, lesion segmentation, feature extraction and feature selection, radiomics signatures and clinical indicators were used to develop a radiomics model and a clinical model respectively. Combining radiomics signatures and clinical indicators, a radiomics nomogram was built. The performance of proposed models was evaluated by the receiver operating characteristic curve (AUC). Calibration curves and decision curve analysis were used to assess the performance of the radiomics nomogram. RESULTS Two clinical indicators that were age and chronic lung disease or asthma and 21 radiomics features were selected to build the radiomics nomogram. The radiomics nomogram yielded an Area Under The Curve1 (AUC) of 0.88 and accuracy of 0.80 in the training set, an AUC of 0.85 and accuracy of 0.77 in internal testing validation set and an AUC of 0.84 and accuracy of 0.75 in independent external validation set. The performance of radiomics nomogram was better than clinical model (AUC = 0.77, p < 0.001) and radiomics model (AUC = 0.72, p = 0.025) in independent external validation set. CONCLUSIONS The radiomics nomogram may be used to assess the deterioration of COVID-19 pneumonia.
Collapse
Affiliation(s)
- Mudan Zhang
- Medical College of Guizhou University, Guiyang, Guizhou Province 550000, China,Department of Medical Imaging, International Exemplary Cooperation Base of Precision Imaging for Diagnosis and Treatment, NHC Key Laboratory of Pulmonary Immune-related Diseases, Guizhou Provincial People’s Hospital, Guiyang 550002, China
| | - Xianchun Zeng
- Department of Medical Imaging, International Exemplary Cooperation Base of Precision Imaging for Diagnosis and Treatment, NHC Key Laboratory of Pulmonary Immune-related Diseases, Guizhou Provincial People’s Hospital, Guiyang 550002, China
| | - Chencui Huang
- AI Lab, Deepwise & League of PhD Technology Co.LTD, Beijing, China
| | - Jun Liu
- Department of Radiology, the Second Xiangya Hospital, Central South University, No.139 Middle Renmin Road, Changsha, Hunan 410011, China,Department of Radiology Quality Control Center, Changsha, Hunan Province 410011, China
| | - Xinfeng Liu
- Department of Medical Imaging, International Exemplary Cooperation Base of Precision Imaging for Diagnosis and Treatment, NHC Key Laboratory of Pulmonary Immune-related Diseases, Guizhou Provincial People’s Hospital, Guiyang 550002, China
| | - Xingzhi Xie
- Department of Radiology, the Second Xiangya Hospital, Central South University, No.139 Middle Renmin Road, Changsha, Hunan 410011, China
| | - Rongpin Wang
- Medical College of Guizhou University, Guiyang, Guizhou Province 550000, China,Department of Medical Imaging, International Exemplary Cooperation Base of Precision Imaging for Diagnosis and Treatment, NHC Key Laboratory of Pulmonary Immune-related Diseases, Guizhou Provincial People’s Hospital, Guiyang 550002, China,Corresponding author at: Department of Medical Imaging, International Exemplary Cooperation Base of Precision Imaging for Diagnosis and Treatment, NHC Key Laboratory of Pulmonary Immune-related Diseases, Guizhou Provincial People’s Hospital. No. 83 Zhongshan East Road, Nan Ming District, Guiyang, Guizhou Province 550002, China
| |
Collapse
|
31
|
Farag HH, Said LAA, Rizk MRM, Ahmed MAE. Hyperparameters optimization for ResNet and Xception in the purpose of diagnosing COVID-19. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2021. [DOI: 10.3233/jifs-210925] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
COVID-19 has been considered as a global pandemic. Recently, researchers are using deep learning networks for medical diseases’ diagnosis. Some of these researches focuses on optimizing deep learning neural networks for enhancing the network accuracy. Optimizing the Convolutional Neural Network includes testing various networks which are obtained through manually configuring their hyperparameters, then the configuration with the highest accuracy is implemented. Each time a different database is used, a different combination of the hyperparameters is required. This paper introduces two COVID-19 diagnosing systems using both Residual Network and Xception Network optimized by random search in the purpose of finding optimal models that give better diagnosis rates for COVID-19. The proposed systems showed that hyperparameters tuning for the ResNet and the Xception Net using random search optimization give more accurate results than other techniques with accuracies 99.27536% and 100 % respectively. We can conclude that hyperparameters tuning using random search optimization for either the tuned Residual Network or the tuned Xception Network gives better accuracies than other techniques diagnosing COVID-19.
Collapse
Affiliation(s)
- Hania H. Farag
- Department of Electrical Engineering, Alexandria University, Alexandria, Egypt
| | - Lamiaa A. A. Said
- Department of Electrical Engineering, Alexandria Higher Institute of Engineering & Technology (AIET), Alexandria, Egypt
| | - Mohamed R. M. Rizk
- Department of Electrical Engineering, Alexandria University, Alexandria, Egypt
| | - Magdy Abd ElAzim Ahmed
- Department of Computer and Systems Engineering, Alexandria University, Alexandria, Egypt
| |
Collapse
|
32
|
Chen HJ, Mao L, Chen Y, Yuan L, Wang F, Li X, Cai Q, Qiu J, Chen F. Machine learning-based CT radiomics model distinguishes COVID-19 from non-COVID-19 pneumonia. BMC Infect Dis 2021; 21:931. [PMID: 34496794 PMCID: PMC8424152 DOI: 10.1186/s12879-021-06614-6] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2021] [Accepted: 08/24/2021] [Indexed: 12/20/2022] Open
Abstract
BACKGROUND To develop a machine learning-based CT radiomics model is critical for the accurate diagnosis of the rapid spreading coronavirus disease 2019 (COVID-19). METHODS In this retrospective study, a total of 326 chest CT exams from 134 patients (63 confirmed COVID-19 patients and 71 non-COVID-19 patients) were collected from January 20 to February 8, 2020. A semi-automatic segmentation procedure was used to delineate the volume of interest (VOI), and radiomic features were extracted. The Support Vector Machine (SVM) model was built on the combination of 4 groups of features, including radiomic features, traditional radiological features, quantifying features, and clinical features. By repeating cross-validation procedure, the performance on the time-independent testing cohort was evaluated by the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, and specificity. RESULTS For the SVM model built on the combination of 4 groups of features (integrated model), the per-exam AUC was 0.925 (95% CI 0.856 to 0.994) for differentiating COVID-19 on the testing cohort, and the sensitivity and specificity were 0.816 (95% CI 0.651 to 0.917) and 0.923 (95% CI 0.621 to 0.996), respectively. As for the SVM models built on radiomic features, radiological features, quantifying features, and clinical features, individually, the AUC on the testing cohort reached 0.765, 0.818, 0.607, and 0.739, respectively, significantly lower than the integrated model, except for the radiomic model. CONCLUSION The machine learning-based CT radiomics models may accurately classify COVID-19, helping clinicians and radiologists to identify COVID-19 positive cases.
Collapse
Affiliation(s)
- Hui Juan Chen
- Department of Radiology, Hainan General Hospital (Hainan Affiliated Hospital of Hainan Medical University), No. 19, Xiuhua St, Xiuying Dic, Haikou, Hainan, 570311, People's Republic of China
| | - Li Mao
- Deepwise AI Lab, Deepwise Inc., No. 8 Haidian avenue, Sinosteel International Plaza, Beijing, 100080, China
| | - Yang Chen
- Department of Radiology, Hainan General Hospital (Hainan Affiliated Hospital of Hainan Medical University), No. 19, Xiuhua St, Xiuying Dic, Haikou, Hainan, 570311, People's Republic of China
| | - Li Yuan
- Department of Radiology, Hainan General Hospital (Hainan Affiliated Hospital of Hainan Medical University), No. 19, Xiuhua St, Xiuying Dic, Haikou, Hainan, 570311, People's Republic of China
| | - Fei Wang
- Department of Radiology, Hainan General Hospital (Hainan Affiliated Hospital of Hainan Medical University), No. 19, Xiuhua St, Xiuying Dic, Haikou, Hainan, 570311, People's Republic of China
| | - Xiuli Li
- Deepwise AI Lab, Deepwise Inc., No. 8 Haidian avenue, Sinosteel International Plaza, Beijing, 100080, China
| | - Qinlei Cai
- Department of Radiology, Hainan General Hospital (Hainan Affiliated Hospital of Hainan Medical University), No. 19, Xiuhua St, Xiuying Dic, Haikou, Hainan, 570311, People's Republic of China
| | - Jie Qiu
- Department of Ultrasound, Hainan General Hospital (Hainan Affiliated Hospital of Hainan Medical University), No. 19, Xiuhua St, Xiuying Dic, Haikou, Hainan, 570311, People's Republic of China
| | - Feng Chen
- Department of Radiology, Hainan General Hospital (Hainan Affiliated Hospital of Hainan Medical University), No. 19, Xiuhua St, Xiuying Dic, Haikou, Hainan, 570311, People's Republic of China.
| |
Collapse
|
33
|
A Comprehensive Survey of COVID-19 Detection Using Medical Images. ACTA ACUST UNITED AC 2021; 2:434. [PMID: 34485924 PMCID: PMC8401373 DOI: 10.1007/s42979-021-00823-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Accepted: 08/16/2021] [Indexed: 12/24/2022]
Abstract
The outbreak of the Coronavirus disease 2019 (COVID-19) caused the death of a large number of people and declared as a pandemic by the World Health Organization. Millions of people are infected by this virus and are still getting infected every day. As the cost and required time of conventional Reverse Transcription Polymerase Chain Reaction (RT-PCR) tests to detect COVID-19 is uneconomical and excessive, researchers are trying to use medical images such as X-ray and Computed Tomography (CT) images to detect this disease with the help of Artificial Intelligence (AI)-based systems, to assist in automating the scanning procedure. In this paper, we reviewed some of these newly emerging AI-based models that can detect COVID-19 from X-ray or CT of lung images. We collected information about available research resources and inspected a total of 80 papers till June 20, 2020. We explored and analyzed data sets, preprocessing techniques, segmentation methods, feature extraction, classification, and experimental results which can be helpful for finding future research directions in the domain of automatic diagnosis of COVID-19 disease using AI-based frameworks. It is also reflected that there is a scarcity of annotated medical images/data sets of COVID-19 affected people, which requires enhancing, segmentation in preprocessing, and domain adaptation in transfer learning for a model, producing an optimal result in model performance. This survey can be the starting point for a novice/beginner level researcher to work on COVID-19 classification.
Collapse
|
34
|
Ge C, Zhang L, Xie L, Kong R, Zhang H, Chang S. COVID-19 Imaging-based AI Research - A Literature Review. Curr Med Imaging 2021; 18:496-508. [PMID: 34473619 DOI: 10.2174/1573405617666210902103729] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Revised: 07/18/2021] [Accepted: 07/20/2021] [Indexed: 11/22/2022]
Abstract
BACKGROUND The new coronavirus disease 2019 (COVID-19) is spreading rapidly around the world. Artificial intelligence (AI) assisted identification and detection of diseases is an ef-fective method of medical diagnosis. OBJECTIVES To present recent advances in AI-assisted diagnosis of COVID-19, we introduce major aspects of AI in the process of diagnosing COVID-19. METHODS In this paper, we firstly cover the latest collection and processing methods of da-tasets of COVID-19. The processing methods mainly include building public datasets, transfer learning, unsupervised learning and weakly supervised learning, semi-supervised learning methods and so on. Secondly, we introduce the algorithm application and evaluation metrics of AI in medical imaging segmentation and automatic screening. Then, we introduce the quantifi-cation and severity assessment of infection in COVID-19 patients based on image segmenta-tion and automatic screening. Finally, we analyze and point out the current AI-assisted diagno-sis of COVID-19 problems, which may provide useful clues for future work. CONCLUSION AI is critical for COVID-19 diagnosis. Combining chest imaging with AI can not only save time and effort, but also provide more accurate and efficient medical diagnosis results.
Collapse
Affiliation(s)
- Cheng Ge
- Institute of Bioinformatics and Medical Engineering, School of Electrical and Information Engineering, Jiangsu University of Technology, Changzhou 213001, China
| | - Lili Zhang
- Institute of Bioinformatics and Medical Engineering, School of Electrical and Information Engineering, Jiangsu University of Technology, Changzhou 213001, China
| | - Liangxu Xie
- Institute of Bioinformatics and Medical Engineering, School of Electrical and Information Engineering, Jiangsu University of Technology, Changzhou 213001, China
| | - Ren Kong
- Institute of Bioinformatics and Medical Engineering, School of Electrical and Information Engineering, Jiangsu University of Technology, Changzhou 213001, China
| | - Hong Zhang
- School of Mathematics, China University of Mining and Technology, Xuzhou, Jiangsu 221116, China
| | - Shan Chang
- Institute of Bioinformatics and Medical Engineering, School of Electrical and Information Engineering, Jiangsu University of Technology, Changzhou 213001, China
| |
Collapse
|
35
|
Sengupta K, Srivastava PR. Quantum algorithm for quicker clinical prognostic analysis: an application and experimental study using CT scan images of COVID-19 patients. BMC Med Inform Decis Mak 2021; 21:227. [PMID: 34330278 PMCID: PMC8323083 DOI: 10.1186/s12911-021-01588-6] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2020] [Accepted: 07/18/2021] [Indexed: 12/31/2022] Open
Abstract
BACKGROUND In medical diagnosis and clinical practice, diagnosing a disease early is crucial for accurate treatment, lessening the stress on the healthcare system. In medical imaging research, image processing techniques tend to be vital in analyzing and resolving diseases with a high degree of accuracy. This paper establishes a new image classification and segmentation method through simulation techniques, conducted over images of COVID-19 patients in India, introducing the use of Quantum Machine Learning (QML) in medical practice. METHODS This study establishes a prototype model for classifying COVID-19, comparing it with non-COVID pneumonia signals in Computed tomography (CT) images. The simulation work evaluates the usage of quantum machine learning algorithms, while assessing the efficacy for deep learning models for image classification problems, and thereby establishes performance quality that is required for improved prediction rate when dealing with complex clinical image data exhibiting high biases. RESULTS The study considers a novel algorithmic implementation leveraging quantum neural network (QNN). The proposed model outperformed the conventional deep learning models for specific classification task. The performance was evident because of the efficiency of quantum simulation and faster convergence property solving for an optimization problem for network training particularly for large-scale biased image classification task. The model run-time observed on quantum optimized hardware was 52 min, while on K80 GPU hardware it was 1 h 30 min for similar sample size. The simulation shows that QNN outperforms DNN, CNN, 2D CNN by more than 2.92% in gain in accuracy measure with an average recall of around 97.7%. CONCLUSION The results suggest that quantum neural networks outperform in COVID-19 traits' classification task, comparing to deep learning w.r.t model efficacy and training time. However, a further study needs to be conducted to evaluate implementation scenarios by integrating the model within medical devices.
Collapse
Affiliation(s)
- Kinshuk Sengupta
- Microsoft Corporation, New Delhi
, India
- Department of Information System, Indian Institute of Management, Rohtak, India
- City Southern Bypass, Sunaria, Rohtak, Haryana 124010 India
| | - Praveen Ranjan Srivastava
- Department of Information System, Indian Institute of Management, Rohtak, India
- City Southern Bypass, Sunaria, Rohtak, Haryana 124010 India
| |
Collapse
|
36
|
Yousefi B, Kawakita S, Amini A, Akbari H, Advani SM, Akhloufi M, Maldague XPV, Ahadian S. Impartially Validated Multiple Deep-Chain Models to Detect COVID-19 in Chest X-ray Using Latent Space Radiomics. J Clin Med 2021; 10:3100. [PMID: 34300266 PMCID: PMC8304336 DOI: 10.3390/jcm10143100] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2021] [Revised: 07/01/2021] [Accepted: 07/07/2021] [Indexed: 12/31/2022] Open
Abstract
The COVID-19 pandemic continues to spread globally at a rapid pace, and its rapid detection remains a challenge due to its rapid infectivity and limited testing availability. One of the simply available imaging modalities in clinical routine involves chest X-ray (CXR), which is often used for diagnostic purposes. Here, we proposed a computer-aided detection of COVID-19 in CXR imaging using deep and conventional radiomic features. First, we used a 2D U-Net model to segment the lung lobes. Then, we extracted deep latent space radiomics by applying deep convolutional autoencoder (ConvAE) with internal dense layers to extract low-dimensional deep radiomics. We used Johnson-Lindenstrauss (JL) lemma, Laplacian scoring (LS), and principal component analysis (PCA) to reduce dimensionality in conventional radiomics. The generated low-dimensional deep and conventional radiomics were integrated to classify COVID-19 from pneumonia and healthy patients. We used 704 CXR images for training the entire model (i.e., U-Net, ConvAE, and feature selection in conventional radiomics). Afterward, we independently validated the whole system using a study cohort of 1597 cases. We trained and tested a random forest model for detecting COVID-19 cases through multivariate binary-class and multiclass classification. The maximal (full multivariate) model using a combination of the two radiomic groups yields performance in classification cross-validated accuracy of 72.6% (69.4-74.4%) for multiclass and 89.6% (88.4-90.7%) for binary-class classification.
Collapse
Affiliation(s)
- Bardia Yousefi
- Department of Electrical and Computer Engineering, Laval University, Quebec City, QC G1V 0A6, Canada
| | - Satoru Kawakita
- Terasaki Institute for Biomedical Innovation, Los Angeles, CA 90024, USA; (S.K.); (S.M.A.)
| | - Arya Amini
- Department of Radiation Oncology, City of Hope Comprehensive Cancer Center, Duarte, CA 91010, USA;
| | - Hamed Akbari
- Department of Radiology, University of Pennsylvania, Philadelphia, PA 19104, USA;
| | - Shailesh M. Advani
- Terasaki Institute for Biomedical Innovation, Los Angeles, CA 90024, USA; (S.K.); (S.M.A.)
| | - Moulay Akhloufi
- Department of Computer Science, Perception Robotics and Intelligent Machines (PRIME) Research Group, University of Moncton, New Brunswick, NB E1A 3E9, Canada;
| | - Xavier P. V. Maldague
- Department of Electrical and Computer Engineering, Laval University, Quebec City, QC G1V 0A6, Canada
| | - Samad Ahadian
- Terasaki Institute for Biomedical Innovation, Los Angeles, CA 90024, USA; (S.K.); (S.M.A.)
| |
Collapse
|
37
|
Qayyum A, Razzak I, Tanveer M, Kumar A. Depth-wise dense neural network for automatic COVID19 infection detection and diagnosis. ANNALS OF OPERATIONS RESEARCH 2021:1-21. [PMID: 34248242 PMCID: PMC8254442 DOI: 10.1007/s10479-021-04154-5] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 06/08/2021] [Indexed: 05/09/2023]
Abstract
Coronavirus (COVID-19) and its new strain resulted in massive damage to society and brought panic worldwide. Automated medical image analysis such as X-rays, CT, and MRI offers excellent early diagnosis potential to augment the traditional healthcare strategy to fight against COVID-19. However, the identification of COVID infected lungs X-rays is challenging due to the high variation in infection characteristics and low-intensity contrast between normal tissues and infections. To identify the infected area, in this work, we present a novel depth-wise dense network that uniformly scales all dimensions and performs multilevel feature embedding, resulting in increased feature representations. The inclusion of depth wise component and squeeze-and-excitation results in better performance by capturing a more receptive field than the traditional convolutional layer; however, the parameters are almost the same. To improve the performance and training set, we have combined three large scale datasets. The extensive experiments on the benchmark X-rays datasets demonstrate the effectiveness of the proposed framework by achieving 96.17% in comparison to cutting-edge methods primarily based on transfer learning.
Collapse
|
38
|
Munusamy H, Karthikeyan JM, Shriram G, Thanga Revathi S, Aravindkumar S. FractalCovNet architecture for COVID-19 Chest X-ray image Classification and CT-scan image Segmentation. Biocybern Biomed Eng 2021; 41:1025-1038. [PMID: 34257471 PMCID: PMC8264565 DOI: 10.1016/j.bbe.2021.06.011] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Revised: 06/26/2021] [Accepted: 06/30/2021] [Indexed: 12/14/2022]
Abstract
Precise and fast diagnosis of COVID-19 cases play a vital role in early stage of medical treatment and prevention. Automatic detection of COVID-19 cases using the chest X-ray images and chest CT-scan images will be helpful to reduce the impact of this pandemic on the human society. We have developed a novel FractalCovNet architecture using Fractal blocks and U-Net for segmentation of chest CT-scan images to localize the lesion region. The same FractalCovNet architecture is also used for classification of chest X-ray images using transfer learning. We have compared the segmentation results using various model such as U-Net, DenseUNet, Segnet, ResnetUNet, and FCN. We have also compared the classification results with various models like ResNet5-, Xception, InceptionResNetV2, VGG-16 and DenseNet architectures. The proposed FractalCovNet model is able to predict the COVID-19 lesion with high F-measure and precision values compared to the other state-of-the-art methods. Thus the proposed model can accurately predict the COVID-19 cases and discover lesion regions in chest CT without the manual annotations of lesions for every suspected individual. An easily-trained and high-performance deep learning model provides a fast way to identify COVID-19 patients, which is beneficial to control the outbreak of SARS-II-COV.
Collapse
Affiliation(s)
- Hemalatha Munusamy
- Department of Information Technology, Anna University, MIT Campus, Chennai, India
| | - J M Karthikeyan
- Department of Information Technology, Anna University, MIT Campus, Chennai, India
| | - G Shriram
- Department of Information Technology, Anna University, MIT Campus, Chennai, India
| | - S Thanga Revathi
- Department of Computer Science and Engineering, SRM Institute of Science and Technology, Chennai, India
| | - S Aravindkumar
- Department of Information Technology, Rajalakshmi Engineering College, Chennai, India
| |
Collapse
|
39
|
Rajamani KT, Siebert H, Heinrich MP. Dynamic deformable attention network (DDANet) for COVID-19 lesions semantic segmentation. J Biomed Inform 2021; 119:103816. [PMID: 34022421 PMCID: PMC9246608 DOI: 10.1016/j.jbi.2021.103816] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2020] [Revised: 05/05/2021] [Accepted: 05/16/2021] [Indexed: 12/24/2022]
Abstract
Deep learning based medical image segmentation is an important step within diagnosis, which relies strongly on capturing sufficient spatial context without requiring too complex models that are hard to train with limited labelled data. Training data is in particular scarce for segmenting infection regions of CT images of COVID-19 patients. Attention models help gather contextual information within deep networks and benefit semantic segmentation tasks. The recent criss-cross-attention module aims to approximate global self-attention while remaining memory and time efficient by separating horizontal and vertical self-similarity computations. However, capturing attention from all non-local locations can adversely impact the accuracy of semantic segmentation networks. We propose a new Dynamic Deformable Attention Network (DDANet) that enables a more accurate contextual information computation in a similarly efficient way. Our novel technique is based on a deformable criss-cross attention block that learns both attention coefficients and attention offsets in a continuous way. A deep U-Net (Schlemper et al., 2019) segmentation network that employs this attention mechanism is able to capture attention from pertinent non-local locations and also improves the performance on semantic segmentation tasks compared to criss-cross attention within a U-Net on a challenging COVID-19 lesion segmentation task. Our validation experiments show that the performance gain of the recursively applied dynamic deformable attention blocks comes from their ability to capture dynamic and precise attention context. Our DDANet achieves Dice scores of 73.4% and 61.3% for Ground-glass opacity and consolidation lesions for COVID-19 segmentation and improves the accuracy by 4.9% points compared to a baseline U-Net and 24.4% points compared to current state of art methods (Fan et al., 2020).
Collapse
Affiliation(s)
- Kumar T Rajamani
- Institute of Medical Informatics, University of Lübeck, Germany.
| | - Hanna Siebert
- Institute of Medical Informatics, University of Lübeck, Germany.
| | | |
Collapse
|
40
|
Abdulkareem M, Petersen SE. The Promise of AI in Detection, Diagnosis, and Epidemiology for Combating COVID-19: Beyond the Hype. Front Artif Intell 2021; 4:652669. [PMID: 34056579 PMCID: PMC8160471 DOI: 10.3389/frai.2021.652669] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2021] [Accepted: 04/13/2021] [Indexed: 12/24/2022] Open
Abstract
COVID-19 has created enormous suffering, affecting lives, and causing deaths. The ease with which this type of coronavirus can spread has exposed weaknesses of many healthcare systems around the world. Since its emergence, many governments, research communities, commercial enterprises, and other institutions and stakeholders around the world have been fighting in various ways to curb the spread of the disease. Science and technology have helped in the implementation of policies of many governments that are directed toward mitigating the impacts of the pandemic and in diagnosing and providing care for the disease. Recent technological tools, artificial intelligence (AI) tools in particular, have also been explored to track the spread of the coronavirus, identify patients with high mortality risk and diagnose patients for the disease. In this paper, areas where AI techniques are being used in the detection, diagnosis and epidemiological predictions, forecasting and social control for combating COVID-19 are discussed, highlighting areas of successful applications and underscoring issues that need to be addressed to achieve significant progress in battling COVID-19 and future pandemics. Several AI systems have been developed for diagnosing COVID-19 using medical imaging modalities such as chest CT and X-ray images. These AI systems mainly differ in their choices of the algorithms for image segmentation, classification and disease diagnosis. Other AI-based systems have focused on predicting mortality rate, long-term patient hospitalization and patient outcomes for COVID-19. AI has huge potential in the battle against the COVID-19 pandemic but successful practical deployments of these AI-based tools have so far been limited due to challenges such as limited data accessibility, the need for external evaluation of AI models, the lack of awareness of AI experts of the regulatory landscape governing the deployment of AI tools in healthcare, the need for clinicians and other experts to work with AI experts in a multidisciplinary context and the need to address public concerns over data collection, privacy, and protection. Having a dedicated team with expertise in medical data collection, privacy, access and sharing, using federated learning whereby AI scientists hand over training algorithms to the healthcare institutions to train models locally, and taking full advantage of biomedical data stored in biobanks can alleviate some of problems posed by these challenges. Addressing these challenges will ultimately accelerate the translation of AI research into practical and useful solutions for combating pandemics.
Collapse
Affiliation(s)
- Musa Abdulkareem
- Barts Heart Centre, Barts Health National Health Service (NHS) Trust, London, United Kingdom
- National Institute for Health Research (NIHR) Barts Biomedical Research Centre, William Harvey Research Institute, Queen Mary University of London, London, United Kingdom
- Health Data Research UK, London, United Kingdom
| | - Steffen E. Petersen
- Barts Heart Centre, Barts Health National Health Service (NHS) Trust, London, United Kingdom
- National Institute for Health Research (NIHR) Barts Biomedical Research Centre, William Harvey Research Institute, Queen Mary University of London, London, United Kingdom
- Health Data Research UK, London, United Kingdom
- The Alan Turing Institute, London, United Kingdom
| |
Collapse
|
41
|
Tello-Mijares S, Woo L. Computed Tomography Image Processing Analysis in COVID-19 Patient Follow-Up Assessment. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:8869372. [PMID: 33968356 PMCID: PMC8083830 DOI: 10.1155/2021/8869372] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/18/2020] [Revised: 02/19/2021] [Accepted: 04/08/2021] [Indexed: 01/17/2023]
Abstract
The rapid worldwide spread of the COVID-19 pandemic has infected patients around the world in a short space of time. Chest computed tomography (CT) images of patients who are infected with COVID-19 can offer early diagnosis and efficient forecast monitoring at a low cost. The diagnosis of COVID-19 on CT in an automated way can speed up many tasks and the application of medical treatments. This can help complement reverse transcription-polymerase chain reaction (RT-PCR) diagnosis. The aim of this work is to develop a system that automatically identifies ground-glass opacity (GGO) and pulmonary infiltrates (PIs) on CT images from patients with COVID-19. The purpose is to assess the disease progression during the patient's follow-up assessment and evaluation. We propose an efficient methodology that incorporates oversegmentation mean shift followed by superpixel-SLIC (simple linear iterative clustering) algorithm on CT images with COVID-19 for pulmonary parenchyma segmentation. To identify the pulmonary parenchyma, we described each superpixel cluster according to its position, grey intensity, second-order texture, and spatial-context-saliency features to classify by a tree random forest (TRF). Second, by applying the watershed segmentation to the mean-shift clusters, only pulmonary parenchyma segmentation-identified zones showed GGO and PI based on the description of each watershed cluster of its position, grey intensity, gradient entropy, second-order texture, Euclidean position to the border region of the PI zone, and global saliency features, after using TRF. Our classification results for pulmonary parenchyma identification on CT images with COVID-19 had a precision of over 92% and recall of over 92% on twofold cross validation. For GGO, the PI identification showed 96% precision and 96% recall on twofold cross validation.
Collapse
Affiliation(s)
- Santiago Tello-Mijares
- Postgraduate Department, Instituto Tecnológico Superior de Lerdo, 35150 Lerdo DGO, Mexico
| | - Luisa Woo
- Medical Familiar Unit, Instituto de Seguridad y Servicios Sociales de Los Trabajadores del Estado, 27268 Torreón COAH, Mexico
| |
Collapse
|
42
|
Chakraborty S, Mali K. SuFMoFPA: A superpixel and meta-heuristic based fuzzy image segmentation approach to explicate COVID-19 radiological images. EXPERT SYSTEMS WITH APPLICATIONS 2021; 167:114142. [PMID: 34924697 PMCID: PMC8664408 DOI: 10.1016/j.eswa.2020.114142] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/29/2020] [Revised: 10/05/2020] [Accepted: 10/19/2020] [Indexed: 05/21/2023]
Abstract
Coronavirus disease 2019 or COVID-19 is one of the biggest challenges which are being faced by mankind. Researchers are continuously trying to discover a vaccine or medicine for this highly infectious disease but, proper success is not achieved to date. Many countries are suffering from this disease and trying to find some solution that can prevent the dramatic spread of this virus. Although the mortality rate is not very high, the highly infectious nature of this virus makes it a global threat. RT-PCR test is the only means to confirm the presence of this virus to date. Only precautionary measures like early screening, frequent hand wash, social distancing use of masks, and other protective equipment can prevent us from this virus. Some researches show that the radiological images can be quite helpful for the early screening purpose because some features of the radiological images indicate the presence of the COVID-19 virus and therefore, it can serve as an effective screening tool. Automated analysis of these radiological images can help the physicians and other domain experts to study and screen the suspected patients easily and reliably within the stipulated amount of time. This method may not replace the traditional RT-PCR method for detection but, it can be helpful to filter the suspected patients from the rest of the community that can effectively reduce the spread in the of this virus. A novel method is proposed in this work to segment the radiological images for the better explication of the COVID-19 radiological images. The proposed method will be known as SuFMoFPA (Superpixel based Fuzzy Modified Flower Pollination Algorithm). The type 2 fuzzy clustering system is blended with this proposed approach to get the better-segmented outcome. Obtained results are quite promising and outperforming some of the standard approaches which are encouraging for the practical uses of the proposed approach to screening the COVID-19 patients.
Collapse
Affiliation(s)
- Shouvik Chakraborty
- Department of Computer Science and Engineering, University of Kalyani, India
| | - Kalyani Mali
- Department of Computer Science and Engineering, University of Kalyani, India
| |
Collapse
|
43
|
Budak Ü, Çıbuk M, Cömert Z, Şengür A. Efficient COVID-19 Segmentation from CT Slices Exploiting Semantic Segmentation with Integrated Attention Mechanism. J Digit Imaging 2021; 34:263-272. [PMID: 33674979 PMCID: PMC7935480 DOI: 10.1007/s10278-021-00434-5] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2020] [Revised: 02/12/2021] [Accepted: 02/17/2021] [Indexed: 12/24/2022] Open
Abstract
Coronavirus (COVID-19) is a pandemic, which caused suddenly unexplained pneumonia cases and caused a devastating effect on global public health. Computerized tomography (CT) is one of the most effective tools for COVID-19 screening. Since some specific patterns such as bilateral, peripheral, and basal predominant ground-glass opacity, multifocal patchy consolidation, crazy-paving pattern with a peripheral distribution can be observed in CT images and these patterns have been declared as the findings of COVID-19 infection. For patient monitoring, diagnosis and segmentation of COVID-19, which spreads into the lung, expeditiously and accurately from CT, will provide vital information about the stage of the disease. In this work, we proposed a SegNet-based network using the attention gate (AG) mechanism for the automatic segmentation of COVID-19 regions in CT images. AGs can be easily integrated into standard convolutional neural network (CNN) architectures with a minimum computing load as well as increasing model precision and predictive accuracy. Besides, the success of the proposed network has been evaluated based on dice, Tversky, and focal Tversky loss functions to deal with low sensitivity arising from the small lesions. The experiments were carried out using a fivefold cross-validation technique on a COVID-19 CT segmentation database containing 473 CT images. The obtained sensitivity, specificity, and dice scores were reported as 92.73%, 99.51%, and 89.61%, respectively. The superiority of the proposed method has been highlighted by comparing with the results reported in previous studies and it is thought that it will be an auxiliary tool that accurately detects automatic COVID-19 regions from CT images.
Collapse
Affiliation(s)
- Ümit Budak
- Department of Electrical and Electronics Engineering, Bitlis Eren University, Bitlis, Turkey.
| | - Musa Çıbuk
- Department of Computer Engineering, Bitlis Eren University, Bitlis, Turkey
| | - Zafer Cömert
- Department of Software Engineering, Samsun University, Samsun, Turkey
| | - Abdulkadir Şengür
- Department of Electrical-Electronics Engineering, Technology Faculty, Firat University, Elazig, Turkey
| |
Collapse
|
44
|
Belkacem AN, Ouhbi S, Lakas A, Benkhelifa E, Chen C. End-to-End AI-Based Point-of-Care Diagnosis System for Classifying Respiratory Illnesses and Early Detection of COVID-19: A Theoretical Framework. Front Med (Lausanne) 2021; 8:585578. [PMID: 33869239 PMCID: PMC8044874 DOI: 10.3389/fmed.2021.585578] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2020] [Accepted: 03/08/2021] [Indexed: 01/10/2023] Open
Abstract
Respiratory symptoms can be caused by different underlying conditions, and are often caused by viral infections, such as Influenza-like illnesses or other emerging viruses like the Coronavirus. These respiratory viruses, often, have common symptoms: coughing, high temperature, congested nose, and difficulty breathing. However, early diagnosis of the type of the virus, can be crucial, especially in cases, such as the COVID-19 pandemic. Among the factors that contributed to the spread of the COVID-19 pandemic were the late diagnosis or misinterpretation of COVID-19 symptoms as regular flu-like symptoms. Research has shown that one of the possible differentiators of the underlying causes of different respiratory diseases could be the cough sound, which comes in different types and forms. A reliable lab-free tool for early and accurate diagnosis, which can differentiate between different respiratory diseases is therefore very much needed, particularly during the current pandemic. This concept paper discusses a medical hypothesis of an end-to-end portable system that can record data from patients with symptoms, including coughs (voluntary or involuntary) and translate them into health data for diagnosis, and with the aid of machine learning, classify them into different respiratory illnesses, including COVID-19. With the ongoing efforts to stop the spread of the COVID-19 disease everywhere today, and against similar diseases in the future, our proposed low cost and user-friendly theoretical solution could play an important part in the early diagnosis.
Collapse
Affiliation(s)
- Abdelkader Nasreddine Belkacem
- Department of Computer and Network Engineering, College of Information Technology, UAE University, Al Ain, United Arab Emirates
| | - Sofia Ouhbi
- Department of Computer Science and Software Engineering, College of Information Technology, UAE University, Al Ain, United Arab Emirates
| | - Abderrahmane Lakas
- Department of Computer and Network Engineering, College of Information Technology, UAE University, Al Ain, United Arab Emirates
| | - Elhadj Benkhelifa
- Cloud Computing and Applications Research Lab, Staffordshire University, Stoke-on-Trent, United Kingdom
| | - Chao Chen
- Key Laboratory of Complex System Control Theory and Application, Tianjin University of Technology, Tianjin, China
| |
Collapse
|
45
|
Xie H, Li Q, Hu PF, Zhu SH, Zhang JF, Zhou HD, Zhou HB. Helping Roles of Artificial Intelligence (AI) in the Screening and Evaluation of COVID-19 Based on the CT Images. J Inflamm Res 2021; 14:1165-1172. [PMID: 33814922 PMCID: PMC8009533 DOI: 10.2147/jir.s301866] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Accepted: 03/03/2021] [Indexed: 12/21/2022] Open
Abstract
Objective The aim of this study was to explore the role of the AI system which was designed and developed based on the characteristics of COVID-19 CT images in the screening and evaluation of COVID-19. Methods The research team adopted an improved U-shaped neural network to segment lungs and pneumonia lesions in CT images through multilayer convolution iterations. Then the appropriate 159 cases were selected to establish and train the model, and Dice loss function and Adam optimizer were used for network training with the initial learning rate of 0.001. Finally, 39 cases (29 positive and 10 negative) were selected for the comparative test. Experimental group: an attending physician a and an associate chief physician a read the CT images to diagnose COVID-19 with the help of the AI system. Control group: an attending physician b and an associate chief physician b did the diagnosis only by their experience, without the help of the AI system. The time spent by each doctor in the diagnosis and their diagnostic results were recorded. Paired t-test, univariate ANOVA, chi-squared test, receiver operating characteristic curves, and logistic regression analysis were used for the statistical analysis. Results There was statistical significance in the time spent in the diagnosis of different groups (P<0.05). For the group with the optimal diagnostic results, univariate and multivariate analyses both suggested no significant correlation for all variables, and thus it might be the assistance of the AI system, the epidemiological history and other factors that played an important role. Conclusion The AI system developed by us, which was created due to COVID-19, had certain clinical practicability and was worth popularizing.
Collapse
Affiliation(s)
- Hui Xie
- Department of Radiation Oncology, Affiliated Hospital (Clinical College) of Xiangnan University, Chenzhou, 423000, People's Republic of China.,Key Laboratory of Medical Imaging and Artificial Intelligence of Hunan Province, Chenzhou, 423000, People's Republic of China
| | - Qing Li
- Key Laboratory of Medical Imaging and Artificial Intelligence of Hunan Province, Chenzhou, 423000, People's Republic of China.,Department of Interventional Vascular Surgery, Affiliated Hospital (Clinical College) of Xiangnan University, Chenzhou, 423000, People's Republic of China
| | - Ping-Feng Hu
- Department of Radiology, The Second People's Hospital of Chenzhou City, Chenzhou, 423000, People's Republic of China
| | - Sen-Hua Zhu
- Beijing Linking Medical Technology Co., Ltd, Beijing, 100085, People's Republic of China
| | - Jian-Fang Zhang
- Department of Physical Examination, Disease Control and Prevention of Chenzhou, Chenzhou, 423000, People's Republic of China
| | - Hong-Da Zhou
- Department of Radiation Oncology, Affiliated Hospital (Clinical College) of Xiangnan University, Chenzhou, 423000, People's Republic of China
| | - Hai-Bo Zhou
- Department of Radiology, The Second People's Hospital of Chenzhou City, Chenzhou, 423000, People's Republic of China
| |
Collapse
|
46
|
Mohammad-Rahimi H, Nadimi M, Ghalyanchi-Langeroudi A, Taheri M, Ghafouri-Fard S. Application of Machine Learning in Diagnosis of COVID-19 Through X-Ray and CT Images: A Scoping Review. Front Cardiovasc Med 2021; 8:638011. [PMID: 33842563 PMCID: PMC8027078 DOI: 10.3389/fcvm.2021.638011] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2021] [Accepted: 02/23/2021] [Indexed: 12/15/2022] Open
Abstract
Coronavirus disease, first detected in late 2019 (COVID-19), has spread fast throughout the world, leading to high mortality. This condition can be diagnosed using RT-PCR technique on nasopharyngeal and throat swabs with sensitivity values ranging from 30 to 70%. However, chest CT scans and X-ray images have been reported to have sensitivity values of 98 and 69%, respectively. The application of machine learning methods on CT and X-ray images has facilitated the accurate diagnosis of COVID-19. In this study, we reviewed studies which used machine and deep learning methods on chest X-ray images and CT scans for COVID-19 diagnosis and compared their performance. The accuracy of these methods ranged from 76% to more than 99%, indicating the applicability of machine and deep learning methods in the clinical diagnosis of COVID-19.
Collapse
Affiliation(s)
- Hossein Mohammad-Rahimi
- Dental Research Center, Research Institute of Dental Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Mohadeseh Nadimi
- Department of Medical Physics and Biomedical Engineering, Tehran University of Medical Sciences (TUMS), Tehran, Iran
- Research Center for Biomedical Technologies and Robotics (RCBTR), Tehran, Iran
| | - Azadeh Ghalyanchi-Langeroudi
- Department of Medical Physics and Biomedical Engineering, Tehran University of Medical Sciences (TUMS), Tehran, Iran
- Research Center for Biomedical Technologies and Robotics (RCBTR), Tehran, Iran
| | - Mohammad Taheri
- Urology and Nephrology Research Center, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Soudeh Ghafouri-Fard
- Department of Medical Genetics, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| |
Collapse
|
47
|
Das AK, Kalam S, Kumar C, Sinha D. TLCoV- An automated Covid-19 screening model using Transfer Learning from chest X-ray images. CHAOS, SOLITONS, AND FRACTALS 2021; 144:110713. [PMID: 33526961 PMCID: PMC7825894 DOI: 10.1016/j.chaos.2021.110713] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/08/2020] [Revised: 01/05/2021] [Accepted: 01/19/2021] [Indexed: 05/09/2023]
Abstract
The Coronavirus disease (Covid-19) has been declared a pandemic by World Health Organisation (WHO) and till date caused 585,727 numbers of deaths all over the world. The only way to minimize the number of death is to quarantine the patients tested Corona positive. The quick spread of this disease can be reduced by automatic screening to cover the lack of radiologists. Though the researchers already have done extremely well to design pioneering deep learning models for the screening of Covid-19, most of them results in low accuracy rate. In addition, over-fitting problem increases difficulties for those models to learn on existing Covid-19 datasets. In this paper, an automated Covid-19 screening model is designed to identify the patients suffering from this disease by using their chest X-ray images. The model classifies the images in three categories - Covid-19 positive, other pneumonia infection and no infection. Three learning schemes such as CNN, VGG-16 and ResNet-50 are separately used to learn the model. A standard Covid-19 radiography dataset from the repository of Kaggle is used to get the chest X-ray images. The performance of the model with all the three learning schemes has been evaluated and it shows VGG-16 performed better as compared to CNN and ResNet-50. The model with VGG-16 gives the accuracy of 97.67%, precision of 96.65%, recall of 96.54% and F1 score of 96.59%. The performance evaluation also shows that our model outperforms two existing models to screen the Covid-19.
Collapse
Affiliation(s)
- Ayan Kumar Das
- Birla Institute of Technology, Mesra, Patna Campus, Patna-800014, India
| | - Sidra Kalam
- Birla Institute of Technology, Mesra, Patna Campus, Patna-800014, India
| | - Chiranjeev Kumar
- Birla Institute of Technology, Mesra, Patna Campus, Patna-800014, India
| | | |
Collapse
|
48
|
Tan W, Liu P, Li X, Liu Y, Zhou Q, Chen C, Gong Z, Yin X, Zhang Y. Classification of COVID-19 pneumonia from chest CT images based on reconstructed super-resolution images and VGG neural network. Health Inf Sci Syst 2021; 9:10. [PMID: 33643612 PMCID: PMC7896179 DOI: 10.1007/s13755-021-00140-0] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2020] [Accepted: 01/16/2021] [Indexed: 12/13/2022] Open
Abstract
The COVID-19 coronavirus has spread rapidly around the world and has caused global panic. Chest CT images play a major role in confirming positive COVID-19 patients. The computer aided diagnosis of COVID-19 from CT images based on artificial intelligence have been developed and deployed in some hospitals. But environmental influences and the movement of lung will affect the image quality, causing the lung parenchyma and pneumonia area unclear in CT images. Therefore, the performance of COVID-19's artificial intelligence diagnostic algorithm is reduced. If chest CT images are reconstructed, the accuracy and performance of the aided diagnostic algorithm may be improved. In this paper, a new aided diagnostic algorithm for COVID-19 based on super-resolution reconstructed images and convolutional neural network is presented. Firstly, the SRGAN neural network is used to reconstruct super-resolution images from original chest CT images. Then COVID-19 images and Non-COVID-19 images are classified from super-resolution chest CT images by VGG16 neural network. Finally, the performance of this method is verified by the pubic COVID-CT dataset and compared with other aided diagnosis methods of COVID-19. The experimental results show that improving the data quality through SRGAN neural network can greatly improve the final classification accuracy when the data quality is low. This proves that this method can obtain high accuracy, sensitivity and specificity in the examined test image datasets and has similar performance to other state-of-the-art deep learning aided algorithms.
Collapse
Affiliation(s)
- Wenjun Tan
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Pan Liu
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Xiaoshuo Li
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Yao Liu
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Qinghua Zhou
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Chao Chen
- Key Laboratory of Complex System Control Theory and Application, Tianjin University of Technology, Tianjin, 300384 China
| | - Zhaoxuan Gong
- Department of Computer science, Shenyang Aerospace University, Shenyang, 110136 Liaoning China
| | - Xiaoxia Yin
- Cyberspace Institute of Advanced Technology, Guangzhou University, Guangzhou, 510006 China
| | - Yanchun Zhang
- Centre for Applied Informatics, College of Engineering and Science, Victoria University, Melbourne, VIC 8001 Australia
| |
Collapse
|
49
|
Quiroz JC, Feng YZ, Cheng ZY, Rezazadegan D, Chen PK, Lin QT, Qian L, Liu XF, Berkovsky S, Coiera E, Song L, Qiu X, Liu S, Cai XR. Development and Validation of a Machine Learning Approach for Automated Severity Assessment of COVID-19 Based on Clinical and Imaging Data: Retrospective Study. JMIR Med Inform 2021; 9:e24572. [PMID: 33534723 PMCID: PMC7879715 DOI: 10.2196/24572] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2020] [Revised: 01/24/2021] [Accepted: 01/27/2021] [Indexed: 01/15/2023] Open
Abstract
BACKGROUND COVID-19 has overwhelmed health systems worldwide. It is important to identify severe cases as early as possible, such that resources can be mobilized and treatment can be escalated. OBJECTIVE This study aims to develop a machine learning approach for automated severity assessment of COVID-19 based on clinical and imaging data. METHODS Clinical data-including demographics, signs, symptoms, comorbidities, and blood test results-and chest computed tomography scans of 346 patients from 2 hospitals in the Hubei Province, China, were used to develop machine learning models for automated severity assessment in diagnosed COVID-19 cases. We compared the predictive power of the clinical and imaging data from multiple machine learning models and further explored the use of four oversampling methods to address the imbalanced classification issue. Features with the highest predictive power were identified using the Shapley Additive Explanations framework. RESULTS Imaging features had the strongest impact on the model output, while a combination of clinical and imaging features yielded the best performance overall. The identified predictive features were consistent with those reported previously. Although oversampling yielded mixed results, it achieved the best model performance in our study. Logistic regression models differentiating between mild and severe cases achieved the best performance for clinical features (area under the curve [AUC] 0.848; sensitivity 0.455; specificity 0.906), imaging features (AUC 0.926; sensitivity 0.818; specificity 0.901), and a combination of clinical and imaging features (AUC 0.950; sensitivity 0.764; specificity 0.919). The synthetic minority oversampling method further improved the performance of the model using combined features (AUC 0.960; sensitivity 0.845; specificity 0.929). CONCLUSIONS Clinical and imaging features can be used for automated severity assessment of COVID-19 and can potentially help triage patients with COVID-19 and prioritize care delivery to those at a higher risk of severe disease.
Collapse
Affiliation(s)
- Juan Carlos Quiroz
- Centre for Health Informatics, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, Macquarie Park, Australia
- Centre for Big Data Research in Health, University of New South Wales, Sydney, Australia
| | - You-Zhen Feng
- Medical Imaging Centre, The First Affiliated Hospital of Jinan University, Guangzhou, China
| | - Zhong-Yuan Cheng
- Medical Imaging Centre, The First Affiliated Hospital of Jinan University, Guangzhou, China
| | - Dana Rezazadegan
- Centre for Health Informatics, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, Macquarie Park, Australia
- Department of Computer Science and Software Engineering, Swinburne University of Technology, Melbourne, Australia
| | - Ping-Kang Chen
- Medical Imaging Centre, The First Affiliated Hospital of Jinan University, Guangzhou, China
| | - Qi-Ting Lin
- Medical Imaging Centre, The First Affiliated Hospital of Jinan University, Guangzhou, China
| | - Long Qian
- Department of Biomedical Engineering, Peking University, Beijing, China
| | - Xiao-Fang Liu
- Institute of Robotics and Automatic Information System, College of Artificial Intelligence, Nankai University, Tianjin, China
- School of Data and Computer Science, Sun Yat-sen University, Guangzhou, China
| | - Shlomo Berkovsky
- Centre for Health Informatics, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, Macquarie Park, Australia
| | - Enrico Coiera
- Centre for Health Informatics, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, Macquarie Park, Australia
| | - Lei Song
- Department of Radiology, Xiangyang Central Hospital, Affiliated Hospital of Hubei University of Arts and Science, Xiangyang, China
| | - Xiaoming Qiu
- Department of Radiology, Huangshi Central Hospital, Affiliated Hospital of Hubei Polytechnic University, Edong Healthcare Group, Huangshi, China
| | - Sidong Liu
- Centre for Health Informatics, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, Macquarie Park, Australia
| | - Xiang-Ran Cai
- Medical Imaging Centre, The First Affiliated Hospital of Jinan University, Guangzhou, China
| |
Collapse
|
50
|
Albahli S, Yar GNAH. Fast and Accurate Detection of COVID-19 Along With 14 Other Chest Pathologies Using a Multi-Level Classification: Algorithm Development and Validation Study. J Med Internet Res 2021; 23:e23693. [PMID: 33529154 PMCID: PMC7879720 DOI: 10.2196/23693] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2020] [Revised: 10/12/2020] [Accepted: 01/31/2021] [Indexed: 01/16/2023] Open
Abstract
BACKGROUND COVID-19 has spread very rapidly, and it is important to build a system that can detect it in order to help an overwhelmed health care system. Many research studies on chest diseases rely on the strengths of deep learning techniques. Although some of these studies used state-of-the-art techniques and were able to deliver promising results, these techniques are not very useful if they can detect only one type of disease without detecting the others. OBJECTIVE The main objective of this study was to achieve a fast and more accurate diagnosis of COVID-19. This study proposes a diagnostic technique that classifies COVID-19 x-ray images from normal x-ray images and those specific to 14 other chest diseases. METHODS In this paper, we propose a novel, multilevel pipeline, based on deep learning models, to detect COVID-19 along with other chest diseases based on x-ray images. This pipeline reduces the burden of a single network to classify a large number of classes. The deep learning models used in this study were pretrained on the ImageNet dataset, and transfer learning was used for fast training. The lungs and heart were segmented from the whole x-ray images and passed onto the first classifier that checks whether the x-ray is normal, COVID-19 affected, or characteristic of another chest disease. If it is neither a COVID-19 x-ray image nor a normal one, then the second classifier comes into action and classifies the image as one of the other 14 diseases. RESULTS We show how our model uses state-of-the-art deep neural networks to achieve classification accuracy for COVID-19 along with 14 other chest diseases and normal cases based on x-ray images, which is competitive with currently used state-of-the-art models. Due to the lack of data in some classes such as COVID-19, we applied 10-fold cross-validation through the ResNet50 model. Our classification technique thus achieved an average training accuracy of 96.04% and test accuracy of 92.52% for the first level of classification (ie, 3 classes). For the second level of classification (ie, 14 classes), our technique achieved a maximum training accuracy of 88.52% and test accuracy of 66.634% by using ResNet50. We also found that when all the 16 classes were classified at once, the overall accuracy for COVID-19 detection decreased, which in the case of ResNet50 was 88.92% for training data and 71.905% for test data. CONCLUSIONS Our proposed pipeline can detect COVID-19 with a higher accuracy along with detecting 14 other chest diseases based on x-ray images. This is achieved by dividing the classification task into multiple steps rather than classifying them collectively.
Collapse
Affiliation(s)
- Saleh Albahli
- Department of Information Technology, College of Computer, Qassim University, Buraydah, Saudi Arabia
- Department of Computer Science, Kent State University, Kent, OH, United States
| | | |
Collapse
|