451
|
Singh RK, Pandey R, Babu RN. COVIDScreen: explainable deep learning framework for differential diagnosis of COVID-19 using chest X-rays. Neural Comput Appl 2021; 33:8871-8892. [PMID: 33437132 PMCID: PMC7791540 DOI: 10.1007/s00521-020-05636-6] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Accepted: 12/15/2020] [Indexed: 12/24/2022]
Abstract
COVID-19 has emerged as a global crisis with unprecedented socio-economic challenges, jeopardizing our lives and livelihoods for years to come. The unavailability of vaccines for COVID-19 has rendered rapid testing of the population instrumental in order to contain the exponential rise in cases of infection. Shortage of RT-PCR test kits and delays in obtaining test results calls for alternative methods of rapid and reliable diagnosis. In this article, we propose a novel deep learning-based solution using chest X-rays which can help in rapid triaging of COVID-19 patients. The proposed solution uses image enhancement, image segmentation, and employs a modified stacked ensemble model consisting of four CNN base-learners along with Naive Bayes as meta-learner to classify chest X-rays into three classes viz. COVID-19, pneumonia, and normal. An effective pruning strategy as introduced in the proposed framework results in increased model performance, generalizability, and decreased model complexity. We incorporate explainability in our article by using Grad-CAM visualization in order to establish trust in the medical AI system. Furthermore, we evaluate multiple state-of-the-art GAN architectures and their ability to generate realistic synthetic samples of COVID-19 chest X-rays to deal with limited numbers of training samples. The proposed solution significantly outperforms existing methods, with 98.67% accuracy, 0.98 Kappa score, and F-1 scores of 100, 98, and 98 for COVID-19, normal, and pneumonia classes, respectively, on standard datasets. The proposed solution can be used as one element of patient evaluation along with gold-standard clinical and laboratory testing.
Collapse
Affiliation(s)
| | - Rohan Pandey
- Shiv Nadar University, NCR, Gautam Budh Nagar, India
| | | |
Collapse
|
452
|
Shastri S, Singh K, Kumar S, Kour P, Mansotra V. Deep-LSTM ensemble framework to forecast Covid-19: an insight to the global pandemic. ACTA ACUST UNITED AC 2021; 13:1291-1301. [PMID: 33426425 PMCID: PMC7779101 DOI: 10.1007/s41870-020-00571-0] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2020] [Accepted: 11/12/2020] [Indexed: 12/16/2022]
Abstract
The pandemic of Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) is spreading all over the world. Medical health care systems are in urgent need to diagnose this pandemic with the support of new emerging technologies like artificial intelligence (AI), internet of things (IoT) and Big Data System. In this dichotomy study, we divide our research in two ways—firstly, the review of literature is carried out on databases of Elsevier, Google Scholar, Scopus, PubMed and Wiley Online using keywords Coronavirus, Covid-19, artificial intelligence on Covid-19, Coronavirus 2019 and collected the latest information about Covid-19. Possible applications are identified from the same to enhance the future research. We have found various databases, websites and dashboards working on real time extraction of Covid-19 data. This will be conducive for future research to easily locate the available information. Secondly, we designed a nested ensemble model using deep learning methods based on long short term memory (LSTM). Proposed Deep-LSTM ensemble model is evaluated on intensive care Covid-19 confirmed and death cases of India with different classification metrics such as accuracy, precision, recall, f-measure and mean absolute percentage error. Medical healthcare facilities are boosted with the intervention of AI as it can mimic human intelligence. Contactless treatment is possible only with the help of AI assisted automated health care systems. Furthermore, remote location self treatment is one of the key benefits provided by AI based systems.
Collapse
Affiliation(s)
- Sourabh Shastri
- Department of Computer Science and IT, University of Jammu, Jammu, Jammu and Kashmir 180006 India
| | - Kuljeet Singh
- Department of Computer Science and IT, University of Jammu, Jammu, Jammu and Kashmir 180006 India
| | - Sachin Kumar
- Department of Computer Science and IT, University of Jammu, Jammu, Jammu and Kashmir 180006 India
| | - Paramjit Kour
- Department of Computer Science and IT, University of Jammu, Jammu, Jammu and Kashmir 180006 India
| | - Vibhakar Mansotra
- Department of Computer Science and IT, University of Jammu, Jammu, Jammu and Kashmir 180006 India
| |
Collapse
|
453
|
Murugan R, Goel T. E-DiCoNet: Extreme learning machine based classifier for diagnosis of COVID-19 using deep convolutional network. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING 2021; 12:8887-8898. [PMID: 33425051 PMCID: PMC7778490 DOI: 10.1007/s12652-020-02688-3] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/26/2020] [Accepted: 11/08/2020] [Indexed: 06/12/2023]
Abstract
The novel coronavirus disease (COVID-19) spread quickly worldwide, changing the everyday lives of billions of individuals. The preliminary diagnosis of COVID-19 empowers health experts and government professionals to break the chain of change and level the epidemic curve. The regular sort of COVID-19 detection test, be that as it may, requires specific hardware and generally has low sensitivity. Chest X-ray images to be used to diagnosis the COVID-19. In this work, a dataset of X-ray images with COVID-19, bacterial pneumonia, and normal was used to diagnose the COVID-19 automatically. This work to assess the execution of best in class Convolutional Neural Network (CNN) models proposed over ongoing years for clinical image classification. In particular, the modified pre-trained CNN-ResNet50 based Extreme Learning Machine classifier (ELM) has proposed for different diagnosis abnormalities such as COVID-19, Pneumonia, and normal. The proposed CNN method has trained and tested with the publicly available COVID-19, pneumonia, and normal datasets. The presented pre-trained ResNet CNN model provides accuracy, sensitivity, specificity, recall, precision, and F1 score values of 94.07, 98.15, 91.48, 85.21, 98.15, and 91.22, respectively, which is the best classification performance than other states of the art methods. This study introduced a computationally productive and exceptionally exact model for multi-class grouping of three diverse contamination types from alongside Normal people. This CNN model can help in the automatic diagnosis of COVID-19 cases and help decrease the burden on medicinal services frameworks.
Collapse
Affiliation(s)
- R. Murugan
- Department of Electronics and Communication Engineering, National Institute of Technology Silchar, Assam, 788010 India
| | - Tripti Goel
- Department of Electronics and Communication Engineering, National Institute of Technology Silchar, Assam, 788010 India
| |
Collapse
|
454
|
Ahsan MM, Ahad MT, Soma FA, Paul S, Chowdhury A, Luna SA, Yazdan MMS, Rahman A, Siddique Z, Huebner P. Detecting SARS-CoV-2 From Chest X-Ray Using Artificial Intelligence. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2021; 9:35501-35513. [PMID: 34976572 PMCID: PMC8675556 DOI: 10.1109/access.2021.3061621] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/14/2021] [Accepted: 02/16/2021] [Indexed: 05/19/2023]
Abstract
Chest radiographs (X-rays) combined with Deep Convolutional Neural Network (CNN) methods have been demonstrated to detect and diagnose the onset of COVID-19, the disease caused by the Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2). However, questions remain regarding the accuracy of those methods as they are often challenged by limited datasets, performance legitimacy on imbalanced data, and have their results typically reported without proper confidence intervals. Considering the opportunity to address these issues, in this study, we propose and test six modified deep learning models, including VGG16, InceptionResNetV2, ResNet50, MobileNetV2, ResNet101, and VGG19 to detect SARS-CoV-2 infection from chest X-ray images. Results are evaluated in terms of accuracy, precision, recall, and f- score using a small and balanced dataset (Study One), and a larger and imbalanced dataset (Study Two). With 95% confidence interval, VGG16 and MobileNetV2 show that, on both datasets, the model could identify patients with COVID-19 symptoms with an accuracy of up to 100%. We also present a pilot test of VGG16 models on a multi-class dataset, showing promising results by achieving 91% accuracy in detecting COVID-19, normal, and Pneumonia patients. Furthermore, we demonstrated that poorly performing models in Study One (ResNet50 and ResNet101) had their accuracy rise from 70% to 93% once trained with the comparatively larger dataset of Study Two. Still, models like InceptionResNetV2 and VGG19's demonstrated an accuracy of 97% on both datasets, which posits the effectiveness of our proposed methods, ultimately presenting a reasonable and accessible alternative to identify patients with COVID-19.
Collapse
Affiliation(s)
- Md Manjurul Ahsan
- School of Industrial and Systems EngineeringThe University of Oklahoma Norman OK 73019 USA
| | - Md Tanvir Ahad
- School of Aerospace and Mechanical EngineeringThe University of Oklahoma Norman OK 73019 USA
| | - Farzana Akter Soma
- Holy Family Red Crescent Medical College & Hospital Dhaka 1000 Bangladesh
| | - Shuva Paul
- School of Electrical and Computer EngineeringGeorgia Institute of Technology Atlanta GA 30332 USA
| | - Ananna Chowdhury
- Z. H. Sikder Women's Medical College & Hospital Dhaka 1212 Bangladesh
| | | | | | - Akhlaqur Rahman
- School of Industrial Automation and Electrical EngineeringEngineering Institute of Technology Melbourne VIC 3000 Australia
| | - Zahed Siddique
- School of Aerospace and Mechanical EngineeringThe University of Oklahoma Norman OK 73019 USA
| | - Pedro Huebner
- School of Industrial and Systems EngineeringThe University of Oklahoma Norman OK 73019 USA
| |
Collapse
|
455
|
Tayarani N MH. Applications of artificial intelligence in battling against covid-19: A literature review. CHAOS, SOLITONS, AND FRACTALS 2021; 142:110338. [PMID: 33041533 PMCID: PMC7532790 DOI: 10.1016/j.chaos.2020.110338] [Citation(s) in RCA: 59] [Impact Index Per Article: 19.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Accepted: 10/01/2020] [Indexed: 05/14/2023]
Abstract
Colloquially known as coronavirus, the Severe Acute Respiratory Syndrome CoronaVirus 2 (SARS-CoV-2), that causes CoronaVirus Disease 2019 (COVID-19), has become a matter of grave concern for every country around the world. The rapid growth of the pandemic has wreaked havoc and prompted the need for immediate reactions to curb the effects. To manage the problems, many research in a variety of area of science have started studying the issue. Artificial Intelligence is among the area of science that has found great applications in tackling the problem in many aspects. Here, we perform an overview on the applications of AI in a variety of fields including diagnosis of the disease via different types of tests and symptoms, monitoring patients, identifying severity of a patient, processing covid-19 related imaging tests, epidemiology, pharmaceutical studies, etc. The aim of this paper is to perform a comprehensive survey on the applications of AI in battling against the difficulties the outbreak has caused. Thus we cover every way that AI approaches have been employed and to cover all the research until the writing of this paper. We try organize the works in a way that overall picture is comprehensible. Such a picture, although full of details, is very helpful in understand where AI sits in current pandemonium. We also tried to conclude the paper with ideas on how the problems can be tackled in a better way and provide some suggestions for future works.
Collapse
Affiliation(s)
- Mohammad-H Tayarani N
- Biocomputation Group, School of Computer Science, University of Hertfordshire, Hatfield, AL10 9AB, United Kingdom
| |
Collapse
|
456
|
Guefrechi S, Jabra MB, Ammar A, Koubaa A, Hamam H. Deep learning based detection of COVID-19 from chest X-ray images. MULTIMEDIA TOOLS AND APPLICATIONS 2021; 80:31803-31820. [PMID: 34305440 PMCID: PMC8286881 DOI: 10.1007/s11042-021-11192-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/12/2020] [Revised: 05/19/2021] [Accepted: 06/24/2021] [Indexed: 05/08/2023]
Abstract
The whole world is facing a health crisis, that is unique in its kind, due to the COVID-19 pandemic. As the coronavirus continues spreading, researchers are concerned by providing or help provide solutions to save lives and to stop the pandemic outbreak. Among others, artificial intelligence (AI) has been adapted to address the challenges caused by pandemic. In this article, we design a deep learning system to extract features and detect COVID-19 from chest X-ray images. Three powerful networks, namely ResNet50, InceptionV3, and VGG16, have been fine-tuned on an enhanced dataset, which was constructed by collecting COVID-19 and normal chest X-ray images from different public databases. We applied data augmentation techniques to artificially generate a large number of chest X-ray images: Random Rotation with an angle between - 10 and 10 degrees, random noise, and horizontal flips. Experimental results are encouraging: the proposed models reached an accuracy of 97.20 % for Resnet50, 98.10 % for InceptionV3, and 98.30 % for VGG16 in classifying chest X-ray images as Normal or COVID-19. The results show that transfer learning is proven to be effective, showing strong performance and easy-to-deploy COVID-19 detection methods. This enables automatizing the process of analyzing X-ray images with high accuracy and it can also be used in cases where the materials and RT-PCR tests are limited.
Collapse
Affiliation(s)
- Sarra Guefrechi
- Faculty of Engineering, University of Moncton, Moncton, NB Canada
| | - Marwa Ben Jabra
- Charisma University, British Overseas Territories, Englewood, UK
- Robotics and Internet- of-Things Unit (RIoT) Lab, Riyadh, Saudi Arabia
| | - Adel Ammar
- Prince Sultan University, Riyadh, Saudi Arabia
| | - Anis Koubaa
- Prince Sultan University, Riyadh, Saudi Arabia
- Gaitech Robotics, Shanghai, China
- INESC- TEC, ISEP, Polytechnic Institute of Porto, Porto, Portugal
| | - Habib Hamam
- Faculty of Engineering, University of Moncton, Moncton, NB Canada
| |
Collapse
|
457
|
Vega C. From Hume to Wuhan: An Epistemological Journey on the Problem of Induction in COVID-19 Machine Learning Models and its Impact Upon Medical Research. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2021; 9:97243-97250. [PMID: 34812399 PMCID: PMC8545192 DOI: 10.1109/access.2021.3095222] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/07/2021] [Accepted: 07/03/2021] [Indexed: 05/08/2023]
Abstract
Advances in computer science have transformed the way artificial intelligence is employed in academia, with Machine Learning (ML) methods easily available to researchers from diverse areas thanks to intuitive frameworks that yield extraordinary results. Notwithstanding, current trends in the mainstream ML community tend to emphasise wins over knowledge, putting the scientific method aside, and focusing on maximising metrics of interest. Methodological flaws lead to poor justification of method choice, which in turn leads to disregard the limitations of the methods employed, ultimately putting at risk the translation of solutions into real-world clinical settings. This work exemplifies the impact of the problem of induction in medical research, studying the methodological issues of recent solutions for computer-aided diagnosis of COVID-19 from chest X-Ray images.
Collapse
Affiliation(s)
- Carlos Vega
- Luxembourg Centre for Systems Biomedicine, Bioinformatics Core GroupUniversité du Luxembourg 4365 Esch-sur-Alzette Luxembourg
| |
Collapse
|
458
|
Chowdhury NK, Kabir MA, Rahman MM, Rezoana N. ECOVNet: a highly effective ensemble based deep learning model for detecting COVID-19. PeerJ Comput Sci 2021; 7:e551. [PMID: 34141883 PMCID: PMC8176542 DOI: 10.7717/peerj-cs.551] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Accepted: 04/27/2021] [Indexed: 05/02/2023]
Abstract
The goal of this research is to develop and implement a highly effective deep learning model for detecting COVID-19. To achieve this goal, in this paper, we propose an ensemble of Convolutional Neural Network (CNN) based on EfficientNet, named ECOVNet, to detect COVID-19 from chest X-rays. To make the proposed model more robust, we have used one of the largest open-access chest X-ray data sets named COVIDx containing three classes-COVID-19, normal, and pneumonia. For feature extraction, we have applied an effective CNN structure, namely EfficientNet, with ImageNet pre-training weights. The generated features are transferred into custom fine-tuned top layers followed by a set of model snapshots. The predictions of the model snapshots (which are created during a single training) are consolidated through two ensemble strategies, i.e., hard ensemble and soft ensemble, to enhance classification performance. In addition, a visualization technique is incorporated to highlight areas that distinguish classes, thereby enhancing the understanding of primal components related to COVID-19. The results of our empirical evaluations show that the proposed ECOVNet model outperforms the state-of-the-art approaches and significantly improves detection performance with 100% recall for COVID-19 and overall accuracy of 96.07%. We believe that ECOVNet can enhance the detection of COVID-19 disease, and thus, underpin a fully automated and efficacious COVID-19 detection system.
Collapse
Affiliation(s)
- Nihad Karim Chowdhury
- Department of Computer Science and Engineering, University of Chittagong, Chittagong, Bangladesh
| | | | - Md. Muhtadir Rahman
- Department of Computer Science and Engineering, University of Chittagong, Chittagong, Bangladesh
| | - Noortaz Rezoana
- Department of Computer Science and Engineering, University of Chittagong, Chittagong, Bangladesh
| |
Collapse
|
459
|
Eldow ME. The worldwide methods of artificial intelligence for detection and diagnosis of COVID-19. LEVERAGING ARTIFICIAL INTELLIGENCE IN GLOBAL EPIDEMICS 2021. [PMCID: PMC8342405 DOI: 10.1016/b978-0-323-89777-8.00012-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
This chapter aims to present and review the early and recent initiatives, researches, and applications of artificial intelligence (AI) and its methods on the detection and diagnosis of COVID-19 virus. Common methods of AI will be presented on these applications including the traditional work on artificial neural networks and the recent approaches on machine learning and deep learning. In this chapter, a survey on many examples of the application of the AI methods on the detection and diagnosis of COVID-19 will be highlighted including the early trials in China and the recent researches in other regions, beside most trials in all other regions of the World including Asia, North America, Europe, and Africa. This chapter will also show many comparisons of the explained approaches and trials based on methods, type of applications, and regions. Brief view of the future and expected applications and trends of AI in the area of detection and diagnosis of viruses and especially the COVID-19 are explained and discussed at the end of the chapter.
Collapse
|
460
|
Nguyen DC, Ding M, Pathirana PN, Seneviratne A. Blockchain and AI-Based Solutions to Combat Coronavirus (COVID-19)-Like Epidemics: A Survey. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2021; 9:95730-95753. [PMID: 34812398 DOI: 10.20944/preprints202004.0325.v1] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/07/2021] [Accepted: 06/27/2021] [Indexed: 05/21/2023]
Abstract
The beginning of 2020 has seen the emergence of coronavirus outbreak caused by a novel virus called SARS-CoV-2. The sudden explosion and uncontrolled worldwide spread of COVID-19 show the limitations of existing healthcare systems in timely handling public health emergencies. In such contexts, innovative technologies such as blockchain and Artificial Intelligence (AI) have emerged as promising solutions for fighting coronavirus epidemic. In particular, blockchain can combat pandemics by enabling early detection of outbreaks, ensuring the ordering of medical data, and ensuring reliable medical supply chain during the outbreak tracing. Moreover, AI provides intelligent solutions for identifying symptoms caused by coronavirus for treatments and supporting drug manufacturing. Therefore, we present an extensive survey on the use of blockchain and AI for combating COVID-19 epidemics. First, we introduce a new conceptual architecture which integrates blockchain and AI for fighting COVID-19. Then, we survey the latest research efforts on the use of blockchain and AI for fighting COVID-19 in various applications. The newly emerging projects and use cases enabled by these technologies to deal with coronavirus pandemic are also presented. A case study is also provided using federated AI for COVID-19 detection. Finally, we point out challenges and future directions that motivate more research efforts to deal with future coronavirus-like epidemics.
Collapse
Affiliation(s)
- Dinh C Nguyen
- School of EngineeringDeakin University Waurn Ponds VIC 3216 Australia
| | - Ming Ding
- Data61CSIRO Eveleigh NSW 2015 Australia
| | | | - Aruna Seneviratne
- School of Electrical Engineering and TelecommunicationsUniversity of New South Wales (UNSW) Sydney NSW 2052 Australia
| |
Collapse
|
461
|
Shelke A, Inamdar M, Shah V, Tiwari A, Hussain A, Chafekar T, Mehendale N. Chest X-ray Classification Using Deep Learning for Automated COVID-19 Screening. SN COMPUTER SCIENCE 2021; 2:300. [PMID: 34075355 DOI: 10.1101/2020.06.21.20136598] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Accepted: 05/10/2021] [Indexed: 05/18/2023]
Abstract
UNLABELLED In today's world, we find ourselves struggling to fight one of the worst pandemics in the history of humanity known as COVID-2019 caused by a coronavirus. When the virus reaches the lungs, we observe ground-glass opacity in the chest X-ray due to fibrosis in the lungs. Due to the significant differences between X-ray images of an infected and non-infected person, artificial intelligence techniques can be used to identify the presence and severity of the infection. We propose a classification model that can analyze the chest X-rays and help in the accurate diagnosis of COVID-19. Our methodology classifies the chest X-rays into four classes viz. normal, pneumonia, tuberculosis (TB), and COVID-19. Further, the X-rays indicating COVID-19 are classified on a severity-basis into mild, medium, and severe. The deep learning model used for the classification of pneumonia, TB, and normal is VGG-16 with a test accuracy of 95.9 %. For the segregation of normal pneumonia and COVID-19, the DenseNet-161 was used with a test accuracy of 98.9 %, whereas the ResNet-18 worked best for severity classification achieving a test accuracy up to 76 %. Our approach allows mass screening of the people using X-rays as a primary validation for COVID-19. SUPPLEMENTARY INFORMATION The online version contains supplementary material available at 10.1007/s42979-021-00695-5.
Collapse
Affiliation(s)
- Ankita Shelke
- K. J. Somaiya College of Engineering, Vidyavihar, Mumbai, India Maharshtra 400077
| | - Madhura Inamdar
- K. J. Somaiya College of Engineering, Vidyavihar, Mumbai, India Maharshtra 400077
| | - Vruddhi Shah
- K. J. Somaiya College of Engineering, Vidyavihar, Mumbai, India Maharshtra 400077
| | - Amanshu Tiwari
- K. J. Somaiya College of Engineering, Vidyavihar, Mumbai, India Maharshtra 400077
| | - Aafiya Hussain
- K. J. Somaiya College of Engineering, Vidyavihar, Mumbai, India Maharshtra 400077
| | - Talha Chafekar
- K. J. Somaiya College of Engineering, Vidyavihar, Mumbai, India Maharshtra 400077
| | - Ninad Mehendale
- K. J. Somaiya College of Engineering, Vidyavihar, Mumbai, India Maharshtra 400077
| |
Collapse
|
462
|
Taresh MM, Zhu N, Ali TAA, Hameed AS, Mutar ML. Transfer Learning to Detect COVID-19 Automatically from X-Ray Images Using Convolutional Neural Networks. Int J Biomed Imaging 2021. [PMID: 34194484 DOI: 10.1101/2020.08.25.20182170] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/09/2023] Open
Abstract
The novel coronavirus disease 2019 (COVID-19) is a contagious disease that has caused thousands of deaths and infected millions worldwide. Thus, various technologies that allow for the fast detection of COVID-19 infections with high accuracy can offer healthcare professionals much-needed help. This study is aimed at evaluating the effectiveness of the state-of-the-art pretrained Convolutional Neural Networks (CNNs) on the automatic diagnosis of COVID-19 from chest X-rays (CXRs). The dataset used in the experiments consists of 1200 CXR images from individuals with COVID-19, 1345 CXR images from individuals with viral pneumonia, and 1341 CXR images from healthy individuals. In this paper, the effectiveness of artificial intelligence (AI) in the rapid and precise identification of COVID-19 from CXR images has been explored based on different pretrained deep learning algorithms and fine-tuned to maximise detection accuracy to identify the best algorithms. The results showed that deep learning with X-ray imaging is useful in collecting critical biological markers associated with COVID-19 infections. VGG16 and MobileNet obtained the highest accuracy of 98.28%. However, VGG16 outperformed all other models in COVID-19 detection with an accuracy, F1 score, precision, specificity, and sensitivity of 98.72%, 97.59%, 96.43%, 98.70%, and 98.78%, respectively. The outstanding performance of these pretrained models can significantly improve the speed and accuracy of COVID-19 diagnosis. However, a larger dataset of COVID-19 X-ray images is required for a more accurate and reliable identification of COVID-19 infections when using deep transfer learning. This would be extremely beneficial in this pandemic when the disease burden and the need for preventive measures are in conflict with the currently available resources.
Collapse
Affiliation(s)
| | - Ningbo Zhu
- College of Information Science and Engineering, Hunan University, Changsha 400013, China
| | - Talal Ahmed Ali Ali
- College of Information Science and Engineering, Hunan University, Changsha 400013, China
| | - Asaad Shakir Hameed
- Department of Mathematics, General Directorate of Thi-Qar Education, Ministry of Education, Thi-Qar, Iraq
| | - Modhi Lafta Mutar
- Faculty of Information and Communication Technology, Universiti Teknikal Malaysia Melaka, Hang Tuah Jaya, Durian Tunggal, Melaka, Malaysia
| |
Collapse
|
463
|
Al-Emran M, Al-Kabi MN, Marques G. A Survey of Using Machine Learning Algorithms During the COVID-19 Pandemic. STUDIES IN SYSTEMS, DECISION AND CONTROL 2021:1-8. [DOI: 10.1007/978-3-030-67716-9_1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
|
464
|
Manokaran J, Zabihollahy F, Hamilton-Wright A, Ukwatta E. Detection of COVID-19 from chest x-ray images using transfer learning. J Med Imaging (Bellingham) 2021; 8:017503. [PMID: 34435075 PMCID: PMC8382139 DOI: 10.1117/1.jmi.8.s1.017503] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2021] [Accepted: 08/06/2021] [Indexed: 12/18/2022] Open
Abstract
Purpose: The objective of this study is to develop and evaluate a fully automated, deep learning-based method for detection of COVID-19 infection from chest x-ray images. Approach: The proposed model was developed by replacing the final classifier layer in DenseNet201 with a new network consisting of global averaging layer, batch normalization layer, a dense layer with ReLU activation, and a final classification layer. Then, we performed an end-to-end training using the initial pretrained weights on all the layers. Our model was trained using a total of 8644 images with 4000 images each in normal and pneumonia cases and 644 in COVID-19 cases representing a large real dataset. The proposed method was evaluated based on accuracy, sensitivity, specificity, ROC curve, and F 1 -score using a test dataset comprising 1729 images (129 COVID-19, 800 normal, and 800 pneumonia). As a benchmark, we also compared the results of our method with those of seven state-of-the-art pretrained models and with a lightweight CNN architecture designed from scratch. Results: The proposed model based on DenseNet201 was able to achieve an accuracy of 94% in detecting COVID-19 and an overall accuracy of 92.19%. The model was able to achieve an AUC of 0.99 for COVID-19, 0.97 for normal, and 0.97 for pneumonia. The model was able to outperform alternative models in terms of overall accuracy, sensitivity, and specificity. Conclusions: Our proposed automated diagnostic model yielded an accuracy of 94% in the initial screening of COVID-19 patients and an overall accuracy of 92.19% using chest x-ray images.
Collapse
Affiliation(s)
- Jenita Manokaran
- University of Guelph, School of Engineering, Biomedical Engineering, Guelph, Ontario, Canada
| | - Fatemeh Zabihollahy
- The Johns Hopkins University, School of Medicine, Department of Radiation Oncology and Molecular Radiation Sciences, Baltimore, Maryland, United States
| | | | - Eranga Ukwatta
- University of Guelph, School of Engineering, Biomedical Engineering, Guelph, Ontario, Canada
| |
Collapse
|
465
|
Bhargava A, Bansal A. Novel coronavirus (COVID-19) diagnosis using computer vision and artificial intelligence techniques: a review. MULTIMEDIA TOOLS AND APPLICATIONS 2021; 80:19931-19946. [PMID: 33686333 PMCID: PMC7928188 DOI: 10.1007/s11042-021-10714-5] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/21/2020] [Revised: 10/23/2020] [Accepted: 02/10/2021] [Indexed: 05/07/2023]
Abstract
The universal transmission of pandemic COVID-19 (Coronavirus) causes an immediate need to commit in the fight across the whole human population. The emergencies for human health care are limited for this abrupt outbreak and abandoned environment. In this situation, inventive automation like computer vision (machine learning, deep learning, artificial intelligence), medical imaging (computed tomography, X-Ray) has developed an encouraging solution against COVID-19. In recent months, different techniques using image processing are done by various researchers. In this paper, a major review on image acquisition, segmentation, diagnosis, avoidance, and management are presented. An analytical comparison of the various proposed algorithm by researchers for coronavirus has been carried out. Also, challenges and motivation for research in the future to deal with coronavirus are indicated. The clinical impact and use of computer vision and deep learning were discussed and we hope that dermatologists may have better understanding of these areas from the study.
Collapse
|
466
|
Madaan V, Roy A, Gupta C, Agrawal P, Sharma A, Bologa C, Prodan R. XCOVNet: Chest X-ray Image Classification for COVID-19 Early Detection Using Convolutional Neural Networks. NEW GENERATION COMPUTING 2021; 39:583-597. [PMID: 33642663 PMCID: PMC7903219 DOI: 10.1007/s00354-021-00121-7] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/05/2020] [Accepted: 01/26/2021] [Indexed: 05/06/2023]
Abstract
COVID-19 (also known as SARS-COV-2) pandemic has spread in the entire world. It is a contagious disease that easily spreads from one person in direct contact to another, classified by experts in five categories: asymptomatic, mild, moderate, severe, and critical. Already more than 66 million people got infected worldwide with more than 22 million active patients as of 5 December 2020 and the rate is accelerating. More than 1.5 million patients (approximately 2.5% of total reported cases) across the world lost their life. In many places, the COVID-19 detection takes place through reverse transcription polymerase chain reaction (RT-PCR) tests which may take longer than 48 h. This is one major reason of its severity and rapid spread. We propose in this paper a two-phase X-ray image classification called XCOVNet for early COVID-19 detection using convolutional neural Networks model. XCOVNet detects COVID-19 infections in chest X-ray patient images in two phases. The first phase pre-processes a dataset of 392 chest X-ray images of which half are COVID-19 positive and half are negative. The second phase trains and tunes the neural network model to achieve a 98.44% accuracy in patient classification.
Collapse
Affiliation(s)
- Vishu Madaan
- Lovely Professional University, Phagwara, Punjab India
| | - Aditya Roy
- Lovely Professional University, Phagwara, Punjab India
| | - Charu Gupta
- Bhagwan Parshuram Institute of Technology, New Delhi, India
| | - Prateek Agrawal
- Lovely Professional University, Phagwara, Punjab India
- University of Klagenfurt, Klagenfurt, Austria
| | - Anand Sharma
- Mody University of Science and Technology, Laxmangarh, Rajasthan India
| | | | - Radu Prodan
- University of Klagenfurt, Klagenfurt, Austria
| |
Collapse
|
467
|
Singh RK, Pandey R, Babu RN. COVIDScreen: explainable deep learning framework for differential diagnosis of COVID-19 using chest X-rays. Neural Comput Appl 2021. [PMID: 33437132 DOI: 10.1007/s00521-020-05636-6]] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/12/2023]
Abstract
COVID-19 has emerged as a global crisis with unprecedented socio-economic challenges, jeopardizing our lives and livelihoods for years to come. The unavailability of vaccines for COVID-19 has rendered rapid testing of the population instrumental in order to contain the exponential rise in cases of infection. Shortage of RT-PCR test kits and delays in obtaining test results calls for alternative methods of rapid and reliable diagnosis. In this article, we propose a novel deep learning-based solution using chest X-rays which can help in rapid triaging of COVID-19 patients. The proposed solution uses image enhancement, image segmentation, and employs a modified stacked ensemble model consisting of four CNN base-learners along with Naive Bayes as meta-learner to classify chest X-rays into three classes viz. COVID-19, pneumonia, and normal. An effective pruning strategy as introduced in the proposed framework results in increased model performance, generalizability, and decreased model complexity. We incorporate explainability in our article by using Grad-CAM visualization in order to establish trust in the medical AI system. Furthermore, we evaluate multiple state-of-the-art GAN architectures and their ability to generate realistic synthetic samples of COVID-19 chest X-rays to deal with limited numbers of training samples. The proposed solution significantly outperforms existing methods, with 98.67% accuracy, 0.98 Kappa score, and F-1 scores of 100, 98, and 98 for COVID-19, normal, and pneumonia classes, respectively, on standard datasets. The proposed solution can be used as one element of patient evaluation along with gold-standard clinical and laboratory testing.
Collapse
Affiliation(s)
| | - Rohan Pandey
- Shiv Nadar University, NCR, Gautam Budh Nagar, India
| | | |
Collapse
|
468
|
Poongodi M, Malviya M, Hamdi M, Rauf HT, Kadry S, Thinnukool O. The Recent Technologies to Curb the Second-Wave of COVID-19 Pandemic. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2021; 9:97906-97928. [PMID: 34812400 PMCID: PMC8545196 DOI: 10.1109/access.2021.3094400] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/19/2021] [Accepted: 06/29/2021] [Indexed: 05/06/2023]
Abstract
Different epidemics, specially Coronavirus, have caused critical misfortunes in various fields like monetary deprivation, survival conditions, thus diminishing the overall individual fulfillment. Various worldwide associations and different hierarchies of government fraternity are endeavoring to offer the necessary assistance in eliminating the infection impacts but unfortunately standing up to the non-appearance of resources and expertise. In contrast to all other pandemics, Coronavirus has proven to exhibit numerous requirements such that curated appropriation and determination of innovations are required to deal with the vigorous undertakings, which include precaution, detection, and medication. Innovative advancements are essential for the subsequent pandemics where-in the forthcoming difficulties can indeed be approached to such a degree that it facilitates constructive solutions more comprehensively. In this study, futuristic and emerging innovations are analyzed, improving COVID-19 effects for the general public. Large data sets need to be advanced so that extensive models related to deep analysis can be used to combat Coronavirus infection, which can be done by applying Artificial intelligence techniques such as Natural Language Processing (NLP), Machine Learning (ML), and Computer vision to varying processing files. This article aims to furnish variation sets of innovations that can be utilized to eliminate COVID-19 and serve as a resource for the coming generations. At last, elaboration associated with future state-of-the-art technologies and the attainable sectors of AI methodologies has been mentioned concerning the post-COVID-19 world to enable the different ideas for dealing with the pandemic-based difficulties.
Collapse
Affiliation(s)
- M Poongodi
- College of Science and EngineeringHamad Bin Khalifa University, Qatar Foundation Doha Qatar
| | - Mohit Malviya
- Department of CTO 5GWipro Ltd. Bengaluru 560035 India
| | - Mounir Hamdi
- College of Science and EngineeringHamad Bin Khalifa University, Qatar Foundation Doha Qatar
| | - Hafiz Tayyab Rauf
- Centre for Smart SystemsAI and Cybersecurity, Staffordshire University Stoke-on-Trent ST4 2DE U.K
| | - Seifedine Kadry
- Faculty of Applied Computing and TechnologyNoroff University College 4608 Kristiansand Norway
| | - Orawit Thinnukool
- Research Group of Embedded Systems and Mobile Application in Health Science, College of Arts, Media and TechnologyChiang Mai University Chiang Mai 50200 Thailand
| |
Collapse
|
469
|
Narin A, Kaya C, Pamuk Z. Automatic detection of coronavirus disease (COVID-19) using X-ray images and deep convolutional neural networks. Pattern Anal Appl 2021. [PMID: 33994847 DOI: 10.1007/s10044-021-00984-y:1-14] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/10/2023]
Abstract
The 2019 novel coronavirus disease (COVID-19), with a starting point in China, has spread rapidly among people living in other countries and is approaching approximately 101,917,147 cases worldwide according to the statistics of World Health Organization. There are a limited number of COVID-19 test kits available in hospitals due to the increasing cases daily. Therefore, it is necessary to implement an automatic detection system as a quick alternative diagnosis option to prevent COVID-19 spreading among people. In this study, five pre-trained convolutional neural network-based models (ResNet50, ResNet101, ResNet152, InceptionV3 and Inception-ResNetV2) have been proposed for the detection of coronavirus pneumonia-infected patient using chest X-ray radiographs. We have implemented three different binary classifications with four classes (COVID-19, normal (healthy), viral pneumonia and bacterial pneumonia) by using five-fold cross-validation. Considering the performance results obtained, it has been seen that the pre-trained ResNet50 model provides the highest classification performance (96.1% accuracy for Dataset-1, 99.5% accuracy for Dataset-2 and 99.7% accuracy for Dataset-3) among other four used models.
Collapse
Affiliation(s)
- Ali Narin
- Department of Electrical and Electronics Engineering, Zonguldak Bulent Ecevit University, Zonguldak, 67100 Turkey
| | - Ceren Kaya
- Department of Biomedical Engineering, Zonguldak Bulent Ecevit University, Zonguldak, 67100 Turkey
| | - Ziynet Pamuk
- Department of Biomedical Engineering, Zonguldak Bulent Ecevit University, Zonguldak, 67100 Turkey
| |
Collapse
|
470
|
Awasthi N, Gupta S, Kiran A, Pardasani R. State-of-the-art equipment for rapid and accurate diagnosis of COVID-19. BIOMEDICAL ENGINEERING TOOLS FOR MANAGEMENT FOR PATIENTS WITH COVID-19 2021. [PMCID: PMC8192314 DOI: 10.1016/b978-0-12-824473-9.00012-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
The World Health Organization (WHO) declared COVID-19 as a pandemic worldwide. Containment of this pandemic requires the diagnosis of the disease at an early stage. Extensive accessibility to accurate and rapid testing procedures is the need of the hour to control SARS-CoV-2 virus infection and to check the amount of immunity in the community. As such, scientists, doctors, and individual laboratories and companies around the world have been working tirelessly to develop the critically needed test kits in huge numbers. The ready to use test kits are based on different principles including detection of viral proteins in samples obtained from feces, sputum, nasopharyngeal or oropharyngeal samples, etc., or in blood or serum, by detection of antibodies produced in the human body to fight the infection. The first kind involves molecular assays like polymerase chain reaction-based techniques for the detection of severe acute respiratory syndrome coronavirus viral RNA. The second one involves serological and immunological assays which mostly rely upon antibody detection in an individual produced as a result of exposure to the virus. While the nucleic acid-based viral RNA can detect current infection in a sample, the serological tests can give an estimate of the already infected population. Medical imaging, specially chest computed tomography (CT), is another kind of technique that is becoming a supplement to the reverse transcriptase-polymerase chain reaction, especially when the results by the former technique are not certain or take time to arrive. Apart from being a diagnostic tool, the CT scan can also help in prediction, assessing the disease progression and checking whether the patient is responsive to administered therapy. This chapter will provide a comprehensive overview of the various rapid and accurate diagnosis methods for SARS COVID-19 suggested by WHO for current infection, for example, detection of viral proteins, medical imaging, and previous infection, and detection of antibodies generated during COVID-19 infections and others that are currently being researched.
Collapse
|
471
|
KC K, Yin Z, Wu M, Wu Z. Evaluation of deep learning-based approaches for COVID-19 classification based on chest X-ray images. SIGNAL, IMAGE AND VIDEO PROCESSING 2021; 15:959-966. [PMID: 33432267 PMCID: PMC7788389 DOI: 10.1007/s11760-020-01820-2] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/04/2020] [Revised: 09/01/2020] [Accepted: 11/12/2020] [Indexed: 05/02/2023]
Abstract
The COVID-19, novel coronavirus or SARS-Cov-2, has claimed hundreds of thousands of lives and affected millions of people all around the world with the number of deaths and infections growing exponentially. Deep convolutional neural network (DCNN) has been a huge milestone for image classification task including medical images. Transfer learning of state-of-the-art models have proven to be an efficient method of overcoming deficient data problem. In this paper, a thorough evaluation of eight pre-trained models is presented. Training, validating, and testing of these models were performed on chest X-ray (CXR) images belonging to five distinct classes, containing a total of 760 images. Fine-tuned models, pre-trained in ImageNet dataset, were computationally efficient and accurate. Fine-tuned DenseNet121 achieved a test accuracy of 98.69% and macro f1-score of 0.99 for four classes classification containing healthy, bacterial pneumonia, COVID-19, and viral pneumonia, and fine-tuned models achieved higher test accuracy for three-class classification containing healthy, COVID-19, and SARS images. The experimental results show that only 62% of total parameters were retrained to achieve such accuracy.
Collapse
Affiliation(s)
- Kamal KC
- School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin, 150001 China
| | - Zhendong Yin
- School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin, 150001 China
| | - Mingyang Wu
- School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin, 150001 China
| | - Zhilu Wu
- School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin, 150001 China
| |
Collapse
|
472
|
Sadeghi MH, Omidi H, Sina S. A Systematic Review on the Use of Artificial Intelligence Techniques in the Diagnosis of COVID-19 from Chest X-Ray Images. AVICENNA JOURNAL OF MEDICAL BIOCHEMISTRY 2020. [DOI: 10.34172/ajmb.2020.17] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
Background: In this study, the artificial intelligence (AI) techniques used for the detection of coronavirus disease 2019 (COVID-19) from the chest x-ray were reviewed. Methods: PubMed, arXiv, and Google Scholar were used to search for AI studies. Results: A total of 20 papers were extracted from Google Scholar, 14 from arXiv, and 5 from PubMed. In 17 papers, publicly available datasets and in 3 papers, independent datasets were used. 10 papers disclosed source codes. Nine papers were about creating a novel AI software, 8 papers reported the modification of the existing AI models, and 3 compared the performance of the existing AI software programs. All papers have used deep learning as AI technique. Most papers reported accuracy, specificity, and sensitivity of the models, and also the area under the curve (AUC) for investigation of the model performance for the prediction of COVID-19. Nine papers reported accuracy, sensitivity, and specificity. The number of datasets used in the studies ranged from 50 to 94323. The accuracy, sensitivity, and specificity of the models ranged from 0.88 to 0.98, 0.80 to 1.00, and 0.70 to 1.00, respectively. Conclusion: The studies revealed that AI can help human in fighting the new Coronavirus.
Collapse
Affiliation(s)
- Mohammad Hosein Sadeghi
- Department of Nuclear Engineering, School of Mechanical Engineering, Shiraz University, Shiraz, Iran
| | - Hamid Omidi
- Department of Nuclear Engineering, School of Mechanical Engineering, Shiraz University, Shiraz, Iran
| | - Sedigheh Sina
- Department of Nuclear Engineering, School of Mechanical Engineering, Shiraz University, Shiraz, Iran
- Radiation Research Center, School of Mechanical Engineering, Shiraz University, Iran
| |
Collapse
|
473
|
Arias-Londoño JD, Gómez-García JA, Moro-Velázquez L, Godino-Llorente JI. Artificial Intelligence Applied to Chest X-Ray Images for the Automatic Detection of COVID-19. A Thoughtful Evaluation Approach. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2020; 8:226811-226827. [PMID: 34786299 PMCID: PMC8545248 DOI: 10.1109/access.2020.3044858] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/25/2020] [Accepted: 12/08/2020] [Indexed: 05/17/2023]
Abstract
Current standard protocols used in the clinic for diagnosing COVID-19 include molecular or antigen tests, generally complemented by a plain chest X-Ray. The combined analysis aims to reduce the significant number of false negatives of these tests and provide complementary evidence about the presence and severity of the disease. However, the procedure is not free of errors, and the interpretation of the chest X-Ray is only restricted to radiologists due to its complexity. With the long term goal to provide new evidence for the diagnosis, this paper presents an evaluation of different methods based on a deep neural network. These are the first steps to develop an automatic COVID-19 diagnosis tool using chest X-Ray images to differentiate between controls, pneumonia, or COVID-19 groups. The paper describes the process followed to train a Convolutional Neural Network with a dataset of more than 79, 500 X-Ray images compiled from different sources, including more than 8, 500 COVID-19 examples. Three different experiments following three preprocessing schemes are carried out to evaluate and compare the developed models. The aim is to evaluate how preprocessing the data affects the results and improves its explainability. Likewise, a critical analysis of different variability issues that might compromise the system and its effects is performed. With the employed methodology, a 91.5% classification accuracy is obtained, with an 87.4% average recall for the worst but most explainable experiment, which requires a previous automatic segmentation of the lung region.
Collapse
Affiliation(s)
| | - Jorge A. Gómez-García
- Bioengineering and Optoelectronics Laboratory (ByO)Universidad Politécnica de Madrid28031MadridSpain
| | - Laureano Moro-Velázquez
- Department of Electrical and Computer EngineeringJohns Hopkins UniversityBaltimoreMD21218USA
| | - Juan I. Godino-Llorente
- Bioengineering and Optoelectronics Laboratory (ByO)Universidad Politécnica de Madrid28031MadridSpain
| |
Collapse
|
474
|
Rasheed J, Jamil A, Hameed AA, Aftab U, Aftab J, Shah SA, Draheim D. A survey on artificial intelligence approaches in supporting frontline workers and decision makers for the COVID-19 pandemic. CHAOS, SOLITONS, AND FRACTALS 2020; 141:110337. [PMID: 33071481 PMCID: PMC7547637 DOI: 10.1016/j.chaos.2020.110337] [Citation(s) in RCA: 42] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Accepted: 10/01/2020] [Indexed: 05/04/2023]
Abstract
While the world has experience with many different types of infectious diseases, the current crisis related to the spread of COVID-19 has challenged epidemiologists and public health experts alike, leading to a rapid search for, and development of, new and innovative solutions to combat its spread. The transmission of this virus has infected more than 18.92 million people as of August 6, 2020, with over half a million deaths across the globe; the World Health Organization (WHO) has declared this a global pandemic. A multidisciplinary approach needs to be followed for diagnosis, treatment and tracking, especially between medical and computer sciences, so, a common ground is available to facilitate the research work at a faster pace. With this in mind, this survey paper aimed to explore and understand how and which different technological tools and techniques have been used within the context of COVID-19. The primary contribution of this paper is in its collation of the current state-of-the-art technological approaches applied to the context of COVID-19, and doing this in a holistic way, covering multiple disciplines and different perspectives. The analysis is widened by investigating Artificial Intelligence (AI) approaches for the diagnosis, anticipate infection and mortality rate by tracing contacts and targeted drug designing. Moreover, the impact of different kinds of medical data used in diagnosis, prognosis and pandemic analysis is also provided. This review paper covers both medical and technological perspectives to facilitate the virologists, AI researchers and policymakers while in combating the COVID-19 outbreak.
Collapse
Affiliation(s)
- Jawad Rasheed
- Department of Computer Engineering, Istanbul Sabahattin Zaim University, Istanbul 34303, Turkey
| | - Akhtar Jamil
- Department of Computer Engineering, Istanbul Sabahattin Zaim University, Istanbul 34303, Turkey
| | - Alaa Ali Hameed
- Department of Computer Engineering, Istanbul Sabahattin Zaim University, Istanbul 34303, Turkey
| | - Usman Aftab
- Department of Pharmacology, University of Health Sciences, Lahore 54700, Pakistan
| | - Javaria Aftab
- Department of Chemistry, Istanbul Technical University, Istanbul 34467, Turkey
| | - Syed Attique Shah
- Department of IT, Balochistan University of Information Technology, Engineering and Management Sciences, Quetta 87300, Pakistan
| | - Dirk Draheim
- Information Systems Group, Tallinn University of Technology, Akadeemia tee 15a, 12618, Tallinn, Estonia
| |
Collapse
|
475
|
Islam MN, Inan TT, Rafi S, Akter SS, Sarker IH, Islam AKMN. A Systematic Review on the Use of AI and ML for Fighting the COVID-19 Pandemic. IEEE TRANSACTIONS ON ARTIFICIAL INTELLIGENCE 2020; 1:258-270. [PMID: 35784006 PMCID: PMC8545030 DOI: 10.1109/tai.2021.3062771] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/03/2020] [Revised: 12/31/2020] [Accepted: 02/24/2021] [Indexed: 11/16/2022]
Abstract
Artificial intelligence (AI) and machine learning (ML) have caused a paradigm shift in healthcare that can be used for decision support and forecasting by exploring medical data. Recent studies have shown that AI and ML can be used to fight COVID-19. The objective of this article is to summarize the recent AI- and ML-based studies that have addressed the pandemic. From an initial set of 634 articles, a total of 49 articles were finally selected through an inclusion-exclusion process. In this article, we have explored the objectives of the existing studies (i.e., the role of AI/ML in fighting the COVID-19 pandemic); the context of the studies (i.e., whether it was focused on a specific country-context or with a global perspective; the type and volume of the dataset; and the methodology, algorithms, and techniques adopted in the prediction or diagnosis processes). We have mapped the algorithms and techniques with the data type by highlighting their prediction/classification accuracy. From our analysis, we categorized the objectives of the studies into four groups: disease detection, epidemic forecasting, sustainable development, and disease diagnosis. We observed that most of these studies used deep learning algorithms on image-data, more specifically on chest X-rays and CT scans. We have identified six future research opportunities that we have summarized in this paper. Impact Statement: Artificial intelligence (AI) and machine learning(ML) methods have been widely used to assist in the fight against COVID-19 pandemic. A very few in-depth literature reviews have been conducted to synthesize the knowledge and identify future research agenda including a previously published review on data science for COVID-19 in this article. In this article, we synthesized reviewed recent literature that focuses on the usages and applications of AI and ML to fight against COVID-19. We have identified seven future research directions that would guide researchers to conduct future research. The most significant of these are: develop new treatment options, explore the contextual effect and variation in research outcomes, support the health care workforce, and explore the effect and variation in research outcomes based on different types of data.
Collapse
Affiliation(s)
- Muhammad Nazrul Islam
- Department of Computer Science, and EngineeringMilitary Institute of Science and TechnologyDhaka1216Bangladesh
| | - Toki Tahmid Inan
- Department of Computer ScienceGeorge Mason UniversityFairfaxVA22031USA
| | - Suzzana Rafi
- Department of Computer Science and EngineeringBangladesh University of Engineering and TechnologyDhaka1205Bangladesh
| | | | - Iqbal H. Sarker
- Department of Computer Science and EngineeringChittagong University of Engineering and TechnologyChittagong4349Bangladesh
| | - A. K. M. Najmul Islam
- LUT School of Engineering ScienceLUT UniversityLahti15210Finland
- Department of ComputingUniversity of Turku20500TurkuFinland
| |
Collapse
|
476
|
A Survey of Deep Learning for Lung Disease Detection on Medical Images: State-of-the-Art, Taxonomy, Issues and Future Directions. J Imaging 2020; 6:jimaging6120131. [PMID: 34460528 PMCID: PMC8321202 DOI: 10.3390/jimaging6120131] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2020] [Revised: 11/25/2020] [Accepted: 11/25/2020] [Indexed: 12/24/2022] Open
Abstract
The recent developments of deep learning support the identification and classification of lung diseases in medical images. Hence, numerous work on the detection of lung disease using deep learning can be found in the literature. This paper presents a survey of deep learning for lung disease detection in medical images. There has only been one survey paper published in the last five years regarding deep learning directed at lung diseases detection. However, their survey is lacking in the presentation of taxonomy and analysis of the trend of recent work. The objectives of this paper are to present a taxonomy of the state-of-the-art deep learning based lung disease detection systems, visualise the trends of recent work on the domain and identify the remaining issues and potential future directions in this domain. Ninety-eight articles published from 2016 to 2020 were considered in this survey. The taxonomy consists of seven attributes that are common in the surveyed articles: image types, features, data augmentation, types of deep learning algorithms, transfer learning, the ensemble of classifiers and types of lung diseases. The presented taxonomy could be used by other researchers to plan their research contributions and activities. The potential future direction suggested could further improve the efficiency and increase the number of deep learning aided lung disease detection applications.
Collapse
|
477
|
Gianchandani N, Jaiswal A, Singh D, Kumar V, Kaur M. Rapid COVID-19 diagnosis using ensemble deep transfer learning models from chest radiographic images. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING 2020; 14:5541-5553. [PMID: 33224307 PMCID: PMC7667280 DOI: 10.1007/s12652-020-02669-6] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/11/2020] [Accepted: 11/03/2020] [Indexed: 05/02/2023]
Abstract
The severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) causes novel coronavirus disease (COVID-19) outbreak in more than 200 countries around the world. The early diagnosis of infected patients is needed to discontinue this outbreak. The diagnosis of coronavirus infection from radiography images is the fastest method. In this paper, two different ensemble deep transfer learning models have been designed for COVID-19 diagnosis utilizing the chest X-rays. Both models have utilized pre-trained models for better performance. They are able to differentiate COVID-19, viral pneumonia, and bacterial pneumonia. Both models have been developed to improve the generalization capability of the classifier for binary and multi-class problems. The proposed models have been tested on two well-known datasets. Experimental results reveal that the proposed framework outperforms the existing techniques in terms of sensitivity, specificity, and accuracy.
Collapse
Affiliation(s)
- Neha Gianchandani
- Department of Computer Science and Engineering, School of Computing and Information Technology, Manipal University Jaipur, Jaipur, Rajasthan 303007 India
| | - Aayush Jaiswal
- Department of Computer Science and Engineering, School of Computing and Information Technology, Manipal University Jaipur, Jaipur, Rajasthan 303007 India
| | - Dilbag Singh
- Computer Science Engineering, School of Engineering and Applied Sciences, Bennett University, Greater Noida, 201310 India
| | - Vijay Kumar
- Department of Computer Science and Engineering, National Institute of Technology Hamirpur, Hamirpur, Himachal Pradesh 177005 India
| | - Manjit Kaur
- Computer Science Engineering, School of Engineering and Applied Sciences, Bennett University, Greater Noida, 201310 India
| |
Collapse
|
478
|
Brunese L, Mercaldo F, Reginelli A, Santone A. Explainable Deep Learning for Pulmonary Disease and Coronavirus COVID-19 Detection from X-rays. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 196:105608. [PMID: 32599338 PMCID: PMC7831868 DOI: 10.1016/j.cmpb.2020.105608] [Citation(s) in RCA: 233] [Impact Index Per Article: 58.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/09/2020] [Accepted: 06/09/2020] [Indexed: 05/03/2023]
Abstract
BACKGROUND AND OBJECTIVE Coronavirus disease (COVID-19) is an infectious disease caused by a new virus never identified before in humans. This virus causes respiratory disease (for instance, flu) with symptoms such as cough, fever and, in severe cases, pneumonia. The test to detect the presence of this virus in humans is performed on sputum or blood samples and the outcome is generally available within a few hours or, at most, days. Analysing biomedical imaging the patient shows signs of pneumonia. In this paper, with the aim of providing a fully automatic and faster diagnosis, we propose the adoption of deep learning for COVID-19 detection from X-rays. METHOD In particular, we propose an approach composed by three phases: the first one to detect if in a chest X-ray there is the presence of a pneumonia. The second one to discern between COVID-19 and pneumonia. The last step is aimed to localise the areas in the X-ray symptomatic of the COVID-19 presence. RESULTS AND CONCLUSION Experimental analysis on 6,523 chest X-rays belonging to different institutions demonstrated the effectiveness of the proposed approach, with an average time for COVID-19 detection of approximately 2.5 seconds and an average accuracy equal to 0.97.
Collapse
Affiliation(s)
- Luca Brunese
- Department of Medicine and Health Sciences "Vincenzo Tiberio", University of Molise, Campobasso, Italy
| | - Francesco Mercaldo
- Department of Medicine and Health Sciences "Vincenzo Tiberio", University of Molise, Campobasso, Italy; Institute for Informatics and Telematics, National Research Council of Italy (CNR), Pisa, Italy
| | - Alfonso Reginelli
- Department of Precision Medicine, University of Campania "Luigi Vanvitelli", Napoli, Italy
| | - Antonella Santone
- Department of Biosciences and Territory, University of Molise, Pesche (IS), Italy
| |
Collapse
|
479
|
Hassantabar S, Ahmadi M, Sharifi A. Diagnosis and detection of infected tissue of COVID-19 patients based on lung x-ray image using convolutional neural network approaches. CHAOS, SOLITONS, AND FRACTALS 2020; 140:110170. [PMID: 32834651 PMCID: PMC7388764 DOI: 10.1016/j.chaos.2020.110170] [Citation(s) in RCA: 103] [Impact Index Per Article: 25.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/09/2020] [Accepted: 07/27/2020] [Indexed: 05/02/2023]
Abstract
COVID-19 pandemic has challenged the world science. The international community tries to find, apply, or design novel methods for diagnosis and treatment of COVID-19 patients as soon as possible. Currently, a reliable method for the diagnosis of infected patients is a reverse transcription-polymerase chain reaction. The method is expensive and time-consuming. Therefore, designing novel methods is important. In this paper, we used three deep learning-based methods for the detection and diagnosis of COVID-19 patients with the use of X-Ray images of lungs. For the diagnosis of the disease, we presented two algorithms include deep neural network (DNN) on the fractal feature of images and convolutional neural network (CNN) methods with the use of the lung images, directly. Results classification shows that the presented CNN architecture with higher accuracy (93.2%) and sensitivity (96.1%) is outperforming than the DNN method with an accuracy of 83.4% and sensitivity of 86%. In the segmentation process, we presented a CNN architecture to find infected tissue in lung images. Results show that the presented method can almost detect infected regions with high accuracy of 83.84%. This finding also can be used to monitor and control patients from infected region growth.
Collapse
Affiliation(s)
- Shayan Hassantabar
- Department of Electrical Engineering, Princeton University, Princeton, NJ, USA
| | - Mohsen Ahmadi
- Department of Industrial Engineering, Urmia University of Technology, Urmia, Iran
| | - Abbas Sharifi
- Department of Mechanical Engineering, Urmia University of Technology, Urmia, Iran
| |
Collapse
|
480
|
Khan AI, Shah JL, Bhat MM. CoroNet: A deep neural network for detection and diagnosis of COVID-19 from chest x-ray images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 196:105581. [PMID: 32534344 PMCID: PMC7274128 DOI: 10.1016/j.cmpb.2020.105581] [Citation(s) in RCA: 494] [Impact Index Per Article: 123.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/10/2020] [Accepted: 05/30/2020] [Indexed: 05/18/2023]
Abstract
BACKGROUND AND OBJECTIVE The novel Coronavirus also called COVID-19 originated in Wuhan, China in December 2019 and has now spread across the world. It has so far infected around 1.8 million people and claimed approximately 114,698 lives overall. As the number of cases are rapidly increasing, most of the countries are facing shortage of testing kits and resources. The limited quantity of testing kits and increasing number of daily cases encouraged us to come up with a Deep Learning model that can aid radiologists and clinicians in detecting COVID-19 cases using chest X-rays. METHODS In this study, we propose CoroNet, a Deep Convolutional Neural Network model to automatically detect COVID-19 infection from chest X-ray images. The proposed model is based on Xception architecture pre-trained on ImageNet dataset and trained end-to-end on a dataset prepared by collecting COVID-19 and other chest pneumonia X-ray images from two different publically available databases. RESULTS CoroNet has been trained and tested on the prepared dataset and the experimental results show that our proposed model achieved an overall accuracy of 89.6%, and more importantly the precision and recall rate for COVID-19 cases are 93% and 98.2% for 4-class cases (COVID vs Pneumonia bacterial vs pneumonia viral vs normal). For 3-class classification (COVID vs Pneumonia vs normal), the proposed model produced a classification accuracy of 95%. The preliminary results of this study look promising which can be further improved as more training data becomes available. CONCLUSION CoroNet achieved promising results on a small prepared dataset which indicates that given more data, the proposed model can achieve better results with minimum pre-processing of data. Overall, the proposed model substantially advances the current radiology based methodology and during COVID-19 pandemic, it can be very helpful tool for clinical practitioners and radiologists to aid them in diagnosis, quantification and follow-up of COVID-19 cases.
Collapse
Affiliation(s)
- Asif Iqbal Khan
- Department of Computer Science, Jamia Millia Islamia, New Delhi, India.
| | | | | |
Collapse
|
481
|
Hernandez-Matamoros A, Fujita H, Hayashi T, Perez-Meana H. Forecasting of COVID19 per regions using ARIMA models and polynomial functions. Appl Soft Comput 2020; 96:106610. [PMID: 32834798 PMCID: PMC7409837 DOI: 10.1016/j.asoc.2020.106610] [Citation(s) in RCA: 83] [Impact Index Per Article: 20.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2020] [Revised: 07/30/2020] [Accepted: 08/02/2020] [Indexed: 01/11/2023]
Abstract
COVID-2019 is a global threat, for this reason around the world, researches have been focused on topics such as to detect it, prevent it, cure it, and predict it. Different analyses propose models to predict the evolution of this epidemic. These analyses propose models for specific geographical areas, specific countries, or create a global model. The models give us the possibility to predict the virus behavior, it could be used to make future response plans. This work presents an analysis of COVID-19 spread that shows a different angle for the whole world, through 6 geographic regions (continents). We propose to create a relationship between the countries, which are in the same geographical area to predict the advance of the virus. The countries in the same geographic region have variables with similar values (quantifiable and non-quantifiable), which affect the spread of the virus. We propose an algorithm to performed and evaluated the ARIMA model for 145 countries, which are distributed into 6 regions. Then, we construct a model for these regions using the ARIMA parameters, the population per 1M people, the number of cases, and polynomial functions. The proposal is able to predict the COVID-19 cases with a RMSE average of 144.81. The main outcome of this paper is showing a relation between COVID-19 behavior and population in a region, these results show us the opportunity to create more models to predict the COVID-19 behavior using variables as humidity, climate, culture, among others.
Collapse
Affiliation(s)
| | - Hamido Fujita
- Faculty of Information Technology, Ho Chi Minh City University of Technology (HUTECH), Ho Chi Minh City, Viet Nam
- Iwate Prefectural University (IPU), Faculty of Software and Information Science, Iwate, 020-0693, Japan
- Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain
| | - Toshitaka Hayashi
- Iwate Prefectural University (IPU), Faculty of Software and Information Science, Iwate, 020-0693, Japan
| | - Hector Perez-Meana
- Instituto Politecnico Nacional, Av. Santa Ana 1000 Mexico D. F., 04430, Mexico
| |
Collapse
|
482
|
Casiraghi E, Malchiodi D, Trucco G, Frasca M, Cappelletti L, Fontana T, Esposito AA, Avola E, Jachetti A, Reese J, Rizzi A, Robinson PN, Valentini G. Explainable Machine Learning for Early Assessment of COVID-19 Risk Prediction in Emergency Departments. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2020; 8:196299-196325. [PMID: 34812365 PMCID: PMC8545262 DOI: 10.1109/access.2020.3034032] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/16/2020] [Accepted: 10/19/2020] [Indexed: 05/06/2023]
Abstract
Between January and October of 2020, the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) virus has infected more than 34 million persons in a worldwide pandemic leading to over one million deaths worldwide (data from the Johns Hopkins University). Since the virus begun to spread, emergency departments were busy with COVID-19 patients for whom a quick decision regarding in- or outpatient care was required. The virus can cause characteristic abnormalities in chest radiographs (CXR), but, due to the low sensitivity of CXR, additional variables and criteria are needed to accurately predict risk. Here, we describe a computerized system primarily aimed at extracting the most relevant radiological, clinical, and laboratory variables for improving patient risk prediction, and secondarily at presenting an explainable machine learning system, which may provide simple decision criteria to be used by clinicians as a support for assessing patient risk. To achieve robust and reliable variable selection, Boruta and Random Forest (RF) are combined in a 10-fold cross-validation scheme to produce a variable importance estimate not biased by the presence of surrogates. The most important variables are then selected to train a RF classifier, whose rules may be extracted, simplified, and pruned to finally build an associative tree, particularly appealing for its simplicity. Results show that the radiological score automatically computed through a neural network is highly correlated with the score computed by radiologists, and that laboratory variables, together with the number of comorbidities, aid risk prediction. The prediction performance of our approach was compared to that that of generalized linear models and shown to be effective and robust. The proposed machine learning-based computational system can be easily deployed and used in emergency departments for rapid and accurate risk prediction in COVID-19 patients.
Collapse
Affiliation(s)
- Elena Casiraghi
- Department of Computer Science “Giovanni degli Antoni,”Università degli Studi di Milano20133MilanItaly
- CINI National Laboratory of Artificial Intelligence and Intelligent Systems (AIIS)Università di Roma00185RomaItaly
| | - Dario Malchiodi
- Department of Computer Science “Giovanni degli Antoni,”Università degli Studi di Milano20133MilanItaly
- CINI National Laboratory of Artificial Intelligence and Intelligent Systems (AIIS)Università di Roma00185RomaItaly
- Data Science Research CenterUniversità degli Studi di Milano20133MilanItaly
| | - Gabriella Trucco
- Department of Computer Science “Giovanni degli Antoni,”Università degli Studi di Milano20133MilanItaly
| | - Marco Frasca
- Department of Computer Science “Giovanni degli Antoni,”Università degli Studi di Milano20133MilanItaly
| | - Luca Cappelletti
- Department of Computer Science “Giovanni degli Antoni,”Università degli Studi di Milano20133MilanItaly
| | - Tommaso Fontana
- Dipartimento di ElettronicaInformazione e BioingegneriaPolitecnico di Milano20133MilanItaly
| | | | - Emanuele Avola
- Postgraduate School in RadiodiagnosticsUniversità degli Studi di Milano20122MilanItaly
| | - Alessandro Jachetti
- Accident and Emergency DepartmentFondazione IRCCS Ca Granda Ospedale Maggiore Policlinico20122MilanItaly
| | - Justin Reese
- Division of Environmental Genomics and Systems BiologyLawrence Berkeley National LaboratoryBerkeleyCA94720USA
| | - Alessandro Rizzi
- Department of Computer Science “Giovanni degli Antoni,”Università degli Studi di Milano20133MilanItaly
| | | | - Giorgio Valentini
- Department of Computer Science “Giovanni degli Antoni,”Università degli Studi di Milano20133MilanItaly
- CINI National Laboratory of Artificial Intelligence and Intelligent Systems (AIIS)Università di Roma00185RomaItaly
- Data Science Research CenterUniversità degli Studi di Milano20133MilanItaly
| |
Collapse
|
483
|
De Moura J, García LR, Vidal PFL, Cruz M, López LA, Lopez EC, Novo J, Ortega M. Deep Convolutional Approaches for the Analysis of COVID-19 Using Chest X-Ray Images From Portable Devices. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2020; 8:195594-195607. [PMID: 34786295 PMCID: PMC8545263 DOI: 10.1109/access.2020.3033762] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/12/2020] [Accepted: 10/21/2020] [Indexed: 05/18/2023]
Abstract
The recent human coronavirus disease (COVID-19) is a respiratory infection caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Given the effects of COVID-19 in pulmonary tissues, chest radiography imaging plays an important role in the screening, early detection, and monitoring of the suspected individuals. Hence, as the pandemic of COVID-19 progresses, there will be a greater reliance on the use of portable equipment for the acquisition of chest X-ray images due to its accessibility, widespread availability, and benefits regarding to infection control issues, minimizing the risk of cross-contamination. This work presents novel fully automatic approaches specifically tailored for the classification of chest X-ray images acquired by portable equipment into 3 different clinical categories: normal, pathological, and COVID-19. For this purpose, 3 complementary deep learning approaches based on a densely convolutional network architecture are herein presented. The joint response of all the approaches allows to enhance the differentiation between patients infected with COVID-19, patients with other diseases that manifest characteristics similar to COVID-19 and normal cases. The proposed approaches were validated over a dataset specifically retrieved for this research. Despite the poor quality of the chest X-ray images that is inherent to the nature of the portable equipment, the proposed approaches provided global accuracy values of 79.62%, 90.27% and 79.86%, respectively, allowing a reliable analysis of portable radiographs to facilitate the clinical decision-making process.
Collapse
Affiliation(s)
- Joaquim De Moura
- Centro de Investigación CITICUniversidade da Coruña15071 ACoruñaSpain
- Grupo VARPAInstituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña15006 ACoruñaSpain
| | - Lucía Ramos García
- Centro de Investigación CITICUniversidade da Coruña15071 ACoruñaSpain
- Grupo VARPAInstituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña15006 ACoruñaSpain
| | - Plácido Francisco Lizancos Vidal
- Centro de Investigación CITICUniversidade da Coruña15071 ACoruñaSpain
- Grupo VARPAInstituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña15006 ACoruñaSpain
| | - Milena Cruz
- Servicio de RadiodiagnósticoComplexo Hospitalario Universitario de A Coruña (CHUAC)15006 ACoruñaSpain
| | - Laura Abelairas López
- Servicio de RadiodiagnósticoComplexo Hospitalario Universitario de A Coruña (CHUAC)15006 ACoruñaSpain
| | - Eva Castro Lopez
- Servicio de RadiodiagnósticoComplexo Hospitalario Universitario de A Coruña (CHUAC)15006 ACoruñaSpain
| | - Jorge Novo
- Centro de Investigación CITICUniversidade da Coruña15071 ACoruñaSpain
- Grupo VARPAInstituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña15006 ACoruñaSpain
| | - Marcos Ortega
- Centro de Investigación CITICUniversidade da Coruña15071 ACoruñaSpain
- Grupo VARPAInstituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña15006 ACoruñaSpain
| |
Collapse
|
484
|
El-bana S, Al-Kabbany A, Sharkas M. A multi-task pipeline with specialized streams for classification and segmentation of infection manifestations in COVID-19 scans. PeerJ Comput Sci 2020; 6:e303. [PMID: 33816954 PMCID: PMC7924532 DOI: 10.7717/peerj-cs.303] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2020] [Accepted: 09/26/2020] [Indexed: 05/02/2023]
Abstract
We are concerned with the challenge of coronavirus disease (COVID-19) detection in chest X-ray and Computed Tomography (CT) scans, and the classification and segmentation of related infection manifestations. Even though it is arguably not an established diagnostic tool, using machine learning-based analysis of COVID-19 medical scans has shown the potential to provide a preliminary digital second opinion. This can help in managing the current pandemic, and thus has been attracting significant research attention. In this research, we propose a multi-task pipeline that takes advantage of the growing advances in deep neural network models. In the first stage, we fine-tuned an Inception-v3 deep model for COVID-19 recognition using multi-modal learning, that is, using X-ray and CT scans. In addition to outperforming other deep models on the same task in the recent literature, with an attained accuracy of 99.4%, we also present comparative analysis for multi-modal learning against learning from X-ray scans alone. The second and the third stages of the proposed pipeline complement one another in dealing with different types of infection manifestations. The former features a convolutional neural network architecture for recognizing three types of manifestations, while the latter transfers learning from another knowledge domain, namely, pulmonary nodule segmentation in CT scans, to produce binary masks for segmenting the regions corresponding to these manifestations. Our proposed pipeline also features specialized streams in which multiple deep models are trained separately to segment specific types of infection manifestations, and we show the significant impact that this framework has on various performance metrics. We evaluate the proposed models on widely adopted datasets, and we demonstrate an increase of approximately 2.5% and 4.5% for dice coefficient and mean intersection-over-union (mIoU), respectively, while achieving 60% reduction in computational time, compared to the recent literature.
Collapse
Affiliation(s)
- Shimaa El-bana
- Alexandria Higher Institute of Engineering and Technology, Alexandria, Egypt
| | - Ahmad Al-Kabbany
- Intelligent Systems Lab, Arab Academy for Science, Technology, and Maritime Transport, Alexandria, Egypt
- Department of Research and Development, VRapeutic, Cairo, Egypt
- Department of Electronics and Communications Engineering, Arab Academy for Science, Technology, and Maritime Transport, Alexandria, Egypt
| | - Maha Sharkas
- Department of Electronics and Communications Engineering, Arab Academy for Science, Technology, and Maritime Transport, Alexandria, Egypt
| |
Collapse
|
485
|
Punn NS, Agarwal S. Automated diagnosis of COVID-19 with limited posteroanterior chest X-ray images using fine-tuned deep neural networks. APPL INTELL 2020; 51:2689-2702. [PMID: 34764554 PMCID: PMC7568031 DOI: 10.1007/s10489-020-01900-3] [Citation(s) in RCA: 73] [Impact Index Per Article: 18.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
Abstract
The novel coronavirus 2019 (COVID-19) is a respiratory syndrome that resembles pneumonia. The current diagnostic procedure of COVID-19 follows reverse-transcriptase polymerase chain reaction (RT-PCR) based approach which however is less sensitive to identify the virus at the initial stage. Hence, a more robust and alternate diagnosis technique is desirable. Recently, with the release of publicly available datasets of corona positive patients comprising of computed tomography (CT) and chest X-ray (CXR) imaging; scientists, researchers and healthcare experts are contributing for faster and automated diagnosis of COVID-19 by identifying pulmonary infections using deep learning approaches to achieve better cure and treatment. These datasets have limited samples concerned with the positive COVID-19 cases, which raise the challenge for unbiased learning. Following from this context, this article presents the random oversampling and weighted class loss function approach for unbiased fine-tuned learning (transfer learning) in various state-of-the-art deep learning approaches such as baseline ResNet, Inception-v3, Inception ResNet-v2, DenseNet169, and NASNetLarge to perform binary classification (as normal and COVID-19 cases) and also multi-class classification (as COVID-19, pneumonia, and normal case) of posteroanterior CXR images. Accuracy, precision, recall, loss, and area under the curve (AUC) are utilized to evaluate the performance of the models. Considering the experimental results, the performance of each model is scenario dependent; however, NASNetLarge displayed better scores in contrast to other architectures, which is further compared with other recently proposed approaches. This article also added the visual explanation to illustrate the basis of model classification and perception of COVID-19 in CXR images.
Collapse
|
486
|
Abstract
Covid-19 is a rapidly spreading viral disease that infects not only humans, but animals are also infected because of this disease. The daily life of human beings, their health, and the economy of a country are affected due to this deadly viral disease. Covid-19 is a common spreading disease, and till now, not a single country can prepare a vaccine for COVID-19. A clinical study of COVID-19 infected patients has shown that these types of patients are mostly infected from a lung infection after coming in contact with this disease. Chest x-ray (i.e., radiography) and chest CT are a more effective imaging technique for diagnosing lunge related problems. Still, a substantial chest x-ray is a lower cost process in comparison to chest CT. Deep learning is the most successful technique of machine learning, which provides useful analysis to study a large amount of chest x-ray images that can critically impact on screening of Covid-19. In this work, we have taken the PA view of chest x-ray scans for covid-19 affected patients as well as healthy patients. After cleaning up the images and applying data augmentation, we have used deep learning-based CNN models and compared their performance. We have compared Inception V3, Xception, and ResNeXt models and examined their accuracy. To analyze the model performance, 6432 chest x-ray scans samples have been collected from the Kaggle repository, out of which 5467 were used for training and 965 for validation. In result analysis, the Xception model gives the highest accuracy (i.e., 97.97%) for detecting Chest X-rays images as compared to other models. This work only focuses on possible methods of classifying covid-19 infected patients and does not claim any medical accuracy.
Collapse
|
487
|
Majeed T, Rashid R, Ali D, Asaad A. Issues associated with deploying CNN transfer learning to detect COVID-19 from chest X-rays. Phys Eng Sci Med 2020; 43:1289-1303. [PMID: 33025386 PMCID: PMC7537970 DOI: 10.1007/s13246-020-00934-8] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2020] [Accepted: 09/25/2020] [Indexed: 12/28/2022]
Abstract
Covid-19 first occurred in Wuhan, China in December 2019. Subsequently, the virus spread throughout the world and as of June 2020 the total number of confirmed cases are above 4.7 million with over 315,000 deaths. Machine learning algorithms built on radiography images can be used as a decision support mechanism to aid radiologists to speed up the diagnostic process. The aim of this work is to conduct a critical analysis to investigate the applicability of convolutional neural networks (CNNs) for the purpose of COVID-19 detection in chest X-ray images and highlight the issues of using CNN directly on the whole image. To accomplish this task, we use 12-off-the-shelf CNN architectures in transfer learning mode on 3 publicly available chest X-ray databases together with proposing a shallow CNN architecture in which we train it from scratch. Chest X-ray images are fed into CNN models without any preprocessing to replicate researches used chest X-rays in this manner. Then a qualitative investigation performed to inspect the decisions made by CNNs using a technique known as class activation maps (CAM). Using CAMs, one can map the activations contributed to the decision of CNNs back to the original image to visualize the most discriminating region(s) on the input image. We conclude that CNN decisions should not be taken into consideration, despite their high classification accuracy, until clinicians can visually inspect and approve the region(s) of the input image used by CNNs that lead to its prediction.
Collapse
Affiliation(s)
- Taban Majeed
- Department of Computer Science and Information Technology, College of Science, Salahaddin University, Erbil, Kurdistan Region, Iraq
| | - Rasber Rashid
- Department of Software Engineering, Faculty of Engineering, Koya University, Koya KOY45, Kurdistan Region, Iraq
| | - Dashti Ali
- Independent Researcher, Toronto, ON Canada
| | - Aras Asaad
- Oxford Drug Design, Oxford Centre for Innovation, New Road, Oxford, OX1 1BY UK
| |
Collapse
|
488
|
Pereira RM, Bertolini D, Teixeira LO, Silla CN, Costa YMG. COVID-19 identification in chest X-ray images on flat and hierarchical classification scenarios. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 194:105532. [PMID: 32446037 PMCID: PMC7207172 DOI: 10.1016/j.cmpb.2020.105532] [Citation(s) in RCA: 205] [Impact Index Per Article: 51.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/15/2020] [Revised: 05/05/2020] [Accepted: 05/06/2020] [Indexed: 05/02/2023]
Abstract
BACKGROUND AND OBJECTIVE The COVID-19 can cause severe pneumonia and is estimated to have a high impact on the healthcare system. Early diagnosis is crucial for correct treatment in order to possibly reduce the stress in the healthcare system. The standard image diagnosis tests for pneumonia are chest X-ray (CXR) and computed tomography (CT) scan. Although CT scan is the gold standard, CXR are still useful because it is cheaper, faster and more widespread. This study aims to identify pneumonia caused by COVID-19 from other types and also healthy lungs using only CXR images. METHODS In order to achieve the objectives, we have proposed a classification schema considering the following perspectives: i) a multi-class classification; ii) hierarchical classification, since pneumonia can be structured as a hierarchy. Given the natural data imbalance in this domain, we also proposed the use of resampling algorithms in the schema in order to re-balance the classes distribution. We observed that, texture is one of the main visual attributes of CXR images, our classification schema extract features using some well-known texture descriptors and also using a pre-trained CNN model. We also explored early and late fusion techniques in the schema in order to leverage the strength of multiple texture descriptors and base classifiers at once. To evaluate the approach, we composed a database, named RYDLS-20, containing CXR images of pneumonia caused by different pathogens as well as CXR images of healthy lungs. The classes distribution follows a real-world scenario in which some pathogens are more common than others. RESULTS The proposed approach tested in RYDLS-20 achieved a macro-avg F1-Score of 0.65 using a multi-class approach and a F1-Score of 0.89 for the COVID-19 identification in the hierarchical classification scenario. CONCLUSIONS As far as we know, the top identification rate obtained in this paper is the best nominal rate obtained for COVID-19 identification in an unbalanced environment with more than three classes. We must also highlight the novel proposed hierarchical classification approach for this task, which considers the types of pneumonia caused by the different pathogens and lead us to the best COVID-19 recognition rate obtained here.
Collapse
Affiliation(s)
- Rodolfo M Pereira
- Instituto Federal de Educação, Ciência e Tecnologia do Paraná (IFPR), Pinhais, PR, Brazil; Pontifícia Universidade Catalica do Paraná (PUCPR), Curitiba, PR, Brazil.
| | - Diego Bertolini
- Universidade Tecnologica Federal do Paraná (UTFPR), Campo Mourão, PR, Brazil; Universidade Estadual de Maringá (UEM), Maringá, PR, Brazil
| | | | - Carlos N Silla
- Pontifícia Universidade Catalica do Paraná (PUCPR), Curitiba, PR, Brazil
| | | |
Collapse
|
489
|
Ulhaq A, Born J, Khan A, Gomes DPS, Chakraborty S, Paul M. COVID-19 Control by Computer Vision Approaches: A Survey. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2020; 8:179437-179456. [PMID: 34812357 PMCID: PMC8545281 DOI: 10.1109/access.2020.3027685] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Accepted: 09/26/2020] [Indexed: 05/03/2023]
Abstract
The COVID-19 pandemic has triggered an urgent call to contribute to the fight against an immense threat to the human population. Computer Vision, as a subfield of artificial intelligence, has enjoyed recent success in solving various complex problems in health care and has the potential to contribute to the fight of controlling COVID-19. In response to this call, computer vision researchers are putting their knowledge base at test to devise effective ways to counter COVID-19 challenge and serve the global community. New contributions are being shared with every passing day. It motivated us to review the recent work, collect information about available research resources, and an indication of future research directions. We want to make it possible for computer vision researchers to find existing and future research directions. This survey article presents a preliminary review of the literature on research community efforts against COVID-19 pandemic.
Collapse
Affiliation(s)
- Anwaar Ulhaq
- School of Computing and MathematicsCharles Sturt UniversityPort MacquarieNSW2795Australia
| | - Jannis Born
- Department for Biosystems Science and EngineeringETH Zurich4058BaselSwitzerland
| | - Asim Khan
- College of Engineering and ScienceVictoria UniversityMelbourneVIC3011Australia
| | | | - Subrata Chakraborty
- Faculty of Engineering and Information TechnologyUniversity of Technology SydneySydneyNSW2007Australia
| | - Manoranjan Paul
- School of Computing and MathematicsCharles Sturt UniversityPort MacquarieNSW2795Australia
| |
Collapse
|
490
|
Karar ME, Hemdan EED, Shouman MA. Cascaded deep learning classifiers for computer-aided diagnosis of COVID-19 and pneumonia diseases in X-ray scans. COMPLEX INTELL SYST 2020; 7:235-247. [PMID: 34777953 PMCID: PMC7507595 DOI: 10.1007/s40747-020-00199-4] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2020] [Accepted: 09/09/2020] [Indexed: 12/18/2022]
Abstract
Computer-aided diagnosis (CAD) systems are considered a powerful tool for physicians to support identification of the novel Coronavirus Disease 2019 (COVID-19) using medical imaging modalities. Therefore, this article proposes a new framework of cascaded deep learning classifiers to enhance the performance of these CAD systems for highly suspected COVID-19 and pneumonia diseases in X-ray images. Our proposed deep learning framework constitutes two major advancements as follows. First, complicated multi-label classification of X-ray images have been simplified using a series of binary classifiers for each tested case of the health status. That mimics the clinical situation to diagnose potential diseases for a patient. Second, the cascaded architecture of COVID-19 and pneumonia classifiers is flexible to use different fine-tuned deep learning models simultaneously, achieving the best performance of confirming infected cases. This study includes eleven pre-trained convolutional neural network models, such as Visual Geometry Group Network (VGG) and Residual Neural Network (ResNet). They have been successfully tested and evaluated on public X-ray image dataset for normal and three diseased cases. The results of proposed cascaded classifiers showed that VGG16, ResNet50V2, and Dense Neural Network (DenseNet169) models achieved the best detection accuracy of COVID-19, viral (Non-COVID-19) pneumonia, and bacterial pneumonia images, respectively. Furthermore, the performance of our cascaded deep learning classifiers is superior to other multi-label classification methods of COVID-19 and pneumonia diseases in previous studies. Therefore, the proposed deep learning framework presents a good option to be applied in the clinical routine to assist the diagnostic procedures of COVID-19 infection.
Collapse
Affiliation(s)
- Mohamed Esmail Karar
- Department of Computer Engineering and Networks, College of Computing and Information Technology, Shaqra University, Shaqra, Saudi Arabia
- Department of Industrial Electronics and Control Engineering, Faculty of Electronic Engineering, Menoufia University, Minuf, 32952 Egypt
| | - Ezz El-Din Hemdan
- Department of Computer Science and Engineering, Faculty of Electronic Engineering, Menoufia University, Minuf, 32952 Egypt
| | - Marwa A. Shouman
- Department of Computer Science and Engineering, Faculty of Electronic Engineering, Menoufia University, Minuf, 32952 Egypt
| |
Collapse
|
491
|
Abstract
In December 2019, a novel virus named COVID-19 emerged in the city of Wuhan, China. In early 2020, the COVID-19 virus spread in all continents of the world except Antarctica, causing widespread infections and deaths due to its contagious characteristics and no medically proven treatment. The COVID-19 pandemic has been termed as the most consequential global crisis since the World Wars. The first line of defense against the COVID-19 spread are the non-pharmaceutical measures like social distancing and personal hygiene. The great pandemic affecting billions of lives economically and socially has motivated the scientific community to come up with solutions based on computer-aided digital technologies for diagnosis, prevention, and estimation of COVID-19. Some of these efforts focus on statistical and Artificial Intelligence-based analysis of the available data concerning COVID-19. All of these scientific efforts necessitate that the data brought to service for the analysis should be open source to promote the extension, validation, and collaboration of the work in the fight against the global pandemic. Our survey is motivated by the open source efforts that can be mainly categorized as (a) COVID-19 diagnosis from CT scans, X-ray images, and cough sounds, (b) COVID-19 case reporting, transmission estimation, and prognosis from epidemiological, demographic, and mobility data, (c) COVID-19 emotional and sentiment analysis from social media, and (d) knowledge-based discovery and semantic analysis from the collection of scholarly articles covering COVID-19. We survey and compare research works in these directions that are accompanied by open source data and code. Future research directions for data-driven COVID-19 research are also debated. We hope that the article will provide the scientific community with an initiative to start open source extensible and transparent research in the collective fight against the COVID-19 pandemic.
Collapse
Affiliation(s)
- Junaid Shuja
- Department of Computer Science, COMSATS University Islamabad, Abbottabad Campus, Islamabad, Pakistan
- Department of Computer Engineering, Umm Al-Qura University, Makkah, Saudi Arabia
- Center of Innovation and Development in Artificial Intelligence, Umm Al-Qura University, Makkah, Saudi Arabia
| | - Eisa Alanazi
- Department of Computer Science, Umm Al-Qura University, Makkah, Saudi Arabia
- Center of Innovation and Development in Artificial Intelligence, Umm Al-Qura University, Makkah, Saudi Arabia
| | - Waleed Alasmary
- Department of Computer Engineering, Umm Al-Qura University, Makkah, Saudi Arabia
- Center of Innovation and Development in Artificial Intelligence, Umm Al-Qura University, Makkah, Saudi Arabia
| | - Abdulaziz Alashaikh
- Computer Engineering and Networks Department, University of Jeddah, Jeddah, Saudi Arabia
| |
Collapse
|
492
|
Babukarthik RG, Adiga VAK, Sambasivam G, Chandramohan D, Amudhavel J. Prediction of COVID-19 Using Genetic Deep Learning Convolutional Neural Network (GDCNN). IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2020; 8:177647-177666. [PMID: 34786292 PMCID: PMC8545287 DOI: 10.1109/access.2020.3025164] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/27/2020] [Accepted: 09/07/2020] [Indexed: 05/14/2023]
Abstract
Rapid spread of Coronavirus disease COVID-19 leads to severe pneumonia and it is estimated to create a high impact on the healthcare system. An urgent need for early diagnosis is required for precise treatment, which in turn reduces the pressure in the health care system. Some of the standard image diagnosis available is Computed Tomography (CT) scan and Chest X-Ray (CXR). Even though a CT scan is considered a gold standard in diagnosis, CXR is most widely used due to widespread, faster, and cheaper. This study aims to provide a solution for identifying pneumonia due to COVID-19 and healthy lungs (normal person) using CXR images. One of the remarkable methods used for extracting a high dimensional feature from medical images is the Deep learning method. In this research, the state-of-the-art techniques used is Genetic Deep Learning Convolutional Neural Network (GDCNN). It is trained from the scratch for extracting features for classifying them between COVID-19 and normal images. A dataset consisting of more than 5000 CXR image samples is used for classifying pneumonia, normal and other pneumonia diseases. Training a GDCNN from scratch proves that, the proposed method performs better compared to other transfer learning techniques. Classification accuracy of 98.84%, the precision of 93%, the sensitivity of 100%, and specificity of 97.0% in COVID-19 prediction is achieved. Top classification accuracy obtained in this research reveals the best nominal rate in the identification of COVID-19 disease prediction in an unbalanced environment. The novel model proposed for classification proves to be better than the existing models such as ReseNet18, ReseNet50, Squeezenet, DenseNet-121, and Visual Geometry Group (VGG16).
Collapse
Affiliation(s)
- R. G. Babukarthik
- Department of Computer Science and EngineeringDayananda Sagar UniversityBengaluru560078India
| | - V. Ananth Krishna Adiga
- Department of Computer Science and EngineeringDayananda Sagar UniversityBengaluru560078India
| | - G. Sambasivam
- Faculty of Information and Communication TechnologyISBAT UniversityKampalaUganda
| | - D. Chandramohan
- Department of Computer Science and EngineeringMadanapalle Institute of Technology and ScienceMadanapalle517325India
| | - J. Amudhavel
- School of Computer Science and EngineeringVIT Bhopal UniversityBhopal466114India
| |
Collapse
|
493
|
Chowdhury NK, Rahman MM, Kabir MA. PDCOVIDNet: a parallel-dilated convolutional neural network architecture for detecting COVID-19 from chest X-ray images. Health Inf Sci Syst 2020; 8:27. [PMID: 32983419 PMCID: PMC7505500 DOI: 10.1007/s13755-020-00119-3] [Citation(s) in RCA: 42] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2020] [Accepted: 09/08/2020] [Indexed: 11/25/2022] Open
Abstract
The COVID-19 pandemic continues to severely undermine the prosperity of the global health system. To combat this pandemic, effective screening techniques for infected patients are indispensable. There is no doubt that the use of chest X-ray images for radiological assessment is one of the essential screening techniques. Some of the early studies revealed that the patient’s chest X-ray images showed abnormalities, which is natural for patients infected with COVID-19. In this paper, we proposed a parallel-dilated convolutional neural network (CNN) based COVID-19 detection system from chest X-ray images, named as Parallel-Dilated COVIDNet (PDCOVIDNet). First, the publicly available chest X-ray collection fully preloaded and enhanced, and then classified by the proposed method. Differing convolution dilation rate in a parallel form demonstrates the proof-of-principle for using PDCOVIDNet to extract radiological features for COVID-19 detection. Accordingly, we have assisted our method with two visualization methods, which are specifically designed to increase understanding of the key components associated with COVID-19 infection. Both visualization methods compute gradients for a given image category related to feature maps of the last convolutional layer to create a class-discriminative region. In our experiment, we used a total of 2905 chest X-ray images, comprising three cases (such as COVID-19, normal, and viral pneumonia), and empirical evaluations revealed that the proposed method extracted more significant features expeditiously related to suspected disease. The experimental results demonstrate that our proposed method significantly improves performance metrics: the accuracy, precision, recall and F1 scores reach \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$96.58\%$$\end{document}96.58%, \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$96.58\%$$\end{document}96.58%, \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$96.59\%$$\end{document}96.59% and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$96.58\%$$\end{document}96.58%, respectively, which is comparable or enhanced compared with the state-of-the-art methods. We believe that our contribution can support resistance to COVID-19, and will adopt for COVID-19 screening in AI-based systems.
Collapse
Affiliation(s)
- Nihad K Chowdhury
- Department of Computer Science and Engineering, University of Chittagong, Chittagong, Bangladesh
| | - Md Muhtadir Rahman
- Department of Computer Science and Engineering, University of Chittagong, Chittagong, Bangladesh
| | - Muhammad Ashad Kabir
- School of Computing and Mathematics, Charles Sturt University, Bathurst, NSW Australia
| |
Collapse
|
494
|
Goel T, Murugan R, Mirjalili S, Chakrabartty DK. OptCoNet: an optimized convolutional neural network for an automatic diagnosis of COVID-19. APPL INTELL 2020; 51:1351-1366. [PMID: 34764551 PMCID: PMC7502308 DOI: 10.1007/s10489-020-01904-z] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
|
495
|
Turkoglu M. COVIDetectioNet: COVID-19 diagnosis system based on X-ray images using features selected from pre-learned deep features ensemble. APPL INTELL 2020; 51:1213-1226. [PMID: 34764550 PMCID: PMC7498308 DOI: 10.1007/s10489-020-01888-w] [Citation(s) in RCA: 68] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
The recent novel coronavirus (also known as COVID-19) has rapidly spread worldwide, causing an infectious respiratory disease that has killed hundreds of thousands and infected millions. While test kits are used for diagnosis of the disease, the process takes time and the test kits are limited in their availability. However, the COVID-19 disease is also diagnosable using radiological images taken through lung X-rays. This process is known to be both faster and more reliable as a form of identification and diagnosis. In this regard, the current study proposes an expert-designed system called COVIDetectioNet model, which utilizes features selected from combination of deep features for diagnosis of COVID-19. For this purpose, a pretrained Convolutional Neural Network (CNN)-based AlexNet architecture that employed the transfer learning approach, was used. The effective features that were selected using the Relief feature selection algorithm from all layers of the architecture were then classified using the Support Vector Machine (SVM) method. To verify the validity of the model proposed, a total of 6092 X-ray images, classified as Normal (healthy), COVID-19, and Pneumonia, were obtained from a combination of public datasets. In the experimental results, an accuracy of 99.18% was achieved using the model proposed. The results demonstrate that the proposed COVIDetectioNet model achieved a superior level of success when compared to previous studies.
Collapse
|
496
|
Sakib S, Tazrin T, Fouda MM, Fadlullah ZM, Guizani M. DL-CRC: Deep Learning-Based Chest Radiograph Classification for COVID-19 Detection: A Novel Approach. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2020; 8:171575-171589. [PMID: 34976555 PMCID: PMC8675549 DOI: 10.1109/access.2020.3025010] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Accepted: 08/26/2020] [Indexed: 05/05/2023]
Abstract
With the exponentially growing COVID-19 (coronavirus disease 2019) pandemic, clinicians continue to seek accurate and rapid diagnosis methods in addition to virus and antibody testing modalities. Because radiographs such as X-rays and computed tomography (CT) scans are cost-effective and widely available at public health facilities, hospital emergency rooms (ERs), and even at rural clinics, they could be used for rapid detection of possible COVID-19-induced lung infections. Therefore, toward automating the COVID-19 detection, in this paper, we propose a viable and efficient deep learning-based chest radiograph classification (DL-CRC) framework to distinguish the COVID-19 cases with high accuracy from other abnormal (e.g., pneumonia) and normal cases. A unique dataset is prepared from four publicly available sources containing the posteroanterior (PA) chest view of X-ray data for COVID-19, pneumonia, and normal cases. Our proposed DL-CRC framework leverages a data augmentation of radiograph images (DARI) algorithm for the COVID-19 data by adaptively employing the generative adversarial network (GAN) and generic data augmentation methods to generate synthetic COVID-19 infected chest X-ray images to train a robust model. The training data consisting of actual and synthetic chest X-ray images are fed into our customized convolutional neural network (CNN) model in DL-CRC, which achieves COVID-19 detection accuracy of 93.94% compared to 54.55% for the scenario without data augmentation (i.e., when only a few actual COVID-19 chest X-ray image samples are available in the original dataset). Furthermore, we justify our customized CNN model by extensively comparing it with widely adopted CNN architectures in the literature, namely ResNet, Inception-ResNet v2, and DenseNet that represent depth-based, multi-path-based, and hybrid CNN paradigms. The encouragingly high classification accuracy of our proposal implies that it can efficiently automate COVID-19 detection from radiograph images to provide a fast and reliable evidence of COVID-19 infection in the lung that can complement existing COVID-19 diagnostics modalities.
Collapse
Affiliation(s)
- Sadman Sakib
- Department of Computer ScienceLakehead UniversityThunder BayONP7B 5E1Canada
| | - Tahrat Tazrin
- Department of Computer ScienceLakehead UniversityThunder BayONP7B 5E1Canada
| | - Mostafa M. Fouda
- Department of Electrical and Computer EngineeringCollege of Science and EngineeringIdaho State UniversityPocatelloID83209USA
- Department of Electrical EngineeringFaculty of Engineering at ShoubraBenha UniversityCairo11629Egypt
| | - Zubair Md. Fadlullah
- Department of Computer ScienceLakehead UniversityThunder BayONP7B 5E1Canada
- Thunder Bay Regional Health Research Institute (TBRHRI)Thunder BayONP7B 7A5Canada
| | - Mohsen Guizani
- Department of Computer Science and EngineeringCollege of EngineeringQatar UniversityDohaQatar
| |
Collapse
|
497
|
Gomes JC, Barbosa VADF, Santana MA, Bandeira J, Valença MJS, de Souza RE, Ismael AM, dos Santos WP. IKONOS: an intelligent tool to support diagnosis of COVID-19 by texture analysis of X-ray images. RESEARCH ON BIOMEDICAL ENGINEERING 2020. [PMCID: PMC7471577 DOI: 10.1007/s42600-020-00091-7] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Purpose In late 2019, the SARS-CoV-2 virus spread worldwide. The virus has high rates of proliferation and causes severe respiratory symptoms, such as pneumonia. The standard diagnostic method for pneumonia is chest X-ray image. There are many advantages to using COVID-19 diagnostic X-rays: low cost, fast, and widely available. Methods We propose an intelligent system to support diagnosis by X-ray images. We tested Haralick and Zernike moments for feature extraction. Experiments with classic classifiers were done. Results Support vector machines stood out, reaching an average accuracy of 89.78%, average sensitivity of 0.8979, and average precision and specificity of 0.8985 and 0.9963, respectively. Conclusion Using features based on textures and shapes combined with classical classifiers, the developed system was able to differentiate COVID-19 from viral and bacterial pneumonia with low computational cost.
Collapse
Affiliation(s)
- Juliana C. Gomes
- Polytechnique School of the University of Pernambuco, Recife, Brazil
| | | | - Maíra A. Santana
- Polytechnique School of the University of Pernambuco, Recife, Brazil
| | - Jonathan Bandeira
- Polytechnique School of the University of Pernambuco, Recife, Brazil
| | | | | | - Aras Masood Ismael
- Information Technology Department, Technical College of Informatics, Sulaimani Polytechnic University, Sulaymaniyah, Iraq
| | | |
Collapse
|
498
|
Swapnarekha H, Behera HS, Nayak J, Naik B. Role of intelligent computing in COVID-19 prognosis: A state-of-the-art review. CHAOS, SOLITONS, AND FRACTALS 2020; 138:109947. [PMID: 32836916 PMCID: PMC7256553 DOI: 10.1016/j.chaos.2020.109947] [Citation(s) in RCA: 79] [Impact Index Per Article: 19.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/15/2020] [Accepted: 05/26/2020] [Indexed: 05/09/2023]
Abstract
The World Health Organization (WHO) declared novel coronavirus 2019 (COVID-19), an infectious epidemic caused by SARS-CoV-2, as Pandemic in March 2020. It has affected more than 40 million people in 216 countries. Almost in all the affected countries, the number of infected and deceased patients has been enhancing at a distressing rate. As the early prediction can reduce the spread of the virus, it is highly desirable to have intelligent prediction and diagnosis tools. The inculcation of efficient forecasting and prediction models may assist the government in implementing better design strategies to prevent the spread of virus. In this paper, a state-of-the-art analysis of the ongoing machine learning (ML) and deep learning (DL) methods in the diagnosis and prediction of COVID-19 has been done. Moreover, a comparative analysis on the impact of machine learning and other competitive approaches like mathematical and statistical models on COVID-19 problem has been conducted. In this study, some factors such as type of methods(machine learning, deep learning, statistical & mathematical) and the impact of COVID research on the nature of data used for the forecasting and prediction of pandemic using computing approaches has been presented. Finally some important research directions for further research on COVID-19 are highlighted which may facilitate the researchers and technocrats to develop competent intelligent models for the prediction and forecasting of COVID-19 real time data.
Collapse
Affiliation(s)
- H Swapnarekha
- Department of Information Technology, Veer Surendra Sai University of Technology (VSSUT), Burla, Sambalpur-768018, Odisha, India
| | - Himansu Sekhar Behera
- Department of Information Technology, Veer Surendra Sai University of Technology (VSSUT), Burla, Sambalpur-768018, Odisha, India
| | - Janmenjoy Nayak
- Department of Computer Science and Engineering, Aditya Institute of Technology and Management (AITAM), Tekkali, Andhra Pradesh 532201, India
| | - Bighnaraj Naik
- Department of Computer Application, Veer Surendra Sai University of Technology (VSSUT), Burla, Sambalpur-768018, Odisha, India
| |
Collapse
|
499
|
Ahuja S, Panigrahi BK, Dey N, Rajinikanth V, Gandhi TK. Deep transfer learning-based automated detection of COVID-19 from lung CT scan slices. APPL INTELL 2020; 51:571-585. [PMID: 34764547 PMCID: PMC7440966 DOI: 10.1007/s10489-020-01826-w] [Citation(s) in RCA: 118] [Impact Index Per Article: 29.5] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
|
500
|
Zhou L, Li Z, Zhou J, Li H, Chen Y, Huang Y, Xie D, Zhao L, Fan M, Hashmi S, Abdelkareem F, Eiada R, Xiao X, Li L, Qiu Z, Gao X. A Rapid, Accurate and Machine-Agnostic Segmentation and Quantification Method for CT-Based COVID-19 Diagnosis. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:2638-2652. [PMID: 32730214 PMCID: PMC8769013 DOI: 10.1109/tmi.2020.3001810] [Citation(s) in RCA: 85] [Impact Index Per Article: 21.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/24/2020] [Revised: 06/06/2020] [Accepted: 06/07/2020] [Indexed: 05/03/2023]
Abstract
COVID-19 has caused a global pandemic and become the most urgent threat to the entire world. Tremendous efforts and resources have been invested in developing diagnosis, prognosis and treatment strategies to combat the disease. Although nucleic acid detection has been mainly used as the gold standard to confirm this RNA virus-based disease, it has been shown that such a strategy has a high false negative rate, especially for patients in the early stage, and thus CT imaging has been applied as a major diagnostic modality in confirming positive COVID-19. Despite the various, urgent advances in developing artificial intelligence (AI)-based computer-aided systems for CT-based COVID-19 diagnosis, most of the existing methods can only perform classification, whereas the state-of-the-art segmentation method requires a high level of human intervention. In this paper, we propose a fully-automatic, rapid, accurate, and machine-agnostic method that can segment and quantify the infection regions on CT scans from different sources. Our method is founded upon two innovations: 1) the first CT scan simulator for COVID-19, by fitting the dynamic change of real patients' data measured at different time points, which greatly alleviates the data scarcity issue; and 2) a novel deep learning algorithm to solve the large-scene-small-object problem, which decomposes the 3D segmentation problem into three 2D ones, and thus reduces the model complexity by an order of magnitude and, at the same time, significantly improves the segmentation accuracy. Comprehensive experimental results over multi-country, multi-hospital, and multi-machine datasets demonstrate the superior performance of our method over the existing ones and suggest its important application value in combating the disease.
Collapse
Affiliation(s)
- Longxi Zhou
- Computer, Electrical, and Mathematical Sciences and Engineering (CEMSE) Division, Computational Bioscience Research Center (CBRC)King Abdullah University of Science and Technology (KAUST)Thuwal23955Saudi Arabia
| | - Zhongxiao Li
- Computer, Electrical, and Mathematical Sciences and Engineering (CEMSE) Division, Computational Bioscience Research Center (CBRC)King Abdullah University of Science and Technology (KAUST)Thuwal23955Saudi Arabia
| | - Juexiao Zhou
- Department of BiologySouthern University of Science and TechnologyShenzhen518055China
| | - Haoyang Li
- Cancer Systems Biology Center, China–Japan Union HospitalJilin UniversityChangchun130031China
| | | | - Yuxin Huang
- Heilongjiang Tuomeng Technology Company Ltd.Harbin150040China
| | - Dexuan Xie
- Department of Computer TomographyThe First Affiliated Hospital of Harbin Medical UniversityHarbin150001China
| | - Lintao Zhao
- Department of Computer TomographyThe First Hospital of Harbin Medical UniversityHarbin150010China
| | - Ming Fan
- Institute of Biomedical Engineering and Instrumentation, Hangzhou Dianzi UniversityHangzhou310018China
| | - Shahrukh Hashmi
- Oncology CenterKing Faisal Specialist Hospital and Research CenterRiyadh11211Saudi Arabia
| | - Faisal Abdelkareem
- Department Medical ImagingKing Faisal Specialist Hospital and Research CenterRiyadh11211Saudi Arabia
| | - Riham Eiada
- Department Medical ImagingKing Faisal Specialist Hospital and Research CenterRiyadh11211Saudi Arabia
| | - Xigang Xiao
- Department of Computer TomographyThe First Affiliated Hospital of Harbin Medical UniversityHarbin150001China
| | - Lihua Li
- Institute of Biomedical Engineering and Instrumentation, Hangzhou Dianzi UniversityHangzhou310018China
| | - Zhaowen Qiu
- Institute of Information and Computer Engineering, Northeast Forestry UniversityHarbin150040China
| | - Xin Gao
- Computer, Electrical, and Mathematical Sciences and Engineering (CEMSE) Division, Computational Bioscience Research Center (CBRC)King Abdullah University of Science and Technology (KAUST)Thuwal23955Saudi Arabia
| |
Collapse
|