201
|
An Exploration into the Detection of COVID-19 from Chest X-ray Scans Using the xRGM-NET Convolutional Neural Network. TECHNOLOGIES 2021. [DOI: 10.3390/technologies9040098] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
COVID-19 has spread rapidly across the world since late 2019. As of December, 2021, there are over 250 million documented COVID-19 cases and over 5 million deaths worldwide, which have caused businesses, schools, and government operations to shut down. The most common method of detecting COVID-19 is the RT-PCR swab test, which suffers from a high false-negative rate and a very slow turnaround for results, often up to two weeks. Because of this, specialists often manually review X-ray images of the lungs to detect the presence of COVID-19 with up to 97% accuracy. Neural network algorithms greatly accelerate this review process, analyzing hundreds of X-rays in seconds. Using the Cohen COVID-19 X-ray Database and the NIH ChestX-ray8 Database, we trained and constructed the xRGM-NET convolutional neural network (CNN) to detect COVID-19 in X-ray scans of the lungs. To further aid medical professionals in the manual review of X-rays, we implemented the CNN activation mapping technique Score-CAM, which generates a heat map over an X-ray to illustrate which areas in the scan are most influential over the ultimate diagnosis. xRGM-NET achieved an overall classification accuracy of 97% with a sensitivity of 94% and specificity of 97%. Lightweight models like xRGM-NET can serve to improve the efficiency and accuracy of COVID-19 detection in developing countries or rural areas. In this paper, we report on our model and methods that were developed as part of a STEM enrichment summer program for high school students. We hope that our model and methods will allow other researchers to create lightweight and accurate models as more COVID-19 X-ray scans become available.
Collapse
|
202
|
Mamalakis M, Swift AJ, Vorselaars B, Ray S, Weeks S, Ding W, Clayton RH, Mackenzie LS, Banerjee A. DenResCov-19: A deep transfer learning network for robust automatic classification of COVID-19, pneumonia, and tuberculosis from X-rays. Comput Med Imaging Graph 2021; 94:102008. [PMID: 34763146 PMCID: PMC8539634 DOI: 10.1016/j.compmedimag.2021.102008] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2021] [Revised: 09/22/2021] [Accepted: 10/18/2021] [Indexed: 12/05/2022]
Abstract
The global pandemic of coronavirus disease 2019 (COVID-19) is continuing to have a significant effect on the well-being of the global population, thus increasing the demand for rapid testing, diagnosis, and treatment. As COVID-19 can cause severe pneumonia, early diagnosis is essential for correct treatment, as well as to reduce the stress on the healthcare system. Along with COVID-19, other etiologies of pneumonia and Tuberculosis (TB) constitute additional challenges to the medical system. Pneumonia (viral as well as bacterial) kills about 2 million infants every year and is consistently estimated as one of the most important factor of childhood mortality (according to the World Health Organization). Chest X-ray (CXR) and computed tomography (CT) scans are the primary imaging modalities for diagnosing respiratory diseases. Although CT scans are the gold standard, they are more expensive, time consuming, and are associated with a small but significant dose of radiation. Hence, CXR have become more widespread as a first line investigation. In this regard, the objective of this work is to develop a new deep transfer learning pipeline, named DenResCov-19, to diagnose patients with COVID-19, pneumonia, TB or healthy based on CXR images. The pipeline consists of the existing DenseNet-121 and the ResNet-50 networks. Since the DenseNet and ResNet have orthogonal performances in some instances, in the proposed model we have created an extra layer with convolutional neural network (CNN) blocks to join these two models together to establish superior performance as compared to the two individual networks. This strategy can be applied universally in cases where two competing networks are observed. We have tested the performance of our proposed network on two-class (pneumonia and healthy), three-class (COVID-19 positive, healthy, and pneumonia), as well as four-class (COVID-19 positive, healthy, TB, and pneumonia) classification problems. We have validated that our proposed network has been able to successfully classify these lung-diseases on our four datasets and this is one of our novel findings. In particular, the AUC-ROC are 99.60, 96.51, 93.70, 96.40% and the F1 values are 98.21, 87.29, 76.09, 83.17% on our Dataset X-Ray 1, 2, 3, and 4 (DXR1, DXR2, DXR3, DXR4), respectively.
Collapse
Affiliation(s)
- Michail Mamalakis
- Department of Computer Science, University of Sheffield, Sheffield, UK; Insigneo Institute for in-silico Medicine, Sheffield, UK.
| | - Andrew J Swift
- Insigneo Institute for in-silico Medicine, Sheffield, UK; Department of Infection, Immunity & Cardiovascular Disease, University of Sheffield, Sheffield, UK
| | - Bart Vorselaars
- School of Mathematics and Physics, University of Lincoln, Brayford Pool, Lincoln LN6 7TS, UK
| | - Surajit Ray
- School of Mathematics and Statistics, University of Glasgow, Glasgow G12 8QW, UK
| | - Simonne Weeks
- School of Applied Sciences, University of Brighton, Brighton BN2 4GJ, UK
| | - Weiping Ding
- School of Information Science and Technology, Nantong University, Nantong 226019, China
| | - Richard H Clayton
- Department of Computer Science, University of Sheffield, Sheffield, UK; Insigneo Institute for in-silico Medicine, Sheffield, UK
| | - Louise S Mackenzie
- School of Applied Sciences, University of Brighton, Brighton BN2 4GJ, UK
| | - Abhirup Banerjee
- Division of Cardiovascular Medicine, Radcliffe Department of Medicine, University of Oxford, Oxford OX3 9DU, UK; Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford OX3 7DQ, UK.
| |
Collapse
|
203
|
Bui LM, Thi Thu Phung H, Ho Thi TT, Singh V, Maurya R, Khambhati K, Wu CC, Uddin MJ, Trung DM, Chu DT. Recent findings and applications of biomedical engineering for COVID-19 diagnosis: a critical review. Bioengineered 2021; 12:8594-8613. [PMID: 34607509 PMCID: PMC8806999 DOI: 10.1080/21655979.2021.1987821] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Accepted: 09/28/2021] [Indexed: 12/23/2022] Open
Abstract
COVID-19 is one of the most severe global health crises that humanity has ever faced. Researchers have restlessly focused on developing solutions for monitoring and tracing the viral culprit, SARS-CoV-2, as vital steps to break the chain of infection. Even though biomedical engineering (BME) is considered a rising field of medical sciences, it has demonstrated its pivotal role in nurturing the maturation of COVID-19 diagnostic technologies. Within a very short period of time, BME research applied to COVID-19 diagnosis has advanced with ever-increasing knowledge and inventions, especially in adapting available virus detection technologies into clinical practice and exploiting the power of interdisciplinary research to design novel diagnostic tools or improve the detection efficiency. To assist the development of BME in COVID-19 diagnosis, this review highlights the most recent diagnostic approaches and evaluates the potential of each research direction in the context of the pandemic.
Collapse
Affiliation(s)
- Le Minh Bui
- NTT Hi-Tech Institute, Nguyen Tat Thanh University, Ho Chi Minh City, Vietnam
- Department of Biology, Faculty of Science and Technology, Universitas Airlangga, Surabaya, Indonesia
| | - Huong Thi Thu Phung
- NTT Hi-Tech Institute, Nguyen Tat Thanh University, Ho Chi Minh City, Vietnam
| | - Thuy-Tien Ho Thi
- Center for Biomedicine and Community Health, International School, Vietnam National University, Hanoi, Vietnam
| | - Vijai Singh
- Department of Biosciences, School of Science, Indrashil University, Mehsana, Gujarat, India
| | - Rupesh Maurya
- Department of Biosciences, School of Science, Indrashil University, Mehsana, Gujarat, India
| | - Khushal Khambhati
- Department of Biosciences, School of Science, Indrashil University, Mehsana, Gujarat, India
| | - Chia-Ching Wu
- Department of Cell Biology and Anatomy, College of Medicine, National Cheng Kung University, Tainan, Taiwan
| | - Md Jamal Uddin
- ABEx Bio-Research Center, East Azampur, Dhaka, Bangladesh
- Graduate School of Pharmaceutical Sciences, College of Pharmacy, Ewha Womans University, Seoul, Republic of Korea
| | - Do Minh Trung
- Institute of Biomedicine and Pharmacy, Vietnam Military Medical University, Hanoi, Vietnam
| | - Dinh Toi Chu
- Center for Biomedicine and Community Health, International School, Vietnam National University, Hanoi, Vietnam
- Department of Cell Biology and Anatomy, College of Medicine, National Cheng Kung University, Tainan, Taiwan
| |
Collapse
|
204
|
Rezaeijo SM, Ghorvei M, Abedi-Firouzjah R, Mojtahedi H, Entezari Zarch H. Detecting COVID-19 in chest images based on deep transfer learning and machine learning algorithms. EGYPTIAN JOURNAL OF RADIOLOGY AND NUCLEAR MEDICINE 2021. [PMCID: PMC8193170 DOI: 10.1186/s43055-021-00524-y] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
Abstract
Background
This study aimed to propose an automatic prediction of COVID-19 disease using chest CT images based on deep transfer learning models and machine learning (ML) algorithms.
Results
The dataset consisted of 5480 samples in two classes, including 2740 CT chest images of patients with confirmed COVID-19 and 2740 images of suspected cases was assessed. The DenseNet201 model has obtained the highest training with an accuracy of 100%. In combining pre-trained models with ML algorithms, the DenseNet201 model and KNN algorithm have received the best performance with an accuracy of 100%. Created map by t-SNE in the DenseNet201 model showed not any points clustered with the wrong class.
Conclusions
The mentioned models can be used in remote places, in low- and middle-income countries, and laboratory equipment with limited resources to overcome a shortage of radiologists.
Collapse
|
205
|
Tan W, Liu P, Li X, Liu Y, Zhou Q, Chen C, Gong Z, Yin X, Zhang Y. Classification of COVID-19 pneumonia from chest CT images based on reconstructed super-resolution images and VGG neural network. Health Inf Sci Syst 2021; 9:10. [PMID: 33643612 PMCID: PMC7896179 DOI: 10.1007/s13755-021-00140-0] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2020] [Accepted: 01/16/2021] [Indexed: 12/13/2022] Open
Abstract
The COVID-19 coronavirus has spread rapidly around the world and has caused global panic. Chest CT images play a major role in confirming positive COVID-19 patients. The computer aided diagnosis of COVID-19 from CT images based on artificial intelligence have been developed and deployed in some hospitals. But environmental influences and the movement of lung will affect the image quality, causing the lung parenchyma and pneumonia area unclear in CT images. Therefore, the performance of COVID-19's artificial intelligence diagnostic algorithm is reduced. If chest CT images are reconstructed, the accuracy and performance of the aided diagnostic algorithm may be improved. In this paper, a new aided diagnostic algorithm for COVID-19 based on super-resolution reconstructed images and convolutional neural network is presented. Firstly, the SRGAN neural network is used to reconstruct super-resolution images from original chest CT images. Then COVID-19 images and Non-COVID-19 images are classified from super-resolution chest CT images by VGG16 neural network. Finally, the performance of this method is verified by the pubic COVID-CT dataset and compared with other aided diagnosis methods of COVID-19. The experimental results show that improving the data quality through SRGAN neural network can greatly improve the final classification accuracy when the data quality is low. This proves that this method can obtain high accuracy, sensitivity and specificity in the examined test image datasets and has similar performance to other state-of-the-art deep learning aided algorithms.
Collapse
Affiliation(s)
- Wenjun Tan
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Pan Liu
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Xiaoshuo Li
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Yao Liu
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Qinghua Zhou
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Chao Chen
- Key Laboratory of Complex System Control Theory and Application, Tianjin University of Technology, Tianjin, 300384 China
| | - Zhaoxuan Gong
- Department of Computer science, Shenyang Aerospace University, Shenyang, 110136 Liaoning China
| | - Xiaoxia Yin
- Cyberspace Institute of Advanced Technology, Guangzhou University, Guangzhou, 510006 China
| | - Yanchun Zhang
- Centre for Applied Informatics, College of Engineering and Science, Victoria University, Melbourne, VIC 8001 Australia
| |
Collapse
|
206
|
Saif AFM, Imtiaz T, Rifat S, Shahnaz C, Zhu WP, Ahmad MO. CapsCovNet: A Modified Capsule Network to Diagnose COVID-19 From Multimodal Medical Imaging. IEEE TRANSACTIONS ON ARTIFICIAL INTELLIGENCE 2021; 2:608-617. [PMID: 35582431 PMCID: PMC8851432 DOI: 10.1109/tai.2021.3104791] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/23/2021] [Accepted: 08/11/2021] [Indexed: 12/26/2022]
Abstract
Since the end of 2019, novel coronavirus disease (COVID-19) has brought about a plethora of unforeseen changes to the world as we know it. Despite our ceaseless fight against it, COVID-19 has claimed millions of lives, and the death toll exacerbated due to its extremely contagious and fast-spreading nature. To control the spread of this highly contagious disease, a rapid and accurate diagnosis can play a very crucial part. Motivated by this context, a parallelly concatenated convolutional block-based capsule network is proposed in this article as an efficient tool to diagnose the COVID-19 patients from multimodal medical images. Concatenation of deep convolutional blocks of different filter sizes allows us to integrate discriminative spatial features by simultaneously changing the receptive field and enhances the scalability of the model. Moreover, concatenation of capsule layers strengthens the model to learn more complex representation by presenting the information in a fine to coarser manner. The proposed model is evaluated on three benchmark datasets, in which two of them are chest radiograph datasets and the rest is an ultrasound imaging dataset. The architecture that we have proposed through extensive analysis and reasoning achieved outstanding performance in COVID-19 detection task, which signifies the potentiality of the proposed model.
Collapse
Affiliation(s)
- A F M Saif
- Department of Electrical and Electronic EngineeringBangladesh University of Engineering and Technology Dhaka 1000 Bangladesh
| | - Tamjid Imtiaz
- Department of Electrical and Electronic EngineeringBangladesh University of Engineering and Technology Dhaka 1000 Bangladesh
| | - Shahriar Rifat
- Department of Electrical and Electronic EngineeringBangladesh University of Engineering and Technology Dhaka 1000 Bangladesh
| | - Celia Shahnaz
- Department of Electrical and Electronic EngineeringBangladesh University of Engineering and Technology Dhaka 1000 Bangladesh
| | - Wei-Ping Zhu
- Department of Electrical and Computer EngineeringConcordia University Montreal QC H3G 2W1 Canada
| | - M Omair Ahmad
- Department of Electrical and Computer EngineeringConcordia University Montreal QC H3G 2W1 Canada
| |
Collapse
|
207
|
Halder A, Datta B. COVID-19 detection from lung CT-scan images using transfer learning approach. MACHINE LEARNING: SCIENCE AND TECHNOLOGY 2021. [DOI: 10.1088/2632-2153/abf22c] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022] Open
Abstract
Abstract
Since the onset of 2020, the spread of coronavirus disease (COVID-19) has rapidly accelerated worldwide into a state of severe pandemic. COVID-19 has infected more than 29 million people and caused more than 900 thousand deaths at the time of writing. Since it is highly contagious, it causes explosive community transmission. Thus, health care delivery has been disrupted and compromised by the lack of testing kits. COVID-19-infected patients show severe acute respiratory syndrome. Meanwhile, the scientific community has been involved in the implementation of deep learning (DL) techniques to diagnose COVID-19 using computed tomography (CT) lung scans, since CT is a pertinent screening tool due to its higher sensitivity in recognizing early pneumonic changes. However, large datasets of CT-scan images are not publicly available due to privacy concerns and obtaining very accurate models has become difficult. Thus, to overcome this drawback, transfer-learning pre-trained models are used in the proposed methodology to classify COVID-19 (positive) and COVID-19 (negative) patients. We describe the development of a DL framework that includes pre-trained models (DenseNet201, VGG16, ResNet50V2, and MobileNet) as its backbone, known as KarNet. To extensively test and analyze the framework, each model was trained on original (i.e. unaugmented) and manipulated (i.e. augmented) datasets. Among the four pre-trained models of KarNet, the one that used DenseNet201 demonstrated excellent diagnostic ability, with AUC scores of 1.00 and 0.99 for models trained on unaugmented and augmented data sets, respectively. Even after considerable distortion of the images (i.e. the augmented dataset) DenseNet201 achieved an accuracy of 97% for the test dataset, followed by ResNet50V2, MobileNet, and VGG16 (which achieved accuracies of 96%, 95%, and 94%, respectively).
Collapse
|
208
|
Sahoo P, Roy I, Ahlawat R, Irtiza S, Khan L. Potential diagnosis of COVID-19 from chest X-ray and CT findings using semi-supervised learning. Phys Eng Sci Med 2021; 45:31-42. [PMID: 34780042 PMCID: PMC8591440 DOI: 10.1007/s13246-021-01075-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Accepted: 10/30/2021] [Indexed: 12/11/2022]
Abstract
COVID-19 is an infectious disease, which has adversely affected public health and the economy across the world. On account of the highly infectious nature of the disease, rapid automated diagnosis of COVID-19 is urgently needed. A few recent findings suggest that chest X-rays and CT scans can be used by machine learning for the diagnosis of COVID-19. Herein, we employed semi-supervised learning (SSL) approaches to detect COVID-19 cases accurately by analyzing digital chest X-rays and CT scans. On a relatively small COVID-19 radiography dataset, which contains only 219 COVID-19 positive images, 1341 normal and 1345 viral pneumonia images, our algorithm, COVIDCon, which takes advantage of data augmentation, consistency regularization, and multicontrastive learning, attains 97.07% average class prediction accuracy, with 1000 labeled images, which is 7.65% better than the next best SSL method, virtual adversarial training. COVIDCon performs even better on a larger COVID-19 CT Scan dataset that contains 82,767 images. It achieved an excellent accuracy of 99.13%, at 20,000 labels, which is 6.45% better than the next best pseudo-labeling approach. COVIDCon outperforms other state-of-the-art algorithms at every label that we have investigated. These results demonstrate COVIDCon as the benchmark SSL algorithm for potential diagnosis of COVID-19 from chest X-rays and CT-Scans. Furthermore, COVIDCon performs exceptionally well in identifying COVID-19 positive cases from a completely unseen repository with a confirmed COVID-19 case history. COVIDCon, may provide a fast, accurate, and reliable method for screening COVID-19 patients.
Collapse
Affiliation(s)
- Pracheta Sahoo
- Department of Computer Science, The University of Texas at Dallas, Richardson, TX, 75080, USA.
| | - Indranil Roy
- Department of Chemistry, Northwestern University, 2145 Sheridan Road, Evanston, IL, 60208-3113, USA
| | - Randeep Ahlawat
- Department of Computer Science, The University of Texas at Dallas, Richardson, TX, 75080, USA
| | - Saquib Irtiza
- Department of Computer Science, The University of Texas at Dallas, Richardson, TX, 75080, USA
| | - Latifur Khan
- Department of Computer Science, The University of Texas at Dallas, Richardson, TX, 75080, USA
| |
Collapse
|
209
|
Feng YZ, Liu S, Cheng ZY, Quiroz JC, Rezazadegan D, Chen PK, Lin QT, Qian L, Liu XF, Berkovsky S, Coiera E, Song L, Qiu XM, Cai XR. Severity Assessment and Progression Prediction of COVID-19 Patients Based on the LesionEncoder Framework and Chest CT. INFORMATION 2021; 12:471. [DOI: 10.3390/info12110471] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
Automatic severity assessment and progression prediction can facilitate admission, triage, and referral of COVID-19 patients. This study aims to explore the potential use of lung lesion features in the management of COVID-19, based on the assumption that lesion features may carry important diagnostic and prognostic information for quantifying infection severity and forecasting disease progression. A novel LesionEncoder framework is proposed to detect lesions in chest CT scans and to encode lesion features for automatic severity assessment and progression prediction. The LesionEncoder framework consists of a U-Net module for detecting lesions and extracting features from individual CT slices, and a recurrent neural network (RNN) module for learning the relationship between feature vectors and collectively classifying the sequence of feature vectors. Chest CT scans of two cohorts of COVID-19 patients from two hospitals in China were used for training and testing the proposed framework. When applied to assessing severity, this framework outperformed baseline methods achieving a sensitivity of 0.818, specificity of 0.952, accuracy of 0.940, and AUC of 0.903. It also outperformed the other tested methods in disease progression prediction with a sensitivity of 0.667, specificity of 0.838, accuracy of 0.829, and AUC of 0.736. The LesionEncoder framework demonstrates a strong potential for clinical application in current COVID-19 management, particularly in automatic severity assessment of COVID-19 patients. This framework also has a potential for other lesion-focused medical image analyses.
Collapse
Affiliation(s)
- You-Zhen Feng
- Medical Imaging Centre, The First Affiliated Hospital of Jinan University, Guangzhou 510630, China
| | - Sidong Liu
- Centre for Health Informatics, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney 2113, Australia
| | - Zhong-Yuan Cheng
- Medical Imaging Centre, The First Affiliated Hospital of Jinan University, Guangzhou 510630, China
| | - Juan C. Quiroz
- Centre for Big Data Research in Health, University of New South Wales, Sydney 1466, Australia
| | - Dana Rezazadegan
- Department of Computer Science and Software Engineering, Swinburne University of Technology, Melbourne 3000, Australia
| | - Ping-Kang Chen
- Medical Imaging Centre, The First Affiliated Hospital of Jinan University, Guangzhou 510630, China
| | - Qi-Ting Lin
- Medical Imaging Centre, The First Affiliated Hospital of Jinan University, Guangzhou 510630, China
| | - Long Qian
- Department of Biomedical Engineering, Peking University, Beijing 100871, China
| | - Xiao-Fang Liu
- Tianjin Key Laboratory of Intelligent Robotics, Institute of Robotics and Automatic Information System, College of Artificial Intelligence, Nankai University, Tianjin 300350, China
| | - Shlomo Berkovsky
- Centre for Health Informatics, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney 2113, Australia
| | - Enrico Coiera
- Centre for Health Informatics, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney 2113, Australia
| | - Lei Song
- Department of Radiology, Xiangyang Central Hospital, Affiliated Hospital of Hubei University of Arts and Science, Xiangyang 441003, China
| | - Xiao-Ming Qiu
- Department of Radiology, Huangshi Central Hospital, Affiliated Hospital of Hubei Polytechnic University, Edong Healthcare Group, Huangshi 435002, China
| | - Xiang-Ran Cai
- Medical Imaging Centre, The First Affiliated Hospital of Jinan University, Guangzhou 510630, China
| |
Collapse
|
210
|
Teodoro AAM, Silva DH, Saadi M, Okey OD, Rosa RL, Otaibi SA, Rodríguez DZ. An Analysis of Image Features Extracted by CNNs to Design Classification Models for COVID-19 and Non-COVID-19. JOURNAL OF SIGNAL PROCESSING SYSTEMS 2021; 95:101-113. [PMID: 34777680 PMCID: PMC8572648 DOI: 10.1007/s11265-021-01714-7] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Revised: 10/05/2021] [Accepted: 10/13/2021] [Indexed: 05/11/2023]
Abstract
The SARS-CoV-2 virus causes a respiratory disease in humans, known as COVID-19. The confirmatory diagnostic of this disease occurs through the real-time reverse transcription and polymerase chain reaction test (RT-qPCR). However, the period of obtaining the results limits the application of the mass test. Thus, chest X-ray computed tomography (CT) images are analyzed to help diagnose the disease. However, during an outbreak of a disease that causes respiratory problems, radiologists may be overwhelmed with analyzing medical images. In the literature, some studies used feature extraction techniques based on CNNs, with classification models to identify COVID-19 and non-COVID-19. This work compare the performance of applying pre-trained CNNs in conjunction with classification methods based on machine learning algorithms. The main objective is to analyze the impact of the features extracted by CNNs, in the construction of models to classify COVID-19 and non-COVID-19. A SARS-CoV-2 CT data-set is used in experimental tests. The CNNs implemented are visual geometry group (VGG-16 and VGG-19), inception V3 (IV3), and EfficientNet-B0 (EB0). The classification methods were k-nearest neighbor (KNN), support vector machine (SVM), and explainable deep neural networks (xDNN). In the experiments, the best results were obtained by the EfficientNet model used to extract data and the SVM with an RBF kernel. This approach achieved an average performance of 0.9856 in the precision macro, 0.9853 in the sensitivity macro, 0.9853 in the specificity macro, and 0.9853 in the F1 score macro.
Collapse
Affiliation(s)
- Arthur A M Teodoro
- Department of Computer Science, Federal University of Lavras, Lavras, MG Brazil
| | - Douglas H Silva
- Department of Computer Science, Federal University of Lavras, Lavras, MG Brazil
| | - Muhammad Saadi
- Department of Electrical Engineering, University of Central Punjab, Lahore, 54000 Pakistan
| | - Ogobuchi D Okey
- Department of Systems Engineering and Automation, Federal University of Lavras, Lavras, MG Brazil
| | - Renata L Rosa
- Department of Computer Science, Federal University of Lavras, Lavras, MG Brazil
| | - Sattam Al Otaibi
- Department of Electrical Engineering, College of Engineering, Taif University, Taif, 21944 Saudi Arabia
| | | |
Collapse
|
211
|
Khan MA, Alhaisoni M, Tariq U, Hussain N, Majid A, Damaševičius R, Maskeliūnas R. COVID-19 Case Recognition from Chest CT Images by Deep Learning, Entropy-Controlled Firefly Optimization, and Parallel Feature Fusion. SENSORS (BASEL, SWITZERLAND) 2021; 21:7286. [PMID: 34770595 PMCID: PMC8588229 DOI: 10.3390/s21217286] [Citation(s) in RCA: 48] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/26/2021] [Revised: 10/28/2021] [Accepted: 10/29/2021] [Indexed: 12/12/2022]
Abstract
In healthcare, a multitude of data is collected from medical sensors and devices, such as X-ray machines, magnetic resonance imaging, computed tomography (CT), and so on, that can be analyzed by artificial intelligence methods for early diagnosis of diseases. Recently, the outbreak of the COVID-19 disease caused many deaths. Computer vision researchers support medical doctors by employing deep learning techniques on medical images to diagnose COVID-19 patients. Various methods were proposed for COVID-19 case classification. A new automated technique is proposed using parallel fusion and optimization of deep learning models. The proposed technique starts with a contrast enhancement using a combination of top-hat and Wiener filters. Two pre-trained deep learning models (AlexNet and VGG16) are employed and fine-tuned according to target classes (COVID-19 and healthy). Features are extracted and fused using a parallel fusion approach-parallel positive correlation. Optimal features are selected using the entropy-controlled firefly optimization method. The selected features are classified using machine learning classifiers such as multiclass support vector machine (MC-SVM). Experiments were carried out using the Radiopaedia database and achieved an accuracy of 98%. Moreover, a detailed analysis is conducted and shows the improved performance of the proposed scheme.
Collapse
Affiliation(s)
- Muhammad Attique Khan
- Department of Computer Science, HITEC University, Taxila 47080, Pakistan; (M.A.K.); (N.H.); (A.M.)
| | - Majed Alhaisoni
- College of Computer Science and Engineering, University of Ha’il, Ha’il 55211, Saudi Arabia;
| | - Usman Tariq
- Information Systems Department, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al Khraj 11942, Saudi Arabia;
| | - Nazar Hussain
- Department of Computer Science, HITEC University, Taxila 47080, Pakistan; (M.A.K.); (N.H.); (A.M.)
| | - Abdul Majid
- Department of Computer Science, HITEC University, Taxila 47080, Pakistan; (M.A.K.); (N.H.); (A.M.)
| | - Robertas Damaševičius
- Faculty of Applied Mathematics, Silesian University of Technology, 44-100 Gliwice, Poland
| | - Rytis Maskeliūnas
- Department of Multimedia Engineering, Kaunas University of Technology, 51368 Kaunas, Lithuania;
| |
Collapse
|
212
|
Wang Q, Guo Y, Ji T, Wang X, Hu B, Li P. Toward Combatting COVID-19: A Risk Assessment System. IEEE INTERNET OF THINGS JOURNAL 2021; 8:15953-15964. [PMID: 35782188 PMCID: PMC8768990 DOI: 10.1109/jiot.2021.3070042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/10/2021] [Revised: 02/28/2021] [Accepted: 03/16/2021] [Indexed: 05/11/2023]
Abstract
The coronavirus disease 2019 (COVID-19) has rapidly become a significant public health emergency all over the world since it was first identified in Wuhan, China, in December 2019. Until today, massive disease-related data have been collected, both manually and through the Internet of Medical Things (IoMT), which can be potentially used to analyze the spread of the disease. On the other hand, with the help of IoMT, the analysis results of the current status of COVID-19 can be delivered to people in real time to enable situational awareness, which may help mitigate the disease spread in communities. However, current accessible data on COVID-19 are mostly at a macrolevel, such as for each state, county, or metropolitan area. For fine-grained areas, such as for each city, community, or geographical coordinate, COVID-19 data are usually not available, which prevents us from obtaining information on the disease spread in closer neighborhoods around us. To address this problem, in this article, we propose a two-level risk assessment system. In particular, we define a "risk index." Then, we develop a risk assessment model, called MK-DNN, by taking advantage of the multikernel density estimation (MKDE) and deep neural network (DNN). We train MK-DNN at the macrolevel (for each metro area), which subsequently enables us to obtain the risk indices at the microlevel (for each geographic coordinate). Moreover, a heuristic validation method is further designed to help validate the obtained microlevel risk indices. Simulations conducted on real-world data demonstrate the accuracy and validity of our proposed risk assessment system.
Collapse
Affiliation(s)
- Qianlong Wang
- Department of Computer and InformationSciencesTowson UniversityTowsonMD21252USA
| | - Yifan Guo
- Department of Electrical, Computer, and Systems EngineeringCase Western Reserve UniversityClevelandOH44106USA
| | - Tianxi Ji
- Department of Electrical, Computer, and Systems EngineeringCase Western Reserve UniversityClevelandOH44106USA
| | - Xufei Wang
- Department of Electrical, Computer, and Systems EngineeringCase Western Reserve UniversityClevelandOH44106USA
| | - Bingfang Hu
- School of MedicineCase Western Reserve UniversityClevelandOH44106USA
| | - Pan Li
- Department of Electrical, Computer, and Systems EngineeringCase Western Reserve UniversityClevelandOH44106USA
| |
Collapse
|
213
|
Chetoui M, Akhloufi MA. Automated Detection of COVID-19 Cases using Recent Deep Convolutional Neural Networks and CT images . ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:3297-3300. [PMID: 34891945 DOI: 10.1109/embc46164.2021.9629689] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
COVID-19 is an acute severe respiratory disease caused by a novel coronavirus SARS-CoV-2. After its first appearance in Wuhan (China), it spread rapidly across the world and became a pandemic. It had a devastating effect on everyday life, public health, and the world economy. The use of advanced artificial intelligence (AI) techniques combined with radiological imaging can be helpful in speeding-up the detection of this disease. In this study, we propose the development of recent deep learning models for automatic COVID-19 detection using computed tomography (CT) images. The proposed models are fine-tuned and optimized to provide accurate results for multiclass classification of COVID-19 vs. Community Acquired Pneumonia (CAP) vs. Normal cases. Tests were conducted both at the image and patient-level and show that the proposed algorithms achieve very high scores. In addition, an explainability algorithm was developed to help visualize the symptoms of the disease detected by the best performing deep model.
Collapse
|
214
|
Mondal MRH, Bharati S, Podder P. CO-IRv2: Optimized InceptionResNetV2 for COVID-19 detection from chest CT images. PLoS One 2021; 16:e0259179. [PMID: 34710175 PMCID: PMC8553063 DOI: 10.1371/journal.pone.0259179] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Accepted: 10/15/2021] [Indexed: 02/05/2023] Open
Abstract
This paper focuses on the application of deep learning (DL) in the diagnosis of coronavirus disease (COVID-19). The novelty of this work is in the introduction of optimized InceptionResNetV2 for COVID-19 (CO-IRv2) method. A part of the CO-IRv2 scheme is derived from the concepts of InceptionNet and ResNet with hyperparameter tuning, while the remaining part is a new architecture consisting of a global average pooling layer, batch normalization, dense layers, and dropout layers. The proposed CO-IRv2 is applied to a new dataset of 2481 computed tomography (CT) images formed by collecting two independent datasets. Data resizing and normalization are performed, and the evaluation is run up to 25 epochs. Various performance metrics, including precision, recall, accuracy, F1-score, area under the receiver operating characteristics (AUC) curve are used as performance metrics. The effectiveness of three optimizers known as Adam, Nadam and RMSProp are evaluated in classifying suspected COVID-19 patients and normal people. Results show that for CO-IRv2 and for CT images, the obtained accuracies of Adam, Nadam and RMSProp optimizers are 94.97%, 96.18% and 96.18%, respectively. Furthermore, it is shown here that for the case of CT images, CO-IRv2 with Nadam optimizer has better performance than existing DL algorithms in the diagnosis of COVID-19 patients. Finally, CO-IRv2 is applied to an X-ray dataset of 1662 images resulting in a classification accuracy of 99.40%.
Collapse
Affiliation(s)
- M. Rubaiyat Hossain Mondal
- Institute of Information and Communication Technology, Bangladesh University of Engineering and Technology, Dhaka, Bangladesh
| | - Subrato Bharati
- Institute of Information and Communication Technology, Bangladesh University of Engineering and Technology, Dhaka, Bangladesh
| | - Prajoy Podder
- Institute of Information and Communication Technology, Bangladesh University of Engineering and Technology, Dhaka, Bangladesh
| |
Collapse
|
215
|
Kaur J, Kaur P. Outbreak COVID-19 in Medical Image Processing Using Deep Learning: A State-of-the-Art Review. ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING : STATE OF THE ART REVIEWS 2021; 29:2351-2382. [PMID: 34690493 PMCID: PMC8525064 DOI: 10.1007/s11831-021-09667-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/11/2021] [Accepted: 10/01/2021] [Indexed: 06/13/2023]
Abstract
From the month of December-19, the outbreak of Coronavirus (COVID-19) triggered several deaths and overstated every aspect of individual health. COVID-19 has been designated as a pandemic by World Health Organization. The circumstances placed serious trouble on every country worldwide, particularly with health arrangements and time-consuming responses. The increase in the positive cases of COVID-19 globally spread every day. The quantity of accessible diagnosing kits is restricted because of complications in detecting the existence of the illness. Fast and correct diagnosis of COVID-19 is a timely requirement for the prevention and controlling of the pandemic through suitable isolation and medicinal treatment. The significance of the present work is to discuss the outline of the deep learning techniques with medical imaging such as outburst prediction, virus transmitted indications, detection and treatment aspects, vaccine availability with remedy research. Abundant image resources of medical imaging as X-rays, Computed Tomography Scans, Magnetic Resonance imaging, formulate deep learning high-quality methods to fight against the pandemic COVID-19. The review presents a comprehensive idea of deep learning and its related applications in healthcare received over the past decade. At the last, some issues and confrontations to control the health crisis and outbreaks have been introduced. The progress in technology has contributed to developing individual's lives. The problems faced by the radiologists during medical imaging techniques and deep learning approaches for diagnosing the COVID-19 infections have been also discussed.
Collapse
Affiliation(s)
- Jaspreet Kaur
- Department of Computer Engineering & Technology, Guru Nanak Dev University, Amritsar, Punjab India
| | - Prabhpreet Kaur
- Department of Computer Engineering & Technology, Guru Nanak Dev University, Amritsar, Punjab India
| |
Collapse
|
216
|
Hou J, Xu J, Jiang L, Du S, Feng R, Zhang Y, Shan F, Xue X. Periphery-aware COVID-19 diagnosis with contrastive representation enhancement. PATTERN RECOGNITION 2021; 118:108005. [PMID: 33972808 PMCID: PMC8099585 DOI: 10.1016/j.patcog.2021.108005] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/04/2021] [Revised: 03/25/2021] [Accepted: 04/27/2021] [Indexed: 06/02/2023]
Abstract
Computer-aided diagnosis has been extensively investigated for more rapid and accurate screening during the outbreak of COVID-19 epidemic. However, the challenge remains to distinguish COVID-19 in the complex scenario of multi-type pneumonia classification and improve the overall diagnostic performance. In this paper, we propose a novel periphery-aware COVID-19 diagnosis approach with contrastive representation enhancement to identify COVID-19 from influenza-A (H1N1) viral pneumonia, community acquired pneumonia (CAP), and healthy subjects using chest CT images. Our key contributions include: 1) an unsupervised Periphery-aware Spatial Prediction (PSP) task which is designed to introduce important spatial patterns into deep networks; 2) an adaptive Contrastive Representation Enhancement (CRE) mechanism which can effectively capture the intra-class similarity and inter-class difference of various types of pneumonia. We integrate PSP and CRE to obtain the representations which are highly discriminative in COVID-19 screening. We evaluate our approach comprehensively on our constructed large-scale dataset and two public datasets. Extensive experiments on both volume-level and slice-level CT images demonstrate the effectiveness of our proposed approach with PSP and CRE for COVID-19 diagnosis.
Collapse
Affiliation(s)
- Junlin Hou
- School of Computer Science, Shanghai Key Lab of Intelligent Information Processing, Fudan University, Shanghai, China
| | - Jilan Xu
- School of Computer Science, Shanghai Key Lab of Intelligent Information Processing, Fudan University, Shanghai, China
| | - Longquan Jiang
- School of Computer Science, Shanghai Key Lab of Intelligent Information Processing, Fudan University, Shanghai, China
| | - Shanshan Du
- School of Information Science and Technology, Fudan University, Shanghai, China
| | - Rui Feng
- School of Computer Science, Shanghai Key Lab of Intelligent Information Processing, Fudan University, Shanghai, China
| | - Yuejie Zhang
- School of Computer Science, Shanghai Key Lab of Intelligent Information Processing, Fudan University, Shanghai, China
| | - Fei Shan
- Department of Radiology, Shanghai Public Health Clinical Center, Fudan University, Shanghai, China
| | - Xiangyang Xue
- School of Computer Science, Shanghai Key Lab of Intelligent Information Processing, Fudan University, Shanghai, China
| |
Collapse
|
217
|
Murugan R, Goel T, Mirjalili S, Chakrabartty DK. WOANet: Whale optimized deep neural network for the classification of COVID-19 from radiography images. Biocybern Biomed Eng 2021; 41:1702-1718. [PMID: 34720309 PMCID: PMC8536521 DOI: 10.1016/j.bbe.2021.10.004] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Revised: 10/02/2021] [Accepted: 10/08/2021] [Indexed: 12/23/2022]
Abstract
Coronavirus Diseases (COVID-19) is a new disease that will be declared a global pandemic in 2020. It is characterized by a constellation of traits like fever, dry cough, dyspnea, fatigue, chest pain, etc. Clinical findings have shown that the human chest Computed Tomography(CT) images can diagnose lung infection in most COVID-19 patients. Visual changes in CT scan due to COVID-19 is subjective and evaluated by radiologists for diagnosis purpose. Deep Learning (DL) can provide an automatic diagnosis tool to relieve radiologists' burden for quantitative analysis of CT scan images in patients. However, DL techniques face different training problems like mode collapse and instability. Deciding on training hyper-parameters to adjust the weight and biases of DL by a given CT image dataset is crucial for achieving the best accuracy. This paper combines the backpropagation algorithm and Whale Optimization Algorithm (WOA) to optimize such DL networks. Experimental results for the diagnosis of COVID-19 patients from a comprehensive COVID-CT scan dataset show the best performance compared to other recent methods. The proposed network architecture results were validated with the existing pre-trained network to prove the efficiency of the network.
Collapse
Affiliation(s)
- R Murugan
- Bio-Medical Imaging Laboratory(BIOMIL), Department of Electronics and communication Engineering, National Institute Of Technology Silchar, Assam 788010, India
| | - Tripti Goel
- Bio-Medical Imaging Laboratory(BIOMIL), Department of Electronics and communication Engineering, National Institute Of Technology Silchar, Assam 788010, India
| | - Seyedali Mirjalili
- Centre for Artificial Intelligence Research and Optimisation, Torrens University Australia, Fortitude Valley, Brisbane, QLD 4006, Australia
- Yonsei Frontier Lab, Yonsei University, Seoul, South Korea
| | | |
Collapse
|
218
|
Fusco R, Grassi R, Granata V, Setola SV, Grassi F, Cozzi D, Pecori B, Izzo F, Petrillo A. Artificial Intelligence and COVID-19 Using Chest CT Scan and Chest X-ray Images: Machine Learning and Deep Learning Approaches for Diagnosis and Treatment. J Pers Med 2021; 11:993. [PMID: 34683133 PMCID: PMC8540782 DOI: 10.3390/jpm11100993] [Citation(s) in RCA: 54] [Impact Index Per Article: 13.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2021] [Revised: 09/22/2021] [Accepted: 09/28/2021] [Indexed: 12/26/2022] Open
Abstract
OBJECTIVE To report an overview and update on Artificial Intelligence (AI) and COVID-19 using chest Computed Tomography (CT) scan and chest X-ray images (CXR). Machine Learning and Deep Learning Approaches for Diagnosis and Treatment were identified. METHODS Several electronic datasets were analyzed. The search covered the years from January 2019 to June 2021. The inclusion criteria were studied evaluating the use of AI methods in COVID-19 disease reporting performance results in terms of accuracy or precision or area under Receiver Operating Characteristic (ROC) curve (AUC). RESULTS Twenty-two studies met the inclusion criteria: 13 papers were based on AI in CXR and 10 based on AI in CT. The summarized mean value of the accuracy and precision of CXR in COVID-19 disease were 93.7% ± 10.0% of standard deviation (range 68.4-99.9%) and 95.7% ± 7.1% of standard deviation (range 83.0-100.0%), respectively. The summarized mean value of the accuracy and specificity of CT in COVID-19 disease were 89.1% ± 7.3% of standard deviation (range 78.0-99.9%) and 94.5 ± 6.4% of standard deviation (range 86.0-100.0%), respectively. No statistically significant difference in summarized accuracy mean value between CXR and CT was observed using the Chi square test (p value > 0.05). CONCLUSIONS Summarized accuracy of the selected papers is high but there was an important variability; however, less in CT studies compared to CXR studies. Nonetheless, AI approaches could be used in the identification of disease clusters, monitoring of cases, prediction of the future outbreaks, mortality risk, COVID-19 diagnosis, and disease management.
Collapse
Affiliation(s)
- Roberta Fusco
- IGEA SpA Medical Division—Oncology, Via Casarea 65, Casalnuovo di Napoli, 80013 Naples, Italy;
| | - Roberta Grassi
- Division of Radiology, Università Degli Studi Della Campania Luigi Vanvitelli, 80138 Naples, Italy; (R.G.); (F.G.)
- Italian Society of Medical and Interventional Radiology (SIRM), SIRM Foundation, 20122 Milan, Italy
| | - Vincenza Granata
- Division of Radiology, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Naples, Italy; (S.V.S.); (A.P.)
| | - Sergio Venanzio Setola
- Division of Radiology, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Naples, Italy; (S.V.S.); (A.P.)
| | - Francesca Grassi
- Division of Radiology, Università Degli Studi Della Campania Luigi Vanvitelli, 80138 Naples, Italy; (R.G.); (F.G.)
| | - Diletta Cozzi
- Division of Radiology, Azienda Ospedaliera Universitaria Careggi, 50134 Florence, Italy;
| | - Biagio Pecori
- Division of Radiotherapy and Innovative Technologies, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Naples, Italy;
| | - Francesco Izzo
- Division of Hepatobiliary Surgery, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Naples, Italy;
| | - Antonella Petrillo
- Division of Radiology, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Naples, Italy; (S.V.S.); (A.P.)
| |
Collapse
|
219
|
Chahar S, Roy PK. COVID-19: A Comprehensive Review of Learning Models. ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING : STATE OF THE ART REVIEWS 2021; 29:1915-1940. [PMID: 34566404 PMCID: PMC8449694 DOI: 10.1007/s11831-021-09641-3] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/13/2021] [Accepted: 08/31/2021] [Indexed: 05/17/2023]
Abstract
Coronavirus disease is communicable and inhibits the infected person's immune system. It belongs to the Coronaviridae family and has affected 213 nations and territories so far. Many kinds of studies are being carried out to filter advice and provide oversight to monitor this outbreak. A comparative and brief review was carried out in this paper on research concerning the early identification of symptoms, estimation of the end of the pandemic, and examination of user-generated conversations. Chest X-ray images, abdominal computed tomography scan, tweets shared on social media are several of the datasets used by researchers. Using machine learning and deep learning methods such as K-means clustering, Random Forest, Convolutional Neural Network, Long Short-Term Memory, Auto-Encoder, and Regression approaches, the above-mentioned datasets are processed. The studies on COVID-19 with machine learning and deep learning models with their results and limitations are outlined in this article. The challenges with open future research directions are discussed at the end.
Collapse
Affiliation(s)
- Shivam Chahar
- School of Computer Science and Engineering, Vellore Institute of Technology, Vellore, TN India
| | - Pradeep Kumar Roy
- Department of Computer Science and Engineering, Indian Institute of Information Technology, Surat, Gujarat India
| |
Collapse
|
220
|
Li Q, Ning J, Yuan J, Xiao L. A depthwise separable dense convolutional network with convolution block attention module for COVID-19 diagnosis on CT scans. Comput Biol Med 2021; 137:104837. [PMID: 34530335 PMCID: PMC8425669 DOI: 10.1016/j.compbiomed.2021.104837] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Revised: 08/16/2021] [Accepted: 08/31/2021] [Indexed: 12/31/2022]
Abstract
Coronavirus disease 2019 (COVID-19) has caused more than 3 million deaths and infected more than 170 million individuals all over the world. Rapid identification of patients with COVID-19 is the key to control transmission and prevent depletion of hospitals. Several networks have been proposed to assist radiologists in diagnosing COVID-19 based on CT scans. However, CTs used in these studies are unavailable for other researchers to do deeper extensions due to privacy concerns. Furthermore, these networks are too heavy-weighted to satisfy the general trend applying on a computationally limited platform. In this paper, we aim to solve these two problems. Firstly, we establish an available dataset COVID-CTx, which contains 828 CT scans positive for COVID-19 across 324 patient cases from three open access data repositories. To our knowledge, it has the largest number of publicly available COVID-19 positive cases compared to other public datasets. Secondly, we propose a light-weighted hybrid neural network: Depthwise Separable Dense Convolutional Network with Convolution Block Attention Module (AM-SdenseNet). AM-SdenseNet synergistically integrates Convolutional Block Attention Module with depthwise separable convolutions to learn powerful feature representations while reducing the parameters to overcome the overfitting problem. Through experiments, we demonstrate the superior performance of our proposed AM-SdenseNet compared with several state-of-the-art baselines. The excellent performance of AM-SdenseNet can improve the speed and accuracy of COVID-19 diagnosis, which is extremely useful to control the spreading of infection.
Collapse
Affiliation(s)
- Qian Li
- Research Center for Ultrasonics and Technologies, Institute of Acoustics, Chinese Academy of Sciences, Beijing, 100190, China; University of Chinese Academy of Sciences, Beijing, 100049, China.
| | - Jiangbo Ning
- Research Center for Ultrasonics and Technologies, Institute of Acoustics, Chinese Academy of Sciences, Beijing, 100190, China.
| | - Jianping Yuan
- Research Center for Ultrasonics and Technologies, Institute of Acoustics, Chinese Academy of Sciences, Beijing, 100190, China.
| | - Ling Xiao
- Research Center for Ultrasonics and Technologies, Institute of Acoustics, Chinese Academy of Sciences, Beijing, 100190, China.
| |
Collapse
|
221
|
Alharbi A, Abdur Rahman MD. Review of Recent Technologies for Tackling COVID-19. SN COMPUTER SCIENCE 2021; 2:460. [PMID: 34549196 PMCID: PMC8444512 DOI: 10.1007/s42979-021-00841-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/26/2020] [Accepted: 08/26/2021] [Indexed: 01/09/2023]
Abstract
The current pandemic caused by the COVID-19 virus requires more effort, experience, and science-sharing to overcome the damage caused by the pathogen. The fast and wide human-to-human transmission of the COVID-19 virus demands a significant role of the newest technologies in the form of local and global computing and information sharing, data privacy, and accurate tests. The advancements of deep neural networks, cloud computing solutions, blockchain technology, and beyond 5G (B5G) communication have contributed to the better management of the COVID-19 impacts on society. This paper reviews recent attempts to tackle the COVID-19 situation using these technological advancements.
Collapse
Affiliation(s)
- Ayman Alharbi
- Department Of Computer Engineering, College of Computer and Information systems, Umm AL-Qura University, Mecca, Saudi Arabia
| | - MD Abdur Rahman
- Department of Cyber Security and Forensic Computing, College of Computer and Cyber Sciences, University of Prince Mugrin, Madinah, 41499 Saudi Arabia
| |
Collapse
|
222
|
Hong G, Chen X, Chen J, Zhang M, Ren Y, Zhang X. A multi-scale gated multi-head attention depthwise separable CNN model for recognizing COVID-19. Sci Rep 2021; 11:18048. [PMID: 34508120 PMCID: PMC8433233 DOI: 10.1038/s41598-021-97428-8] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2021] [Accepted: 08/25/2021] [Indexed: 01/08/2023] Open
Abstract
Coronavirus 2019 (COVID-19) is a new acute respiratory disease that has spread rapidly throughout the world. In this paper, a lightweight convolutional neural network (CNN) model named multi-scale gated multi-head attention depthwise separable CNN (MGMADS-CNN) is proposed, which is based on attention mechanism and depthwise separable convolution. A multi-scale gated multi-head attention mechanism is designed to extract effective feature information from the COVID-19 X-ray and CT images for classification. Moreover, the depthwise separable convolution layers are adopted as MGMADS-CNN's backbone to reduce the model size and parameters. The LeNet-5, AlexNet, GoogLeNet, ResNet, VGGNet-16, and three MGMADS-CNN models are trained, validated and tested with tenfold cross-validation on X-ray and CT images. The results show that MGMADS-CNN with three attention layers (MGMADS-3) has achieved accuracy of 96.75% on X-ray images and 98.25% on CT images. The specificity and sensitivity are 98.06% and 96.6% on X-ray images, and 98.17% and 98.05% on CT images. The size of MGMADS-3 model is only 43.6 M bytes. In addition, the detection speed of MGMADS-3 on X-ray images and CT images are 6.09 ms and 4.23 ms for per image, respectively. It is proved that the MGMADS-3 can detect and classify COVID-19 faster with higher accuracy and efficiency.
Collapse
Affiliation(s)
- Geng Hong
- Department of Electrical Information and Automation, Tianjin University of Science and Technology, Tianjin, 300222, China
| | - Xiaoyan Chen
- Department of Electrical Information and Automation, Tianjin University of Science and Technology, Tianjin, 300222, China.
| | - Jianyong Chen
- Department of Electrical Information and Automation, Tianjin University of Science and Technology, Tianjin, 300222, China
| | - Miao Zhang
- Department of Electrical Information and Automation, Tianjin University of Science and Technology, Tianjin, 300222, China
| | - Yumeng Ren
- Department of Electrical Information and Automation, Tianjin University of Science and Technology, Tianjin, 300222, China
| | - Xinyu Zhang
- Department of Electrical Information and Automation, Tianjin University of Science and Technology, Tianjin, 300222, China
| |
Collapse
|
223
|
Bhowal P, Sen S, Yoon JH, Geem ZW, Sarkar R. Choquet Integral and Coalition Game-based Ensemble of Deep Learning Models for COVID-19 Screening from Chest X-ray Images. IEEE J Biomed Health Inform 2021; 25:4328-4339. [PMID: 34499608 DOI: 10.1109/jbhi.2021.3111415] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Under the present circumstances, when we are still under the threat of different strains of coronavirus, and since the most widely used method for COVID-19 detection, RT-PCR is a tedious and time-consuming manual procedure with poor precision, the application of Artificial Intelligence (AI) and Computer-Aided Diagnosis (CAD) is inevitable. In this work, we have analyzed Chest X-ray (CXR) images for the detection of the coronavirus. The primary agenda of this proposed research study is to leverage the classification performance of the deep learning models using ensemble learning. Many papers have proposed different ensemble learning techniques in this field, some methods using aggregation functions like Weighted Arithmetic Mean (WAM) among others. However, none of these methods take into consideration the decisions that subsets of the classifiers take. In this paper, we have applied Choquet integral for ensemble and propose a novel method for the evaluation of fuzzy measures using Coalition Game Theory, Information Theory, and Lambda fuzzy approximation. Three different sets of Fuzzy Measures are calculated using three different weighting schemes along with information theory and coalition game theory. Using these three sets of fuzzy measures three Choquet Integrals are calculated and their decisions are finally combined.We have created a database by combining several image repositories developed recently. Impressive results on the newly developed dataset and the challenging COVIDx dataset support the efficacy and robustness of the proposed method. To the best of our knowledge, our experimental results outperform many recently proposed methods. Source code available at https://github.com/subhankar01/Covid-Chestxray-lambda-fuzzy.
Collapse
|
224
|
Qureshi KN, Alhudhaif A, Ali M, Qureshi MA, Jeon G. Self-assessment and deep learning-based coronavirus detection and medical diagnosis systems for healthcare. MULTIMEDIA SYSTEMS 2021; 28:1439-1448. [PMID: 34511733 PMCID: PMC8421458 DOI: 10.1007/s00530-021-00839-w] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/15/2020] [Accepted: 08/12/2021] [Indexed: 05/17/2023]
Abstract
Coronavirus is one of the serious threat and challenge for existing healthcare systems. Several prevention methods and precautions have been proposed by medical specialists to treat the virus and secure infected patients. Deep learning methods have been adopted for disease detection, especially for medical image classification. In this paper, we proposed a deep learning-based medical image classification for COVID-19 patients namely deep learning model for coronavirus (DLM-COVID-19). The proposed model improves the medical image classification and optimization for better disease diagnosis. This paper also proposes a mobile application for COVID-19 patient detection using a self-assessment test combined with medical expertise and diagnose and prevent the virus using the online system. The proposed deep learning model is evaluated with existing algorithms where it shows better performance in terms of sensitivity, specificity, and accuracy. Whereas the proposed application also helps to overcome the virus risk and spread.
Collapse
Affiliation(s)
| | - Adi Alhudhaif
- Department of Computer Science, College of Computer Engineering and Sciences in Al-kharj, Prince Sattam bin Abdulaziz University, P.O. Box 151, Al-Kharj 11942, Saudi Arabia
| | - Moazam Ali
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | | | | |
Collapse
|
225
|
Castiglione A, Vijayakumar P, Nappi M, Sadiq S, Umer M. COVID-19: Automatic Detection of the Novel Coronavirus Disease From CT Images Using an Optimized Convolutional Neural Network. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS 2021; 17:6480-6488. [PMID: 37981916 PMCID: PMC8545019 DOI: 10.1109/tii.2021.3057524] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/20/2020] [Revised: 12/06/2020] [Accepted: 02/02/2021] [Indexed: 11/21/2023]
Abstract
It is widely known that a quick disclosure of the COVID-19 can help to reduce its spread dramatically. Transcriptase polymerase chain reaction could be a more useful, rapid, and trustworthy technique for the evaluation and classification of the COVID-19 disease. Currently, a computerized method for classifying computed tomography (CT) images of chests can be crucial for speeding up the detection while the COVID-19 epidemic is rapidly spreading. In this article, the authors have proposed an optimized convolutional neural network model (ADECO-CNN) to divide infected and not infected patients. Furthermore, the ADECO-CNN approach is compared with pretrained convolutional neural network (CNN)-based VGG19, GoogleNet, and ResNet models. Extensive analysis proved that the ADECO-CNN-optimized CNN model can classify CT images with 99.99% accuracy, 99.96% sensitivity, 99.92% precision, and 99.97% specificity.
Collapse
Affiliation(s)
- Aniello Castiglione
- Department of Science and TechnologyUniversity of Naples Parthenope80143NaplesItaly
| | - Pandi Vijayakumar
- Department of Computer Science and EngineeringUniversity College of Engineering TindivanamTindivanam604001India
| | - Michele Nappi
- Department of Computer ScienceUniversity of Salerno84084FiscianoItaly
| | - Saima Sadiq
- Department of Computer ScienceKhwaja Fareed University of Engineering and Information TechnologyRahim Yar Khan64200Pakistan
| | - Muhammad Umer
- Department of Computer ScienceKhwaja Fareed University of Engineering and Information TechnologyRahim Yar Khan64200Pakistan
- Department of Computer Science and Information TechnologyThe Islamia University of BahawalpurBahawalpur63100Pakistan
| |
Collapse
|
226
|
Umair M, Khan MS, Ahmed F, Baothman F, Alqahtani F, Alian M, Ahmad J. Detection of COVID-19 Using Transfer Learning and Grad-CAM Visualization on Indigenously Collected X-ray Dataset. SENSORS 2021; 21:s21175813. [PMID: 34502702 PMCID: PMC8434081 DOI: 10.3390/s21175813] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/06/2021] [Revised: 08/11/2021] [Accepted: 08/16/2021] [Indexed: 12/13/2022]
Abstract
The COVID-19 outbreak began in December 2019 and has dreadfully affected our lives since then. More than three million lives have been engulfed by this newest member of the corona virus family. With the emergence of continuously mutating variants of this virus, it is still indispensable to successfully diagnose the virus at early stages. Although the primary technique for the diagnosis is the PCR test, the non-contact methods utilizing the chest radiographs and CT scans are always preferred. Artificial intelligence, in this regard, plays an essential role in the early and accurate detection of COVID-19 using pulmonary images. In this research, a transfer learning technique with fine tuning was utilized for the detection and classification of COVID-19. Four pre-trained models i.e., VGG16, DenseNet-121, ResNet-50, and MobileNet were used. The aforementioned deep neural networks were trained using the dataset (available on Kaggle) of 7232 (COVID-19 and normal) chest X-ray images. An indigenous dataset of 450 chest X-ray images of Pakistani patients was collected and used for testing and prediction purposes. Various important parameters, e.g., recall, specificity, F1-score, precision, loss graphs, and confusion matrices were calculated to validate the accuracy of the models. The achieved accuracies of VGG16, ResNet-50, DenseNet-121, and MobileNet are 83.27%, 92.48%, 96.49%, and 96.48%, respectively. In order to display feature maps that depict the decomposition process of an input image into various filters, a visualization of the intermediate activations is performed. Finally, the Grad-CAM technique was applied to create class-specific heatmap images in order to highlight the features extracted in the X-ray images. Various optimizers were used for error minimization purposes. DenseNet-121 outperformed the other three models in terms of both accuracy and prediction.
Collapse
Affiliation(s)
- Muhammad Umair
- Department of Electrical Engineering, HITEC University, Taxila 47080, Pakistan; (M.U.); (M.A.)
| | - Muhammad Shahbaz Khan
- Department of Electrical Engineering, HITEC University, Taxila 47080, Pakistan; (M.U.); (M.A.)
- Correspondence:
| | - Fawad Ahmed
- Department of Biomedical Engineering, HITEC University, Taxila 47080, Pakistan;
| | - Fatmah Baothman
- Faculty of Computing and Information Technology, King Abdul Aziz University, Jeddah 21431, Saudi Arabia;
| | - Fehaid Alqahtani
- Department of Computer Science, King Fahad Naval Academy, Al Jubail 35512, Saudi Arabia;
| | - Muhammad Alian
- Department of Electrical Engineering, HITEC University, Taxila 47080, Pakistan; (M.U.); (M.A.)
| | - Jawad Ahmad
- School of Computing, Edinburgh Napier University, Edinburgh EH10 5DT, UK;
| |
Collapse
|
227
|
Shah FM, Joy SKS, Ahmed F, Hossain T, Humaira M, Ami AS, Paul S, Jim MARK, Ahmed S. A Comprehensive Survey of COVID-19 Detection Using Medical Images. SN COMPUTER SCIENCE 2021; 2:434. [PMID: 34485924 PMCID: PMC8401373 DOI: 10.1007/s42979-021-00823-1] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Accepted: 08/16/2021] [Indexed: 12/24/2022]
Abstract
The outbreak of the Coronavirus disease 2019 (COVID-19) caused the death of a large number of people and declared as a pandemic by the World Health Organization. Millions of people are infected by this virus and are still getting infected every day. As the cost and required time of conventional Reverse Transcription Polymerase Chain Reaction (RT-PCR) tests to detect COVID-19 is uneconomical and excessive, researchers are trying to use medical images such as X-ray and Computed Tomography (CT) images to detect this disease with the help of Artificial Intelligence (AI)-based systems, to assist in automating the scanning procedure. In this paper, we reviewed some of these newly emerging AI-based models that can detect COVID-19 from X-ray or CT of lung images. We collected information about available research resources and inspected a total of 80 papers till June 20, 2020. We explored and analyzed data sets, preprocessing techniques, segmentation methods, feature extraction, classification, and experimental results which can be helpful for finding future research directions in the domain of automatic diagnosis of COVID-19 disease using AI-based frameworks. It is also reflected that there is a scarcity of annotated medical images/data sets of COVID-19 affected people, which requires enhancing, segmentation in preprocessing, and domain adaptation in transfer learning for a model, producing an optimal result in model performance. This survey can be the starting point for a novice/beginner level researcher to work on COVID-19 classification.
Collapse
Affiliation(s)
- Faisal Muhammad Shah
- Department of Computer Science and Engineering, Ahsanullah University of Science and Technology, Dhaka, Bangladesh
| | - Sajib Kumar Saha Joy
- Department of Computer Science and Engineering, Ahsanullah University of Science and Technology, Dhaka, Bangladesh
| | - Farzad Ahmed
- Department of Computer Science and Engineering, Ahsanullah University of Science and Technology, Dhaka, Bangladesh
| | - Tonmoy Hossain
- Department of Computer Science and Engineering, Ahsanullah University of Science and Technology, Dhaka, Bangladesh
| | - Mayeesha Humaira
- Department of Computer Science and Engineering, Ahsanullah University of Science and Technology, Dhaka, Bangladesh
| | - Amit Saha Ami
- Department of Computer Science and Engineering, Ahsanullah University of Science and Technology, Dhaka, Bangladesh
| | - Shimul Paul
- Department of Computer Science and Engineering, Ahsanullah University of Science and Technology, Dhaka, Bangladesh
| | - Md Abidur Rahman Khan Jim
- Department of Computer Science and Engineering, Ahsanullah University of Science and Technology, Dhaka, Bangladesh
| | - Sifat Ahmed
- Department of Computer Science and Engineering, Ahsanullah University of Science and Technology, Dhaka, Bangladesh
| |
Collapse
|
228
|
A Method for Optimal Detection of Lung Cancer Based on Deep Learning Optimized by Marine Predators Algorithm. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:3694723. [PMID: 34447429 PMCID: PMC8384530 DOI: 10.1155/2021/3694723] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/04/2021] [Revised: 07/24/2021] [Accepted: 08/04/2021] [Indexed: 01/02/2023]
Abstract
Lung cancer is the uncontrolled growth of cells in the lung that are made up of two spongy organs located in the chest. These cells may penetrate outside the lungs in a process called metastasis and spread to tissues and organs in the body. In this paper, using image processing, deep learning, and metaheuristic, an optimal methodology is proposed for early detection of this cancer. Here, we design a new convolutional neural network for this purpose. Marine predators algorithm is also used for optimal arrangement and better network accuracy. The method finally applied to RIDER dataset, and the results are compared with some pretrained deep networks, including CNN ResNet-18, GoogLeNet, AlexNet, and VGG-19. Final results showed higher results of the proposed method toward the compared techniques. The results showed that the proposed MPA-based method with 93.4% accuracy, 98.4% sensitivity, and 97.1% specificity provides the highest efficiency with the least error (1.6) toward the other state of the art methods.
Collapse
|
229
|
Ahsan MM, Nazim R, Siddique Z, Huebner P. Detection of COVID-19 Patients from CT Scan and Chest X-ray Data Using Modified MobileNetV2 and LIME. Healthcare (Basel) 2021; 9:1099. [PMID: 34574873 PMCID: PMC8465084 DOI: 10.3390/healthcare9091099] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2021] [Revised: 08/18/2021] [Accepted: 08/20/2021] [Indexed: 11/30/2022] Open
Abstract
The COVID-19 global pandemic caused by the widespread transmission of the novel coronavirus (SARS-CoV-2) has become one of modern history's most challenging issues from a healthcare perspective. At its dawn, still without a vaccine, contagion containment strategies remained most effective in preventing the disease's spread. Patient isolation has been primarily driven by the results of polymerase chain reaction (PCR) testing, but its initial reach was challenged by low availability and high cost, especially in developing countries. As a means of taking advantage of a preexisting infrastructure for respiratory disease diagnosis, researchers have proposed COVID-19 patient screening based on the results of Chest Computerized Tomography (CT) and Chest Radiographs (X-ray). When paired with artificial-intelligence- and deep-learning-based approaches for analysis, early studies have achieved a comparatively high accuracy in diagnosing the disease. Considering the opportunity to further explore these methods, we implement six different Deep Convolutional Neural Networks (Deep CNN) models-VGG16, MobileNetV2, InceptionResNetV2, ResNet50, ResNet101, and VGG19-and use a mixed dataset of CT and X-ray images to classify COVID-19 patients. Preliminary results showed that a modified MobileNetV2 model performs best with an accuracy of 95 ± 1.12% (AUC = 0.816). Notably, a high performance was also observed for the VGG16 model, outperforming several previously proposed models with an accuracy of 98.5 ± 1.19% on the X-ray dataset. Our findings are supported by recent works in the academic literature, which also uphold the higher performance of MobileNetV2 when X-ray, CT, and their mixed datasets are considered. Lastly, we further explain the process of feature extraction using Local Interpretable Model-Agnostic Explanations (LIME), which contributes to a better understanding of what features in CT/X-ray images characterize the onset of COVID-19.
Collapse
Affiliation(s)
- Md Manjurul Ahsan
- Industrial and Systems Engineering, University of Oklahoma, Norman, OK 73019, USA
| | - Redwan Nazim
- Chemical, Biological & Materials Engineering, University of Oklahoma, Norman, OK 73019, USA;
| | - Zahed Siddique
- School of Aerospace and Mechanical Engineering, University of Oklahoma, Norman, OK 73019, USA;
| | - Pedro Huebner
- Industrial and Systems Engineering, University of Oklahoma, Norman, OK 73019, USA
| |
Collapse
|
230
|
Hariri W, Narin A. Deep neural networks for COVID-19 detection and diagnosis using images and acoustic-based techniques: a recent review. Soft comput 2021; 25:15345-15362. [PMID: 34456618 PMCID: PMC8382671 DOI: 10.1007/s00500-021-06137-x] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/07/2021] [Indexed: 01/12/2023]
Abstract
The new coronavirus disease (COVID-19) has been declared a pandemic since March 2020 by the World Health Organization. It consists of an emerging viral infection with respiratory tropism that could develop atypical pneumonia. Experts emphasize the importance of early detection of those who have the COVID-19 virus. In this way, patients will be isolated from other people and the spread of the virus can be prevented. For this reason, it has become an area of interest to develop early diagnosis and detection methods to ensure a rapid treatment process and prevent the virus from spreading. Since the standard testing system is time-consuming and not available for everyone, alternative early screening techniques have become an urgent need. In this study, the approaches used in the detection of COVID-19 based on deep learning (DL) algorithms, which have been popular in recent years, have been comprehensively discussed. The advantages and disadvantages of different approaches used in literature are examined in detail. We further present the databases and major future challenges of DL-based COVID-19 detection. The computed tomography of the chest and X-ray images gives a rich representation of the patient's lung that is less time-consuming and allows an efficient viral pneumonia detection using the DL algorithms. The first step is the preprocessing of these images to remove noise. Next, deep features are extracted using multiple types of deep models (pretrained models, generative models, generic neural networks, etc.). Finally, the classification is performed using the obtained features to decide whether the patient is infected by coronavirus or it is another lung disease. In this study, we also give a brief review of the latest applications of cough analysis to early screen the COVID-19 and human mobility estimation to limit its spread.
Collapse
Affiliation(s)
- Walid Hariri
- Labged Laboratory, Computer Science Department, Badji Mokhtar Annaba University, Annaba, Algeria
| | - Ali Narin
- Department of Electrical and Electronics Engineering, Zonguldak Bulent Ecevit University, Zonguldak, Turkey
| |
Collapse
|
231
|
Chen L, Rezaei T. A New Optimal Diagnosis System for Coronavirus (COVID-19) Diagnosis Based on Archimedes Optimization Algorithm on Chest X-Ray Images. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:7788491. [PMID: 34447431 PMCID: PMC8384522 DOI: 10.1155/2021/7788491] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Revised: 07/29/2021] [Accepted: 08/11/2021] [Indexed: 11/18/2022]
Abstract
The new coronavirus, COVID-19, has affected people all over the world. Coronaviruses are a large group of viruses that can infect animals and humans and cause respiratory distress; these discomforts may be as mild as a cold or as severe as pneumonia. Correct detection of this disease can help to avoid its spreading increasingly. In this paper, a new CAD-based approach is suggested for the optimal diagnosis of this disease from chest X-ray images. The proposed method starts with a min-max normalization to scale all data into a normal scale, and then, histogram equalization is performed to improve the quality of the image before main processing. Afterward, 18 different features are extracted from the image. To decrease the method difficulty, the minimum features are selected based on a metaheuristic called Archimedes optimization algorithm (AOA). The model is then implemented on three datasets, and its results are compared with four other state-of-the-art methods. The final results indicated that the proposed method with 86% accuracy and 96% precision has the highest balance between accuracy and reliability with the compared methods as a diagnostic system for COVID-19.
Collapse
Affiliation(s)
- Liping Chen
- College of Computer, Weinan Normal University, Weinan, Shaanxi, China
| | | |
Collapse
|
232
|
Nafees MT, Irshadullah, Rizwan M, Maazullah, Khan MI, Farhan M. A Novel Convolutional Neural Network for COVID-19 detection and classification using Chest X-Ray images.. [DOI: 10.1101/2021.08.11.21261946] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Abstract
AbstractThe early and rapid diagnosis of severe acute respiratory syndrome coronavirus 2 (SARS CoV-2), the main cause of fatal pandemic coronavirus disease 2019 (COVID-19), with the analysis of patients chest X-ray (CXR) images has life-saving importance for both patients and medical professionals. In this research a very simple novel and robust deep-learning convolutional neural network (CNN) model with less number of trainable-parameters is proposed to assist the radiologists and physicians in the early detection of COVID-19 patients. It also helps to classify patients into COVID-19, pneumonia and normal on the bases of analysis of augmented X-ray images. This augmented dataset contains 4803 COVID-19 from 686 publicly available chest X-ray images along with 5000 normal and 5000 pneumonia samples. These images are divided into 80% training and 20 % validation. The proposed CNN model is trained on training dataset and then tested on validation dataset. This model has a promising performance with a mean accuracy of 92.29%, precision of 99.96%, Specificity of 99.85% along with Sensitivity value of 85.92%. The result can further be improved if more data of expert radiologist is publically available.
Collapse
|
233
|
Dwivedi P, Sarkar AK, Chakraborty C, Singha M, Rojwal V. Application of Artificial Intelligence on Post Pandemic Situation and Lesson Learn for Future Prospects. J EXP THEOR ARTIF IN 2021. [DOI: 10.1080/0952813x.2021.1958063] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Affiliation(s)
- Priyanka Dwivedi
- Indian Institute of Information Technology (IIIT) Sri City, Chittoor, India
| | | | | | - Monoj Singha
- Indian Institute of Science (IISc), Bangalore, India
| | - Vineet Rojwal
- Indian Institute of Science (IISc), Bangalore, India
| |
Collapse
|
234
|
Turkoglu M. COVID-19 Detection System Using Chest CT Images and Multiple Kernels-Extreme Learning Machine Based on Deep Neural Network. Ing Rech Biomed 2021; 42:207-214. [PMID: 33527035 PMCID: PMC7839628 DOI: 10.1016/j.irbm.2021.01.004] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2020] [Revised: 01/23/2021] [Accepted: 01/23/2021] [Indexed: 12/23/2022]
Abstract
OBJECTIVES Coronavirus disease is a fatal epidemic that has originated in Wuhan, China in December 2019. This disease is diagnosed using radiological images taken with the help of basic scanning methods besides the test kits for Reverse Transcription Polymerase Chain Reaction (RT-PCR). Automatic analysis of chest Computed Tomography (CT) images that are based on image processing technology plays an important role in combating this infectious disease. MATERIAL AND METHODS In this paper, a new Multiple Kernels-ELM-based Deep Neural Network (MKs-ELM-DNN) method is proposed for the detection of novel coronavirus disease - also known as COVID-19, through chest CT scanning images. In the model proposed, deep features are extracted from CT scan images using a Convolutional Neural Network (CNN). For this purpose, pre-trained CNN-based DenseNet201 architecture, which is based on the transfer learning approach is used. Extreme Learning Machine (ELM) classifier based on different activation methods is used to calculate the architecture's performance. Lastly, the final class label is determined using the majority voting method for prediction of the results obtained from each architecture based on ReLU-ELM, PReLU-ELM, and TanhReLU-ELM. RESULTS In experimental works, a public dataset containing COVID-19 and Non-COVID-19 classes was used to verify the validity of the MKs-ELM-DNN model proposed. According to the results obtained, the accuracy score was obtained as 98.36% using the MKs-ELM-DNN model. The results have demonstrated that, when compared, the MKs-ELM-DNN model proposed is proven to be more successful than the state-of-the-art algorithms and previous studies. CONCLUSION This study shows that the proposed Multiple Kernels-ELM-based Deep Neural Network model can effectively contribute to the identification of COVID-19 disease.
Collapse
Affiliation(s)
- M Turkoglu
- Computer Engineering Department, Engineering Faculty, Bingol University, 12000, Bingol, Turkey
| |
Collapse
|
235
|
Martín J, Tena N, Asuero AG. Current state of diagnostic, screening and surveillance testing methods for COVID-19 from an analytical chemistry point of view. Microchem J 2021; 167:106305. [PMID: 33897053 PMCID: PMC8054532 DOI: 10.1016/j.microc.2021.106305] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Revised: 04/12/2021] [Accepted: 04/14/2021] [Indexed: 12/18/2022]
Abstract
Since December 2019, we have been in the battlefield with a new threat to the humanity known as severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). In this review, we describe the four main methods used for diagnosis, screening and/or surveillance of SARS-CoV-2: Real-time reverse transcription polymerase chain reaction (RT-PCR); chest computed tomography (CT); and different complementary alternatives developed in order to obtain rapid results, antigen and antibody detection. All of them compare the highlighting advantages and disadvantages from an analytical point of view. The gold standard method in terms of sensitivity and specificity is the RT-PCR. The different modifications propose to make it more rapid and applicable at point of care (POC) are also presented and discussed. CT images are limited to central hospitals. However, being combined with RT-PCR is the most robust and accurate way to confirm COVID-19 infection. Antibody tests, although unable to provide reliable results on the status of the infection, are suitable for carrying out maximum screening of the population in order to know the immune capacity. More recently, antigen tests, less sensitive than RT-PCR, have been authorized to determine in a quicker way whether the patient is infected at the time of analysis and without the need of specific instruments.
Collapse
Key Words
- 2019-nCoV, 2019 novel coronavirus
- ACE2, Angiotensin-Converting Enzyme 2
- AI, Artificial Intelligence
- ALP, Alkaline Phosphatase
- ASOs, Antisense Oligonucleotides
- Antigen and antibody tests
- AuNIs, Gold Nanoislands
- AuNPs, Gold Nanoparticles
- BSL, Biosecurity Level
- CAP, College of American Pathologists
- CCD, Charge-Coupled Device
- CG, Colloidal Gold
- CGIA, Colloidal Gold Immunochromatographic Assay
- CLIA, Chemiluminescence Enzyme Immunoassay
- CLIA, Clinical Laboratory Improvement Amendments
- COVID-19
- COVID-19, Coronavirus disease-19
- CRISPR, Clustered Regularly Interspaced Short Palindromic Repeats
- CT, Chest Computed Tomography
- Cas, CRISPR Associate Protein
- China CDC, Chinese Center for Disease Control and Prevention
- Ct, Cycle Threshold
- DETECTR, SARS-CoV-2 DNA Endonuclease-Targeted CRISPR Trans Reporter
- DNA, Dexosyrosyribonucleic Acid
- E, Envelope protein
- ELISA, Enzyme Linked Immunosorbent Assay
- EMA, European Medicines Agency
- EUA, Emergence Use Authorization
- FDA, Food and Drug Administration
- FET, Field-Effect Transistor
- GISAID, Global Initiative on Sharing All Influenza Data
- GeneBank, Genetic sequence data base of the National Institute of Health
- ICTV, International Committee on Taxonomy of Viruses
- IgA, Immunoglobulins A
- IgG, Immunoglobulins G
- IgM, Immunoglobulins M
- IoMT, Internet of Medical Things
- IoT, Internet of Things
- LFIA, Lateral Flow Immunochromatographic Assays
- LOC, Lab-on-a-Chip
- LOD, Limit of detection
- LSPR, Localized Surface Plasmon Resonance
- M, Membrane protein
- MERS-CoV, Middle East Respiratory Syndrome Coronavirus
- MNP, Magnetic Nanoparticle
- MS, Mass spectrometry
- N, Nucleocapsid protein
- NER, Naked Eye Readout
- NGM, Next Generation Molecular
- NGS, Next Generation Sequencing
- NIH, National Institute of Health
- NSPs, Nonstructural Proteins
- Net, Neural Network
- ORF, Open Reading Frame
- OSN, One Step Single-tube Nested
- PDMS, Polydimethylsiloxane
- POC, Point of Care
- PPT, Plasmonic Photothermal
- QD, Quantum Dot
- R0, Basic reproductive number
- RBD, Receptor-binding domain
- RNA, Ribonucleic Acid
- RNaseH, Ribonuclease H
- RT, Reverse Transcriptase
- RT-LAMP, Reverse Transcription Loop-Mediated Isothermal Amplification
- RT-PCR, Real-Time Reverse Transcription Polymerase Chain Reaction
- RT-PCR, chest computerized tomography
- RdRp, RNA-Dependent RNA Polymerase
- S, Spike protein
- SARS-CoV-2
- SARS-CoV-2, Severe Acute Respiratory Syndrome Coronavirus 2
- SERS, Surface Enhanced Raman Spectroscopy
- SHERLOCK, Specific High Sensitivity Enzymatic Reporter UnLOCKing
- STOPCovid, SHERLOCK Testing on One Pot
- SVM, Support Vector Machine
- SiO2@Ag, Complete silver nanoparticle shell coated on silica core
- US CDC, US Centers for Disease Control and Prevention
- VOC, Variant of Concern
- VTM, Viral Transport Medium
- WGS, Whole Genome Sequencing
- WHO, World Health Organization
- aM, Attomolar
- dNTPs, Nucleotides
- dPCR, Digital PCR
- ddPCR, Droplet digital PCR
- fM, Femtomolar
- m-RNA, Messenger Ribonucleic Acid
- nM, Nanomolar
- pM, Picomolar
- pfu, Plaque-forming unit
- rN, Recombinant nucleocapsid protein antigen
- rS, Recombinant Spike protein antigen
- ssRNA, Single-Stranded Positive-Sense RNA
Collapse
Affiliation(s)
- Julia Martín
- Departamento de Química Analítica, Escuela Politécnica Superior, Universidad de Sevilla, C/ Virgen de África 7, Sevilla E-41011, Spain
| | - Noelia Tena
- Departamento de Química Analítica, Facultad de Farmacia, Universidad de Sevilla, Prof. García González, 2, Sevilla 41012, Spain
| | - Agustin G Asuero
- Departamento de Química Analítica, Facultad de Farmacia, Universidad de Sevilla, Prof. García González, 2, Sevilla 41012, Spain
| |
Collapse
|
236
|
Alshazly H, Linse C, Abdalla M, Barth E, Martinetz T. COVID-Nets: deep CNN architectures for detecting COVID-19 using chest CT scans. PeerJ Comput Sci 2021; 7:e655. [PMID: 34401477 PMCID: PMC8330434 DOI: 10.7717/peerj-cs.655] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Accepted: 07/09/2021] [Indexed: 05/10/2023]
Abstract
In this paper we propose two novel deep convolutional network architectures, CovidResNet and CovidDenseNet, to diagnose COVID-19 based on CT images. The models enable transfer learning between different architectures, which might significantly boost the diagnostic performance. Whereas novel architectures usually suffer from the lack of pretrained weights, our proposed models can be partly initialized with larger baseline models like ResNet50 and DenseNet121, which is attractive because of the abundance of public repositories. The architectures are utilized in a first experimental study on the SARS-CoV-2 CT-scan dataset, which contains 4173 CT images for 210 subjects structured in a subject-wise manner into three different classes. The models differentiate between COVID-19, non-COVID-19 viral pneumonia, and healthy samples. We also investigate their performance under three binary classification scenarios where we distinguish COVID-19 from healthy, COVID-19 from non-COVID-19 viral pneumonia, and non-COVID-19 from healthy, respectively. Our proposed models achieve up to 93.87% accuracy, 99.13% precision, 92.49% sensitivity, 97.73% specificity, 95.70% F1-score, and 96.80% AUC score for binary classification, and up to 83.89% accuracy, 80.36% precision, 82.04% sensitivity, 92.07% specificity, 81.05% F1-score, and 94.20% AUC score for the three-class classification tasks. We also validated our models on the COVID19-CT dataset to differentiate COVID-19 and other non-COVID-19 viral infections, and our CovidDenseNet model achieved the best performance with 81.77% accuracy, 79.05% precision, 84.69% sensitivity, 79.05% specificity, 81.77% F1-score, and 87.50% AUC score. The experimental results reveal the effectiveness of the proposed networks in automated COVID-19 detection where they outperform standard models on the considered datasets while being more efficient.
Collapse
Affiliation(s)
- Hammam Alshazly
- Institut für Neuro- und Bioinformatik, University of Lübeck, Lübeck, Germany
- Faculty of Computers and Information, South Valley University, Qena, Egypt
| | - Christoph Linse
- Institut für Neuro- und Bioinformatik, University of Lübeck, Lübeck, Germany
| | - Mohamed Abdalla
- Mathematics Department, Faculty of Science, King Khalid University, Abha, Saudi Arabia
- Mathematics Department, Faculty of Science, South Valley University, Qena, Egypt
| | - Erhardt Barth
- Institut für Neuro- und Bioinformatik, University of Lübeck, Lübeck, Germany
| | - Thomas Martinetz
- Institut für Neuro- und Bioinformatik, University of Lübeck, Lübeck, Germany
| |
Collapse
|
237
|
Hasan N, Bao Y, Shawon A, Huang Y. DenseNet Convolutional Neural Networks Application for Predicting COVID-19 Using CT Image. SN COMPUTER SCIENCE 2021; 2:389. [PMID: 34337432 PMCID: PMC8300985 DOI: 10.1007/s42979-021-00782-7] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/13/2021] [Accepted: 07/17/2021] [Indexed: 01/12/2023]
Abstract
Recently, the destructive impact of Coronavirus 2019, commonly known as COVID-19, has affected public health and human lives. This catastrophic effect disrupted human experience by introducing an exponentially more damaging unpredictable health crisis since the Second World War (Kursumovic et al. in Anaesthesia 75: 989-992, 2020). Strong communicable characteristics of COVID-19 within human communities make the world's crisis a severe pandemic. Due to the unavailable vaccine of COVID-19 to control rather than cure, early and accurate detection of the virus can be a promising technique for tracking and preventing the infection from spreading (e.g., by isolating the patients). This situation indicates improving the auxiliary COVID-19 detection technique. Computed tomography (CT) imaging is a widely used technique for pneumonia because of its expected availability. The artificial intelligence-aided images analysis might be a promising alternative for identifying COVID-19. This paper presents a promising technique of predicting COVID-19 patients from the CT image using convolutional neural networks (CNN). The novel approach is based on the most recent modified CNN architecture (DenseNet-121) to predict COVID-19. The results outperformed 92% accuracy, with a 95% recall showing acceptable performance for the prediction of COVID-19.
Collapse
Affiliation(s)
- Najmul Hasan
- Center for Modern Information Management, School of Management, Huazhong University of Science and Technology, Wuhan, 430074 People’s Republic of China
| | - Yukun Bao
- Center for Modern Information Management, School of Management, Huazhong University of Science and Technology, Wuhan, 430074 People’s Republic of China
| | | | - Yanmei Huang
- Center for Big Data Analytics, Jiangxi University of Engineering, Xinyu, 338029 People’s Republic of China
| |
Collapse
|
238
|
Deng H, Li X. AI-Empowered Computational Examination of Chest Imaging for COVID-19 Treatment: A Review. Front Artif Intell 2021; 4:612914. [PMID: 34368756 PMCID: PMC8333868 DOI: 10.3389/frai.2021.612914] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Accepted: 06/23/2021] [Indexed: 12/21/2022] Open
Abstract
Since the first case of coronavirus disease 2019 (COVID-19) was discovered in December 2019, COVID-19 swiftly spread over the world. By the end of March 2021, more than 136 million patients have been infected. Since the second and third waves of the COVID-19 outbreak are in full swing, investigating effective and timely solutions for patients' check-ups and treatment is important. Although the SARS-CoV-2 virus-specific reverse transcription polymerase chain reaction test is recommended for the diagnosis of COVID-19, the test results are prone to be false negative in the early course of COVID-19 infection. To enhance the screening efficiency and accessibility, chest images captured via X-ray or computed tomography (CT) provide valuable information when evaluating patients with suspected COVID-19 infection. With advanced artificial intelligence (AI) techniques, AI-driven models training with lung scans emerge as quick diagnostic and screening tools for detecting COVID-19 infection in patients. In this article, we provide a comprehensive review of state-of-the-art AI-empowered methods for computational examination of COVID-19 patients with lung scans. In this regard, we searched for papers and preprints on bioRxiv, medRxiv, and arXiv published for the period from January 1, 2020, to March 31, 2021, using the keywords of COVID, lung scans, and AI. After the quality screening, 96 studies are included in this review. The reviewed studies were grouped into three categories based on their target application scenarios: automatic detection of coronavirus disease, infection segmentation, and severity assessment and prognosis prediction. The latest AI solutions to process and analyze chest images for COVID-19 treatment and their advantages and limitations are presented. In addition to reviewing the rapidly developing techniques, we also summarize publicly accessible lung scan image sets. The article ends with discussions of the challenges in current research and potential directions in designing effective computational solutions to fight against the COVID-19 pandemic in the future.
Collapse
Affiliation(s)
- Hanqiu Deng
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB, Canada
- School of Aerospace Engineering, Beijing Institute of Technology, Beijing, China
| | - Xingyu Li
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB, Canada
| |
Collapse
|
239
|
Kumar R, Khan AA, Kumar J, Zakria, Golilarz NA, Zhang S, Ting Y, Zheng C, Wang W. Blockchain-Federated-Learning and Deep Learning Models for COVID-19 Detection Using CT Imaging. IEEE SENSORS JOURNAL 2021; 21:16301-16314. [PMID: 35789224 PMCID: PMC8791443 DOI: 10.1109/jsen.2021.3076767] [Citation(s) in RCA: 83] [Impact Index Per Article: 20.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/24/2021] [Revised: 04/24/2021] [Accepted: 04/24/2021] [Indexed: 05/08/2023]
Abstract
With the increase of COVID-19 cases worldwide, an effective way is required to diagnose COVID-19 patients. The primary problem in diagnosing COVID-19 patients is the shortage and reliability of testing kits, due to the quick spread of the virus, medical practitioners are facing difficulty in identifying the positive cases. The second real-world problem is to share the data among the hospitals globally while keeping in view the privacy concerns of the organizations. Building a collaborative model and preserving privacy are the major concerns for training a global deep learning model. This paper proposes a framework that collects a small amount of data from different sources (various hospitals) and trains a global deep learning model using blockchain-based federated learning. Blockchain technology authenticates the data and federated learning trains the model globally while preserving the privacy of the organization. First, we propose a data normalization technique that deals with the heterogeneity of data as the data is gathered from different hospitals having different kinds of Computed Tomography (CT) scanners. Secondly, we use Capsule Network-based segmentation and classification to detect COVID-19 patients. Thirdly, we design a method that can collaboratively train a global model using blockchain technology with federated learning while preserving privacy. Additionally, we collected real-life COVID-19 patients' data open to the research community. The proposed framework can utilize up-to-date data which improves the recognition of CT images. Finally, we conducted comprehensive experiments to validate the proposed method. Our results demonstrate better performance for detecting COVID-19 patients.
Collapse
Affiliation(s)
- Rajesh Kumar
- Yangtze Delta Region Institute (Huzhou), University of Electronic Science and Technology of ChinaHuzhou313001China
| | - Abdullah Aman Khan
- University of Electronic Science and Technology of ChinaChengdu611731China
| | - Jay Kumar
- Yangtze Delta Region Institute (Huzhou), University of Electronic Science and Technology of ChinaHuzhou313001China
| | - Zakria
- University of Electronic Science and Technology of ChinaChengdu611731China
| | | | - Simin Zhang
- Huaxi MR Research Center (HMRRC)Department of RadiologyWest China Hospital of Sichuan UniversityChengdu610000China
| | - Yang Ting
- University of Electronic Science and Technology of ChinaChengdu611731China
| | - Chengyu Zheng
- China TelecomCompany Ltd., Sichuan BranchChengdu610000China
| | - Wenyong Wang
- International Institute of Next Generation Internet, Macau University of Science and TechnologyTaipa999078China
| |
Collapse
|
240
|
Yasar H, Ceylan M. Deep Learning-Based Approaches to Improve Classification Parameters for Diagnosing COVID-19 from CT Images. Cognit Comput 2021:1-28. [PMID: 34306240 PMCID: PMC8280590 DOI: 10.1007/s12559-021-09915-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2020] [Accepted: 07/07/2021] [Indexed: 11/10/2022]
Abstract
Patients infected with the COVID-19 virus develop severe pneumonia, which generally leads to death. Radiological evidence has demonstrated that the disease causes interstitial involvement in the lungs and lung opacities, as well as bilateral ground-glass opacities and patchy opacities. In this study, new pipeline suggestions are presented, and their performance is tested to decrease the number of false-negative (FN), false-positive (FP), and total misclassified images (FN + FP) in the diagnosis of COVID-19 (COVID-19/non-COVID-19 and COVID-19 pneumonia/other pneumonia) from CT lung images. A total of 4320 CT lung images, of which 2554 were related to COVID-19 and 1766 to non-COVID-19, were used for the test procedures in COVID-19 and non-COVID-19 classifications. Similarly, a total of 3801 CT lung images, of which 2554 were related to COVID-19 pneumonia and 1247 to other pneumonia, were used for the test procedures in COVID-19 pneumonia and other pneumonia classifications. A 24-layer convolutional neural network (CNN) architecture was used for the classification processes. Within the scope of this study, the results of two experiments were obtained by using CT lung images with and without local binary pattern (LBP) application, and sub-band images were obtained by applying dual-tree complex wavelet transform (DT-CWT) to these images. Next, new classification results were calculated from these two results by using the five pipeline approaches presented in this study. For COVID-19 and non-COVID-19 classification, the highest sensitivity, specificity, accuracy, F-1, and AUC values obtained without using pipeline approaches were 0.9676, 0.9181, 0.9456, 0.9545, and 0.9890, respectively; using pipeline approaches, the values were 0.9832, 0.9622, 0.9577, 0.9642, and 0.9923, respectively. For COVID-19 pneumonia/other pneumonia classification, the highest sensitivity, specificity, accuracy, F-1, and AUC values obtained without using pipeline approaches were 0.9615, 0.7270, 0.8846, 0.9180, and 0.9370, respectively; using pipeline approaches, the values were 0.9915, 0.8140, 0.9071, 0.9327, and 0.9615, respectively. The results of this study show that classification success can be increased by reducing the time to obtain per-image results through using the proposed pipeline approaches.
Collapse
Affiliation(s)
- Huseyin Yasar
- Ministry of Health of Republic of Turkey, Ankara, Turkey
| | - Murat Ceylan
- Department of Electrical and Electronics Engineering, Faculty of Engineering and Natural Sciences, Konya Technical University, Konya, Turkey
| |
Collapse
|
241
|
Jingxin L, Mengchao Z, Yuchen L, Jinglei C, Yutong Z, Zhong Z, Lihui Z. COVID-19 lesion detection and segmentation-A deep learning method. Methods 2021; 202:62-69. [PMID: 34237453 PMCID: PMC8256684 DOI: 10.1016/j.ymeth.2021.07.001] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2021] [Revised: 04/24/2021] [Accepted: 07/02/2021] [Indexed: 12/31/2022] Open
Abstract
PURPOSE In this paper, we utilized deep learning methods to screen the positive COVID-19 cases in chest CT. Our primary goal is to supply rapid and precise assistance for disease surveillance on the medical imaging aspect. MATERIALS AND METHODS Basing on deep learning, we combined semantic segmentation and object detection methods to study the lesion performance of COVID-19. We put forward a novel end-to-end model which takes advantage of the Spatio-temporal features. Furthermore, a segmentation model attached with a fully connected CRF was designed for a more effective ROI input. RESULTS Our method showed a better performance across different metrics against the comparison models. Moreover, our strategy highlighted strong robustness for the processed augmented testing samples. CONCLUSION The comprehensive fusion of Spatio-temporal correlations can exploit more valuable features for locating target regions, and this mechanism is friendly to detect tiny lesions. Although it remains in discrete form, the feature extracting in temporal dimension improves the precision of final prediction.
Collapse
Affiliation(s)
- Liu Jingxin
- Department of Radiology, China-Japan Union Hospital, Jilin University, Changchun, China
| | - Zhang Mengchao
- Department of Radiology, China-Japan Union Hospital, Jilin University, Changchun, China
| | - Liu Yuchen
- School of Medical Information, Changchun University of Chinese Medicine, Changchun, China
| | - Cui Jinglei
- Medical Imaging Engineering Technology R&D Center of Jilin Province, Changchun, China
| | - Zhong Yutong
- Electronic Information Engineering College, Changchun University of Science and Technology, Changchun, China
| | - Zhang Zhong
- R&D Department, WX Medical Technology Co., Shenyang, China.
| | - Zu Lihui
- Department of Radiology, China-Japan Union Hospital, Jilin University, Changchun, China.
| |
Collapse
|
242
|
Shi W, Tong L, Zhu Y, Wang MD. COVID-19 Automatic Diagnosis With Radiographic Imaging: Explainable Attention Transfer Deep Neural Networks. IEEE J Biomed Health Inform 2021. [PMID: 33882010 DOI: 10.1109/jbhi.2021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/18/2023]
Abstract
Researchers seek help from deep learning methods to alleviate the enormous burden of reading radiological images by clinicians during the COVID-19 pandemic. However, clinicians are often reluctant to trust deep models due to their black-box characteristics. To automatically differentiate COVID-19 and community-acquired pneumonia from healthy lungs in radiographic imaging, we propose an explainable attention-transfer classification model based on the knowledge distillation network structure. The attention transfer direction always goes from the teacher network to the student network. Firstly, the teacher network extracts global features and concentrates on the infection regions to generate attention maps. It uses a deformable attention module to strengthen the response of infection regions and to suppress noise in irrelevant regions with an expanded reception field. Secondly, an image fusion module combines attention knowledge transferred from teacher network to student network with the essential information in original input. While the teacher network focuses on global features, the student branch focuses on irregularly shaped lesion regions to learn discriminative features. Lastly, we conduct extensive experiments on public chest X-ray and CT datasets to demonstrate the explainability of the proposed architecture in diagnosing COVID-19.
Collapse
|
243
|
Maheshwari S, Sharma RR, Kumar M. LBP-based information assisted intelligent system for COVID-19 identification. Comput Biol Med 2021; 134:104453. [PMID: 33957343 PMCID: PMC8087862 DOI: 10.1016/j.compbiomed.2021.104453] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2021] [Revised: 04/19/2021] [Accepted: 04/24/2021] [Indexed: 01/08/2023]
Abstract
A real-time COVID-19 detection system is an utmost requirement of the present situation. This article presents a chest X-ray image-based automated COVID-19 detection system which can be employed with the RT-PCR test to improve the diagnosis rate. In the proposed approach, the textural features are extracted from the chest X-ray images and local binary pattern (LBP) based images. Further, the image-based and LBP image-based features are jointly investigated. Thereafter, highly discriminatory features are provided to the classifier for developing an automated model for COVID-19 identification. The performance of the proposed approach is investigated over 2905 chest X-ray images of normal, pneumonia, and COVID-19 infected persons on various class combinations to analyze the robustness. The developed method achieves 97.97% accuracy (acc) and 99.88% sensitivity (sen) for classifying COVID-19 X-ray images against pneumonia infected and normal person's X-ray images. It attains 98.91% acc and 99.33% sen for COVID-19 X-ray against the normal X-ray classification. This method can be employed to assist the radiologists during mass screening for fast, accurate, and contact-free COVID-19 diagnosis.
Collapse
Affiliation(s)
- Shishir Maheshwari
- Discipline of Electrical and Electronics Engineering, Birla Institute of Technology and Science, Pilani, 333031, India.
| | - Rishi Raj Sharma
- Department of Electronics Engineering, Defence Institute of Advanced Technology, Pune, 411025, India.
| | - Mohit Kumar
- NAF Department, Indian Institute of Technology Kanpur, Kanpur, India.
| |
Collapse
|
244
|
Munusamy H, Karthikeyan JM, Shriram G, Thanga Revathi S, Aravindkumar S. FractalCovNet architecture for COVID-19 Chest X-ray image Classification and CT-scan image Segmentation. Biocybern Biomed Eng 2021; 41:1025-1038. [PMID: 34257471 PMCID: PMC8264565 DOI: 10.1016/j.bbe.2021.06.011] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Revised: 06/26/2021] [Accepted: 06/30/2021] [Indexed: 12/14/2022]
Abstract
Precise and fast diagnosis of COVID-19 cases play a vital role in early stage of medical treatment and prevention. Automatic detection of COVID-19 cases using the chest X-ray images and chest CT-scan images will be helpful to reduce the impact of this pandemic on the human society. We have developed a novel FractalCovNet architecture using Fractal blocks and U-Net for segmentation of chest CT-scan images to localize the lesion region. The same FractalCovNet architecture is also used for classification of chest X-ray images using transfer learning. We have compared the segmentation results using various model such as U-Net, DenseUNet, Segnet, ResnetUNet, and FCN. We have also compared the classification results with various models like ResNet5-, Xception, InceptionResNetV2, VGG-16 and DenseNet architectures. The proposed FractalCovNet model is able to predict the COVID-19 lesion with high F-measure and precision values compared to the other state-of-the-art methods. Thus the proposed model can accurately predict the COVID-19 cases and discover lesion regions in chest CT without the manual annotations of lesions for every suspected individual. An easily-trained and high-performance deep learning model provides a fast way to identify COVID-19 patients, which is beneficial to control the outbreak of SARS-II-COV.
Collapse
Affiliation(s)
- Hemalatha Munusamy
- Department of Information Technology, Anna University, MIT Campus, Chennai, India
| | - J M Karthikeyan
- Department of Information Technology, Anna University, MIT Campus, Chennai, India
| | - G Shriram
- Department of Information Technology, Anna University, MIT Campus, Chennai, India
| | - S Thanga Revathi
- Department of Computer Science and Engineering, SRM Institute of Science and Technology, Chennai, India
| | - S Aravindkumar
- Department of Information Technology, Rajalakshmi Engineering College, Chennai, India
| |
Collapse
|
245
|
Singh VK, Kolekar MH. Deep learning empowered COVID-19 diagnosis using chest CT scan images for collaborative edge-cloud computing platform. MULTIMEDIA TOOLS AND APPLICATIONS 2021; 81:3-30. [PMID: 34220289 PMCID: PMC8236565 DOI: 10.1007/s11042-021-11158-7] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 05/01/2021] [Accepted: 06/07/2021] [Indexed: 05/04/2023]
Abstract
The novel coronavirus outbreak has spread worldwide, causing respiratory infections in humans, leading to a huge global pandemic COVID-19. According to World Health Organization, the only way to curb this spread is by increasing the testing and isolating the infected. Meanwhile, the clinical testing currently being followed is not easily accessible and requires much time to give the results. In this scenario, remote diagnostic systems could become a handy solution. Some existing studies leverage the deep learning approach to provide an effective alternative to clinical diagnostic techniques. However, it is difficult to use such complex networks in resource constraint environments. To address this problem, we developed a fine-tuned deep learning model inspired by the architecture of the MobileNet V2 model. Moreover, the developed model is further optimized in terms of its size and complexity to make it compatible with mobile and edge devices. The results of extensive experimentation performed on a real-world dataset consisting of 2482 chest Computerized Tomography scan images strongly suggest the superiority of the developed fine-tuned deep learning model in terms of high accuracy and faster diagnosis time. The proposed model achieved a classification accuracy of 96.40%, with approximately ten times shorter response time than prevailing deep learning models. Further, McNemar's statistical test results also prove the efficacy of the proposed model.
Collapse
Affiliation(s)
- Vipul Kumar Singh
- Department of Electrical Engineering, Indian Institute of Technology, Patna, India
| | | |
Collapse
|
246
|
El-Rashidy N, Abdelrazik S, Abuhmed T, Amer E, Ali F, Hu JW, El-Sappagh S. Comprehensive Survey of Using Machine Learning in the COVID-19 Pandemic. Diagnostics (Basel) 2021; 11:1155. [PMID: 34202587 PMCID: PMC8303306 DOI: 10.3390/diagnostics11071155] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2021] [Revised: 05/29/2021] [Accepted: 05/31/2021] [Indexed: 12/11/2022] Open
Abstract
Since December 2019, the global health population has faced the rapid spreading of coronavirus disease (COVID-19). With the incremental acceleration of the number of infected cases, the World Health Organization (WHO) has reported COVID-19 as an epidemic that puts a heavy burden on healthcare sectors in almost every country. The potential of artificial intelligence (AI) in this context is difficult to ignore. AI companies have been racing to develop innovative tools that contribute to arm the world against this pandemic and minimize the disruption that it may cause. The main objective of this study is to survey the decisive role of AI as a technology used to fight against the COVID-19 pandemic. Five significant applications of AI for COVID-19 were found, including (1) COVID-19 diagnosis using various data types (e.g., images, sound, and text); (2) estimation of the possible future spread of the disease based on the current confirmed cases; (3) association between COVID-19 infection and patient characteristics; (4) vaccine development and drug interaction; and (5) development of supporting applications. This study also introduces a comparison between current COVID-19 datasets. Based on the limitations of the current literature, this review highlights the open research challenges that could inspire the future application of AI in COVID-19.
Collapse
Affiliation(s)
- Nora El-Rashidy
- Machine Learning and Information Retrieval Department, Faculty of Artificial Intelligence, Kafrelsheiksh University, Kafrelsheiksh 13518, Egypt
| | - Samir Abdelrazik
- Information System Department, Faculty of Computer Science and Information Systems, Mansoura University, Mansoura 13518, Egypt;
| | - Tamer Abuhmed
- College of Computing and Informatics, Sungkyunkwan University, Seoul 03063, Korea
| | - Eslam Amer
- Faculty of Computer Science, Misr International University, Cairo 11828, Egypt;
| | - Farman Ali
- Department of Software, Sejong University, Seoul 05006, Korea;
| | - Jong-Wan Hu
- Department of Civil and Environmental Engineering, Incheon National University, Incheon 22012, Korea
| | - Shaker El-Sappagh
- Centro Singular de Investigación en Tecnoloxías Intelixentes (CiTIUS), Universidade de Santiago de Compostela, 15782 Santiago de Compostela, Spain
- Information Systems Department, Faculty of Computers and Artificial Intelligence, Benha University, Banha 13518, Egypt
| |
Collapse
|
247
|
Deep supervised learning using self-adaptive auxiliary loss for COVID-19 diagnosis from imbalanced CT images. Neurocomputing 2021; 458:232-245. [PMID: 34121811 PMCID: PMC8180474 DOI: 10.1016/j.neucom.2021.06.012] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2020] [Revised: 05/02/2021] [Accepted: 06/04/2021] [Indexed: 12/21/2022]
Abstract
The outbreak and rapid spread of coronavirus disease 2019 (COVID-19) has had a huge impact on the lives and safety of people around the world. Chest CT is considered an effective tool for the diagnosis and follow-up of COVID-19. For faster examination, automatic COVID-19 diagnostic techniques using deep learning on CT images have received increasing attention. However, the number and category of existing datasets for COVID-19 diagnosis that can be used for training are limited, and the number of initial COVID-19 samples is much smaller than the normal’s, which leads to the problem of class imbalance. It makes the classification algorithms difficult to learn the discriminative boundaries since the data of some classes are rich while others are scarce. Therefore, training robust deep neural networks with imbalanced data is a fundamental challenging but important task in the diagnosis of COVID-19. In this paper, we create a challenging clinical dataset (named COVID19-Diag) with category diversity and propose a novel imbalanced data classification method using deep supervised learning with a self-adaptive auxiliary loss (DSN-SAAL) for COVID-19 diagnosis. The loss function considers both the effects of data overlap between CT slices and possible noisy labels in clinical datasets on a multi-scale, deep supervised network framework by integrating the effective number of samples and a weighting regularization item. The learning process jointly and automatically optimizes all parameters over the deep supervised network, making our model generally applicable to a wide range of datasets. Extensive experiments are conducted on COVID19-Diag and three public COVID-19 diagnosis datasets. The results show that our DSN-SAAL outperforms the state-of-the-art methods and is effective for the diagnosis of COVID-19 in varying degrees of data imbalance.
Collapse
|
248
|
Serena Low WC, Chuah JH, Tee CATH, Anis S, Shoaib MA, Faisal A, Khalil A, Lai KW. An Overview of Deep Learning Techniques on Chest X-Ray and CT Scan Identification of COVID-19. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2021; 2021:5528144. [PMID: 34194535 PMCID: PMC8184329 DOI: 10.1155/2021/5528144] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Revised: 04/19/2021] [Accepted: 05/19/2021] [Indexed: 12/15/2022]
Abstract
Pneumonia is an infamous life-threatening lung bacterial or viral infection. The latest viral infection endangering the lives of many people worldwide is the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which causes COVID-19. This paper is aimed at detecting and differentiating viral pneumonia and COVID-19 disease using digital X-ray images. The current practices include tedious conventional processes that solely rely on the radiologist or medical consultant's technical expertise that are limited, time-consuming, inefficient, and outdated. The implementation is easily prone to human errors of being misdiagnosed. The development of deep learning and technology improvement allows medical scientists and researchers to venture into various neural networks and algorithms to develop applications, tools, and instruments that can further support medical radiologists. This paper presents an overview of deep learning techniques made in the chest radiography on COVID-19 and pneumonia cases.
Collapse
Affiliation(s)
- Woan Ching Serena Low
- Department of Electrical Engineering, Faculty of Engineering, University of Malaya, 40603 Kuala Lumpur, Malaysia
| | - Joon Huang Chuah
- Department of Electrical Engineering, Faculty of Engineering, University of Malaya, 40603 Kuala Lumpur, Malaysia
| | - Clarence Augustine T. H. Tee
- Department of Electrical Engineering, Faculty of Engineering, University of Malaya, 40603 Kuala Lumpur, Malaysia
| | - Shazia Anis
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, 40603 Kuala Lumpur, Malaysia
| | - Muhammad Ali Shoaib
- Department of Electrical Engineering, Faculty of Engineering, University of Malaya, 40603 Kuala Lumpur, Malaysia
| | - Amir Faisal
- Department of Biomedical Engineering, Faculty of Production and Industrial Technology, Institut Teknologi Sumatera, Lampung 35365, Indonesia
| | - Azira Khalil
- Faculty of Science and Technology, Universiti Sains Islam Malaysia, 71800 Nilai, Negeri Sembilan, Malaysia
| | - Khin Wee Lai
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, 40603 Kuala Lumpur, Malaysia
| |
Collapse
|
249
|
Shelke A, Inamdar M, Shah V, Tiwari A, Hussain A, Chafekar T, Mehendale N. Chest X-ray Classification Using Deep Learning for Automated COVID-19 Screening. ACTA ACUST UNITED AC 2021; 2:300. [PMID: 34075355 PMCID: PMC8152712 DOI: 10.1007/s42979-021-00695-5] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Accepted: 05/10/2021] [Indexed: 12/13/2022]
Abstract
In today’s world, we find ourselves struggling to fight one of the worst pandemics in the history of humanity known as COVID-2019 caused by a coronavirus. When the virus reaches the lungs, we observe ground-glass opacity in the chest X-ray due to fibrosis in the lungs. Due to the significant differences between X-ray images of an infected and non-infected person, artificial intelligence techniques can be used to identify the presence and severity of the infection. We propose a classification model that can analyze the chest X-rays and help in the accurate diagnosis of COVID-19. Our methodology classifies the chest X-rays into four classes viz. normal, pneumonia, tuberculosis (TB), and COVID-19. Further, the X-rays indicating COVID-19 are classified on a severity-basis into mild, medium, and severe. The deep learning model used for the classification of pneumonia, TB, and normal is VGG-16 with a test accuracy of 95.9 %. For the segregation of normal pneumonia and COVID-19, the DenseNet-161 was used with a test accuracy of 98.9 %, whereas the ResNet-18 worked best for severity classification achieving a test accuracy up to 76 %. Our approach allows mass screening of the people using X-rays as a primary validation for COVID-19.
Collapse
Affiliation(s)
- Ankita Shelke
- K. J. Somaiya College of Engineering, Vidyavihar, Mumbai, India Maharshtra 400077
| | - Madhura Inamdar
- K. J. Somaiya College of Engineering, Vidyavihar, Mumbai, India Maharshtra 400077
| | - Vruddhi Shah
- K. J. Somaiya College of Engineering, Vidyavihar, Mumbai, India Maharshtra 400077
| | - Amanshu Tiwari
- K. J. Somaiya College of Engineering, Vidyavihar, Mumbai, India Maharshtra 400077
| | - Aafiya Hussain
- K. J. Somaiya College of Engineering, Vidyavihar, Mumbai, India Maharshtra 400077
| | - Talha Chafekar
- K. J. Somaiya College of Engineering, Vidyavihar, Mumbai, India Maharshtra 400077
| | - Ninad Mehendale
- K. J. Somaiya College of Engineering, Vidyavihar, Mumbai, India Maharshtra 400077
| |
Collapse
|
250
|
Ozdemir MA, Ozdemir GD, Guren O. Classification of COVID-19 electrocardiograms by using hexaxial feature mapping and deep learning. BMC Med Inform Decis Mak 2021; 21:170. [PMID: 34034715 PMCID: PMC8146190 DOI: 10.1186/s12911-021-01521-x] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2021] [Accepted: 05/05/2021] [Indexed: 12/17/2022] Open
Abstract
BACKGROUND Coronavirus disease 2019 (COVID-19) has become a pandemic since its first appearance in late 2019. Deaths caused by COVID-19 are still increasing day by day and early diagnosis has become crucial. Since current diagnostic methods have many disadvantages, new investigations are needed to improve the performance of diagnosis. METHODS A novel method is proposed to automatically diagnose COVID-19 by using Electrocardiogram (ECG) data with deep learning for the first time. Moreover, a new and effective method called hexaxial feature mapping is proposed to represent 12-lead ECG to 2D colorful images. Gray-Level Co-Occurrence Matrix (GLCM) method is used to extract features and generate hexaxial mapping images. These generated images are then fed into a new Convolutional Neural Network (CNN) architecture to diagnose COVID-19. RESULTS Two different classification scenarios are conducted on a publicly available paper-based ECG image dataset to reveal the diagnostic capability and performance of the proposed approach. In the first scenario, ECG data labeled as COVID-19 and No-Findings (normal) are classified to evaluate COVID-19 classification ability. According to results, the proposed approach provides encouraging COVID-19 detection performance with an accuracy of 96.20% and F1-Score of 96.30%. In the second scenario, ECG data labeled as Negative (normal, abnormal, and myocardial infarction) and Positive (COVID-19) are classified to evaluate COVID-19 diagnostic ability. The experimental results demonstrated that the proposed approach provides satisfactory COVID-19 prediction performance with an accuracy of 93.00% and F1-Score of 93.20%. Furthermore, different experimental studies are conducted to evaluate the robustness of the proposed approach. CONCLUSION Automatic detection of cardiovascular changes caused by COVID-19 can be possible with a deep learning framework through ECG data. This not only proves the presence of cardiovascular changes caused by COVID-19 but also reveals that ECG can potentially be used in the diagnosis of COVID-19. We believe the proposed study may provide a crucial decision-making system for healthcare professionals. SOURCE CODE All source codes are made publicly available at: https://github.com/mkfzdmr/COVID-19-ECG-Classification.
Collapse
Affiliation(s)
- Mehmet Akif Ozdemir
- Department of Biomedical Engineering, Faculty of Enigneering and Architecture, Izmir Katip Celebi University, 35620 Cigli, Izmir, Turkey
- Department of Biomedical Technologies, Graduate School of Natural and Applied Sciences, Izmir Katip Celebi University, 35620 Cigli, Izmir, Turkey
| | - Gizem Dilara Ozdemir
- Department of Biomedical Engineering, Faculty of Enigneering and Architecture, Izmir Katip Celebi University, 35620 Cigli, Izmir, Turkey
- Department of Biomedical Technologies, Graduate School of Natural and Applied Sciences, Izmir Katip Celebi University, 35620 Cigli, Izmir, Turkey
| | - Onan Guren
- Department of Biomedical Engineering, Faculty of Enigneering and Architecture, Izmir Katip Celebi University, 35620 Cigli, Izmir, Turkey
| |
Collapse
|