251
|
Khanna M, Agarwal A, Singh LK, Thawkar S, Khanna A, Gupta D. Radiologist-Level Two Novel and Robust Automated Computer-Aided Prediction Models for Early Detection of COVID-19 Infection from Chest X-ray Images. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2021; 48:1-33. [PMID: 34395156 PMCID: PMC8349241 DOI: 10.1007/s13369-021-05880-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/31/2020] [Accepted: 06/15/2021] [Indexed: 12/24/2022]
Abstract
COVID-19 is an ongoing pandemic that is widely spreading daily and reaches a significant community spread. X-ray images, computed tomography (CT) images and test kits (RT-PCR) are three easily available options for predicting this infection. Compared to the screening of COVID-19 infection from X-ray and CT images, the test kits(RT-PCR) available to diagnose COVID-19 face problems such as high analytical time, high false negative outcomes, poor sensitivity and specificity. Radiological signatures that X-rays can detect have been found in COVID-19 positive patients. Radiologists may examine these signatures, but it's a time-consuming and error-prone process (riddled with intra-observer variability). Thus, the chest X-ray analysis process needs to be automated, for which AI-driven tools have proven to be the best choice to increase accuracy and speed up analysis time, especially in the case of medical image analysis. We shortlisted four datasets and 20 CNN-based models to test and validate the best ones using 16 detailed experiments with fivefold cross-validation. The two proposed models, ensemble deep transfer learning CNN model and hybrid LSTMCNN, perform the best. The accuracy of ensemble CNN was up to 99.78% (96.51% average-wise), F1-score up to 0.9977 (0.9682 average-wise) and AUC up to 0.9978 (0.9583 average-wise). The accuracy of LSTMCNN was up to 98.66% (96.46% average-wise), F1-score up to 0.9974 (0.9668 average-wise) and AUC up to 0.9856 (0.9645 average-wise). These two best pre-trained transfer learning-based detection models can contribute clinically by offering the patients prediction correctly and rapidly.
Collapse
Affiliation(s)
- Munish Khanna
- Hindustan College of Science and Technology, Mathura, 281122 India
| | - Astitwa Agarwal
- Hindustan College of Science and Technology, Mathura, 281122 India
| | - Law Kumar Singh
- Hindustan College of Science and Technology, Mathura, 281122 India
| | - Shankar Thawkar
- Hindustan College of Science and Technology, Mathura, 281122 India
| | - Ashish Khanna
- Maharaja Agrasen Institute of Technology, Delhi, 110034 India
| | - Deepak Gupta
- Maharaja Agrasen Institute of Technology, Delhi, 110034 India
| |
Collapse
|
252
|
Sitharthan R, Rajesh M. RETRACTED ARTICLE: Application of machine learning (ML) and internet of things (IoT) in healthcare to predict and tackle pandemic situation. DISTRIBUTED AND PARALLEL DATABASES 2021; 40:887. [PMID: 34393377 PMCID: PMC8349240 DOI: 10.1007/s10619-021-07358-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 07/30/2021] [Indexed: 05/29/2023]
Affiliation(s)
- R. Sitharthan
- Department of Electrical Engineering, School of Electrical Engineering, Vellore Institute of Technology and Science, 632014 Vellore, India
| | - M. Rajesh
- Sanjivani College of Engineering, Kopargaon, & RaGa Academic Solutions, Chennai, India
| |
Collapse
|
253
|
Özcan ANŞ, Aslan K. Diagnostic accuracy of sagittal TSE-T2W, variable flip angle 3D TSE-T2W and high-resolution 3D heavily T2W sequences for the stenosis of two localizations: the cerebral aqueduct and the superior medullary velum. Curr Med Imaging 2021; 17:1432-1438. [PMID: 34365953 DOI: 10.2174/1573405617666210806123720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Revised: 04/07/2021] [Accepted: 05/03/2021] [Indexed: 11/22/2022]
Abstract
OBJECTIVES This study aimed to investigate the accuracy of conventional sagittal turbo spin echo T2-weighted (Sag TSE-T2W), variable flip angle 3D TSE (VFA-3D-TSE) and high-resolution 3D heavily T2W (HR-3D-HT2W) sequences in the diagnosis of primary aqueductal stenosis (PAS) and superior medullary velum stenosis (SMV-S), and the effect of stenosis localization on diagnosis. METHODS Seventy-seven patients were included in the study. The diagnosis accuracy of the HR-3D-HT2W, Sag TSE-T2W and VFA-3D-TSE sequences, was classified into three grades by two experienced neuroradiologists: grade 0 (the sequence has no diagnostic ability), grade 1 (the sequence diagnoses stenosis but does not show focal stenosis itself or membrane formation), and grade 2 (the sequence makes a definitive diagnosis of stenosis and shows focal stenosis itself or membrane formation). Stenosis localizations were divided into three as Cerebral Aquaduct (CA), superior medullary velum (SMV) and SMV+CA. In the statistical analysis, the grades of the sequences were compared without making a differentiation based on localization. Then, the effect of localization on diagnosis was determined by comparing the grades for individual localizations. RESULTS In the sequence comparison, grade 0 was not detected in the VFA-3D-TSE and HR-3D-HT2W sequences, and these sequences diagnosed all cases. On the other hand, 25.4% of grade 0 was detected with the Sag TSE-T2W sequence (P<0.05). Grade 1 was detected by VFA-3D-TSE in 23% of the cases, while grade 1 (12.5%) was detected by HRH-3D-T2W in only one case, and the difference was statistically significant (P<0.05). When the sequences were examined according to localizations, the rate of grade 0 in the Sag TSE-T2W sequence was statistically significantly higher for the SMV localization (33.3%) compared to CA (66.7%) and SMV+CA (0%) (P<0.05). Localization had no effect on diagnosis using the other sequences. CONCLUSION In our study, we found that the VFA-3D-TSE and HR-3D-HT2W sequences were successful in the diagnosis of PAS and SMV-S contrary to the Sag TSE-T2W sequence.
Collapse
Affiliation(s)
| | - Kerim Aslan
- Samsun Ondokuz Mayıs University, Department of Radiology, Samsun. Turkey
| |
Collapse
|
254
|
Dong S, Yang Q, Fu Y, Tian M, Zhuo C. RCoNet: Deformable Mutual Information Maximization and High-Order Uncertainty-Aware Learning for Robust COVID-19 Detection. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2021; 32:3401-3411. [PMID: 34143745 PMCID: PMC8864918 DOI: 10.1109/tnnls.2021.3086570] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/22/2020] [Revised: 01/15/2021] [Accepted: 06/01/2021] [Indexed: 06/01/2023]
Abstract
The novel 2019 Coronavirus (COVID-19) infection has spread worldwide and is currently a major healthcare challenge around the world. Chest computed tomography (CT) and X-ray images have been well recognized to be two effective techniques for clinical COVID-19 disease diagnoses. Due to faster imaging time and considerably lower cost than CT, detecting COVID-19 in chest X-ray (CXR) images is preferred for efficient diagnosis, assessment, and treatment. However, considering the similarity between COVID-19 and pneumonia, CXR samples with deep features distributed near category boundaries are easily misclassified by the hyperplanes learned from limited training data. Moreover, most existing approaches for COVID-19 detection focus on the accuracy of prediction and overlook uncertainty estimation, which is particularly important when dealing with noisy datasets. To alleviate these concerns, we propose a novel deep network named RCoNet ks for robust COVID-19 detection which employs Deformable Mutual Information Maximization (DeIM), Mixed High-order Moment Feature (MHMF), and Multiexpert Uncertainty-aware Learning (MUL). With DeIM, the mutual information (MI) between input data and the corresponding latent representations can be well estimated and maximized to capture compact and disentangled representational characteristics. Meanwhile, MHMF can fully explore the benefits of using high-order statistics and extract discriminative features of complex distributions in medical imaging. Finally, MUL creates multiple parallel dropout networks for each CXR image to evaluate uncertainty and thus prevent performance degradation caused by the noise in the data. The experimental results show that RCoNet ks achieves the state-of-the-art performance on an open-source COVIDx dataset of 15 134 original CXR images across several metrics. Crucially, our method is shown to be more effective than existing methods with the presence of noise in the data.
Collapse
Affiliation(s)
- Shunjie Dong
- Department of Information Science and Electronic EngineeringZhejiang UniversityHangzhou310027China
| | - Qianqian Yang
- Department of Information Science and Electronic EngineeringZhejiang UniversityHangzhou310027China
| | - Yu Fu
- Department of Information Science and Electronic EngineeringZhejiang UniversityHangzhou310027China
| | - Mei Tian
- Nuclear Medicine Innovative Research CenterZhejiang UniversityHangzhou310009China
| | - Cheng Zhuo
- Department of Information Science and Electronic EngineeringZhejiang UniversityHangzhou310027China
- International Joint Innovation CenterZhejiang UniversityHangzhou314400China
| |
Collapse
|
255
|
Dey S, Bhattacharya R, Malakar S, Mirjalili S, Sarkar R. Choquet fuzzy integral-based classifier ensemble technique for COVID-19 detection. Comput Biol Med 2021. [PMID: 34229144 DOI: 10.1016/j.compbiomed] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
The COVID-19 outbreak has resulted in a global pandemic and led to more than a million deaths to date. COVID-19 early detection is essential for its mitigation by controlling its spread from infected patients in communities through quarantine. Although vaccination has started, it will take time to reach everyone, especially in developing nations, and computer scientists are striving to come up with competent methods using image analysis. In this work, a classifier ensemble technique is proposed, utilizing Choquet fuzzy integral, wherein convolutional neural network (CNN) based models are used as base classifiers. It classifies chest X-ray images from patients with common Pneumonia, confirmed COVID-19, and healthy lungs. Since there are few samples of COVID-19 cases for training on a standard CNN model from scratch, we use the transfer learning scheme to train the base classifiers, which are InceptionV3, DenseNet121, and VGG19. We utilize the pre-trained CNN models to extract features and classify the chest X-ray images using two dense layers and one softmax layer. After that, we combine the prediction scores of the data from individual models using Choquet fuzzy integral to get the final predicted labels, which is more accurate than the prediction by the individual models. To determine the fuzzy-membership values of each classifier for the application of Choquet fuzzy integral, we use the validation accuracy of each classifier. The proposed method is evaluated on chest X-ray images in publicly available repositories (IEEE and Kaggle datasets). It provides 99.00%, 99.00%, 99.00%, and 99.02% average recall, precision, F-score, and accuracy, respectively. We have also evaluated the performance of the proposed model on an inter-dataset experimental setup, where chest X-ray images from another dataset (CMSC-678-ML-Project GitHub dataset) are fed to our trained model and we have achieved 99.05% test accuracy on this dataset. The results are better than commonly used classifier ensemble methods as well as many state-of-the-art methods.
Collapse
Affiliation(s)
- Subhrajit Dey
- Department of Electrical Engineering, Jadavpur University, Kolkata, 700032, India.
| | - Rajdeep Bhattacharya
- Department of Computer Science and Engineering, Jadavpur University, Kolkata, 700032, India.
| | - Samir Malakar
- Department of Computer Science, Asutosh College, Kolkata, 700026, India.
| | - Seyedali Mirjalili
- Centre for Artificial Intelligence Research and Optimisation, Torrens University Australia, Fortitude Valley, Brisbane, QLD, 4006, Australia; Yonsei Frontier Lab, Yonsei University, Seoul, South Korea; King Abdulaziz University, Jeddah, Saudi Arabia.
| | - Ram Sarkar
- Department of Computer Science and Engineering, Jadavpur University, Kolkata, 700032, India.
| |
Collapse
|
256
|
Kaur I, Behl T, Aleya L, Rahman H, Kumar A, Arora S, Bulbul IJ. Artificial intelligence as a fundamental tool in management of infectious diseases and its current implementation in COVID-19 pandemic. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2021; 28:40515-40532. [PMID: 34036497 PMCID: PMC8148397 DOI: 10.1007/s11356-021-13823-8] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/13/2020] [Accepted: 04/05/2021] [Indexed: 04/15/2023]
Abstract
The world has never been prepared for global pandemics like the COVID-19, currently posing an immense threat to the public and consistent pressure on the global healthcare systems to navigate optimized tools, equipments, medicines, and techno-driven approaches to retard the infection spread. The synergized outcome of artificial intelligence paradigms and human-driven control measures elicit a significant impact on screening, analysis, prediction, and tracking the currently infected individuals, and likely the future patients, with precision and accuracy, generating regular international and national data on confirmed, recovered, and death cases, as the current status of 3,820,869 infected patients worldwide. Artificial intelligence is a frontline concept, with time-saving, cost-effective, and productive access to disease management, rendering positive results in physician assistance in high workload conditions, radiology imaging, computational tomography, and database formulations, to facilitate availability of information accessible to researchers all over the globe. The review tends to elaborate the role of industry 4.0 technology, fast diagnostic procedures, and convolutional neural networks, as artificial intelligence aspects, in potentiating the COVID-19 management criteria and differentiating infection in SARS-CoV-2 positive and negative groups. Therefore, the review successfully supplements the processes of vaccine development, disease management, diagnosis, patient records, transmission inhibition, social distancing, and future pandemic predictions, with artificial intelligence revolution and smart techno processes to ensure that the human race wins this battle with COVID-19 and many more combats in the future.
Collapse
Affiliation(s)
- Ishnoor Kaur
- Chitkara College of Pharmacy, Chitkara University, Chandigarh, Punjab, India
| | - Tapan Behl
- Chitkara College of Pharmacy, Chitkara University, Chandigarh, Punjab, India.
| | - Lotfi Aleya
- Chrono-Environment Laboratory, UMR CNRS 6249, Bourgogne Franche-Comté University, Besançon, France
| | - Habibur Rahman
- Department of Global Medical Science, Wonju College of Medicine, Yonsei University, Seoul, South Korea
- Department of Pharmacy, Southeast University, Banani, Dhaka, 1213, Bangladesh
| | - Arun Kumar
- Chitkara College of Pharmacy, Chitkara University, Chandigarh, Punjab, India
| | - Sandeep Arora
- Chitkara College of Pharmacy, Chitkara University, Chandigarh, Punjab, India
| | - Israt Jahan Bulbul
- Department of Pharmacy, Southeast University, Banani, Dhaka, 1213, Bangladesh
| |
Collapse
|
257
|
Momeny M, Neshat AA, Hussain MA, Kia S, Marhamati M, Jahanbakhshi A, Hamarneh G. Learning-to-augment strategy using noisy and denoised data: Improving generalizability of deep CNN for the detection of COVID-19 in X-ray images. Comput Biol Med 2021; 136:104704. [PMID: 34352454 PMCID: PMC8760424 DOI: 10.1016/j.compbiomed.2021.104704] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2021] [Revised: 07/14/2021] [Accepted: 07/23/2021] [Indexed: 12/21/2022]
Abstract
Chest X-ray images are used in deep convolutional neural networks for the detection of COVID-19, the greatest human challenge of the 21st century. Robustness to noise and improvement of generalization are the major challenges in designing these networks. In this paper, we introduce a strategy for data augmentation using the determination of the type and value of noise density to improve the robustness and generalization of deep CNNs for COVID-19 detection. Firstly, we present a learning-to-augment approach that generates new noisy variants of the original image data with optimized noise density. We apply a Bayesian optimization technique to control and choose the optimal noise type and its parameters. Secondly, we propose a novel data augmentation strategy, based on denoised X-ray images, that uses the distance between denoised and original pixels to generate new data. We develop an autoencoder model to create new data using denoised images corrupted by the Gaussian and impulse noise. A database of chest X-ray images, containing COVID-19 positive, healthy, and non-COVID pneumonia cases, is used to fine-tune the pre-trained networks (AlexNet, ShuffleNet, ResNet18, and GoogleNet). The proposed method performs better results compared to the state-of-the-art learning to augment strategies in terms of sensitivity (0.808), specificity (0.915), and F-Measure (0.737). The source code of the proposed method is available at https://github.com/mohamadmomeny/Learning-to-augment-strategy.
Collapse
Affiliation(s)
- Mohammad Momeny
- Department of Computer Engineering, Yazd University, Yazd, Iran.
| | - Ali Asghar Neshat
- Department of Environmental Engineering, Esfarayen Faculty of Medical Science, Esfarayen, Iran.
| | | | - Solmaz Kia
- Department of Engineering Science, Faculty of Advanced Technologies, University of Mohaghegh Ardabili, Namin, Iran
| | - Mahmoud Marhamati
- Department of Medical-Surgical Nursing, Esfarayen Faculty of Medical Science, Esfarayen, Iran
| | - Ahmad Jahanbakhshi
- Department of Biosystems Engineering, University of Mohaghegh Ardabili, Ardabil, Iran
| | - Ghassan Hamarneh
- School of Computing Science, Simon Fraser University, Burnaby, BC, V5A 1S6, Canada
| |
Collapse
|
258
|
Acar E, Şahin E, Yılmaz İ. Improving effectiveness of different deep learning-based models for detecting COVID-19 from computed tomography (CT) images. Neural Comput Appl 2021; 33:17589-17609. [PMID: 34345118 PMCID: PMC8321007 DOI: 10.1007/s00521-021-06344-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2020] [Accepted: 07/18/2021] [Indexed: 12/12/2022]
Abstract
COVID-19 has caused a pandemic crisis that threatens the world in many areas, especially in public health. For the diagnosis of COVID-19, computed tomography has a prognostic role in the early diagnosis of COVID-19 as it provides both rapid and accurate results. This is crucial to assist clinicians in making decisions for rapid isolation and appropriate patient treatment. Therefore, many researchers have shown that the accuracy of COVID-19 patient detection from chest CT images using various deep learning systems is extremely optimistic. Deep learning networks such as convolutional neural networks (CNNs) require substantial training data. One of the biggest problems for researchers is accessing a significant amount of training data. In this work, we combine methods such as segmentation, data augmentation and generative adversarial network (GAN) to increase the effectiveness of deep learning models. We propose a method that generates synthetic chest CT images using the GAN method from a limited number of CT images. We test the performance of experiments (with and without GAN) on internal and external dataset. When the CNN is trained on real images and synthetic images, a slight increase in accuracy and other results are observed in the internal dataset, but between \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$3\%$$\end{document}3% and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$9\%$$\end{document}9% in the external dataset. It is promising according to the performance results that the proposed method will accelerate the detection of COVID-19 and lead to more robust systems.
Collapse
Affiliation(s)
- Erdi Acar
- Department of Computer Engineering, Çanakkale Onsekiz Mart University, 17100 Çanakkale, Turkey
| | - Engin Şahin
- Department of Computer Engineering, Çanakkale Onsekiz Mart University, 17100 Çanakkale, Turkey
| | - İhsan Yılmaz
- Department of Computer Engineering, Çanakkale Onsekiz Mart University, 17100 Çanakkale, Turkey
| |
Collapse
|
259
|
Alshazly H, Linse C, Abdalla M, Barth E, Martinetz T. COVID-Nets: deep CNN architectures for detecting COVID-19 using chest CT scans. PeerJ Comput Sci 2021; 7:e655. [PMID: 34401477 PMCID: PMC8330434 DOI: 10.7717/peerj-cs.655] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Accepted: 07/09/2021] [Indexed: 05/10/2023]
Abstract
In this paper we propose two novel deep convolutional network architectures, CovidResNet and CovidDenseNet, to diagnose COVID-19 based on CT images. The models enable transfer learning between different architectures, which might significantly boost the diagnostic performance. Whereas novel architectures usually suffer from the lack of pretrained weights, our proposed models can be partly initialized with larger baseline models like ResNet50 and DenseNet121, which is attractive because of the abundance of public repositories. The architectures are utilized in a first experimental study on the SARS-CoV-2 CT-scan dataset, which contains 4173 CT images for 210 subjects structured in a subject-wise manner into three different classes. The models differentiate between COVID-19, non-COVID-19 viral pneumonia, and healthy samples. We also investigate their performance under three binary classification scenarios where we distinguish COVID-19 from healthy, COVID-19 from non-COVID-19 viral pneumonia, and non-COVID-19 from healthy, respectively. Our proposed models achieve up to 93.87% accuracy, 99.13% precision, 92.49% sensitivity, 97.73% specificity, 95.70% F1-score, and 96.80% AUC score for binary classification, and up to 83.89% accuracy, 80.36% precision, 82.04% sensitivity, 92.07% specificity, 81.05% F1-score, and 94.20% AUC score for the three-class classification tasks. We also validated our models on the COVID19-CT dataset to differentiate COVID-19 and other non-COVID-19 viral infections, and our CovidDenseNet model achieved the best performance with 81.77% accuracy, 79.05% precision, 84.69% sensitivity, 79.05% specificity, 81.77% F1-score, and 87.50% AUC score. The experimental results reveal the effectiveness of the proposed networks in automated COVID-19 detection where they outperform standard models on the considered datasets while being more efficient.
Collapse
Affiliation(s)
- Hammam Alshazly
- Institut für Neuro- und Bioinformatik, University of Lübeck, Lübeck, Germany
- Faculty of Computers and Information, South Valley University, Qena, Egypt
| | - Christoph Linse
- Institut für Neuro- und Bioinformatik, University of Lübeck, Lübeck, Germany
| | - Mohamed Abdalla
- Mathematics Department, Faculty of Science, King Khalid University, Abha, Saudi Arabia
- Mathematics Department, Faculty of Science, South Valley University, Qena, Egypt
| | - Erhardt Barth
- Institut für Neuro- und Bioinformatik, University of Lübeck, Lübeck, Germany
| | - Thomas Martinetz
- Institut für Neuro- und Bioinformatik, University of Lübeck, Lübeck, Germany
| |
Collapse
|
260
|
Perspectives and Attitudes of Patients with COVID-19 toward a Telerehabilitation Programme: A Qualitative Study. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:ijerph18157845. [PMID: 34360138 PMCID: PMC8345417 DOI: 10.3390/ijerph18157845] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Revised: 07/14/2021] [Accepted: 07/21/2021] [Indexed: 01/07/2023]
Abstract
The total isolation of patients with coronavirus disease 2019 (COVID-19) requires non-face-to-face medical assistance. There is evidence of the efficacy of home treatments with exercises in patients with respiratory disorders which could become the therapeutic method of choice for the treatment and supervision of patients isolated due to infection during home confinement. This study’s objective was to analyse the experience and opinions of isolated patients with COVID-19 included in a programme of telerehabilitation exercises for 14 days and it is intended to reflect, from a qualitative point of view, the viability and usefulness of telerehabilitation tools in the management of these patients. Twenty-five participants of a telerehabilitation programme were interviewed by telephone through semi-structured interviews, following a positivist and objective model. The data were categorised and analysed through NVIVO qualitative analysis software. The information obtained was classified into four main topics (telerehabilitation programme, perception of clinical benefit, psychological aspects and level of health care) and six subtopics (technical aspects, communication, improvement aspects, exercise plan, motivation and applicability to public health systems). The telerehabilitation programme established in patients confined by COVID-19 is very well received, without considerable technical difficulties and generates physical and psychological improvements. Patients highlight the importance of applying this type of programme in public health systems.
Collapse
|
261
|
Papoutsoglou G, Karaglani M, Lagani V, Thomson N, Røe OD, Tsamardinos I, Chatzaki E. Automated machine learning optimizes and accelerates predictive modeling from COVID-19 high throughput datasets. Sci Rep 2021; 11:15107. [PMID: 34302024 PMCID: PMC8302755 DOI: 10.1038/s41598-021-94501-0] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2021] [Accepted: 07/08/2021] [Indexed: 12/24/2022] Open
Abstract
COVID-19 outbreak brings intense pressure on healthcare systems, with an urgent demand for effective diagnostic, prognostic and therapeutic procedures. Here, we employed Automated Machine Learning (AutoML) to analyze three publicly available high throughput COVID-19 datasets, including proteomic, metabolomic and transcriptomic measurements. Pathway analysis of the selected features was also performed. Analysis of a combined proteomic and metabolomic dataset led to 10 equivalent signatures of two features each, with AUC 0.840 (CI 0.723-0.941) in discriminating severe from non-severe COVID-19 patients. A transcriptomic dataset led to two equivalent signatures of eight features each, with AUC 0.914 (CI 0.865-0.955) in identifying COVID-19 patients from those with a different acute respiratory illness. Another transcriptomic dataset led to two equivalent signatures of nine features each, with AUC 0.967 (CI 0.899-0.996) in identifying COVID-19 patients from virus-free individuals. Signature predictive performance remained high upon validation. Multiple new features emerged and pathway analysis revealed biological relevance by implication in Viral mRNA Translation, Interferon gamma signaling and Innate Immune System pathways. In conclusion, AutoML analysis led to multiple biosignatures of high predictive performance, with reduced features and large choice of alternative predictors. These favorable characteristics are eminent for development of cost-effective assays to contribute to better disease management.
Collapse
Affiliation(s)
- Georgios Papoutsoglou
- JADBio, Gnosis Data Analysis PC, Science and Technology Park of Crete, N. Plastira 100, Vassilika Vouton, 70013, Heraklion, Crete, Greece
- Computer Science Department, University of Crete, Voutes Campus, 70013, Heraklion, Crete, Greece
| | - Makrina Karaglani
- JADBio, Gnosis Data Analysis PC, Science and Technology Park of Crete, N. Plastira 100, Vassilika Vouton, 70013, Heraklion, Crete, Greece
- Laboratory of Pharmacology, Medical School, Democritus University of Thrace, 68100, Alexandroupolis, Greece
| | - Vincenzo Lagani
- JADBio, Gnosis Data Analysis PC, Science and Technology Park of Crete, N. Plastira 100, Vassilika Vouton, 70013, Heraklion, Crete, Greece
- Institute of Chemical Biology, Ilia State University, Kakutsa Cholokashvili Ave 3/5, 0162, Tbilisi, Georgia
| | - Naomi Thomson
- JADBio, Gnosis Data Analysis PC, Science and Technology Park of Crete, N. Plastira 100, Vassilika Vouton, 70013, Heraklion, Crete, Greece
| | - Oluf Dimitri Røe
- Department of Clinical and Molecular Medicine, Norwegian University of Science and Technology, Prinsesse Kristinsgt. 1, 7491, Trondheim, Norway
- Clinical Cancer Research Center, Department of Clinical Medicine, Aalborg University Hospital, Hobrovej 18-22, 9100, Aalborg, Denmark
| | - Ioannis Tsamardinos
- JADBio, Gnosis Data Analysis PC, Science and Technology Park of Crete, N. Plastira 100, Vassilika Vouton, 70013, Heraklion, Crete, Greece
- Computer Science Department, University of Crete, Voutes Campus, 70013, Heraklion, Crete, Greece
| | - Ekaterini Chatzaki
- Laboratory of Pharmacology, Medical School, Democritus University of Thrace, 68100, Alexandroupolis, Greece.
- Institute of Agri-Food and Life Sciences, Mediterranean University Research Centre, 71410, Heraklion, Crete, Greece.
| |
Collapse
|
262
|
Deng H, Li X. AI-Empowered Computational Examination of Chest Imaging for COVID-19 Treatment: A Review. Front Artif Intell 2021; 4:612914. [PMID: 34368756 PMCID: PMC8333868 DOI: 10.3389/frai.2021.612914] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Accepted: 06/23/2021] [Indexed: 12/21/2022] Open
Abstract
Since the first case of coronavirus disease 2019 (COVID-19) was discovered in December 2019, COVID-19 swiftly spread over the world. By the end of March 2021, more than 136 million patients have been infected. Since the second and third waves of the COVID-19 outbreak are in full swing, investigating effective and timely solutions for patients' check-ups and treatment is important. Although the SARS-CoV-2 virus-specific reverse transcription polymerase chain reaction test is recommended for the diagnosis of COVID-19, the test results are prone to be false negative in the early course of COVID-19 infection. To enhance the screening efficiency and accessibility, chest images captured via X-ray or computed tomography (CT) provide valuable information when evaluating patients with suspected COVID-19 infection. With advanced artificial intelligence (AI) techniques, AI-driven models training with lung scans emerge as quick diagnostic and screening tools for detecting COVID-19 infection in patients. In this article, we provide a comprehensive review of state-of-the-art AI-empowered methods for computational examination of COVID-19 patients with lung scans. In this regard, we searched for papers and preprints on bioRxiv, medRxiv, and arXiv published for the period from January 1, 2020, to March 31, 2021, using the keywords of COVID, lung scans, and AI. After the quality screening, 96 studies are included in this review. The reviewed studies were grouped into three categories based on their target application scenarios: automatic detection of coronavirus disease, infection segmentation, and severity assessment and prognosis prediction. The latest AI solutions to process and analyze chest images for COVID-19 treatment and their advantages and limitations are presented. In addition to reviewing the rapidly developing techniques, we also summarize publicly accessible lung scan image sets. The article ends with discussions of the challenges in current research and potential directions in designing effective computational solutions to fight against the COVID-19 pandemic in the future.
Collapse
Affiliation(s)
- Hanqiu Deng
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB, Canada
- School of Aerospace Engineering, Beijing Institute of Technology, Beijing, China
| | - Xingyu Li
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB, Canada
| |
Collapse
|
263
|
Bi-Level Prediction Model for Screening COVID-19 Patients Using Chest X-Ray Images. BIG DATA RESEARCH 2021; 25. [PMCID: PMC8084620 DOI: 10.1016/j.bdr.2021.100233] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
The ongoing pandemic due to coronavirus disease, commonly abbreviated as COVID-19, has unleashed a major health crisis across the world. Although multiple vaccines have emerged, large scale vaccination have proven to be a major challenge, especially in developing nations. As a result, early detection still remains a crucial aspect of containing the spread of the virus. The popularly used test for COVID-19 is limited by the availability of test kits and is time-consuming. This has prompted researchers to use chest x-ray (CXR) and chest tomography (CT) scan images of subjects to predict COVID. Many COVID-19 patients also suffer from viral Pneumonia caused by SARS-CoV2 virus. Hence, distinguishing between bacterial and non-COVID Pneumonia is of paramount importance for proper diagnosis of the patients. To this end, in the present work, we have developed a bi-level prediction model of the subjects into normal, Pneumonia and COVID-19 patients by using a shallow learner based classifier on features extracted by VGG19 from the CXR images. The model is used on 3168 images distributed among normal, Pneumonia and COVID classes. We have created a dataset by collating CXR images from various sources like SIRM COVID-19 Database, Chest Imaging (Twitter), COVID-chestxray-dataset and Chest X-Ray Images. The experimental results confirm the superiority of the proposed model (99.26% accuracy) over the best performing single-level classification method (96.74% accuracy). This result is also at par with the many state-of-the-art methods mentioned in literature. The source code is available in the link https://github.com/sdrxc/Bi-level-Prediction-Model-for-Screening-COVID-19-from-Chest-X-ray-Images.
Collapse
|
264
|
Yasar H, Ceylan M. Deep Learning-Based Approaches to Improve Classification Parameters for Diagnosing COVID-19 from CT Images. Cognit Comput 2021:1-28. [PMID: 34306240 PMCID: PMC8280590 DOI: 10.1007/s12559-021-09915-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2020] [Accepted: 07/07/2021] [Indexed: 11/10/2022]
Abstract
Patients infected with the COVID-19 virus develop severe pneumonia, which generally leads to death. Radiological evidence has demonstrated that the disease causes interstitial involvement in the lungs and lung opacities, as well as bilateral ground-glass opacities and patchy opacities. In this study, new pipeline suggestions are presented, and their performance is tested to decrease the number of false-negative (FN), false-positive (FP), and total misclassified images (FN + FP) in the diagnosis of COVID-19 (COVID-19/non-COVID-19 and COVID-19 pneumonia/other pneumonia) from CT lung images. A total of 4320 CT lung images, of which 2554 were related to COVID-19 and 1766 to non-COVID-19, were used for the test procedures in COVID-19 and non-COVID-19 classifications. Similarly, a total of 3801 CT lung images, of which 2554 were related to COVID-19 pneumonia and 1247 to other pneumonia, were used for the test procedures in COVID-19 pneumonia and other pneumonia classifications. A 24-layer convolutional neural network (CNN) architecture was used for the classification processes. Within the scope of this study, the results of two experiments were obtained by using CT lung images with and without local binary pattern (LBP) application, and sub-band images were obtained by applying dual-tree complex wavelet transform (DT-CWT) to these images. Next, new classification results were calculated from these two results by using the five pipeline approaches presented in this study. For COVID-19 and non-COVID-19 classification, the highest sensitivity, specificity, accuracy, F-1, and AUC values obtained without using pipeline approaches were 0.9676, 0.9181, 0.9456, 0.9545, and 0.9890, respectively; using pipeline approaches, the values were 0.9832, 0.9622, 0.9577, 0.9642, and 0.9923, respectively. For COVID-19 pneumonia/other pneumonia classification, the highest sensitivity, specificity, accuracy, F-1, and AUC values obtained without using pipeline approaches were 0.9615, 0.7270, 0.8846, 0.9180, and 0.9370, respectively; using pipeline approaches, the values were 0.9915, 0.8140, 0.9071, 0.9327, and 0.9615, respectively. The results of this study show that classification success can be increased by reducing the time to obtain per-image results through using the proposed pipeline approaches.
Collapse
Affiliation(s)
- Huseyin Yasar
- Ministry of Health of Republic of Turkey, Ankara, Turkey
| | - Murat Ceylan
- Department of Electrical and Electronics Engineering, Faculty of Engineering and Natural Sciences, Konya Technical University, Konya, Turkey
| |
Collapse
|
265
|
Ekpenyong ME, Edoho ME, Inyang UG, Uzoka FM, Ekaidem IS, Moses AE, Emeje MO, Tatfeng YM, Udo IJ, Anwana ED, Etim OE, Geoffery JI, Dan EA. A hybrid computational framework for intelligent inter-continent SARS-CoV-2 sub-strains characterization and prediction. Sci Rep 2021; 11:14558. [PMID: 34267263 PMCID: PMC8282786 DOI: 10.1038/s41598-021-93757-w] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Accepted: 06/25/2021] [Indexed: 11/09/2022] Open
Abstract
Whereas accelerated attention beclouded early stages of the coronavirus spread, knowledge of actual pathogenicity and origin of possible sub-strains remained unclear. By harvesting the Global initiative on Sharing All Influenza Data (GISAID) database ( https://www.gisaid.org/ ), between December 2019 and January 15, 2021, a total of 8864 human SARS-CoV-2 complete genome sequences processed by gender, across 6 continents (88 countries) of the world, Antarctica exempt, were analyzed. We hypothesized that data speak for itself and can discern true and explainable patterns of the disease. Identical genome diversity and pattern correlates analysis performed using a hybrid of biotechnology and machine learning methods corroborate the emergence of inter- and intra- SARS-CoV-2 sub-strains transmission and sustain an increase in sub-strains within the various continents, with nucleotide mutations dynamically varying between individuals in close association with the virus as it adapts to its host/environment. Interestingly, some viral sub-strain patterns progressively transformed into new sub-strain clusters indicating varying amino acid, and strong nucleotide association derived from same lineage. A novel cognitive approach to knowledge mining helped the discovery of transmission routes and seamless contact tracing protocol. Our classification results were better than state-of-the-art methods, indicating a more robust system for predicting emerging or new viral sub-strain(s). The results therefore offer explanations for the growing concerns about the virus and its next wave(s). A future direction of this work is a defuzzification of confusable pattern clusters for precise intra-country SARS-CoV-2 sub-strains analytics.
Collapse
Affiliation(s)
- Moses Effiong Ekpenyong
- Department of Computer Science, University of Uyo, P.M.B. 1017, Uyo, 520003, Nigeria.
- Centre for Research and Development, University of Uyo, P.M.B. 1017, Uyo, 520003, Nigeria.
| | - Mercy Ernest Edoho
- Department of Computer Science, University of Uyo, P.M.B. 1017, Uyo, 520003, Nigeria
| | | | - Faith-Michael Uzoka
- Department of Mathematics and Computing, Mount Royal University, 4825 Mt Royal Gate SW, Calgary, AB, T3E 6K6, Canada
| | | | | | - Martins Ochubiojo Emeje
- National Institute for Pharmaceutical Research and Development (NIPRD), Plot 942, Cadastral Zone C16, Idu, Industrial District, Abuja, FCT, Nigeria
| | - Youtchou Mirabeau Tatfeng
- College of Health Sciences, Niger Delta University, Wilberforce Island, P.M.B. 071, Amassama, 560103, Nigeria
| | - Ifiok James Udo
- Department of Computer Science, University of Uyo, P.M.B. 1017, Uyo, 520003, Nigeria
| | - EnoAbasi Deborah Anwana
- Department of Botany and Ecological Studies, University of Uyo, P.M.B. 1017, Uyo, 520003, Nigeria
| | - Oboso Edem Etim
- Department of Biochemistry, University of Uyo, P.M.B. 1017, Uyo, 520003, Nigeria
| | - Joseph Ikim Geoffery
- Department of Computer Science, University of Uyo, P.M.B. 1017, Uyo, 520003, Nigeria
| | - Emmanuel Ambrose Dan
- Department of Computer Science, University of Uyo, P.M.B. 1017, Uyo, 520003, Nigeria
| |
Collapse
|
266
|
Mondal MRH, Bharati S, Podder P. Diagnosis of COVID-19 Using Machine Learning and Deep Learning: A Review. Curr Med Imaging 2021; 17:1403-1418. [PMID: 34259149 DOI: 10.2174/1573405617666210713113439] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2020] [Revised: 03/29/2021] [Accepted: 04/08/2021] [Indexed: 02/08/2023]
Abstract
BACKGROUND This paper provides a systematic review of the application of artificial intelligence (AI) in the form of machine learning (ML) and deep learning (DL) techniques in fighting against the effects of novel coronavirus disease (COVID-19). OBJECTIVE & METHOD The objective is to perform a scoping review on AI for COVID-19 using preferred reporting items of systematic reviews and meta-analysis (PRISMA) guidelines. A literature search was performed for relevant studies published from 1 January 2020 till 27 March 2021. Out of 4050 research papers available in reputed publishers, a full-text review of 440 articles was done based on the keywords of AI, COVID-19, ML, forecasting, DL, X-ray, and computed tomography (CT). Finally, 52 articles were included in the result synthesis of this paper. As part of the review, different ML regression methods were reviewed first in predicting the number of confirmed and death cases. Secondly, a comprehensive survey was carried out on the use of ML in classifying COVID-19 patients. Thirdly, different datasets on medical imaging were compared in terms of the number of images, number of positive samples and number of classes in the datasets. The different stages of the diagnosis, including preprocessing, segmentation and feature extraction were also reviewed. Fourthly, the performance results of different research papers were compared to evaluate the effectiveness of DL methods on different datasets. RESULTS Results show that residual neural network (ResNet-18) and densely connected convolutional network (DenseNet 169) exhibit excellent classification accuracy for X-ray images, while DenseNet-201 has the maximum accuracy in classifying CT scan images. This indicates that ML and DL are useful tools in assisting researchers and medical professionals in predicting, screening and detecting COVID-19. CONCLUSION Finally, this review highlights the existing challenges, including regulations, noisy data, data privacy, and the lack of reliable large datasets, then provides future research directions in applying AI in managing COVID-19.
Collapse
Affiliation(s)
| | - Subrato Bharati
- Institute of ICT, Bangladesh University of Engineering and Technology, Dhaka-1205, Bangladesh
| | - Prajoy Podder
- Institute of ICT, Bangladesh University of Engineering and Technology, Dhaka-1205, Bangladesh
| |
Collapse
|
267
|
Ravi V, Narasimhan H, Chakraborty C, Pham TD. Deep learning-based meta-classifier approach for COVID-19 classification using CT scan and chest X-ray images. MULTIMEDIA SYSTEMS 2021; 28:1401-1415. [PMID: 34248292 PMCID: PMC8258271 DOI: 10.1007/s00530-021-00826-1] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Accepted: 06/01/2021] [Indexed: 05/27/2023]
Abstract
Literature survey shows that convolutional neural network (CNN)-based pretrained models have been largely used for CoronaVirus Disease 2019 (COVID-19) classification using chest X-ray (CXR) and computed tomography (CT) datasets. However, most of the methods have used a smaller number of data samples for both CT and CXR datasets for training, validation, and testing. As a result, the model might have shown good performance during testing, but this type of model will not be more effective on unseen COVID-19 data samples. Generalization is an important term to be considered while designing a classifier that can perform well on completely unseen datasets. Here, this work proposes a large-scale learning with stacked ensemble meta-classifier and deep learning-based feature fusion approach for COVID-19 classification. The features from the penultimate layer (global average pooling) of EfficientNet-based pretrained models were extracted and the dimensionality of the extracted features reduced using kernel principal component analysis (PCA). Next, a feature fusion approach was employed to merge the features of various extracted features. Finally, a stacked ensemble meta-classifier-based approach was used for classification. It is a two-stage approach. In the first stage, random forest and support vector machine (SVM) were applied for prediction, then aggregated and fed into the second stage. The second stage includes logistic regression classifier that classifies the data sample of CT and CXR into either COVID-19 or Non-COVID-19. The proposed model was tested using large CT and CXR datasets, which are publicly available. The performance of the proposed model was compared with various existing CNN-based pretrained models. The proposed model outperformed the existing methods and can be used as a tool for point-of-care diagnosis by healthcare professionals.
Collapse
Affiliation(s)
- Vinayakumar Ravi
- Center for Artificial Intelligence, Prince Mohammad Bin Fahd University, Khobar, Saudi Arabia
| | - Harini Narasimhan
- Smart Materials Structures and Systems Lab, Indian Institute of Technology, Kanpur, India
| | - Chinmay Chakraborty
- Department of Electronics and Communication Engineering, Birla Institute of Technology, Ranchi, Jharkhand India
| | - Tuan D. Pham
- Center for Artificial Intelligence, Prince Mohammad Bin Fahd University, Khobar, Saudi Arabia
| |
Collapse
|
268
|
Dogan O, Tiwari S, Jabbar MA, Guggari S. A systematic review on AI/ML approaches against COVID-19 outbreak. COMPLEX INTELL SYST 2021; 7:2655-2678. [PMID: 34777970 PMCID: PMC8256231 DOI: 10.1007/s40747-021-00424-8] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Accepted: 06/05/2021] [Indexed: 12/24/2022]
Abstract
A pandemic disease, COVID-19, has caused trouble worldwide by infecting millions of people. The studies that apply artificial intelligence (AI) and machine learning (ML) methods for various purposes against the COVID-19 outbreak have increased because of their significant advantages. Although AI/ML applications provide satisfactory solutions to COVID-19 disease, these solutions can have a wide diversity. This increase in the number of AI/ML studies and diversity in solutions can confuse deciding which AI/ML technique is suitable for which COVID-19 purposes. Because there is no comprehensive review study, this study systematically analyzes and summarizes related studies. A research methodology has been proposed to conduct the systematic literature review for framing the research questions, searching criteria and relevant data extraction. Finally, 264 studies were taken into account after following inclusion and exclusion criteria. This research can be regarded as a key element for epidemic and transmission prediction, diagnosis and detection, and drug/vaccine development. Six research questions are explored with 50 AI/ML approaches in COVID-19, 8 AI/ML methods for patient outcome prediction, 14 AI/ML techniques in disease predictions, along with five AI/ML methods for risk assessment of COVID-19. It also covers AI/ML method in drug development, vaccines for COVID-19, models in COVID-19, datasets and their usage and dataset applications with AI/ML.
Collapse
Affiliation(s)
- Onur Dogan
- Department of Industrial Engineering, Izmir Bakircay University, 35665 Izmir, Turkey.,Research Center for Data Analytics and Spatial Data Modeling (RC-DAS), Izmir Bakircay University, 35665 Izmir, Turkey
| | - Sanju Tiwari
- Department of Computer Science, Universidad Autonoma de Tamaulipas, Ciudad Victoria, Mexico
| | - M A Jabbar
- Vardhaman College of Engineering, Kacharam, India
| | | |
Collapse
|
269
|
A new composite approach for COVID-19 detection in X-ray images using deep features. Appl Soft Comput 2021; 111:107669. [PMID: 34248447 PMCID: PMC8255192 DOI: 10.1016/j.asoc.2021.107669] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2020] [Revised: 05/23/2021] [Accepted: 06/25/2021] [Indexed: 11/23/2022]
Abstract
The new type of coronavirus, COVID 19, appeared in China at the end of 2019. It has become a pandemic that is spreading all over the world in a very short time. The detection of this disease, which has serious health and socio-economic damages, is of vital importance. COVID-19 detection is performed by applying PCR and serological tests. Additionally, COVID detection is possible using X-ray and computed tomography images. Disease detection has an important position in scientific researches that includes artificial intelligence methods. The combined models, which consist of different phases, are frequently used for classification problems. In this paper, a new combined approach is proposed to detect COVID-19 cases using deep features obtained from X-ray images. Two main variances of the approach can be presented as single layer-based (SLB) and feature fusion-based (FFB). SLB model consists of pre-processing, deep feature extraction, post-processing, and classification phases. On the other side, the FFB model consists of pre-processing, deep feature extraction, feature fusion, post-processing, and classification phases. Four different SLB and six different FFB models were developed according to the number and binary combination of layers used in the feature extraction phase. Each model is employed for binary and multi-class classification experiments. According to experimental results, the accuracy performance for COVID-19 and no-findings classification of the proposed FFB3 model is 99.52%, which is better than the best performance accuracy (of 98.08%) in the literature. Concurrently, for multi-class classification, the proposed FFB3 model has an accuracy performance of 87.64% outperforming the best existing work (which reported an 87.02% classification performance). Various metrics, including sensitivity, specificity, precision, and F1-score metrics are used for performance analysis. For all performance metrics, the FFB3 model recorded a higher success rate than existing work in the literature. To the best of our knowledge, these accuracy rates are the best in the literature for the dataset and data split type (five-fold cross-validation). Composite models (SLBs and FFBs), which are generated in this paper, are successful ways to detect COVID-19. Experimental results show that feature extraction, pre-processing, post-processing, and hyperparameter tuning are the steps are necessary to obtain a higher success. For prospective works, different types of pre-trained models and other hyperparameter tuning methods can be implemented.
Collapse
|
270
|
A CNN-based novel solution for determining the survival status of heart failure patients with clinical record data: numeric to image. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102716] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
271
|
Hu Y, Su F, Dong K, Wang X, Zhao X, Jiang Y, Li J, Ji J, Sun Y. Deep learning system for lymph node quantification and metastatic cancer identification from whole-slide pathology images. Gastric Cancer 2021; 24:868-877. [PMID: 33484355 DOI: 10.1007/s10120-021-01158-9] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/16/2020] [Accepted: 01/07/2021] [Indexed: 02/07/2023]
Abstract
BACKGROUND Traditional diagnosis methods for lymph node metastases are labor-intensive and time-consuming. As a result, diagnostic systems based on deep learning (DL) algorithms have become a hot topic. However, current research lacks testing with sufficient data to verify performance. The aim of this study was to develop and test a deep learning system capable of identifying lymph node metastases. METHODS 921 whole-slide images of lymph nodes were divided into two cohorts: training and testing. For lymph node quantification, we combined Faster RCNN and DeepLab as a cascade DL algorithm to detect regions of interest. For metastatic cancer identification, we fused Xception and DenseNet-121 models and extracted features. Prospective testing to verify the performance of the diagnostic system was performed using 327 unlabeled images. We further validated the proposed system using Positive Predictive Value (PPV) and Negative Predictive Value (NPV) criteria. RESULTS We developed a DL-based system capable of automated quantification and identification of metastatic lymph nodes. The accuracy of lymph node quantification was shown to be 97.13%. The PPV of the combined Xception and DenseNet-121 model was 93.53%, and the NPV was 97.99%. Our experimental results show that the differentiation level of metastatic cancer affects the recognition performance. CONCLUSIONS The diagnostic system we established reached a high level of efficiency and accuracy of lymph node diagnosis. This system could potentially be implemented into clinical workflow to assist pathologists in making a preliminary screening for lymph node metastases in gastric cancer patients.
Collapse
Affiliation(s)
- Yajie Hu
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education), Department of Pathology, Peking University Cancer Hospital and Institute, 52 Fucheng Road, Haidian District, Beijing, 100142, China
| | - Feng Su
- Peking-Tsinghua Center for Life Sciences, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, 100871, China
| | - Kun Dong
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education), Department of Pathology, Peking University Cancer Hospital and Institute, 52 Fucheng Road, Haidian District, Beijing, 100142, China
| | - Xinyu Wang
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education), Department of Pathology, Peking University Cancer Hospital and Institute, 52 Fucheng Road, Haidian District, Beijing, 100142, China
| | - Xinya Zhao
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education), Department of Pathology, Peking University Cancer Hospital and Institute, 52 Fucheng Road, Haidian District, Beijing, 100142, China
| | - Yumeng Jiang
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education), Department of Pathology, Peking University Cancer Hospital and Institute, 52 Fucheng Road, Haidian District, Beijing, 100142, China
| | - Jianming Li
- Institute for Artificial Intelligence, The State Key Laboratory of Intelligence Technology and Systems, Beijing National Research Center for Information Science and Technology, Department of Computer Science and Technology, Tsinghua University, Beijing, 100084, China
| | - Jiafu Ji
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education), Gastrointestinal Cancer Center, Peking University Cancer Hospital and Institute, Beijing, 100142, China
| | - Yu Sun
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education), Department of Pathology, Peking University Cancer Hospital and Institute, 52 Fucheng Road, Haidian District, Beijing, 100142, China.
| |
Collapse
|
272
|
Albahli S, Ayub N, Shiraz M. Coronavirus disease (COVID-19) detection using X-ray images and enhanced DenseNet. Appl Soft Comput 2021; 110:107645. [PMID: 34191925 PMCID: PMC8225990 DOI: 10.1016/j.asoc.2021.107645] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2020] [Revised: 06/18/2021] [Accepted: 06/23/2021] [Indexed: 12/20/2022]
Abstract
The 2019 novel coronavirus (COVID-19) originating from China, has spread rapidly among people living in other countries. According to the World Health Organization (WHO), by the end of January, more than 104 million people have been affected by COVID-19, including more than 2 million deaths. The number of COVID-19 test kits available in hospitals is reduced due to the increase in regular cases. Therefore, an automatic detection system should be introduced as a fast, alternative diagnostic to prevent COVID-19 from spreading among humans. For this purpose, three different BiT models: DenseNet, InceptionV3, and Inception-ResNetV4 have been proposed in this analysis for the diagnosis of patients infected with coronavirus pneumonia using X-ray radiographs in the chest. These three models give and examine Receiver Operating Characteristic (ROC) analyses and uncertainty matrices, using 5-fold cross-validation. We have performed the simulations which have visualized that the pre-trained DenseNet model has the best classification efficiency with 92% among two other models proposed (83.47% accuracy for inception V3 and 85.57% accuracy for Inception-ResNetV4).
Collapse
Affiliation(s)
- Saleh Albahli
- Department of Information Technology, Qassim University, Buraydah, Saudi Arabia
| | - Nasir Ayub
- Department of Computer Science, Federal Urdu University, Islamabad, 44000, Pakistan
| | - Muhammad Shiraz
- Department of Computer Science, Federal Urdu University, Islamabad, 44000, Pakistan
| |
Collapse
|
273
|
El-Rashidy N, Abdelrazik S, Abuhmed T, Amer E, Ali F, Hu JW, El-Sappagh S. Comprehensive Survey of Using Machine Learning in the COVID-19 Pandemic. Diagnostics (Basel) 2021; 11:1155. [PMID: 34202587 PMCID: PMC8303306 DOI: 10.3390/diagnostics11071155] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2021] [Revised: 05/29/2021] [Accepted: 05/31/2021] [Indexed: 12/11/2022] Open
Abstract
Since December 2019, the global health population has faced the rapid spreading of coronavirus disease (COVID-19). With the incremental acceleration of the number of infected cases, the World Health Organization (WHO) has reported COVID-19 as an epidemic that puts a heavy burden on healthcare sectors in almost every country. The potential of artificial intelligence (AI) in this context is difficult to ignore. AI companies have been racing to develop innovative tools that contribute to arm the world against this pandemic and minimize the disruption that it may cause. The main objective of this study is to survey the decisive role of AI as a technology used to fight against the COVID-19 pandemic. Five significant applications of AI for COVID-19 were found, including (1) COVID-19 diagnosis using various data types (e.g., images, sound, and text); (2) estimation of the possible future spread of the disease based on the current confirmed cases; (3) association between COVID-19 infection and patient characteristics; (4) vaccine development and drug interaction; and (5) development of supporting applications. This study also introduces a comparison between current COVID-19 datasets. Based on the limitations of the current literature, this review highlights the open research challenges that could inspire the future application of AI in COVID-19.
Collapse
Affiliation(s)
- Nora El-Rashidy
- Machine Learning and Information Retrieval Department, Faculty of Artificial Intelligence, Kafrelsheiksh University, Kafrelsheiksh 13518, Egypt
| | - Samir Abdelrazik
- Information System Department, Faculty of Computer Science and Information Systems, Mansoura University, Mansoura 13518, Egypt;
| | - Tamer Abuhmed
- College of Computing and Informatics, Sungkyunkwan University, Seoul 03063, Korea
| | - Eslam Amer
- Faculty of Computer Science, Misr International University, Cairo 11828, Egypt;
| | - Farman Ali
- Department of Software, Sejong University, Seoul 05006, Korea;
| | - Jong-Wan Hu
- Department of Civil and Environmental Engineering, Incheon National University, Incheon 22012, Korea
| | - Shaker El-Sappagh
- Centro Singular de Investigación en Tecnoloxías Intelixentes (CiTIUS), Universidade de Santiago de Compostela, 15782 Santiago de Compostela, Spain
- Information Systems Department, Faculty of Computers and Artificial Intelligence, Benha University, Banha 13518, Egypt
| |
Collapse
|
274
|
Nabavi S, Ejmalian A, Moghaddam ME, Abin AA, Frangi AF, Mohammadi M, Rad HS. Medical imaging and computational image analysis in COVID-19 diagnosis: A review. Comput Biol Med 2021; 135:104605. [PMID: 34175533 PMCID: PMC8219713 DOI: 10.1016/j.compbiomed.2021.104605] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Revised: 06/21/2021] [Accepted: 06/21/2021] [Indexed: 12/11/2022]
Abstract
Coronavirus disease (COVID-19) is an infectious disease caused by a newly discovered coronavirus. The disease presents with symptoms such as shortness of breath, fever, dry cough, and chronic fatigue, amongst others. The disease may be asymptomatic in some patients in the early stages, which can lead to increased transmission of the disease to others. This study attempts to review papers on the role of imaging and medical image computing in COVID-19 diagnosis. For this purpose, PubMed, Scopus and Google Scholar were searched to find related studies until the middle of 2021. The contribution of this study is four-fold: 1) to use as a tutorial of the field for both clinicians and technologists, 2) to comprehensively review the characteristics of COVID-19 as presented in medical images, 3) to examine automated artificial intelligence-based approaches for COVID-19 diagnosis, 4) to express the research limitations in this field and the methods used to overcome them. Using machine learning-based methods can diagnose the disease with high accuracy from medical images and reduce time, cost and error of diagnostic procedure. It is recommended to collect bulk imaging data from patients in the shortest possible time to improve the performance of COVID-19 automated diagnostic methods.
Collapse
Affiliation(s)
- Shahabedin Nabavi
- Faculty of Computer Science and Engineering, Shahid Beheshti University, Tehran, Iran.
| | - Azar Ejmalian
- Anesthesiology Research Center, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | | | - Ahmad Ali Abin
- Faculty of Computer Science and Engineering, Shahid Beheshti University, Tehran, Iran
| | - Alejandro F Frangi
- Centre for Computational Imaging and Simulation Technologies in Biomedicine (CISTIB), School of Computing, University of Leeds, Leeds, UK
| | - Mohammad Mohammadi
- Department of Medical Physics, Royal Adelaide Hospital, Adelaide, South Australia, Australia; School of Physical Sciences, The University of Adelaide, Adelaide, South Australia, Australia
| | - Hamidreza Saligheh Rad
- Quantitative MR Imaging and Spectroscopy Group (QMISG), Tehran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
275
|
Zhang J, Yu L, Chen D, Pan W, Shi C, Niu Y, Yao X, Xu X, Cheng Y. Dense GAN and multi-layer attention based lesion segmentation method for COVID-19 CT images. Biomed Signal Process Control 2021; 69:102901. [PMID: 34178095 PMCID: PMC8220920 DOI: 10.1016/j.bspc.2021.102901] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Revised: 06/11/2021] [Accepted: 06/19/2021] [Indexed: 02/01/2023]
Abstract
As the COVID-19 virus spreads around the world, testing and screening of patients have become a headache for governments. With the accumulation of clinical diagnostic data, the imaging big data features of COVID-19 are gradually clear, and CT imaging diagnosis results become more important. To obtain clear lesion information from the CT images of patients' lungs is helpful for doctors to adopt effective medical methods, and at the same time, is helpful to screen the patients with real infection. Deep learning image segmentation is widely used in the field of medical image segmentation. However, there are some challenges in using deep learning to segment the lung lesions of COVID-19 patients. Since image segmentation requires the labeling of lesion information on a pixel by pixel basis, most professional radiologists need to screen and diagnose patients on the front line, and they do not have enough energy to label a large amount of image data. In this paper, an improved Dense GAN to expand data set is developed, and a multi-layer attention mechanism method, combined with U-Net's COVID-19 pulmonary CT image segmentation, is proposed. The experimental results showed that the segmentation method proposed in this paper improved the segmentation accuracy of COVID-19 pulmonary medical CT image by comparing with other image segmentation methods.
Collapse
Affiliation(s)
- Ju Zhang
- Zhijiang College of Zhejiang University of Technology, Shaoxing 312030, China
| | - Lundun Yu
- College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China
| | - Decheng Chen
- College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China
| | - Weidong Pan
- College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China
| | - Chao Shi
- College of Information Engineering, Zhejiang University of Technology, Hangzhou 310023, China
| | - Yan Niu
- College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China
| | - Xinwei Yao
- College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China
| | - Xiaobin Xu
- Department of Medical Imaging, Zhejiang Hospital, Hangzhou 310013, China
| | - Yun Cheng
- Department of Medical Imaging, Zhejiang Hospital, Hangzhou 310013, China
| |
Collapse
|
276
|
Dey S, Bhattacharya R, Malakar S, Mirjalili S, Sarkar R. Choquet fuzzy integral-based classifier ensemble technique for COVID-19 detection. Comput Biol Med 2021; 135:104585. [PMID: 34229144 PMCID: PMC8216853 DOI: 10.1016/j.compbiomed.2021.104585] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2021] [Revised: 05/30/2021] [Accepted: 06/12/2021] [Indexed: 12/24/2022]
Abstract
The COVID-19 outbreak has resulted in a global pandemic and led to more than a million deaths to date. COVID-19 early detection is essential for its mitigation by controlling its spread from infected patients in communities through quarantine. Although vaccination has started, it will take time to reach everyone, especially in developing nations, and computer scientists are striving to come up with competent methods using image analysis. In this work, a classifier ensemble technique is proposed, utilizing Choquet fuzzy integral, wherein convolutional neural network (CNN) based models are used as base classifiers. It classifies chest X-ray images from patients with common Pneumonia, confirmed COVID-19, and healthy lungs. Since there are few samples of COVID-19 cases for training on a standard CNN model from scratch, we use the transfer learning scheme to train the base classifiers, which are InceptionV3, DenseNet121, and VGG19. We utilize the pre-trained CNN models to extract features and classify the chest X-ray images using two dense layers and one softmax layer. After that, we combine the prediction scores of the data from individual models using Choquet fuzzy integral to get the final predicted labels, which is more accurate than the prediction by the individual models. To determine the fuzzy-membership values of each classifier for the application of Choquet fuzzy integral, we use the validation accuracy of each classifier. The proposed method is evaluated on chest X-ray images in publicly available repositories (IEEE and Kaggle datasets). It provides 99.00%, 99.00%, 99.00%, and 99.02% average recall, precision, F-score, and accuracy, respectively. We have also evaluated the performance of the proposed model on an inter-dataset experimental setup, where chest X-ray images from another dataset (CMSC-678-ML-Project GitHub dataset) are fed to our trained model and we have achieved 99.05% test accuracy on this dataset. The results are better than commonly used classifier ensemble methods as well as many state-of-the-art methods.
Collapse
Affiliation(s)
- Subhrajit Dey
- Department of Electrical Engineering, Jadavpur University, Kolkata, 700032, India.
| | - Rajdeep Bhattacharya
- Department of Computer Science and Engineering, Jadavpur University, Kolkata, 700032, India.
| | - Samir Malakar
- Department of Computer Science, Asutosh College, Kolkata, 700026, India.
| | - Seyedali Mirjalili
- Centre for Artificial Intelligence Research and Optimisation, Torrens University Australia, Fortitude Valley, Brisbane, QLD, 4006, Australia; Yonsei Frontier Lab, Yonsei University, Seoul, South Korea; King Abdulaziz University, Jeddah, Saudi Arabia.
| | - Ram Sarkar
- Department of Computer Science and Engineering, Jadavpur University, Kolkata, 700032, India.
| |
Collapse
|
277
|
Berta L, Rizzetto F, De Mattia C, Lizio D, Felisi M, Colombo PE, Carrazza S, Gelmini S, Bianchi L, Artioli D, Travaglini F, Vanzulli A, Torresin A. Automatic lung segmentation in COVID-19 patients: Impact on quantitative computed tomography analysis. Phys Med 2021; 87:115-122. [PMID: 34139383 PMCID: PMC9188767 DOI: 10.1016/j.ejmp.2021.06.001] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/31/2021] [Revised: 05/05/2021] [Accepted: 06/04/2021] [Indexed: 12/04/2022] Open
Abstract
Purpose To assess the impact of lung segmentation accuracy in an automatic pipeline for quantitative analysis of CT images. Methods Four different platforms for automatic lung segmentation based on convolutional neural network (CNN), region-growing technique and atlas-based algorithm were considered. The platforms were tested using CT images of 55 COVID-19 patients with severe lung impairment. Four radiologists assessed the segmentations using a 5-point qualitative score (QS). For each CT series, a manually revised reference segmentation (RS) was obtained. Histogram-based quantitative metrics (QM) were calculated from CT histogram using lung segmentationsfrom all platforms and RS. Dice index (DI) and differences of QMs (ΔQMs) were calculated between RS and other segmentations. Results Highest QS and lower ΔQMs values were associated to the CNN algorithm. However, only 45% CNN segmentations were judged to need no or only minimal corrections, and in only 17 cases (31%), automatic segmentations provided RS without manual corrections. Median values of the DI for the four algorithms ranged from 0.993 to 0.904. Significant differences for all QMs calculated between automatic segmentations and RS were found both when data were pooled together and stratified according to QS, indicating a relationship between qualitative and quantitative measurements. The most unstable QM was the histogram 90th percentile, with median ΔQMs values ranging from 10HU and 158HU between different algorithms. Conclusions None of tested algorithms provided fully reliable segmentation. Segmentation accuracy impacts differently on different quantitative metrics, and each of them should be individually evaluated according to the purpose of subsequent analyses.
Collapse
Affiliation(s)
- L Berta
- Department of Medical Physics, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162 Milan, Italy
| | - F Rizzetto
- Department of Radiology, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162 Milan, Italy; Postgraduate School of Diagnostic and Interventional Radiology, Università degli Studi di Milano, via Festa del Perdono 7, 20122, Milan, Italy
| | - C De Mattia
- Department of Medical Physics, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162 Milan, Italy
| | - D Lizio
- Department of Medical Physics, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162 Milan, Italy
| | - M Felisi
- Department of Medical Physics, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162 Milan, Italy
| | - P E Colombo
- Department of Medical Physics, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162 Milan, Italy
| | - S Carrazza
- Department of Physics, Università degli Studi di Milano, via Giovanni Celoria 16, 20133 Milan, Italy; Department of Physics, INFN Sezione di Milano, via Giovanni Celoria 16, 20133 Milan, Italy
| | - S Gelmini
- Department of Physics, Università degli Studi di Milano, via Giovanni Celoria 16, 20133 Milan, Italy
| | - L Bianchi
- Department of Radiology, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162 Milan, Italy; Postgraduate School of Diagnostic and Interventional Radiology, Università degli Studi di Milano, via Festa del Perdono 7, 20122, Milan, Italy
| | - D Artioli
- Department of Radiology, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162 Milan, Italy
| | - F Travaglini
- Department of Radiology, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162 Milan, Italy
| | - A Vanzulli
- Department of Radiology, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162 Milan, Italy; Department of Oncology and Hemato-Oncology, Università degli Studi di Milano, via Festa del Perdono 7, 20122, Milan, Italy
| | - A Torresin
- Department of Medical Physics, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162 Milan, Italy; Department of Physics, Università degli Studi di Milano, via Giovanni Celoria 16, 20133 Milan, Italy.
| | | |
Collapse
|
278
|
Facial Recognition System for People with and without Face Mask in Times of the COVID-19 Pandemic. SUSTAINABILITY 2021. [DOI: 10.3390/su13126900] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
In the face of the COVID-19 pandemic, the World Health Organization (WHO) declared the use of a face mask as a mandatory biosafety measure. This has caused problems in current facial recognition systems, motivating the development of this research. This manuscript describes the development of a system for recognizing people, even when they are using a face mask, from photographs. A classification model based on the MobileNetV2 architecture and the OpenCv’s face detector is used. Thus, using these stages, it can be identified where the face is and it can be determined whether or not it is wearing a face mask. The FaceNet model is used as a feature extractor and a feedforward multilayer perceptron to perform facial recognition. For training the facial recognition models, a set of observations made up of 13,359 images is generated; 52.9% images with a face mask and 47.1% images without a face mask. The experimental results show that there is an accuracy of 99.65% in determining whether a person is wearing a mask or not. An accuracy of 99.52% is achieved in the facial recognition of 10 people with masks, while for facial recognition without masks, an accuracy of 99.96% is obtained.
Collapse
|
279
|
Scat-NET: COVID-19 diagnosis with a CNN model using scattergram images. Comput Biol Med 2021; 135:104579. [PMID: 34171641 PMCID: PMC8217791 DOI: 10.1016/j.compbiomed.2021.104579] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Revised: 06/10/2021] [Accepted: 06/11/2021] [Indexed: 11/20/2022]
Abstract
The acute respiratory syndrome COVID-19 disease, which is caused by SARS-CoV-2, has infected many people over a short time and caused the death of more than 2 million people. The gold standard in detecting COVID-19 is to apply the reverse transcription polymerase chain reaction (RT-PCR) test. This test has low sensitivity and produces false results of approximately 15%-20%. Computer tomography (CT) images were checked as a result of suspicious RT-PCR tests. If the virus is not infected in the lung, the virus is not observed on CT lung images. To overcome this problem, we propose a 25-depth convolutional neural network (CNN) model that uses scattergram images, which we call Scat-NET. Scattergram images are frequently used to reveal the numbers of neutrophils, eosinophils, basophils, lymphocytes and monocytes, which are measurements used in evaluating disease symptoms, and the relationships between them. To the best of our knowledge, using the CNN together with scattergram images in the detection of COVID-19 is the first study on this subject. Scattergram images obtained from 335 patients in total were classified using the Scat-NET architecture. The overall accuracy was 92.4%. The most striking finding in the results obtained was that COVID-19 patients with negative RT-PCR tests but positive CT test results were positive. As a result, we emphasize that the Scat-NET model will be an alternative to CT scans and could be applied as a secondary test for patients with negative RT-PCR tests.
Collapse
|
280
|
Ding W, Nayak J, Swapnarekha H, Abraham A, Naik B, Pelusi D. Fusion of intelligent learning for COVID-19: A state-of-the-art review and analysis on real medical data. Neurocomputing 2021; 457:40-66. [PMID: 34149184 PMCID: PMC8206574 DOI: 10.1016/j.neucom.2021.06.024] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2021] [Revised: 06/02/2021] [Accepted: 06/11/2021] [Indexed: 12/11/2022]
Abstract
The unprecedented surge of a novel coronavirus in the month of December 2019, named as COVID-19 by the World Health organization has caused a serious impact on the health and socioeconomic activities of the public all over the world. Since its origin, the number of infected and deceased cases has been growing exponentially in almost all the affected countries of the world. The rapid spread of the novel coronavirus across the world results in the scarcity of medical resources and overburdened hospitals. As a result, the researchers and technocrats are continuously working across the world for the inculcation of efficient strategies which may assist the government and healthcare system in controlling and managing the spread of the COVID-19 pandemic. Therefore, this study provides an extensive review of the ongoing strategies such as diagnosis, prediction, drug and vaccine development and preventive measures used in combating the COVID-19 along with technologies used and limitations. Moreover, this review also provides a comparative analysis of the distinct type of data, emerging technologies, approaches used in diagnosis and prediction of COVID-19, statistics of contact tracing apps, vaccine production platforms used in the COVID-19 pandemic. Finally, the study highlights some challenges and pitfalls observed in the systematic review which may assist the researchers to develop more efficient strategies used in controlling and managing the spread of COVID-19.
Collapse
Affiliation(s)
- Weiping Ding
- School of Information Science and Technology, Nantong University, China
| | - Janmenjoy Nayak
- Aditya Institute of Technology and Management (AITAM), India
| | - H Swapnarekha
- Aditya Institute of Technology and Management (AITAM), India
- Veer Surendra Sai University of Technology, India
| | | | | | | |
Collapse
|
281
|
Hagita K, Aoyagi T, Abe Y, Genda S, Honda T. Deep learning-based estimation of Flory-Huggins parameter of A-B block copolymers from cross-sectional images of phase-separated structures. Sci Rep 2021; 11:12322. [PMID: 34112914 PMCID: PMC8192782 DOI: 10.1038/s41598-021-91761-8] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2021] [Accepted: 05/31/2021] [Indexed: 02/05/2023] Open
Abstract
In this study, deep learning (DL)-based estimation of the Flory-Huggins χ parameter of A-B diblock copolymers from two-dimensional cross-sectional images of three-dimensional (3D) phase-separated structures were investigated. 3D structures with random networks of phase-separated domains were generated from real-space self-consistent field simulations in the 25-40 χN range for chain lengths (N) of 20 and 40. To confirm that the prepared data can be discriminated using DL, image classification was performed using the VGG-16 network. We comprehensively investigated the performances of the learned networks in the regression problem. The generalization ability was evaluated from independent images with the unlearned χN. We found that, except for large χN values, the standard deviation values were approximately 0.1 and 0.5 for A-component fractions of 0.2 and 0.35, respectively. The images for larger χN values were more difficult to distinguish. In addition, the learning performances for the 4-class problem were comparable to those for the 8-class problem, except when the χN values were large. This information is useful for the analysis of real experimental image data, where the variation of samples is limited.
Collapse
Affiliation(s)
- Katsumi Hagita
- Department of Applied Physics, National Defense Academy, 1-10-20 Hashirimizu, Yokosuka, 239-8686, Japan.
| | - Takeshi Aoyagi
- Research Center for Computational Design of Advanced Functional Materials, National Institute of Advanced Industrial Science and Technology, Central 2, 1-1-1, Umezono, Tsukuba, Ibaraki, 305-8568, Japan
| | - Yuto Abe
- Department of Applied Physics, National Defense Academy, 1-10-20 Hashirimizu, Yokosuka, 239-8686, Japan
| | - Shinya Genda
- Department of Applied Physics, National Defense Academy, 1-10-20 Hashirimizu, Yokosuka, 239-8686, Japan
| | - Takashi Honda
- Zeon Corporation, 1-2-1 Yako, Kawasaki-ku, Kawasaki, 210-9507, Japan
| |
Collapse
|
282
|
Yanamala N, Krishna NH, Hathaway QA, Radhakrishnan A, Sunkara S, Patel H, Farjo P, Patel B, Sengupta PP. A vital sign-based prediction algorithm for differentiating COVID-19 versus seasonal influenza in hospitalized patients. NPJ Digit Med 2021; 4:95. [PMID: 34088961 PMCID: PMC8178379 DOI: 10.1038/s41746-021-00467-8] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2020] [Accepted: 05/06/2021] [Indexed: 11/19/2022] Open
Abstract
Patients with influenza and SARS-CoV2/Coronavirus disease 2019 (COVID-19) infections have a different clinical course and outcomes. We developed and validated a supervised machine learning pipeline to distinguish the two viral infections using the available vital signs and demographic dataset from the first hospital/emergency room encounters of 3883 patients who had confirmed diagnoses of influenza A/B, COVID-19 or negative laboratory test results. The models were able to achieve an area under the receiver operating characteristic curve (ROC AUC) of at least 97% using our multiclass classifier. The predictive models were externally validated on 15,697 encounters in 3125 patients available on TrinetX database that contains patient-level data from different healthcare organizations. The influenza vs COVID-19-positive model had an AUC of 98.8%, and 92.8% on the internal and external test sets, respectively. Our study illustrates the potentials of machine-learning models for accurately distinguishing the two viral infections. The code is made available at https://github.com/ynaveena/COVID-19-vs-Influenza and may have utility as a frontline diagnostic tool to aid healthcare workers in triaging patients once the two viral infections start cocirculating in the communities.
Collapse
Affiliation(s)
- Naveena Yanamala
- Division of Cardiology, West Virginia University Medicine Heart & Vascular Institute, Morgantown, WV, USA. .,Institute for Software Research, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA.
| | - Nanda H Krishna
- Division of Cardiology, West Virginia University Medicine Heart & Vascular Institute, Morgantown, WV, USA.,Institute for Software Research, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Quincy A Hathaway
- Division of Cardiology, West Virginia University Medicine Heart & Vascular Institute, Morgantown, WV, USA
| | - Aditya Radhakrishnan
- Division of Cardiology, West Virginia University Medicine Heart & Vascular Institute, Morgantown, WV, USA.,Institute for Software Research, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Srinidhi Sunkara
- Division of Cardiology, West Virginia University Medicine Heart & Vascular Institute, Morgantown, WV, USA.,Institute for Software Research, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Heenaben Patel
- Division of Cardiology, West Virginia University Medicine Heart & Vascular Institute, Morgantown, WV, USA
| | - Peter Farjo
- Division of Cardiology, West Virginia University Medicine Heart & Vascular Institute, Morgantown, WV, USA
| | - Brijesh Patel
- Division of Cardiology, West Virginia University Medicine Heart & Vascular Institute, Morgantown, WV, USA
| | - Partho P Sengupta
- Division of Cardiology, West Virginia University Medicine Heart & Vascular Institute, Morgantown, WV, USA.
| |
Collapse
|
283
|
Serena Low WC, Chuah JH, Tee CATH, Anis S, Shoaib MA, Faisal A, Khalil A, Lai KW. An Overview of Deep Learning Techniques on Chest X-Ray and CT Scan Identification of COVID-19. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2021; 2021:5528144. [PMID: 34194535 PMCID: PMC8184329 DOI: 10.1155/2021/5528144] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Revised: 04/19/2021] [Accepted: 05/19/2021] [Indexed: 12/15/2022]
Abstract
Pneumonia is an infamous life-threatening lung bacterial or viral infection. The latest viral infection endangering the lives of many people worldwide is the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which causes COVID-19. This paper is aimed at detecting and differentiating viral pneumonia and COVID-19 disease using digital X-ray images. The current practices include tedious conventional processes that solely rely on the radiologist or medical consultant's technical expertise that are limited, time-consuming, inefficient, and outdated. The implementation is easily prone to human errors of being misdiagnosed. The development of deep learning and technology improvement allows medical scientists and researchers to venture into various neural networks and algorithms to develop applications, tools, and instruments that can further support medical radiologists. This paper presents an overview of deep learning techniques made in the chest radiography on COVID-19 and pneumonia cases.
Collapse
Affiliation(s)
- Woan Ching Serena Low
- Department of Electrical Engineering, Faculty of Engineering, University of Malaya, 40603 Kuala Lumpur, Malaysia
| | - Joon Huang Chuah
- Department of Electrical Engineering, Faculty of Engineering, University of Malaya, 40603 Kuala Lumpur, Malaysia
| | - Clarence Augustine T. H. Tee
- Department of Electrical Engineering, Faculty of Engineering, University of Malaya, 40603 Kuala Lumpur, Malaysia
| | - Shazia Anis
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, 40603 Kuala Lumpur, Malaysia
| | - Muhammad Ali Shoaib
- Department of Electrical Engineering, Faculty of Engineering, University of Malaya, 40603 Kuala Lumpur, Malaysia
| | - Amir Faisal
- Department of Biomedical Engineering, Faculty of Production and Industrial Technology, Institut Teknologi Sumatera, Lampung 35365, Indonesia
| | - Azira Khalil
- Faculty of Science and Technology, Universiti Sains Islam Malaysia, 71800 Nilai, Negeri Sembilan, Malaysia
| | - Khin Wee Lai
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, 40603 Kuala Lumpur, Malaysia
| |
Collapse
|
284
|
Owais M, Lee YW, Mahmood T, Haider A, Sultan H, Park KR. Multilevel Deep-Aggregated Boosted Network to Recognize COVID-19 Infection from Large-Scale Heterogeneous Radiographic Data. IEEE J Biomed Health Inform 2021; 25:1881-1891. [PMID: 33835928 PMCID: PMC8545161 DOI: 10.1109/jbhi.2021.3072076] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
In the present epidemic of the coronavirus disease 2019 (COVID-19), radiological imaging modalities, such as X-ray and computed tomography (CT), have been identified as effective diagnostic tools. However, the subjective assessment of radiographic examination is a time-consuming task and demands expert radiologists. Recent advancements in artificial intelligence have enhanced the diagnostic power of computer-aided diagnosis (CAD) tools and assisted medical specialists in making efficient diagnostic decisions. In this work, we propose an optimal multilevel deep-aggregated boosted network to recognize COVID-19 infection from heterogeneous radiographic data, including X-ray and CT images. Our method leverages multilevel deep-aggregated features and multistage training via a mutually beneficial approach to maximize the overall CAD performance. To improve the interpretation of CAD predictions, these multilevel deep features are visualized as additional outputs that can assist radiologists in validating the CAD results. A total of six publicly available datasets were fused to build a single large-scale heterogeneous radiographic collection that was used to analyze the performance of the proposed technique and other baseline methods. To preserve generality of our method, we selected different patient data for training, validation, and testing, and consequently, the data of same patient were not included in training, validation, and testing subsets. In addition, fivefold cross-validation was performed in all the experiments for a fair evaluation. Our method exhibits promising performance values of 95.38%, 95.57%, 92.53%, 98.14%, 93.16%, and 98.55% in terms of average accuracy, F-measure, specificity, sensitivity, precision, and area under the curve, respectively and outperforms various state-of-the-art methods.
Collapse
|
285
|
Polat H, Özerdem MS, Ekici F, Akpolat V. Automatic detection and localization of COVID-19 pneumonia using axial computed tomography images and deep convolutional neural networks. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY 2021; 31:509-524. [PMID: 33821092 PMCID: PMC8013431 DOI: 10.1002/ima.22558] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/22/2020] [Revised: 01/09/2021] [Accepted: 01/27/2021] [Indexed: 05/13/2023]
Abstract
COVID-19 was first reported as an unknown group of pneumonia in Wuhan City, Hubei province of China in late December of 2019. The rapid increase in the number of cases diagnosed with COVID-19 and the lack of experienced radiologists can cause diagnostic errors in the interpretation of the images along with the exceptional workload occurring in this process. Therefore, the urgent development of automated diagnostic systems that can scan radiological images quickly and accurately is important in combating the pandemic. With this motivation, a deep convolutional neural network (CNN)-based model that can automatically detect patterns related to lesions caused by COVID-19 from chest computed tomography (CT) images is proposed in this study. In this context, the image ground-truth regarding the COVID-19 lesions scanned by the radiologist was evaluated as the main criteria of the segmentation process. A total of 16 040 CT image segments were obtained by applying segmentation to the raw 102 CT images. Then, 10 420 CT image segments related to healthy lung regions were labeled as COVID-negative, and 5620 CT image segments, in which the findings related to the lesions were detected in various forms, were labeled as COVID-positive. With the proposed CNN architecture, 93.26% diagnostic accuracy performance was achieved. The sensitivity and specificity performance metrics for the proposed automatic diagnosis model were 93.27% and 93.24%, respectively. Additionally, it has been shown that by scanning the small regions of the lungs, COVID-19 pneumonia can be localized automatically with high resolution and the lesion densities can be successfully evaluated quantitatively.
Collapse
Affiliation(s)
- Hasan Polat
- Department of Electrical and EnergyBingol UniversityBingölTurkey
| | - Mehmet Siraç Özerdem
- Department of Electrical and Electronics EngineeringDicle UniversityDiyarbakırTurkey
| | - Faysal Ekici
- Department of RadiologyDicle UniversityDiyarbakırTurkey
| | - Veysi Akpolat
- Department of BiophysicsDicle UniversityDiyarbakırTurkey
| |
Collapse
|
286
|
Developing an efficient deep neural network for automatic detection of COVID-19 using chest X-ray images. ALEXANDRIA ENGINEERING JOURNAL 2021; 60. [PMCID: PMC7825895 DOI: 10.1016/j.aej.2021.01.011] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/02/2023]
Abstract
The novel coronavirus (COVID-19) could be described as the greatest human challenge of the 21st century. The development and transmission of the disease have increased mortality in all countries. Therefore, a rapid diagnosis of COVID-19 is necessary to treat and control the disease. In this paper, a new method for the automatic identification of pneumonia (including COVID-19) is presented using a proposed deep neural network. In the proposed method, the chest X-ray images are used to separate 2–4 classes in 7 different and functional scenarios according to healthy, viral, bacterial, and COVID-19 classes. In the proposed architecture, Generative Adversarial Networks (GANs) are used together with a fusion of the deep transfer learning and LSTM networks, without involving feature extraction/selection for classification of pneumonia. We have achieved more than 90% accuracy for all scenarios except one and also achieved 99% accuracy for separating COVID-19 from healthy group. We also compared our deep proposed network with other deep transfer learning networks (including Inception-ResNet V2, Inception V4, VGG16 and MobileNet) that have been recently widely used in pneumonia detection studies. The results based on the proposed network were very promising in terms of accuracy, precision, sensitivity, and specificity compared to the other deep transfer learning approaches. Depending on the high performance of the proposed method, it can be used during the treatment of patients.
Collapse
|
287
|
Jahmunah V, Sudarshan VK, Oh SL, Gururajan R, Gururajan R, Zhou X, Tao X, Faust O, Ciaccio EJ, Ng KH, Acharya UR. Future IoT tools for COVID-19 contact tracing and prediction: A review of the state-of-the-science. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY 2021; 31:455-471. [PMID: 33821093 PMCID: PMC8013643 DOI: 10.1002/ima.22552] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/08/2020] [Revised: 12/13/2020] [Accepted: 01/04/2021] [Indexed: 05/17/2023]
Abstract
In 2020 the world is facing unprecedented challenges due to COVID-19. To address these challenges, many digital tools are being explored and developed to contain the spread of the disease. With the lack of availability of vaccines, there is an urgent need to avert resurgence of infections by putting some measures, such as contact tracing, in place. While digital tools, such as phone applications are advantageous, they also pose challenges and have limitations (eg, wireless coverage could be an issue in some cases). On the other hand, wearable devices, when coupled with the Internet of Things (IoT), are expected to influence lifestyle and healthcare directly, and they may be useful for health monitoring during the global pandemic and beyond. In this work, we conduct a literature review of contact tracing methods and applications. Based on the literature review, we found limitations in gathering health data, such as insufficient network coverage. To address these shortcomings, we propose a novel intelligent tool that will be useful for contact tracing and prediction of COVID-19 clusters. The solution comprises a phone application combined with a wearable device, infused with unique intelligent IoT features (complex data analysis and intelligent data visualization) embedded within the system to aid in COVID-19 analysis. Contact tracing applications must establish data collection and data interpretation. Intelligent data interpretation can assist epidemiological scientists in anticipating clusters, and can enable them to take necessary action in improving public health management. Our proposed tool could also be used to curb disease incidence in future global health crises.
Collapse
Affiliation(s)
| | - Vidya K. Sudarshan
- Biomedical EngineeringSchool of Social Science and Technology, Singapore University of Social SciencesSingaporeSingapore
| | - Shu Lih Oh
- School of EngineeringNgee Ann PolytechnicSingaporeSingapore
| | - Raj Gururajan
- School of Management and EnterpriseUniversity of Southern QueenslandToowoombaQueenslandAustralia
| | | | - Xujuan Zhou
- School of Management and EnterpriseUniversity of Southern QueenslandToowoombaQueenslandAustralia
| | - Xiaohui Tao
- Faculty of Health, Engineering and SciencesUniversity of QueenslandBrisbaneAustralia
| | - Oliver Faust
- Department of Engineering and MathematicsSheffield Hallam UniversitySheffieldUnited Kingdom
| | - Edward J. Ciaccio
- Department of Medicine – CardiologyColumbia UniversityNew YorkNew YorkUSA
| | - Kwan Hoong Ng
- Department of Biomedical ImagingUniversity of MalayaKuala LumpurMalaysia
- Department of Medical Imaging and Radiological SciencesCollege of Health Sciences, Kaohsiung Medical UniversityKaohsiungTaiwan
| | - U. Rajendra Acharya
- School of EngineeringNgee Ann PolytechnicSingaporeSingapore
- Biomedical EngineeringSchool of Social Science and Technology, Singapore University of Social SciencesSingaporeSingapore
- School of Management and EnterpriseUniversity of Southern QueenslandToowoombaQueenslandAustralia
- International Research Organization for Advanced Science and Technology (IROAST)Kumamoto UniversityKumamotoJapan
- Department Bioinformatics and Medical EngineeringAsia UniversityWufengTaiwan
| |
Collapse
|
288
|
Khanday NY, Sofi SA. Deep insight: Convolutional neural network and its applications for COVID-19 prognosis. Biomed Signal Process Control 2021; 69:102814. [PMID: 34093724 PMCID: PMC8162826 DOI: 10.1016/j.bspc.2021.102814] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2021] [Revised: 05/18/2021] [Accepted: 05/23/2021] [Indexed: 12/24/2022]
Abstract
Background and objective SARS-CoV-2, a novel strain of coronavirus' also called coronavirus disease 19 (COVID-19), a highly contagious pathogenic respiratory viral infection emerged in December 2019 in Wuhan, a city in China's Hubei province without an obvious cause. Very rapidly it spread across the globe (over 200 countries and territories) and finally on 11 March 2020 World Health Organisation characterized it as a "pandemic". Although it has low mortality of around 3% as of 18 May 2021 it has already infected 164,316,270 humans with 3,406,027 unfortunate deaths. Undoubtedly the world was rocked by the COVID-19 pandemic, but researchers rose to all manner of challenges to tackle this pandemic by adopting the shreds of evidence of ML and AI in previous epidemics to develop novel models, methods, and strategies. We aim to provide a deeper insight into the convolutional neural network which is the most notable and extensively adopted technique on radiographic visual imagery to help expert medical practitioners and researchers to design and finetune their state-of-the-art models for their applicability in the arena of COVID-19. Method In this study, a deep convolutional neural network, its layers, activation and loss functions, regularization techniques, tools, methods, variants, and recent developments were explored to find its applications for COVID-19 prognosis. The pipeline of a general architecture for COVID-19 prognosis has also been proposed. Result This paper highlights recent studies of deep CNN and its applications for better prognosis, detection, classification, and screening of COVID-19 to help researchers and expert medical community in multiple directions. It also addresses a few challenges, limitations, and outlooks while using such methods for COVID-19 prognosis. Conclusion The recent and ongoing developments in AI, MI, and deep learning (Deep CNN) has shown promising results and significantly improved performance metrics for screening, prediction, detection, classification, forecasting, medication, treatment, contact tracing, etc. to curtail the manual intervention in medical practice. However, the research community of medical experts is yet to recognize and label the benchmark of the deep learning framework for effective detection of COVID-19 positive cases from radiology imagery.
Collapse
Affiliation(s)
| | - Shabir Ahmad Sofi
- National Institute of Technology Srinagar, Jammu and Kashmir 19006, India
| |
Collapse
|
289
|
Ibrahim MR, Youssef SM, Fathalla KM. Abnormality detection and intelligent severity assessment of human chest computed tomography scans using deep learning: a case study on SARS-COV-2 assessment. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING 2021; 14:5665-5688. [PMID: 34055098 PMCID: PMC8147594 DOI: 10.1007/s12652-021-03282-x] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Accepted: 04/19/2021] [Indexed: 05/07/2023]
Abstract
Different respiratory infections cause abnormal symptoms in lung parenchyma that show in chest computed tomography. Since December 2019, the SARS-COV-2 virus, which is the causative agent of COVID-19, has invaded the world causing high numbers of infections and deaths. The infection with SARS-COV-2 virus shows an abnormality in lung parenchyma that can be effectively detected using Computed Tomography (CT) imaging. In this paper, a novel computer aided framework (COV-CAF) is proposed for classifying the severity degree of the infection from 3D Chest Volumes. COV-CAF fuses traditional and deep learning approaches. The proposed COV-CAF consists of two phases: the preparatory phase and the feature analysis and classification phase. The preparatory phase handles 3D-CT volumes and presents an effective cut choice strategy for choosing informative CT slices. The feature analysis and classification phase incorporate fuzzy clustering for automatic Region of Interest (RoI) segmentation and feature fusion. In feature fusion, automatic features are extracted from a newly introduced Convolution Neural Network (Norm-VGG16) and are fused with spatial hand-crafted features extracted from segmented RoI. Experiments are conducted on MosMedData: Chest CT Scans with COVID-19 Related Findings with COVID-19 severity classes and SARS-COV-2 CT-Scan benchmark datasets. The proposed COV-CAF achieved remarkable results on both datasets. On MosMedData dataset, it achieved an overall accuracy of 97.76% and average sensitivity of 96.73%, while on SARS-COV-2 CT-Scan dataset it achieves an overall accuracy and sensitivity 97.59% and 98.41% respectively.
Collapse
Affiliation(s)
- Mohamed Ramzy Ibrahim
- Computer Engineering Department, Arab Academy for Science, Technology and Maritime Transport (AASTMT), Alexandria, 1029 Egypt
| | - Sherin M. Youssef
- Computer Engineering Department, Arab Academy for Science, Technology and Maritime Transport (AASTMT), Alexandria, 1029 Egypt
| | - Karma M. Fathalla
- Computer Engineering Department, Arab Academy for Science, Technology and Maritime Transport (AASTMT), Alexandria, 1029 Egypt
| |
Collapse
|
290
|
Ozdemir MA, Ozdemir GD, Guren O. Classification of COVID-19 electrocardiograms by using hexaxial feature mapping and deep learning. BMC Med Inform Decis Mak 2021; 21:170. [PMID: 34034715 PMCID: PMC8146190 DOI: 10.1186/s12911-021-01521-x] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2021] [Accepted: 05/05/2021] [Indexed: 12/17/2022] Open
Abstract
BACKGROUND Coronavirus disease 2019 (COVID-19) has become a pandemic since its first appearance in late 2019. Deaths caused by COVID-19 are still increasing day by day and early diagnosis has become crucial. Since current diagnostic methods have many disadvantages, new investigations are needed to improve the performance of diagnosis. METHODS A novel method is proposed to automatically diagnose COVID-19 by using Electrocardiogram (ECG) data with deep learning for the first time. Moreover, a new and effective method called hexaxial feature mapping is proposed to represent 12-lead ECG to 2D colorful images. Gray-Level Co-Occurrence Matrix (GLCM) method is used to extract features and generate hexaxial mapping images. These generated images are then fed into a new Convolutional Neural Network (CNN) architecture to diagnose COVID-19. RESULTS Two different classification scenarios are conducted on a publicly available paper-based ECG image dataset to reveal the diagnostic capability and performance of the proposed approach. In the first scenario, ECG data labeled as COVID-19 and No-Findings (normal) are classified to evaluate COVID-19 classification ability. According to results, the proposed approach provides encouraging COVID-19 detection performance with an accuracy of 96.20% and F1-Score of 96.30%. In the second scenario, ECG data labeled as Negative (normal, abnormal, and myocardial infarction) and Positive (COVID-19) are classified to evaluate COVID-19 diagnostic ability. The experimental results demonstrated that the proposed approach provides satisfactory COVID-19 prediction performance with an accuracy of 93.00% and F1-Score of 93.20%. Furthermore, different experimental studies are conducted to evaluate the robustness of the proposed approach. CONCLUSION Automatic detection of cardiovascular changes caused by COVID-19 can be possible with a deep learning framework through ECG data. This not only proves the presence of cardiovascular changes caused by COVID-19 but also reveals that ECG can potentially be used in the diagnosis of COVID-19. We believe the proposed study may provide a crucial decision-making system for healthcare professionals. SOURCE CODE All source codes are made publicly available at: https://github.com/mkfzdmr/COVID-19-ECG-Classification.
Collapse
Affiliation(s)
- Mehmet Akif Ozdemir
- Department of Biomedical Engineering, Faculty of Enigneering and Architecture, Izmir Katip Celebi University, 35620 Cigli, Izmir, Turkey
- Department of Biomedical Technologies, Graduate School of Natural and Applied Sciences, Izmir Katip Celebi University, 35620 Cigli, Izmir, Turkey
| | - Gizem Dilara Ozdemir
- Department of Biomedical Engineering, Faculty of Enigneering and Architecture, Izmir Katip Celebi University, 35620 Cigli, Izmir, Turkey
- Department of Biomedical Technologies, Graduate School of Natural and Applied Sciences, Izmir Katip Celebi University, 35620 Cigli, Izmir, Turkey
| | - Onan Guren
- Department of Biomedical Engineering, Faculty of Enigneering and Architecture, Izmir Katip Celebi University, 35620 Cigli, Izmir, Turkey
| |
Collapse
|
291
|
Abdulkareem M, Petersen SE. The Promise of AI in Detection, Diagnosis, and Epidemiology for Combating COVID-19: Beyond the Hype. Front Artif Intell 2021; 4:652669. [PMID: 34056579 PMCID: PMC8160471 DOI: 10.3389/frai.2021.652669] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2021] [Accepted: 04/13/2021] [Indexed: 12/24/2022] Open
Abstract
COVID-19 has created enormous suffering, affecting lives, and causing deaths. The ease with which this type of coronavirus can spread has exposed weaknesses of many healthcare systems around the world. Since its emergence, many governments, research communities, commercial enterprises, and other institutions and stakeholders around the world have been fighting in various ways to curb the spread of the disease. Science and technology have helped in the implementation of policies of many governments that are directed toward mitigating the impacts of the pandemic and in diagnosing and providing care for the disease. Recent technological tools, artificial intelligence (AI) tools in particular, have also been explored to track the spread of the coronavirus, identify patients with high mortality risk and diagnose patients for the disease. In this paper, areas where AI techniques are being used in the detection, diagnosis and epidemiological predictions, forecasting and social control for combating COVID-19 are discussed, highlighting areas of successful applications and underscoring issues that need to be addressed to achieve significant progress in battling COVID-19 and future pandemics. Several AI systems have been developed for diagnosing COVID-19 using medical imaging modalities such as chest CT and X-ray images. These AI systems mainly differ in their choices of the algorithms for image segmentation, classification and disease diagnosis. Other AI-based systems have focused on predicting mortality rate, long-term patient hospitalization and patient outcomes for COVID-19. AI has huge potential in the battle against the COVID-19 pandemic but successful practical deployments of these AI-based tools have so far been limited due to challenges such as limited data accessibility, the need for external evaluation of AI models, the lack of awareness of AI experts of the regulatory landscape governing the deployment of AI tools in healthcare, the need for clinicians and other experts to work with AI experts in a multidisciplinary context and the need to address public concerns over data collection, privacy, and protection. Having a dedicated team with expertise in medical data collection, privacy, access and sharing, using federated learning whereby AI scientists hand over training algorithms to the healthcare institutions to train models locally, and taking full advantage of biomedical data stored in biobanks can alleviate some of problems posed by these challenges. Addressing these challenges will ultimately accelerate the translation of AI research into practical and useful solutions for combating pandemics.
Collapse
Affiliation(s)
- Musa Abdulkareem
- Barts Heart Centre, Barts Health National Health Service (NHS) Trust, London, United Kingdom
- National Institute for Health Research (NIHR) Barts Biomedical Research Centre, William Harvey Research Institute, Queen Mary University of London, London, United Kingdom
- Health Data Research UK, London, United Kingdom
| | - Steffen E. Petersen
- Barts Heart Centre, Barts Health National Health Service (NHS) Trust, London, United Kingdom
- National Institute for Health Research (NIHR) Barts Biomedical Research Centre, William Harvey Research Institute, Queen Mary University of London, London, United Kingdom
- Health Data Research UK, London, United Kingdom
- The Alan Turing Institute, London, United Kingdom
| |
Collapse
|
292
|
Owais M, Yoon HS, Mahmood T, Haider A, Sultan H, Park KR. Light-weighted ensemble network with multilevel activation visualization for robust diagnosis of COVID19 pneumonia from large-scale chest radiographic database. Appl Soft Comput 2021; 108:107490. [PMID: 33994894 PMCID: PMC8103783 DOI: 10.1016/j.asoc.2021.107490] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2020] [Revised: 04/14/2021] [Accepted: 05/04/2021] [Indexed: 12/17/2022]
Abstract
Currently, the coronavirus disease 2019 (COVID19) pandemic has killed more than one million people worldwide. In the present outbreak, radiological imaging modalities such as computed tomography (CT) and X-rays are being used to diagnose this disease, particularly in the early stage. However, the assessment of radiographic images includes a subjective evaluation that is time-consuming and requires substantial clinical skills. Nevertheless, the recent evolution in artificial intelligence (AI) has further strengthened the ability of computer-aided diagnosis tools and supported medical professionals in making effective diagnostic decisions. Therefore, in this study, the strength of various AI algorithms was analyzed to diagnose COVID19 infection from large-scale radiographic datasets. Based on this analysis, a light-weighted deep network is proposed, which is the first ensemble design (based on MobileNet, ShuffleNet, and FCNet) in medical domain (particularly for COVID19 diagnosis) that encompasses the reduced number of trainable parameters (a total of 3.16 million parameters) and outperforms the various existing models. Moreover, the addition of a multilevel activation visualization layer in the proposed network further visualizes the lesion patterns as multilevel class activation maps (ML-CAMs) along with the diagnostic result (either COVID19 positive or negative). Such additional output as ML-CAMs provides a visual insight of the computer decision and may assist radiologists in validating it, particularly in uncertain situations Additionally, a novel hierarchical training procedure was adopted to perform the training of the proposed network. It proceeds the network training by the adaptive number of epochs based on the validation dataset rather than using the fixed number of epochs. The quantitative results show the better performance of the proposed training method over the conventional end-to-end training procedure. A large collection of CT-scan and X-ray datasets (based on six publicly available datasets) was used to evaluate the performance of the proposed model and other baseline methods. The experimental results of the proposed network exhibit a promising performance in terms of diagnostic decision. An average F1 score (F1) of 94.60% and 95.94% and area under the curve (AUC) of 97.50% and 97.99% are achieved for the CT-scan and X-ray datasets, respectively. Finally, the detailed comparative analysis reveals that the proposed model outperforms the various state-of-the-art methods in terms of both quantitative and computational performance.
Collapse
Affiliation(s)
- Muhammad Owais
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, Republic of Korea
| | - Hyo Sik Yoon
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, Republic of Korea
| | - Tahir Mahmood
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, Republic of Korea
| | - Adnan Haider
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, Republic of Korea
| | - Haseeb Sultan
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, Republic of Korea
| | - Kang Ryoung Park
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, Republic of Korea
| |
Collapse
|
293
|
Cortés U, Cortés A, Garcia-Gasulla D, Pérez-Arnal R, Álvarez-Napagao S, Àlvarez E. The ethical use of high-performance computing and artificial intelligence: fighting COVID-19 at Barcelona Supercomputing Center. AI AND ETHICS 2021; 2:325-340. [PMID: 34790948 PMCID: PMC8101339 DOI: 10.1007/s43681-021-00056-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/22/2021] [Accepted: 04/15/2021] [Indexed: 10/24/2022]
Abstract
The COVID-19 pandemic has created an extraordinary medical, economic and humanitarian emergency. Artificial intelligence, in combination with other digital technologies, is being used as a tool to support the fight against the viral pandemic that has affected the entire world since the beginning of 2020. Barcelona Supercomputing Center collaborates in the battle against the coronavirus in different areas: the application of bioinformatics for the research on the virus and its possible treatments, the use of artificial intelligence, natural language processing and big data techniques to analyse the spread and impact of the pandemic, and the use of the MareNostrum 4 supercomputer to enable massive analysis on COVID-19 data. Many of these activities have included the use of personal and sensitive data of citizens, which, even during a pandemic, should be treated and handled with care. In this work we discuss our approach based on an ethical, transparent and fair use of this information, an approach aligned with the guidelines proposed by the European Union.
Collapse
Affiliation(s)
- Ulises Cortés
- Universitat Politècnica de Catalunya, Edifici Omega 205, Jordi Girona 29, 08034 Barcelona, Spain.,Barcelona Supercomputing Center, Edifici Omega 201, Jordi Girona 1 and 3, 08034 Barcelona, Spain
| | - Atia Cortés
- Barcelona Supercomputing Center, Edifici Omega 201, Jordi Girona 1 and 3, 08034 Barcelona, Spain
| | - Dario Garcia-Gasulla
- Barcelona Supercomputing Center, Edifici Omega 201, Jordi Girona 1 and 3, 08034 Barcelona, Spain
| | - Raquel Pérez-Arnal
- Barcelona Supercomputing Center, Edifici Omega 201, Jordi Girona 1 and 3, 08034 Barcelona, Spain
| | - Sergio Álvarez-Napagao
- Barcelona Supercomputing Center, Edifici Omega 201, Jordi Girona 1 and 3, 08034 Barcelona, Spain
| | - Enric Àlvarez
- Universitat Politècnica de Catalunya, Edifici Omega 205, Jordi Girona 29, 08034 Barcelona, Spain
| |
Collapse
|
294
|
Islam MM, Poly TN, Alsinglawi B, Lin MC, Hsu MH, Li YC(J. A State-of-the-Art Survey on Artificial Intelligence to Fight COVID-19. J Clin Med 2021; 10:1961. [PMID: 34063302 PMCID: PMC8124542 DOI: 10.3390/jcm10091961] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2021] [Revised: 04/27/2021] [Accepted: 04/28/2021] [Indexed: 01/08/2023] Open
Abstract
Artificial intelligence (AI) has shown immense potential to fight COVID-19 in many ways. This paper focuses primarily on AI's role in managing COVID-19 using digital images, clinical and laboratory data analysis, and a summary of the most recent articles published last year. We surveyed the use of AI for COVID-19 detection, screening, diagnosis, the progression of severity, mortality, drug repurposing, and other tasks. We started with the technical overview of all models used to fight the COVID-19 pandemic and ended with a brief statement of the current state-of-the-art, limitations, and challenges.
Collapse
Affiliation(s)
- Md. Mohaimenul Islam
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei 110301, Taiwan; (M.M.I.); (T.N.P.); (M.C.L.)
- International Center for Health Information Technology (ICHIT), Taipei Medical University, Taipei 110301, Taiwan
- Research Center of Big Data and Meta-Analysis, Wan Fang Hospital, Taipei Medical University, Taipei 110301, Taiwan
| | - Tahmina Nasrin Poly
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei 110301, Taiwan; (M.M.I.); (T.N.P.); (M.C.L.)
- International Center for Health Information Technology (ICHIT), Taipei Medical University, Taipei 110301, Taiwan
- Research Center of Big Data and Meta-Analysis, Wan Fang Hospital, Taipei Medical University, Taipei 110301, Taiwan
| | - Belal Alsinglawi
- School of Computer, Data and Mathematical Sciences, Parramatta South Campus Western, Sydney University, Sydney, NSW 2116, Australia;
| | - Ming Chin Lin
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei 110301, Taiwan; (M.M.I.); (T.N.P.); (M.C.L.)
- Department of Neurosurgery, Shuang Ho Hospital, Taipei Medical University, Taipei 110301, Taiwan
- Professional Master Program in Artificial Intelligence in Medicine, Taipei Medical University, Taipei 110301, Taiwan
| | - Min-Huei Hsu
- Graduate Institute of Data Science, Taipei Medical University, Taipei 110301, Taiwan;
| | - Yu-Chuan (Jack) Li
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei 110301, Taiwan; (M.M.I.); (T.N.P.); (M.C.L.)
- International Center for Health Information Technology (ICHIT), Taipei Medical University, Taipei 110301, Taiwan
- Research Center of Big Data and Meta-Analysis, Wan Fang Hospital, Taipei Medical University, Taipei 110301, Taiwan
- Department of Dermatology, Wan Fang Hospital, Taipei 116081, Taiwan
- TMU Research Center of Cancer Translational Medicine, Taipei Medical University, Taipei 110301, Taiwan
| |
Collapse
|
295
|
Rehman A, Saba T, Tariq U, Ayesha N. Deep Learning-Based COVID-19 Detection Using CT and X-Ray Images: Current Analytics and Comparisons. IT PROFESSIONAL 2021; 23:63-68. [PMID: 35582037 PMCID: PMC8864950 DOI: 10.1109/mitp.2020.3036820] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/11/2020] [Accepted: 10/23/2020] [Indexed: 06/04/2023]
Abstract
Currently, the world faces a novel coronavirus disease 2019 (COVID-19) challenge and infected cases are increasing exponentially. COVID-19 is a disease that has been reported by the WHO in March 2020, caused by a virus called the SARS-CoV-2. As of 10 March 2021, more than 150 million people were infected and 3v million died. Researchers strive to find out about the virus and recommend effective actions. An unprecedented increase in pathogens is happening and a major attempt is being made to tackle the epidemic. This article presents deep learning-based COVID-19 detection using CT and X-ray images and data analytics on its spread worldwide. This article's research structure builds on a recent analysis of the COVID-19 data and prospective research to systematize current resources, help the researchers, practitioners by using in-depth learning methodologies to build solutions for the COVID-19 pandemic.
Collapse
Affiliation(s)
- Amjad Rehman
- Artificial Intelligence & Data Analytics Lab.CCIS Prince Sultan University Saudi Arabia
| | - Tanzila Saba
- Artificial Intelligence & Data Analytics Lab.CCIS Prince Sultan University Saudi Arabia
| | - Usman Tariq
- College of Computer Engineering and SciencePrince Sattam bin Abdulaziz University Saudi Arabia
| | - Noor Ayesha
- School of Clinical MedicineZhengzhou University China
| |
Collapse
|
296
|
Lieneck C, Herzog B, Krips R. Analysis of Facilitators and Barriers to the Delivery of Routine Care during the COVID-19 Global Pandemic: A Systematic Review. Healthcare (Basel) 2021; 9:healthcare9050528. [PMID: 34062813 PMCID: PMC8147259 DOI: 10.3390/healthcare9050528] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2021] [Revised: 04/27/2021] [Accepted: 04/29/2021] [Indexed: 12/15/2022] Open
Abstract
The delivery of routine health care during the COVID-19 global pandemic continues to be challenged as public health guidelines and other local/regional/state and other policies are enforced to help prevent the spread of the virus. The objective of this systematic review is to identify the facilitators and barriers affecting the delivery of routine health care services during the pandemic to provide a framework for future research. In total, 32 articles were identified for common themes surrounding facilitators of routine care during COVID-19. Identified constructed in the literature include enhanced education initiatives for parents/patients regarding routine vaccinations, an importance of routine vaccinations as compared to the risk of COVID-19 infection, an enhanced use of telehealth resources (including diagnostic imagery) and identified patient throughput/PPE initiatives. Reviewers identified the following barriers to the delivery of routine care: conservation of medical providers and PPE for non-routine (acute) care delivery needs, specific routine care services incongruent the telehealth care delivery methods, and job-loss/food insecurity. Review results can assist healthcare organizations with process-related challenges related to current and/or future delivery of routine care and support future research initiatives as the global pandemic continues.
Collapse
|
297
|
Deep-chest: Multi-classification deep learning model for diagnosing COVID-19, pneumonia, and lung cancer chest diseases. Comput Biol Med 2021; 132:104348. [PMID: 33774272 PMCID: PMC7977039 DOI: 10.1016/j.compbiomed.2021.104348] [Citation(s) in RCA: 76] [Impact Index Per Article: 25.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Revised: 03/13/2021] [Accepted: 03/13/2021] [Indexed: 12/16/2022]
Abstract
Corona Virus Disease (COVID-19) has been announced as a pandemic and is spreading rapidly throughout the world. Early detection of COVID-19 may protect many infected people. Unfortunately, COVID-19 can be mistakenly diagnosed as pneumonia or lung cancer, which with fast spread in the chest cells, can lead to patient death. The most commonly used diagnosis methods for these three diseases are chest X-ray and computed tomography (CT) images. In this paper, a multi-classification deep learning model for diagnosing COVID-19, pneumonia, and lung cancer from a combination of chest x-ray and CT images is proposed. This combination has been used because chest X-ray is less powerful in the early stages of the disease, while a CT scan of the chest is useful even before symptoms appear, and CT can precisely detect the abnormal features that are identified in images. In addition, using these two types of images will increase the dataset size, which will increase the classification accuracy. To the best of our knowledge, no other deep learning model choosing between these diseases is found in the literature. In the present work, the performance of four architectures are considered, namely: VGG19-CNN, ResNet152V2, ResNet152V2 + Gated Recurrent Unit (GRU), and ResNet152V2 + Bidirectional GRU (Bi-GRU). A comprehensive evaluation of different deep learning architectures is provided using public digital chest x-ray and CT datasets with four classes (i.e., Normal, COVID-19, Pneumonia, and Lung cancer). From the results of the experiments, it was found that the VGG19 +CNN model outperforms the three other proposed models. The VGG19+CNN model achieved 98.05% accuracy (ACC), 98.05% recall, 98.43% precision, 99.5% specificity (SPC), 99.3% negative predictive value (NPV), 98.24% F1 score, 97.7% Matthew's correlation coefficient (MCC), and 99.66% area under the curve (AUC) based on X-ray and CT images.
Collapse
|
298
|
Shiri I, Sorouri M, Geramifar P, Nazari M, Abdollahi M, Salimi Y, Khosravi B, Askari D, Aghaghazvini L, Hajianfar G, Kasaeian A, Abdollahi H, Arabi H, Rahmim A, Radmard AR, Zaidi H. Machine learning-based prognostic modeling using clinical data and quantitative radiomic features from chest CT images in COVID-19 patients. Comput Biol Med 2021; 132:104304. [PMID: 33691201 PMCID: PMC7925235 DOI: 10.1016/j.compbiomed.2021.104304] [Citation(s) in RCA: 54] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2021] [Revised: 02/26/2021] [Accepted: 02/27/2021] [Indexed: 12/16/2022]
Abstract
OBJECTIVE To develop prognostic models for survival (alive or deceased status) prediction of COVID-19 patients using clinical data (demographics and history, laboratory tests, visual scoring by radiologists) and lung/lesion radiomic features extracted from chest CT images. METHODS Overall, 152 patients were enrolled in this study protocol. These were divided into 106 training/validation and 46 test datasets (untouched during training), respectively. Radiomic features were extracted from the segmented lungs and infectious lesions separately from chest CT images. Clinical data, including patients' history and demographics, laboratory tests and radiological scores were also collected. Univariate analysis was first performed (q-value reported after false discovery rate (FDR) correction) to determine the most predictive features among all imaging and clinical data. Prognostic modeling of survival was performed using radiomic features and clinical data, separately or in combination. Maximum relevance minimum redundancy (MRMR) and XGBoost were used for feature selection and classification. The receiver operating characteristic (ROC) curve and the area under the ROC curve (AUC), sensitivity, specificity, and accuracy were used to assess the prognostic performance of the models on the test datasets. RESULTS For clinical data, cancer comorbidity (q-value < 0.01), consciousness level (q-value < 0.05) and radiological score involved zone (q-value < 0.02) were found to have high correlated features with outcome. Oxygen saturation (AUC = 0.73, q-value < 0.01) and Blood Urea Nitrogen (AUC = 0.72, q-value = 0.72) were identified as high clinical features. For lung radiomic features, SAHGLE (AUC = 0.70) and HGLZE (AUC = 0.67) from GLSZM were identified as most prognostic features. Amongst lesion radiomic features, RLNU from GLRLM (AUC = 0.73), HGLZE from GLSZM (AUC = 0.73) had the highest performance. In multivariate analysis, combining lung, lesion and clinical features was determined to provide the most accurate prognostic model (AUC = 0.95 ± 0.029 (95%CI: 0.95-0.96), accuracy = 0.88 ± 0.046 (95% CI: 0.88-0.89), sensitivity = 0.88 ± 0.066 (95% CI = 0.87-0.9) and specificity = 0.89 ± 0.07 (95% CI = 0.87-0.9)). CONCLUSION Combination of radiomic features and clinical data can effectively predict outcome in COVID-19 patients. The developed model has significant potential for improved management of COVID-19 patients.
Collapse
Affiliation(s)
- Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva, Switzerland
| | - Majid Sorouri
- Digestive Diseases Research Center, Digestive Diseases Research Institute, Tehran University of Medical Sciences, Tehran, Iran
| | - Parham Geramifar
- Research Center for Nuclear Medicine, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Mostafa Nazari
- Department of Biomedical Engineering and Medical Physics, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Mohammad Abdollahi
- Digestive Diseases Research Center, Digestive Diseases Research Institute, Tehran University of Medical Sciences, Tehran, Iran
| | - Yazdan Salimi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva, Switzerland
| | - Bardia Khosravi
- Digestive Diseases Research Center, Digestive Diseases Research Institute, Tehran University of Medical Sciences, Tehran, Iran
| | - Dariush Askari
- Department of Radiology Technology, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Leila Aghaghazvini
- Department of Radiology, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Ghasem Hajianfar
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Amir Kasaeian
- Digestive Diseases Research Center, Digestive Diseases Research Institute, Tehran University of Medical Sciences, Tehran, Iran,Hematology, Oncology and Stem Cell Transplantation Research Center, Research Institute for Oncology, Hematology and Cell Therapy, Tehran University of Medical Sciences, Tehran, Iran,Inflammation Research Center, Tehran University of Medical Sciences, Tehran, Iran
| | - Hamid Abdollahi
- Department of Radiologic Sciences and Medical Physics, Kerman University of Medical Sciences, Kerman, Iran
| | - Hossein Arabi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva, Switzerland
| | - Arman Rahmim
- Departments of Radiology and Physics, University of British Columbia, Vancouver, BC, Canada,Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada
| | - Amir Reza Radmard
- Department of Radiology, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran,Corresponding author. Department of Radiology, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211, Geneva, Switzerland,Geneva University Neurocenter, Geneva University, Geneva, Switzerland,Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, Netherlands,Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark,Corresponding author. Geneva University Hospital, Division of Nuclear Medicine and Molecular Imaging, CH-1211, Geneva, Switzerland
| |
Collapse
|
299
|
Poly TN, Islam MM, Li YCJ, Alsinglawi B, Hsu MH, Jian WS, Yang HC. Application of Artificial Intelligence for Screening COVID-19 Patients Using Digital Images: Meta-analysis. JMIR Med Inform 2021; 9:e21394. [PMID: 33764884 PMCID: PMC8086786 DOI: 10.2196/21394] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2020] [Revised: 09/04/2020] [Accepted: 03/21/2021] [Indexed: 12/24/2022] Open
Abstract
BACKGROUND The COVID-19 outbreak has spread rapidly and hospitals are overwhelmed with COVID-19 patients. While analysis of nasal and throat swabs from patients is the main way to detect COVID-19, analyzing chest images could offer an alternative method to hospitals, where health care personnel and testing kits are scarce. Deep learning (DL), in particular, has shown impressive levels of performance when analyzing medical images, including those related to COVID-19 pneumonia. OBJECTIVE The goal of this study was to perform a systematic review with a meta-analysis of relevant studies to quantify the performance of DL algorithms in the automatic stratification of COVID-19 patients using chest images. METHODS A search strategy for use in PubMed, Scopus, Google Scholar, and Web of Science was developed, where we searched for articles published between January 1 and April 25, 2020. We used the key terms "COVID-19," or "coronavirus," or "SARS-CoV-2," or "novel corona," or "2019-ncov," and "deep learning," or "artificial intelligence," or "automatic detection." Two authors independently extracted data on study characteristics, methods, risk of bias, and outcomes. Any disagreement between them was resolved by consensus. RESULTS A total of 16 studies were included in the meta-analysis, which included 5896 chest images from COVID-19 patients. The pooled sensitivity and specificity of the DL models in detecting COVID-19 were 0.95 (95% CI 0.94-0.95) and 0.96 (95% CI 0.96-0.97), respectively, with an area under the receiver operating characteristic curve of 0.98. The positive likelihood, negative likelihood, and diagnostic odds ratio were 19.02 (95% CI 12.83-28.19), 0.06 (95% CI 0.04-0.10), and 368.07 (95% CI 162.30-834.75), respectively. The pooled sensitivity and specificity for distinguishing other types of pneumonia from COVID-19 were 0.93 (95% CI 0.92-0.94) and 0.95 (95% CI 0.94-0.95), respectively. The performance of radiologists in detecting COVID-19 was lower than that of the DL models; however, the performance of junior radiologists was improved when they used DL-based prediction tools. CONCLUSIONS Our study findings show that DL models have immense potential in accurately stratifying COVID-19 patients and in correctly differentiating them from patients with other types of pneumonia and normal patients. Implementation of DL-based tools can assist radiologists in correctly and quickly detecting COVID-19 and, consequently, in combating the COVID-19 pandemic.
Collapse
Affiliation(s)
- Tahmina Nasrin Poly
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
- International Center for Health Information Technology, Taipei Medical University, Taipei, Taiwan
- Research Center of Big Data and Meta-Analysis, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
| | - Md Mohaimenul Islam
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
- International Center for Health Information Technology, Taipei Medical University, Taipei, Taiwan
- Research Center of Big Data and Meta-Analysis, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
| | - Yu-Chuan Jack Li
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
- International Center for Health Information Technology, Taipei Medical University, Taipei, Taiwan
- Research Center of Big Data and Meta-Analysis, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
- Department of Dermatology, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
- TMU Research Center of Cancer Translational Medicine, Taipei Medical University, Taipei, Taiwan
| | - Belal Alsinglawi
- School of Computer, Data, and Mathematical Science, Western Sydney University, Sydney, Australia
| | - Min-Huei Hsu
- Graduate Institute of Data Science, Taipei Medical University, Taipei, Taiwan
| | - Wen Shan Jian
- School of Health Care Administration, Taipei Medical University, Taipei, Taiwan
| | - Hsuan-Chia Yang
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
- International Center for Health Information Technology, Taipei Medical University, Taipei, Taiwan
- Research Center of Big Data and Meta-Analysis, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
| |
Collapse
|
300
|
Ameer AQA, Mohammed RF. Covid-19 Detection Using CT Scan based on Gray Level Co-Occurrence Matrix. MATERIALS TODAY. PROCEEDINGS 2021:S2214-7853(21)03144-8. [PMID: 33936954 PMCID: PMC8075841 DOI: 10.1016/j.matpr.2021.04.224] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/11/2021] [Accepted: 04/16/2021] [Indexed: 11/29/2022]
Abstract
The Coronavirus pandemic is one of the biggest problems the world has faced in the 21st century and this virus is a virus that infects the lung and causes breathing problems. In this research the program is designed for the purpose of reading images of the type CT scan, this study used 654 case these cases split in to two classes (infect , not infect), there are two phases in this study, training phase and testing phase. After training the training data store in database, the second phase is testing at first is pre-processing step which increase contrast, then remove lung by labelling the most contrast connected pixels and subtract labelling pixels from original image, the next step is noise removal by applying three filters (mean, median, Gaussian), after that applying gray level co-occurrence matrix (GLCM) in four directions (0°,45°,90° and 135°), then extract features from GLCM, in this study 10 features was extracted from each GLCM matrix, then compare between testing features and training database to specify the case is infect or not, in this study get accuracy 94% for detect the location of infection and detect the lung is infect or not.
Collapse
Affiliation(s)
| | - Raghad Falih Mohammed
- Department of Business Administration, College of Administration Sciences and Financial, Imam Ja'afar Al-Sadiq University, Baghdad, Iraq
| |
Collapse
|