1
|
Sannasi Chakravarthy SR, Bharanidharan N, Vinothini C, Vinoth Kumar V, Mahesh TR, Guluwadi S. Adaptive Mish activation and ranger optimizer-based SEA-ResNet50 model with explainable AI for multiclass classification of COVID-19 chest X-ray images. BMC Med Imaging 2024; 24:206. [PMID: 39123118 PMCID: PMC11313131 DOI: 10.1186/s12880-024-01394-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2024] [Accepted: 08/06/2024] [Indexed: 08/12/2024] Open
Abstract
A recent global health crisis, COVID-19 is a significant global health crisis that has profoundly affected lifestyles. The detection of such diseases from similar thoracic anomalies using medical images is a challenging task. Thus, the requirement of an end-to-end automated system is vastly necessary in clinical treatments. In this way, the work proposes a Squeeze-and-Excitation Attention-based ResNet50 (SEA-ResNet50) model for detecting COVID-19 utilizing chest X-ray data. Here, the idea lies in improving the residual units of ResNet50 using the squeeze-and-excitation attention mechanism. For further enhancement, the Ranger optimizer and adaptive Mish activation function are employed to improve the feature learning of the SEA-ResNet50 model. For evaluation, two publicly available COVID-19 radiographic datasets are utilized. The chest X-ray input images are augmented during experimentation for robust evaluation against four output classes namely normal, pneumonia, lung opacity, and COVID-19. Then a comparative study is done for the SEA-ResNet50 model against VGG-16, Xception, ResNet18, ResNet50, and DenseNet121 architectures. The proposed framework of SEA-ResNet50 together with the Ranger optimizer and adaptive Mish activation provided maximum classification accuracies of 98.38% (multiclass) and 99.29% (binary classification) as compared with the existing CNN architectures. The proposed method achieved the highest Kappa validation scores of 0.975 (multiclass) and 0.98 (binary classification) over others. Furthermore, the visualization of the saliency maps of the abnormal regions is represented using the explainable artificial intelligence (XAI) model, thereby enhancing interpretability in disease diagnosis.
Collapse
Affiliation(s)
- S R Sannasi Chakravarthy
- Department of Electronics and Communication Engineering, Bannari Amman Institute of Technology, Sathyamangalam, India
| | - N Bharanidharan
- School of Computer Science Engineering and Information Systems, Vellore Institute of Technology, Vellore, 632014, India
| | - C Vinothini
- Department of Computer Science and Engineering, Dayananda Sagar College of Engineering, Bangalore, India
| | - Venkatesan Vinoth Kumar
- School of Computer Science Engineering and Information Systems, Vellore Institute of Technology, Vellore, 632014, India
| | - T R Mahesh
- Department of Computer Science and Engineering, JAIN (Deemed-to-Be University), Bengaluru, 562112, India
| | - Suresh Guluwadi
- Adama Science and Technology University, Adama, 302120, Ethiopia.
| |
Collapse
|
2
|
Rajinikanth V, Biju R, Mittal N, Mittal V, Askar S, Abouhawwash M. COVID-19 detection in lung CT slices using Brownian-butterfly-algorithm optimized lightweight deep features. Heliyon 2024; 10:e27509. [PMID: 38468955 PMCID: PMC10926136 DOI: 10.1016/j.heliyon.2024.e27509] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Revised: 02/29/2024] [Accepted: 02/29/2024] [Indexed: 03/13/2024] Open
Abstract
Several deep-learning assisted disease assessment schemes (DAS) have been proposed to enhance accurate detection of COVID-19, a critical medical emergency, through the analysis of clinical data. Lung imaging, particularly from CT scans, plays a pivotal role in identifying and assessing the severity of COVID-19 infections. Existing automated methods leveraging deep learning contribute significantly to reducing the diagnostic burden associated with this process. This research aims in developing a simple DAS for COVID-19 detection using the pre-trained lightweight deep learning methods (LDMs) applied to lung CT slices. The use of LDMs contributes to a less complex yet highly accurate detection system. The key stages of the developed DAS include image collection and initial processing using Shannon's thresholding, deep-feature mining supported by LDMs, feature optimization utilizing the Brownian Butterfly Algorithm (BBA), and binary classification through three-fold cross-validation. The performance evaluation of the proposed scheme involves assessing individual, fused, and ensemble features. The investigation reveals that the developed DAS achieves a detection accuracy of 93.80% with individual features, 96% accuracy with fused features, and an impressive 99.10% accuracy with ensemble features. These outcomes affirm the effectiveness of the proposed scheme in significantly enhancing COVID-19 detection accuracy in the chosen lung CT database.
Collapse
Affiliation(s)
- Venkatesan Rajinikanth
- Department of Computer Science and Engineering, Division of Research and Innovation, Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, Chennai, 602105, Tamil Nadu, India
| | - Roshima Biju
- Department of Computer Science Engineering, Parul University, Vadodara, 391760, Gujarat, India
| | - Nitin Mittal
- Skill Faculty of Engineering and Technology, Shri Vishwakarma Skill University, Palwal, 121102, Haryana, India
| | - Vikas Mittal
- Department of Electronics and Communication Engineering, Chandigarh University, Mohali, 140413, India
| | - S.S. Askar
- Department of Statistics and Operations Research, College of Science, King Saud University, P.O. Box 2455, Riyadh, 11451, Saudi Arabia
| | - Mohamed Abouhawwash
- Department of Mathematics, Faculty of Science, Mansoura University, Mansoura, 35516, Egypt
| |
Collapse
|
3
|
Kabir MM, Mridha M, Rahman A, Hamid MA, Monowar MM. Detection of COVID-19, pneumonia, and tuberculosis from radiographs using AI-driven knowledge distillation. Heliyon 2024; 10:e26801. [PMID: 38444490 PMCID: PMC10912466 DOI: 10.1016/j.heliyon.2024.e26801] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2023] [Revised: 01/30/2024] [Accepted: 02/20/2024] [Indexed: 03/07/2024] Open
Abstract
Chest radiography is an essential diagnostic tool for respiratory diseases such as COVID-19, pneumonia, and tuberculosis because it accurately depicts the structures of the chest. However, accurate detection of these diseases from radiographs is a complex task that requires the availability of medical imaging equipment and trained personnel. Conventional deep learning models offer a viable automated solution for this task. However, the high complexity of these models often poses a significant obstacle to their practical deployment within automated medical applications, including mobile apps, web apps, and cloud-based platforms. This study addresses and resolves this dilemma by reducing the complexity of neural networks using knowledge distillation techniques (KDT). The proposed technique trains a neural network on an extensive collection of chest X-ray images and propagates the knowledge to a smaller network capable of real-time detection. To create a comprehensive dataset, we have integrated three popular chest radiograph datasets with chest radiographs for COVID-19, pneumonia, and tuberculosis. Our experiments show that this knowledge distillation approach outperforms conventional deep learning methods in terms of computational complexity and performance for real-time respiratory disease detection. Specifically, our system achieves an impressive average accuracy of 0.97, precision of 0.94, and recall of 0.97.
Collapse
Affiliation(s)
- Md Mohsin Kabir
- Department of Computer Science & Engineering, Bangladesh University of Business & Technology, Dhaka-1216, Bangladesh
| | - M.F. Mridha
- Department of Computer Science, American International University-Bangladesh, Dhaka-1229, Bangladesh
| | - Ashifur Rahman
- Department of Computer Science & Engineering, Bangladesh University of Business & Technology, Dhaka-1216, Bangladesh
| | - Md. Abdul Hamid
- Department of Information Technology, Faculty of Computing & Information Technology, King Abdulaziz University, Jeddah-21589, Kingdom of Saudi Arabia
| | - Muhammad Mostafa Monowar
- Department of Information Technology, Faculty of Computing & Information Technology, King Abdulaziz University, Jeddah-21589, Kingdom of Saudi Arabia
| |
Collapse
|
4
|
Nizam NB, Siddiquee SM, Shirin M, Bhuiyan MIH, Hasan T. COVID-19 Severity Prediction from Chest X-ray Images Using an Anatomy-Aware Deep Learning Model. J Digit Imaging 2023; 36:2100-2112. [PMID: 37369941 PMCID: PMC10502002 DOI: 10.1007/s10278-023-00861-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Revised: 05/17/2023] [Accepted: 05/25/2023] [Indexed: 06/29/2023] Open
Abstract
The COVID-19 pandemic has been adversely affecting the patient management systems in hospitals around the world. Radiological imaging, especially chest x-ray and lung Computed Tomography (CT) scans, plays a vital role in the severity analysis of hospitalized COVID-19 patients. However, with an increasing number of patients and a lack of skilled radiologists, automated assessment of COVID-19 severity using medical image analysis has become increasingly important. Chest x-ray (CXR) imaging plays a significant role in assessing the severity of pneumonia, especially in low-resource hospitals, and is the most frequently used diagnostic imaging in the world. Previous methods that automatically predict the severity of COVID-19 pneumonia mainly focus on feature pooling from pre-trained CXR models without explicitly considering the underlying human anatomical attributes. This paper proposes an anatomy-aware (AA) deep learning model that learns the generic features from x-ray images considering the underlying anatomical information. Utilizing a pre-trained model and lung segmentation masks, the model generates a feature vector including disease-level features and lung involvement scores. We have used four different open-source datasets, along with an in-house annotated test set for training and evaluation of the proposed method. The proposed method improves the geographical extent score by 11% in terms of mean squared error (MSE) while preserving the benchmark result in lung opacity score. The results demonstrate the effectiveness of the proposed AA model in COVID-19 severity prediction from chest X-ray images. The algorithm can be used in low-resource setting hospitals for COVID-19 severity prediction, especially where there is a lack of skilled radiologists.
Collapse
Affiliation(s)
- Nusrat Binta Nizam
- mHealth Research Group, Department of Biomedical Engineering, Bangladesh University of Engineering and Technology (BUET), Dhaka, 1205, Bangladesh
| | - Sadi Mohammad Siddiquee
- mHealth Research Group, Department of Biomedical Engineering, Bangladesh University of Engineering and Technology (BUET), Dhaka, 1205, Bangladesh
| | - Mahbuba Shirin
- Department of Radiology and Imaging, Bangabandhu Sheikh Mujib Medical University, Shahbagh, Dhaka, 1000, Bangladesh
| | - Mohammed Imamul Hassan Bhuiyan
- Department of Electrical and Electronics Engineering (EEE), Bangladesh University of Engineering and Technology, Dhaka, 1205, Bangladesh
| | - Taufiq Hasan
- mHealth Research Group, Department of Biomedical Engineering, Bangladesh University of Engineering and Technology (BUET), Dhaka, 1205, Bangladesh.
- Center for Bioengineering Innovation and Design (CBID), Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA.
| |
Collapse
|
5
|
Ortiz GX, Ulbrich AHDPDS, Lenhart G, dos Santos HDP, Schwambach KH, Becker MW, Blatt CR. Drug-induced liver injury and COVID-19: Use of artificial intelligence and the updated Roussel Uclaf Causality Assessment Method in clinical practice. Artif Intell Gastroenterol 2023; 4:36-47. [DOI: 10.35712/aig.v4.i2.36] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/04/2023] [Revised: 08/18/2023] [Accepted: 09/05/2023] [Indexed: 09/07/2023] Open
Abstract
BACKGROUND Liver injury is a relevant condition in coronavirus disease 2019 (COVID-19) inpatients. Pathophysiology varies from direct infection by virus, systemic inflammation or drug-induced adverse reaction (DILI). DILI detection and monitoring is clinically relevant, as it may contribute to poor prognosis, prolonged hospitalization and increase indirect healthcare costs. Artificial Intelligence (AI) applied in data mining of electronic medical records combining abnormal liver tests, keyword searching tools, and risk factors analysis is a relevant opportunity for early DILI detection by automated algorithms.
AIM To describe DILI cases in COVID-19 inpatients detected from data mining in electronic medical records (EMR) using AI and the updated Roussel Uclaf Causality Assessment Method (RUCAM).
METHODS The study was conducted in March 2021 in a hospital in southern Brazil. The NoHarm© system uses AI to support decision making in clinical pharmacy. Hospital admissions were 100523 during this period, of which 478 met the inclusion criteria. From these, 290 inpatients were excluded due to alternative causes of liver injury and/or due to not having COVID-19. We manually reviewed the EMR of 188 patients for DILI investigation. Absence of clinical information excluded most eligible patients. The DILI assessment causality was possible via the updated RUCAM in 17 patients.
RESULTS Mean patient age was 53 years (SD ± 18.37; range 22-83), most were male (70%), and admitted to the non-intensive care unit sector (65%). Liver injury pattern was mainly mixed, mean time to normalization of liver markers was 10 d, and mean length of hospitalization was 20.5 d (SD ± 16; range 7-70). Almost all patients recovered from DILI and one patient died of multiple organ failure. There were 31 suspected drugs with the following RUCAM score: Possible (n = 24), probable (n = 5), and unlikely (n = 2). DILI agents in our study were ivermectin, bicalutamide, linezolid, azithromycin, ceftriaxone, amoxicillin-clavulanate, tocilizumab, piperacillin-tazobactam, and albendazole. Lack of essential clinical information excluded most patients. Although rare, DILI is a relevant clinical condition in COVID-19 patients and may contribute to poor prognostics.
CONCLUSION The incidence of DILI in COVID-19 inpatients is rare and the absence of relevant clinical information on EMR may underestimate DILI rates. Prospects involve creation and validation of alerts for risk factors in all DILI patients based on RUCAM assessment causality, alterations of liver biomarkers and AI and machine learning.
Collapse
Affiliation(s)
- Gabriela Xavier Ortiz
- Graduate Program in Medicine – Hepatology, Federal University of Health Sciences of Porto Alegre, Porto Alegre 90050-170, Brazil
| | | | - Gabriele Lenhart
- Multiprofessional Residency Integrated in Health, Federal University of Health Sciences of Porto Alegre, Porto Alegre 90050-170, Brazil
| | | | - Karin Hepp Schwambach
- Graduate Program in Medicine – Hepatology, Federal University of Health Sciences of Porto Alegre, Porto Alegre 90050-170, Brazil
| | - Matheus William Becker
- Graduate Program in Medicine – Hepatology, Federal University of Health Sciences of Porto Alegre, Porto Alegre 90050-170, Brazil
| | - Carine Raquel Blatt
- Department of Pharmacoscience, Graduate Program in Medicine – Hepatology, Federal University of Health Sciences of Porto Alegre, Porto Alegre 90050-170, Brazil
| |
Collapse
|
6
|
Al-Nabulsi J, Turab N, Owida HA, Al-Naami B, De Fazio R, Visconti P. IoT Solutions and AI-Based Frameworks for Masked-Face and Face Recognition to Fight the COVID-19 Pandemic. SENSORS (BASEL, SWITZERLAND) 2023; 23:7193. [PMID: 37631730 PMCID: PMC10458933 DOI: 10.3390/s23167193] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/17/2023] [Revised: 08/04/2023] [Accepted: 08/10/2023] [Indexed: 08/27/2023]
Abstract
A global health emergency resulted from the COVID-19 epidemic. Image recognition techniques are a useful tool for limiting the spread of the pandemic; indeed, the World Health Organization (WHO) recommends the use of face masks in public places as a form of protection against contagion. Hence, innovative systems and algorithms were deployed to rapidly screen a large number of people with faces covered by masks. In this article, we analyze the current state of research and future directions in algorithms and systems for masked-face recognition. First, the paper discusses the importance and applications of facial and face mask recognition, introducing the main approaches. Afterward, we review the recent facial recognition frameworks and systems based on Convolution Neural Networks, deep learning, machine learning, and MobilNet techniques. In detail, we analyze and critically discuss recent scientific works and systems which employ machine learning (ML) and deep learning tools for promptly recognizing masked faces. Also, Internet of Things (IoT)-based sensors, implementing ML and DL algorithms, were described to keep track of the number of persons donning face masks and notify the proper authorities. Afterward, the main challenges and open issues that should be solved in future studies and systems are discussed. Finally, comparative analysis and discussion are reported, providing useful insights for outlining the next generation of face recognition systems.
Collapse
Affiliation(s)
- Jamal Al-Nabulsi
- Medical Engineering Department, Faculty of Engineering, Al-Ahliyya Amman University, Amman 19328, Jordan; (J.A.-N.); (H.A.O.)
| | - Nidal Turab
- Department of Networks and Cyber Security, Faculty of Information Technology, Al-Ahliyya Amman University, Amman 19328, Jordan;
| | - Hamza Abu Owida
- Medical Engineering Department, Faculty of Engineering, Al-Ahliyya Amman University, Amman 19328, Jordan; (J.A.-N.); (H.A.O.)
| | - Bassam Al-Naami
- Department of Biomedical Engineering, Faculty of Engineering, The Hashemite University, Zarqa 13133, Jordan;
| | - Roberto De Fazio
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy;
| | - Paolo Visconti
- Department of Innovation Engineering, University of Salento, 73100 Lecce, Italy;
| |
Collapse
|
7
|
Lakshmi M, Das R. Classification of Monkeypox Images Using LIME-Enabled Investigation of Deep Convolutional Neural Network. Diagnostics (Basel) 2023; 13:1639. [PMID: 37175030 PMCID: PMC10178151 DOI: 10.3390/diagnostics13091639] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2023] [Revised: 03/04/2023] [Accepted: 03/07/2023] [Indexed: 05/15/2023] Open
Abstract
In this research, we demonstrate a Deep Convolutional Neural Network-based classification model for the detection of monkeypox. Monkeypox can be difficult to diagnose clinically in its early stages since it resembles both chickenpox and measles in symptoms. The early diagnosis of monkeypox helps doctors cure it more quickly. Therefore, pre-trained models are frequently used in the diagnosis of monkeypox, because the manual analysis of a large number of images is labor-intensive and prone to inaccuracy. Therefore, finding the monkeypox virus requires an automated process. The large layer count of convolutional neural network (CNN) architectures enables them to successfully conceptualize the features on their own, thereby contributing to better performance in image classification. The scientific community has recently articulated significant attention in employing artificial intelligence (AI) to diagnose monkeypox from digital skin images due primarily to AI's success in COVID-19 identification. The VGG16, VGG19, ResNet50, ResNet101, DenseNet201, and AlexNet models were used in our proposed method to classify patients with monkeypox symptoms with other diseases of a similar kind (chickenpox, measles, and normal). The majority of images in our research are collected from publicly available datasets. This study suggests an adaptive k-means clustering image segmentation technique that delivers precise segmentation results with straightforward operation. Our preliminary computational findings reveal that the proposed model could accurately detect patients with monkeypox. The best overall accuracy achieved by ResNet101 is 94.25%, with an AUC of 98.59%. Additionally, we describe the categorization of our model utilizing feature extraction using Local Interpretable Model-Agnostic Explanations (LIME), which provides a more in-depth understanding of particular properties that distinguish the monkeypox virus.
Collapse
Affiliation(s)
| | - Raja Das
- Department of Mathematics, School of Advanced Sciences, Vellore Institute of Technology (VIT), Vellore 632014, Tamil Nadu, India;
| |
Collapse
|
8
|
Ngo HG, Nair GB, Al-Katib S. Impact of a structured reporting template on the quality of HRCT radiology reports for interstitial lung disease. Clin Imaging 2023; 97:78-83. [PMID: 36921449 DOI: 10.1016/j.clinimag.2023.03.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Revised: 02/26/2023] [Accepted: 03/01/2023] [Indexed: 03/09/2023]
Abstract
PURPOSE This QI study compared the completeness of HRCT radiology reports before and after the implementation of a disease-specific structured reporting template for suspected cases of interstitial lung disease (ILD). MATERIALS AND METHODS A pre-post study of radiology reports for HRCT of the thorax at a multicenter health system was performed. Data was collected in 6-month period intervals before (June 2019-November 2019) and after (January 2021-June 2021) the implementation of a disease-specific template. The use of the template was voluntary. The primary outcome measure was the completeness of HRCT reports graded based on the documentation of ten descriptors. The secondary outcome measure assessed which descriptor(s) improved after the intervention. RESULTS 521 HRCT reports before and 557 HRCT reports after the intervention were reviewed. Of the 557 reports, 118 reports (21%) were created using the structured reporting template. The mean completeness score of the pre-intervention group was 9.20 (SD = 1.08) and the post-intervention group was 9.36 (SD = 1.03) with a difference of -0.155, 95% CI [-0.2822, -0.0285, p < 0.0001]. Within the post-intervention group, the mean completeness score of the unstructured reports was 9.25 (SD = 1.07) and the template reports was 9.93 (SD = 0.25) with a difference of -0.677, 95% CI [-0.7871, -0.5671, p < 0.0001]. After the intervention, the use of two descriptors improved significantly: presence of honeycombing from 78.3% to 85.1% (p < 0.0039) and technique from 90% to 96.6% (p < 0.0001). DISCUSSION Shifting to disease-specific structured reporting for HRCT exams of suspected ILD is beneficial, as it improves the completeness of radiology reports. Further research on how to improve the voluntary uptake of a disease-specific template is needed to help increase the acceptance of structured reporting among radiologists.
Collapse
Affiliation(s)
- Han G Ngo
- Oakland University William Beaumont School of Medicine, Rochester, MI, United States of America.
| | - Girish B Nair
- Department of Pulmonary and Critical Care Medicine, Corewell Health William Beaumont University Hospital, Oakland University William Beaumont School of Medicine, Royal Oak, MI, United States of America
| | - Sayf Al-Katib
- Department of Radiology and Molecular Imaging, Corewell Health William Beaumont University Hospital, Oakland University William Beaumont School of Medicine, Royal Oak, MI, United States of America
| |
Collapse
|
9
|
Khattab R, Abdelmaksoud IR, Abdelrazek S. Deep Convolutional Neural Networks for Detecting COVID-19 Using Medical Images: A Survey. NEW GENERATION COMPUTING 2023; 41:343-400. [PMID: 37229176 PMCID: PMC10071474 DOI: 10.1007/s00354-023-00213-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Accepted: 02/23/2023] [Indexed: 05/27/2023]
Abstract
Coronavirus Disease 2019 (COVID-19), which is caused by Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-COV-2), surprised the world in December 2019 and has threatened the lives of millions of people. Countries all over the world closed worship places and shops, prevented gatherings, and implemented curfews to stand against the spread of COVID-19. Deep Learning (DL) and Artificial Intelligence (AI) can have a great role in detecting and fighting this disease. Deep learning can be used to detect COVID-19 symptoms and signs from different imaging modalities, such as X-Ray, Computed Tomography (CT), and Ultrasound Images (US). This could help in identifying COVID-19 cases as a first step to curing them. In this paper, we reviewed the research studies conducted from January 2020 to September 2022 about deep learning models that were used in COVID-19 detection. This paper clarified the three most common imaging modalities (X-Ray, CT, and US) in addition to the DL approaches that are used in this detection and compared these approaches. This paper also provided the future directions of this field to fight COVID-19 disease.
Collapse
Affiliation(s)
- Rana Khattab
- Information Systems Department, Faculty of Computers and Information, Mansoura University, Mansoura, Egypt
| | - Islam R. Abdelmaksoud
- Information Systems Department, Faculty of Computers and Information, Mansoura University, Mansoura, Egypt
| | - Samir Abdelrazek
- Information Systems Department, Faculty of Computers and Information, Mansoura University, Mansoura, Egypt
| |
Collapse
|
10
|
Almuayqil S, Abd El-Ghany S, Shehab A. Multimodality Imaging of COVID-19 Using Fine-Tuned Deep Learning Models. Diagnostics (Basel) 2023; 13:1268. [PMID: 37046486 PMCID: PMC10093688 DOI: 10.3390/diagnostics13071268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Revised: 03/22/2023] [Accepted: 03/23/2023] [Indexed: 03/30/2023] Open
Abstract
In the face of the COVID-19 pandemic, many studies have been undertaken to provide assistive recommendations to patients to help overcome the burden of the expected shortage in clinicians. Thus, this study focused on diagnosing the COVID-19 virus using a set of fine-tuned deep learning models to overcome the latency in virus checkups. Five recent deep learning algorithms (EfficientB0, VGG-19, DenseNet121, EfficientB7, and MobileNetV2) were utilized to label both CT scan and chest X-ray images as positive or negative for COVID-19. The experimental results showed the superiority of the proposed method compared to state-of-the-art methods in terms of precision, sensitivity, specificity, F1 score, accuracy, and data access time.
Collapse
Affiliation(s)
- Saleh Almuayqil
- Department of Information Systems, College of Computer and Information Sciences, Jouf University, Sakaka 72388, Saudi Arabia; (S.A.); (S.A.E.-G.)
| | - Sameh Abd El-Ghany
- Department of Information Systems, College of Computer and Information Sciences, Jouf University, Sakaka 72388, Saudi Arabia; (S.A.); (S.A.E.-G.)
- Department of Information Systems, Mansoura University, Mansoura 35516, Egypt
| | - Abdulaziz Shehab
- Department of Information Systems, College of Computer and Information Sciences, Jouf University, Sakaka 72388, Saudi Arabia; (S.A.); (S.A.E.-G.)
- Department of Information Systems, Mansoura University, Mansoura 35516, Egypt
| |
Collapse
|
11
|
Gürsoy E, Kaya Y. An overview of deep learning techniques for COVID-19 detection: methods, challenges, and future works. MULTIMEDIA SYSTEMS 2023; 29:1603-1627. [PMID: 37261262 PMCID: PMC10039775 DOI: 10.1007/s00530-023-01083-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/16/2022] [Accepted: 03/20/2023] [Indexed: 06/02/2023]
Abstract
The World Health Organization (WHO) declared a pandemic in response to the coronavirus COVID-19 in 2020, which resulted in numerous deaths worldwide. Although the disease appears to have lost its impact, millions of people have been affected by this virus, and new infections still occur. Identifying COVID-19 requires a reverse transcription-polymerase chain reaction test (RT-PCR) or analysis of medical data. Due to the high cost and time required to scan and analyze medical data, researchers are focusing on using automated computer-aided methods. This review examines the applications of deep learning (DL) and machine learning (ML) in detecting COVID-19 using medical data such as CT scans, X-rays, cough sounds, MRIs, ultrasound, and clinical markers. First, the data preprocessing, the features used, and the current COVID-19 detection methods are divided into two subsections, and the studies are discussed. Second, the reported publicly available datasets, their characteristics, and the potential comparison materials mentioned in the literature are presented. Third, a comprehensive comparison is made by contrasting the similar and different aspects of the studies. Finally, the results, gaps, and limitations are summarized to stimulate the improvement of COVID-19 detection methods, and the study concludes by listing some future research directions for COVID-19 classification.
Collapse
Affiliation(s)
- Ercan Gürsoy
- Department of Computer Engineering, Adana Alparslan Turkes Science and Technology University, 01250 Adana, Turkey
| | - Yasin Kaya
- Department of Computer Engineering, Adana Alparslan Turkes Science and Technology University, 01250 Adana, Turkey
| |
Collapse
|
12
|
Eminaga O, Abbas M, Shen J, Laurie M, Brooks JD, Liao JC, Rubin DL. PlexusNet: A neural network architectural concept for medical image classification. Comput Biol Med 2023; 154:106594. [PMID: 36753979 DOI: 10.1016/j.compbiomed.2023.106594] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2022] [Revised: 01/12/2023] [Accepted: 01/22/2023] [Indexed: 01/27/2023]
Abstract
State-of-the-art (SOTA) convolutional neural network models have been widely adapted in medical imaging and applied to address different clinical problems. However, the complexity and scale of such models may not be justified in medical imaging and subject to the available resource budget. Further increasing the number of representative feature maps for the classification task decreases the model explainability. The current data normalization practice is fixed prior to model development and discounting the specification of the data domain. Acknowledging these issues, the current work proposed a new scalable model family called PlexusNet; the block architecture and model scaling by the network's depth, width, and branch regulate PlexusNet's architecture. The efficient computation costs outlined the dimensions of PlexusNet scaling and design. PlexusNet includes a new learnable data normalization algorithm for better data generalization. We applied a simple yet effective neural architecture search to design PlexusNet tailored to five clinical classification problems that achieve a performance noninferior to the SOTA models ResNet-18 and EfficientNet B0/1. It also does so with lower parameter capacity and representative feature maps in ten-fold ranges than the smallest SOTA models with comparable performance. The visualization of representative features revealed distinguishable clusters associated with categories based on latent features generated by PlexusNet. The package and source code are at https://github.com/oeminaga/PlexusNet.git.
Collapse
Affiliation(s)
- Okyaz Eminaga
- Center for Artificial Intelligence in Medicine & Imaging and Department of Urology, Stanford School of Medicine, Stanford, CA, 94305, USA; Department of Urology, Stanford School of Medicine, Stanford, CA, 94305, USA
| | - Mahmoud Abbas
- Department of Pathology, University of Muenster, Muenster, Germany.
| | - Jeanne Shen
- Department of Pathology, Stanford School of Medicine, Stanford, CA, 94305, USA.
| | - Mark Laurie
- Department of Computer Science, Stanford University, Stanford, CA, 94305, USA.
| | - James D Brooks
- Department of Urology, Stanford School of Medicine, Stanford, CA, 94305, USA.
| | - Joseph C Liao
- Department of Urology, Stanford School of Medicine, Stanford, CA, 94305, USA.
| | - Daniel L Rubin
- Department of Biomedical Data Science, Stanford School of Medicine, Stanford, CA, 94305, USA.
| |
Collapse
|
13
|
Makkar A, Santosh KC. SecureFed: federated learning empowered medical imaging technique to analyze lung abnormalities in chest X-rays. INT J MACH LEARN CYB 2023; 14:1-12. [PMID: 36817940 PMCID: PMC9928498 DOI: 10.1007/s13042-023-01789-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2022] [Accepted: 01/20/2023] [Indexed: 02/16/2023]
Abstract
Machine learning is an effective and accurate technique to diagnose COVID-19 infections using image data, and chest X-Ray (CXR) is no exception. Considering privacy issues, machine learning scientists end up receiving less medical imaging data. Federated Learning (FL) is a privacy-preserving distributed machine learning paradigm that generates an unbiased global model that follows local model (from clients) without exposing their personal data. In the case of heterogeneous data among clients, vanilla or default FL mechanism still introduces an insecure method for updating models. Therefore, we proposed SecureFed-a secure aggregation method-which ensures fairness and robustness. In our experiments, we employed COVID-19 CXR dataset (of size 2100 positive cases) and compared it with the existing FL frameworks such as FedAvg, FedMGDA+, and FedRAD. In our comparison, we primarily considered robustness (accuracy) and fairness (consistency). As the SecureFed produced consistently better results, it is generic enough to be considered for multimodal data.
Collapse
Affiliation(s)
- Aaisha Makkar
- College of Science and Engineering, University of Derby, Kedleston Rd, Derby, DE22 1GB UK
| | - KC Santosh
- Applied AI Research Lab, Department of Computer Science, University of South Dakota, 414 E Clark St, Vermillion, SD 57069 USA
| |
Collapse
|
14
|
Hamad QS, Samma H, Suandi SA. Feature selection of pre-trained shallow CNN using the QLESCA optimizer: COVID-19 detection as a case study. APPL INTELL 2023; 53:1-23. [PMID: 36777882 PMCID: PMC9900578 DOI: 10.1007/s10489-022-04446-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/29/2022] [Indexed: 02/08/2023]
Abstract
According to the World Health Organization, millions of infections and a lot of deaths have been recorded worldwide since the emergence of the coronavirus disease (COVID-19). Since 2020, a lot of computer science researchers have used convolutional neural networks (CNNs) to develop interesting frameworks to detect this disease. However, poor feature extraction from the chest X-ray images and the high computational cost of the available models introduce difficulties for an accurate and fast COVID-19 detection framework. Moreover, poor feature extraction has caused the issue of 'the curse of dimensionality', which will negatively affect the performance of the model. Feature selection is typically considered as a preprocessing mechanism to find an optimal subset of features from a given set of all features in the data mining process. Thus, the major purpose of this study is to offer an accurate and efficient approach for extracting COVID-19 features from chest X-rays that is also less computationally expensive than earlier approaches. To achieve the specified goal, we design a mechanism for feature extraction based on shallow conventional neural network (SCNN) and used an effective method for selecting features by utilizing the newly developed optimization algorithm, Q-Learning Embedded Sine Cosine Algorithm (QLESCA). Support vector machines (SVMs) are used as a classifier. Five publicly available chest X-ray image datasets, consisting of 4848 COVID-19 images and 8669 non-COVID-19 images, are used to train and evaluate the proposed model. The performance of the QLESCA is evaluated against nine recent optimization algorithms. The proposed method is able to achieve the highest accuracy of 97.8086% while reducing the number of features from 100 to 38. Experiments prove that the accuracy of the model improves with the usage of the QLESCA as the dimensionality reduction technique by selecting relevant features. Graphical abstract
Collapse
Affiliation(s)
- Qusay Shihab Hamad
- Intelligent Biometric Group, School of Electrical and Electronic Engineering, Engineering Campus, Universiti Sains Malaysia, 14300 Nibong Tebal, Penang, Malaysia
- University of Information Technology and Communications (UOITC), Baghdad, Iraq
| | - Hussein Samma
- SDAIA-KFUPM Joint Research Center for Artificial Intelligence (JRC-AI), King Fahd University of Petroleum and Minerals, Dhahran, Saudi Arabia
| | - Shahrel Azmin Suandi
- Intelligent Biometric Group, School of Electrical and Electronic Engineering, Engineering Campus, Universiti Sains Malaysia, 14300 Nibong Tebal, Penang, Malaysia
| |
Collapse
|
15
|
Ahamed MKU, Islam MM, Uddin MA, Akhter A, Acharjee UK, Paul BK, Moni MA. DTLCx: An Improved ResNet Architecture to Classify Normal and Conventional Pneumonia Cases from COVID-19 Instances with Grad-CAM-Based Superimposed Visualization Utilizing Chest X-ray Images. Diagnostics (Basel) 2023; 13:diagnostics13030551. [PMID: 36766662 PMCID: PMC9914155 DOI: 10.3390/diagnostics13030551] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Revised: 01/04/2023] [Accepted: 01/31/2023] [Indexed: 02/05/2023] Open
Abstract
COVID-19 is a severe respiratory contagious disease that has now spread all over the world. COVID-19 has terribly impacted public health, daily lives and the global economy. Although some developed countries have advanced well in detecting and bearing this coronavirus, most developing countries are having difficulty in detecting COVID-19 cases for the mass population. In many countries, there is a scarcity of COVID-19 testing kits and other resources due to the increasing rate of COVID-19 infections. Therefore, this deficit of testing resources and the increasing figure of daily cases encouraged us to improve a deep learning model to aid clinicians, radiologists and provide timely assistance to patients. In this article, an efficient deep learning-based model to detect COVID-19 cases that utilizes a chest X-ray images dataset has been proposed and investigated. The proposed model is developed based on ResNet50V2 architecture. The base architecture of ResNet50V2 is concatenated with six extra layers to make the model more robust and efficient. Finally, a Grad-CAM-based discriminative localization is used to readily interpret the detection of radiological images. Two datasets were gathered from different sources that are publicly available with class labels: normal, confirmed COVID-19, bacterial pneumonia and viral pneumonia cases. Our proposed model obtained a comprehensive accuracy of 99.51% for four-class cases (COVID-19/normal/bacterial pneumonia/viral pneumonia) on Dataset-2, 96.52% for the cases with three classes (normal/ COVID-19/bacterial pneumonia) and 99.13% for the cases with two classes (COVID-19/normal) on Dataset-1. The accuracy level of the proposed model might motivate radiologists to rapidly detect and diagnose COVID-19 cases.
Collapse
Affiliation(s)
- Md. Khabir Uddin Ahamed
- Department of Computer Science and Engineering, Jagannath University, Dhaka 1100, Bangladesh
| | - Md Manowarul Islam
- Department of Computer Science and Engineering, Jagannath University, Dhaka 1100, Bangladesh
- Correspondence:
| | - Md. Ashraf Uddin
- Department of Computer Science and Engineering, Jagannath University, Dhaka 1100, Bangladesh
- School of Information Technology, Geelong, Deakin University, Geelong, VIC 3216, Australia
| | - Arnisha Akhter
- Department of Computer Science and Engineering, Jagannath University, Dhaka 1100, Bangladesh
| | - Uzzal Kumar Acharjee
- Department of Computer Science and Engineering, Jagannath University, Dhaka 1100, Bangladesh
| | - Bikash Kumar Paul
- Department of Information and Communication Technology, Mawlana Bhashani Science and Technology University, Tangail 1902, Bangladesh
- Department of Software Engineering, Daffodil International University, Dhaka 1207, Bangladesh
| | - Mohammad Ali Moni
- Artificial Intelligence & Data Science, School of Health and Rehabilitation Sciences, Faculty of Health and Behavioural Sciences, The University of Queensland, St. Lucia, QLD 4072, Australia
| |
Collapse
|
16
|
Gu S, Wang L, Han R, Liu X, Wang Y, Chen T, Zheng Z. Detection of sarcopenia using deep learning-based artificial intelligence body part measure system (AIBMS). Front Physiol 2023; 14:1092352. [PMID: 36776966 PMCID: PMC9909827 DOI: 10.3389/fphys.2023.1092352] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2022] [Accepted: 01/09/2023] [Indexed: 01/27/2023] Open
Abstract
Background: Sarcopenia is an aging syndrome that increases the risks of various adverse outcomes, including falls, fractures, physical disability, and death. Sarcopenia can be diagnosed through medical images-based body part analysis, which requires laborious and time-consuming outlining of irregular contours of abdominal body parts. Therefore, it is critical to develop an efficient computational method for automatically segmenting body parts and predicting diseases. Methods: In this study, we designed an Artificial Intelligence Body Part Measure System (AIBMS) based on deep learning to automate body parts segmentation from abdominal CT scans and quantification of body part areas and volumes. The system was developed using three network models, including SEG-NET, U-NET, and Attention U-NET, and trained on abdominal CT plain scan data. Results: This segmentation model was evaluated using multi-device developmental and independent test datasets and demonstrated a high level of accuracy with over 0.9 DSC score in segment body parts. Based on the characteristics of the three network models, we gave recommendations for the appropriate model selection in various clinical scenarios. We constructed a sarcopenia classification model based on cutoff values (Auto SMI model), which demonstrated high accuracy in predicting sarcopenia with an AUC of 0.874. We used Youden index to optimize the Auto SMI model and found a better threshold of 40.69. Conclusion: We developed an AI system to segment body parts in abdominal CT images and constructed a model based on cutoff value to achieve the prediction of sarcopenia with high accuracy.
Collapse
Affiliation(s)
- Shangzhi Gu
- Department of Computer Science and Technology, Institute for Artificial Intelligence, and BNRist, Tsinghua University, Beijing, China,School of Medicine, Tsinghua University, Beijing, China
| | - Lixue Wang
- Department of Radiology, Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua University, Beijing, China
| | - Rong Han
- Department of Computer Science and Technology, Institute for Artificial Intelligence, and BNRist, Tsinghua University, Beijing, China
| | - Xiaohong Liu
- Department of Computer Science and Technology, Institute for Artificial Intelligence, and BNRist, Tsinghua University, Beijing, China
| | - Yizhe Wang
- Department of Radiology, Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua University, Beijing, China
| | - Ting Chen
- Department of Computer Science and Technology, Institute for Artificial Intelligence, and BNRist, Tsinghua University, Beijing, China,Department of Bioinformatics, Fujian Key Laboratory of Medical Bioinformatics, School of Medical Technology and Engineering, Fujian Medical University, Fuzhou, China,*Correspondence: Ting Chen, ; Zhuozhao Zheng,
| | - Zhuozhao Zheng
- Department of Radiology, Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua University, Beijing, China,*Correspondence: Ting Chen, ; Zhuozhao Zheng,
| |
Collapse
|
17
|
Vinod DN, Prabaharan SRS. COVID-19-The Role of Artificial Intelligence, Machine Learning, and Deep Learning: A Newfangled. ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING : STATE OF THE ART REVIEWS 2023; 30:2667-2682. [PMID: 36685135 PMCID: PMC9843670 DOI: 10.1007/s11831-023-09882-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Accepted: 01/05/2023] [Indexed: 05/29/2023]
Abstract
The absolute previously infected novel coronavirus (COVID-19) was found in Wuhan, China, in December 2019. The COVID-19 epidemic has spread to more than 220 nations and territories globally and has altogether influenced each part of our day-to-day lives. As of 9th March 2022, a total aggregate of 44,78,82,185 (60,07,317) contaminated (dead) COVID-19 cases were accounted for all over the world. The quantities of contaminated cases passing despite everything increment essentially and do not indicate a controlled circumstance. The scope of this paper is to address this issue by presenting a comprehensive and comparative analysis of the existing Machine Learning (ML), Deep Learning (DL) and Artificial Intelligence (AI) based approaches used in significance in reacting to the COVID-19 epidemic and diagnosing the severe impacts. The paper provides, firstly, an overview of COVID-19 infection and highlights of this article; Secondly, an overview of exploring various executive innovations by utilizing different resources to stop the spread of COVID-19; Thirdly, a comparison of existing predicting methods of COVID-19 in the literature, with focus on ML, DL and AI-driven techniques with performance metrics; and finally, a discussion on the results of the work as well as future scope.
Collapse
Affiliation(s)
- Dasari Naga Vinod
- Department of Electronics and Communication Engineering, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Avadi, Chennai, Tamil Nadu 600062 India
| | - S. R. S. Prabaharan
- Sathyabama Centre for Advanced Studies, Sathyabama Institute of Science and Technology, Rajiv Gandhi Salai, Chennai, Tamil Nadu 600119 India
| |
Collapse
|
18
|
Majrashi NAA. The value of chest X-ray and CT severity scoring systems in the diagnosis of COVID-19: A review. Front Med (Lausanne) 2023; 9:1076184. [PMID: 36714121 PMCID: PMC9877460 DOI: 10.3389/fmed.2022.1076184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Accepted: 12/13/2022] [Indexed: 01/13/2023] Open
Abstract
Coronavirus disease 2019 (COVID-19) is caused by a coronavirus family member known as severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2). The main laboratory test to confirm the quick diagnosis of COVID-19 infection is reverse transcription-polymerase chain reaction (RT-PCR) based on nasal or throat swab sampling. A small percentage of false-negative RT-PCR results have been reported. The RT-PCR test has a sensitivity of 50-72%, which could be attributed to a low viral load in test specimens or laboratory errors. In contrast, chest CT has shown 56-98% of sensitivity in diagnosing COVID-19 at initial presentation and has been suggested to be useful in correcting false negatives from RT-PCR. Chest X-rays and CT scans have been proposed to predict COVID-19 disease severity by displaying the score of lung involvement and thus providing information about the diagnosis and prognosis of COVID-19 infection. As a result, the current study provides a comprehensive overview of the utility of the severity score index using X-rays and CT scans in diagnosing patients with COVID-19 when compared to RT-PCR.
Collapse
|
19
|
Podder P, Das SR, Mondal MRH, Bharati S, Maliha A, Hasan MJ, Piltan F. LDDNet: A Deep Learning Framework for the Diagnosis of Infectious Lung Diseases. SENSORS (BASEL, SWITZERLAND) 2023; 23:480. [PMID: 36617076 PMCID: PMC9824583 DOI: 10.3390/s23010480] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Revised: 12/25/2022] [Accepted: 12/27/2022] [Indexed: 06/17/2023]
Abstract
This paper proposes a new deep learning (DL) framework for the analysis of lung diseases, including COVID-19 and pneumonia, from chest CT scans and X-ray (CXR) images. This framework is termed optimized DenseNet201 for lung diseases (LDDNet). The proposed LDDNet was developed using additional layers of 2D global average pooling, dense and dropout layers, and batch normalization to the base DenseNet201 model. There are 1024 Relu-activated dense layers and 256 dense layers using the sigmoid activation method. The hyper-parameters of the model, including the learning rate, batch size, epochs, and dropout rate, were tuned for the model. Next, three datasets of lung diseases were formed from separate open-access sources. One was a CT scan dataset containing 1043 images. Two X-ray datasets comprising images of COVID-19-affected lungs, pneumonia-affected lungs, and healthy lungs exist, with one being an imbalanced dataset with 5935 images and the other being a balanced dataset with 5002 images. The performance of each model was analyzed using the Adam, Nadam, and SGD optimizers. The best results have been obtained for both the CT scan and CXR datasets using the Nadam optimizer. For the CT scan images, LDDNet showed a COVID-19-positive classification accuracy of 99.36%, a 100% precision recall of 98%, and an F1 score of 99%. For the X-ray dataset of 5935 images, LDDNet provides a 99.55% accuracy, 73% recall, 100% precision, and 85% F1 score using the Nadam optimizer in detecting COVID-19-affected patients. For the balanced X-ray dataset, LDDNet provides a 97.07% classification accuracy. For a given set of parameters, the performance results of LDDNet are better than the existing algorithms of ResNet152V2 and XceptionNet.
Collapse
Affiliation(s)
- Prajoy Podder
- Institute of Information and Communication Technology, Bangladesh University of Engineering and Technology, Dhaka 1205, Bangladesh
| | - Sanchita Rani Das
- Institute of Information and Communication Technology, Bangladesh University of Engineering and Technology, Dhaka 1205, Bangladesh
| | - M. Rubaiyat Hossain Mondal
- Institute of Information and Communication Technology, Bangladesh University of Engineering and Technology, Dhaka 1205, Bangladesh
| | - Subrato Bharati
- Institute of Information and Communication Technology, Bangladesh University of Engineering and Technology, Dhaka 1205, Bangladesh
| | - Azra Maliha
- Faculty of Engineering and IT, The British University in Dubai, Dubai P.O. Box 345015, United Arab Emirates
| | - Md Junayed Hasan
- National Subsea Centre, Robert Gordon University, Aberdeen AB10 7AQ, UK
| | - Farzin Piltan
- Ulsan Industrial Artificial Intelligence (UIAI) Lab, Department of Electrical, Electronics and Computer Engineering, University of Ulsan, Ulsan 44610, Republic of Korea
| |
Collapse
|
20
|
Yang H, Wang L, Xu Y, Liu X. CovidViT: a novel neural network with self-attention mechanism to detect Covid-19 through X-ray images. INT J MACH LEARN CYB 2023; 14:973-987. [PMID: 36274812 PMCID: PMC9580454 DOI: 10.1007/s13042-022-01676-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2021] [Accepted: 09/28/2022] [Indexed: 11/30/2022]
Abstract
Since the emergence of the novel coronavirus in December 2019, it has rapidly swept across the globe, with a huge impact on daily life, public health and the economy around the world. There is an urgent necessary for a rapid and economical detection method for the Covid-19. In this study, we used the transformers-based deep learning method to analyze the chest X-rays of normal, Covid-19 and viral pneumonia patients. Covid-Vision-Transformers (CovidViT) is proposed to detect Covid-19 cases through X-ray images. CovidViT is based on transformers block with the self-attention mechanism. In order to demonstrate its superiority, this research is also compared with other popular deep learning models, and the experimental result shows CovidViT outperforms other deep learning models and achieves 98.0% accuracy on test set, which means that the proposed model is excellent in Covid-19 detection. Besides, an online system for quick Covid-19 diagnosis is built on http://yanghang.site/covid19.
Collapse
Affiliation(s)
- Hang Yang
- College of Science, China Agricultural University, Beijing, 100083 China
| | - Liyang Wang
- School of Clinical Medicine, Tsinghua University, Beijing, 100084 China
| | - Yitian Xu
- College of Science, China Agricultural University, Beijing, 100083 China
| | - Xuhua Liu
- College of Science, China Agricultural University, Beijing, 100083 China
| |
Collapse
|
21
|
Celik G. Detection of Covid-19 and other pneumonia cases from CT and X-ray chest images using deep learning based on feature reuse residual block and depthwise dilated convolutions neural network. Appl Soft Comput 2023; 133:109906. [PMID: 36504726 PMCID: PMC9726212 DOI: 10.1016/j.asoc.2022.109906] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2022] [Revised: 11/29/2022] [Accepted: 12/01/2022] [Indexed: 12/12/2022]
Abstract
Covid-19 has become a worldwide epidemic which has caused the death of millions in a very short time. This disease, which is transmitted rapidly, has mutated and different variations have emerged. Early diagnosis is important to prevent the spread of this disease. In this study, a new deep learning-based architecture is proposed for rapid detection of Covid-19 and other symptoms using CT and X-ray chest images. This method, called CovidDWNet, is based on a structure based on feature reuse residual block (FRB) and depthwise dilated convolutions (DDC) units. The FRB and DDC units efficiently acquired various features in the chest scan images and it was seen that the proposed architecture significantly improved its performance. In addition, the feature maps obtained with the CovidDWNet architecture were estimated with the Gradient boosting (GB) algorithm. With the CovidDWNet+GB architecture, which is a combination of CovidDWNet and GB, a performance increase of approximately 7% in CT images and between 3% and 4% in X-ray images has been achieved. The CovidDWNet+GB architecture achieved the highest success compared to other architectures, with 99.84% and 100% accuracy rates, respectively, on different datasets containing binary class (Covid-19 and Normal) CT images. Similarly, the proposed architecture showed the highest success with 96.81% accuracy in multi-class (Covid-19, Lung Opacity, Normal and Viral Pneumonia) X-ray images and 96.32% accuracy in the dataset containing X-ray and CT images. When the time to predict the disease in CT or X-ray images is examined, it is possible to say that it has a high speed because the CovidDWNet+GB method predicts thousands of images within seconds.
Collapse
Affiliation(s)
- Gaffari Celik
- Agri Ibrahim Cecen University, Department of Computer Technology, Agri, Turkey
| |
Collapse
|
22
|
Singh MP, Singh N, Mishra D, Ehsan S, Chaturvedi VK, Chaudhary A, Singh V, Vamanu E. Computational Approaches to Designing Antiviral Drugs against COVID-19: A Comprehensive Review. Curr Pharm Des 2023; 29:2601-2617. [PMID: 37916490 DOI: 10.2174/0113816128259795231023193419] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Accepted: 09/21/2023] [Indexed: 11/03/2023]
Abstract
The global impact of the COVID-19 pandemic caused by SARS-CoV-2 necessitates innovative strategies for the rapid development of effective treatments. Computational methodologies, such as molecular modelling, molecular dynamics simulations, and artificial intelligence, have emerged as indispensable tools in the drug discovery process. This review aimed to provide a comprehensive overview of these computational approaches and their application in the design of antiviral agents for COVID-19. Starting with an examination of ligand-based and structure-based drug discovery, the review has delved into the intricate ways through which molecular modelling can accelerate the identification of potential therapies. Additionally, the investigation extends to phytochemicals sourced from nature, which have shown promise as potential antiviral agents. Noteworthy compounds, including gallic acid, naringin, hesperidin, Tinospora cordifolia, curcumin, nimbin, azadironic acid, nimbionone, nimbionol, and nimocinol, have exhibited high affinity for COVID-19 Mpro and favourable binding energy profiles compared to current drugs. Although these compounds hold potential, their further validation through in vitro and in vivo experimentation is imperative. Throughout this exploration, the review has emphasized the pivotal role of computational biologists, bioinformaticians, and biotechnologists in driving rapid advancements in clinical research and therapeutic development. By combining state-of-the-art computational techniques with insights from structural and molecular biology, the search for potent antiviral agents has been accelerated. The collaboration between these disciplines holds immense promise in addressing the transmissibility and virulence of SARS-CoV-2.
Collapse
Affiliation(s)
- Mohan P Singh
- Centre of Biotechnology, University of Allahabad, Prayagraj 211002, India
| | - Nidhi Singh
- Centre of Bioinformatics, University of Allahabad, Prayagraj 211002, India
| | - Divya Mishra
- Centre of Bioinformatics, University of Allahabad, Prayagraj 211002, India
| | - Saba Ehsan
- Centre of Biotechnology, University of Allahabad, Prayagraj 211002, India
| | - Vivek K Chaturvedi
- Department of Gastroenterology, Institute of Medical Sciences, Banaras Hindu University, Varanasi 221005, India
| | - Anupriya Chaudhary
- Centre of Biotechnology, University of Allahabad, Prayagraj 211002, India
| | - Veer Singh
- Department of Biochemistry, Rajendra Memorial Research Institute of Medical Sciences, Patna 800007, India
| | - Emanuel Vamanu
- Faculty of Biotechnology, University of Agricultural Sciences and Veterinary Medicine of Bucharest, Bucharest 011464, Romania
| |
Collapse
|
23
|
Detection of COVID-19 Case from Chest CT Images Using Deformable Deep Convolutional Neural Network. JOURNAL OF HEALTHCARE ENGINEERING 2023; 2023:4301745. [PMID: 36844950 PMCID: PMC9949952 DOI: 10.1155/2023/4301745] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/24/2022] [Revised: 06/14/2022] [Accepted: 01/24/2023] [Indexed: 02/18/2023]
Abstract
The infectious coronavirus disease (COVID-19) has become a great threat to global human health. Timely and rapid detection of COVID-19 cases is very crucial to control its spreading through isolation measures as well as for proper treatment. Though the real-time reverse transcription-polymerase chain reaction (RT-PCR) test is a widely used technique for COVID-19 infection, recent researches suggest chest computed tomography (CT)-based screening as an effective substitute in cases of time and availability limitations of RT-PCR. In consequence, deep learning-based COVID-19 detection from chest CT images is gaining momentum. Furthermore, visual analysis of data has enhanced the opportunities of maximizing the prediction performance in this big data and deep learning realm. In this article, we have proposed two separate deformable deep networks converting from the conventional convolutional neural network (CNN) and the state-of-the-art ResNet-50, to detect COVID-19 cases from chest CT images. The impact of the deformable concept has been observed through performance comparative analysis among the designed deformable and normal models, and it is found that the deformable models show better prediction results than their normal form. Furthermore, the proposed deformable ResNet-50 model shows better performance than the proposed deformable CNN model. The gradient class activation mapping (Grad-CAM) technique has been used to visualize and check the targeted regions' localization effort at the final convolutional layer and has been found excellent. Total 2481 chest CT images have been used to evaluate the performance of the proposed models with a train-valid-test data splitting ratio of 80 : 10 : 10 in random fashion. The proposed deformable ResNet-50 model achieved training accuracy of 99.5% and test accuracy of 97.6% with specificity of 98.5% and sensitivity of 96.5% which are satisfactory compared with related works. The comprehensive discussion demonstrates that the proposed deformable ResNet-50 model-based COVID-19 detection technique can be useful for clinical applications.
Collapse
|
24
|
Ornob TR, Roy G, Hassan E. CovidExpert: A Triplet Siamese Neural Network framework for the detection of COVID-19. INFORMATICS IN MEDICINE UNLOCKED 2023; 37:101156. [PMID: 36686559 PMCID: PMC9837208 DOI: 10.1016/j.imu.2022.101156] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Revised: 12/27/2022] [Accepted: 12/28/2022] [Indexed: 01/15/2023] Open
Abstract
Patients with the COVID-19 infection may have pneumonia-like symptoms as well as respiratory problems which may harm the lungs. From medical images, coronavirus illness may be accurately identified and predicted using a variety of machine learning methods. Most of the published machine learning methods may need extensive hyperparameter adjustment and are unsuitable for small datasets. By leveraging the data in a comparatively small dataset, few-shot learning algorithms aim to reduce the requirement of large datasets. This inspired us to develop a few-shot learning model for early detection of COVID-19 to reduce the post-effect of this dangerous disease. The proposed architecture combines few-shot learning with an ensemble of pre-trained convolutional neural networks to extract feature vectors from CT scan images for similarity learning. The proposed Triplet Siamese Network as the few-shot learning model classified CT scan images into Normal, COVID-19, and Community-Acquired Pneumonia. The suggested model achieved an overall accuracy of 98.719%, a specificity of 99.36%, a sensitivity of 98.72%, and a ROC score of 99.9% with only 200 CT scans per category for training data.
Collapse
|
25
|
Lasker A, Ghosh M, Obaidullah SM, Chakraborty C, Roy K. LWSNet - a novel deep-learning architecture to segregate Covid-19 and pneumonia from x-ray imagery. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 82:21801-21823. [PMID: 36532598 PMCID: PMC9734972 DOI: 10.1007/s11042-022-14247-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Revised: 08/18/2022] [Accepted: 11/04/2022] [Indexed: 05/27/2023]
Abstract
Automatic detection of lung diseases using AI-based tools became very much necessary to handle the huge number of cases occurring across the globe and support the doctors. This paper proposed a novel deep learning architecture named LWSNet (Light Weight Stacking Network) to separate Covid-19, cold pneumonia, and normal chest x-ray images. This framework is based on single, double, triple, and quadruple stack mechanisms to address the above-mentioned tri-class problem. In this framework, a truncated version of standard deep learning models and a lightweight CNN model was considered to conviniently deploy in resource-constraint devices. An evaluation was conducted on three publicly available datasets alongwith their combination. We received 97.28%, 96.50%, 97.41%, and 98.54% highest classification accuracies using quadruple stack. On further investigation, we found, using LWSNet, the average accuracy got improved from individual model to quadruple model by 2.31%, 2.55%, 2.88%, and 2.26% on four respective datasets.
Collapse
Affiliation(s)
- Asifuzzaman Lasker
- Department of Computer Science & Engineering, Aliah University, Kolkata, India
| | - Mridul Ghosh
- Department of Computer Science, Shyampur Siddheswari Mahavidyalaya, Howrah, India
| | - Sk Md Obaidullah
- Department of Computer Science & Engineering, Aliah University, Kolkata, India
| | | | - Kaushik Roy
- Department of Computer Science, West Bengal State University, Barasat, India
| |
Collapse
|
26
|
Lasker A, Ghosh M, Obaidullah SM, Chakraborty C, Roy K. LWSNet - a novel deep-learning architecture to segregate Covid-19 and pneumonia from x-ray imagery. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 82:1-23. [PMID: 36532598 DOI: 10.1007/s11042-022-13740-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Revised: 08/18/2022] [Accepted: 11/04/2022] [Indexed: 05/23/2023]
Abstract
Automatic detection of lung diseases using AI-based tools became very much necessary to handle the huge number of cases occurring across the globe and support the doctors. This paper proposed a novel deep learning architecture named LWSNet (Light Weight Stacking Network) to separate Covid-19, cold pneumonia, and normal chest x-ray images. This framework is based on single, double, triple, and quadruple stack mechanisms to address the above-mentioned tri-class problem. In this framework, a truncated version of standard deep learning models and a lightweight CNN model was considered to conviniently deploy in resource-constraint devices. An evaluation was conducted on three publicly available datasets alongwith their combination. We received 97.28%, 96.50%, 97.41%, and 98.54% highest classification accuracies using quadruple stack. On further investigation, we found, using LWSNet, the average accuracy got improved from individual model to quadruple model by 2.31%, 2.55%, 2.88%, and 2.26% on four respective datasets.
Collapse
Affiliation(s)
- Asifuzzaman Lasker
- Department of Computer Science & Engineering, Aliah University, Kolkata, India
| | - Mridul Ghosh
- Department of Computer Science, Shyampur Siddheswari Mahavidyalaya, Howrah, India
| | - Sk Md Obaidullah
- Department of Computer Science & Engineering, Aliah University, Kolkata, India
| | | | - Kaushik Roy
- Department of Computer Science, West Bengal State University, Barasat, India
| |
Collapse
|
27
|
Guo J, Meng S, Su H, Zhang B, Li T. Non-invasive optical monitoring of human lungs: Monte Carlo modeling of photon migration in Visible Chinese Human and an experimental test on a human. BIOMEDICAL OPTICS EXPRESS 2022; 13:6389-6403. [PMID: 36589576 PMCID: PMC9774858 DOI: 10.1364/boe.472530] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/11/2022] [Revised: 09/30/2022] [Accepted: 10/23/2022] [Indexed: 05/02/2023]
Abstract
The human lung was quantified and visualized by photon transport in this paper. A Monte Carlo (MC) simulation of voxelized media was used with the visible Chinese human (VCH). This study theoretically explored the feasibility of non-invasive optical detection of pulmonary hemodynamics, and investigated the optimal location of the light source in the lung photon migration and optimized the source-detector distance. The light fluence intensity showed that the photon penetration depth was 6-8.4 mm in the human lung. The optimal distance from the light source to the detector was 2.7-2.9 cm, but the optimal distance of the superior lobe of right lung was 3.3-3.5 cm. We then conducted experiments on diffuse light reflectance using NIRS on 14 volunteers. These measurements agree well with the simulation results. All the results demonstrated the great potential of non-invasive monitoring of pulmonary hemodynamics and contribute to the study of human lungs in the biomedical optics community.
Collapse
Affiliation(s)
- Jianghui Guo
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences & Peking Union Medical College, Tianjin 300192, China
- School of optoelectronic science and engineering, University of Electronic Science & Technology of China, Chengdu, 611731, China
| | - Shuo Meng
- Tiangong University, Tianjin, 300387, China
| | - Hengjie Su
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences & Peking Union Medical College, Tianjin 300192, China
| | - Bowen Zhang
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences & Peking Union Medical College, Tianjin 300192, China
| | - Ting Li
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences & Peking Union Medical College, Tianjin 300192, China
| |
Collapse
|
28
|
Reis HC, Turk V. COVID-DSNet: A novel deep convolutional neural network for detection of coronavirus (SARS-CoV-2) cases from CT and Chest X-Ray images. Artif Intell Med 2022; 134:102427. [PMID: 36462906 PMCID: PMC9574866 DOI: 10.1016/j.artmed.2022.102427] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2022] [Revised: 10/07/2022] [Accepted: 10/13/2022] [Indexed: 12/14/2022]
Abstract
COVID-19 (SARS-CoV-2), which causes acute respiratory syndrome, is a contagious and deadly disease that has devastating effects on society and human life. COVID-19 can cause serious complications, especially in patients with pre-existing chronic health problems such as diabetes, hypertension, lung cancer, weakened immune systems, and the elderly. The most critical step in the fight against COVID-19 is the rapid diagnosis of infected patients. Computed Tomography (CT), chest X-ray (CXR), and RT-PCR diagnostic kits are frequently used to diagnose the disease. However, due to difficulties such as the inadequacy of RT-PCR test kits and false negative (FN) results in the early stages of the disease, the time-consuming examination of medical images obtained from CT and CXR imaging techniques by specialists/doctors, and the increasing workload on specialists, it is challenging to detect COVID-19. Therefore, researchers have suggested searching for new methods in COVID- 19 detection. In analysis studies with CT and CXR radiography images, it was determined that COVID-19-infected patients experienced abnormalities related to COVID-19. The anomalies observed here are the primary motivation for artificial intelligence researchers to develop COVID-19 detection applications with deep convolutional neural networks. Here, convolutional neural network-based deep learning algorithms from artificial intelligence technologies with high discrimination capabilities can be considered as an alternative approach in the disease detection process. This study proposes a deep convolutional neural network, COVID-DSNet, to diagnose typical pneumonia (bacterial, viral) and COVID-19 diseases from CT, CXR, hybrid CT + CXR images. In the multi-classification study with the CT dataset, 97.60 % accuracy and 97.60 % sensitivity values were obtained from the COVID-DSNet model, and 100 %, 96.30 %, and 96.58 % sensitivity values were obtained in the detection of typical, common pneumonia and COVID-19, respectively. The proposed model is an economical, practical deep learning network that data scientists can benefit from and develop. Although it is not a definitive solution in disease diagnosis, it may help experts as it produces successful results in detecting pneumonia and COVID-19.
Collapse
Affiliation(s)
- Hatice Catal Reis
- Department of Geomatics Engineering, Gumushane University, Gumushane 2900, Turkey,Corresponding author at: Department of Geomatics Engineering, Gumushane University, Gumushane 2900, Turkey
| | - Veysel Turk
- Department of Computer Engineering, University of Harran, Sanliurfa, Turkey
| |
Collapse
|
29
|
Lasker A, Obaidullah SM, Chakraborty C, Roy K. Application of Machine Learning and Deep Learning Techniques for COVID-19 Screening Using Radiological Imaging: A Comprehensive Review. SN COMPUTER SCIENCE 2022; 4:65. [PMID: 36467853 PMCID: PMC9702883 DOI: 10.1007/s42979-022-01464-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/22/2022] [Accepted: 10/18/2022] [Indexed: 11/26/2022]
Abstract
Lung, being one of the most important organs in human body, is often affected by various SARS diseases, among which COVID-19 has been found to be the most fatal disease in recent times. In fact, SARS-COVID 19 led to pandemic that spreads fast among the community causing respiratory problems. Under such situation, radiological imaging-based screening [mostly chest X-ray and computer tomography (CT) modalities] has been performed for rapid screening of the disease as it is a non-invasive approach. Due to scarcity of physician/chest specialist/expert doctors, technology-enabled disease screening techniques have been developed by several researchers with the help of artificial intelligence and machine learning (AI/ML). It can be remarkably observed that the researchers have introduced several AI/ML/DL (deep learning) algorithms for computer-assisted detection of COVID-19 using chest X-ray and CT images. In this paper, a comprehensive review has been conducted to summarize the works related to applications of AI/ML/DL for diagnostic prediction of COVID-19, mainly using X-ray and CT images. Following the PRISMA guidelines, total 265 articles have been selected out of 1715 published articles till the third quarter of 2021. Furthermore, this review summarizes and compares varieties of ML/DL techniques, various datasets, and their results using X-ray and CT imaging. A detailed discussion has been made on the novelty of the published works, along with advantages and limitations.
Collapse
Affiliation(s)
- Asifuzzaman Lasker
- Department of Computer Science & Engineering, Aliah University, Kolkata, India
| | - Sk Md Obaidullah
- Department of Computer Science & Engineering, Aliah University, Kolkata, India
| | - Chandan Chakraborty
- Department of Computer Science & Engineering, National Institute of Technical Teachers’ Training & Research Kolkata, Kolkata, India
| | - Kaushik Roy
- Department of Computer Science, West Bengal State University, Barasat, India
| |
Collapse
|
30
|
Dey S, Bhattacharya R, Malakar S, Schwenker F, Sarkar R. CovidConvLSTM: A fuzzy ensemble model for COVID-19 detection from chest X-rays. EXPERT SYSTEMS WITH APPLICATIONS 2022; 206:117812. [PMID: 35754941 PMCID: PMC9212804 DOI: 10.1016/j.eswa.2022.117812] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/03/2021] [Revised: 06/05/2022] [Accepted: 06/06/2022] [Indexed: 05/17/2023]
Abstract
The rapid outbreak of COVID-19 has affected the lives and livelihoods of a large part of the society. Hence, to confine the rapid spread of this virus, early detection of COVID-19 is extremely important. One of the most common ways of detecting COVID-19 is by using chest X-ray images. In the literature, it is found that most of the research activities applied convolutional neural network (CNN) models where the features generated by the last convolutional layer were directly passed to the classification models. In this paper, convolutional long short-term memory (ConvLSTM) layer is used in order to encode the spatial dependency among the feature maps obtained from the last convolutional layer of the CNN and to improve the image representational capability of the model. Additionally, the squeeze-and-excitation (SE) block, a spatial attention mechanism, is used to allocate weights to important local features. These two mechanisms are employed on three popular CNN models - VGG19, InceptionV3, and MobileNet to improve their classification strength. Finally, the Sugeno fuzzy integral based ensemble method is used on these classifiers' outputs to enhance the detection accuracy further. For experiments, three chest X-ray datasets, which are very prevalent for COVID-19 detection, are considered. For all the three datasets, it is found that the results obtained by the proposed method are comparable to state-of-the-art methods. The code, along with the pre-trained models, can be found at https://github.com/colabpro123/CovidConvLSTM.
Collapse
Affiliation(s)
- Subhrajit Dey
- Department of Electrical Engineering, Jadavpur University, Kolkata, India
| | - Rajdeep Bhattacharya
- Department of Computer Science and Engineering, Jadavpur University, Kolkata, India
| | - Samir Malakar
- Department of Computer Science, Asutosh College, Kolkata, India
| | | | - Ram Sarkar
- Department of Computer Science and Engineering, Jadavpur University, Kolkata, India
| |
Collapse
|
31
|
Nawaz M, Nazir T, Javed A, Malik KM, Saudagar AKJ, Khan MB, Abul Hasanat MH, AlTameem A, AlKhathami M. Efficient-ECGNet framework for COVID-19 classification and correlation prediction with the cardio disease through electrocardiogram medical imaging. Front Med (Lausanne) 2022; 9:1005920. [PMID: 36405585 PMCID: PMC9672089 DOI: 10.3389/fmed.2022.1005920] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Accepted: 10/19/2022] [Indexed: 11/06/2022] Open
Abstract
In the last 2 years, we have witnessed multiple waves of coronavirus that affected millions of people around the globe. The proper cure for COVID-19 has not been diagnosed as vaccinated people also got infected with this disease. Precise and timely detection of COVID-19 can save human lives and protect them from complicated treatment procedures. Researchers have employed several medical imaging modalities like CT-Scan and X-ray for COVID-19 detection, however, little concentration is invested in the ECG imaging analysis. ECGs are quickly available image modality in comparison to CT-Scan and X-ray, therefore, we use them for diagnosing COVID-19. Efficient and effective detection of COVID-19 from the ECG signal is a complex and time-taking task, as researchers usually convert them into numeric values before applying any method which ultimately increases the computational burden. In this work, we tried to overcome these challenges by directly employing the ECG images in a deep-learning (DL)-based approach. More specifically, we introduce an Efficient-ECGNet method that presents an improved version of the EfficientNetV2-B4 model with additional dense layers and is capable of accurately classifying the ECG images into healthy, COVID-19, myocardial infarction (MI), abnormal heartbeats (AHB), and patients with Previous History of Myocardial Infarction (PMI) classes. Moreover, we introduce a module to measure the similarity of COVID-19-affected ECG images with the rest of the diseases. To the best of our knowledge, this is the first effort to approximate the correlation of COVID-19 patients with those having any previous or current history of cardio or respiratory disease. Further, we generate the heatmaps to demonstrate the accurate key-points computation ability of our method. We have performed extensive experimentation on a publicly available dataset to show the robustness of the proposed approach and confirmed that the Efficient-ECGNet framework is reliable to classify the ECG-based COVID-19 samples.
Collapse
Affiliation(s)
- Marriam Nawaz
- Department of Computer Science, University of Engineering and Technology, Taxila, Pakistan
- Department of Software Engineering, University of Engineering and Technology, Taxila, Pakistan
| | - Tahira Nazir
- Department of Computer Science, University of Engineering and Technology, Taxila, Pakistan
- Department of Computer Science, Faculty of Computing, Riphah International University Gulberg Green Campus, Islamabad, Pakistan
| | - Ali Javed
- Department of Software Engineering, University of Engineering and Technology, Taxila, Pakistan
| | - Khalid Mahmood Malik
- Department of Computer Science and Engineering, Oakland University, Rochester, NY, United States
| | - Abdul Khader Jilani Saudagar
- Information Systems Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh, Saudi Arabia
- *Correspondence: Abdul Khader Jilani Saudagar,
| | - Muhammad Badruddin Khan
- Information Systems Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh, Saudi Arabia
| | - Mozaherul Hoque Abul Hasanat
- Information Systems Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh, Saudi Arabia
| | - Abdullah AlTameem
- Information Systems Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh, Saudi Arabia
| | - Mohammed AlKhathami
- Information Systems Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh, Saudi Arabia
| |
Collapse
|
32
|
Ahila T, Subhajini AC. E-GCS: Detection of COVID-19 through classification by attention bottleneck residual network. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE 2022; 116:105398. [PMID: 36158870 PMCID: PMC9485443 DOI: 10.1016/j.engappai.2022.105398] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Revised: 06/30/2022] [Accepted: 08/26/2022] [Indexed: 06/16/2023]
Abstract
Background Recently, the coronavirus disease 2019 (COVID-19) has caused mortality of many people globally. Thus, there existed a need to detect this disease to prevent its further spread. Hence, the study aims to predict COVID-19 infected patients based on deep learning (DL) and image processing. Objectives The study intends to classify the normal and abnormal cases of COVID-19 by considering three different medical imaging modalities namely ultrasound imaging, X-ray images and CT scan images through introduced attention bottleneck residual network (AB-ResNet). It also aims to segment the abnormal infected area from normal images for localizing localising the disease infected area through the proposed edge based graph cut segmentation (E-GCS). Methodology AB-ResNet is used for classifying images whereas E-GCS segment the abnormal images. The study possess various advantages as it rely on DL and possess capability for accelerating the training speed of deep networks. It also enhance the network depth leading to minimum parameters, minimising the impact of vanishing gradient issue and attaining effective network performance with respect to better accuracy. Results/Conclusion Performance and comparative analysis is undertaken to evaluate the efficiency of the introduced system and results explores the efficiency of the proposed system in COVID-19 detection with high accuracy (99%).
Collapse
Affiliation(s)
- T Ahila
- Department of Computer Applications, Noorul Islam Centre For Higher Education, Kumaracoil, 629180, India
| | - A C Subhajini
- Department of Computer Applications, Noorul Islam Centre For Higher Education, Kumaracoil, 629180, India
| |
Collapse
|
33
|
Ghose P, Uddin MA, Acharjee UK, Sharmin S. Deep viewing for the identification of Covid-19 infection status from chest X-Ray image using CNN based architecture. INTELLIGENT SYSTEMS WITH APPLICATIONS 2022; 16. [PMCID: PMC9536212 DOI: 10.1016/j.iswa.2022.200130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
In recent years, coronavirus (Covid-19) has evolved into one of the world’s leading life-threatening severe viral illnesses. A self-executing accord system might be a better option to stop Covid-19 from spreading due to its quick diagnostic option. Many researches have already investigated various deep learning techniques, which have a significant impact on the quick and precise early detection of Covid-19. Most of the existing techniques, though, have not been trained and tested using a significant amount of data. In this paper, we purpose a deep learning technique enabled Convolutional Neural Network (CNN) to automatically diagnose Covid-19 from chest x-rays. To train and test our model, 10,293 x-rays, including 2875 x-rays of Covid-19, were collected as a data set. The applied dataset consists of three groups of chest x-rays: Covid-19, pneumonia, and normal patients. The proposed approach achieved 98.5% accuracy, 98.9% specificity, 99.2% sensitivity, 99.2% precision, and 98.3% F1-score. Distinguishing Covid-19 patients from pneumonia patients using chest x-ray, particularly for human eyes is crucial since both diseases have nearly identical characteristics. To address this issue, we have categorized Covid-19 and pneumonia using x-rays, achieving a 99.60% accuracy rate. Our findings show that the proposed model might aid clinicians and researchers in rapidly detecting Covid-19 patients, hence facilitating the treatment of Covid-19 patients.
Collapse
Affiliation(s)
- Partho Ghose
- Depaprtment of Computer Science and Engineering, Jagannath University, Dhaka, Bangladesh,Corresponding author
| | - Md. Ashraf Uddin
- Depaprtment of Computer Science and Engineering, Jagannath University, Dhaka, Bangladesh
| | - Uzzal Kumar Acharjee
- Depaprtment of Computer Science and Engineering, Jagannath University, Dhaka, Bangladesh
| | - Selina Sharmin
- Depaprtment of Computer Science and Engineering, Jagannath University, Dhaka, Bangladesh
| |
Collapse
|
34
|
An evaluation of lightweight deep learning techniques in medical imaging for high precision COVID-19 diagnostics. HEALTHCARE ANALYTICS 2022. [PMID: 37520618 PMCID: PMC9396460 DOI: 10.1016/j.health.2022.100096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
Timely and rapid diagnoses are core to informing on optimum interventions that curb the spread of COVID-19. The use of medical images such as chest X-rays and CTs has been advocated to supplement the Reverse-Transcription Polymerase Chain Reaction (RT-PCR) test, which in turn has stimulated the application of deep learning techniques in the development of automated systems for the detection of infections. Decision support systems relax the challenges inherent to the physical examination of images, which is both time consuming and requires interpretation by highly trained clinicians. A review of relevant reported studies to date shows that most deep learning algorithms utilised approaches are not amenable to implementation on resource-constrained devices. Given the rate of infections is increasing, rapid, trusted diagnoses are a central tool in the management of the spread, mandating a need for a low-cost and mobile point-of-care detection systems, especially for middle- and low-income nations. The paper presents the development and evaluation of the performance of lightweight deep learning technique for the detection of COVID-19 using the MobileNetV2 model. Results demonstrate that the performance of the lightweight deep learning model is competitive with respect to heavyweight models but delivers a significant increase in the efficiency of deployment, notably in the lowering of the cost and memory requirements of computing resources.
Collapse
|
35
|
Conceptualising a channel-based overlapping CNN tower architecture for COVID-19 identification from CT-scan images. Sci Rep 2022; 12:18197. [PMID: 36307444 PMCID: PMC9616419 DOI: 10.1038/s41598-022-21700-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Accepted: 09/30/2022] [Indexed: 12/31/2022] Open
Abstract
Convolutional Neural Network (CNN) has been employed in classifying the COVID cases from the lungs' CT-Scan with promising quantifying metrics. However, SARS COVID-19 has been mutated, and we have many versions of the virus B.1.1.7, B.1.135, and P.1, hence there is a need for a more robust architecture that will classify the COVID positive patients from COVID negative patients with less training. We have developed a neural network based on the number of channels present in the images. The CNN architecture is developed in accordance with the number of the channels present in the dataset and are extracting the features separately from the channels present in the CT-Scan dataset. In the tower architecture, the first tower is dedicated for only the first channel present in the image; the second CNN tower is dedicated to the first and second channel feature maps, and finally the third channel takes account of all the feature maps from all three channels. We have used two datasets viz. one from Tongji Hospital, Wuhan, China and another SARS-CoV-2 dataset to train and evaluate our CNN architecture. The proposed model brought about an average accuracy of 99.4%, F1 score 0.988, and AUC 0.99.
Collapse
|
36
|
WSAGrad: a novel adaptive gradient based method. APPL INTELL 2022. [DOI: 10.1007/s10489-022-04205-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
37
|
Li F, Zhang X, Comellas AP, Hoffman EA, Yang T, Lin CL. Contrastive learning and subtyping of post-COVID-19 lung computed tomography images. Front Physiol 2022; 13:999263. [PMID: 36304574 PMCID: PMC9593072 DOI: 10.3389/fphys.2022.999263] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Accepted: 09/27/2022] [Indexed: 11/30/2022] Open
Abstract
Patients who recovered from the novel coronavirus disease 2019 (COVID-19) may experience a range of long-term symptoms. Since the lung is the most common site of the infection, pulmonary sequelae may present persistently in COVID-19 survivors. To better understand the symptoms associated with impaired lung function in patients with post-COVID-19, we aimed to build a deep learning model which conducts two tasks: to differentiate post-COVID-19 from healthy subjects and to identify post-COVID-19 subtypes, based on the latent representations of lung computed tomography (CT) scans. CT scans of 140 post-COVID-19 subjects and 105 healthy controls were analyzed. A novel contrastive learning model was developed by introducing a lung volume transform to learn latent features of disease phenotypes from CT scans at inspiration and expiration of the same subjects. The model achieved 90% accuracy for the differentiation of the post-COVID-19 subjects from the healthy controls. Two clusters (C1 and C2) with distinct characteristics were identified among the post-COVID-19 subjects. C1 exhibited increased air-trapping caused by small airways disease (4.10%, p = 0.008) and diffusing capacity for carbon monoxide %predicted (DLCO %predicted, 101.95%, p < 0.001), while C2 had decreased lung volume (4.40L, p < 0.001) and increased ground glass opacity (GGO%, 15.85%, p < 0.001). The contrastive learning model is able to capture the latent features of two post-COVID-19 subtypes characterized by air-trapping due to small airways disease and airway-associated interstitial fibrotic-like patterns, respectively. The discovery of post-COVID-19 subtypes suggests the need for different managements and treatments of long-term sequelae of patients with post-COVID-19.
Collapse
Affiliation(s)
- Frank Li
- Roy J. Carver Department of Biomedical Engineering, University of Iowa, Iowa City, IA, United States
- IIHR-Hydroscience and Engineering, University of Iowa, Iowa City, IA, United States
| | - Xuan Zhang
- IIHR-Hydroscience and Engineering, University of Iowa, Iowa City, IA, United States
- Department of Mechanical Engineering, University of Iowa, Iowa City, IA, United States
| | | | - Eric A. Hoffman
- Roy J. Carver Department of Biomedical Engineering, University of Iowa, Iowa City, IA, United States
- Department of Radiology, University of Iowa, Iowa City, IA, United States
| | - Tianbao Yang
- Department of Computer Science, University of Iowa, Iowa City, IA, United States
| | - Ching-Long Lin
- Roy J. Carver Department of Biomedical Engineering, University of Iowa, Iowa City, IA, United States
- IIHR-Hydroscience and Engineering, University of Iowa, Iowa City, IA, United States
- Department of Mechanical Engineering, University of Iowa, Iowa City, IA, United States
- Department of Radiology, University of Iowa, Iowa City, IA, United States
| |
Collapse
|
38
|
Shokri F, Rezapoor S, Najafi M, Asadi M, Karimi alavije M, Abolhassani M, Moieneddin MH, Ashrafi AM, Gholipour N, Naderi P, Charati JY, Alizadeh-Navaei R, Saeedi M, Heidary M, Rostamnezhad M. Efficacy of drug regimen with and without oseltamivir in hospitalized patients with COVID-19: A retrospective study. VACUNAS 2022; 24:141-149. [PMID: 36211984 PMCID: PMC9531663 DOI: 10.1016/j.vacun.2022.09.077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/13/2022] [Accepted: 09/16/2022] [Indexed: 11/05/2022]
Abstract
Introduction Coronavirus disease 2019 (COVID-19) is the most critical issue in nowadays medicine. We aimed to evaluate the use and therapeutic outcomes of oseltamivir, an antiviral drug for patients with COVID-19. Materials and method In an observational study conducted at Imam Khomeini Hospital in Amol, Iran, data for 544 patients with laboratory and CT scan result confirmed COVID-19 were retrospectively collected between February 24th and April 13th 2020. To compare the characteristics of patients based on gender, the chi-square test was used. Logistic regression was used to evaluate the effect of oseltamivir on the outcome of treatment. Logrank test were used to compare the length of hospital stay in people treated with oseltamivir and drugs other than oseltamivir. Results Kaplan–Meier and logrank test showed no significant reduction in hospitalization time and survival rate following treatment with oseltamivir. However, a significant increase in lymphocytes count and reduction of C-reactive protein (CRP) level detected. Conclusion Administration of oseltamivir for patients with COVID-19 didn't show any improvement in hospitalization duration and survival rate.
Collapse
Affiliation(s)
- Fazlollah Shokri
- Department of Medical Genetics, Faculty of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Saeed Rezapoor
- Department of Radiology, Imam Khomeini Hospital, Amol, Iran
| | - Masoud Najafi
- Medical Technology Research Center, Kermanshah University of Medical Sciences, Kermanshah, Iran,Radiology and Nuclear Medicine Department, Kermanshah University of Medical Sciences, Kermanshah, Iran
| | - Mohsen Asadi
- Department of Hematology and Blood Banking, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
| | | | - Moussa Abolhassani
- International Federation of Inventors' Associations (IFIA), Geneva, Switzerland
| | | | - Amir Muhammad Ashrafi
- Student Research Committee, Amol Faculty of Nursing, Mazandaran University of Medical Sciences, Sari, Iran
| | - Narges Gholipour
- Student Research Committee, School of Nursing and Midwifery, Mazandaran University of Medical Sciences, Sari, Iran
| | - Parisa Naderi
- Department of Biology, Faculty of Cellular and Molecular Sciences, Central Tehran Branch, Islamic Azad University, Tehran, Iran
| | - Jamshid Yazdani Charati
- Department of Biostatistics, Faculty of Health, Mazandaran University of Medical Sciences, Sari, Iran
| | - Reza Alizadeh-Navaei
- Gastrointestinal Cancer Research Center, Non-communicable Diseases Institute, Mazandaran University of Medical Sciences, Sari, Iran
| | - Majid Saeedi
- Department of Pharmaceutics, Faculty of Pharmacy, Mazandaran University of Medical Science, Sari, Iran
| | - Mohsen Heidary
- Cellular and Molecular Research Center, Sabzevar University of Medical Sciences, Sabzevar, Iran,Corresponding authors
| | - Mostafa Rostamnezhad
- Department of Pharmaceutics, Faculty of Pharmacy, Tehran University of Medical Sciences, Tehran, Iran,Corresponding authors
| |
Collapse
|
39
|
Jangam E, Annavarapu CSR, Barreto AAD. A multi-class classification framework for disease screening and disease diagnosis of COVID-19 from chest X-ray images. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 82:14367-14401. [PMID: 36157353 PMCID: PMC9490695 DOI: 10.1007/s11042-022-13710-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Revised: 05/05/2022] [Accepted: 08/24/2022] [Indexed: 06/16/2023]
Abstract
To accurately diagnose multiple lung diseases from chest X-rays, the critical aspect is to identify lung diseases with high sensitivity and specificity. This study proposed a novel multi-class classification framework that minimises either false positives or false negatives that is useful in computer aided diagnosis or computer aided detection respectively. To minimise false positives or false negatives, we generated respective stacked ensemble from pre-trained models and fully connected layers using selection metric and systematic method. The diversity of base classifiers was based on diverse set of false positives or false negatives generated. The proposed multi-class framework was evaluated on two chest X-ray datasets, and the performance was compared with the existing models and base classifiers. Moreover, we used LIME (Local Interpretable Model-agnostic Explanations) to locate the regions focused by the multi-class classification framework.
Collapse
Affiliation(s)
- Ebenezer Jangam
- Department of Information Technology, Velagapudi Ramakrishna Siddhartha Engineering College, Vijayawada, Andhra Pradesh India
- Department of Computer Science Engineering, Indian Institute of Technology(ISM), Dhanbad, Jharkhand India
| | | | | |
Collapse
|
40
|
Ghose P, Alavi M, Tabassum M, Ashraf Uddin M, Biswas M, Mahbub K, Gaur L, Mallik S, Zhao Z. Detecting COVID-19 infection status from chest X-ray and CT scan via single transfer learning-driven approach. Front Genet 2022; 13:980338. [PMID: 36212141 PMCID: PMC9533058 DOI: 10.3389/fgene.2022.980338] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Accepted: 08/18/2022] [Indexed: 11/17/2022] Open
Abstract
COVID-19 has caused over 528 million infected cases and over 6.25 million deaths since its outbreak in 2019. The uncontrolled transmission of the SARS-CoV-2 virus has caused human suffering and the death of uncountable people. Despite the continuous effort by the researchers and laboratories, it has been difficult to develop reliable efficient and stable vaccines to fight against the rapidly evolving virus strains. Therefore, effectively preventing the transmission in the community and globally has remained an urgent task since its outbreak. To avoid the rapid spread of infection, we first need to identify the infected individuals and isolate them. Therefore, screening computed tomography (CT scan) and X-ray can better separate the COVID-19 infected patients from others. However, one of the main challenges is to accurately identify infection from a medical image. Even experienced radiologists often have failed to do it accurately. On the other hand, deep learning algorithms can tackle this task much easier, faster, and more accurately. In this research, we adopt the transfer learning method to identify the COVID-19 patients from normal individuals when there is an inadequacy of medical image data to save time by generating reliable results promptly. Furthermore, our model can perform both X-rays and CT scan. The experimental results found that the introduced model can achieve 99.59% accuracy for X-rays and 99.95% for CT scan images. In summary, the proposed method can effectively identify COVID-19 infected patients, could be a great way which will help to classify COVID-19 patients quickly and prevent the viral transmission in the community.
Collapse
Affiliation(s)
- Partho Ghose
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka, Bangladesh
| | - Muhaddid Alavi
- Department of Computer Science and Engineering, Jagannath University, Dhaka, Bangladesh
| | - Mehnaz Tabassum
- Center for Health Informatics, Macquarie University, Sydney, NSW, Australia
| | - Md. Ashraf Uddin
- Department of Computer Science and Engineering, Jagannath University, Dhaka, Bangladesh
| | - Milon Biswas
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka, Bangladesh
| | - Kawsher Mahbub
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka, Bangladesh
| | - Loveleen Gaur
- Amity International Business School, Amity University, Noida, India
| | - Saurav Mallik
- Department of Environmental Health, Harvard T H Chan School of Public Health, Boston, MA, United States
| | - Zhongming Zhao
- Department of Environmental Health, Harvard T H Chan School of Public Health, Boston, MA, United States
- Human Genetics Center, School of Public Health, The University of Texas Health Science Center at Houston, Houston, TX, United States
| |
Collapse
|
41
|
Anilkumar B, Srividya K, Mary Sowjanya A. Covid-19 classification using sigmoid based hyper-parameter modified DNN for CT scans and chest X-rays. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 82:12513-12536. [PMID: 36157352 PMCID: PMC9485800 DOI: 10.1007/s11042-022-13783-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Revised: 07/22/2022] [Accepted: 09/05/2022] [Indexed: 06/16/2023]
Abstract
Coronavirus disease (COVID-19) is an infectious disease caused by the SARS-CoV-2 virus. Diagnosis of Computed Tomography (CT), and Chest X-rays (CXR) contains the problem of overfitting, earlier diagnosis, and mode collapse. In this work, we predict the classification of the Corona in CT and CXR images. Initially, the images of the dataset are pre-processed using the function of an adaptive Gaussian filter for de-nosing the image. Once the image is pre-processed it goes to Sigmoid Based Hyper-Parameter Modified DNN(SHMDNN). The hyperparameter modification makes use of the optimization algorithm of adaptive grey wolf optimization (AGWO). Finally, classification takes place and classifies the CT and CXR images into 3 categories namely normal, Pneumonia, and COVID-19 images. Better accuracy of 99.9% is reached when compared to different DNN networks.
Collapse
Affiliation(s)
- B Anilkumar
- Department of ECE, GMR Institute of Technology, Rajam, India
| | - K Srividya
- Department of CSE, GMR Institute of Technology, Rajam, India
| | - A Mary Sowjanya
- Department of CS&SE, Andhra University College of Engineering, Visakhapatnam, India
| |
Collapse
|
42
|
Pramanik R, Dey S, Malakar S, Mirjalili S, Sarkar R. TOPSIS aided ensemble of CNN models for screening COVID-19 in chest X-ray images. Sci Rep 2022; 12:15409. [PMID: 36104401 PMCID: PMC9471038 DOI: 10.1038/s41598-022-18463-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2021] [Accepted: 08/12/2022] [Indexed: 11/23/2022] Open
Abstract
The novel coronavirus (COVID-19), has undoubtedly imprinted our lives with its deadly impact. Early testing with isolation of the individual is the best possible way to curb the spread of this deadly virus. Computer aided diagnosis (CAD) provides an alternative and cheap option for screening of the said virus. In this paper, we propose a convolution neural network (CNN)-based CAD method for COVID-19 and pneumonia detection from chest X-ray images. We consider three input types for three identical base classifiers. To capture maximum possible complementary features, we consider the original RGB image, Red channel image and the original image stacked with Robert's edge information. After that we develop an ensemble strategy based on the technique for order preference by similarity to an ideal solution (TOPSIS) to aggregate the outcomes of base classifiers. The overall framework, called TOPCONet, is very light in comparison with standard CNN models in terms of the number of trainable parameters required. TOPCONet achieves state-of-the-art results when evaluated on the three publicly available datasets: (1) IEEE COVID-19 dataset + Kaggle Pneumonia Dataset, (2) Kaggle Radiography dataset and (3) COVIDx.
Collapse
|
43
|
Umer MJ, Amin J, Sharif M, Anjum MA, Azam F, Shah JH. An integrated framework for COVID-19 classification based on classical and quantum transfer learning from a chest radiograph. CONCURRENCY AND COMPUTATION : PRACTICE & EXPERIENCE 2022; 34:e6434. [PMID: 34512201 PMCID: PMC8420477 DOI: 10.1002/cpe.6434] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/22/2021] [Revised: 04/21/2021] [Accepted: 05/13/2021] [Indexed: 05/07/2023]
Abstract
COVID-19 is a quickly spreading over 10 million persons globally. The overall number of infected patients worldwide is estimated to be around 133,381,413 people. Infection rate is being increased on daily basis. It has also caused a devastating effect on the world economy and public health. Early stage detection of this disease is mandatory to reduce the mortality rate. Artificial intelligence performs a vital role for COVID-19 detection at an initial stage using chest radiographs. The proposed methods comprise of the two phases. Deep features (DFs) are derived from its last fully connected layers of pre-trained models like AlexNet and MobileNet in phase-I. Later these feature vectors are fused serially. Best features are selected through feature selection method of PCA and passed to the SVM and KNN for classification. In phase-II, quantum transfer learning model is utilized, in which a pre-trained ResNet-18 model is applied for DF collection and then these features are supplied as an input to the 4-qubit quantum circuit for model training with the tuned hyperparameters. The proposed technique is evaluated on two publicly available x-ray imaging datasets. The proposed methodology achieved an accuracy index of 99.0% with three classes including corona virus-positive images, normal images, and pneumonia radiographs. In comparison to other recently published work, the experimental findings show that the proposed approach outperforms it.
Collapse
Affiliation(s)
- Muhammad Junaid Umer
- Department of Computer ScienceComsats University Islamabad, Wah CampusRawalpindiPakistan
| | - Javeria Amin
- Department of Computer ScienceUniversity of WahRawalpindiPakistan
| | - Muhammad Sharif
- Department of Computer ScienceComsats University Islamabad, Wah CampusRawalpindiPakistan
| | | | - Faisal Azam
- Department of Computer ScienceComsats University Islamabad, Wah CampusRawalpindiPakistan
| | - Jamal Hussain Shah
- Department of Computer ScienceComsats University Islamabad, Wah CampusRawalpindiPakistan
| |
Collapse
|
44
|
Jalali SMJ, Ahmadian M, Ahmadian S, Hedjam R, Khosravi A, Nahavandi S. X-ray image based COVID-19 detection using evolutionary deep learning approach. EXPERT SYSTEMS WITH APPLICATIONS 2022; 201:116942. [PMID: 35378906 PMCID: PMC8966159 DOI: 10.1016/j.eswa.2022.116942] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/08/2020] [Revised: 12/24/2021] [Accepted: 03/17/2022] [Indexed: 06/01/2023]
Abstract
Radiological methodologies, such as chest x-rays and CT, are widely employed to help diagnose and monitor COVID-19 disease. COVID-19 displays certain radiological patterns easily detectable by X-rays of the chest. Therefore, radiologists can investigate these patterns for detecting coronavirus disease. However, this task is time-consuming and needs lots of trial and error. One of the main solutions to resolve this issue is to apply intelligent techniques such as deep learning (DL) models to automatically analyze the chest X-rays. Nevertheless, fine-tuning of architecture and hyperparameters of DL models is a complex and time-consuming procedure. In this paper, we propose an effective method to detect COVID-19 disease by applying convolutional neural network (CNN) to the chest X-ray images. To improve the accuracy of the proposed method, the last Softmax CNN layer is replaced with a K -nearest neighbors (KNN) classifier which takes into account the agreement of the neighborhood labeling. Moreover, we develop a novel evolutionary algorithm by improving the basic version of competitive swarm optimizer. To this end, three powerful evolutionary operators: Cauchy Mutation (CM), Evolutionary Boundary Constraint Handling (EBCH), and tent chaotic map are incorporated into the search process of the proposed evolutionary algorithm to speed up its convergence and make an excellent balance between exploration and exploitation phases. Then, the proposed evolutionary algorithm is used to automatically achieve the optimal values of CNN's hyperparameters leading to a significant improvement in the classification accuracy of the proposed method. Comprehensive comparative results reveal that compared with current models in the literature, the proposed method performs significantly more efficient.
Collapse
Affiliation(s)
| | - Milad Ahmadian
- Department of Computer Engineering, Razi University, Kermanshah, Iran
| | - Sajad Ahmadian
- Faculty of Information Technology, Kermanshah University of Technology, Kermanshah, Iran
| | - Rachid Hedjam
- Department of Computer science, Sultan Qaboos University, Muscat, Sultanate of Oman
| | - Abbas Khosravi
- Institute for Intelligent Systems Research and Innovation, (IISRI), Deakin University, Geelong, Australia
| | - Saeid Nahavandi
- Institute for Intelligent Systems Research and Innovation, (IISRI), Deakin University, Geelong, Australia
| |
Collapse
|
45
|
Neural architecture search for pneumonia diagnosis from chest X-rays. Sci Rep 2022; 12:11309. [PMID: 35788644 PMCID: PMC9252574 DOI: 10.1038/s41598-022-15341-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Accepted: 06/22/2022] [Indexed: 11/25/2022] Open
Abstract
Pneumonia is one of the diseases that causes the most fatalities worldwide, especially in children. Recently, pneumonia-caused deaths have increased dramatically due to the novel Coronavirus global pandemic. Chest X-ray (CXR) images are one of the most readily available and common imaging modality for the detection and identification of pneumonia. However, the detection of pneumonia from chest radiography is a difficult task even for experienced radiologists. Artificial Intelligence (AI) based systems have great potential in assisting in quick and accurate diagnosis of pneumonia from chest X-rays. The aim of this study is to develop a Neural Architecture Search (NAS) method to find the best convolutional architecture capable of detecting pneumonia from chest X-rays. We propose a Learning by Teaching framework inspired by the teaching-driven learning methodology from humans, and conduct experiments on a pneumonia chest X-ray dataset with over 5000 images. Our proposed method yields an area under ROC curve (AUC) of 97.6% for pneumonia detection, which improves upon previous NAS methods by 5.1% (absolute).
Collapse
|
46
|
A New Approach to COVID-19 Detection: An ANN Proposal Optimized through Tree-Seed Algorithm. Symmetry (Basel) 2022. [DOI: 10.3390/sym14071310] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023] Open
Abstract
Coronavirus disease (COVID-19), which affects the whole world, continues to spread. This disease has infected and killed millions of people worldwide. To limit the rate of spread of the disease, early detection should be provided and then the infected person should be quarantined. This paper proposes a Deep Learning-based application for early and accurate diagnosis of COVID-19. Compared to other studies, this application’s biggest difference and contribution are that it uses Tree Seed Algorithm (TSA)-optimized Artificial Neural Networks (ANN) to classify deep architectural features. Previous studies generally use fully connected layers for end-to-end learning classification. However, this study proves that even relatively simple AlexNet features can be classified more accurately with the TSA-ANN structure. The proposed hybrid model provides diagnosis with 98.54% accuracy for COVID-19 disease, which shows asymmetric distribution on Computed Tomography (CT) images. As a result, it is shown that using the proposed classification strategy, the features of end-to-end architectures can be classified more accurately.
Collapse
|
47
|
Pavlova M, Terhljan N, Chung AG, Zhao A, Surana S, Aboutalebi H, Gunraj H, Sabri A, Alaref A, Wong A. COVID-Net CXR-2: An Enhanced Deep Convolutional Neural Network Design for Detection of COVID-19 Cases From Chest X-ray Images. Front Med (Lausanne) 2022; 9:861680. [PMID: 35755067 PMCID: PMC9226387 DOI: 10.3389/fmed.2022.861680] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2022] [Accepted: 05/12/2022] [Indexed: 01/08/2023] Open
Abstract
As the COVID-19 pandemic devastates globally, the use of chest X-ray (CXR) imaging as a complimentary screening strategy to RT-PCR testing continues to grow given its routine clinical use for respiratory complaint. As part of the COVID-Net open source initiative, we introduce COVID-Net CXR-2, an enhanced deep convolutional neural network design for COVID-19 detection from CXR images built using a greater quantity and diversity of patients than the original COVID-Net. We also introduce a new benchmark dataset composed of 19,203 CXR images from a multinational cohort of 16,656 patients from at least 51 countries, making it the largest, most diverse COVID-19 CXR dataset in open access form. The COVID-Net CXR-2 network achieves sensitivity and positive predictive value of 95.5 and 97.0%, respectively, and was audited in a transparent and responsible manner. Explainability-driven performance validation was used during auditing to gain deeper insights in its decision-making behavior and to ensure clinically relevant factors are leveraged for improving trust in its usage. Radiologist validation was also conducted, where select cases were reviewed and reported on by two board-certified radiologists with over 10 and 19 years of experience, respectively, and showed that the critical factors leveraged by COVID-Net CXR-2 are consistent with radiologist interpretations.
Collapse
Affiliation(s)
- Maya Pavlova
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON, Canada
| | - Naomi Terhljan
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON, Canada
| | - Audrey G. Chung
- Waterloo AI Institute, University of Waterloo, Waterloo, ON, Canada
- DarwinAI Corp., Waterloo, ON, Canada
| | - Andy Zhao
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON, Canada
| | - Siddharth Surana
- Cheriton School of Computer Science, University of Waterloo, Waterloo, ON, Canada
| | - Hossein Aboutalebi
- Waterloo AI Institute, University of Waterloo, Waterloo, ON, Canada
- Cheriton School of Computer Science, University of Waterloo, Waterloo, ON, Canada
| | - Hayden Gunraj
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON, Canada
| | - Ali Sabri
- Department of Radiology, McMaster University, Hamilton, ON, Canada
- Niagara Health System, St. Catharines, ON, Canada
| | - Amer Alaref
- Department of Diagnostic Imaging, Northern Ontario School of Medicine, Thunder Bay, ON, Canada
- Department of Diagnostic Radiology, Thunder Bay Regional Health Sciences Centre, Thunder Bay, ON, Canada
| | - Alexander Wong
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON, Canada
- Waterloo AI Institute, University of Waterloo, Waterloo, ON, Canada
- DarwinAI Corp., Waterloo, ON, Canada
| |
Collapse
|
48
|
Abstract
During the outbreak of the COVID-19 pandemic, social networks became the preeminent medium for communication, social discussion, and entertainment. Social network users are regularly expressing their opinions about the impacts of the coronavirus pandemic. Therefore, social networks serve as a reliable source for studying the topics, emotions, and attitudes of users that have been discussed during the pandemic. In this paper, we investigate the reactions and attitudes of people towards topics raised on social media platforms. We collected data of two large-scale COVID-19 datasets from Twitter and Instagram for six and three months, respectively. This paper analyzes the reaction of social network users in terms of different aspects including sentiment analysis, topic detection, emotions, and the geo-temporal characteristics of our dataset. We show that the dominant sentiment reactions on social media are neutral, while the most discussed topics by social network users are about health issues. This paper examines the countries that attracted a higher number of posts and reactions from people, as well as the distribution of health-related topics discussed in the most mentioned countries. We shed light on the temporal shift of topics over countries. Our results show that posts from the top-mentioned countries influence and attract more reactions worldwide than posts from other parts of the world.
Collapse
|
49
|
Ho TT, Tran KD, Huang Y. FedSGDCOVID: Federated SGD COVID-19 Detection under Local Differential Privacy Using Chest X-ray Images and Symptom Information. SENSORS (BASEL, SWITZERLAND) 2022; 22:3728. [PMID: 35632136 PMCID: PMC9147951 DOI: 10.3390/s22103728] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Revised: 05/09/2022] [Accepted: 05/10/2022] [Indexed: 12/15/2022]
Abstract
Coronavirus (COVID-19) has created an unprecedented global crisis because of its detrimental effect on the global economy and health. COVID-19 cases have been rapidly increasing, with no sign of stopping. As a result, test kits and accurate detection models are in short supply. Early identification of COVID-19 patients will help decrease the infection rate. Thus, developing an automatic algorithm that enables the early detection of COVID-19 is essential. Moreover, patient data are sensitive, and they must be protected to prevent malicious attackers from revealing information through model updates and reconstruction. In this study, we presented a higher privacy-preserving federated learning system for COVID-19 detection without sharing data among data owners. First, we constructed a federated learning system using chest X-ray images and symptom information. The purpose is to develop a decentralized model across multiple hospitals without sharing data. We found that adding the spatial pyramid pooling to a 2D convolutional neural network improves the accuracy of chest X-ray images. Second, we explored that the accuracy of federated learning for COVID-19 identification reduces significantly for non-independent and identically distributed (Non-IID) data. We then proposed a strategy to improve the model's accuracy on Non-IID data by increasing the total number of clients, parallelism (client-fraction), and computation per client. Finally, for our federated learning model, we applied a differential privacy stochastic gradient descent (DP-SGD) to improve the privacy of patient data. We also proposed a strategy to maintain the robustness of federated learning to ensure the security and accuracy of the model.
Collapse
Affiliation(s)
- Trang-Thi Ho
- Research Center for Information Technology Innovation, Academia Sinica, Taipei 10607, Taiwan; (K.-D.T.); (Y.H.)
| | | | | |
Collapse
|
50
|
Meraihi Y, Gabis AB, Mirjalili S, Ramdane-Cherif A, Alsaadi FE. Machine Learning-Based Research for COVID-19 Detection, Diagnosis, and Prediction: A Survey. SN COMPUTER SCIENCE 2022; 3:286. [PMID: 35578678 PMCID: PMC9096341 DOI: 10.1007/s42979-022-01184-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/09/2022] [Accepted: 04/30/2022] [Indexed: 12/12/2022]
Abstract
The year 2020 experienced an unprecedented pandemic called COVID-19, which impacted the whole world. The absence of treatment has motivated research in all fields to deal with it. In Computer Science, contributions mainly include the development of methods for the diagnosis, detection, and prediction of COVID-19 cases. Data science and Machine Learning (ML) are the most widely used techniques in this area. This paper presents an overview of more than 160 ML-based approaches developed to combat COVID-19. They come from various sources like Elsevier, Springer, ArXiv, MedRxiv, and IEEE Xplore. They are analyzed and classified into two categories: Supervised Learning-based approaches and Deep Learning-based ones. In each category, the employed ML algorithm is specified and a number of used parameters is given. The parameters set for each of the algorithms are gathered in different tables. They include the type of the addressed problem (detection, diagnosis, or detection), the type of the analyzed data (Text data, X-ray images, CT images, Time series, Clinical data,...) and the evaluated metrics (accuracy, precision, sensitivity, specificity, F1-Score, and AUC). The study discusses the collected information and provides a number of statistics drawing a picture about the state of the art. Results show that Deep Learning is used in 79% of cases where 65% of them are based on the Convolutional Neural Network (CNN) and 17% use Specialized CNN. On his side, supervised learning is found in only 16% of the reviewed approaches and only Random Forest, Support Vector Machine (SVM) and Regression algorithms are employed.
Collapse
Affiliation(s)
- Yassine Meraihi
- LIST Laboratory, University of M’Hamed Bougara Boumerdes, Avenue of Independence, 35000 Boumerdes, Algeria
| | - Asma Benmessaoud Gabis
- Ecole nationale Supérieure d’Informatique, Laboratoire des Méthodes de Conception des Systèmes, BP 68 M, 16309 Oued-Smar, Alger Algeria
| | - Seyedali Mirjalili
- Centre for Artificial Intelligence Research and Optimisation, Torrens University Australia, Fortitude Valley, Brisbane, QLD 4006 Australia
- Yonsei Frontier Lab, Yonsei University, Seoul, Korea
| | - Amar Ramdane-Cherif
- LISV Laboratory, University of Versailles St-Quentin-en-Yvelines, 10-12 Avenue of Europe, 78140 Velizy, France
| | - Fawaz E. Alsaadi
- Information Technology Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah, Saudi Arabia
| |
Collapse
|