1
|
Davidian M, Lahav A, Joshua BZ, Wand O, Lurie Y, Mark S. Exploring the Interplay of Dataset Size and Imbalance on CNN Performance in Healthcare: Using X-rays to Identify COVID-19 Patients. Diagnostics (Basel) 2024; 14:1727. [PMID: 39202215 PMCID: PMC11353409 DOI: 10.3390/diagnostics14161727] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2024] [Revised: 07/21/2024] [Accepted: 08/07/2024] [Indexed: 09/03/2024] Open
Abstract
INTRODUCTION Convolutional Neural Network (CNN) systems in healthcare are influenced by unbalanced datasets and varying sizes. This article delves into the impact of dataset size, class imbalance, and their interplay on CNN systems, focusing on the size of the training set versus imbalance-a unique perspective compared to the prevailing literature. Furthermore, it addresses scenarios with more than two classification groups, often overlooked but prevalent in practical settings. METHODS Initially, a CNN was developed to classify lung diseases using X-ray images, distinguishing between healthy individuals and COVID-19 patients. Later, the model was expanded to include pneumonia patients. To evaluate performance, numerous experiments were conducted with varied data sizes and imbalance ratios for both binary and ternary classifications, measuring various indices to validate the model's efficacy. RESULTS The study revealed that increasing dataset size positively impacts CNN performance, but this improvement saturates beyond a certain size. A novel finding is that the data balance ratio influences performance more significantly than dataset size. The behavior of three-class classification mirrored that of binary classification, underscoring the importance of balanced datasets for accurate classification. CONCLUSIONS This study emphasizes the fact that achieving balanced representation in datasets is crucial for optimal CNN performance in healthcare, challenging the conventional focus on dataset size. Balanced datasets improve classification accuracy, both in two-class and three-class scenarios, highlighting the need for data-balancing techniques to improve model reliability and effectiveness. MOTIVATION Our study is motivated by a scenario with 100 patient samples, offering two options: a balanced dataset with 200 samples and an unbalanced dataset with 500 samples (400 healthy individuals). We aim to provide insights into the optimal choice based on the interplay between dataset size and imbalance, enriching the discourse for stakeholders interested in achieving optimal model performance. LIMITATIONS Recognizing a single model's generalizability limitations, we assert that further studies on diverse datasets are needed.
Collapse
Affiliation(s)
- Moshe Davidian
- Guilford Glazer Faculty of Business and Management, Ben-Gurion University of the Negev, Beer-Sheva 8410501, Israel;
| | - Adi Lahav
- Software Engineering Department, SCE—Shamoon College of Engineering, Beer-Sheva 84100, Israel;
| | - Ben-Zion Joshua
- Department of Otorhinolaryngology, Barzilai University Medical Center, Ashkelon 7830604, Israel;
| | - Ori Wand
- Division of Pulmonary Medicine, Barzilai University Medical Center, Ashkelon 7830604, Israel;
- Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer-Sheva 8410501, Israel
| | - Yotam Lurie
- Guilford Glazer Faculty of Business and Management, Ben-Gurion University of the Negev, Beer-Sheva 8410501, Israel;
| | - Shlomo Mark
- Software Engineering Department, SCE—Shamoon College of Engineering, Ashdod 77245, Israel;
| |
Collapse
|
2
|
Pan CT, Kumar R, Wen ZH, Wang CH, Chang CY, Shiue YL. Improving Respiratory Infection Diagnosis with Deep Learning and Combinatorial Fusion: A Two-Stage Approach Using Chest X-ray Imaging. Diagnostics (Basel) 2024; 14:500. [PMID: 38472972 DOI: 10.3390/diagnostics14050500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2023] [Revised: 02/16/2024] [Accepted: 02/18/2024] [Indexed: 03/14/2024] Open
Abstract
The challenges of respiratory infections persist as a global health crisis, placing substantial stress on healthcare infrastructures and necessitating ongoing investigation into efficacious treatment modalities. The persistent challenge of respiratory infections, including COVID-19, underscores the critical need for enhanced diagnostic methodologies to support early treatment interventions. This study introduces an innovative two-stage data analytics framework that leverages deep learning algorithms through a strategic combinatorial fusion technique, aimed at refining the accuracy of early-stage diagnosis of such infections. Utilizing a comprehensive dataset compiled from publicly available lung X-ray images, the research employs advanced pre-trained deep learning models to navigate the complexities of disease classification, addressing inherent data imbalances through methodical validation processes. The core contribution of this work lies in its novel application of combinatorial fusion, integrating select models to significantly elevate diagnostic precision. This approach not only showcases the adaptability and strength of deep learning in navigating the intricacies of medical imaging but also marks a significant step forward in the utilization of artificial intelligence to improve outcomes in healthcare diagnostics. The study's findings illuminate the path toward leveraging technological advancements in enhancing diagnostic accuracies, ultimately contributing to the timely and effective treatment of respiratory diseases.
Collapse
Affiliation(s)
- Cheng-Tang Pan
- Department of Mechanical and Electro-Mechanical Engineering, National Sun Yat-sen University, Kaohsiung 804, Taiwan
- Institute of Precision Medicine, National Sun Yat-sen University, Kaohsiung 804, Taiwan
- Taiwan Instrument Research Institute, National Applied Research Laboratories, Hsinchu 300, Taiwan
- Institute of Advanced Semiconductor Packaging and Testing, College of Semiconductor and Advanced Technology Research, National Sun Yat-sen University, Kaohsiung 804, Taiwan
| | - Rahul Kumar
- Department of Mechanical and Electro-Mechanical Engineering, National Sun Yat-sen University, Kaohsiung 804, Taiwan
| | - Zhi-Hong Wen
- Department of Marine Biotechnology and Research, National Sun Yat-sen University, Kaohsiung 804, Taiwan
| | - Chih-Hsuan Wang
- Division of Nephrology and Metabolism, Department of Internal Medicine, Kaohsiung Armed Forces General Hospital, Kaohsiung 804, Taiwan
- Institute of Medical Science and Technology, National Sun Yat-sen University, Kaohsiung 80424, Taiwan
| | - Chun-Yung Chang
- Division of Nephrology and Metabolism, Department of Internal Medicine, Kaohsiung Armed Forces General Hospital, Kaohsiung 804, Taiwan
- Institute of Medical Science and Technology, National Sun Yat-sen University, Kaohsiung 80424, Taiwan
| | - Yow-Ling Shiue
- Institute of Precision Medicine, National Sun Yat-sen University, Kaohsiung 804, Taiwan
- Institute of Biomedical Sciences, National Sun Yat-sen University, Kaohsiung 80424, Taiwan
| |
Collapse
|
3
|
Nur-A-Alam M, Nasir MK, Ahsan M, Based MA, Haider J, Kowalski M. Ensemble classification of integrated CT scan datasets in detecting COVID-19 using feature fusion from contourlet transform and CNN. Sci Rep 2023; 13:20063. [PMID: 37973820 PMCID: PMC10654719 DOI: 10.1038/s41598-023-47183-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 11/09/2023] [Indexed: 11/19/2023] Open
Abstract
The COVID-19 disease caused by coronavirus is constantly changing due to the emergence of different variants and thousands of people are dying every day worldwide. Early detection of this new form of pulmonary disease can reduce the mortality rate. In this paper, an automated method based on machine learning (ML) and deep learning (DL) has been developed to detect COVID-19 using computed tomography (CT) scan images extracted from three publicly available datasets (A total of 11,407 images; 7397 COVID-19 images and 4010 normal images). An unsupervised clustering approach that is a modified region-based clustering technique for segmenting COVID-19 CT scan image has been proposed. Furthermore, contourlet transform and convolution neural network (CNN) have been employed to extract features individually from the segmented CT scan images and to fuse them in one feature vector. Binary differential evolution (BDE) approach has been employed as a feature optimization technique to obtain comprehensible features from the fused feature vector. Finally, a ML/DL-based ensemble classifier considering bagging technique has been employed to detect COVID-19 from the CT images. A fivefold and generalization cross-validation techniques have been used for the validation purpose. Classification experiments have also been conducted with several pre-trained models (AlexNet, ResNet50, GoogleNet, VGG16, VGG19) and found that the ensemble classifier technique with fused feature has provided state-of-the-art performance with an accuracy of 99.98%.
Collapse
Affiliation(s)
- Md Nur-A-Alam
- Department of Computer Science & Engineering, Mawlana Bhashani Science and Technology University, Tangail, 1902, Bangladesh
| | - Mostofa Kamal Nasir
- Department of Computer Science & Engineering, Mawlana Bhashani Science and Technology University, Tangail, 1902, Bangladesh
| | - Mominul Ahsan
- Department of Computer Science, University of York, Deramore Lane, York, YO10 5GH, UK
| | - Md Abdul Based
- Department of Computer Science & Engineering, Dhaka International University, Dhaka, 1205, Bangladesh
| | - Julfikar Haider
- Department of Engineering, Manchester Metropolitan University, Chester St, Manchester, M1 5GD, UK
| | - Marcin Kowalski
- Institute of Optoelectronics, Military University of Technology, Gen. S. Kaliskiego 2, Warsaw, Poland.
| |
Collapse
|
4
|
Ahmad IS, Li N, Wang T, Liu X, Dai J, Chan Y, Liu H, Zhu J, Kong W, Lu Z, Xie Y, Liang X. COVID-19 Detection via Ultra-Low-Dose X-ray Images Enabled by Deep Learning. Bioengineering (Basel) 2023; 10:1314. [PMID: 38002438 PMCID: PMC10669345 DOI: 10.3390/bioengineering10111314] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Revised: 10/28/2023] [Accepted: 11/02/2023] [Indexed: 11/26/2023] Open
Abstract
The detection of Coronavirus disease 2019 (COVID-19) is crucial for controlling the spread of the virus. Current research utilizes X-ray imaging and artificial intelligence for COVID-19 diagnosis. However, conventional X-ray scans expose patients to excessive radiation, rendering repeated examinations impractical. Ultra-low-dose X-ray imaging technology enables rapid and accurate COVID-19 detection with minimal additional radiation exposure. In this retrospective cohort study, ULTRA-X-COVID, a deep neural network specifically designed for automatic detection of COVID-19 infections using ultra-low-dose X-ray images, is presented. The study included a multinational and multicenter dataset consisting of 30,882 X-ray images obtained from approximately 16,600 patients across 51 countries. It is important to note that there was no overlap between the training and test sets. The data analysis was conducted from 1 April 2020 to 1 January 2022. To evaluate the effectiveness of the model, various metrics such as the area under the receiver operating characteristic curve, receiver operating characteristic, accuracy, specificity, and F1 score were utilized. In the test set, the model demonstrated an AUC of 0.968 (95% CI, 0.956-0.983), accuracy of 94.3%, specificity of 88.9%, and F1 score of 99.0%. Notably, the ULTRA-X-COVID model demonstrated a performance comparable to conventional X-ray doses, with a prediction time of only 0.1 s per image. These findings suggest that the ULTRA-X-COVID model can effectively identify COVID-19 cases using ultra-low-dose X-ray scans, providing a novel alternative for COVID-19 detection. Moreover, the model exhibits potential adaptability for diagnoses of various other diseases.
Collapse
Affiliation(s)
- Isah Salim Ahmad
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; (I.S.A.); (T.W.); (X.L.); (J.D.); (Y.C.); (Y.X.)
| | - Na Li
- Department of Biomedical Engineering, Guangdong Medical University, Dongguan 523808, China; (N.L.); (H.L.); (J.Z.); (W.K.); (Z.L.)
| | - Tangsheng Wang
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; (I.S.A.); (T.W.); (X.L.); (J.D.); (Y.C.); (Y.X.)
| | - Xuan Liu
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; (I.S.A.); (T.W.); (X.L.); (J.D.); (Y.C.); (Y.X.)
| | - Jingjing Dai
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; (I.S.A.); (T.W.); (X.L.); (J.D.); (Y.C.); (Y.X.)
| | - Yinping Chan
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; (I.S.A.); (T.W.); (X.L.); (J.D.); (Y.C.); (Y.X.)
| | - Haoyang Liu
- Department of Biomedical Engineering, Guangdong Medical University, Dongguan 523808, China; (N.L.); (H.L.); (J.Z.); (W.K.); (Z.L.)
| | - Junming Zhu
- Department of Biomedical Engineering, Guangdong Medical University, Dongguan 523808, China; (N.L.); (H.L.); (J.Z.); (W.K.); (Z.L.)
| | - Weibin Kong
- Department of Biomedical Engineering, Guangdong Medical University, Dongguan 523808, China; (N.L.); (H.L.); (J.Z.); (W.K.); (Z.L.)
| | - Zefeng Lu
- Department of Biomedical Engineering, Guangdong Medical University, Dongguan 523808, China; (N.L.); (H.L.); (J.Z.); (W.K.); (Z.L.)
| | - Yaoqin Xie
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; (I.S.A.); (T.W.); (X.L.); (J.D.); (Y.C.); (Y.X.)
| | - Xiaokun Liang
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; (I.S.A.); (T.W.); (X.L.); (J.D.); (Y.C.); (Y.X.)
| |
Collapse
|
5
|
Ahmed ST, Basha SM, Venkatesan M, Mathivanan SK, Mallik S, Alsubaie N, Alqahtani MS. TVFx - CoVID-19 X-Ray images classification approach using neural networks based feature thresholding technique. BMC Med Imaging 2023; 23:146. [PMID: 37784025 PMCID: PMC10544389 DOI: 10.1186/s12880-023-01100-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Accepted: 09/11/2023] [Indexed: 10/04/2023] Open
Abstract
COVID-19, the global pandemic of twenty-first century, has caused major challenges and setbacks for researchers and medical infrastructure worldwide. The CoVID-19 influences on the patients respiratory system cause flooding of airways in the lungs. Multiple techniques have been proposed since the outbreak each of which is interdepended on features and larger training datasets. It is challenging scenario to consolidate larger datasets for accurate and reliable decision support. This research article proposes a chest X-Ray images classification approach based on feature thresholding in categorizing the CoVID-19 samples. The proposed approach uses the threshold value-based Feature Extraction (TVFx) technique and has been validated on 661-CoVID-19 X-Ray datasets in providing decision support for medical experts. The model has three layers of training datasets to attain a sequential pattern based on various learning features. The aligned feature-set of the proposed technique has successfully categorized CoVID-19 active samples into mild, serious, and extreme categories as per medical standards. The proposed technique has achieved an accuracy of 97.42% in categorizing and classifying given samples sets.
Collapse
Affiliation(s)
- Syed Thouheed Ahmed
- Department of Electrical Engineering, Indian Institute of Technology, Hyderabad., Hyderabad, India
- School of Computer Science and Engineering, REVA University, Bengaluru, India
| | - Syed Muzamil Basha
- School of Computer Science and Engineering, REVA University, Bengaluru, India
| | - Muthukumaran Venkatesan
- Department of Mathematics, College of Engineering and Technology, SRM Institute of Science and Technology, Kattankulathur, Tamilnadu, 603203, India
| | - Sandeep Kumar Mathivanan
- School of Computing Science & Engineering, Galgotias University, Greater Noida, Uttar Pradesh, 203201, India.
| | - Saurav Mallik
- Department of Environmental Health, Harvard T H Chan School of Public Health, Boston, MA, 02115, USA.
- Department of Pharmacology & Toxicology, The University of Arizona, Tucson, AZ, 85721, USA.
| | - Najah Alsubaie
- Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, P.O. Box 84428, Riyadh, 11671, Saudi Arabia.
| | - Mohammed S Alqahtani
- Radiological Sciences Department, College of Applied Medical Sciences, King Khalid University, Abha, 61421, Saudi Arabia
- BioImaging Unit, Space Research Centre, University of Leicester, Michael Atiyah Building, Leicester, LE1 7RH, UK
| |
Collapse
|
6
|
Hasan MM, Hossain MM, Rahman MM, Azad A, Alyami SA, Moni MA. FP-CNN: Fuzzy pooling-based convolutional neural network for lung ultrasound image classification with explainable AI. Comput Biol Med 2023; 165:107407. [PMID: 37678140 DOI: 10.1016/j.compbiomed.2023.107407] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 08/08/2023] [Accepted: 08/26/2023] [Indexed: 09/09/2023]
Abstract
The COVID-19 pandemic wreaks havoc on healthcare systems all across the world. In pandemic scenarios like COVID-19, the applicability of diagnostic modalities is crucial in medical diagnosis, where non-invasive ultrasound imaging has the potential to be a useful biomarker. This research develops a computer-assisted intelligent methodology for ultrasound lung image classification by utilizing a fuzzy pooling-based convolutional neural network FP-CNN with underlying evidence of particular decisions. The fuzzy-pooling method finds better representative features for ultrasound image classification. The FPCNN model categorizes ultrasound images into one of three classes: covid, disease-free (normal), and pneumonia. Explanations of diagnostic decisions are crucial to ensure the fairness of an intelligent system. This research has used Shapley Additive Explanation (SHAP) to explain the prediction of the FP-CNN models. The prediction of the black-box model is illustrated using the SHAP explanation of the intermediate layers of the black-box model. To determine the most effective model, we have tested different state-of-the-art convolutional neural network architectures with various training strategies, including fine-tuned models, single-layer fuzzy pooling models, and fuzzy pooling at all pooling layers. Among different architectures, the Xception model with all pooling layers having fuzzy pooling achieves the best classification results of 97.2% accuracy. We hope our proposed method will be helpful for the clinical diagnosis of covid-19 from lung ultrasound (LUS) images.
Collapse
Affiliation(s)
- Md Mahmodul Hasan
- Department of Computer Science and Engineering, Mawlana Bhashani Science and Technology University, Tangail, 1902, Dhaka, Bangladesh.
| | - Muhammad Minoar Hossain
- Department of Computer Science and Engineering, Mawlana Bhashani Science and Technology University, Tangail, 1902, Dhaka, Bangladesh; Department of Computer Science and Engineering, Bangladesh University, Mohammadpur, Dhaka, 1207, Bangladesh.
| | - Mohammad Motiur Rahman
- Department of Computer Science and Engineering, Mawlana Bhashani Science and Technology University, Tangail, 1902, Dhaka, Bangladesh.
| | - Akm Azad
- Department of Mathematics and Statistics, Faculty of Science, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh, 13318, Saudi Arabia.
| | - Salem A Alyami
- Department of Mathematics and Statistics, Faculty of Science, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh, 13318, Saudi Arabia.
| | - Mohammad Ali Moni
- Artificial Intelligence & Data Science, School of Health and Rehabilitation Sciences, The University of Queensland, Brisbane, QLD 4072, Australia; Artificial Intelligence and Cyber Futures Institute, Charles Stuart University, Bathurst, NSW 2795, Australia.
| |
Collapse
|
7
|
Bakasa W, Viriri S. VGG16 Feature Extractor with Extreme Gradient Boost Classifier for Pancreas Cancer Prediction. J Imaging 2023; 9:138. [PMID: 37504815 PMCID: PMC10381878 DOI: 10.3390/jimaging9070138] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 06/19/2023] [Accepted: 07/04/2023] [Indexed: 07/29/2023] Open
Abstract
The prognosis of patients with pancreatic ductal adenocarcinoma (PDAC) is greatly improved by an early and accurate diagnosis. Several studies have created automated methods to forecast PDAC development utilising various medical imaging modalities. These papers give a general overview of the classification, segmentation, or grading of many cancer types utilising conventional machine learning techniques and hand-engineered characteristics, including pancreatic cancer. This study uses cutting-edge deep learning techniques to identify PDAC utilising computerised tomography (CT) medical imaging modalities. This work suggests that the hybrid model VGG16-XGBoost (VGG16-backbone feature extractor and Extreme Gradient Boosting-classifier) for PDAC images. According to studies, the proposed hybrid model performs better, obtaining an accuracy of 0.97 and a weighted F1 score of 0.97 for the dataset under study. The experimental validation of the VGG16-XGBoost model uses the Cancer Imaging Archive (TCIA) public access dataset, which has pancreas CT images. The results of this study can be extremely helpful for PDAC diagnosis from computerised tomography (CT) pancreas images, categorising them into five different tumours (T), node (N), and metastases (M) (TNM) staging system class labels, which are T0, T1, T2, T3, and T4.
Collapse
Affiliation(s)
- Wilson Bakasa
- School of Mathematics, Statistics and Computer Science, University of KwaZulu-Natal, Durban 4041, South Africa
| | - Serestina Viriri
- School of Mathematics, Statistics and Computer Science, University of KwaZulu-Natal, Durban 4041, South Africa
| |
Collapse
|
8
|
Nahiduzzaman M, Faruq Goni MO, Robiul Islam M, Sayeed A, Shamim Anower M, Ahsan M, Haider J, Kowalski M. Detection of various lung diseases including COVID-19 using extreme learning machine algorithm based on the features extracted from a lightweight CNN architecture. Biocybern Biomed Eng 2023; 43:S0208-5216(23)00037-2. [PMID: 38620111 PMCID: PMC10292668 DOI: 10.1016/j.bbe.2023.06.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2022] [Revised: 04/04/2023] [Accepted: 06/16/2023] [Indexed: 11/09/2023]
Abstract
Around the world, several lung diseases such as pneumonia, cardiomegaly, and tuberculosis (TB) contribute to severe illness, hospitalization or even death, particularly for elderly and medically vulnerable patients. In the last few decades, several new types of lung-related diseases have taken the lives of millions of people, and COVID-19 has taken almost 6.27 million lives. To fight against lung diseases, timely and correct diagnosis with appropriate treatment is crucial in the current COVID-19 pandemic. In this study, an intelligent recognition system for seven lung diseases has been proposed based on machine learning (ML) techniques to aid the medical experts. Chest X-ray (CXR) images of lung diseases were collected from several publicly available databases. A lightweight convolutional neural network (CNN) has been used to extract characteristic features from the raw pixel values of the CXR images. The best feature subset has been identified using the Pearson Correlation Coefficient (PCC). Finally, the extreme learning machine (ELM) has been used to perform the classification task to assist faster learning and reduced computational complexity. The proposed CNN-PCC-ELM model achieved an accuracy of 96.22% with an Area Under Curve (AUC) of 99.48% for eight class classification. The outcomes from the proposed model demonstrated better performance than the existing state-of-the-art (SOTA) models in the case of COVID-19, pneumonia, and tuberculosis detection in both binary and multiclass classifications. For eight class classification, the proposed model achieved precision, recall and fi-score and ROC are 100%, 99%, 100% and 99.99% respectively for COVID-19 detection demonstrating its robustness. Therefore, the proposed model has overshadowed the existing pioneering models to accurately differentiate COVID-19 from the other lung diseases that can assist the medical physicians in treating the patient effectively.
Collapse
Affiliation(s)
- Md Nahiduzzaman
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Md Omaer Faruq Goni
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Md Robiul Islam
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Abu Sayeed
- Department of Computer Science & Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Md Shamim Anower
- Department of Electrical & Electronic Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Mominul Ahsan
- Department of Computer Science, University of York, Deramore Lane, Heslington, York YO10 5GH, UK
| | - Julfikar Haider
- Department of Engineering, Manchester Metropolitan University, Chester St, Manchester M1 5GD, UK
| | - Marcin Kowalski
- Institute of Optoelectronics, Military University of Technology, Gen. S. Kaliskiego 2, Warsaw, Poland
| |
Collapse
|
9
|
Sistaninejhad B, Rasi H, Nayeri P. A Review Paper about Deep Learning for Medical Image Analysis. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2023; 2023:7091301. [PMID: 37284172 PMCID: PMC10241570 DOI: 10.1155/2023/7091301] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Revised: 02/12/2023] [Accepted: 04/21/2023] [Indexed: 06/08/2023]
Abstract
Medical imaging refers to the process of obtaining images of internal organs for therapeutic purposes such as discovering or studying diseases. The primary objective of medical image analysis is to improve the efficacy of clinical research and treatment options. Deep learning has revamped medical image analysis, yielding excellent results in image processing tasks such as registration, segmentation, feature extraction, and classification. The prime motivations for this are the availability of computational resources and the resurgence of deep convolutional neural networks. Deep learning techniques are good at observing hidden patterns in images and supporting clinicians in achieving diagnostic perfection. It has proven to be the most effective method for organ segmentation, cancer detection, disease categorization, and computer-assisted diagnosis. Many deep learning approaches have been published to analyze medical images for various diagnostic purposes. In this paper, we review the work exploiting current state-of-the-art deep learning approaches in medical image processing. We begin the survey by providing a synopsis of research works in medical imaging based on convolutional neural networks. Second, we discuss popular pretrained models and general adversarial networks that aid in improving convolutional networks' performance. Finally, to ease direct evaluation, we compile the performance metrics of deep learning models focusing on COVID-19 detection and child bone age prediction.
Collapse
Affiliation(s)
| | - Habib Rasi
- Sahand University of Technology, East Azerbaijan, New City of Sahand, Iran
| | - Parisa Nayeri
- Khoy University of Medical Sciences, West Azerbaijan, Khoy, Iran
| |
Collapse
|
10
|
Sultana A, Nahiduzzaman M, Bakchy SC, Shahriar SM, Peyal HI, Chowdhury MEH, Khandakar A, Arselene Ayari M, Ahsan M, Haider J. A Real Time Method for Distinguishing COVID-19 Utilizing 2D-CNN and Transfer Learning. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23094458. [PMID: 37177662 PMCID: PMC10181786 DOI: 10.3390/s23094458] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Revised: 04/19/2023] [Accepted: 04/21/2023] [Indexed: 05/15/2023]
Abstract
Rapid identification of COVID-19 can assist in making decisions for effective treatment and epidemic prevention. The PCR-based test is expert-dependent, is time-consuming, and has limited sensitivity. By inspecting Chest R-ray (CXR) images, COVID-19, pneumonia, and other lung infections can be detected in real time. The current, state-of-the-art literature suggests that deep learning (DL) is highly advantageous in automatic disease classification utilizing the CXR images. The goal of this study is to develop models by employing DL models for identifying COVID-19 and other lung disorders more efficiently. For this study, a dataset of 18,564 CXR images with seven disease categories was created from multiple publicly available sources. Four DL architectures including the proposed CNN model and pretrained VGG-16, VGG-19, and Inception-v3 models were applied to identify healthy and six lung diseases (fibrosis, lung opacity, viral pneumonia, bacterial pneumonia, COVID-19, and tuberculosis). Accuracy, precision, recall, f1 score, area under the curve (AUC), and testing time were used to evaluate the performance of these four models. The results demonstrated that the proposed CNN model outperformed all other DL models employed for a seven-class classification with an accuracy of 93.15% and average values for precision, recall, f1-score, and AUC of 0.9343, 0.9443, 0.9386, and 0.9939. The CNN model equally performed well when other multiclass classifications including normal and COVID-19 as the common classes were considered, yielding accuracy values of 98%, 97.49%, 97.81%, 96%, and 96.75% for two, three, four, five, and six classes, respectively. The proposed model can also identify COVID-19 with shorter training and testing times compared to other transfer learning models.
Collapse
Affiliation(s)
- Abida Sultana
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Md Nahiduzzaman
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
- Department of Electrical Engineering, Qatar University, Doha 2713, Qatar
| | - Sagor Chandro Bakchy
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Saleh Mohammed Shahriar
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | - Hasibul Islam Peyal
- Department of Electrical & Computer Engineering, Rajshahi University of Engineering & Technology, Rajshahi 6204, Bangladesh
| | | | - Amith Khandakar
- Department of Electrical Engineering, Qatar University, Doha 2713, Qatar
| | | | - Mominul Ahsan
- Department of Computer Science, University of York, Deramore Lane, Heslington, York YO10 5GH, UK
| | - Julfikar Haider
- Department of Engineering, Manchester Metropolitan University, Chester Street, Manchester M1 5GD, UK
| |
Collapse
|
11
|
Mavragani A, Wongsirichot T, Damkliang K, Navasakulpong A. Classifying COVID-19 Patients From Chest X-ray Images Using Hybrid Machine Learning Techniques: Development and Evaluation. JMIR Form Res 2023; 7:e42324. [PMID: 36780315 PMCID: PMC9976774 DOI: 10.2196/42324] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 02/10/2023] [Accepted: 02/13/2023] [Indexed: 02/14/2023] Open
Abstract
BACKGROUND The COVID-19 pandemic has raised global concern, with moderate to severe cases displaying lung inflammation and respiratory failure. Chest x-ray (CXR) imaging is crucial for diagnosis and is usually interpreted by experienced medical specialists. Machine learning has been applied with acceptable accuracy, but computational efficiency has received less attention. OBJECTIVE We introduced a novel hybrid machine learning model to accurately classify COVID-19, non-COVID-19, and healthy patients from CXR images with reduced computational time and promising results. Our proposed model was thoroughly evaluated and compared with existing models. METHODS A retrospective study was conducted to analyze 5 public data sets containing 4200 CXR images using machine learning techniques including decision trees, support vector machines, and neural networks. The images were preprocessed to undergo image segmentation, enhancement, and feature extraction. The best performing machine learning technique was selected and combined into a multilayer hybrid classification model for COVID-19 (MLHC-COVID-19). The model consisted of 2 layers. The first layer was designed to differentiate healthy individuals from infected patients, while the second layer aimed to classify COVID-19 and non-COVID-19 patients. RESULTS The MLHC-COVID-19 model was trained and evaluated on unseen COVID-19 CXR images, achieving reasonably high accuracy and F measures of 0.962 and 0.962, respectively. These results show the effectiveness of the MLHC-COVID-19 in classifying COVID-19 CXR images, with improved accuracy and a reduction in interpretation time. The model was also embedded into a web-based MLHC-COVID-19 computer-aided diagnosis system, which was made publicly available. CONCLUSIONS The study found that the MLHC-COVID-19 model effectively differentiated CXR images of COVID-19 patients from those of healthy and non-COVID-19 individuals. It outperformed other state-of-the-art deep learning techniques and showed promising results. These results suggest that the MLHC-COVID-19 model could have been instrumental in early detection and diagnosis of COVID-19 patients, thus playing a significant role in controlling and managing the pandemic. Although the pandemic has slowed down, this model can be adapted and utilized for future similar situations. The model was also integrated into a publicly accessible web-based computer-aided diagnosis system.
Collapse
Affiliation(s)
| | - Thakerng Wongsirichot
- Division of Computational Science, Faculty of Science, Prince of Songkla University, Songkhla, Thailand
| | - Kasikrit Damkliang
- Division of Computational Science, Faculty of Science, Prince of Songkla University, Songkhla, Thailand
| | - Asma Navasakulpong
- Division of Respiratory and Respiratory Critical Care Medicine, Faculty of Medicine, Prince of Songkla University, Songkhla, Thailand
| |
Collapse
|
12
|
A survey of machine learning-based methods for COVID-19 medical image analysis. Med Biol Eng Comput 2023; 61:1257-1297. [PMID: 36707488 PMCID: PMC9883138 DOI: 10.1007/s11517-022-02758-y] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Accepted: 12/22/2022] [Indexed: 01/29/2023]
Abstract
The ongoing COVID-19 pandemic caused by the SARS-CoV-2 virus has already resulted in 6.6 million deaths with more than 637 million people infected after only 30 months since the first occurrences of the disease in December 2019. Hence, rapid and accurate detection and diagnosis of the disease is the first priority all over the world. Researchers have been working on various methods for COVID-19 detection and as the disease infects lungs, lung image analysis has become a popular research area for detecting the presence of the disease. Medical images from chest X-rays (CXR), computed tomography (CT) images, and lung ultrasound images have been used by automated image analysis systems in artificial intelligence (AI)- and machine learning (ML)-based approaches. Various existing and novel ML, deep learning (DL), transfer learning (TL), and hybrid models have been applied for detecting and classifying COVID-19, segmentation of infected regions, assessing the severity, and tracking patient progress from medical images of COVID-19 patients. In this paper, a comprehensive review of some recent approaches on COVID-19-based image analyses is provided surveying the contributions of existing research efforts, the available image datasets, and the performance metrics used in recent works. The challenges and future research scopes to address the progress of the fight against COVID-19 from the AI perspective are also discussed. The main objective of this paper is therefore to provide a summary of the research works done in COVID detection and analysis from medical image datasets using ML, DL, and TL models by analyzing their novelty and efficiency while mentioning other COVID-19-based review/survey researches to deliver a brief overview on the maximum amount of information on COVID-19-based existing researches.
Collapse
|
13
|
Tallapragada VS, Manga NA, Kumar GP. A novel COVID diagnosis and feature extraction based on discrete wavelet model and classification using X-ray and CT images. MULTIMEDIA TOOLS AND APPLICATIONS 2023; 82:1-42. [PMID: 36712955 PMCID: PMC9859748 DOI: 10.1007/s11042-023-14367-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Revised: 08/22/2022] [Accepted: 01/02/2023] [Indexed: 06/18/2023]
Abstract
Recently, the Covid-19 pandemic has affected several lives of people globally, and there is a need for a massive number of screening tests to diagnose the existence of coronavirus. For the medical specialist, detecting COVID-19 cases is a difficult task. There is a need for fast, cheap and accurate diagnostic tools. The chest X-ray and the computerized tomography (CT) play a significant role in the COVID-19 diagnosis. The advancement of deep learning (DL) approaches helps to introduce a COVID diagnosis system to achieve maximum detection rate with minimum time complexity. This research proposed a discrete wavelet optimized network model for COVID-19 diagnosis and feature extraction to overcome these problems. It consists of three stages pre-processing, feature extraction and classification. The raw images are filtered in the pre-processing phase to eliminate unnecessary noises and improve the image quality using the MMG hybrid filtering technique. The next phase is feature extraction, in this stage, the features are extracted, and the dimensionality of the features is diminished with the aid of a modified discrete wavelet based Mobile Net model. The third stage is the classification here, the convolutional Aquila COVID detection network model is developed to classify normal and COVID-19 positive cases from the collected images of the COVID-CT and chest X-ray dataset. Finally, the performance of the proposed model is compared with some of the existing models in terms of accuracy, specificity, sensitivity, precision, f-score, negative predictive value (NPV) and positive predictive value (PPV), respectively. The proposed model achieves the performance of 99%, 100%, 98.5%, and 99.5% for the CT dataset, and the accomplished accuracy, specificity, sensitivity, and precision values of the proposed model for the X-ray dataset are 98%, 99%, 98% and 97% respectively. In addition, the statistical and cross validation analysis is conducted to validate the effectiveness of the proposed model.
Collapse
Affiliation(s)
| | | | - G.V. Pradeep Kumar
- Department of ECE, Chaitanya Bharathi Institute of Technology, Hyderabad, India
| |
Collapse
|
14
|
Hybrid intelligent model for classifying chest X-ray images of COVID-19 patients using genetic algorithm and neutrosophic logic. Soft comput 2023; 27:3427-3442. [PMID: 34421342 PMCID: PMC8371596 DOI: 10.1007/s00500-021-06103-7] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/30/2021] [Indexed: 12/23/2022]
Abstract
The highly spreading virus, COVID-19, created a huge need for an accurate and speedy diagnosis method. The famous RT-PCR test is costly and not available for many suspected cases. This article proposes a neurotrophic model to diagnose COVID-19 patients based on their chest X-ray images. The proposed model has five main phases. First, the speeded up robust features (SURF) method is applied to each X-ray image to extract robust invariant features. Second, three sampling algorithms are applied to treat imbalanced dataset. Third, the neutrosophic rule-based classification system is proposed to generate a set of rules based on the three neutrosophic values < T; I; F>, the degrees of truth, indeterminacy falsity. Fourth, a genetic algorithm is applied to select the optimal neutrosophic rules to improve the classification performance. Fifth, in this phase, the classification-based neutrosophic logic is proposed. The testing rule matrix is constructed with no class label, and the goal of this phase is to determine the class label for each testing rule using intersection percentage between testing and training rules. The proposed model is referred to as GNRCS. It is compared with six state-of-the-art classifiers such as multilayer perceptron (MLP), support vector machines (SVM), linear discriminant analysis (LDA), decision tree (DT), naive Bayes (NB), and random forest classifiers (RFC) with quality measures of accuracy, precision, sensitivity, specificity, and F1-score. The results show that the proposed model is powerful for COVID-19 recognition with high specificity and high sensitivity and less computational complexity. Therefore, the proposed GNRCS model could be used for real-time automatic early recognition of COVID-19.
Collapse
|
15
|
Preliminary Stages for COVID-19 Detection Using Image Processing. Diagnostics (Basel) 2022; 12:diagnostics12123171. [PMID: 36553177 PMCID: PMC9777505 DOI: 10.3390/diagnostics12123171] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2022] [Revised: 11/30/2022] [Accepted: 12/08/2022] [Indexed: 12/23/2022] Open
Abstract
COVID-19 was first discovered in December 2019 in Wuhan. There have been reports of thousands of illnesses and hundreds of deaths in almost every region of the world. Medical images, when combined with cutting-edge technology such as artificial intelligence, have the potential to improve the efficiency of the public health system and deliver faster and more reliable findings in the detection of COVID-19. The process of developing the COVID-19 diagnostic system begins with image accusation and proceeds via preprocessing, feature extraction, and classification. According to literature review, several attempts to develop taxonomies for COVID-19 detection using image processing methods have been introduced. However, most of these adhere to a standard category that exclusively considers classification methods. Therefore, in this study a new taxonomy for the early stages of COVID-19 detection is proposed. It attempts to offer a full grasp of image processing in COVID-19 while considering all phases required prior to classification. The survey concludes with a discussion of outstanding concerns and future directions.
Collapse
|
16
|
Chatterjee S, Maity S, Bhattacharjee M, Banerjee S, Das AK, Ding W. Variational Autoencoder Based Imbalanced COVID-19 Detection Using Chest X-Ray Images. NEW GENERATION COMPUTING 2022; 41:25-60. [PMID: 36439303 PMCID: PMC9676807 DOI: 10.1007/s00354-022-00194-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Accepted: 10/16/2022] [Indexed: 06/12/2023]
Abstract
Early and fast detection of disease is essential for the fight against COVID-19 pandemic. Researchers have focused on developing robust and cost-effective detection methods using Deep learning based chest X-Ray image processing. However, such prediction models are often not well suited to address the challenge of highly imabalanced datasets. The current work is an attempt to address the issue by utilizing unsupervised Variational Auto Encoders (VAEs). Firstly, chest X-Ray images are converted to a latent space by learning the most important features using VAEs. Secondly, a wide range of well established data resampling techniques are used to balance the preexisting imbalanced classes in the latent vector form of the dataset. Finally, the modified dataset in the new feature space is used to train well known classification models to classify chest X-Ray images into three different classes viz., "COVID-19", "Pneumonia", and "Normal". In order to capture the quality of resampling methods, 10-folds cross validation technique is applied on the dataset. Extensive experimental analysis have been carried out and results so obtained indicate significant improvement in COVID-19 detection using the proposed VAE based method. Furthermore, the ingenuity of the results have been established by performing Wilcoxon rank test with 95% level of significance.
Collapse
Affiliation(s)
- Sankhadeep Chatterjee
- Department of Computer Science and Technology, Indian Institute of Engineering Science and Technology, Shibpur, West Bengal India
| | - Soumyajit Maity
- Department of Computer Science and Engineering, University of Engineering & Management, Kolkata, West Bengal India
| | - Mayukh Bhattacharjee
- Department of Computer Science and Engineering, University of Engineering & Management, Kolkata, West Bengal India
| | - Soumen Banerjee
- Department of Electronics and Communication Engineering, Budge Budge Institute of Technology, Budge Budge, Kolkata, West Bengal 700137 India
| | - Asit Kumar Das
- Department of Computer Science and Technology, Indian Institute of Engineering Science and Technology, Shibpur, West Bengal India
| | - Weiping Ding
- School of Information Science and Technology, Nantong University, 66479, Nantong, 226019 Jiangsu China
| |
Collapse
|
17
|
Kuanr M, Mohapatra P, Mittal S, Maindarkar M, Fouda MM, Saba L, Saxena S, Suri JS. Recommender System for the Efficient Treatment of COVID-19 Using a Convolutional Neural Network Model and Image Similarity. Diagnostics (Basel) 2022; 12:2700. [PMID: 36359545 PMCID: PMC9689970 DOI: 10.3390/diagnostics12112700] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2022] [Revised: 10/30/2022] [Accepted: 11/03/2022] [Indexed: 09/09/2023] Open
Abstract
Background: Hospitals face a significant problem meeting patients' medical needs during epidemics, especially when the number of patients increases rapidly, as seen during the recent COVID-19 pandemic. This study designs a treatment recommender system (RS) for the efficient management of human capital and resources such as doctors, medicines, and resources in hospitals. We hypothesize that a deep learning framework, when combined with search paradigms in an image framework, can make the RS very efficient. Methodology: This study uses a Convolutional neural network (CNN) model for the feature extraction of the images and discovers the most similar patients. The input queries patients from the hospital database with similar chest X-ray images. It uses a similarity metric for the similarity computation of the images. Results: This methodology recommends the doctors, medicines, and resources associated with similar patients to a COVID-19 patients being admitted to the hospital. The performance of the proposed RS is verified with five different feature extraction CNN models and four similarity measures. The proposed RS with a ResNet-50 CNN feature extraction model and Maxwell-Boltzmann similarity is found to be a proper framework for treatment recommendation with a mean average precision of more than 0.90 for threshold similarities in the range of 0.7 to 0.9 and an average highest cosine similarity of more than 0.95. Conclusions: Overall, an RS with a CNN model and image similarity is proven as an efficient tool for the proper management of resources during the peak period of pandemics and can be adopted in clinical settings.
Collapse
Affiliation(s)
- Madhusree Kuanr
- Department of Computer Science and Engineering, IIIT, Bhubaneswar 751003, India
| | | | - Sanchi Mittal
- Department of Computer Science and Engineering, IIIT, Bhubaneswar 751003, India
| | - Mahesh Maindarkar
- Stroke Monitoring and Diagnostic Division, AtheroPointTM, Roseville, CA 95661, USA
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA
| | - Luca Saba
- Department of Radiology, University of Cagliari, 09123 Cagliari, Italy
| | - Sanjay Saxena
- Department of Computer Science and Engineering, IIIT, Bhubaneswar 751003, India
| | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPointTM, Roseville, CA 95661, USA
- Knowledge Engineering Center, Global Biomedical Technologies, Inc., Roseville, CA 95661, USA
| |
Collapse
|
18
|
Choi SR, Lee M. Estimating the Prognosis of Low-Grade Glioma with Gene Attention Using Multi-Omics and Multi-Modal Schemes. BIOLOGY 2022; 11:biology11101462. [PMID: 36290366 PMCID: PMC9598836 DOI: 10.3390/biology11101462] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 10/01/2022] [Accepted: 10/02/2022] [Indexed: 11/20/2022]
Abstract
The prognosis estimation of low-grade glioma (LGG) patients with deep learning models using gene expression data has been extensively studied in recent years. However, the deep learning models used in these studies do not utilize the latest deep learning techniques, such as residual learning and ensemble learning. To address this limitation, in this study, a deep learning model using multi-omics and multi-modal schemes, namely the Multi-Prognosis Estimation Network (Multi-PEN), is proposed. When using Multi-PEN, gene attention layers are employed for each datatype, including mRNA and miRNA, thereby allowing us to identify prognostic genes. Additionally, recent developments in deep learning, such as residual learning and layer normalization, are utilized. As a result, Multi-PEN demonstrates competitive performance compared to conventional models for prognosis estimation. Furthermore, the most significant prognostic mRNA and miRNA were identified using the attention layers in Multi-PEN. For instance, MYBL1 was identified as the most significant prognostic mRNA. Such a result accords with the findings in existing studies that have demonstrated that MYBL1 regulates cell survival, proliferation, and differentiation. Additionally, hsa-mir-421 was identified as the most significant prognostic miRNA, and it has been extensively reported that hsa-mir-421 is highly associated with various cancers. These results indicate that the estimations of Multi-PEN are valid and reliable and showcase Multi-PEN's capacity to present hypotheses regarding prognostic mRNAs and miRNAs.
Collapse
|
19
|
Meedeniya D, Kumarasinghe H, Kolonne S, Fernando C, Díez IDLT, Marques G. Chest X-ray analysis empowered with deep learning: A systematic review. Appl Soft Comput 2022; 126:109319. [PMID: 36034154 PMCID: PMC9393235 DOI: 10.1016/j.asoc.2022.109319] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2021] [Revised: 03/16/2022] [Accepted: 07/12/2022] [Indexed: 11/12/2022]
Abstract
Chest radiographs are widely used in the medical domain and at present, chest X-radiation particularly plays an important role in the diagnosis of medical conditions such as pneumonia and COVID-19 disease. The recent developments of deep learning techniques led to a promising performance in medical image classification and prediction tasks. With the availability of chest X-ray datasets and emerging trends in data engineering techniques, there is a growth in recent related publications. Recently, there have been only a few survey papers that addressed chest X-ray classification using deep learning techniques. However, they lack the analysis of the trends of recent studies. This systematic review paper explores and provides a comprehensive analysis of the related studies that have used deep learning techniques to analyze chest X-ray images. We present the state-of-the-art deep learning based pneumonia and COVID-19 detection solutions, trends in recent studies, publicly available datasets, guidance to follow a deep learning process, challenges and potential future research directions in this domain. The discoveries and the conclusions of the reviewed work have been organized in a way that researchers and developers working in the same domain can use this work to support them in taking decisions on their research.
Collapse
|
20
|
Fakieh B, Ragab M. Automated COVID-19 Classification Using Heap-Based Optimization with the Deep Transfer Learning Model. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:7508836. [PMID: 36045956 PMCID: PMC9423999 DOI: 10.1155/2022/7508836] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/07/2022] [Revised: 05/31/2022] [Accepted: 06/23/2022] [Indexed: 11/17/2022]
Abstract
The outbreak of the COVID-19 pandemic necessitates prompt identification of affected persons to restrict the spread of the COVID-19 epidemic. Radiological imaging such as computed tomography (CT) and chest X-rays (CXR) is considered an effective way to diagnose COVID-19. However, it needs an expert's knowledge and consumes more time. At the same time, artificial intelligence (AI) and medical images are discovered to be helpful in effectively assessing and providing treatment for COVID-19 infected patients. In particular, deep learning (DL) models act as a vital part of a high-performance classification model for COVID-19 recognition on CXR images. This study develops a heap-based optimization with the deep transfer learning model for detection and classification (HBODTL-DC) of COVID-19. The proposed HBODTL-DC system majorly focuses on the identification of COVID-19 on CXR images. To do so, the presented HBODTL-DC model initially exploits the Gabor filtering (GF) technique to enhance the image quality. In addition, the HBO algorithm with a neural architecture search network (NasNet) large model is employed for the extraction of feature vectors. Finally, Elman Neural Network (ENN) model gets the feature vectors as input and categorizes the CXR images into distinct classes. The experimental validation of the HBODTL-DC model takes place on the benchmark CXR image dataset from the Kaggle repository, and the outcomes are checked in numerous dimensions. The experimental outcomes stated the supremacy of the HBODTL-DC model over recent approaches with a maximum accuracy of 0.9992.
Collapse
Affiliation(s)
- Bahjat Fakieh
- Information Systems Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Mahmoud Ragab
- Information Technology Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
- Department of Mathematics, Faculty of Science, Al-Azhar University, Naser City 11884, Cairo, Egypt
- Centre for Artificial Intelligence in Precision Medicines, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| |
Collapse
|
21
|
Mahaboob Basha S, Lira Neto AV, Alshathri S, Elaziz MA, Hashmitha Mohisin S, De Albuquerque VHC. Multithreshold Segmentation and Machine Learning Based Approach to Differentiate COVID-19 from Viral Pneumonia. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:2728866. [PMID: 36039344 PMCID: PMC9420061 DOI: 10.1155/2022/2728866] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 06/13/2022] [Accepted: 07/05/2022] [Indexed: 11/17/2022]
Abstract
Coronavirus disease (COVID-19) has created an unprecedented devastation and the loss of millions of lives globally. Contagious nature and fatalities invariably pose challenges to physicians and healthcare support systems. Clinical diagnostic evaluation using reverse transcription-polymerase chain reaction and other approaches are currently in use. The Chest X-ray (CXR) and CT images were effectively utilized in screening purposes that could provide relevant data on localized regions affected by the infection. A step towards automated screening and diagnosis using CXR and CT could be of considerable importance in these turbulent times. The main objective is to probe a simple threshold-based segmentation approach to identify possible infection regions in CXR images and investigate intensity-based, wavelet transform (WT)-based, and Laws based texture features with statistical measures. Further feature selection strategy using Random Forest (RF) then selected features used to create Machine Learning (ML) representation with Support Vector Machine (SVM) and a Random Forest (RF) to make different COVID-19 from viral pneumonia (VP). The results obtained clearly indicate that the intensity and WT-based features vary in the two pathologies that are better differentiated with the combined features trained using SVM and RF classifiers. Classifier performance measures like an Area Under the Curve (AUC) of 0.97 and by and large classification accuracy of 0.9 using the RF model clearly indicate that the methodology implemented is useful in characterizing COVID-19 and Viral Pneumonia.
Collapse
Affiliation(s)
- Shaik Mahaboob Basha
- Department of Electronics and Communication Engineering, Geethanjali Institute of Science and Technology, Nellore, India
- Graduation Program in Telecommunication Engineering, Federal Institute of Ceará, Fortaleza, CE, Brazil
| | - Aloísio Vieira Lira Neto
- Graduation Program in Telecommunication Engineering, Federal Institute of Ceará, Fortaleza, CE, Brazil
| | - Samah Alshathri
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
| | - Mohamed Abd Elaziz
- Faculty of Computer Science and Engineering, Galala University, Suez 435611, Egypt
| | - Shaik Hashmitha Mohisin
- Department of Electrical and Electronics Engineering, National Institute of Technology Calicut, Kozhikode 673601, India
| | | |
Collapse
|
22
|
Laddha S, Mnasri S, Alghamdi M, Kumar V, Kaur M, Alrashidi M, Almuhaimeed A, Alshehri A, Alrowaily MA, Alkhazi I. COVID-19 Diagnosis and Classification Using Radiological Imaging and Deep Learning Techniques: A Comparative Study. Diagnostics (Basel) 2022; 12:1880. [PMID: 36010231 PMCID: PMC9406661 DOI: 10.3390/diagnostics12081880] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 07/23/2022] [Accepted: 07/25/2022] [Indexed: 11/16/2022] Open
Abstract
In December 2019, the novel coronavirus disease 2019 (COVID-19) appeared. Being highly contagious and with no effective treatment available, the only solution was to detect and isolate infected patients to further break the chain of infection. The shortage of test kits and other drawbacks of lab tests motivated researchers to build an automated diagnosis system using chest X-rays and CT scanning. The reviewed works in this study use AI coupled with the radiological image processing of raw chest X-rays and CT images to train various CNN models. They use transfer learning and numerous types of binary and multi-class classifications. The models are trained and validated on several datasets, the attributes of which are also discussed. The obtained results of various algorithms are later compared using performance metrics such as accuracy, F1 score, and AUC. Major challenges faced in this research domain are the limited availability of COVID image data and the high accuracy of the prediction of the severity of patients using deep learning compared to well-known methods of COVID-19 detection such as PCR tests. These automated detection systems using CXR technology are reliable enough to help radiologists in the initial screening and in the immediate diagnosis of infected individuals. They are preferred because of their low cost, availability, and fast results.
Collapse
Affiliation(s)
- Saloni Laddha
- Computer Science and Engineering Department, National Institute of Technology Hamirpur, Hamirpur 177005, Himachal Pradesh, India; (S.L.); (V.K.)
| | - Sami Mnasri
- Department of Computer Science, Applied College, University of Tabuk, Tabuk 47512, Saudi Arabia; (M.A.); (M.A.); (A.A.); (M.A.A.)
- Department of Computer Science, ISSAT of Gafsa, University of Gafsa, Gafsa 2112, Tunisia
| | - Mansoor Alghamdi
- Department of Computer Science, Applied College, University of Tabuk, Tabuk 47512, Saudi Arabia; (M.A.); (M.A.); (A.A.); (M.A.A.)
| | - Vijay Kumar
- Computer Science and Engineering Department, National Institute of Technology Hamirpur, Hamirpur 177005, Himachal Pradesh, India; (S.L.); (V.K.)
| | - Manjit Kaur
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju 61005, Korea;
| | - Malek Alrashidi
- Department of Computer Science, Applied College, University of Tabuk, Tabuk 47512, Saudi Arabia; (M.A.); (M.A.); (A.A.); (M.A.A.)
| | - Abdullah Almuhaimeed
- The National Centre for Genomics Technologies and Bioinformatics, King Abdulaziz City for Science and Technology, Riyadh 11442, Saudi Arabia
| | - Ali Alshehri
- Department of Computer Science, Applied College, University of Tabuk, Tabuk 47512, Saudi Arabia; (M.A.); (M.A.); (A.A.); (M.A.A.)
| | - Majed Abdullah Alrowaily
- Department of Computer Science, Applied College, University of Tabuk, Tabuk 47512, Saudi Arabia; (M.A.); (M.A.); (A.A.); (M.A.A.)
| | - Ibrahim Alkhazi
- College of Computers & Information Technology, University of Tabuk, Tabuk 47512, Saudi Arabia;
| |
Collapse
|
23
|
Fang L, Wang X. COVID-RDNet: A novel coronavirus pneumonia classification model using the mixed dataset by CT and X-rays images. Biocybern Biomed Eng 2022; 42:977-994. [PMID: 35945982 PMCID: PMC9353669 DOI: 10.1016/j.bbe.2022.07.009] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Revised: 07/10/2022] [Accepted: 07/31/2022] [Indexed: 12/23/2022]
Abstract
Corona virus disease 2019 (COVID-19) testing relies on traditional screening methods, which require a lot of manpower and material resources. Recently, to effectively reduce the damage caused by radiation and enhance effectiveness, deep learning of classifying COVID-19 negative and positive using the mixed dataset by CT and X-rays images have achieved remarkable research results. However, the details presented on CT and X-ray images have pathological diversity and similarity features, thus increasing the difficulty for physicians to judge specific cases. On this basis, this paper proposes a novel coronavirus pneumonia classification model using the mixed dataset by CT and X-rays images. To solve the problem of feature similarity between lung diseases and COVID-19, the extracted features are enhanced by an adaptive region enhancement algorithm. Besides, the depth network based on the residual blocks and the dense blocks is trained and tested. On the one hand, the residual blocks effectively improve the accuracy of the model and the non-linear COVID-19 features are obtained by cross-layer link. On the other hand, the dense blocks effectively improve the robustness of the model by connecting local and abstract information. On mixed X-ray and CT datasets, the sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), area under curve (AUC), and accuracy can all reach 0.99. On the basis of respecting patient privacy and ethics, the proposed algorithm using the mixed dataset from real cases can effectively assist doctors in performing the accurate COVID-19 negative and positive classification to determine the infection status of patients.
Collapse
Affiliation(s)
- Lingling Fang
- Department of Computing and Information Technology, Liaoning Normal University, Dalian City, Liaoning Province, China
| | - Xin Wang
- Department of Computing and Information Technology, Liaoning Normal University, Dalian City, Liaoning Province, China
| |
Collapse
|
24
|
COVID-19 Diagnosis on Chest Radiographs with Enhanced Deep Neural Networks. Diagnostics (Basel) 2022; 12:diagnostics12081828. [PMID: 36010179 PMCID: PMC9406472 DOI: 10.3390/diagnostics12081828] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Revised: 07/12/2022] [Accepted: 07/20/2022] [Indexed: 11/17/2022] Open
Abstract
The COVID-19 pandemic has caused a devastating impact on the social activity, economy and politics worldwide. Techniques to diagnose COVID-19 cases by examining anomalies in chest X-ray images are urgently needed. Inspired by the success of deep learning in various tasks, this paper evaluates the performance of four deep neural networks in detecting COVID-19 patients from their chest radiographs. The deep neural networks studied include VGG16, MobileNet, ResNet50 and DenseNet201. Preliminary experiments show that all deep neural networks perform promisingly, while DenseNet201 outshines other models. Nevertheless, the sensitivity rates of the models are below expectations, which can be attributed to several factors: limited publicly available COVID-19 images, imbalanced sample size for the COVID-19 class and non-COVID-19 class, overfitting or underfitting of the deep neural networks and that the feature extraction of pre-trained models does not adapt well to the COVID-19 detection task. To address these factors, several enhancements are proposed, including data augmentation, adjusted class weights, early stopping and fine-tuning, to improve the performance. Empirical results on DenseNet201 with these enhancements demonstrate outstanding performance with an accuracy of 0.999%, precision of 0.9899%, sensitivity of 0.98%, specificity of 0.9997% and F1-score of 0.9849% on the COVID-Xray-5k dataset.
Collapse
|
25
|
Latif G, Morsy H, Hassan A, Alghazo J. Novel Coronavirus and Common Pneumonia Detection from CT Scans Using Deep Learning-Based Extracted Features. Viruses 2022; 14:v14081667. [PMID: 36016288 PMCID: PMC9414828 DOI: 10.3390/v14081667] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2022] [Revised: 07/23/2022] [Accepted: 07/26/2022] [Indexed: 11/23/2022] Open
Abstract
COVID-19 which was announced as a pandemic on 11 March 2020, is still infecting millions to date as the vaccines that have been developed do not prevent the disease but rather reduce the severity of the symptoms. Until a vaccine is developed that can prevent COVID-19 infection, the testing of individuals will be a continuous process. Medical personnel monitor and treat all health conditions; hence, the time-consuming process to monitor and test all individuals for COVID-19 becomes an impossible task, especially as COVID-19 shares similar symptoms with the common cold and pneumonia. Some off-the-counter tests have been developed and sold, but they are unreliable and add an additional burden because false-positive cases have to visit hospitals and perform specialized diagnostic tests to confirm the diagnosis. Therefore, the need for systems that can automatically detect and diagnose COVID-19 automatically without human intervention is still an urgent priority and will remain so because the same technology can be used for future pandemics and other health conditions. In this paper, we propose a modified machine learning (ML) process that integrates deep learning (DL) algorithms for feature extraction and well-known classifiers that can accurately detect and diagnose COVID-19 from chest CT scans. Publicly available datasets were made available by the China Consortium for Chest CT Image Investigation (CC-CCII). The highest average accuracy obtained was 99.9% using the modified ML process when 2000 features were extracted using GoogleNet and ResNet18 and using the support vector machine (SVM) classifier. The results obtained using the modified ML process were higher when compared to similar methods reported in the extant literature using the same datasets or different datasets of similar size; thus, this study is considered of added value to the current body of knowledge. Further research in this field is required to develop methods that can be applied in hospitals and can better equip mankind to be prepared for any future pandemics.
Collapse
Affiliation(s)
- Ghazanfar Latif
- Computer Science Department, Prince Mohammad Bin Fahd University, Khobar 34754, Saudi Arabia
- Department of Computer Sciences and Mathematics, Université du Québec à Chicoutimi, 555 Boulevard de l’Université, Chicoutimi, QC G7H 2B1, Canada
- Correspondence: or
| | - Hamdy Morsy
- Department of Applied Natural Sciences, College of Community, Qassim University, Buraydah 52571, Saudi Arabia;
- Department of Electronics and communications, College of Engineering, Helwan University, Cairo 11792, Egypt
| | - Asmaa Hassan
- Faculty of Medicine, Helwan University, Helwan 11795, Egypt;
| | - Jaafar Alghazo
- Department of Electrical and Computer Engineering, Virginia Military Institute, Lexington, VA 24450, USA;
| |
Collapse
|
26
|
Nandhini Abirami R, Durai Raj Vincent PM, Rajinikanth V, Kadry S. COVID-19 Classification Using Medical Image Synthesis by Generative Adversarial Networks. INT J UNCERTAIN FUZZ 2022. [DOI: 10.1142/s0218488522400128] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
The outbreak of novel coronavirus disease 2019, also called COVID-19, in Wuhan, China, began in December 2019. Since its outbreak, infectious disease has rapidly spread across the globe. The testing methods adopted by the medical practitioners gave false negatives, which is a big challenge. Medical imaging using deep learning can be adopted to speed up the testing process and avoid false negatives. This work proposes a novel approach, COVID-19 GAN, to perform coronavirus disease classification using medical image synthesis by a generative adversarial network. Detecting coronavirus infections from the chest X-ray images is very crucial for its early diagnosis and effective treatment. To boost the performance of the deep learning model and improve the accuracy of classification, synthetic data augmentation is performed using generative adversarial networks. Here, the available COVID-19 positive chest X-ray images are fed into the styleGAN2 model. The styleGAN model is trained, and the data necessary for training the deep learning model for coronavirus classification is generated. The generated COVID-19 positive chest X-ray images and the normal chest X-ray images are fed into the deep learning model for training. An accuracy of 99.78% is achieved in classifying chest X-ray images using CNN binary classifier model.
Collapse
Affiliation(s)
- R. Nandhini Abirami
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore 632014, Tamil Nadhu, India
| | - P. M. Durai Raj Vincent
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore 632014, Tamil Nadhu, India
| | - Venkatesan Rajinikanth
- Department of Electronics & Instrumentation Engineering, St. Joseph’s College of Engineering, Chennai 600119, Tamil Nadhu, India
| | - Seifedine Kadry
- Department of Applied Data Science, Noroff University College, Norway
| |
Collapse
|
27
|
M. A, Govindharaju K, A. J, Mohan S, Ahmadian A, Ciano T. A hybrid learning approach for the stage‐wise classification and prediction of COVID‐19 X‐ray images. EXPERT SYSTEMS 2022; 39. [DOI: 10.1111/exsy.12884] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/08/2021] [Accepted: 10/13/2021] [Indexed: 09/15/2023]
Abstract
AbstractBackgroundThe COVID‐19 pandemic has precipitated global apprehensions about increased fatalities and raised concerns about gaps in healthcare infrastructure and accessibility the world over. Consequently, the importance of timely prediction and treatment of the disease to reduce transmission and mortality rates cannot be emphasized enough. Various symptoms of the disease have been identified as it progresses from the time it is contracted. COVID‐19 has been found to internally affect the lungs, and the four progressive stages of the infection can be categorized as mild, moderate, severe, and critical. Therefore, an accurate analysis of the current stage of the disease that can help predict its progression has become critical. X‐ray imaging has been found to be an effective screening procedure for predicting the various stages of this epidemic. Although many different approaches using machine learning, as well as deep learning were utilized to predict and classify diseases in general, till date, such an approach has not been used to predict the various stages of COVID‐19 by using X‐ray imaging to identify and classify those stages.Materials and methodThe proposed hybrid method used three public datasets for its implementation. In this work, extensive images were used for the purposes of testing and training. The dataset‐1 consists of 1200 COVID‐19 as well as 1200 Non‐COVID‐19 images, while dataset‐2 used 700 COVID‐19 as well as 700 Non‐COVID‐19 images, and finally, dataset‐III utilized 1900 COVID‐19 as well as 1900 Non‐COVID‐19 images for purposes of testing and training. The proposed work undertook the task of pre‐processing using textual and morphological features, while the segmentation and prediction of COVID‐19 as well as Non‐COVID‐19 images were undertaken using VGG‐16 with light GBM for better prediction and handing of huge datasets, and finally, the classification of the various stages of COVID‐19 images was performed using Deep Belief Network.ResultsThe outcomes of the proposed work were subjected to several iterations which were then compared using different parameters such as accuracy, specificity, and sensitivity. In general, the prediction and grouping of the various stages of COVID‐19 by using affected images were found to be 99.2%, 99.4% and 99.5%, respectively. The bacterial pneumonia prediction rates were observed to be 98.5%, 99.4% and 98.3%, respectively. The average classification of the stages were found to be 98.1%, 98.6% and 98.3%, while the combined multi‐classification prediction rates were observed to be 98.6%, 99.1% and 98.7%, respectively.
Collapse
Affiliation(s)
- Adimoolam M.
- Department of Computer Science and Engineering Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences Chennai India
| | - Karthi Govindharaju
- Department of Artificial Intelligence and Data Science Saveetha Engineering College Chennai India
| | - John A.
- School of Computer Science and Engineering Galgotias University Greater Noida India
| | - Senthilkumar Mohan
- School of Information Technology and Engineering Vellore Institute of Technology Vellore India
| | - Ali Ahmadian
- Institute of IR 4.0 The National University of Malaysia, UKM Bangi Malaysia
- Department of Mathematics Near East University Nicosia, TRNC, Mersin 10 Turkey
| | - Tiziana Ciano
- Faculty of Business and Law University of Portsmouth Portsmouth UK
| |
Collapse
|
28
|
Lee M. An Ensemble Deep Learning Model with a Gene Attention Mechanism for Estimating the Prognosis of Low-Grade Glioma. BIOLOGY 2022; 11:586. [PMID: 35453785 PMCID: PMC9027395 DOI: 10.3390/biology11040586] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Revised: 03/30/2022] [Accepted: 04/11/2022] [Indexed: 06/14/2023]
Abstract
While estimating the prognosis of low-grade glioma (LGG) is a crucial problem, it has not been extensively studied to introduce recent improvements in deep learning to address the problem. The attention mechanism is one of the significant advances; however, it is still unclear how attention mechanisms are used in gene expression data to estimate prognosis because they were designed for convolutional layers and word embeddings. This paper proposes an attention mechanism called gene attention for gene expression data. Additionally, a deep learning model for prognosis estimation of LGG is proposed using gene attention. The proposed Gene Attention Ensemble NETwork (GAENET) outperformed other conventional methods, including survival support vector machine and random survival forest. When evaluated by C-Index, the GAENET exhibited an improvement of 7.2% compared to the second-best model. In addition, taking advantage of the gene attention mechanism, HILS1 was discovered as the most significant prognostic gene in terms of deep learning training. While HILS1 is known as a pseudogene, HILS1 is a biomarker estimating the prognosis of LGG and has demonstrated a possibility of regulating the expression of other prognostic genes.
Collapse
Affiliation(s)
- Minhyeok Lee
- School of Electrical and Electronics Engineering, Chung-Ang University, Seoul 06974, Korea
| |
Collapse
|
29
|
Ayalew AM, Salau AO, Abeje BT, Enyew B. Detection and classification of COVID-19 disease from X-ray images using convolutional neural networks and histogram of oriented gradients. Biomed Signal Process Control 2022; 74:103530. [PMID: 35096125 PMCID: PMC8789569 DOI: 10.1016/j.bspc.2022.103530] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2021] [Revised: 01/04/2022] [Accepted: 01/21/2022] [Indexed: 12/11/2022]
Abstract
COVID-19 is now regarded as the most lethal disease caused by the novel coronavirus disease of humans. The COVID-19 pandemic has spread to every country on the planet and has wreaked havoc on these countries by increasing the number of human deaths, and in addition, caused intense hunger, and lowered economic productivity. Due to a lack of sufficient radiologist, a restricted amount of COVID-19 test kits is available in hospitals, and this is also accompanied by a shortage of equipment due to the daily increase in cases, as a result of increase in the number of persons infected with COVID-19 . Even for experienced radiologists, examining chest X-rays is a difficult task. Many people have died as a result of inaccurate COVID-19 diagnosis and treatment, as well as ineffective detection measures. This paper, therefore presents a unique detection and classification approach (DCCNet) for quick diagnosis of COVID-19 using chest X-ray images of patients. To achieve quick diagnosis, a convolutional neural network (CNN) and histogram of oriented gradients (HOG) method is proposed in this paper to help medical experts diagnose COVID-19 disease. The diagnostic performance of the hybrid CNN model and HOG-based method was then evaluated using chest X-ray images collected from University of Gondar and online databases. The experiment was performed using Keras (with TensorFlow as a backend) and Python. After the DCCNet model was evaluated, a 99.9% training accuracy and 98.3% test accuracy was achieved, while a 100% training accuracy and 98.5% test accuracy was achieved using HOG. After the evaluation, the hybrid model achieved 99.97% and 99.67% training and testing accuracy for detection and classification of COVID-19 which was better by 1.37% compared to when features were extracted using CNN and 1.17% when HOG was used. The DCCNet achieved a result that outperformed state-of-the-art models by 6.7%.
Collapse
Affiliation(s)
| | - Ayodeji Olalekan Salau
- Department of Electrical/Electronics and Computer Engineering, Afe Babalola University, Ado-Ekiti, Nigeria
- Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, India
| | | | - Belay Enyew
- Department of Information Technology, University of Gondar, Ethiopia
| |
Collapse
|
30
|
Chen HY, Lin CS, Fang WH, Lou YS, Cheng CC, Lee CC, Lin C. Artificial Intelligence-Enabled Electrocardiography Predicts Left Ventricular Dysfunction and Future Cardiovascular Outcomes: A Retrospective Analysis. J Pers Med 2022; 12:455. [PMID: 35330455 PMCID: PMC8950054 DOI: 10.3390/jpm12030455] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Revised: 02/24/2022] [Accepted: 03/10/2022] [Indexed: 02/05/2023] Open
Abstract
BACKGROUND: The ejection fraction (EF) provides critical information about heart failure (HF) and its management. Electrocardiography (ECG) is a noninvasive screening tool for cardiac electrophysiological activities that has been used to detect patients with low EF based on a deep learning model (DLM) trained via large amounts of data. However, no studies have widely investigated its clinical impacts. OBJECTIVE: This study developed a DLM to estimate EF via ECG (ECG-EF). We further investigated the relationship between ECG-EF and echo-based EF (ECHO-EF) and explored their contributions to future cardiovascular adverse events. METHODS: There were 57,206 ECGs with corresponding echocardiograms used to train our DLM. We compared a series of training strategies and selected the best DLM. The architecture of the DLM was based on ECG12Net, developed previously. Next, 10,762 ECGs were used for validation, and another 20,629 ECGs were employed to conduct the accuracy test. The changes between ECG-EF and ECHO-EF were evaluated. The primary follow-up adverse events included future ECHO-EF changes and major adverse cardiovascular events (MACEs). RESULTS: The sex-/age-matching strategy-trained DLM achieved the best area under the curve (AUC) of 0.9472 with a sensitivity of 86.9% and specificity of 89.6% in the follow-up cohort, with a correlation of 0.603 and a mean absolute error of 7.436. In patients with accurate prediction (initial difference < 10%), the change traces of ECG-EF and ECHO-EF were more consistent (R-square = 0.351) than in all patients (R-square = 0.115). Patients with lower ECG-EF (≤35%) exhibited a greater risk of cardiovascular (CV) complications, delayed ECHO-EF recovery, and earlier ECHO-EF deterioration than patients with normal ECG-EF (>50%). Importantly, ECG-EF demonstrated an independent impact on MACEs and all CV adverse outcomes, with better prediction of CV outcomes than ECHO-EF. CONCLUSIONS: The ECG-EF could be used to initially screen asymptomatic left ventricular dysfunction (LVD) and it could also independently contribute to the predictions of future CV adverse events. Although further large-scale studies are warranted, DLM-based ECG-EF could serve as a promising diagnostic supportive and management-guided tool for CV disease prediction and the care of patients with LVD.
Collapse
Affiliation(s)
- Hung-Yi Chen
- Department of Internal Medicine, Tri-Service General Hospital, National Defense Medical Center, Taipei 114, Taiwan
| | - Chin-Sheng Lin
- Division of Cardiology, Department of Internal Medicine, Tri-Service General Hospital, National Defense Medical Center, Taipei 114, Taiwan
| | - Wen-Hui Fang
- Department of Family and Community Medicine, Tri-Service General Hospital, National Defense Medical Center, Taipei 114, Taiwan
| | - Yu-Sheng Lou
- Graduate Institute of Life Sciences, National Defense Medical Center, Taipei 114, Taiwan
- School of Public Health, National Defense Medical Center, Taipei 114, Taiwan
| | - Cheng-Chung Cheng
- Division of Cardiology, Department of Internal Medicine, Tri-Service General Hospital, National Defense Medical Center, Taipei 114, Taiwan
| | - Chia-Cheng Lee
- Planning and Management Office, Tri-Service General Hospital, National Defense Medical Center, Taipei 114, Taiwan
- Division of Colorectal Surgery, Department of Surgery, Tri-Service General Hospital, National Defense Medical Center, Taipei 114, Taiwan
| | - Chin Lin
- Graduate Institute of Life Sciences, National Defense Medical Center, Taipei 114, Taiwan
- School of Public Health, National Defense Medical Center, Taipei 114, Taiwan
- School of Medicine, National Defense Medical Center, Taipei 114, Taiwan
| |
Collapse
|
31
|
Bozkurt F. A deep and handcrafted features-based framework for diagnosis of COVID-19 from chest x-ray images. CONCURRENCY AND COMPUTATION : PRACTICE & EXPERIENCE 2022; 34:e6725. [PMID: 34899079 PMCID: PMC8646664 DOI: 10.1002/cpe.6725] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2021] [Revised: 09/24/2021] [Accepted: 10/29/2021] [Indexed: 05/07/2023]
Abstract
Automatic early diagnosis of COVID-19 with computer-aided tools is crucial for disease treatment and control. Radiology images of COVID-19 and other lung diseases like bacterial pneumonia, viral pneumonia have common features. Thus, this similarity makes it difficult for radiologists to detect COVID-19 cases. A reliable method for classifying non-COVID-19 and COVID-19 chest x-ray images could be useful to reduce triage process and diagnose. In this study, we develop an original framework (HANDEFU) that supports handcrafted, deep, and fusion-based feature extraction techniques for feature engineering. The user interactively builds any model by selecting feature extraction technique and classification method through the framework. Any feature extraction technique and model could then be added dynamically to the library of software at a later time upon request. The novelty of this study is that image preprocessing and diverse feature extraction and classification techniques are assembled under an original framework. In this study, this framework is utilized for diagnosing COVID-19 from chest x-ray images on an open-access dataset. All of the experimental results and performance evaluations on this dataset are performed with this software. In experimental studies, COVID-19 prediction is performed by 27 different models through software. The superior performance with accuracy of 99.36% is obtained by LBP+SVM model.
Collapse
Affiliation(s)
- Ferhat Bozkurt
- Department of Computer Engineering, Faculty of EngineeringAtatürk UniversityErzurumTurkey
| |
Collapse
|
32
|
Bayram F, Eleyan A. COVID-19 detection on chest radiographs using feature fusion based deep learning. SIGNAL, IMAGE AND VIDEO PROCESSING 2022; 16:1455-1462. [PMID: 35096182 PMCID: PMC8784235 DOI: 10.1007/s11760-021-02098-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 08/10/2021] [Accepted: 11/17/2021] [Indexed: 05/17/2023]
Abstract
The year 2020 will certainly be remembered in human history as the year in which humans faced a global pandemic that drastically affected every living soul on planet earth. The COVID-19 pandemic certainly had a massive impact on human's social and daily lives. The economy and relations of all countries were also radically impacted. Due to such unexpected situations, healthcare systems either collapsed or failed under colossal pressure to cope with the overwhelming numbers of patients arriving at emergency rooms and intensive care units. The COVID -19 tests used for diagnosis were expensive, slow, and gave indecisive results. Unfortunately, such a hindered diagnosis of the infection prevented abrupt isolation of the infected people which, in turn, caused the rapid spread of the virus. In this paper, we proposed the use of cost-effective X-ray images in diagnosing COVID-19 patients. Compared to other imaging modalities, X-ray imaging is available in most healthcare units. Deep learning was used for feature extraction and classification by implementing a multi-stream convolutional neural network model. The model extracts and concatenates features from its three inputs, namely; grayscale, local binary patterns, and histograms of oriented gradients images. Extensive experiments using fivefold cross-validation were carried out on a publicly available X-ray database with 3886 images of three classes. Obtained results outperform the results of other algorithms with an accuracy of 97.76%. The results also show that the proposed model can make a significant contribution to the rapidly increasing workload in health systems with an artificial intelligence-based automatic diagnosis tool.
Collapse
Affiliation(s)
- Fatih Bayram
- Mechatronics Engineering Department, Faculty of Technology, Afyon Kocatepe University, Afyonkarahisar, Turkey
| | - Alaa Eleyan
- College of Engineering and Technology, American University of the Middle East, Egaila, Kuwait
| |
Collapse
|
33
|
Li Z, Li Z, Yao L, Chen Q, Zhang J, Li X, Feng JM, Li Y, Xu J. Multiple-Inputs Convolutional Neural Network for COVID-19 Classification and Critical Region Screening From Chest X-ray Radiographs: Model Development and Performance Evaluation. JMIR BIOINFORMATICS AND BIOTECHNOLOGY 2022; 3:e36660. [PMID: 36277075 PMCID: PMC9578294 DOI: 10.2196/36660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Revised: 08/23/2022] [Accepted: 08/29/2022] [Indexed: 12/02/2022]
Abstract
Background The COVID-19 pandemic is becoming one of the largest, unprecedented health crises, and chest X-ray radiography (CXR) plays a vital role in diagnosing COVID-19. However, extracting and finding useful image features from CXRs demand a heavy workload for radiologists. Objective The aim of this study was to design a novel multiple-inputs (MI) convolutional neural network (CNN) for the classification of COVID-19 and extraction of critical regions from CXRs. We also investigated the effect of the number of inputs on the performance of our new MI-CNN model. Methods A total of 6205 CXR images (including 3021 COVID-19 CXRs and 3184 normal CXRs) were used to test our MI-CNN models. CXRs could be evenly segmented into different numbers (2, 4, and 16) of individual regions. Each region could individually serve as one of the MI-CNN inputs. The CNN features of these MI-CNN inputs would then be fused for COVID-19 classification. More importantly, the contributions of each CXR region could be evaluated through assessing the number of images that were accurately classified by their corresponding regions in the testing data sets. Results In both the whole-image and left- and right-lung region of interest (LR-ROI) data sets, MI-CNNs demonstrated good efficiency for COVID-19 classification. In particular, MI-CNNs with more inputs (2-, 4-, and 16-input MI-CNNs) had better efficiency in recognizing COVID-19 CXRs than the 1-input CNN. Compared to the whole-image data sets, the efficiency of LR-ROI data sets showed approximately 4% lower accuracy, sensitivity, specificity, and precision (over 91%). In considering the contributions of each region, one of the possible reasons for this reduced performance was that nonlung regions (eg, region 16) provided false-positive contributions to COVID-19 classification. The MI-CNN with the LR-ROI data set could provide a more accurate evaluation of the contribution of each region and COVID-19 classification. Additionally, the right-lung regions had higher contributions to the classification of COVID-19 CXRs, whereas the left-lung regions had higher contributions to identifying normal CXRs. Conclusions Overall, MI-CNNs could achieve higher accuracy with an increasing number of inputs (eg, 16-input MI-CNN). This approach could assist radiologists in identifying COVID-19 CXRs and in screening the critical regions related to COVID-19 classifications.
Collapse
Affiliation(s)
- Zhongqiang Li
- Division of Electrical and Computer Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| | - Zheng Li
- Division of Electrical and Computer Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| | - Luke Yao
- Division of Electrical and Computer Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| | - Qing Chen
- Division of Computer Science and Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| | - Jian Zhang
- Division of Computer Science and Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| | - Xin Li
- Department of Visualization Texas A & M University College Station, TX United States
| | - Ji-Ming Feng
- Department of Comparative Biomedical Science School of Veterinary Medicine Louisiana State University Baton Rouge, LA United States
| | - Yanping Li
- School of Environment and Sustainability University of Saskatchewan Saskatoon, SK Canada
| | - Jian Xu
- Division of Electrical and Computer Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| |
Collapse
|
34
|
Riahi A, Elharrouss O, Al-Maadeed S. BEMD-3DCNN-based method for COVID-19 detection. Comput Biol Med 2021; 142:105188. [PMID: 34998222 PMCID: PMC8717690 DOI: 10.1016/j.compbiomed.2021.105188] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2021] [Revised: 12/27/2021] [Accepted: 12/27/2021] [Indexed: 12/23/2022]
Abstract
The coronavirus outbreak continues to spread around the world and no one knows when it will stop. Therefore, from the first day of the identification of the virus in Wuhan, China, scientists have launched numerous research projects to understand the nature of the virus, how to detect it, and search for the most effective medicine to help and protect patients. Importantly, a rapid diagnostic and detection system is a priority and should be developed to stop COVID-19 from spreading. Medical imaging techniques have been used for this purpose. Current research is focused on exploiting different backbones like VGG, ResNet, DenseNet, or combining them to detect COVID-19. By using these backbones many aspects cannot be analyzed like the spatial and contextual information in the images, although this information can be useful for more robust detection performance. In this paper, we used 3D representation of the data as input for the proposed 3DCNN-based deep learning model. The process includes using the Bi-dimensional Empirical Mode Decomposition (BEMD) technique to decompose the original image into IMFs, and then building a video of these IMF images. The formed video is used as input for the 3DCNN model to classify and detect the COVID-19 virus. The 3DCNN model consists of a 3D VGG-16 backbone followed by a Context-aware attention (CAA) module, and then fully connected layers for classification. Each CAA module takes the feature maps of different blocks of the backbone, which allows learning from different feature maps. In our experiments, we used 6484 X-ray images, of which 1802 were COVID-19 positive cases, 1910 normal cases, and 2772 pneumonia cases. The experiment results showed that our proposed technique achieved the desired results on the selected dataset. Additionally, the use of the 3DCNN model with contextual information processing exploited CAA networks to achieve better performance.
Collapse
Affiliation(s)
- Ali Riahi
- Department of Computer Science and Engineering, Department of Computer Science and Engineering, Qatar University, Doha, Qatar.
| | - Omar Elharrouss
- Department of Computer Science and Engineering, Department of Computer Science and Engineering, Qatar University, Doha, Qatar.
| | - Somaya Al-Maadeed
- Department of Computer Science and Engineering, Department of Computer Science and Engineering, Qatar University, Doha, Qatar.
| |
Collapse
|
35
|
Danilov VV, Proutski A, Karpovsky A, Kirpich A, Litmanovich D, Nefaridze D, Talalov O, Semyonov S, Koniukhovskii V, Shvartc V, Gankin Y. Indirect supervision applied to COVID-19 and pneumonia classification. INFORMATICS IN MEDICINE UNLOCKED 2021; 28:100835. [PMID: 34977331 PMCID: PMC8712713 DOI: 10.1016/j.imu.2021.100835] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 12/11/2021] [Accepted: 12/23/2021] [Indexed: 01/08/2023] Open
Abstract
The novel coronavirus 19 (COVID-19) continues to have a devastating effect around the globe, leading many scientists and clinicians to actively seek to develop new techniques to assist with the tackling of this disease. Modern machine learning methods have shown promise in their adoption to assist the healthcare industry through their data and analytics-driven decision making, inspiring researchers to develop new angles to fight the virus. In this paper, we aim to develop a CNN-based method for the detection of COVID-19 by utilizing patients' chest X-ray images. Developing upon the inclusion of convolutional units, the proposed method makes use of indirect supervision based on Grad-CAM. This technique is used in the training process where Grad-CAM's attention heatmaps support the network's predictions. Despite recent progress, scarcity of data has thus far limited the development of a robust solution. We extend upon existing work by combining publicly available data across 5 different sources and carefully annotate the comprising images across three categories: normal, pneumonia, and COVID-19. To achieve a high classification accuracy, we propose a training pipeline based on indirect supervision of traditional classification networks, where the guidance is directed by an external algorithm. With this method, we observed that the widely used, standard networks can achieve an accuracy comparable to tailor-made models, specifically for COVID-19, with one network in particular, VGG-16, outperforming the best of the tailor-made models.
Collapse
Affiliation(s)
- Viacheslav V Danilov
- Tomsk Polytechnic University, Tomsk, Russia
- Research Institute for Complex Issues of Cardiovascular Diseases, Kemerovo, Russia
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
36
|
Lu SY, Zhang Z, Zhang YD, Wang SH. CGENet: A Deep Graph Model for COVID-19 Detection Based on Chest CT. BIOLOGY 2021; 11:33. [PMID: 35053031 PMCID: PMC8773037 DOI: 10.3390/biology11010033] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/28/2021] [Revised: 12/23/2021] [Accepted: 12/25/2021] [Indexed: 11/17/2022]
Abstract
Accurate and timely diagnosis of COVID-19 is indispensable to control its spread. This study proposes a novel explainable COVID-19 diagnosis system called CGENet based on graph embedding and an extreme learning machine for chest CT images. We put forward an optimal backbone selection algorithm to select the best backbone for the CGENet based on transfer learning. Then, we introduced graph theory into the ResNet-18 based on the k-nearest neighbors. Finally, an extreme learning machine was trained as the classifier of the CGENet. The proposed CGENet was evaluated on a large publicly-available COVID-19 dataset and produced an average accuracy of 97.78% based on 5-fold cross-validation. In addition, we utilized the Grad-CAM maps to present a visual explanation of the CGENet based on COVID-19 samples. In all, the proposed CGENet can be an effective and efficient tool to assist COVID-19 diagnosis.
Collapse
Affiliation(s)
- Si-Yuan Lu
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK;
| | - Zheng Zhang
- Shenzhen Key Laboratory of Visual Object Detection and Recognition, Harbin Institute of Technology, Shenzhen 518055, China; or
- Department of Computer and Information Science, University of Macau, Macau 999078, China
| | - Yu-Dong Zhang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK;
| | - Shui-Hua Wang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK;
| |
Collapse
|
37
|
Data-Driven Analytics Leveraging Artificial Intelligence in the Era of COVID-19: An Insightful Review of Recent Developments. Symmetry (Basel) 2021. [DOI: 10.3390/sym14010016] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023] Open
Abstract
This paper presents the role of artificial intelligence (AI) and other latest technologies that were employed to fight the recent pandemic (i.e., novel coronavirus disease-2019 (COVID-19)). These technologies assisted the early detection/diagnosis, trends analysis, intervention planning, healthcare burden forecasting, comorbidity analysis, and mitigation and control, to name a few. The key-enablers of these technologies was data that was obtained from heterogeneous sources (i.e., social networks (SN), internet of (medical) things (IoT/IoMT), cellular networks, transport usage, epidemiological investigations, and other digital/sensing platforms). To this end, we provide an insightful overview of the role of data-driven analytics leveraging AI in the era of COVID-19. Specifically, we discuss major services that AI can provide in the context of COVID-19 pandemic based on six grounds, (i) AI role in seven different epidemic containment strategies (a.k.a non-pharmaceutical interventions (NPIs)), (ii) AI role in data life cycle phases employed to control pandemic via digital solutions, (iii) AI role in performing analytics on heterogeneous types of data stemming from the COVID-19 pandemic, (iv) AI role in the healthcare sector in the context of COVID-19 pandemic, (v) general-purpose applications of AI in COVID-19 era, and (vi) AI role in drug design and repurposing (e.g., iteratively aligning protein spikes and applying three/four-fold symmetry to yield a low-resolution candidate template) against COVID-19. Further, we discuss the challenges involved in applying AI to the available data and privacy issues that can arise from personal data transitioning into cyberspace. We also provide a concise overview of other latest technologies that were increasingly applied to limit the spread of the ongoing pandemic. Finally, we discuss the avenues of future research in the respective area. This insightful review aims to highlight existing AI-based technological developments and future research dynamics in this area.
Collapse
|
38
|
Gudigar A, Raghavendra U, Nayak S, Ooi CP, Chan WY, Gangavarapu MR, Dharmik C, Samanth J, Kadri NA, Hasikin K, Barua PD, Chakraborty S, Ciaccio EJ, Acharya UR. Role of Artificial Intelligence in COVID-19 Detection. SENSORS (BASEL, SWITZERLAND) 2021; 21:8045. [PMID: 34884045 PMCID: PMC8659534 DOI: 10.3390/s21238045] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Revised: 11/26/2021] [Accepted: 11/26/2021] [Indexed: 12/15/2022]
Abstract
The global pandemic of coronavirus disease (COVID-19) has caused millions of deaths and affected the livelihood of many more people. Early and rapid detection of COVID-19 is a challenging task for the medical community, but it is also crucial in stopping the spread of the SARS-CoV-2 virus. Prior substantiation of artificial intelligence (AI) in various fields of science has encouraged researchers to further address this problem. Various medical imaging modalities including X-ray, computed tomography (CT) and ultrasound (US) using AI techniques have greatly helped to curb the COVID-19 outbreak by assisting with early diagnosis. We carried out a systematic review on state-of-the-art AI techniques applied with X-ray, CT, and US images to detect COVID-19. In this paper, we discuss approaches used by various authors and the significance of these research efforts, the potential challenges, and future trends related to the implementation of an AI system for disease detection during the COVID-19 pandemic.
Collapse
Affiliation(s)
- Anjan Gudigar
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - U Raghavendra
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Sneha Nayak
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Chui Ping Ooi
- School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore;
| | - Wai Yee Chan
- Department of Biomedical Imaging, Faculty of Medicine, University of Malaya, Kuala Lumpur 50603, Malaysia;
| | - Mokshagna Rohit Gangavarapu
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Chinmay Dharmik
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Jyothi Samanth
- Department of Cardiovascular Technology, Manipal College of Health Professions, Manipal Academy of Higher Education, Manipal 576104, India;
| | - Nahrizul Adib Kadri
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia; (N.A.K.); (K.H.)
| | - Khairunnisa Hasikin
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia; (N.A.K.); (K.H.)
| | - Prabal Datta Barua
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW 2010, Australia;
- School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD 4350, Australia
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia;
| | - Subrata Chakraborty
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia;
- Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW 2351, Australia
| | - Edward J. Ciaccio
- Department of Medicine, Columbia University Medical Center, New York, NY 10032, USA;
| | - U. Rajendra Acharya
- School of Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore;
- Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung 41354, Taiwan
- International Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto 860-8555, Japan
| |
Collapse
|
39
|
Prakash NB, Murugappan M, Hemalakshmi GR, Jayalakshmi M, Mahmud M. Deep transfer learning for COVID-19 detection and infection localization with superpixel based segmentation. SUSTAINABLE CITIES AND SOCIETY 2021; 75:103252. [PMID: 34422549 PMCID: PMC8364837 DOI: 10.1016/j.scs.2021.103252] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/28/2021] [Revised: 08/01/2021] [Accepted: 08/09/2021] [Indexed: 05/07/2023]
Abstract
The evolution the novel corona virus disease (COVID-19) as a pandemic has inflicted several thousand deaths per day endangering the lives of millions of people across the globe. In addition to thermal scanning mechanisms, chest imaging examinations provide valuable insights to the detection of this virus, diagnosis and prognosis of the infections. Though Chest CT and Chest X-ray imaging are common in the clinical protocols of COVID-19 management, the latter is highly preferred, attributed to its simple image acquisition procedure and mobility of the imaging mechanism. However, Chest X-ray images are found to be less sensitive compared to Chest CT images in detecting infections in the early stages. In this paper, we propose a deep learning based framework to enhance the diagnostic values of these images for improved clinical outcomes. It is realized as a variant of the conventional SqueezeNet classifier with segmentation capabilities, which is trained with deep features extracted from the Chest X-ray images of a standard dataset for binary and multi class classification. The binary classifier achieves an accuracy of 99.53% in the discrimination of COVID-19 and Non COVID-19 images. Similarly, the multi class classifier performs classification of COVID-19, Viral Pneumonia and Normal cases with an accuracy of 99.79%. This model called the COVID-19 Super pixel SqueezNet (COVID-SSNet) performs super pixel segmentation of the activation maps to extract the regions of interest which carry perceptual image features and constructs an overlay of the Chest X-ray images with these regions. The proposed classifier model adds significant value to the Chest X-rays for an integral examination of the image features and the image regions influencing the classifier decisions to expedite the COVID-19 treatment regimen.
Collapse
Affiliation(s)
- N B Prakash
- Department of Electrical and Electronics Engineering, National Engineering College, Tamil Nadu, India
| | - M Murugappan
- Intelligent Signal Processing (ISP) Research Lab, Department of Electronics and Communication Engineering, Kuwait College of Science and Technology, Kuwait
| | - G R Hemalakshmi
- Department of Computer Science and Engineering, National Engineering College, Tamil Nadu, India
| | - M Jayalakshmi
- Department of Computer Science and Engineering, National Engineering College, Tamil Nadu, India
| | - Mufti Mahmud
- Department of Computer Science, Nottingham Trent University, Clifton, Nottingham NG11 8NS, UK
- Medical Technologies Innovation Facility, Nottingham Trent University, Clifton, Nottingham NG11 8NS, UK
- Computing and Informatics Research Centre, Nottingham Trent University, Clifton, Nottingham NG11 8NS, UK
| |
Collapse
|
40
|
Khan MA, Alhaisoni M, Tariq U, Hussain N, Majid A, Damaševičius R, Maskeliūnas R. COVID-19 Case Recognition from Chest CT Images by Deep Learning, Entropy-Controlled Firefly Optimization, and Parallel Feature Fusion. SENSORS (BASEL, SWITZERLAND) 2021; 21:7286. [PMID: 34770595 PMCID: PMC8588229 DOI: 10.3390/s21217286] [Citation(s) in RCA: 42] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/26/2021] [Revised: 10/28/2021] [Accepted: 10/29/2021] [Indexed: 12/12/2022]
Abstract
In healthcare, a multitude of data is collected from medical sensors and devices, such as X-ray machines, magnetic resonance imaging, computed tomography (CT), and so on, that can be analyzed by artificial intelligence methods for early diagnosis of diseases. Recently, the outbreak of the COVID-19 disease caused many deaths. Computer vision researchers support medical doctors by employing deep learning techniques on medical images to diagnose COVID-19 patients. Various methods were proposed for COVID-19 case classification. A new automated technique is proposed using parallel fusion and optimization of deep learning models. The proposed technique starts with a contrast enhancement using a combination of top-hat and Wiener filters. Two pre-trained deep learning models (AlexNet and VGG16) are employed and fine-tuned according to target classes (COVID-19 and healthy). Features are extracted and fused using a parallel fusion approach-parallel positive correlation. Optimal features are selected using the entropy-controlled firefly optimization method. The selected features are classified using machine learning classifiers such as multiclass support vector machine (MC-SVM). Experiments were carried out using the Radiopaedia database and achieved an accuracy of 98%. Moreover, a detailed analysis is conducted and shows the improved performance of the proposed scheme.
Collapse
Affiliation(s)
- Muhammad Attique Khan
- Department of Computer Science, HITEC University, Taxila 47080, Pakistan; (M.A.K.); (N.H.); (A.M.)
| | - Majed Alhaisoni
- College of Computer Science and Engineering, University of Ha’il, Ha’il 55211, Saudi Arabia;
| | - Usman Tariq
- Information Systems Department, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al Khraj 11942, Saudi Arabia;
| | - Nazar Hussain
- Department of Computer Science, HITEC University, Taxila 47080, Pakistan; (M.A.K.); (N.H.); (A.M.)
| | - Abdul Majid
- Department of Computer Science, HITEC University, Taxila 47080, Pakistan; (M.A.K.); (N.H.); (A.M.)
| | - Robertas Damaševičius
- Faculty of Applied Mathematics, Silesian University of Technology, 44-100 Gliwice, Poland
| | - Rytis Maskeliūnas
- Department of Multimedia Engineering, Kaunas University of Technology, 51368 Kaunas, Lithuania;
| |
Collapse
|
41
|
Brima Y, Atemkeng M, Tankio Djiokap S, Ebiele J, Tchakounté F. Transfer Learning for the Detection and Diagnosis of Types of Pneumonia including Pneumonia Induced by COVID-19 from Chest X-ray Images. Diagnostics (Basel) 2021; 11:1480. [PMID: 34441414 PMCID: PMC8394302 DOI: 10.3390/diagnostics11081480] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2021] [Revised: 08/07/2021] [Accepted: 08/09/2021] [Indexed: 12/23/2022] Open
Abstract
Accurate early diagnosis of COVID-19 viral pneumonia, primarily in asymptomatic people, is essential to reduce the spread of the disease, the burden on healthcare capacity, and the overall death rate. It is essential to design affordable and accessible solutions to distinguish pneumonia caused by COVID-19 from other types of pneumonia. In this work, we propose a reliable approach based on deep transfer learning that requires few computations and converges faster. Experimental results demonstrate that our proposed framework for transfer learning is a potential and effective approach to detect and diagnose types of pneumonia from chest X-ray images with a test accuracy of 94.0%.
Collapse
Affiliation(s)
- Yusuf Brima
- African Institute for Mathematical Sciences (AIMS), Kigali P.O. Box 7150, Rwanda;
| | - Marcellin Atemkeng
- Department of Mathematics, Rhodes University, Grahamstown 6140, South Africa
| | - Stive Tankio Djiokap
- Department of Arts, Technology and Heritage, Institute of Fine Arts, University of Dschang, Foumban P.O. Box 31, Cameroon;
| | - Jaures Ebiele
- African Institute for Mathematical Sciences (AIMS), Kigali P.O. Box 7150, Rwanda;
| | - Franklin Tchakounté
- Department of Mathematics and Computer Science, Faculty of Science, University of Ngaoundéré, Ngaoundéré P.O. Box 454, Cameroon;
| |
Collapse
|
42
|
Mahmood AF, Mahmood SW. Auto informing COVID-19 detection result from x-ray/CT images based on deep learning. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2021; 92:084102. [PMID: 34470404 DOI: 10.1063/5.0059829] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/12/2021] [Accepted: 07/11/2021] [Indexed: 06/13/2023]
Abstract
It is no secret to all that the corona pandemic has caused a decline in all aspects of the world. Therefore, offering an accurate automatic diagnostic system is very important. This paper proposed an accurate COVID-19 system by testing various deep learning models for x-ray/computed tomography (CT) medical images. A deep preprocessing procedure was done with two filters and segmentation to increase classification results. According to the results obtained, 99.94% of accuracy, 98.70% of sensitivity, and 100% of specificity scores were obtained by the Xception model in the x-ray dataset and the InceptionV3 model for CT scan images. The compared results have demonstrated that the proposed model is proven to be more successful than the deep learning algorithms in previous studies. Moreover, it has the ability to automatically notify the examination results to the patients, the health authority, and the community after taking any x-ray or CT images.
Collapse
Affiliation(s)
| | - Saja Waleed Mahmood
- University of Mosul, College of Engineering, Computer Engineering, Mosul, Iraq
| |
Collapse
|
43
|
Etienne EE, Nunna BB, Talukder N, Wang Y, Lee ES. COVID-19 Biomarkers and Advanced Sensing Technologies for Point-of-Care (POC) Diagnosis. Bioengineering (Basel) 2021; 8:98. [PMID: 34356205 PMCID: PMC8301167 DOI: 10.3390/bioengineering8070098] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2021] [Revised: 06/23/2021] [Accepted: 06/29/2021] [Indexed: 02/06/2023] Open
Abstract
COVID-19, also known as SARS-CoV-2 is a novel, respiratory virus currently plaguing humanity. Genetically, at its core, it is a single-strand positive-sense RNA virus. It is a beta-type Coronavirus and is distinct in its structure and binding mechanism compared to other types of coronaviruses. Testing for the virus remains a challenge due to the small market available for at-home detection. Currently, there are three main types of tests for biomarker detection: viral, antigen and antibody. Reverse Transcription-Polymerase Chain Reaction (RT-PCR) remains the gold standard for viral testing. However, the lack of quantitative detection and turnaround time for results are drawbacks. This manuscript focuses on recent advances in COVID-19 detection that have lower limits of detection and faster response times than RT-PCR testing. The advancements in sensing platforms have amplified the detection levels and provided real-time results for SARS-CoV-2 spike protein detection with limits as low as 1 fg/mL in the Graphene Field Effect Transistor (FET) sensor. Additionally, using multiple biomarkers, detection levels can achieve a specificity and sensitivity level comparable to that of PCR testing. Proper biomarker selection coupled with nano sensing detection platforms are key in the widespread use of Point of Care (POC) diagnosis in COVID-19 detection.
Collapse
Affiliation(s)
- Ernst Emmanuel Etienne
- Advanced Energy Systems and Microdevices Laboratory, Department of Mechanical and Industrial Engineering, New Jersey Institute of Technology, Newark, NJ 07102, USA; (E.E.E.); (B.B.N.); (N.T.); (Y.W.)
| | - Bharath Babu Nunna
- Advanced Energy Systems and Microdevices Laboratory, Department of Mechanical and Industrial Engineering, New Jersey Institute of Technology, Newark, NJ 07102, USA; (E.E.E.); (B.B.N.); (N.T.); (Y.W.)
- Division of Engineering in Medicine, Department of Medicine, Brigham, and Women’s Hospital, Harvard Medical School, Harvard University, Cambridge, MA 02139, USA
| | - Niladri Talukder
- Advanced Energy Systems and Microdevices Laboratory, Department of Mechanical and Industrial Engineering, New Jersey Institute of Technology, Newark, NJ 07102, USA; (E.E.E.); (B.B.N.); (N.T.); (Y.W.)
| | - Yudong Wang
- Advanced Energy Systems and Microdevices Laboratory, Department of Mechanical and Industrial Engineering, New Jersey Institute of Technology, Newark, NJ 07102, USA; (E.E.E.); (B.B.N.); (N.T.); (Y.W.)
| | - Eon Soo Lee
- Advanced Energy Systems and Microdevices Laboratory, Department of Mechanical and Industrial Engineering, New Jersey Institute of Technology, Newark, NJ 07102, USA; (E.E.E.); (B.B.N.); (N.T.); (Y.W.)
| |
Collapse
|
44
|
Le N, Sorensen J, Bui T, Choudhary A, Luu K, Nguyen H. Enhance Portable Radiograph for Fast and High Accurate COVID-19 Monitoring. Diagnostics (Basel) 2021; 11:1080. [PMID: 34204846 PMCID: PMC8231621 DOI: 10.3390/diagnostics11061080] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2021] [Revised: 06/03/2021] [Accepted: 06/07/2021] [Indexed: 12/24/2022] Open
Abstract
This work aimed to assist physicians by improving their speed and diagnostic accuracy when interpreting portable CXRs as well as monitoring the treatment process to see whether a patient is improving or deteriorating with treatment. These objectives are in especially high demand in the setting of the ongoing COVID-19 pandemic. With the recent progress in the development of artificial intelligence (AI), we introduce new deep learning frameworks to align and enhance the quality of portable CXRs to be more consistent, and to more closely match higher quality conventional CXRs. These enhanced portable CXRs can then help the doctors provide faster and more accurate diagnosis and treatment planning. The contributions of this work are four-fold. Firstly, a new database collection of subject-pair radiographs is introduced. For each subject, we collected a pair of samples from both portable and conventional machines. Secondly, a new deep learning approach is presented to align the subject-pairs dataset to obtain a pixel-pairs dataset. Thirdly, a new PairFlow approach is presented, an end-to-end invertible transfer deep learning method, to enhance the degraded quality of portable CXRs. Finally, the performance of the proposed system is evaluated by UAMS doctors in terms of both image quality and topological properties. This work was undertaken in collaboration with the Department of Radiology at the University of Arkansas for Medical Sciences (UAMS) to enhance portable/mobile COVID-19 CXRs, to improve the speed and accuracy of portable CXR images and aid in urgent COVID-19 diagnosis, monitoring and treatment.
Collapse
Affiliation(s)
- Ngan Le
- Department of CSCE, University of Arkansas, Fayetteville, AR 72701, USA;
| | - James Sorensen
- Department of Radiologist, University of Arkansas for Medical Sciences UAMS, Little Rock, AR 72205, USA; (J.S.); (A.C.)
| | - Toan Bui
- Vin-AI Research, Hanoi 100000, Vietnam;
| | - Arabinda Choudhary
- Department of Radiologist, University of Arkansas for Medical Sciences UAMS, Little Rock, AR 72205, USA; (J.S.); (A.C.)
| | - Khoa Luu
- Department of CSCE, University of Arkansas, Fayetteville, AR 72701, USA;
| | - Hien Nguyen
- Department of CSCE, University of Houston, Houston, TX 77204, USA;
| |
Collapse
|
45
|
Javan AAK, Jafari M, Shoeibi A, Zare A, Khodatars M, Ghassemi N, Alizadehsani R, Gorriz JM. Medical Images Encryption Based on Adaptive-Robust Multi-Mode Synchronization of Chen Hyper-Chaotic Systems. SENSORS (BASEL, SWITZERLAND) 2021; 21:3925. [PMID: 34200287 PMCID: PMC8200970 DOI: 10.3390/s21113925] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Revised: 06/01/2021] [Accepted: 06/02/2021] [Indexed: 01/03/2023]
Abstract
In this paper, a novel medical image encryption method based on multi-mode synchronization of hyper-chaotic systems is presented. The synchronization of hyper-chaotic systems is of great significance in secure communication tasks such as encryption of images. Multi-mode synchronization is a novel and highly complex issue, especially if there is uncertainty and disturbance. In this work, an adaptive-robust controller is designed for multimode synchronized chaotic systems with variable and unknown parameters, despite the bounded disturbance and uncertainty with a known function in two modes. In the first case, it is a main system with some response systems, and in the second case, it is a circular synchronization. Using theorems it is proved that the two synchronization methods are equivalent. Our results show that, we are able to obtain the convergence of synchronization error and parameter estimation error to zero using Lyapunov's method. The new laws to update time-varying parameters, estimating disturbance and uncertainty bounds are proposed such that stability of system is guaranteed. To assess the performance of the proposed synchronization method, various statistical analyzes were carried out on the encrypted medical images and standard benchmark images. The results show effective performance of the proposed synchronization technique in the medical images encryption for telemedicine application.
Collapse
Affiliation(s)
- Ali Akbar Kekha Javan
- Faculty of Electrical Engineering, Zabol Branch, Islamic Azad University, Zabol 1939598616, Iran;
| | - Mahboobeh Jafari
- Electrical and Computer Engineering Faculty, Semnan University, Semnan 3513119111, Iran;
| | - Afshin Shoeibi
- Faculty of Electrical Engineering, Biomedical Data Acquisition Lab (BDAL), K. N. Toosi University of Technology, Tehran 1631714191, Iran;
| | - Assef Zare
- Faculty of Electrical Engineering, Gonabad Branch, Islamic Azad University, Gonabad 6518115743, Iran
| | - Marjane Khodatars
- Faculty of Engineering, Mashhad Branch, Islamic Azad University, Mashhad 91735413, Iran;
| | - Navid Ghassemi
- Computer Engineering Department, Ferdowsi University of Mashhad, Mashhad 9177948974, Iran;
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Waurn Ponds, VIC 3217, Australia;
| | - Juan Manuel Gorriz
- Department of Signal Theory, Networking and Communications, Universidad de Granada, 52005 Granada, Spain;
| |
Collapse
|
46
|
Kadoya Y, Watanapongvanich S, Yuktadatta P, Putthinun P, Lartey ST, Khan MSR. Willing or Hesitant? A Socioeconomic Study on the Potential Acceptance of COVID-19 Vaccine in Japan. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:4864. [PMID: 34063327 PMCID: PMC8125588 DOI: 10.3390/ijerph18094864] [Citation(s) in RCA: 33] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/18/2021] [Revised: 04/29/2021] [Accepted: 04/30/2021] [Indexed: 12/22/2022]
Abstract
The worldwide COVID-19 vaccination program is already underway, raising hopes and aspirations to contain the spread of the COVID-19 pandemic that halted economic and social activities. However, the issue of vaccine effectiveness and its side-effects is influencing the potential acceptance of vaccines. In this uncertain situation, we used data from a nationwide survey in Japan during February 2021, following the Japanese government's initial phase of COVID-19 vaccination. Our results show that 47% of the respondents are willing to take a vaccine once it is available, while 22% are not willing and another 31% remain indecisive. Our ordered probit regression results show that demographic, socioeconomic, and behavioral variables such as gender, age, subjective health status, children, household income, household assets, financial literacy, future anxiety, and myopic view of the future are associated with willingness to take a COVID-19 vaccine. Our findings suggest that Japan's government should not adopt a one-size-fits-all policy to promote the vaccination program, but rather target people with specific socioeconomic backgrounds who are less willing and more hesitant to take a vaccine.
Collapse
Affiliation(s)
- Yoshihiko Kadoya
- School of Economics, Hiroshima University, Higashi-Hiroshima 739-8525, Japan; (Y.K.); (S.W.); (P.Y.); (P.P.)
| | - Somtip Watanapongvanich
- School of Economics, Hiroshima University, Higashi-Hiroshima 739-8525, Japan; (Y.K.); (S.W.); (P.Y.); (P.P.)
| | - Pattaphol Yuktadatta
- School of Economics, Hiroshima University, Higashi-Hiroshima 739-8525, Japan; (Y.K.); (S.W.); (P.Y.); (P.P.)
| | - Pongpat Putthinun
- School of Economics, Hiroshima University, Higashi-Hiroshima 739-8525, Japan; (Y.K.); (S.W.); (P.Y.); (P.P.)
| | - Stella T. Lartey
- Department of Epidemiology and Biostatistics, Indiana University School of Public Health, Bloomington, IN 47405, USA;
| | - Mostafa Saidur Rahim Khan
- School of Economics, Hiroshima University, Higashi-Hiroshima 739-8525, Japan; (Y.K.); (S.W.); (P.Y.); (P.P.)
| |
Collapse
|
47
|
CovidXrayNet: Optimizing data augmentation and CNN hyperparameters for improved COVID-19 detection from CXR. Comput Biol Med 2021; 133:104375. [PMID: 33866253 PMCID: PMC8048393 DOI: 10.1016/j.compbiomed.2021.104375] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2020] [Revised: 03/31/2021] [Accepted: 04/01/2021] [Indexed: 12/24/2022]
Abstract
To mitigate the spread of the current coronavirus disease 2019 (COVID-19) pandemic, it is crucial to have an effective screening of infected patients to be isolated and treated. Chest X-Ray (CXR) radiological imaging coupled with Artificial Intelligence (AI) applications, in particular Convolutional Neural Network (CNN), can speed the COVID-19 diagnostic process. In this paper, we optimize the data augmentation and the CNN hyperparameters for detecting COVID-19 from CXRs in terms of validation accuracy. This optimization increases the accuracy of the popular CNN architectures such as the Visual Geometry Group network (VGG-19) and the Residual Neural Network (ResNet-50), by 11.93% and 4.97%, respectively. We then proposed CovidXrayNet model that is based on EfficientNet-B0 and our optimization results. We evaluated CovidXrayNet on two datasets, including our generated balanced COVIDcxr dataset (960 CXRs) and the benchmark COVIDx dataset (15,496 CXRs). With only 30 epochs of training, CovidXrayNet achieves state-of-the-art accuracy of 95.82% on the COVIDx dataset in the three-class classification task (COVID-19, normal or pneumonia). The CovidXRayNet model, the COVIDcxr dataset, and several optimization experiments are publicly available at https://github.com/MaramMonshi/CovidXrayNet.
Collapse
|