151
|
Rangarajan AK, Ramachandran HK. A preliminary analysis of AI based smartphone application for diagnosis of COVID-19 using chest X-ray images. Expert Syst Appl 2021; 183:115401. [PMID: 34149202 PMCID: PMC8196480 DOI: 10.1016/j.eswa.2021.115401] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/19/2020] [Revised: 01/17/2021] [Accepted: 06/08/2021] [Indexed: 05/08/2023]
Abstract
The COVID-19 outbreak has catastrophically affected both public health system and world economy. Swift diagnosis of the positive cases will help in providing proper medical attention to the infected individuals and will also aid in effective tracing of their contacts to break the chain of transmission. Blending Artificial Intelligence (AI) with chest X-ray images and incorporating these models in a smartphone can be handy for the accelerated diagnosis of COVID-19. In this study, publicly available datasets of chest X-ray images have been utilized for training and testing of five pre-trained Convolutional Neural Network (CNN) models namely VGG16, MobileNetV2, Xception, NASNetMobile and InceptionResNetV2. Prior to the training of the selected models, the number of images in COVID-19 category has been increased employing traditional augmentation and Generative Adversarial Network (GAN). The performance of the five pre-trained CNN models utilizing the images generated with the two strategies has been compared. In the case of models trained using augmented images, Xception (98%) and MobileNetV2 (97.9%) turned out to be the ones with highest validation accuracy. Xception (98.1%) and VGG16 (98.6%) emerged as models with the highest validation accuracy in the models trained with synthetic GAN images. The best performing models have been further deployed in a smartphone and evaluated. The overall results suggest that VGG16 and Xception, trained with the synthetic images created using GAN, performed better compared to models trained with augmented images. Among these two models VGG16 produced an encouraging Diagnostic Odd Ratio (DOR) with higher positive likelihood and lower negative likelihood for the prediction of COVID-19.
Collapse
|
152
|
Yang M, Kumar P, Bhola J, Shabaz M. Development of image recognition software based on artificial intelligence algorithm for the efficient sorting of apple fruit. Int J Syst Assur Eng Manag 2021. [DOI: 10.1007/s13198-021-01415-1] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
|
153
|
Zhao W, Jiang W, Qiu X. Fine-Tuning Convolutional Neural Networks for COVID-19 Detection from Chest X-ray Images. Diagnostics (Basel) 2021; 11:1887. [PMID: 34679585 PMCID: PMC8535063 DOI: 10.3390/diagnostics11101887] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Revised: 09/30/2021] [Accepted: 10/10/2021] [Indexed: 12/24/2022] Open
Abstract
As the COVID-19 pandemic continues to ravage the world, the use of chest X-ray (CXR) images as a complementary screening strategy to reverse transcription-polymerase chain reaction (RT-PCR) testing continues to grow owing to its routine clinical application to respiratory diseases. We performed extensive convolutional neural network (CNN) fine-tuning experiments and identified that models pretrained on larger out-of-domain datasets show an improved performance. This suggests that a priori knowledge of models from out-of-field training should also apply to X-ray images. With appropriate hyperparameters selection, we found that higher resolution images carry more clinical information, and the use of mixup in training improved the performance of the model. The experimental showed that our proposed transfer learning present state-of-the-art results. Furthermore, we evaluated the performance of our model with a small amount of downstream training data and found that the model still performed well in COVID-19 identification. We also explored the mechanism of model detection using a gradient-weighted class activation mapping (Grad-CAM) method for CXR imaging to interpret the detection of radiology images. The results helped us understand how the model detects COVID-19, which can be used to discover new visual features and assist radiologists in screening.
Collapse
Affiliation(s)
- Wentao Zhao
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China; (W.Z.); (X.Q.)
- School of Intelligent Transportation, Zhejiang Institute of Mechanical & Electrical Engineering, Hangzhou 310053, China
| | - Wei Jiang
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China; (W.Z.); (X.Q.)
| | - Xinguo Qiu
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China; (W.Z.); (X.Q.)
| |
Collapse
|
154
|
Khan SH, Sohail A, Khan A, Hassan M, Lee YS, Alam J, Basit A, Zubair S. COVID-19 detection in chest X-ray images using deep boosted hybrid learning. Comput Biol Med 2021; 137:104816. [PMID: 34482199 PMCID: PMC8403339 DOI: 10.1016/j.compbiomed.2021.104816] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2021] [Revised: 08/16/2021] [Accepted: 08/26/2021] [Indexed: 12/24/2022]
Abstract
The new emerging COVID-19, declared a pandemic disease, has affected millions of human lives and caused a massive burden on healthcare centers. Therefore, a quick, accurate, and low-cost computer-based tool is required to timely detect and treat COVID-19 patients. In this work, two new deep learning frameworks: Deep Hybrid Learning (DHL) and Deep Boosted Hybrid Learning (DBHL), is proposed for effective COVID-19 detection in X-ray dataset. In the proposed DHL framework, the representation learning ability of the two developed COVID-RENet-1 & 2 models is exploited individually through a machine learning (ML) classifier. In COVID-RENet models, Region and Edge-based operations are carefully applied to learn region homogeneity and extract boundaries features. While in the case of the proposed DBHL framework, COVID-RENet-1 & 2 are fine-tuned using transfer learning on the chest X-rays. Furthermore, deep feature spaces are generated from the penultimate layers of the two models and then concatenated to get a single enriched boosted feature space. A conventional ML classifier exploits the enriched feature space to achieve better COVID-19 detection performance. The proposed COVID-19 detection frameworks are evaluated on radiologist's authenticated chest X-ray data, and their performance is compared with the well-established CNNs. It is observed through experiments that the proposed DBHL framework, which merges the two-deep CNN feature spaces, yields good performance (accuracy: 98.53%, sensitivity: 0.99, F-score: 0.98, and precision: 0.98). Furthermore, a web-based interface is developed, which takes only 5-10s to detect COVID-19 in each unseen chest X-ray image. This web-predictor is expected to help early diagnosis, save precious lives, and thus positively impact society.
Collapse
Affiliation(s)
- Saddam Hussain Khan
- Pattern Recognition Lab, Department of Computer & Information Sciences, Pakistan Institute of Engineering & Applied Sciences, Nilore, Islamabad, 45650, Pakistan; PIEAS Artificial Intelligence Center (PAIC), Pakistan Institute of Engineering & Applied Sciences, Nilore, Islamabad, 45650, Pakistan.
| | - Anabia Sohail
- Pattern Recognition Lab, Department of Computer & Information Sciences, Pakistan Institute of Engineering & Applied Sciences, Nilore, Islamabad, 45650, Pakistan; PIEAS Artificial Intelligence Center (PAIC), Pakistan Institute of Engineering & Applied Sciences, Nilore, Islamabad, 45650, Pakistan.
| | - Asifullah Khan
- Pattern Recognition Lab, Department of Computer & Information Sciences, Pakistan Institute of Engineering & Applied Sciences, Nilore, Islamabad, 45650, Pakistan; PIEAS Artificial Intelligence Center (PAIC), Pakistan Institute of Engineering & Applied Sciences, Nilore, Islamabad, 45650, Pakistan; Center for Mathematical Sciences, Pakistan Institute of Engineering & Applied Sciences, Nilore, Islamabad, 45650, Pakistan.
| | - Mehdi Hassan
- Department of Computer Science, Air University, Islamabad, Pakistan.
| | - Yeon Soo Lee
- Department of Biomedical Engineering, College of Medical Science, Catholic University of Daegu, South Korea.
| | | | - Abdul Basit
- TPD, Pakistan Institute of Nuclear Science and Technology, Nilore, Islamabad, 45650, Pakistan.
| | - Saima Zubair
- Islamabad Institute of Reproduce Medicine, Pakistan.
| |
Collapse
|
155
|
Fusco R, Grassi R, Granata V, Setola SV, Grassi F, Cozzi D, Pecori B, Izzo F, Petrillo A. Artificial Intelligence and COVID-19 Using Chest CT Scan and Chest X-ray Images: Machine Learning and Deep Learning Approaches for Diagnosis and Treatment. J Pers Med 2021; 11:993. [PMID: 34683133 PMCID: PMC8540782 DOI: 10.3390/jpm11100993] [Citation(s) in RCA: 41] [Impact Index Per Article: 13.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2021] [Revised: 09/22/2021] [Accepted: 09/28/2021] [Indexed: 12/26/2022] Open
Abstract
OBJECTIVE To report an overview and update on Artificial Intelligence (AI) and COVID-19 using chest Computed Tomography (CT) scan and chest X-ray images (CXR). Machine Learning and Deep Learning Approaches for Diagnosis and Treatment were identified. METHODS Several electronic datasets were analyzed. The search covered the years from January 2019 to June 2021. The inclusion criteria were studied evaluating the use of AI methods in COVID-19 disease reporting performance results in terms of accuracy or precision or area under Receiver Operating Characteristic (ROC) curve (AUC). RESULTS Twenty-two studies met the inclusion criteria: 13 papers were based on AI in CXR and 10 based on AI in CT. The summarized mean value of the accuracy and precision of CXR in COVID-19 disease were 93.7% ± 10.0% of standard deviation (range 68.4-99.9%) and 95.7% ± 7.1% of standard deviation (range 83.0-100.0%), respectively. The summarized mean value of the accuracy and specificity of CT in COVID-19 disease were 89.1% ± 7.3% of standard deviation (range 78.0-99.9%) and 94.5 ± 6.4% of standard deviation (range 86.0-100.0%), respectively. No statistically significant difference in summarized accuracy mean value between CXR and CT was observed using the Chi square test (p value > 0.05). CONCLUSIONS Summarized accuracy of the selected papers is high but there was an important variability; however, less in CT studies compared to CXR studies. Nonetheless, AI approaches could be used in the identification of disease clusters, monitoring of cases, prediction of the future outbreaks, mortality risk, COVID-19 diagnosis, and disease management.
Collapse
Affiliation(s)
- Roberta Fusco
- IGEA SpA Medical Division—Oncology, Via Casarea 65, Casalnuovo di Napoli, 80013 Naples, Italy;
| | - Roberta Grassi
- Division of Radiology, Università Degli Studi Della Campania Luigi Vanvitelli, 80138 Naples, Italy; (R.G.); (F.G.)
- Italian Society of Medical and Interventional Radiology (SIRM), SIRM Foundation, 20122 Milan, Italy
| | - Vincenza Granata
- Division of Radiology, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Naples, Italy; (S.V.S.); (A.P.)
| | - Sergio Venanzio Setola
- Division of Radiology, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Naples, Italy; (S.V.S.); (A.P.)
| | - Francesca Grassi
- Division of Radiology, Università Degli Studi Della Campania Luigi Vanvitelli, 80138 Naples, Italy; (R.G.); (F.G.)
| | - Diletta Cozzi
- Division of Radiology, Azienda Ospedaliera Universitaria Careggi, 50134 Florence, Italy;
| | - Biagio Pecori
- Division of Radiotherapy and Innovative Technologies, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Naples, Italy;
| | - Francesco Izzo
- Division of Hepatobiliary Surgery, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Naples, Italy;
| | - Antonella Petrillo
- Division of Radiology, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Naples, Italy; (S.V.S.); (A.P.)
| |
Collapse
|
156
|
Wu T, Tang C, Xu M, Hong N, Lei Z. ULNet for the detection of coronavirus (COVID-19) from chest X-ray images. Comput Biol Med 2021; 137:104834. [PMID: 34507159 PMCID: PMC8418052 DOI: 10.1016/j.compbiomed.2021.104834] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Revised: 08/27/2021] [Accepted: 08/31/2021] [Indexed: 12/21/2022]
Abstract
Novel coronavirus disease 2019 (COVID-19) is an infectious disease that spreads very rapidly and threatens the health of billions of people worldwide. With the number of cases increasing rapidly, most countries are facing the problem of a shortage of testing kits and resources, and it is necessary to use other diagnostic methods as an alternative to these test kits. In this paper, we propose a convolutional neural network (CNN) model (ULNet) to detect COVID-19 using chest X-ray images. The proposed architecture is constructed by adding a new downsampling side, skip connections and fully connected layers on the basis of U-net. Because the shape of the network is similar to UL, it is named ULNet. This model is trained and tested on a publicly available Kaggle dataset (consisting of a combination of 219 COVID-19, 1314 normal and 1345 viral pneumonia chest X-ray images), including binary classification (COVID-19 vs. Normal) and multiclass classification (COVID-19 vs. Normal vs. Viral Pneumonia). The accuracy of the proposed model in the detection of COVID-19 in the binary-class and multiclass tasks is 99.53% and 95.35%, respectively. Based on these promising results, this method is expected to help doctors diagnose and detect COVID-19. Overall, our ULNet provides a quick method for identifying patients with COVID-19, which is conducive to the control of the COVID-19 pandemic.
Collapse
Affiliation(s)
- Tianbo Wu
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China
| | - Chen Tang
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China.
| | - Min Xu
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China
| | - Nian Hong
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China
| | - Zhenkun Lei
- State Key Laboratory Analysis for Industrial Equipment, Dalian University of Technology, Dalian, 116024, China
| |
Collapse
|
157
|
Khasawneh N, Fraiwan M, Fraiwan L, Khassawneh B, Ibnian A. Detection of COVID-19 from Chest X-ray Images Using Deep Convolutional Neural Networks. Sensors (Basel) 2021; 21:5940. [PMID: 34502829 PMCID: PMC8434649 DOI: 10.3390/s21175940] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/29/2021] [Revised: 08/19/2021] [Accepted: 09/01/2021] [Indexed: 12/24/2022]
Abstract
The COVID-19 global pandemic has wreaked havoc on every aspect of our lives. More specifically, healthcare systems were greatly stretched to their limits and beyond. Advances in artificial intelligence have enabled the implementation of sophisticated applications that can meet clinical accuracy requirements. In this study, customized and pre-trained deep learning models based on convolutional neural networks were used to detect pneumonia caused by COVID-19 respiratory complications. Chest X-ray images from 368 confirmed COVID-19 patients were collected locally. In addition, data from three publicly available datasets were used. The performance was evaluated in four ways. First, the public dataset was used for training and testing. Second, data from the local and public sources were combined and used to train and test the models. Third, the public dataset was used to train the model and the local data were used for testing only. This approach adds greater credibility to the detection models and tests their ability to generalize to new data without overfitting the model to specific samples. Fourth, the combined data were used for training and the local dataset was used for testing. The results show a high detection accuracy of 98.7% with the combined dataset, and most models handled new data with an insignificant drop in accuracy.
Collapse
Affiliation(s)
- Natheer Khasawneh
- Department of Software Engineering, Jordan University of Science and Technology, P.O. Box 3030, Irbid 22110, Jordan
| | - Mohammad Fraiwan
- Department of Computer Engineering, Jordan University of Science and Technology, P.O. Box 3030, Irbid 22110, Jordan;
| | - Luay Fraiwan
- Department of Biomedical Engineering, Jordan University of Science and Technology, P.O. Box 3030, Irbid 22110, Jordan;
| | - Basheer Khassawneh
- Department of Internal Medicine, Jordan University of Science and Technology, P.O. Box 3030, Irbid 22110, Jordan; (B.K.); (A.I.)
| | - Ali Ibnian
- Department of Internal Medicine, Jordan University of Science and Technology, P.O. Box 3030, Irbid 22110, Jordan; (B.K.); (A.I.)
| |
Collapse
|
158
|
Erdaw Y, Tachbele E. Machine Learning Model Applied on Chest X-Ray Images Enables Automatic Detection of COVID-19 Cases with High Accuracy. Int J Gen Med 2021; 14:4923-4931. [PMID: 34483682 PMCID: PMC8409602 DOI: 10.2147/ijgm.s325609] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2021] [Accepted: 08/05/2021] [Indexed: 12/21/2022] Open
Abstract
PURPOSE This research was designed to investigate the application of artificial intelligence (AI) in the rapid and accurate diagnosis of coronavirus disease 2019 (COVID-19) using digital chest X-ray images, and to develop a robust computer-aided application for the automatic classification of COVID-19 pneumonia from other pneumonia and normal images. MATERIALS AND METHODS A total of 1100 chest X-ray images were randomly selected from three different open sources, containing 300 X-ray images of confirmed COVID-19 patients, 400 images of other pneumonia patients, and 400 normal X-ray images. In this study, a classical machine learning approach was employed. The model was built using the support vector machine (SVM) classifier algorithm. The SVM was trained by 630 features obtained from the HOG descriptor, which was quantized into 30 orientation bins in the range between 0 and 360. The model was validated using a 10-fold cross-validation method. The performance of the model was evaluated using appropriate classification metrics, including sensitivity, specificity, area under the curve, positive predictive value, negative predictive value, kappa, and accuracy. RESULTS The multi-level classification model was able to distinguish COVID-19 patients with a sensitivity of 97.92% and specificity of 98.91%, for the internal testing or cross-validation. For the independent external testing, the model showed sensitivity of 95% and specificity of 98.13%, for distinguishing COVID-19 from other pneumonia and no-findings. The binary classification model was able to distinguish COVID-19 patients with a sensitivity of 99.58% and specificity of 99.69%, for the internal testing. For the independent external testing, the model showed a sensitivity of 98.33% and specificity of 100%, for distinguishing COVID-19 from normal images. CONCLUSION The model can achieve the rapid and accurate identification of COVID-19 patients from chest X-rays with more than 97% accuracy. This high accuracy and very rapid computer-aided diagnostic approach would be very helpful to control the pandemic.
Collapse
Affiliation(s)
- Yabsera Erdaw
- Electrical and Mechanical Engineering, Addis Ababa Science & Technology University, Addis Ababa, Ethiopia
| | - Erdaw Tachbele
- Nursing & Midwifery, College of Health Sciences, Addis Ababa University, Addis Ababa, Ethiopia
| |
Collapse
|
159
|
Wang K, Khoo KS, Leong HY, Nagarajan D, Chew KW, Ting HY, Selvarajoo A, Chang JS, Show PL. How does the Internet of Things (IoT) help in microalgae biorefinery? Biotechnol Adv 2021;:107819. [PMID: 34454007 DOI: 10.1016/j.biotechadv.2021.107819] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2021] [Revised: 07/27/2021] [Accepted: 08/22/2021] [Indexed: 12/14/2022]
Abstract
Microalgae biorefinery is a platform for the conversion of microalgal biomass into a variety of value-added products, such as biofuels, bio-based chemicals, biomaterials, and bioactive substances. Commercialization and industrialization of microalgae biorefinery heavily rely on the capability and efficiency of large-scale cultivation of microalgae. Thus, there is an urgent need for novel technologies that can be used to monitor, automatically control, and precisely predict microalgae production. In light of this, innovative applications of the Internet of things (IoT) technologies in microalgae biorefinery have attracted tremendous research efforts. IoT has potential applications in a microalgae biorefinery for the automatic control of microalgae cultivation, monitoring and manipulation of microalgal cultivation parameters, optimization of microalgae productivity, identification of toxic algae species, screening of target microalgae species, classification of microalgae species, and viability detection of microalgal cells. In this critical review, cutting-edge IoT technologies that could be adopted to microalgae biorefinery in the upstream and downstream processing are described comprehensively. The current advances of the integration of IoT with microalgae biorefinery are presented. What this review discussed includes automation, sensors, lab-on-chip, and machine learning, which are the main constituent elements and advanced technologies of IoT. Specifically, future research directions are discussed with special emphasis on the development of sensors, the application of microfluidic technology, robotized microalgae, high-throughput platforms, deep learning, and other innovative techniques. This review could contribute greatly to the novelty and relevance in the field of IoT-based microalgae biorefinery to develop smarter, safer, cleaner, greener, and economically efficient techniques for exhaustive energy recovery during the biorefinery process.
Collapse
|
160
|
Ji D, Zhang Z, Zhao Y, Zhao Q. Research on Classification of COVID-19 Chest X-Ray Image Modal Feature Fusion Based on Deep Learning. J Healthc Eng 2021; 2021:6799202. [PMID: 34457220 PMCID: PMC8387167 DOI: 10.1155/2021/6799202] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Revised: 07/07/2021] [Accepted: 08/13/2021] [Indexed: 01/15/2023]
Abstract
Most detection methods of coronavirus disease 2019 (COVID-19) use classic image classification models, which have problems of low recognition accuracy and inaccurate capture of modal features when detecting chest X-rays of COVID-19. This study proposes a COVID-19 detection method based on image modal feature fusion. This method first performs small-sample enhancement processing on chest X-rays, such as rotation, translation, and random transformation. Five classic pretraining models are used when extracting modal features. A global average pooling layer reduces training parameters and prevents overfitting. The model is trained and fine-tuned, the machine learning evaluation standard is used to evaluate the model, and the receiver operating characteristic (ROC) curve is drawn. Experiments show that compared with the classic model, the classification method in this study can more effectively detect COVID-19 image modal information, and it achieves the expected effect of accurately detecting cases.
Collapse
Affiliation(s)
- Dongsheng Ji
- School of Computer and Communication, Lanzhou University of Technology, Lanzhou 730000, China
| | - Zhujun Zhang
- School of Computer and Communication, Lanzhou University of Technology, Lanzhou 730000, China
| | - Yanzhong Zhao
- School of Computer and Communication, Lanzhou University of Technology, Lanzhou 730000, China
| | - Qianchuan Zhao
- School of Computer and Communication, Lanzhou University of Technology, Lanzhou 730000, China
- Center for Intelligent and Networked Systems (CFINS), Department of Automation, Tsinghua University, Beijing 100084, China
| |
Collapse
|
161
|
Ghaderzadeh M, Aria M, Asadi F. X-Ray Equipped with Artificial Intelligence: Changing the COVID-19 Diagnostic Paradigm during the Pandemic. Biomed Res Int 2021; 2021:9942873. [PMID: 34458373 PMCID: PMC8390162 DOI: 10.1155/2021/9942873] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/23/2021] [Revised: 06/16/2021] [Accepted: 08/04/2021] [Indexed: 12/16/2022]
Abstract
PURPOSE Due to the excessive use of raw materials in diagnostic tools and equipment during the COVID-19 pandemic, there is a dire need for cheaper and more effective methods in the healthcare system. With the development of artificial intelligence (AI) methods in medical sciences as low-cost and safer diagnostic methods, researchers have turned their attention to the use of imaging tools with AI that have fewer complications for patients and reduce the consumption of healthcare resources. Despite its limitations, X-ray is suggested as the first-line diagnostic modality for detecting and screening COVID-19 cases. METHOD This systematic review assessed the current state of AI applications and the performance of algorithms in X-ray image analysis. The search strategy yielded 322 results from four databases and google scholar, 60 of which met the inclusion criteria. The performance statistics included the area under the receiver operating characteristics (AUC) curve, accuracy, sensitivity, and specificity. RESULT The average sensitivity and specificity of CXR equipped with AI algorithms for COVID-19 diagnosis were >96% (83%-100%) and 92% (80%-100%), respectively. For common X-ray methods in COVID-19 detection, these values were 0.56 (95% CI 0.51-0.60) and 0.60 (95% CI 0.54-0.65), respectively. AI has substantially improved the diagnostic performance of X-rays in COVID-19. CONCLUSION X-rays equipped with AI can serve as a tool to screen the cases requiring CT scans. The use of this tool does not waste time or impose extra costs, has minimal complications, and can thus decrease or remove unnecessary CT slices and other healthcare resources.
Collapse
Affiliation(s)
- Mustafa Ghaderzadeh
- Student Research Committee, Department and Faculty of Health Information Technology and Ma School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Mehrad Aria
- Department of Computer Engineering, Faculty of Electrical and Computer Engineering, Shiraz University, Shiraz, Iran
| | - Farkhondeh Asadi
- Department of Health Information Technology and Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| |
Collapse
|
162
|
Hernandez-Cruz N, Cato D, Favela J. Neural Style Transfer as Data Augmentation for Improving COVID-19 Diagnosis Classification. SN Comput Sci 2021; 2:410. [PMID: 34405153 PMCID: PMC8361825 DOI: 10.1007/s42979-021-00795-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/01/2020] [Accepted: 07/25/2021] [Indexed: 12/31/2022]
Abstract
Coronavirus disease 2019 (COVID-19) has accounted for millions of causalities. While it affects not only individuals but also our collective healthcare and economic systems, testing is insufficient and costly hampering efforts to deal with the pandemic. Chest X-rays are routine radiographic imaging tests that are used for the diagnosis of respiratory conditions such as pneumonia and COVID-19. Convolutional neural networks have shown promise to be effective at classifying X-rays for assisting diagnosis of conditions; however, achieving robust performance demanded in most modern medical applications typically requires a large number of samples. While there exist datasets containing thousands of X-ray images of patients with healthy and pneumonia diagnoses, because COVID-19 is such a recent phenomenon, there are relatively few confirmed COVID-19 positive chest X-rays openly available to the research community. In this paper, we demonstrate the effectiveness of cycle-generative adversarial network, commonly used for neural style transfer, as a way to augment COVID-19 negative X-ray images to look like COVID-19 positive images for increasing the number of COVID-19 positive training samples. The statistical results show an increase in the mean macro f1-score over 21% on a one-tailed t score = 2.68 and p value = 0.01 to accept our alternative hypothesis for an α = 0.05 . We conclude that this approach, when used in conjunction with standard transfer learning techniques, is effective at improving the performance of COVID-19 classifiers for a variety of common convolutional neural networks.
Collapse
Affiliation(s)
| | - David Cato
- Independent Researcher, London, England, UK
| | | |
Collapse
|
163
|
Ren R, Zhang S, Sun H, Gao T. Research on Pepper External Quality Detection Based on Transfer Learning Integrated with Convolutional Neural Network. Sensors (Basel) 2021; 21:5305. [PMID: 34450747 DOI: 10.3390/s21165305] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Revised: 07/31/2021] [Accepted: 08/04/2021] [Indexed: 12/14/2022]
Abstract
A pepper quality detection and classification model based on transfer learning combined with convolutional neural network is proposed as a solution for low efficiency of manual pepper sorting at the current stage. The pepper dataset was amplified with data pre-processing methods including rotation, luminance switch, and contrast ratio switch. To improve training speed and precision, a network model was optimized with a fine-tuned VGG 16 model in this research, transfer learning was applied after parameter optimization, and comparative analysis was performed by combining ResNet50, MobileNet V2, and GoogLeNet models. It turned out that the VGG 16 model output anticipation precision was 98.14%, and the prediction loss rate was 0.0669 when the dropout was settled as 0.3, learning rate settled as 0.000001, batch normalization added, and ReLU as activation function. Comparing with other finetune models and network models, this model was of better anticipation performance, as well as faster and more stable convergence rate, which embodied the best performance. Considering the basis of transfer learning and integration with strong generalization and fitting capacity of the VGG 16 finetune model, it is feasible to apply this model to the external quality classification of pepper, thus offering technical reference for further realizing the automatic classification of pepper quality.
Collapse
|
164
|
Al-shargabi AA, Alshobaili JF, Alabdulatif A, Alrobah N. COVID-CGAN: Efficient Deep Learning Approach for COVID-19 Detection Based on CXR Images Using Conditional GANs. Applied Sciences 2021; 11:7174. [DOI: 10.3390/app11167174] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
COVID-19, a novel coronavirus infectious disease, has spread around the world, resulting in a large number of deaths. Due to a lack of physicians, emergency facilities, and equipment, medical systems have been unable to treat all patients in many countries. Deep learning is a promising approach for providing solutions to COVID-19 based on patients’ medical images. As COVID-19 is a new disease, its related dataset is still being collected and published. Small COVID-19 datasets may not be sufficient to build powerful deep learning detection models. Such models are often over-fitted, and their prediction results cannot be generalized. To fill this gap, we propose a deep learning approach for accurately detecting COVID-19 cases based on chest X-ray (CXR) images. For the proposed approach, named COVID-CGAN, we first generated a larger dataset using generative adversarial networks (GANs). Specifically, a customized conditional GAN (CGAN) was designed to generate the target COVID-19 CXR images. The expanded dataset, which contains 84.8% generated images and 15.2% original images, was then used for training five deep detection models: InceptionResNetV2, Xception, SqueezeNet, VGG16, and AlexNet. The results show that the use of the synthetic CXR images, which were generated by the customized CGAN, helped all deep learning models to achieve high detection accuracies. In particular, the highest accuracy was achieved by the InceptionResNetV2 model, which was 99.72% accurate with only ten epochs. All five models achieved kappa coefficients between 0.81 and 1, which is interpreted as an almost perfect agreement between the actual labels and the detected labels. Furthermore, the experiment showed that some models were faster yet smaller compared to the others but could still achieve high accuracy. For instance, SqueezeNet, which is a small network, required only three minutes and achieved comparable accuracy to larger networks such as InceptionResNetV2, which needed about 143 min. Our proposed approach can be applied to other fields with scarce datasets.
Collapse
|
165
|
Martín J, Tena N, Asuero AG. Current state of diagnostic, screening and surveillance testing methods for COVID-19 from an analytical chemistry point of view. Microchem J 2021; 167:106305. [PMID: 33897053 PMCID: PMC8054532 DOI: 10.1016/j.microc.2021.106305] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Revised: 04/12/2021] [Accepted: 04/14/2021] [Indexed: 12/18/2022]
Abstract
Since December 2019, we have been in the battlefield with a new threat to the humanity known as severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). In this review, we describe the four main methods used for diagnosis, screening and/or surveillance of SARS-CoV-2: Real-time reverse transcription polymerase chain reaction (RT-PCR); chest computed tomography (CT); and different complementary alternatives developed in order to obtain rapid results, antigen and antibody detection. All of them compare the highlighting advantages and disadvantages from an analytical point of view. The gold standard method in terms of sensitivity and specificity is the RT-PCR. The different modifications propose to make it more rapid and applicable at point of care (POC) are also presented and discussed. CT images are limited to central hospitals. However, being combined with RT-PCR is the most robust and accurate way to confirm COVID-19 infection. Antibody tests, although unable to provide reliable results on the status of the infection, are suitable for carrying out maximum screening of the population in order to know the immune capacity. More recently, antigen tests, less sensitive than RT-PCR, have been authorized to determine in a quicker way whether the patient is infected at the time of analysis and without the need of specific instruments.
Collapse
Key Words
- 2019-nCoV, 2019 novel coronavirus
- ACE2, Angiotensin-Converting Enzyme 2
- AI, Artificial Intelligence
- ALP, Alkaline Phosphatase
- ASOs, Antisense Oligonucleotides
- Antigen and antibody tests
- AuNIs, Gold Nanoislands
- AuNPs, Gold Nanoparticles
- BSL, Biosecurity Level
- CAP, College of American Pathologists
- CCD, Charge-Coupled Device
- CG, Colloidal Gold
- CGIA, Colloidal Gold Immunochromatographic Assay
- CLIA, Chemiluminescence Enzyme Immunoassay
- CLIA, Clinical Laboratory Improvement Amendments
- COVID-19
- COVID-19, Coronavirus disease-19
- CRISPR, Clustered Regularly Interspaced Short Palindromic Repeats
- CT, Chest Computed Tomography
- Cas, CRISPR Associate Protein
- China CDC, Chinese Center for Disease Control and Prevention
- Ct, Cycle Threshold
- DETECTR, SARS-CoV-2 DNA Endonuclease-Targeted CRISPR Trans Reporter
- DNA, Dexosyrosyribonucleic Acid
- E, Envelope protein
- ELISA, Enzyme Linked Immunosorbent Assay
- EMA, European Medicines Agency
- EUA, Emergence Use Authorization
- FDA, Food and Drug Administration
- FET, Field-Effect Transistor
- GISAID, Global Initiative on Sharing All Influenza Data
- GeneBank, Genetic sequence data base of the National Institute of Health
- ICTV, International Committee on Taxonomy of Viruses
- IgA, Immunoglobulins A
- IgG, Immunoglobulins G
- IgM, Immunoglobulins M
- IoMT, Internet of Medical Things
- IoT, Internet of Things
- LFIA, Lateral Flow Immunochromatographic Assays
- LOC, Lab-on-a-Chip
- LOD, Limit of detection
- LSPR, Localized Surface Plasmon Resonance
- M, Membrane protein
- MERS-CoV, Middle East Respiratory Syndrome Coronavirus
- MNP, Magnetic Nanoparticle
- MS, Mass spectrometry
- N, Nucleocapsid protein
- NER, Naked Eye Readout
- NGM, Next Generation Molecular
- NGS, Next Generation Sequencing
- NIH, National Institute of Health
- NSPs, Nonstructural Proteins
- Net, Neural Network
- ORF, Open Reading Frame
- OSN, One Step Single-tube Nested
- PDMS, Polydimethylsiloxane
- POC, Point of Care
- PPT, Plasmonic Photothermal
- QD, Quantum Dot
- R0, Basic reproductive number
- RBD, Receptor-binding domain
- RNA, Ribonucleic Acid
- RNaseH, Ribonuclease H
- RT, Reverse Transcriptase
- RT-LAMP, Reverse Transcription Loop-Mediated Isothermal Amplification
- RT-PCR, Real-Time Reverse Transcription Polymerase Chain Reaction
- RT-PCR, chest computerized tomography
- RdRp, RNA-Dependent RNA Polymerase
- S, Spike protein
- SARS-CoV-2
- SARS-CoV-2, Severe Acute Respiratory Syndrome Coronavirus 2
- SERS, Surface Enhanced Raman Spectroscopy
- SHERLOCK, Specific High Sensitivity Enzymatic Reporter UnLOCKing
- STOPCovid, SHERLOCK Testing on One Pot
- SVM, Support Vector Machine
- SiO2@Ag, Complete silver nanoparticle shell coated on silica core
- US CDC, US Centers for Disease Control and Prevention
- VOC, Variant of Concern
- VTM, Viral Transport Medium
- WGS, Whole Genome Sequencing
- WHO, World Health Organization
- aM, Attomolar
- dNTPs, Nucleotides
- dPCR, Digital PCR
- ddPCR, Droplet digital PCR
- fM, Femtomolar
- m-RNA, Messenger Ribonucleic Acid
- nM, Nanomolar
- pM, Picomolar
- pfu, Plaque-forming unit
- rN, Recombinant nucleocapsid protein antigen
- rS, Recombinant Spike protein antigen
- ssRNA, Single-Stranded Positive-Sense RNA
Collapse
Affiliation(s)
- Julia Martín
- Departamento de Química Analítica, Escuela Politécnica Superior, Universidad de Sevilla, C/ Virgen de África 7, Sevilla E-41011, Spain
| | - Noelia Tena
- Departamento de Química Analítica, Facultad de Farmacia, Universidad de Sevilla, Prof. García González, 2, Sevilla 41012, Spain
| | - Agustin G Asuero
- Departamento de Química Analítica, Facultad de Farmacia, Universidad de Sevilla, Prof. García González, 2, Sevilla 41012, Spain
| |
Collapse
|
166
|
Hafeez MA, Rashid M, Tariq H, Abideen ZU, Alotaibi SS, Sinky MH. Performance Improvement of Decision Tree: A Robust Classifier Using Tabu Search Algorithm. Applied Sciences 2021; 11:6728. [DOI: 10.3390/app11156728] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
Classification and regression are the major applications of machine learning algorithms which are widely used to solve problems in numerous domains of engineering and computer science. Different classifiers based on the optimization of the decision tree have been proposed, however, it is still evolving over time. This paper presents a novel and robust classifier based on a decision tree and tabu search algorithms, respectively. In the aim of improving performance, our proposed algorithm constructs multiple decision trees while employing a tabu search algorithm to consistently monitor the leaf and decision nodes in the corresponding decision trees. Additionally, the used tabu search algorithm is responsible to balance the entropy of the corresponding decision trees. For training the model, we used the clinical data of COVID-19 patients to predict whether a patient is suffering. The experimental results were obtained using our proposed classifier based on the built-in sci-kit learn library in Python. The extensive analysis for the performance comparison was presented using Big O and statistical analysis for conventional supervised machine learning algorithms. Moreover, the performance comparison to optimized state-of-the-art classifiers is also presented. The achieved accuracy of 98%, the required execution time of 55.6 ms and the area under receiver operating characteristic (AUROC) for proposed method of 0.95 reveals that the proposed classifier algorithm is convenient for large datasets.
Collapse
|
167
|
Yousefi B, Kawakita S, Amini A, Akbari H, Advani SM, Akhloufi M, Maldague XPV, Ahadian S. Impartially Validated Multiple Deep-Chain Models to Detect COVID-19 in Chest X-ray Using Latent Space Radiomics. J Clin Med 2021; 10:3100. [PMID: 34300266 PMCID: PMC8304336 DOI: 10.3390/jcm10143100] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2021] [Revised: 07/01/2021] [Accepted: 07/07/2021] [Indexed: 12/31/2022] Open
Abstract
The COVID-19 pandemic continues to spread globally at a rapid pace, and its rapid detection remains a challenge due to its rapid infectivity and limited testing availability. One of the simply available imaging modalities in clinical routine involves chest X-ray (CXR), which is often used for diagnostic purposes. Here, we proposed a computer-aided detection of COVID-19 in CXR imaging using deep and conventional radiomic features. First, we used a 2D U-Net model to segment the lung lobes. Then, we extracted deep latent space radiomics by applying deep convolutional autoencoder (ConvAE) with internal dense layers to extract low-dimensional deep radiomics. We used Johnson-Lindenstrauss (JL) lemma, Laplacian scoring (LS), and principal component analysis (PCA) to reduce dimensionality in conventional radiomics. The generated low-dimensional deep and conventional radiomics were integrated to classify COVID-19 from pneumonia and healthy patients. We used 704 CXR images for training the entire model (i.e., U-Net, ConvAE, and feature selection in conventional radiomics). Afterward, we independently validated the whole system using a study cohort of 1597 cases. We trained and tested a random forest model for detecting COVID-19 cases through multivariate binary-class and multiclass classification. The maximal (full multivariate) model using a combination of the two radiomic groups yields performance in classification cross-validated accuracy of 72.6% (69.4-74.4%) for multiclass and 89.6% (88.4-90.7%) for binary-class classification.
Collapse
Affiliation(s)
- Bardia Yousefi
- Department of Electrical and Computer Engineering, Laval University, Quebec City, QC G1V 0A6, Canada
| | - Satoru Kawakita
- Terasaki Institute for Biomedical Innovation, Los Angeles, CA 90024, USA; (S.K.); (S.M.A.)
| | - Arya Amini
- Department of Radiation Oncology, City of Hope Comprehensive Cancer Center, Duarte, CA 91010, USA;
| | - Hamed Akbari
- Department of Radiology, University of Pennsylvania, Philadelphia, PA 19104, USA;
| | - Shailesh M. Advani
- Terasaki Institute for Biomedical Innovation, Los Angeles, CA 90024, USA; (S.K.); (S.M.A.)
| | - Moulay Akhloufi
- Department of Computer Science, Perception Robotics and Intelligent Machines (PRIME) Research Group, University of Moncton, New Brunswick, NB E1A 3E9, Canada;
| | - Xavier P. V. Maldague
- Department of Electrical and Computer Engineering, Laval University, Quebec City, QC G1V 0A6, Canada
| | - Samad Ahadian
- Terasaki Institute for Biomedical Innovation, Los Angeles, CA 90024, USA; (S.K.); (S.M.A.)
| |
Collapse
|
168
|
Dogan O, Tiwari S, Jabbar MA, Guggari S. A systematic review on AI/ML approaches against COVID-19 outbreak. COMPLEX INTELL SYST 2021; 7:2655-2678. [PMID: 34777970 PMCID: PMC8256231 DOI: 10.1007/s40747-021-00424-8] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Accepted: 06/05/2021] [Indexed: 12/24/2022]
Abstract
A pandemic disease, COVID-19, has caused trouble worldwide by infecting millions of people. The studies that apply artificial intelligence (AI) and machine learning (ML) methods for various purposes against the COVID-19 outbreak have increased because of their significant advantages. Although AI/ML applications provide satisfactory solutions to COVID-19 disease, these solutions can have a wide diversity. This increase in the number of AI/ML studies and diversity in solutions can confuse deciding which AI/ML technique is suitable for which COVID-19 purposes. Because there is no comprehensive review study, this study systematically analyzes and summarizes related studies. A research methodology has been proposed to conduct the systematic literature review for framing the research questions, searching criteria and relevant data extraction. Finally, 264 studies were taken into account after following inclusion and exclusion criteria. This research can be regarded as a key element for epidemic and transmission prediction, diagnosis and detection, and drug/vaccine development. Six research questions are explored with 50 AI/ML approaches in COVID-19, 8 AI/ML methods for patient outcome prediction, 14 AI/ML techniques in disease predictions, along with five AI/ML methods for risk assessment of COVID-19. It also covers AI/ML method in drug development, vaccines for COVID-19, models in COVID-19, datasets and their usage and dataset applications with AI/ML.
Collapse
Affiliation(s)
- Onur Dogan
- Department of Industrial Engineering, Izmir Bakircay University, 35665 Izmir, Turkey.,Research Center for Data Analytics and Spatial Data Modeling (RC-DAS), Izmir Bakircay University, 35665 Izmir, Turkey
| | - Sanju Tiwari
- Department of Computer Science, Universidad Autonoma de Tamaulipas, Ciudad Victoria, Mexico
| | - M A Jabbar
- Vardhaman College of Engineering, Kacharam, India
| | | |
Collapse
|
169
|
Affiliation(s)
- Jin Sun
- College of Mechanical Engineering Yangzhou University Yangzhou China
- Joint International Research Laboratory of Agriculture and Agri‐Product Safety, The Ministry of Education of China Yangzhou University Yangzhou China
- Department of Informatics University of Leicester Leicester UK
| | - Yang Zhang
- College of Mechanical Engineering Yangzhou University Yangzhou China
- Joint International Research Laboratory of Agriculture and Agri‐Product Safety, The Ministry of Education of China Yangzhou University Yangzhou China
| | - Xinglong Zhu
- College of Mechanical Engineering Yangzhou University Yangzhou China
- Joint International Research Laboratory of Agriculture and Agri‐Product Safety, The Ministry of Education of China Yangzhou University Yangzhou China
| | - Yu‐Dong Zhang
- Department of Informatics University of Leicester Leicester UK
| |
Collapse
|
170
|
Nguyen D, Kay F, Tan J, Yan Y, Ng YS, Iyengar P, Peshock R, Jiang S. Deep Learning-Based COVID-19 Pneumonia Classification Using Chest CT Images: Model Generalizability. Front Artif Intell 2021; 4:694875. [PMID: 34268489 PMCID: PMC8275994 DOI: 10.3389/frai.2021.694875] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2021] [Accepted: 06/02/2021] [Indexed: 01/08/2023] Open
Abstract
Since the outbreak of the COVID-19 pandemic, worldwide research efforts have focused on using artificial intelligence (AI) technologies on various medical data of COVID-19-positive patients in order to identify or classify various aspects of the disease, with promising reported results. However, concerns have been raised over their generalizability, given the heterogeneous factors in training datasets. This study aims to examine the severity of this problem by evaluating deep learning (DL) classification models trained to identify COVID-19-positive patients on 3D computed tomography (CT) datasets from different countries. We collected one dataset at UT Southwestern (UTSW) and three external datasets from different countries: CC-CCII Dataset (China), COVID-CTset (Iran), and MosMedData (Russia). We divided the data into two classes: COVID-19-positive and COVID-19-negative patients. We trained nine identical DL-based classification models by using combinations of datasets with a 72% train, 8% validation, and 20% test data split. The models trained on a single dataset achieved accuracy/area under the receiver operating characteristic curve (AUC) values of 0.87/0.826 (UTSW), 0.97/0.988 (CC-CCCI), and 0.86/0.873 (COVID-CTset) when evaluated on their own dataset. The models trained on multiple datasets and evaluated on a test set from one of the datasets used for training performed better. However, the performance dropped close to an AUC of 0.5 (random guess) for all models when evaluated on a different dataset outside of its training datasets. Including MosMedData, which only contained positive labels, into the training datasets did not necessarily help the performance of other datasets. Multiple factors likely contributed to these results, such as patient demographics and differences in image acquisition or reconstruction, causing a data shift among different study cohorts.
Collapse
Affiliation(s)
- Dan Nguyen
- Medical Artificial Intelligence and Automation (MAIA) Laboratory, University of Texas Southwestern Medical Center, Dallas, TX, United States
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX, United States
| | - Fernando Kay
- Department of Radiology, University of Texas Southwestern Medical Center, Dallas, TX, United States
| | - Jun Tan
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX, United States
| | - Yulong Yan
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX, United States
| | - Yee Seng Ng
- Department of Radiology, University of Texas Southwestern Medical Center, Dallas, TX, United States
| | - Puneeth Iyengar
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX, United States
| | - Ron Peshock
- Department of Radiology, University of Texas Southwestern Medical Center, Dallas, TX, United States
| | - Steve Jiang
- Medical Artificial Intelligence and Automation (MAIA) Laboratory, University of Texas Southwestern Medical Center, Dallas, TX, United States
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX, United States
| |
Collapse
|
171
|
El-Rashidy N, Abdelrazik S, Abuhmed T, Amer E, Ali F, Hu JW, El-Sappagh S. Comprehensive Survey of Using Machine Learning in the COVID-19 Pandemic. Diagnostics (Basel) 2021; 11:1155. [PMID: 34202587 PMCID: PMC8303306 DOI: 10.3390/diagnostics11071155] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2021] [Revised: 05/29/2021] [Accepted: 05/31/2021] [Indexed: 12/11/2022] Open
Abstract
Since December 2019, the global health population has faced the rapid spreading of coronavirus disease (COVID-19). With the incremental acceleration of the number of infected cases, the World Health Organization (WHO) has reported COVID-19 as an epidemic that puts a heavy burden on healthcare sectors in almost every country. The potential of artificial intelligence (AI) in this context is difficult to ignore. AI companies have been racing to develop innovative tools that contribute to arm the world against this pandemic and minimize the disruption that it may cause. The main objective of this study is to survey the decisive role of AI as a technology used to fight against the COVID-19 pandemic. Five significant applications of AI for COVID-19 were found, including (1) COVID-19 diagnosis using various data types (e.g., images, sound, and text); (2) estimation of the possible future spread of the disease based on the current confirmed cases; (3) association between COVID-19 infection and patient characteristics; (4) vaccine development and drug interaction; and (5) development of supporting applications. This study also introduces a comparison between current COVID-19 datasets. Based on the limitations of the current literature, this review highlights the open research challenges that could inspire the future application of AI in COVID-19.
Collapse
Affiliation(s)
- Nora El-Rashidy
- Machine Learning and Information Retrieval Department, Faculty of Artificial Intelligence, Kafrelsheiksh University, Kafrelsheiksh 13518, Egypt
| | - Samir Abdelrazik
- Information System Department, Faculty of Computer Science and Information Systems, Mansoura University, Mansoura 13518, Egypt;
| | - Tamer Abuhmed
- College of Computing and Informatics, Sungkyunkwan University, Seoul 03063, Korea
| | - Eslam Amer
- Faculty of Computer Science, Misr International University, Cairo 11828, Egypt;
| | - Farman Ali
- Department of Software, Sejong University, Seoul 05006, Korea;
| | - Jong-Wan Hu
- Department of Civil and Environmental Engineering, Incheon National University, Incheon 22012, Korea
| | - Shaker El-Sappagh
- Centro Singular de Investigación en Tecnoloxías Intelixentes (CiTIUS), Universidade de Santiago de Compostela, 15782 Santiago de Compostela, Spain
- Information Systems Department, Faculty of Computers and Artificial Intelligence, Benha University, Banha 13518, Egypt
| |
Collapse
|
172
|
Hassan SM, Maji AK, Jasiński M, Leonowicz Z, Jasińska E. Identification of Plant-Leaf Diseases Using CNN and Transfer-Learning Approach. Electronics 2021; 10:1388. [DOI: 10.3390/electronics10121388] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The timely identification and early prevention of crop diseases are essential for improving production. In this paper, deep convolutional-neural-network (CNN) models are implemented to identify and diagnose diseases in plants from their leaves, since CNNs have achieved impressive results in the field of machine vision. Standard CNN models require a large number of parameters and higher computation cost. In this paper, we replaced standard convolution with depth=separable convolution, which reduces the parameter number and computation cost. The implemented models were trained with an open dataset consisting of 14 different plant species, and 38 different categorical disease classes and healthy plant leaves. To evaluate the performance of the models, different parameters such as batch size, dropout, and different numbers of epochs were incorporated. The implemented models achieved a disease-classification accuracy rates of 98.42%, 99.11%, 97.02%, and 99.56% using InceptionV3, InceptionResNetV2, MobileNetV2, and EfficientNetB0, respectively, which were greater than that of traditional handcrafted-feature-based approaches. In comparison with other deep-learning models, the implemented model achieved better performance in terms of accuracy and it required less training time. Moreover, the MobileNetV2 architecture is compatible with mobile devices using the optimized parameter. The accuracy results in the identification of diseases showed that the deep CNN model is promising and can greatly impact the efficient identification of the diseases, and may have potential in the detection of diseases in real-time agricultural systems.
Collapse
|
173
|
Rasheed J, Jamil A, Hameed AA, Al-Turjman F, Rasheed A. COVID-19 in the Age of Artificial Intelligence: A Comprehensive Review. Interdiscip Sci 2021; 13:153-175. [PMID: 33886097 PMCID: PMC8060789 DOI: 10.1007/s12539-021-00431-w] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2020] [Revised: 04/03/2021] [Accepted: 04/09/2021] [Indexed: 12/23/2022]
Abstract
The recent COVID-19 pandemic, which broke at the end of the year 2019 in Wuhan, China, has infected more than 98.52 million people by today (January 23, 2021) with over 2.11 million deaths across the globe. To combat the growing pandemic on urgent basis, there is need to design effective solutions using new techniques that could exploit recent technology, such as machine learning, deep learning, big data, artificial intelligence, Internet of Things, for identification and tracking of COVID-19 cases in near real time. These technologies have offered inexpensive and rapid solution for proper screening, analyzing, prediction and tracking of COVID-19 positive cases. In this paper, a detailed review of the role of AI as a decisive tool for prognosis, analyze, and tracking the COVID-19 cases is performed. We searched various databases including Google Scholar, IEEE Library, Scopus and Web of Science using a combination of different keywords consisting of COVID-19 and AI. We have identified various applications, where AI can help healthcare practitioners in the process of identification and monitoring of COVID-19 cases. A compact summary of the corona virus cases are first highlighted, followed by the application of AI. Finally, we conclude the paper by highlighting new research directions and discuss the research challenges. Even though scientists and researchers have gathered and exchanged sufficient knowledge over last couple of months, but this structured review also examined technological perspectives while encompassing the medical aspect to help the healthcare practitioners, policymakers, decision makers, policymakers, AI scientists and virologists to quell this infectious COVID-19 pandemic outbreak.
Collapse
Affiliation(s)
- Jawad Rasheed
- Department of Computer Engineering, Istanbul Aydin University, Istanbul, 34295, Turkey.
| | - Akhtar Jamil
- Department of Computer Engineering, Istanbul Sabahattin Zaim University, Istanbul, 34303, Turkey
| | - Alaa Ali Hameed
- Department of Computer Engineering, Istanbul Sabahattin Zaim University, Istanbul, 34303, Turkey
| | - Fadi Al-Turjman
- Artificial Intelligence Engineering Department, Research Center for AI and IoT, Near East University, Nicosia, Mersin 10, Turkey
| | - Ahmad Rasheed
- Department of Electrical and Electronics Engineering, Eastern Mediterranean University, Famagusta, Mersin 10, Turkey
| |
Collapse
|
174
|
Sethy PK, Panigrahi M, Vijayakumar K, Behera SK. Machine learning based classification of EEG signal for detection of child epileptic seizure without snipping. Int J Speech Technol 2021. [DOI: 10.1007/s10772-021-09855-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/16/2021] [Accepted: 05/21/2021] [Indexed: 08/02/2023]
|
175
|
M. Bahgat W, Magdy Balaha H, AbdulAzeem Y, Badawy MM. An optimized transfer learning-based approach for automatic diagnosis of COVID-19 from chest x-ray images. PeerJ Comput Sci 2021; 7:e555. [PMID: 34141886 PMCID: PMC8176553 DOI: 10.7717/peerj-cs.555] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2021] [Accepted: 04/29/2021] [Indexed: 05/09/2023]
Abstract
Accurate and fast detection of COVID-19 patients is crucial to control this pandemic. Due to the scarcity of COVID-19 testing kits, especially in developing countries, there is a crucial need to rely on alternative diagnosis methods. Deep learning architectures built on image modalities can speed up the COVID-19 pneumonia classification from other types of pneumonia. The transfer learning approach is better suited to automatically detect COVID-19 cases due to the limited availability of medical images. This paper introduces an Optimized Transfer Learning-based Approach for Automatic Detection of COVID-19 (OTLD-COVID-19) that applies an optimization algorithm to twelve CNN architectures to diagnose COVID-19 cases using chest x-ray images. The OTLD-COVID-19 approach adapts Manta-Ray Foraging Optimization (MRFO) algorithm to optimize the network hyperparameters' values of the CNN architectures to improve their classification performance. The proposed dataset is collected from eight different public datasets to classify 4-class cases (COVID-19, pneumonia bacterial, pneumonia viral, and normal). The experimental result showed that DenseNet121 optimized architecture achieves the best performance. The evaluation results based on Loss, Accuracy, F1-score, Precision, Recall, Specificity, AUC, Sensitivity, IoU, and Dice values reached 0.0523, 98.47%, 0.9849, 98.50%, 98.47%, 99.50%, 0.9983, 0.9847, 0.9860, and 0.9879 respectively.
Collapse
Affiliation(s)
- Waleed M. Bahgat
- Information Technology Department, Faculty of Computer and Information, Mansoura University, Mansoura, Egypt
| | - Hossam Magdy Balaha
- Computers and Systems Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| | - Yousry AbdulAzeem
- Computer Engineering Department, Misr Higher Institute for Engineering and Technology, Mansoura, Egypt
| | - Mahmoud M. Badawy
- Computers and Systems Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| |
Collapse
|
176
|
Kumar V, Singh D, Kaur M, Damaševičius R. Overview of current state of research on the application of artificial intelligence techniques for COVID-19. PeerJ Comput Sci 2021; 7:e564. [PMID: 34141890 PMCID: PMC8176528 DOI: 10.7717/peerj-cs.564] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2020] [Accepted: 05/05/2021] [Indexed: 05/09/2023]
Abstract
BACKGROUND Until now, there are still a limited number of resources available to predict and diagnose COVID-19 disease. The design of novel drug-drug interaction for COVID-19 patients is an open area of research. Also, the development of the COVID-19 rapid testing kits is still a challenging task. METHODOLOGY This review focuses on two prime challenges caused by urgent needs to effectively address the challenges of the COVID-19 pandemic, i.e., the development of COVID-19 classification tools and drug discovery models for COVID-19 infected patients with the help of artificial intelligence (AI) based techniques such as machine learning and deep learning models. RESULTS In this paper, various AI-based techniques are studied and evaluated by the means of applying these techniques for the prediction and diagnosis of COVID-19 disease. This study provides recommendations for future research and facilitates knowledge collection and formation on the application of the AI techniques for dealing with the COVID-19 epidemic and its consequences. CONCLUSIONS The AI techniques can be an effective tool to tackle the epidemic caused by COVID-19. These may be utilized in four main fields such as prediction, diagnosis, drug design, and analyzing social implications for COVID-19 infected patients.
Collapse
Affiliation(s)
- Vijay Kumar
- Computer Science and Engineering Department, National Institute of Technology, Hamirpur, Himachal Pradesh, India
| | - Dilbag Singh
- School of Engineering and Applied Sciences, Bennett University, Greater Noida, India
| | - Manjit Kaur
- School of Engineering and Applied Sciences, Bennett University, Greater Noida, India
| | - Robertas Damaševičius
- Faculty of Applied Mathematics, Silesian University of Technology, Gliwice, Poland
- Department of Applied Informatics, Vytautas Magnus University, Kaunas, Lithuania
| |
Collapse
|
177
|
Behera SK, Rath AK, Sethy PK. Fruits yield estimation using Faster R-CNN with MIoU. Multimed Tools Appl 2021; 80:19043-19056. [DOI: 10.1007/s11042-021-10704-7] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/29/2020] [Revised: 01/04/2021] [Accepted: 02/10/2021] [Indexed: 08/02/2023]
|
178
|
Elbishlawi S, Abdelpakey MH, Shehata MS, Mohamed MM. CORONA-Net: Diagnosing COVID-19 from X-ray Images Using Re-Initialization and Classification Networks. J Imaging 2021; 7:81. [PMID: 34460677 DOI: 10.3390/jimaging7050081] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2021] [Revised: 04/21/2021] [Accepted: 04/22/2021] [Indexed: 12/24/2022] Open
Abstract
The COVID-19 pandemic has been deemed a global health pandemic. The early detection of COVID-19 is key to combating its outbreak and could help bring this pandemic to an end. One of the biggest challenges in combating COVID-19 is accurate testing for the disease. Utilizing the power of Convolutional Neural Networks (CNNs) to detect COVID-19 from chest X-ray images can help radiologists compare and validate their results with an automated system. In this paper, we propose a carefully designed network, dubbed CORONA-Net, that can accurately detect COVID-19 from chest X-ray images. CORONA-Net is divided into two phases: (1) The reinitialization phase and (2) the classification phase. In the reinitialization phase, the network consists of encoder and decoder networks. The objective of this phase is to train and initialize the encoder and decoder networks by a distribution that comes out of medical images. In the classification phase, the decoder network is removed from CORONA-Net, and the encoder network acts as a backbone network to fine-tune the classification phase based on the learned weights from the reinitialization phase. Extensive experiments were performed on a publicly available dataset, COVIDx, and the results show that CORONA-Net significantly outperforms the current state-of-the-art networks with an overall accuracy of 95.84%.
Collapse
|
179
|
Rehman A, Iqbal MA, Xing H, Ahmed I. COVID-19 Detection Empowered with Machine Learning and Deep Learning Techniques: A Systematic Review. Applied Sciences 2021; 11:3414. [DOI: 10.3390/app11083414] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
COVID-19 has infected 223 countries and caused 2.8 million deaths worldwide (at the time of writing this article), and the death rate is increasing continuously. Early diagnosis of COVID patients is a critical challenge for medical practitioners, governments, organizations, and countries to overcome the rapid spread of the deadly virus in any geographical area. In this situation, the previous epidemic evidence on Machine Learning (ML) and Deep Learning (DL) techniques encouraged the researchers to play a significant role in detecting COVID-19. Similarly, the rising scope of ML/DL methodologies in the medical domain also advocates its significant role in COVID-19 detection. This systematic review presents ML and DL techniques practiced in this era to predict, diagnose, classify, and detect the coronavirus. In this study, the data was retrieved from three prevalent full-text archives, i.e., Science Direct, Web of Science, and PubMed, using the search code strategy on 16 March 2021. Using professional assessment, among 961 articles retrieved by an initial query, only 40 articles focusing on ML/DL-based COVID-19 detection schemes were selected. Findings have been presented as a country-wise distribution of publications, article frequency, various data collection, analyzed datasets, sample sizes, and applied ML/DL techniques. Precisely, this study reveals that ML/DL technique accuracy lay between 80% to 100% when detecting COVID-19. The RT-PCR-based model with Support Vector Machine (SVM) exhibited the lowest accuracy (80%), whereas the X-ray-based model achieved the highest accuracy (99.7%) using a deep convolutional neural network. However, current studies have shown that an anal swab test is super accurate to detect the virus. Moreover, this review addresses the limitations of COVID-19 detection along with the detailed discussion of the prevailing challenges and future research directions, which eventually highlight outstanding issues.
Collapse
|
180
|
Bari BS, Islam MN, Rashid M, Hasan MJ, Razman MAM, Musa RM, Ab Nasir AF, P.P. Abdul Majeed A. A real-time approach of diagnosing rice leaf disease using deep learning-based faster R-CNN framework. PeerJ Comput Sci 2021; 7:e432. [PMID: 33954231 PMCID: PMC8049121 DOI: 10.7717/peerj-cs.432] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2020] [Accepted: 02/17/2021] [Indexed: 05/25/2023]
Abstract
The rice leaves related diseases often pose threats to the sustainable production of rice affecting many farmers around the world. Early diagnosis and appropriate remedy of the rice leaf infection is crucial in facilitating healthy growth of the rice plants to ensure adequate supply and food security to the rapidly increasing population. Therefore, machine-driven disease diagnosis systems could mitigate the limitations of the conventional methods for leaf disease diagnosis techniques that is often time-consuming, inaccurate, and expensive. Nowadays, computer-assisted rice leaf disease diagnosis systems are becoming very popular. However, several limitations ranging from strong image backgrounds, vague symptoms' edge, dissimilarity in the image capturing weather, lack of real field rice leaf image data, variation in symptoms from the same infection, multiple infections producing similar symptoms, and lack of efficient real-time system mar the efficacy of the system and its usage. To mitigate the aforesaid problems, a faster region-based convolutional neural network (Faster R-CNN) was employed for the real-time detection of rice leaf diseases in the present research. The Faster R-CNN algorithm introduces advanced RPN architecture that addresses the object location very precisely to generate candidate regions. The robustness of the Faster R-CNN model is enhanced by training the model with publicly available online and own real-field rice leaf datasets. The proposed deep-learning-based approach was observed to be effective in the automatic diagnosis of three discriminative rice leaf diseases including rice blast, brown spot, and hispa with an accuracy of 98.09%, 98.85%, and 99.17% respectively. Moreover, the model was able to identify a healthy rice leaf with an accuracy of 99.25%. The results obtained herein demonstrated that the Faster R-CNN model offers a high-performing rice leaf infection identification system that could diagnose the most common rice diseases more precisely in real-time.
Collapse
Affiliation(s)
- Bifta Sama Bari
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Pahang, Malaysia
| | - Md Nahidul Islam
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Pahang, Malaysia
| | - Mamunur Rashid
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Pahang, Malaysia
| | - Md Jahid Hasan
- Innovative Manufacturing, Mechatronics and Sports Laboratory, Faculty of Manufacturing and Mechatronic Engineering Technology, Universiti Malaysia Pahang, Pekan, Pahang, Malaysia
| | - Mohd Azraai Mohd Razman
- Innovative Manufacturing, Mechatronics and Sports Laboratory, Faculty of Manufacturing and Mechatronic Engineering Technology, Universiti Malaysia Pahang, Pekan, Pahang, Malaysia
| | - Rabiu Muazu Musa
- Centre for Fundamental and Continuing Education, Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia
| | - Ahmad Fakhri Ab Nasir
- Innovative Manufacturing, Mechatronics and Sports Laboratory, Faculty of Manufacturing and Mechatronic Engineering Technology, Universiti Malaysia Pahang, Pekan, Pahang, Malaysia
- Centre for Software Development & Integrated Computing, Universiti Malaysia Pahang, Pahang Darul Makmur, Pekan, Malaysia
| | - Anwar P.P. Abdul Majeed
- Innovative Manufacturing, Mechatronics and Sports Laboratory, Faculty of Manufacturing and Mechatronic Engineering Technology, Universiti Malaysia Pahang, Pekan, Pahang, Malaysia
- Centre for Software Development & Integrated Computing, Universiti Malaysia Pahang, Pahang Darul Makmur, Pekan, Malaysia
| |
Collapse
|
181
|
Mohammad-Rahimi H, Nadimi M, Ghalyanchi-Langeroudi A, Taheri M, Ghafouri-Fard S. Application of Machine Learning in Diagnosis of COVID-19 Through X-Ray and CT Images: A Scoping Review. Front Cardiovasc Med 2021; 8:638011. [PMID: 33842563 PMCID: PMC8027078 DOI: 10.3389/fcvm.2021.638011] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2021] [Accepted: 02/23/2021] [Indexed: 12/15/2022] Open
Abstract
Coronavirus disease, first detected in late 2019 (COVID-19), has spread fast throughout the world, leading to high mortality. This condition can be diagnosed using RT-PCR technique on nasopharyngeal and throat swabs with sensitivity values ranging from 30 to 70%. However, chest CT scans and X-ray images have been reported to have sensitivity values of 98 and 69%, respectively. The application of machine learning methods on CT and X-ray images has facilitated the accurate diagnosis of COVID-19. In this study, we reviewed studies which used machine and deep learning methods on chest X-ray images and CT scans for COVID-19 diagnosis and compared their performance. The accuracy of these methods ranged from 76% to more than 99%, indicating the applicability of machine and deep learning methods in the clinical diagnosis of COVID-19.
Collapse
Affiliation(s)
- Hossein Mohammad-Rahimi
- Dental Research Center, Research Institute of Dental Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Mohadeseh Nadimi
- Department of Medical Physics and Biomedical Engineering, Tehran University of Medical Sciences (TUMS), Tehran, Iran
- Research Center for Biomedical Technologies and Robotics (RCBTR), Tehran, Iran
| | - Azadeh Ghalyanchi-Langeroudi
- Department of Medical Physics and Biomedical Engineering, Tehran University of Medical Sciences (TUMS), Tehran, Iran
- Research Center for Biomedical Technologies and Robotics (RCBTR), Tehran, Iran
| | - Mohammad Taheri
- Urology and Nephrology Research Center, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Soudeh Ghafouri-Fard
- Department of Medical Genetics, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| |
Collapse
|
182
|
Ghaderzadeh M, Asadi F. Deep Learning in the Detection and Diagnosis of COVID-19 Using Radiology Modalities: A Systematic Review. J Healthc Eng 2021; 2021:6677314. [PMID: 33747419 PMCID: PMC7958142 DOI: 10.1155/2021/6677314] [Citation(s) in RCA: 37] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 01/08/2021] [Accepted: 02/11/2021] [Indexed: 12/17/2022]
Abstract
Introduction The early detection and diagnosis of COVID-19 and the accurate separation of non-COVID-19 cases at the lowest cost and in the early stages of the disease are among the main challenges in the current COVID-19 pandemic. Concerning the novelty of the disease, diagnostic methods based on radiological images suffer from shortcomings despite their many applications in diagnostic centers. Accordingly, medical and computer researchers tend to use machine-learning models to analyze radiology images. Material and Methods. The present systematic review was conducted by searching the three databases of PubMed, Scopus, and Web of Science from November 1, 2019, to July 20, 2020, based on a search strategy. A total of 168 articles were extracted and, by applying the inclusion and exclusion criteria, 37 articles were selected as the research population. Result This review study provides an overview of the current state of all models for the detection and diagnosis of COVID-19 through radiology modalities and their processing based on deep learning. According to the findings, deep learning-based models have an extraordinary capacity to offer an accurate and efficient system for the detection and diagnosis of COVID-19, the use of which in the processing of modalities would lead to a significant increase in sensitivity and specificity values. Conclusion The application of deep learning in the field of COVID-19 radiologic image processing reduces false-positive and negative errors in the detection and diagnosis of this disease and offers a unique opportunity to provide fast, cheap, and safe diagnostic services to patients.
Collapse
Affiliation(s)
- Mustafa Ghaderzadeh
- Student Research Committee, Department and Faculty of Health Information Technology and Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Farkhondeh Asadi
- Department of Health Information Technology and Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| |
Collapse
|
183
|
Sethy PK, Behera SK, Kannan N, Narayanan S, Pandey C. Smart paddy field monitoring system using deep learning and IoT. Concurrent Engineering 2021; 29:16-24. [DOI: 10.1177/1063293x21988944] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/02/2023]
Abstract
Paddy is an essential nutrient worldwide. Rice gives 21% of worldwide human per capita energy and 15% of per capita protein. Asia represented 60% of the worldwide populace, about 92% of the world’s rice creation, and 90% of worldwide rice utilization. With the increase in population, the demand for rice is increased. So, the productivity of farming is needed to be enhanced by introducing new technology. Deep learning and IoT are hot topics for research in various fields. This paper suggested a setup comprising deep learning and IoT for monitoring of paddy field remotely. The vgg16 pre-trained network is considered for the identification of paddy leaf diseases and nitrogen status estimation. Here, two strategies are carried out to identify images: transfer learning and deep feature extraction. The deep feature extraction approach is combined with a support vector machine (SVM) to classify images. The transfer learning approach of vgg16 for identifying four types of leaf diseases and prediction of nitrogen status results in 79.86% and 84.88% accuracy. Again, the deep features of Vgg16 and SVM results for identifying four types of leaf diseases and prediction of nitrogen status have achieved an accuracy of 97.31% and 99.02%, respectively. Besides, a framework is suggested for monitoring of paddy field remotely based on IoT and deep learning. The suggested prototype’s superiority is that it controls temperature and humidity like the state-of-the-art and can monitor the additional two aspects, such as detecting nitrogen status and diseases.
Collapse
Affiliation(s)
| | - Santi Kumari Behera
- Department of Computer Science and Engineering, Veer Surendra Surendra Sai University of Technology, Burla, Odisha, India
| | | | | | - Chanki Pandey
- Department of Electronics and Communication Engineering, GEC Jagdalpur, CG, India
| |
Collapse
|
184
|
Garillos-Manliguez CA, Chiang JY. Multimodal Deep Learning and Visible-Light and Hyperspectral Imaging for Fruit Maturity Estimation. Sensors (Basel) 2021; 21:s21041288. [PMID: 33670232 PMCID: PMC7916978 DOI: 10.3390/s21041288] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/01/2021] [Revised: 01/29/2021] [Accepted: 02/08/2021] [Indexed: 11/16/2022]
Abstract
Fruit maturity is a critical factor in the supply chain, consumer preference, and agriculture industry. Most classification methods on fruit maturity identify only two classes: ripe and unripe, but this paper estimates six maturity stages of papaya fruit. Deep learning architectures have gained respect and brought breakthroughs in unimodal processing. This paper suggests a novel non-destructive and multimodal classification using deep convolutional neural networks that estimate fruit maturity by feature concatenation of data acquired from two imaging modes: visible-light and hyperspectral imaging systems. Morphological changes in the sample fruits can be easily measured with RGB images, while spectral signatures that provide high sensitivity and high correlation with the internal properties of fruits can be extracted from hyperspectral images with wavelength range in between 400 nm and 900 nm—factors that must be considered when building a model. This study further modified the architectures: AlexNet, VGG16, VGG19, ResNet50, ResNeXt50, MobileNet, and MobileNetV2 to utilize multimodal data cubes composed of RGB and hyperspectral data for sensitivity analyses. These multimodal variants can achieve up to 0.90 F1 scores and 1.45% top-2 error rate for the classification of six stages. Overall, taking advantage of multimodal input coupled with powerful deep convolutional neural network models can classify fruit maturity even at refined levels of six stages. This indicates that multimodal deep learning architectures and multimodal imaging have great potential for real-time in-field fruit maturity estimation that can help estimate optimal harvest time and other in-field industrial applications.
Collapse
Affiliation(s)
- Cinmayii A. Garillos-Manliguez
- Department of Computer Science and Engineering, National Sun Yat-sen University, Kaohsiung 804, Taiwan;
- Department of Mathematics, Physics, and Computer Science, University of the Philippines Mindanao, Davao City 8000, Philippines
| | - John Y. Chiang
- Department of Computer Science and Engineering, National Sun Yat-sen University, Kaohsiung 804, Taiwan;
- Department of Healthcare Administration and Medical Informatics, Kaohsiung Medical University, Kaohsiung 804, Taiwan
- Correspondence:
| |
Collapse
|
185
|
Silva JCS, de Lima Silva DF, Delgado Neto ADS, Ferraz A, Melo JL, Ferreira Júnior NR, de Almeida Filho AT. A city cluster risk-based approach for Sars-CoV-2 and isolation barriers based on anonymized mobile phone users' location data. Sustain Cities Soc 2021; 65:102574. [PMID: 33178556 PMCID: PMC7644257 DOI: 10.1016/j.scs.2020.102574] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Revised: 10/22/2020] [Accepted: 10/23/2020] [Indexed: 05/04/2023]
Abstract
Given the recent outbreak of Sars-CoV-2, several countries started to seek different strategies to control contamination and minimize fatalities, which are usually the primary objectives for all strategies. Secondary objectives are related to economic factors, therefore ensuring that society would be able is to keep its essential activities and avoid supply disruptions. This paper presents an application of anonymized mobile phone users' location data to estimate population flow amongst cities with an origin-destination matrix. The work includes a clustering analysis of cities, which may enable policymakers (and epidemiologists) to develop public policies giving the appropriate consideration for each set of cities within a Province or State. Risk measures are included to analyze the severity of the spread among the clusters, which can be ranked. Then, intelligence can be obtained from the analysis, and some clusters could be isolated to avoid contagion while keeping their economic activities. Therefore, this analysis is reproducible for other states of Brazil and other countries and can be adapted for districts within a city, especially considering the possibility of a second wave COVID-19 pandemic.
Collapse
|
186
|
Sethy PK, Behera SK, Anitha K, Pandey C, Khan MR. Computer aid screening of COVID-19 using X-ray and CT scan images: An inner comparison. J Xray Sci Technol 2021; 29:197-210. [PMID: 33492267 DOI: 10.3233/xst-200784] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
The objective of this study is to conduct a critical analysis to investigate and compare a group of computer aid screening methods of COVID-19 using chest X-ray images and computed tomography (CT) images. The computer aid screening method includes deep feature extraction, transfer learning, and machine learning image classification approach. The deep feature extraction and transfer learning method considered 13 pre-trained CNN models. The machine learning approach includes three sets of handcrafted features and three classifiers. The pre-trained CNN models include AlexNet, GoogleNet, VGG16, VGG19, Densenet201, Resnet18, Resnet50, Resnet101, Inceptionv3, Inceptionresnetv2, Xception, MobileNetv2 and ShuffleNet. The handcrafted features are GLCM, LBP & HOG, and machine learning based classifiers are KNN, SVM & Naive Bayes. In addition, the different paradigms of classifiers are also analyzed. Overall, the comparative analysis is carried out in 65 classification models, i.e., 13 in deep feature extraction, 13 in transfer learning, and 39 in the machine learning approaches. Finally, all classification models perform better when applying to the chest X-ray image set as comparing to the use of CT scan image set. Among 65 classification models, the VGG19 with SVM achieved the highest accuracy of 99.81%when applying to the chest X-ray images. In conclusion, the findings of this analysis study are beneficial for the researchers who are working towards designing computer aid tools for screening COVID-19 infection diseases.
Collapse
Affiliation(s)
| | | | - Komma Anitha
- Department of Electronics and Communication Engineering, Prasad V Potluri Siddhartha Institute of Technology, Vijayawada, Andrapradesh, India
| | - Chanki Pandey
- Department of Electronics and Telecommunication Engineering, GEC, Jagdalpur, CG, India
| | - M R Khan
- Department of Electronics and Telecommunication Engineering, GEC, Jagdalpur, CG, India
| |
Collapse
|
187
|
Madaan V, Roy A, Gupta C, Agrawal P, Sharma A, Bologa C, Prodan R. XCOVNet: Chest X-ray Image Classification for COVID-19 Early Detection Using Convolutional Neural Networks. New Gener Comput 2021; 39:583-597. [PMID: 33642663 PMCID: PMC7903219 DOI: 10.1007/s00354-021-00121-7] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/05/2020] [Accepted: 01/26/2021] [Indexed: 05/06/2023]
Abstract
COVID-19 (also known as SARS-COV-2) pandemic has spread in the entire world. It is a contagious disease that easily spreads from one person in direct contact to another, classified by experts in five categories: asymptomatic, mild, moderate, severe, and critical. Already more than 66 million people got infected worldwide with more than 22 million active patients as of 5 December 2020 and the rate is accelerating. More than 1.5 million patients (approximately 2.5% of total reported cases) across the world lost their life. In many places, the COVID-19 detection takes place through reverse transcription polymerase chain reaction (RT-PCR) tests which may take longer than 48 h. This is one major reason of its severity and rapid spread. We propose in this paper a two-phase X-ray image classification called XCOVNet for early COVID-19 detection using convolutional neural Networks model. XCOVNet detects COVID-19 infections in chest X-ray patient images in two phases. The first phase pre-processes a dataset of 392 chest X-ray images of which half are COVID-19 positive and half are negative. The second phase trains and tunes the neural network model to achieve a 98.44% accuracy in patient classification.
Collapse
Affiliation(s)
- Vishu Madaan
- Lovely Professional University, Phagwara, Punjab India
| | - Aditya Roy
- Lovely Professional University, Phagwara, Punjab India
| | - Charu Gupta
- Bhagwan Parshuram Institute of Technology, New Delhi, India
| | - Prateek Agrawal
- Lovely Professional University, Phagwara, Punjab India
- University of Klagenfurt, Klagenfurt, Austria
| | - Anand Sharma
- Mody University of Science and Technology, Laxmangarh, Rajasthan India
| | | | - Radu Prodan
- University of Klagenfurt, Klagenfurt, Austria
| |
Collapse
|
188
|
Arpaci I, Huang S, Al-Emran M, Al-Kabi MN, Peng M. Predicting the COVID-19 infection with fourteen clinical features using machine learning classification algorithms. Multimed Tools Appl 2021; 80:11943-11957. [PMID: 33437173 PMCID: PMC7790521 DOI: 10.1007/s11042-020-10340-7] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/21/2020] [Revised: 10/23/2020] [Accepted: 12/22/2020] [Indexed: 05/07/2023]
Abstract
While the RT-PCR is the silver bullet test for confirming the COVID-19 infection, it is limited by the lack of reagents, time-consuming, and the need for specialized labs. As an alternative, most of the prior studies have focused on Chest CT images and Chest X-Ray images using deep learning algorithms. However, these two approaches cannot always be used for patients' screening due to the radiation doses, high costs, and the low number of available devices. Hence, there is a need for a less expensive and faster diagnostic model to identify the positive and negative cases of COVID-19. Therefore, this study develops six predictive models for COVID-19 diagnosis using six different classifiers (i.e., BayesNet, Logistic, IBk, CR, PART, and J48) based on 14 clinical features. This study retrospected 114 cases from the Taizhou hospital of Zhejiang Province in China. The results showed that the CR meta-classifier is the most accurate classifier for predicting the positive and negative COVID-19 cases with an accuracy of 84.21%. The results could help in the early diagnosis of COVID-19, specifically when the RT-PCR kits are not sufficient for testing the infection and assist countries, specifically the developing ones that suffer from the shortage of RT-PCR tests and specialized laboratories.
Collapse
Affiliation(s)
- Ibrahim Arpaci
- Department of Computer Education and Instructional Technology, Tokat Gaziosmanpasa University, Tokat, Turkey
| | - Shigao Huang
- Cancer Centre, Institute of Translational Medicine, Faculty of Health Sciences, University of Macau, Taipa, Macao SAR China
| | - Mostafa Al-Emran
- Faculty of Engineering & IT, The British University in Dubai, Dubai, UAE
| | - Mohammed N. Al-Kabi
- Department of Information Technology, Al Buraimi University College, Al Buraimi, Oman
| | - Minfei Peng
- Zhejiang Taizhou Hospital, Wenzhou Medical University, Taizhou, China
| |
Collapse
|
189
|
A survey of machine learning techniques for detecting and diagnosing COVID-19 from imaging. Quant Biol 2021; 0:0. [DOI: 10.15302/j-qb-021-0274] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
190
|
Autee P, Bagwe S, Shah V, Srivastava K. StackNet-DenVIS: a multi-layer perceptron stacked ensembling approach for COVID-19 detection using X-ray images. Phys Eng Sci Med 2020; 43:1399-1414. [PMID: 33275187 PMCID: PMC7715648 DOI: 10.1007/s13246-020-00952-6] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2020] [Accepted: 11/21/2020] [Indexed: 12/20/2022]
Abstract
The highly contagious nature of Coronavirus disease 2019 (Covid-19) resulted in a global pandemic. Due to the relatively slow and taxing nature of conventional testing for Covid-19, a faster method needs to be in place. The current researches have suggested that visible irregularities found in the chest X-ray of Covid-19 positive patients are indicative of the presence of the disease. Hence, Deep Learning and Image Classification techniques can be employed to learn from these irregularities, and classify accordingly with high accuracy. This research presents an approach to create a classifier model named StackNet-DenVIS which is designed to act as a screening process before conducting the existing swab tests. Using a novel approach, which incorporates Transfer Learning and Stacked Generalization, the model aims to lower the False Negative rate of classification compensating for the 30% False Negative rate of the swab tests. A dataset gathered from multiple reliable sources consisting of 9953 Chest X-rays (868 Covid and 9085 Non-Covid) was used. Also, this research demonstrates handling data imbalance using various techniques involving Generative Adversarial Networks and sampling techniques. The accuracy, sensitivity, and specificity obtained on our proposed model were 95.07%, 99.40% and 94.61% respectively. To the best of our knowledge, the combination of accuracy and false negative rate obtained by this paper outperforms the current implementations. We must also highlight that our proposed architecture also considers other types of viral pneumonia. Given the unprecedented sensitivity of our model we are optimistic it contributes to a better Covid-19 detection.
Collapse
Affiliation(s)
- Pratik Autee
- Department of Computer Engineering, Dwarkadas J. Sanghvi College of Engineering, Mumbai, India
| | - Sagar Bagwe
- Department of Computer Engineering, Dwarkadas J. Sanghvi College of Engineering, Mumbai, India
| | - Vimal Shah
- Department of Computer Engineering, Dwarkadas J. Sanghvi College of Engineering, Mumbai, India
- A/602, Venkatesh Pooja, Balaji Complex, 150 Feet Road, Bhayander (West), Thane, Maharashtra 401101 India
| | - Kriti Srivastava
- Department of Computer Engineering, Dwarkadas J. Sanghvi College of Engineering, Mumbai, India
| |
Collapse
|
191
|
Rasheed J, Jamil A, Hameed AA, Aftab U, Aftab J, Shah SA, Draheim D. A survey on artificial intelligence approaches in supporting frontline workers and decision makers for the COVID-19 pandemic. Chaos Solitons Fractals 2020; 141:110337. [PMID: 33071481 PMCID: PMC7547637 DOI: 10.1016/j.chaos.2020.110337] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Accepted: 10/01/2020] [Indexed: 05/04/2023]
Abstract
While the world has experience with many different types of infectious diseases, the current crisis related to the spread of COVID-19 has challenged epidemiologists and public health experts alike, leading to a rapid search for, and development of, new and innovative solutions to combat its spread. The transmission of this virus has infected more than 18.92 million people as of August 6, 2020, with over half a million deaths across the globe; the World Health Organization (WHO) has declared this a global pandemic. A multidisciplinary approach needs to be followed for diagnosis, treatment and tracking, especially between medical and computer sciences, so, a common ground is available to facilitate the research work at a faster pace. With this in mind, this survey paper aimed to explore and understand how and which different technological tools and techniques have been used within the context of COVID-19. The primary contribution of this paper is in its collation of the current state-of-the-art technological approaches applied to the context of COVID-19, and doing this in a holistic way, covering multiple disciplines and different perspectives. The analysis is widened by investigating Artificial Intelligence (AI) approaches for the diagnosis, anticipate infection and mortality rate by tracing contacts and targeted drug designing. Moreover, the impact of different kinds of medical data used in diagnosis, prognosis and pandemic analysis is also provided. This review paper covers both medical and technological perspectives to facilitate the virologists, AI researchers and policymakers while in combating the COVID-19 outbreak.
Collapse
Affiliation(s)
- Jawad Rasheed
- Department of Computer Engineering, Istanbul Sabahattin Zaim University, Istanbul 34303, Turkey
| | - Akhtar Jamil
- Department of Computer Engineering, Istanbul Sabahattin Zaim University, Istanbul 34303, Turkey
| | - Alaa Ali Hameed
- Department of Computer Engineering, Istanbul Sabahattin Zaim University, Istanbul 34303, Turkey
| | - Usman Aftab
- Department of Pharmacology, University of Health Sciences, Lahore 54700, Pakistan
| | - Javaria Aftab
- Department of Chemistry, Istanbul Technical University, Istanbul 34467, Turkey
| | - Syed Attique Shah
- Department of IT, Balochistan University of Information Technology, Engineering and Management Sciences, Quetta 87300, Pakistan
| | - Dirk Draheim
- Information Systems Group, Tallinn University of Technology, Akadeemia tee 15a, 12618, Tallinn, Estonia
| |
Collapse
|
192
|
Islam MN, Inan TT, Rafi S, Akter SS, Sarker IH, Islam AKMN. A Systematic Review on the Use of AI and ML for Fighting the COVID-19 Pandemic. IEEE Trans Artif Intell 2020; 1:258-270. [PMID: 35784006 PMCID: PMC8545030 DOI: 10.1109/tai.2021.3062771] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/03/2020] [Revised: 12/31/2020] [Accepted: 02/24/2021] [Indexed: 11/16/2022]
Abstract
Artificial intelligence (AI) and machine learning (ML) have caused a paradigm shift in healthcare that can be used for decision support and forecasting by exploring medical data. Recent studies have shown that AI and ML can be used to fight COVID-19. The objective of this article is to summarize the recent AI- and ML-based studies that have addressed the pandemic. From an initial set of 634 articles, a total of 49 articles were finally selected through an inclusion-exclusion process. In this article, we have explored the objectives of the existing studies (i.e., the role of AI/ML in fighting the COVID-19 pandemic); the context of the studies (i.e., whether it was focused on a specific country-context or with a global perspective; the type and volume of the dataset; and the methodology, algorithms, and techniques adopted in the prediction or diagnosis processes). We have mapped the algorithms and techniques with the data type by highlighting their prediction/classification accuracy. From our analysis, we categorized the objectives of the studies into four groups: disease detection, epidemic forecasting, sustainable development, and disease diagnosis. We observed that most of these studies used deep learning algorithms on image-data, more specifically on chest X-rays and CT scans. We have identified six future research opportunities that we have summarized in this paper. Impact Statement: Artificial intelligence (AI) and machine learning(ML) methods have been widely used to assist in the fight against COVID-19 pandemic. A very few in-depth literature reviews have been conducted to synthesize the knowledge and identify future research agenda including a previously published review on data science for COVID-19 in this article. In this article, we synthesized reviewed recent literature that focuses on the usages and applications of AI and ML to fight against COVID-19. We have identified seven future research directions that would guide researchers to conduct future research. The most significant of these are: develop new treatment options, explore the contextual effect and variation in research outcomes, support the health care workforce, and explore the effect and variation in research outcomes based on different types of data.
Collapse
Affiliation(s)
- Muhammad Nazrul Islam
- Department of Computer Science, and EngineeringMilitary Institute of Science and TechnologyDhaka1216Bangladesh
| | - Toki Tahmid Inan
- Department of Computer ScienceGeorge Mason UniversityFairfaxVA22031USA
| | - Suzzana Rafi
- Department of Computer Science and EngineeringBangladesh University of Engineering and TechnologyDhaka1205Bangladesh
| | | | - Iqbal H. Sarker
- Department of Computer Science and EngineeringChittagong University of Engineering and TechnologyChittagong4349Bangladesh
| | - A. K. M. Najmul Islam
- LUT School of Engineering ScienceLUT UniversityLahti15210Finland
- Department of ComputingUniversity of Turku20500TurkuFinland
| |
Collapse
|
193
|
Kieu STH, Bade A, Hijazi MHA, Kolivand H. A Survey of Deep Learning for Lung Disease Detection on Medical Images: State-of-the-Art, Taxonomy, Issues and Future Directions. J Imaging 2020; 6:131. [PMID: 34460528 DOI: 10.3390/jimaging6120131] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2020] [Revised: 11/25/2020] [Accepted: 11/25/2020] [Indexed: 12/24/2022] Open
Abstract
The recent developments of deep learning support the identification and classification of lung diseases in medical images. Hence, numerous work on the detection of lung disease using deep learning can be found in the literature. This paper presents a survey of deep learning for lung disease detection in medical images. There has only been one survey paper published in the last five years regarding deep learning directed at lung diseases detection. However, their survey is lacking in the presentation of taxonomy and analysis of the trend of recent work. The objectives of this paper are to present a taxonomy of the state-of-the-art deep learning based lung disease detection systems, visualise the trends of recent work on the domain and identify the remaining issues and potential future directions in this domain. Ninety-eight articles published from 2016 to 2020 were considered in this survey. The taxonomy consists of seven attributes that are common in the surveyed articles: image types, features, data augmentation, types of deep learning algorithms, transfer learning, the ensemble of classifiers and types of lung diseases. The presented taxonomy could be used by other researchers to plan their research contributions and activities. The potential future direction suggested could further improve the efficiency and increase the number of deep learning aided lung disease detection applications.
Collapse
|
194
|
Taha BA, Al Mashhadany Y, Hafiz Mokhtar MH, Dzulkefly Bin Zan MS, Arsad N. An Analysis Review of Detection Coronavirus Disease 2019 (COVID-19) Based on Biosensor Application. Sensors (Basel) 2020; 20:E6764. [PMID: 33256085 PMCID: PMC7729752 DOI: 10.3390/s20236764] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/02/2020] [Revised: 11/17/2020] [Accepted: 11/21/2020] [Indexed: 02/06/2023]
Abstract
Timely detection and diagnosis are essentially needed to guide outbreak measures and infection control. It is vital to improve healthcare quality in public places, markets, schools and airports and provide useful insights into the technological environment and help researchers acknowledge the choices and gaps available in this field. In this narrative review, the detection of coronavirus disease 2019 (COVID-19) technologies is summarized and discussed with a comparison between them from several aspects to arrive at an accurate decision on the feasibility of applying the best of these techniques in the biosensors that operate using laser detection technology. The collection of data in this analysis was done by using six reliable academic databases, namely, Science Direct, IEEE Xplore, Scopus, Web of Science, Google Scholar and PubMed. This review includes an analysis review of three highlights: evaluating the hazard of pandemic COVID-19 transmission styles and comparing them with Severe Acute Respiratory Syndrome (SARS) and Middle East Respiratory Syndrome (MERS) to identify the main causes of the virus spreading, a critical analysis to diagnose coronavirus disease 2019 (COVID-19) based on artificial intelligence using CT scans and CXR images and types of biosensors. Finally, we select the best methods that can potentially stop the propagation of the coronavirus pandemic.
Collapse
Affiliation(s)
- Bakr Ahmed Taha
- UKM—Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia, Bangi 43600, Malaysia; (B.A.T.); (M.H.H.M.); (M.S.D.B.Z.)
| | - Yousif Al Mashhadany
- Department of Electrical Engineering, College of Engineering, University of Anbar, Anbar 00964, Iraq;
| | - Mohd Hadri Hafiz Mokhtar
- UKM—Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia, Bangi 43600, Malaysia; (B.A.T.); (M.H.H.M.); (M.S.D.B.Z.)
| | - Mohd Saiful Dzulkefly Bin Zan
- UKM—Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia, Bangi 43600, Malaysia; (B.A.T.); (M.H.H.M.); (M.S.D.B.Z.)
| | - Norhana Arsad
- UKM—Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia, Bangi 43600, Malaysia; (B.A.T.); (M.H.H.M.); (M.S.D.B.Z.)
| |
Collapse
|
195
|
Al-Bawi A, Al-Kaabi K, Jeryo M, Al-Fatlawi A. CCBlock: an effective use of deep learning for automatic diagnosis of COVID-19 using X-ray images. ACTA ACUST UNITED AC 2020. [PMCID: PMC7648896 DOI: 10.1007/s42600-020-00110-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Propose Troubling countries one after another, the COVID-19 pandemic has dramatically affected the health and well-being of the world’s population. The disease may continue to persist more extensively due to the increasing number of new cases daily, the rapid spread of the virus, and delay in the PCR analysis results. Therefore, it is necessary to consider developing assistive methods for detecting and diagnosing the COVID-19 to eradicate the spread of the novel coronavirus among people. Based on convolutional neural networks (CNNs), automated detection systems have shown promising results of diagnosing patients with the COVID-19 through radiography; thus, they are introduced as a workable solution to the COVID-19 diagnosis. Materials and methods Based on the enhancement of the classical visual geometry group (VGG) network with the convolutional COVID block (CCBlock), an efficient screening model was proposed in this study to diagnose and distinguish patients with the COVID-19 from those with pneumonia and the healthy people through radiography. The model testing dataset included 1828 X-ray images available on public platforms. Three hundred and ten images were showing confirmed COVID-19 cases, 864 images indicating pneumonia cases, and 654 images showing healthy people. Results According to the test results, enhancing the classical VGG network with radiography provided the highest diagnosis performance and overall accuracy of 98.52% for two classes as well as accuracy of 95.34% for three classes. Conclusions According to the results, using the enhanced VGG deep neural network can help radiologists automatically diagnose the COVID-19 through radiography.
Collapse
|
196
|
El-bana S, Al-Kabbany A, Sharkas M. A multi-task pipeline with specialized streams for classification and segmentation of infection manifestations in COVID-19 scans. PeerJ Comput Sci 2020; 6:e303. [PMID: 33816954 PMCID: PMC7924532 DOI: 10.7717/peerj-cs.303] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2020] [Accepted: 09/26/2020] [Indexed: 05/02/2023]
Abstract
We are concerned with the challenge of coronavirus disease (COVID-19) detection in chest X-ray and Computed Tomography (CT) scans, and the classification and segmentation of related infection manifestations. Even though it is arguably not an established diagnostic tool, using machine learning-based analysis of COVID-19 medical scans has shown the potential to provide a preliminary digital second opinion. This can help in managing the current pandemic, and thus has been attracting significant research attention. In this research, we propose a multi-task pipeline that takes advantage of the growing advances in deep neural network models. In the first stage, we fine-tuned an Inception-v3 deep model for COVID-19 recognition using multi-modal learning, that is, using X-ray and CT scans. In addition to outperforming other deep models on the same task in the recent literature, with an attained accuracy of 99.4%, we also present comparative analysis for multi-modal learning against learning from X-ray scans alone. The second and the third stages of the proposed pipeline complement one another in dealing with different types of infection manifestations. The former features a convolutional neural network architecture for recognizing three types of manifestations, while the latter transfers learning from another knowledge domain, namely, pulmonary nodule segmentation in CT scans, to produce binary masks for segmenting the regions corresponding to these manifestations. Our proposed pipeline also features specialized streams in which multiple deep models are trained separately to segment specific types of infection manifestations, and we show the significant impact that this framework has on various performance metrics. We evaluate the proposed models on widely adopted datasets, and we demonstrate an increase of approximately 2.5% and 4.5% for dice coefficient and mean intersection-over-union (mIoU), respectively, while achieving 60% reduction in computational time, compared to the recent literature.
Collapse
Affiliation(s)
- Shimaa El-bana
- Alexandria Higher Institute of Engineering and Technology, Alexandria, Egypt
| | - Ahmad Al-Kabbany
- Intelligent Systems Lab, Arab Academy for Science, Technology, and Maritime Transport, Alexandria, Egypt
- Department of Research and Development, VRapeutic, Cairo, Egypt
- Department of Electronics and Communications Engineering, Arab Academy for Science, Technology, and Maritime Transport, Alexandria, Egypt
| | - Maha Sharkas
- Department of Electronics and Communications Engineering, Arab Academy for Science, Technology, and Maritime Transport, Alexandria, Egypt
| |
Collapse
|
197
|
Jain G, Mittal D, Thakur D, Mittal MK. A deep learning approach to detect Covid-19 coronavirus with X-Ray images. Biocybern Biomed Eng 2020; 40:1391-1405. [PMID: 32921862 PMCID: PMC7476608 DOI: 10.1016/j.bbe.2020.08.008] [Citation(s) in RCA: 99] [Impact Index Per Article: 24.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2020] [Revised: 08/26/2020] [Accepted: 08/30/2020] [Indexed: 01/20/2023]
Abstract
Rapid and accurate detection of COVID-19 coronavirus is necessity of time to prevent and control of this pandemic by timely quarantine and medical treatment in absence of any vaccine. Daily increase in cases of COVID-19 patients worldwide and limited number of available detection kits pose difficulty in identifying the presence of disease. Therefore, at this point of time, necessity arises to look for other alternatives. Among already existing, widely available and low-cost resources, X-ray is frequently used imaging modality and on the other hand, deep learning techniques have achieved state-of-the-art performances in computer-aided medical diagnosis. Therefore, an alternative diagnostic tool to detect COVID-19 cases utilizing available resources and advanced deep learning techniques is proposed in this work. The proposed method is implemented in four phases, viz., data augmentation, preprocessing, stage-I and stage-II deep network model designing. This study is performed with online available resources of 1215 images and further strengthen by utilizing data augmentation techniques to provide better generalization of the model and to prevent the model overfitting by increasing the overall length of dataset to 1832 images. Deep network implementation in two stages is designed to differentiate COVID-19 induced pneumonia from healthy cases, bacterial and other virus induced pneumonia on X-ray images of chest. Comprehensive evaluations have been performed to demonstrate the effectiveness of the proposed method with both (i) training-validation-testing and (ii) 5-fold cross validation procedures. High classification accuracy as 97.77%, recall as 97.14% and precision as 97.14% in case of COVID-19 detection shows the efficacy of proposed method in present need of time. Further, the deep network architecture showing averaged accuracy/sensitivity/specificity/precision/F1-score of 98.93/98.93/98.66/96.39/98.15 with 5-fold cross validation makes a promising outcome in COVID-19 detection using X-ray images.
Collapse
Affiliation(s)
- Govardhan Jain
- Department of Electrical Engineering, Medical Engineering and Computer Science (EMI), Hochschule Offenburg, Offenburg, Germany
| | - Deepti Mittal
- Department of Electrical and Instrumentation Engineering, Thapar Institute of Engineering & Technology, Patiala, Punjab, India
| | - Daksh Thakur
- Department of Electrical Engineering, Medical Engineering and Computer Science (EMI), Hochschule Offenburg, Offenburg, Germany
| | - Madhup K Mittal
- Department of Mechanical Engineering, Thapar Institute of Engineering & Technology, Patiala, Punjab, India
| |
Collapse
|
198
|
Xu Z, Guo X, Zhu A, He X, Zhao X, Han Y, Subedi R. Using Deep Convolutional Neural Networks for Image-Based Diagnosis of Nutrient Deficiencies in Rice. Comput Intell Neurosci 2020; 2020:7307252. [PMID: 32952543 DOI: 10.1155/2020/7307252] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Revised: 07/23/2020] [Accepted: 08/01/2020] [Indexed: 11/17/2022]
Abstract
Symptoms of nutrient deficiencies in rice plants often appear on the leaves. The leaf color and shape, therefore, can be used to diagnose nutrient deficiencies in rice. Image classification is an efficient and fast approach for this diagnosis task. Deep convolutional neural networks (DCNNs) have been proven to be effective in image classification, but their use to identify nutrient deficiencies in rice has received little attention. In the present study, we explore the accuracy of different DCNNs for diagnosis of nutrient deficiencies in rice. A total of 1818 photographs of plant leaves were obtained via hydroponic experiments to cover full nutrition and 10 classes of nutrient deficiencies. The photographs were divided into training, validation, and test sets in a 3 : 1 : 1 ratio. Fine-tuning was performed to evaluate four state-of-the-art DCNNs: Inception-v3, ResNet with 50 layers, NasNet-Large, and DenseNet with 121 layers. All the DCNNs obtained validation and test accuracies of over 90%, with DenseNet121 performing best (validation accuracy = 98.62 ± 0.57%; test accuracy = 97.44 ± 0.57%). The performance of the DCNNs was validated by comparison to color feature with support vector machine and histogram of oriented gradient with support vector machine. This study demonstrates that DCNNs provide an effective approach to diagnose nutrient deficiencies in rice.
Collapse
|
199
|
El-rashidy N, El-sappagh S, Islam SMR, El-bakry HM, Abdelrazek S. End-To-End Deep Learning Framework for Coronavirus (COVID-19) Detection and Monitoring. Electronics 2020; 9:1439. [DOI: 10.3390/electronics9091439] [Citation(s) in RCA: 42] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
Coronavirus (COVID-19) is a new virus of viral pneumonia. It can outbreak in the world through person-to-person transmission. Although several medical companies provide cooperative monitoring healthcare systems, these solutions lack offering of the end-to-end management of the disease. The main objective of the proposed framework is to bridge the current gap between current technologies and healthcare systems. The wireless body area network, cloud computing, fog computing, and clinical decision support system are integrated to provide a comprehensive and complete model for disease detection and monitoring. By monitoring a person with COVID-19 in real time, physicians can guide patients with the right decisions. The proposed framework has three main layers (i.e., a patient layer, cloud layer, and hospital layer). In the patient layer, the patient is tracked through a set of wearable sensors and a mobile app. In the cloud layer, a fog network architecture is proposed to solve the issues of storage and data transmission. In the hospital layer, we propose a convolutional neural network-based deep learning model for COVID-19 detection based on patient’s X-ray scan images and transfer learning. The proposed model achieved promising results compared to the state-of-the art (i.e., accuracy of 97.95% and specificity of 98.85%). Our framework is a useful application, through which we expect significant effects on COVID-19 proliferation and considerable lowering in healthcare expenses.
Collapse
|
200
|
Abstract
Plant stress is one of major issues that cause significant economic loss for growers. The labor-intensive conventional methods for identifying the stressed plants constrain their applications. To address this issue, rapid methods are in urgent needs. Developments of advanced sensing and machine learning techniques trigger revolutions for precision agriculture based on deep learning and big data. In this paper, we reviewed the latest deep learning approaches pertinent to the image analysis of crop stress diagnosis. We compiled the current sensor tools and deep learning principles involved in plant stress phenotyping. In addition, we reviewed a variety of deep learning applications/functions with plant stress imaging, including classification, object detection, and segmentation, of which are closely intertwined. Furthermore, we summarized and discussed the current challenges and future development avenues in plant phenotyping.
Collapse
|